A decision support tool to determine cost-to-benefit of a family-centered in-home program for at-risk adolescents.

PubMed

Wilson, Fernando A; Araz, Ozgur M; Thompson, Ronald W; Ringle, Jay L; Mason, W Alex; Stimpson, Jim P

2016-06-01

Family-centered program research has demonstrated its effectiveness in improving adolescent outcomes. However, given current fiscal constraints faced by governmental agencies, a recent report from the Institute of Medicine and National Research Council highlighted the need for cost-benefit analyses to inform decision making by policymakers. Furthermore, performance management tools such as balanced scorecards and dashboards do not generally include cost-benefit analyses. In this paper, we describe the development of an Excel-based decision support tool that can be used to evaluate a selected family-based program for at-risk children and adolescents relative to a comparison program or the status quo. This tool incorporates the use of an efficient, user-friendly interface with results provided in concise tabular and graphical formats that may be interpreted without need for substantial training in economic evaluation. To illustrate, we present an application of this tool to evaluate use of Boys Town's In-Home Family Services (IHFS) relative to detention and out-of-home placement in New York City. Use of the decision support tool can help mitigate the need for programs to contract experts in economic evaluation, especially when there are financial or time constraints. Copyright © 2016 Elsevier Ltd. All rights reserved.

Test Review for Preschool-Wide Evaluation Tool (PreSET) Manual: Assessing Universal Program-Wide Positive Behavior Support in Early Childhood

ERIC Educational Resources Information Center

Rodriguez, Billie Jo

2013-01-01

The Preschool-Wide Evaluation Tool (PreSET; Steed & Pomerleau, 2012) is published by Paul H. Brookes Publishing Company in Baltimore, MD. The PreSET purports to measure universal and program-wide features of early childhood programs' implementation fidelity of program-wide positive behavior intervention and support (PW-PBIS) and is,…

Common Evaluation Tools across Multi-State Programs: A Study of Parenting Education and Youth Engagement Programs in Children, Youth, and Families At-Risk

ERIC Educational Resources Information Center

Payne, Pamela B.; McDonald, Daniel A.

2015-01-01

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

Introduction of the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Costing Tool: a user-friendly spreadsheet program to estimate costs of providing patient-centered interventions.

PubMed

Reed, Shelby D; Li, Yanhong; Kamble, Shital; Polsky, Daniel; Graham, Felicia L; Bowers, Margaret T; Samsa, Gregory P; Paul, Sara; Schulman, Kevin A; Whellan, David J; Riegel, Barbara J

2012-01-01

Patient-centered health care interventions, such as heart failure disease management programs, are under increasing pressure to demonstrate good value. Variability in costing methods and assumptions in economic evaluations of such interventions limit the comparability of cost estimates across studies. Valid cost estimation is critical to conducting economic evaluations and for program budgeting and reimbursement negotiations. Using sound economic principles, we developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Costing Tool, a spreadsheet program that can be used by researchers and health care managers to systematically generate cost estimates for economic evaluations and to inform budgetary decisions. The tool guides users on data collection and cost assignment for associated personnel, facilities, equipment, supplies, patient incentives, miscellaneous items, and start-up activities. The tool generates estimates of total program costs, cost per patient, and cost per week and presents results using both standardized and customized unit costs for side-by-side comparisons. Results from pilot testing indicated that the tool was well-formatted, easy to use, and followed a logical order. Cost estimates of a 12-week exercise training program in patients with heart failure were generated with the costing tool and were found to be consistent with estimates published in a recent study. The TEAM-HF Costing Tool could prove to be a valuable resource for researchers and health care managers to generate comprehensive cost estimates of patient-centered interventions in heart failure or other conditions for conducting high-quality economic evaluations and making well-informed health care management decisions.

Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Management of an affiliated Physics Residency Program using a commercial software tool.

PubMed

Zacarias, Albert S; Mills, Michael D

2010-06-01

A review of commercially available allied health educational management software tools was performed to evaluate their capacity to manage program data associated with a CAMPEP-accredited Therapy Physics Residency Program. Features of these software tools include: a) didactic course reporting and organization, b) competency reporting by topic, category and didactic course, c) student time management and accounting, and d) student patient case reporting by topic, category and course. The software package includes features for recording school administrative information; setting up lists of courses, faculty, clinical sites, categories, competencies, and time logs; and the inclusion of standardized external documents. There are provisions for developing evaluation and survey instruments. The mentors and program may be evaluated by residents, and residents may be evaluated by faculty members using this feature. Competency documentation includes the time spent on the problem or with the patient, time spent with the mentor, date of the competency, and approval by the mentor and program director. Course documentation includes course and lecture title, lecturer, topic information, date of lecture and approval by the Program Director. These software tools have the facility to include multiple clinical sites, with local subadministrators having the ability to approve competencies and attendance at clinical conferences. In total, these software tools have the capability of managing all components of a CAMPEP-accredited residency program. The application database lends the software to the support of multiple affiliated clinical sites within a single residency program. Such tools are a critical and necessary component if the medical physics profession is to meet the projected needs for qualified medical physicists in future years.

A call for change: clinical evaluation of student registered nurse anesthetists.

PubMed

Collins, Shawn; Callahan, Margaret Faut

2014-02-01

The ability to integrate theory with practice is integral to a student's success. A common reason for attrition from a nurse anesthesia program is clinical issues. To document clinical competence, students are evaluated using various tools. For use of a clinical evaluation tool as possible evidence for a student's dismissal, an important psychometric property to ensure is instrument validity. Clinical evaluation instruments of nurse anesthesia programs are not standardized among programs, which suggests a lack of instrument validity. The lack of established validity of the instruments used to evaluate students' clinical progress brings into question their ability to detect a student who is truly in jeopardy of attrition. Given this possibility, clinical instrument validity warrants research to be fair to students and improve attrition rates based on valid data. This ex post facto study evaluated a 17-item clinical instrument tool to demonstrate the need for validity of clinical evaluation tools. It also compared clinical scores with scores on the National Certification Examination.

Programming Tools: Status, Evaluation, and Comparison

NASA Technical Reports Server (NTRS)

Cheng, Doreen Y.; Cooper, D. M. (Technical Monitor)

1994-01-01

In this tutorial I will first describe the characteristics of scientific applications and their developers, and describe the computing environment in a typical high-performance computing center. I will define the user requirements for tools that support application portability and present the difficulties to satisfy them. These form the basis of the evaluation and comparison of the tools. I will then describe the tools available in the market and the tools available in the public domain. Specifically, I will describe the tools for converting sequential programs, tools for developing portable new programs, tools for debugging and performance tuning, tools for partitioning and mapping, and tools for managing network of resources. I will introduce the main goals and approaches of the tools, and show main features of a few tools in each category. Meanwhile, I will compare tool usability for real-world application development and compare their different technological approaches. Finally, I will indicate the future directions of the tools in each category.

Introduction of the TEAM-HF Costing Tool: A User-Friendly Spreadsheet Program to Estimate Costs of Providing Patient-Centered Interventions

PubMed Central

Reed, Shelby D.; Li, Yanhong; Kamble, Shital; Polsky, Daniel; Graham, Felicia L.; Bowers, Margaret T.; Samsa, Gregory P.; Paul, Sara; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara J.

2011-01-01

Background Patient-centered health care interventions, such as heart failure disease management programs, are under increasing pressure to demonstrate good value. Variability in costing methods and assumptions in economic evaluations of such interventions limit the comparability of cost estimates across studies. Valid cost estimation is critical to conducting economic evaluations and for program budgeting and reimbursement negotiations. Methods and Results Using sound economic principles, we developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Costing Tool, a spreadsheet program that can be used by researchers or health care managers to systematically generate cost estimates for economic evaluations and to inform budgetary decisions. The tool guides users on data collection and cost assignment for associated personnel, facilities, equipment, supplies, patient incentives, miscellaneous items, and start-up activities. The tool generates estimates of total program costs, cost per patient, and cost per week and presents results using both standardized and customized unit costs for side-by-side comparisons. Results from pilot testing indicated that the tool was well-formatted, easy to use, and followed a logical order. Cost estimates of a 12-week exercise training program in patients with heart failure were generated with the costing tool and were found to be consistent with estimates published in a recent study. Conclusions The TEAM-HF Costing Tool could prove to be a valuable resource for researchers and health care managers to generate comprehensive cost estimates of patient-centered interventions in heart failure or other conditions for conducting high-quality economic evaluations and making well-informed health care management decisions. PMID:22147884

EDCATS: An Evaluation Tool

NASA Technical Reports Server (NTRS)

Heard, Pamala D.

1998-01-01

The purpose of this research is to explore the development of Marshall Space Flight Center Unique Programs. These academic tools provide the Education Program Office with important information from the Education Computer Aided Tracking System (EDCATS). This system is equipped to provide on-line data entry, evaluation, analysis, and report generation, with full archiving for all phases of the evaluation process. Another purpose is to develop reports and data that is tailored to Marshall Space Flight Center Unique Programs. It also attempts to acquire knowledge on how, why, and where information is derived. As a result, a user will be better prepared to decide which available tool is the most feasible for their reports.

Tools for Formative Evaluation: Gathering the Information Necessary for Program Improvement

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2016-01-01

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Clinical Trial Assessment of Infrastructure Matrix Tool to Improve the Quality of Research Conduct in the Community.

PubMed

Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S; Dimond, Eileen P; Zon, Robin T; Weiner, Bryan J; St Germain, Diane; Denicoff, Andrea M; Dempsey, Kandie; Carrigan, Angela C; Teal, Randall W; Good, Marjorie J; McCaskill-Stevens, Worta; Grubbs, Stephen S

2016-01-01

Several publications have described minimum standards and exemplary attributes for clinical trial sites to improve research quality. The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) developed the clinical trial Best Practice Matrix tool to facilitate research program improvements through annual self-assessments and benchmarking. The tool identified nine attributes, each with three progressive levels, to score clinical trial infrastructural elements from less to more exemplary. The NCCCP sites correlated tool use with research program improvements, and the NCI pursued a formative evaluation to refine the interpretability and measurability of the tool. From 2011 to 2013, 21 NCCCP sites self-assessed their programs with the tool annually. During 2013 to 2014, NCI collaborators conducted a five-step formative evaluation of the matrix tool. Sites reported significant increases in level-three scores across the original nine attributes combined (P<.001). Two specific attributes exhibited significant change: clinical trial portfolio diversity and management (P=.0228) and clinical trial communication (P=.0281). The formative evaluation led to revisions, including renaming the Best Practice Matrix as the Clinical Trial Assessment of Infrastructure Matrix (CT AIM), expanding infrastructural attributes from nine to 11, clarifying metrics, and developing a new scoring tool. Broad community input, cognitive interviews, and pilot testing improved the usability and functionality of the tool. Research programs are encouraged to use the CT AIM to assess and improve site infrastructure. Experience within the NCCCP suggests that the CT AIM is useful for improving quality, benchmarking research performance, reporting progress, and communicating program needs with institutional leaders. The tool model may also be useful in disciplines beyond oncology.

Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

Title V Delinquency Prevention Program. Community Self-Evaluation Workbook.

ERIC Educational Resources Information Center

Caliber Associates, Fairfax, VA.

This workbook is designed to help communities and program administrators assess the success of their Title V delinquency prevention programs, but it may serve as an evaluation tool for other prevention efforts as well. It provides information and resource aids on program planning, conducting evaluations, tracking programs, describing activities,…

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

A New Internet Tool for Automatic Evaluation in Control Systems and Programming

ERIC Educational Resources Information Center

Munoz de la Pena, D.; Gomez-Estern, F.; Dormido, S.

2012-01-01

In this paper we present a web-based innovative education tool designed for automating the collection, evaluation and error detection in practical exercises assigned to computer programming and control engineering students. By using a student/instructor code-fusion architecture, the conceptual limits of multiple-choice tests are overcome by far.…

OPTIMAL WELL LOCATOR (OWL): A SCREENING TOOL FOR EVALUATING LOCATIONS OF MONITORING WELLS

EPA Science Inventory

The Optimal Well Locator ( OWL) program was designed and developed by USEPA to be a screening tool to evaluate and optimize the placement of wells in long term monitoring networks at small sites. The first objective of the OWL program is to allow the user to visualize the change ...

Agent-based modeling as a tool for program design and evaluation.

PubMed

Lawlor, Jennifer A; McGirr, Sara

2017-12-01

Recently, systems thinking and systems science approaches have gained popularity in the field of evaluation; however, there has been relatively little exploration of how evaluators could use quantitative tools to assist in the implementation of systems approaches therein. The purpose of this paper is to explore potential uses of one such quantitative tool, agent-based modeling, in evaluation practice. To this end, we define agent-based modeling and offer potential uses for it in typical evaluation activities, including: engaging stakeholders, selecting an intervention, modeling program theory, setting performance targets, and interpreting evaluation results. We provide demonstrative examples from published agent-based modeling efforts both inside and outside the field of evaluation for each of the evaluative activities discussed. We further describe potential pitfalls of this tool and offer cautions for evaluators who may chose to implement it in their practice. Finally, the article concludes with a discussion of the future of agent-based modeling in evaluation practice and a call for more formal exploration of this tool as well as other approaches to simulation modeling in the field. Copyright © 2017 Elsevier Ltd. All rights reserved.

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

ERIC Educational Resources Information Center

Hawkins, J. David; Nederhood, Britt

This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

Experimental and analytical tools for evaluation of Stirling engine rod seal behavior

NASA Technical Reports Server (NTRS)

Krauter, A. I.; Cheng, H. S.

1979-01-01

The first year of a two year experimental and analytical program is reported. The program is directed at the elastohydrodynamic behavior of sliding elastomeric rod seals for the Stirling engine. During the year, experimental and analytical tools were developed for evaluating seal leakage, seal friction, and the fluid film thickness at the seal/cylinder interface.

OPTIMAL WELL LOCATOR (OWL): A SCREENING TOOL FOR EVALUATING LOCATIONS OF MONITORING WELLS: USER'S GUIDE VERSION 1.2

EPA Science Inventory

The Optimal Well Locator ( OWL) program was designed and developed by USEPA to be a screening tool to evaluate and optimize the placement of wells in long term monitoring networks at small sites. The first objective of the OWL program is to allow the user to visualize the change ...

Learnings From the Pilot Implementation of Mobile Medical Milestones Application.

PubMed

Page, Cristen P; Reid, Alfred; Coe, Catherine L; Carlough, Martha; Rosenbaum, Daryl; Beste, Janalynn; Fagan, Blake; Steinbacher, Erika; Jones, Geoffrey; Newton, Warren P

2016-10-01

Implementation of the educational milestones benefits from mobile technology that facilitates ready assessments in the clinical environment. We developed a point-of-care resident evaluation tool, the Mobile Medical Milestones Application (M3App), and piloted it in 8 North Carolina family medicine residency programs. We sought to examine variations we found in the use of the tool across programs and explored the experiences of program directors, faculty, and residents to better understand the perceived benefits and challenges of implementing the new tool. Residents and faculty completed presurveys and postsurveys about the tool and the evaluation process in their program. Program directors were interviewed individually. Interviews and open-ended survey responses were analyzed and coded using the constant comparative method, and responses were tabulated under themes. Common perceptions included increased data collection, enhanced efficiency, and increased perceived quality of the information gathered with the M3App. Residents appreciated the timely, high-quality feedback they received. Faculty reported becoming more comfortable with the tool over time, and a more favorable evaluation of the tool was associated with higher utilization. Program directors reported improvements in faculty knowledge of the milestones and resident satisfaction with feedback. Faculty and residents credited the M3App with improving the quality and efficiency of resident feedback. Residents appreciated the frequency, proximity, and specificity of feedback, and faculty reported the app improved their familiarity with the milestones. Implementation challenges included lack of a physician champion and competing demands on faculty time.

Appendix W. Cost Analysis in Teacher Education Programs.

ERIC Educational Resources Information Center

Sell, G. Roger; And Others

This paper is an introduction to the basic cost-related tools available to management for planning, evaluating, and organizing resources for the purpose of achieving objectives within a teacher education preparation program. Three tools are presented in separate sections. Part I on the cost accounting tool for identifying, categorizing, and…

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2012 CFR

2012-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2011 CFR

2011-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2013 CFR

2013-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2014 CFR

2014-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

The Practice Profile: An All Purpose Tool for Program Communication, Staff Development, Evaluation and Improvement.

ERIC Educational Resources Information Center

Loucks, Susan F.; Crandall, David P.

The practice profile is a standardized, systematic, cost-effective tool for summarizing the components and requirements of a program in a manner that permits comparison with other programs or selection of discrete components from various programs. It provides a component checklist, a precise list of implementation requirements, and a system for…

Critical Measurement Issues in Translational Research

ERIC Educational Resources Information Center

Glasgow, Russell E.

2009-01-01

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Clarus multi-state regional demonstrations, evaluation of use case #4 : multi-state control strategy tool.

DOT National Transportation Integrated Search

2011-06-10

This report provides the results of an independent evaluation of the Clarus Use Case #4 Multi-State Control Strategy Tool (MSCST). This tool, developed for the Road Weather Management Program of the Federal Highway Administration by a private contrac...

[eLearning-radiology.com--sustainability for quality assurance].

PubMed

Ketelsen, D; Talanow, R; Uder, M; Grunewald, M

2009-04-01

The aim of the study was to analyze the availability of published radiological e-learning tools and to establish a solution for quality assurance. Substantial pubmed research was performed to identify radiological e-learning tools. 181 e-learning programs were selected. As examples two databases expanding their programs with external links, Compare (n = 435 external links) and TNT-Radiology (n = 1078 external links), were evaluated. A concept for quality assurance was developed by an international taskforce. At the time of assessment, 56.4 % (102 / 181) of the investigated e-learning tools were accessible at their original URL. A subgroup analysis of programs published 5 to 8 years ago showed significantly inferior availability to programs published 3 to 5 years ago (p < 0.01). The analysis of external links showed 49.2 % and 61.0 % accessible links for the programs Compare (published 2003) and TNT-Radiology (published 2006), respectively. As a consequence, the domain www.eLearning-radiology.com was developed by the taskforce and published online. This tool allows authors to present their programs and users to evaluate the e-learning tools depending on several criteria in order to remove inoperable links and to obtain information about the complexity and quality of the e-learning tools. More than 50 % of investigated radiological e-learning tools on the Internet were not accessible after a period of 5 to 8 years. As a consequence, an independent, international tool for quality assurance was designed and published online under www.eLearning-radiology.com .

Practical Application of Aspiration as an Outcome Indicator in Extension Evaluation

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2010-01-01

Extension educators need simple and accurate evaluation tools for program evaluation. This article explains how to use aspiration as an outcome indicator in Extension evaluation and introduces a practical evaluation tool. Aspiration can be described as the readiness for change. By recording participants' levels of aspiration, we will be able to…

Cost analysis of objective resident cataract surgery assessments.

PubMed

Nandigam, Kiran; Soh, Jonathan; Gensheimer, William G; Ghazi, Ahmed; Khalifa, Yousuf M

2015-05-01

To compare 8 ophthalmology resident surgical training tools to determine which is most cost effective. University of Rochester Medical Center, Rochester, New York, USA. Retrospective evaluation of technology. A cost-analysis model was created to compile all relevant costs in running each tool in a medium-sized ophthalmology program. Quantitative cost estimates were obtained based on cost of tools, cost of time in evaluations, and supply and maintenance costs. For wet laboratory simulation, Eyesi was the least expensive cataract surgery simulation method; however, it is only capable of evaluating simulated cataract surgery rehearsal and requires supplementation with other evaluative methods for operating room performance and for noncataract wet lab training and evaluation. The most expensive training tool was the Eye Surgical Skills Assessment Test (ESSAT). The 2 most affordable methods for resident evaluation in operating room performance were the Objective Assessment of Skills in Intraocular Surgery (OASIS) and Global Rating Assessment of Skills in Intraocular Surgery (GRASIS). Cost-based analysis of ophthalmology resident surgical training tools are needed so residency programs can implement tools that are valid, reliable, objective, and cost effective. There is no perfect training system at this time. Copyright © 2015 ASCRS and ESCRS. Published by Elsevier Inc. All rights reserved.

Surgeons' attitude toward a competency-based training and assessment program: results of a multicenter survey.

PubMed

Hopmans, Cornelis J; den Hoed, Pieter T; Wallenburg, Iris; van der Laan, Lijkckle; van der Harst, Erwin; van der Elst, Maarten; Mannaerts, Guido H H; Dawson, Imro; van Lanschot, Jan J B; Ijzermans, Jan N M

2013-01-01

Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents' competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. In 2011, all residents (n = 51) and attending surgeons (n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach's α, and the Mann-Whitney test was applied to assess differences between groups. The response rate was 88% (n = 140). The CanMEDS framework demonstrated good reliability (Cronbach's α = 0.87). However, the importance of the competencies 'Manager' (78%) and 'Health Advocate' (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach's α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools 'in-training evaluation report' (91%) and 'objective structured assessment of technical skill' (82%). No significant differences were found between the residents and the attending surgeons. This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large training region in the Netherlands do not acknowledge the importance of all CanMEDS competencies and consider the assessment tools generally unsuitable for competence evaluation. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Evaluation of Supplemental Nutrition Assistance Program Education: Application of Behavioral Theory and Survey Validation

ERIC Educational Resources Information Center

Wyker, Brett A.; Jordan, Patricia; Quigley, Danielle L.

2012-01-01

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

Using System Dynamics as an Evaluation Tool: Experience from a Demonstration Program

ERIC Educational Resources Information Center

Fredericks, Kimberly A.; Deegan, Michael; Carman, Joanne G.

2008-01-01

Evaluators are often faced with many challenges in the design and implementation of a program's evaluation. Because programs are entangled in complex networks of structures and stakeholders, they can be challenging to understand, and they often pose issues of competing and conflicting goals. However, by using a systems mapping approach to…

Analyzing for Individual Differences in Evaluating Compensatory Education Programs. Occasional Paper No. 27.

ERIC Educational Resources Information Center

Krus, Patricia H.

Trait-Treatment Interaction (TTI), a research method for observing experimental effects of treatments on subjects of different aptitudes and learning characteristics, is suggested as an effective evaluation tool to provide evaluators and educators in compensatory education programs with information about which program is best for different kinds…

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

MRM Evaluation Research Program

NASA Technical Reports Server (NTRS)

Taylor, James C.

1998-01-01

This is an interim report on the current output of the MRM evaluation research program. During 1998 this research program has used new and existing data to create an important tool for the development and improvement of "maintenance resource management" (MRM). Thousands of surveys completed by participants in airline MRM training and/or behavior change programs have, for the first time, been consolidated into a panel of "MRM Attitudes and Opinion Profiles." These profiles can be used to compare the attitudes about decision making and communication in any given company at any stage in its MRM program with attitudes of a large sample of like employees during a similar period in their MRM involvement. This panel of comparison profiles for attitudes and opinions is a tool to help audit the effectiveness of a maintenance human factors program. The profile panel is the first of several tools envisioned for applying the information accumulating in MRM databases produced as one of the program's long range objectives.

UpStart Parent Survey-Prenatal: A New Tool for Evaluating Prenatal Education Programs.

PubMed

Benzies, Karen M; Barker, Leslie; Churchill, Jocelyn; Smith, Jennifer; Horn, Sarah

2016-09-01

To evaluate a new prenatal education program evaluation tool, the UpStart Parent Survey - Prenatal, in terms of: (a) reliability and validity; (b) sensitivity to change over time; (c) whether results differed for mothers versus fathers; and (d) whether results differed when using an electronic tablet-computer versus a paper survey. Psychometric study. Participants were 277 expectant mothers (n = 161) and fathers (n = 106) enrolled in Childbirth Essentials, a 6-week prenatal education program. The UpStart Parent Survey - Prenatal is a retrospective pretest/posttest survey with three scales: Parenting Knowledge, Parenting Experience, and Program Satisfaction, and three open-ended questions. The UpStart Parent Survey - Prenatal is sensitive to change and demonstrated significant positive differences in parenting knowledge and parenting experience. There was no difference in results whether the survey was completed by mothers or fathers. Results were similar whether paper or electronic formats were used. The survey was easy to complete. The UpStart Parent Survey - Prenatal holds promise as a reliable and valid evaluation tool to capture outcomes of brief prenatal education programs that target the general population of expectant parents. © 2016 Wiley Periodicals, Inc.

Measuring Security Effectiveness and Efficiency at U.S. Commercial Airports

DTIC Science & Technology

2013-03-01

formative program evaluation and policy analysis to investigate current airport security programs. It identifies innovative public administration and...policy-analysis tools that could provide potential benefits to airport security . These tools will complement the System Based Risk Management framework if

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

PubMed

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

BlueJ Visual Debugger for Learning the Execution of Object-Oriented Programs?

ERIC Educational Resources Information Center

Bennedsen, Jens; Schulte, Carsten

2010-01-01

This article reports on an experiment undertaken in order to evaluate the effect of a program visualization tool for helping students to better understand the dynamics of object-oriented programs. The concrete tool used was BlueJ's debugger and object inspector. The study was done as a control-group experiment in an introductory programming…

[The Italian instrument evaluating the nursing students clinical learning quality].

PubMed

Palese, Alvisa; Grassetti, Luca; Mansutti, Irene; Destrebecq, Anne; Terzoni, Stefano; Altini, Pietro; Bevilacqua, Anita; Brugnolli, Anna; Benaglio, Carla; Dal Ponte, Adriana; De Biasio, Laura; Dimonte, Valerio; Gambacorti, Benedetta; Fasci, Adriana; Grosso, Silvia; Mantovan, Franco; Marognolli, Oliva; Montalti, Sandra; Nicotera, Raffaela; Randon, Giulia; Stampfl, Brigitte; Tollini, Morena; Canzan, Federica; Saiani, Luisa; Zannini, Lucia

2017-01-01

. The Clinical Learning Quality Evaluation Index for nursing students. The Italian nursing programs, the need to introduce tools evaluating the quality of the clinical learning as perceived by nursing students. Several tools already exist, however, several limitations suggesting the need to develop a new tool. A national project aimed at developing and validating a new instrument capable of measuring the clinical learning quality as experience by nursing students. A validation study design was undertaken from 2015 to 2016. All nursing national programs (n=43) were invited to participate by including all nursing students attending regularly their clinical learning. The tool developed based upon a) literature, b) validated tools already established among other healthcare professionals, and c) consensus expressed by experts and nursing students, was administered to the eligible students. 9606 nursing in 27 universities (62.8%) participated. The psychometric properties of the new instrument ranged from good to excellent. According to the findings, the tool consists in 22 items and five factors: a) quality of the tutorial strategies, b) learning opportunities; c) safety and nursing care quality; d) self-direct learning; e) quality of the learning environment. The tool is already used. Its systematic adoption may support comparison among settings and across different programs; moreover, the tool may also support in accrediting new settings as well as in measuring the effects of strategies aimed at improving the quality of the clinical learning.

Evaluating International Research Ethics Capacity Development: An Empirical Approach

PubMed Central

Ali, Joseph; Kass, Nancy E.; Sewankambo, Nelson K.; White, Tara D.; Hyder, Adnan A.

2014-01-01

The US National Institutes of health, Fogarty International Center (NIH-FIC) has, for the past 13 years, been a leading funder of international research ethics education for resource-limited settings. Nearly half of the NIH-FIC funding in this area has gone to training programs that train individuals from sub-Saharan Africa. Identifying the impact of training investments, as well as the potential predictors of post-training success, can support curricular decision-making, help establish funding priorities, and recognize the ultimate outcomes of trainees and training programs. Comprehensive evaluation frameworks and targeted evaluation tools for bioethics training programs generally, and for international research ethics programs in particular, are largely absent from published literature. This paper shares an original conceptual framework, data collection tool, and detailed methods for evaluating the inputs, processes, outputs, and outcomes of research ethics training programs serving individuals in resource-limited settings. This paper is part of a collection of papers analyzing the Fogarty International Center’s International Research Ethics Education and Curriculum Development program. PMID:24782071

ePORT, NASA's Computer Database Program for System Safety Risk Management Oversight (Electronic Project Online Risk Tool)

NASA Technical Reports Server (NTRS)

Johnson, Paul W.

2008-01-01

ePORT (electronic Project Online Risk Tool) provides a systematic approach to using an electronic database program to manage a program/project risk management processes. This presentation will briefly cover the standard risk management procedures, then thoroughly cover NASA's Risk Management tool called ePORT. This electronic Project Online Risk Tool (ePORT) is a web-based risk management program that provides a common framework to capture and manage risks, independent of a programs/projects size and budget. It is used to thoroughly cover the risk management paradigm providing standardized evaluation criterion for common management reporting, ePORT improves Product Line, Center and Corporate Management insight, simplifies program/project manager reporting, and maintains an archive of data for historical reference.

An Overview of Evaluative Instrumentation for Virtual High Schools

ERIC Educational Resources Information Center

Black, Erik W.; Ferdig, Richard E.; DiPietro, Meredith

2008-01-01

With an increasing prevalence of virtual high school programs in the United States, a better understanding of evaluative tools available for distance educators and administrators is needed. These evaluative tools would provide opportunities for assessment and a determination of success within virtual schools. This article seeks to provide an…

Evaluation of School Environmental Programs Regarding the Objectives for the Environmentally Literate Students, of Heraklion, Greece Prefecture

ERIC Educational Resources Information Center

Kalathak, Maria

2015-01-01

This evaluation research concerns the aims and objectives for creating the future environmentally literate citizen through the environmental programs (PEEs) of Secondary Education of Heraklion prefecture, Crete, Greece. An evaluation tool applied on the application forms and the final reports of the programs, in order to asses how sustainable they…

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

PubMed

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

How to Recognize Success and Failure: Practical Assessment of an Evolving, First-Semester Laboratory Program Using Simple, Outcome-Based Tools

ERIC Educational Resources Information Center

Gron, Liz U.; Bradley, Shelly B.; McKenzie, Jennifer R.; Shinn, Sara E.; Teague, M. Warfield

2013-01-01

This paper presents the use of simple, outcome-based assessment tools to design and evaluate the first semester of a new introductory laboratory program created to teach green analytical chemistry using environmental samples. This general chemistry laboratory program, like many introductory courses, has a wide array of stakeholders within and…

The iEvaluate OSD Guidelines and Exemplars: A Disability Services Evaluation Tool

ERIC Educational Resources Information Center

Dukes, Lyman, III

2011-01-01

Program evaluation is rapidly becoming the norm in higher education and this includes disability services. Postsecondary institutions increasingly encourage disability service programs to demonstrate accountability specified through appropriate benchmarks. However, professionals in disability service offices typically report that while they…

SUNREL Related Links | Buildings | NREL

Science.gov Websites

SUNREL Related Links SUNREL Related Links DOE Simulation Software Tools Directory a directory of 301 building software tools for evaluation of energy efficiency, renewable energy, and sustainability in buildings. TREAT Software Program a computer program that uses SUNREL and is designed to provide

Evaluation tools for undergraduate program planning in times of financial austerity.

PubMed

O'Palka, J; Harris, P R

1990-05-01

This article describes the administration and outcome of two evaluation tools developed by faculty of the dietetic program for ongoing assessment of a Plan IV dietetic education program over a 4-year period. Interns and internship directors were asked to evaluate the level of skills and knowledge base of interns compared with their internship classmates. Interns were also asked to rate the effectiveness of undergraduate course assignments and activities for internship preparation. As a result of the surveys, the home economics core course work was deleted, credits were shifted from food science to nutrient metabolism courses, and credits in clinical nutrition were increased. Projects in clinical nutrition and food systems management were modified. The surveys justified program requirements and utilization of resources, and provided an additional, effective measure of faculty competence.

Critical Evaluations and Instructional Potential of Authoring and Titled Program Software.

ERIC Educational Resources Information Center

Reppert, James E.

This paper describes and evaluates the instructional uses of the Claris Works and Ultimedia Tools Series authoring programs and the following titled software programs: CNN Time Capsule: 100 Defining Moments of 1993; Windows Magazine: 1994; Ultimate Digital Studio; Data Trek Manager Series; and Cinemania '95. (AEF)

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Building Evaluation Capacity in Local Programs for Multisite Nutrition Education Interventions

ERIC Educational Resources Information Center

Fourney, Andrew; Gregson, Jennifer; Sugerman, Sharon; Bellow, Andrew

2011-01-01

From 2004-2008, capacity to conduct program evaluation was built among the "Network for a Healthy California's" 48 largest local partners. Capacity building was done within a framework of Empowerment Evaluation and Utility-Focused evaluation. Tools included: a Scope of Work template, a handbook, a compendium of surveys, an evaluation…

Multi-criteria development and incorporation into decision tools for health technology adoption.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Waddell, Cameron D; Dixon, Elijah; Poulin, Michelle; Lafrenière, René

2013-01-01

When introducing new health technologies, decision makers must integrate research evidence with local operational management information to guide decisions about whether and under what conditions the technology will be used. Multi-criteria decision analysis can support the adoption or prioritization of health interventions by using criteria to explicitly articulate the health organization's needs, limitations, and values in addition to evaluating evidence for safety and effectiveness. This paper seeks to describe the development of a framework to create agreed-upon criteria and decision tools to enhance a pre-existing local health technology assessment (HTA) decision support program. The authors compiled a list of published criteria from the literature, consulted with experts to refine the criteria list, and used a modified Delphi process with a group of key stakeholders to review, modify, and validate each criterion. In a workshop setting, the criteria were used to create decision tools. A set of user-validated criteria for new health technology evaluation and adoption was developed and integrated into the local HTA decision support program. Technology evaluation and decision guideline tools were created using these criteria to ensure that the decision process is systematic, consistent, and transparent. This framework can be used by others to develop decision-making criteria and tools to enhance similar technology adoption programs. The development of clear, user-validated criteria for evaluating new technologies adds a critical element to improve decision-making on technology adoption, and the decision tools ensure consistency, transparency, and real-world relevance.

A Cost Analysis Model for Army Sponsored Graduate Dental Education Programs.

DTIC Science & Technology

1997-04-01

characteristics of a good measurement tool ? Cooper and Emory in their textbook, Business Research Methods, state there are three major criteria for evaluating...a measurement tool : validity, reliability, and practicality (Cooper and Emory 1995). Validity can be compartmentalized into internal and external...tremendous expense? The AEGD-1 year program is used extensively as a recruiting tool to encourage senior dental students to join the Army Dental Corps. The

Using the RE-AIM framework to evaluate physical activity public health programs in Mexico

USDA-ARS?s Scientific Manuscript database

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizationa...

The Development and Implementation of the Kennedy Space Center Umbilical Clearance Tool

NASA Technical Reports Server (NTRS)

Chesnutt, David

2016-01-01

In preparation for NASAs upcoming Space Launch System program, the Kennedy Space Center is currently developing subsystems to provide fuel, purges and communications to the flight vehicle, known as umbilicals. It is vital to the crew and mission that these umbilicals release at T-0 without re-contacting the vehicle as it is accelerating from the launch pad. To help ensure this requirement is met by the program, a methodology of evaluating the moving bodies was developed and implemented into a tool using MATLAB. The tool, known as the KSC Umbilical Clearance Tool, takes a given elevation of interest and an umbilical retract profile within the plane to evaluate the clearance between the umbilical arm and thousands of independent flight vehicle drift profiles from a Monte Carlo analysis. The presentation will delve into the challenges associated with developing and implementing the tool framed in the context of evaluating the clearance for one of the SLS umbilicals.

A practical assessment of physician biopsychosocial performance.

PubMed

Margalit, Alon Pa; Glick, Shimon M; Benbassat, Jochanan; Cohen, Ayala; Margolis, Carmi Z

2007-10-01

A biopsychosocial approach to care seems to improve patient satisfaction and health outcomes. Nevertheless, this approach is not widely practiced, possibly because its precepts have not been translated into observable skills. To identify the skill components of a biopsychosocial consultation and develop an tool for their evaluation. We approached three e-mail discussion groups of family physicians and pooled their responses to the question "what types of observed physician behavior would characterize a biopsychosocial consultation?" We received 35 responses describing 37 types of behavior, all of which seemed to cluster around one of three aspects: patient-centered interview; system-centered and family-centered approach to care; or problem-solving orientation. Using these categories, we developed a nine-item evaluation tool. We used the evaluation tool to score videotaped encounters of patients with two types of doctors: family physicians who were identified by peer ratings to have a highly biopsychosocial orientation (n = 9) or a highly biomedical approach (n = 4); and 44 general practitioners, before and after they had participated in a program that taught a biopsychosocial approach to care. The evaluation tool was found to demonstrate high reliability (alpha = 0.90) and acceptable interobserver variability. The average scores of the physicians with a highly biopsychosocial orientation were significantly higher than those of physicians with a highly biomedical approach. There were significant differences between the scores of the teaching-program participants before and after the program. A biopsychosocial approach to patient care can be characterized using a valid and easy-to-apply evaluation tool.

Validation and Use of a Predictive Modeling Tool: Employing Scientific Findings to Improve Responsible Conduct of Research Education.

PubMed

Mulhearn, Tyler J; Watts, Logan L; Todd, E Michelle; Medeiros, Kelsey E; Connelly, Shane; Mumford, Michael D

2017-01-01

Although recent evidence suggests ethics education can be effective, the nature of specific training programs, and their effectiveness, varies considerably. Building on a recent path modeling effort, the present study developed and validated a predictive modeling tool for responsible conduct of research education. The predictive modeling tool allows users to enter ratings in relation to a given ethics training program and receive instantaneous evaluative information for course refinement. Validation work suggests the tool's predicted outcomes correlate strongly (r = 0.46) with objective course outcomes. Implications for training program development and refinement are discussed.

Evolution of a multilevel framework for health program evaluation.

PubMed

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

[EEQ in clinical embryology: a starting program].

PubMed

Boyer, Pierre; Brugnon, Florence; Levy, Rachel; Pfeffer, Jérôme; Siest, Jean-Pascal

2014-01-01

Every laboratory including those working in assisted reproductive technologies have to be accredited EN ISO 15189 before 2020. This standardisation includes an external quality evaluation (EQE). In order to work out an EQE tool, we used images extracted from our own database developed during daily practice. We achieved an easily online tool called: "EEQ en embryologie clinique", developed on Biologie prospective web site with ART French biologists Association (Blefco) expertise in evaluation of early human embryonic stages. In 2013, 38 ART laboratories participate to the first program with more than 90% of appropriates results. The present article aims at describing this tool and discussing its limits.

Program Evaluation Resources

EPA Pesticide Factsheets

These resources list tools to help you conduct evaluations, find organizations outside of EPA that are useful to evaluators, and find additional guides on how to do evaluations from organizations outside of EPA.

SimulCAT: Windows Software for Simulating Computerized Adaptive Test Administration

ERIC Educational Resources Information Center

Han, Kyung T.

2012-01-01

Most, if not all, computerized adaptive testing (CAT) programs use simulation techniques to develop and evaluate CAT program administration and operations, but such simulation tools are rarely available to the public. Up to now, several software tools have been available to conduct CAT simulations for research purposes; however, these existing…

Development and Evaluation of LEGUME ID: A ToolBook Multimedia Module.

ERIC Educational Resources Information Center

Hannaway, David B.; And Others

1992-01-01

Describes the development and advantages of LEGUME ID, a multimedia module for agricultural education. LEGUME ID is an example of how teachers, given the opportunity through accessible computer software programs, can create powerful teaching tools. Summarized is a student response to the use of this teacher-produced software program. (MCO)

"SimChemistry" as an Active Learning Tool in Chemical Education

ERIC Educational Resources Information Center

Bolton, Kim; Saalman, Elisabeth; Christie, Michael; Ingerman, Ake; Linder, Cedric

2008-01-01

The publicly available free computer program, "SimChemistry," was used as an active learning tool in the chemical engineering curriculum at the University College of Boras, Sweden. The activity involved students writing their own simulation programs on topics in the area of molecular structure and interactions. Evaluation of the learning…

Software Tools: A One-Semester Secondary School Computer Course.

ERIC Educational Resources Information Center

Bromley, John; Lakatos, John

1985-01-01

Provides a course outline, describes equipment and teacher requirements, discusses student evaluation and course outcomes, and details the computer programs used in a high school course. The course is designed to teach students use of the microcomputer as a tool through hands-on experience with a variety of commercial software programs. (MBR)

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Bearing tester data compilation, analysis, and reporting and bearing math modeling

NASA Technical Reports Server (NTRS)

1983-01-01

The Shaberth bearing analysis computer program was developed for the analysis of jet engine shaft/bearing systems operating above room temperature with normal hydrocarbon lubricants. It is also possible to use this tool to evaluate the shaft bearing systems operating in cryogenics. Effects such as fluid drag, radial temperature gradients, outer race misalignments and clearance changes were simulated and evaluated. In addition, the speed and preload effects on bearing radial stiffness was evaluated. The Shaberth program was also used to provide contact stresses from which contact geometry was calculated to support other analyses such as the determination of cryogenic fluid film thickness in the contacts and evaluation of surface and subsurface stresses necessary for bearing failure evaluation. This program was a vital tool for the thermal analysis of the bearing in that it provides the heat generation rates at the rolling element/race contacts for input into a thermal model of the bearing/shaft assembly.

Instrumentation, performance visualization, and debugging tools for multiprocessors

NASA Technical Reports Server (NTRS)

Yan, Jerry C.; Fineman, Charles E.; Hontalas, Philip J.

1991-01-01

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessor architectures. However, without effective means to monitor (and visualize) program execution, debugging, and tuning parallel programs becomes intractably difficult as program complexity increases with the number of processors. Research on performance evaluation tools for multiprocessors is being carried out at ARC. Besides investigating new techniques for instrumenting, monitoring, and presenting the state of parallel program execution in a coherent and user-friendly manner, prototypes of software tools are being incorporated into the run-time environments of various hardware testbeds to evaluate their impact on user productivity. Our current tool set, the Ames Instrumentation Systems (AIMS), incorporates features from various software systems developed in academia and industry. The execution of FORTRAN programs on the Intel iPSC/860 can be automatically instrumented and monitored. Performance data collected in this manner can be displayed graphically on workstations supporting X-Windows. We have successfully compared various parallel algorithms for computational fluid dynamics (CFD) applications in collaboration with scientists from the Numerical Aerodynamic Simulation Systems Division. By performing these comparisons, we show that performance monitors and debuggers such as AIMS are practical and can illuminate the complex dynamics that occur within parallel programs.

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

Program Model Checking: A Practitioner's Guide

NASA Technical Reports Server (NTRS)

Pressburger, Thomas T.; Mansouri-Samani, Masoud; Mehlitz, Peter C.; Pasareanu, Corina S.; Markosian, Lawrence Z.; Penix, John J.; Brat, Guillaume P.; Visser, Willem C.

2008-01-01

Program model checking is a verification technology that uses state-space exploration to evaluate large numbers of potential program executions. Program model checking provides improved coverage over testing by systematically evaluating all possible test inputs and all possible interleavings of threads in a multithreaded system. Model-checking algorithms use several classes of optimizations to reduce the time and memory requirements for analysis, as well as heuristics for meaningful analysis of partial areas of the state space Our goal in this guidebook is to assemble, distill, and demonstrate emerging best practices for applying program model checking. We offer it as a starting point and introduction for those who want to apply model checking to software verification and validation. The guidebook will not discuss any specific tool in great detail, but we provide references for specific tools.

Evaluating the Impact of Cooperative Extension Outreach via Twitter

ERIC Educational Resources Information Center

O'Neill, Barbara

2014-01-01

Twitter is increasingly being used by Extension educators as a teaching and program-marketing tool. It is not enough, however, to simply use Twitter to disseminate information. Steps must be taken to evaluate program impact with quantitative and qualitative data. This article described the following Twitter evaluation metrics: unique hashtags,…

Evaluation of Training Programs in Russian Manufacturing Companies

ERIC Educational Resources Information Center

Kucherov, Dmitry; Manokhina, Daria

2017-01-01

Purpose: This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels…

Independent Living Evaluation-Training Program. Reprint Series No. 16.

ERIC Educational Resources Information Center

Van Soest, Eileen; And Others

Intended to be used both as a guide for general program direction and as an individual evaluation and training tool this rehabilitation training guide includes materials and evaluation devices for use with mentally and/or physically handicapped clients on basic, intermediate and advanced living center levels. The eight independent living skill…

Stepping Stones to Evaluating Your Own School Literacy Program

ERIC Educational Resources Information Center

Levesque, Jeri; Carnahan, Danielle

2005-01-01

Stepping Stones to Literacy is a tool for elementary school improvement teams to evaluate and strengthen their reading programs. Each Stepping Stone is a guided activity to stimulate reflection and guide systematic inquiry. It is a collaborative, active research approach to evaluation (Levesque & Hinton 2001). The goal is to eliminate the gap…

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

PubMed

Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

2015-01-01

Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of verification and testing tools for FORTRAN programs

NASA Technical Reports Server (NTRS)

Smith, K. A.

1980-01-01

Two automated software verification and testing systems were developed for use in the analysis of computer programs. An evaluation of the static analyzer DAVE and the dynamic analyzer PET, which are used in the analysis of FORTRAN programs on Control Data (CDC) computers, are described. Both systems were found to be effective and complementary, and are recommended for use in testing FORTRAN programs.

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Using Maps in Web Analytics to Evaluate the Impact of Web-Based Extension Programs

ERIC Educational Resources Information Center

Veregin, Howard

2015-01-01

Maps can be a valuable addition to the Web analytics toolbox for Extension programs that use the Web to disseminate information. Extension professionals use Web analytics tools to evaluate program impacts. Maps add a unique perspective through visualization and analysis of geographic patterns and their relationships to other variables. Maps can…

Cost Effectiveness Ratio: Evaluation Tool for Comparing the Effectiveness of Similar Extension Programs

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2015-01-01

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

THE IMPACT OF STATE LEVEL BROWNFIELDS PROGRAM PUBLIC PARTICIPATION MECHANISMS ON DISADVANTAGED COMMUNITY INVOLVEMENT IN DECISION-MAKING: A CASE COMPARISON

EPA Science Inventory

A recent EPA survey of state-level brownfields programs shows great variability among states in use of public participation tools such as public record and notice, public comment, hearing, meeting and citizen group grants. This study seeks to evaluate the impact of these tools o...

Measuring Outcomes in Children's Services.

ERIC Educational Resources Information Center

Christner, Anne Marshall, Ed.

Outcomes evaluation can provide program managers and clinical directors in child welfare, juvenile justice, child mental health, and child protective services the necessary tools for program quality assurance and accountability. This guide describes the outcomes evaluation process and provides a summary of articles and reports detailing current…

Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Evidence Tool

PubMed Central

Albert, Dayna; Fortin, Rebecca; Herrera, Christine; Hanning, Rhona; Lessio, Anne; Rush, Brian

2013-01-01

In public health and chronic disease prevention there is increasing priority for effective use of evidence in practice. In Ontario, Canada, despite various models being advanced, public health practitioners are seeking ways to identify and apply evidence in their work in practical and meaningful ways. In a companion article, “Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Assessment Tool,” we describe use of a tool to assess and strengthen program planning and implementation processes using 19 criteria derived from best and promising practices literature. In this article, we describe use of a complementary Program Evidence Tool to identify, synthesize, and apply a range of evidence sources to strengthen the content of chronic disease prevention programming. The Program Evidence Tool adapts tools of evidence-based medicine to the unique contexts of community-based health promotion and chronic disease prevention. Knowledge management tools and a guided dialogue process known as an Evidence Forum enable community stakeholders to make appropriate use of evidence in diverse social, political, and structural contexts. Practical guidelines and worksheets direct users through 5 steps: 1) define an evidence question, 2) develop a search strategy, 3) collect and synthesize evidence, 4) interpret and adapt evidence, and 5) implement and evaluate. We describe the Program Evidence Tool’s benefits, strengths, challenges, and what was learned from its application in 4 Ontario public health departments. The Program Evidence Tool contributes to the development and understanding of the complex use of evidence in community-based chronic disease prevention. PMID:23721788

Use of a structured template to facilitate practice-based learning and improvement projects.

PubMed

McClain, Elizabeth K; Babbott, Stewart F; Tsue, Terance T; Girod, Douglas A; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-06-01

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008-2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level.

Use of a Structured Template to Facilitate Practice-Based Learning and Improvement Projects

PubMed Central

McClain, Elizabeth K.; Babbott, Stewart F.; Tsue, Terance T.; Girod, Douglas A.; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-01-01

Background The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. Purpose We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. Methods We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008–2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. Results An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. Discussion The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level. PMID:23730444

Dynamic visualization techniques for high consequence software

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pollock, G.M.

1998-02-01

This report documents a prototype tool developed to investigate the use of visualization and virtual reality technologies for improving software surety confidence. The tool is utilized within the execution phase of the software life cycle. It provides a capability to monitor an executing program against prespecified requirements constraints provided in a program written in the requirements specification language SAGE. The resulting Software Attribute Visual Analysis Tool (SAVAnT) also provides a technique to assess the completeness of a software specification. The prototype tool is described along with the requirements constraint language after a brief literature review is presented. Examples of howmore » the tool can be used are also presented. In conclusion, the most significant advantage of this tool is to provide a first step in evaluating specification completeness, and to provide a more productive method for program comprehension and debugging. The expected payoff is increased software surety confidence, increased program comprehension, and reduced development and debugging time.« less

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

PubMed

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

PubMed Central

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Pediatric faculty and residents’ perspectives on In-Training Evaluation Reports (ITERs)

PubMed Central

Patel, Rikin; Drover, Anne; Chafe, Roger

2015-01-01

Background In-training evaluation reports (ITERs) are used by over 90% of postgraduate medical training programs in Canada for resident assessment. Our study examined the perspectives of faculty and residents in one pediatric program as a means to improve the ITER as an evaluation tool. Method Two separate focus groups were conducted, one with eight pediatric residents and one with nine clinical faculty within the pediatrics program of Memorial University’s Faculty of Medicine to discuss their perceptions of, and suggestions for improving, the use of ITERs. Results Residents and faculty shared many similar suggestions for improving the ITER as an evaluation tool. Both the faculty and residents emphasized the importance of written feedback, contextualizing the evaluation and timely follow-up. The biggest challenge appears to be the discrepancy in the quality of feedback sought by the residents and the faculty members’ ability to do so in a time effective manner. Others concerns related to the need for better engagement in setting rotation objectives and more direct observation by the faculty member completing the ITER. Conclusions The ITER is a useful tool in resident evaluations, but a number of issues relating to its actual use could improve the quality of feedback which residents receive. PMID:27004076

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Evaluation of Federal Social Programs: An Uncertain Impact. Occasional Paper 1992-2.

ERIC Educational Resources Information Center

Levitan, Sar A.

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

The Effects of a Statewide Evaluation Initiative in Gifted Education on Practitioner Knowledge, Concerns, and Program Documentation

ERIC Educational Resources Information Center

Robinson, Ann; Cotabish, Alicia; Wood, Betty K.; O'Tuel, Fran S.

2014-01-01

When well-considered and grounded in current knowledge, program evaluations of services to gifted learners can be a powerful tool for increasing practitioners' knowledge and self-efficacy, and for effecting positive programmatic changes. The Arkansas Evaluation Initiative (AEI) in Gifted Education, a Jacob K. Javits-funded project, was implemented…

An Incentive Program for Nurse Aides Implementation Report: Description and Evaluation. Illinois Long Term Care Research and Demonstration Projects Series. Final Report.

ERIC Educational Resources Information Center

Sinke, Mary

This study examined a nursing aide recognition program in a nursing home with 50 nurses and 200 nurse aides. Before the program was implemented, baseline data on job satisfaction were gathered with a questionnaire. A one-page description of the program and an evaluation tool were distributed to the nurse aides at their information sessions. Nurse…

Development of EUV mask handling technology at MIRAI-Selete

NASA Astrophysics Data System (ADS)

Ota, Kazuya; Amemiya, Mitsuaki; Taguchi, Takao; Kamono, Takashi; Kubo, Hiroyoshi; Takikawa, Tadahiko; Usui, Yoichi; Suga, Osamu

2007-03-01

We, MIRAI-Selete, started a new EUV mask program in April, 2006. Development of EUV mask handling technology is one of the key areas of the program. We plan to develop mask handling technology and to evaluate EUV mask carriers using Lasertec M3350, a particle inspection tool with the defect sensitivity less than 50nm PSL, and Mask Protection Engineering Tool (named "MPE Tool"). M3350 is a newly developed tool based on a conventional M1350 for EUV blanks inspection. Since our M3350 has a blank flipping mechanism in it, we can inspect the front and the back surface of the blank automatically. We plan to use the M3350 for evaluating particle adders during mask shipping, storage and handling. MPE Tool is a special tool exclusively developed for demonstration of pellicleless mask handling. It can handle a mask within a protective enclosure, which Canon and Nikon have been jointly proposing1, and also, can be modified to handle other type of carrier as the need arises.

Evaluation of Visual Computer Simulator for Computer Architecture Education

ERIC Educational Resources Information Center

Imai, Yoshiro; Imai, Masatoshi; Moritoh, Yoshio

2013-01-01

This paper presents trial evaluation of a visual computer simulator in 2009-2011, which has been developed to play some roles of both instruction facility and learning tool simultaneously. And it illustrates an example of Computer Architecture education for University students and usage of e-Learning tool for Assembly Programming in order to…

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

ERIC Educational Resources Information Center

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Evaluation of Arabic Language Learning Program for Non-Native Speakers in Saudi Electronic University According to Total Quality Standards

ERIC Educational Resources Information Center

Alowaydhi, Wafa Hafez

2016-01-01

The current study aimed at standardizing the program of learning Arabic for non-native speakers in Saudi Electronic University according to certain standards of total quality. To achieve its purpose, the study adopted the descriptive analytical method. The author prepared a measurement tool for evaluating the electronic learning programs in light…

What Works for Whom? A Bayesian Approach to Channeling Big Data Streams for Public Program Evaluation

ERIC Educational Resources Information Center

Finucane, Mariel McKenzie; Martinez, Ignacio; Cody, Scott

2018-01-01

In the coming years, public programs will capture even more and richer data than they do now, including data from web-based tools used by participants in employment services, from tablet-based educational curricula, and from electronic health records for Medicaid beneficiaries. Program evaluators seeking to take full advantage of these data…

DensToolKit: A comprehensive open-source package for analyzing the electron density and its derivative scalar and vector fields

NASA Astrophysics Data System (ADS)

Solano-Altamirano, J. M.; Hernández-Pérez, Julio M.

2015-11-01

DensToolKit is a suite of cross-platform, optionally parallelized, programs for analyzing the molecular electron density (ρ) and several fields derived from it. Scalar and vector fields, such as the gradient of the electron density (∇ρ), electron localization function (ELF) and its gradient, localized orbital locator (LOL), region of slow electrons (RoSE), reduced density gradient, localized electrons detector (LED), information entropy, molecular electrostatic potential, kinetic energy densities K and G, among others, can be evaluated on zero, one, two, and three dimensional grids. The suite includes a program for searching critical points and bond paths of the electron density, under the framework of Quantum Theory of Atoms in Molecules. DensToolKit also evaluates the momentum space electron density on spatial grids, and the reduced density matrix of order one along lines joining two arbitrary atoms of a molecule. The source code is distributed under the GNU-GPLv3 license, and we release the code with the intent of establishing an open-source collaborative project. The style of DensToolKit's code follows some of the guidelines of an object-oriented program. This allows us to supply the user with a simple manner for easily implement new scalar or vector fields, provided they are derived from any of the fields already implemented in the code. In this paper, we present some of the most salient features of the programs contained in the suite, some examples of how to run them, and the mathematical definitions of the implemented fields along with hints of how we optimized their evaluation. We benchmarked our suite against both a freely-available program and a commercial package. Speed-ups of ˜2×, and up to 12× were obtained using a non-parallel compilation of DensToolKit for the evaluation of fields. DensToolKit takes similar times for finding critical points, compared to a commercial package. Finally, we present some perspectives for the future development and growth of the suite.

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, C.; Illing, S.; Kunst, O.; Cubasch, U.

2014-12-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: guest password: miklip

A Hybrid Evaluation System Framework (Shell & Web) with Standardized Access to Climate Model Data and Verification Tools for a Clear Climate Science Infrastructure on Big Data High Performance Computers

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Kunst, Oliver; Ulbrich, Uwe; Cubasch, Ulrich

2015-04-01

The project 'Integrated Data and Evaluation System for Decadal Scale Prediction' (INTEGRATION) as part of the German decadal prediction project MiKlip develops a central evaluation system. The fully operational hybrid features a HPC shell access and an user friendly web-interface. It employs one common system with a variety of verification tools and validation data from different projects in- and outside of MiKlip. The evaluation system is located at the German Climate Computing Centre (DKRZ) and has direct access to the bulk of its ESGF node including millions of climate model data sets, e.g. from CMIP5 and CORDEX. The database is organized by the international CMOR standard using the meta information of the self-describing model, reanalysis and observational data sets. Apache Solr is used for indexing the different data projects into one common search environment. This implemented meta data system with its advanced but easy to handle search tool supports users, developers and their tools to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitating the provision and usage of tools and climate data increases automatically the number of scientists working with the data sets and identify discrepancies. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a MySQL database. Configurations and results of the tools can be shared among scientists via shell or web-system. Therefore, plugged-in tools gain automatically from transparency and reproducibility. Furthermore, when configurations match while starting a evaluation tool, the system suggests to use results already produced by other users-saving CPU time, I/O and disk space. This study presents the different techniques and advantages of such a hybrid evaluation system making use of a Big Data HPC in climate science. website: www-miklip.dkrz.de visitor-login: click on "Guest"

COMMUNITY-BASED WATERSHED MANAGEMENT: CREATING A TOOL FOR PROGRAM EVALUATION AND DESIGN

EPA Science Inventory

The criteria will be assembled into a manual to be used by community organizers, academics, managers, or policy makers in evaluating community-based watershed management initiatives and in designing new watershed management programs. The case study will also be added to the b...

Computer-Assisted Learning in Elementary Reading: A Randomized Control Trial

ERIC Educational Resources Information Center

Shannon, Lisa Cassidy; Styers, Mary Koenig; Wilkerson, Stephanie Baird; Peery, Elizabeth

2015-01-01

This study evaluated the efficacy of Accelerated Reader, a computer-based learning program, at improving student reading. Accelerated Reader is a progress-monitoring, assessment, and practice tool that supports classroom instruction and guides independent reading. Researchers used a randomized controlled trial to evaluate the program with 344…

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

PubMed

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.

High-tech tools for exercise motivation: use and role of technologies such as the internet, mobile applications, social media, and video games.

PubMed

Tate, Deborah F; Lyons, Elizabeth J; Valle, Carmina G

2015-01-01

IN BRIEF The majority of patients with type 2 diabetes are not active at recommended levels, and many do not have access to behavior change programs to support lifestyle change. Thus, tools and programs designed to promote the adoption and maintenance of physical activity using technology may be helpful. This article reviews the evidence regarding the use of technology tools such as the Internet, mobile applications, social media, and video games and provides suggestions for evaluating the potential benefit of such tools for behavior change.

High-Tech Tools for Exercise Motivation: Use and Role of Technologies Such as the Internet, Mobile Applications, Social Media, and Video Games

PubMed Central

Lyons, Elizabeth J.; Valle, Carmina G.

2015-01-01

IN BRIEF The majority of patients with type 2 diabetes are not active at recommended levels, and many do not have access to behavior change programs to support lifestyle change. Thus, tools and programs designed to promote the adoption and maintenance of physical activity using technology may be helpful. This article reviews the evidence regarding the use of technology tools such as the Internet, mobile applications, social media, and video games and provides suggestions for evaluating the potential benefit of such tools for behavior change. PMID:25717278

Improving health aid for a better planet: The planning, monitoring and evaluation tool (PLANET).

PubMed

Sridhar, Devi; Car, Josip; Chopra, Mickey; Campbell, Harry; Woods, Ngaire; Rudan, Igor

2015-12-01

International development assistance for health (DAH) quadrupled between 1990 and 2012, from US$ 5.6 billion to US$ 28.1 billion. This generates an increasing need for transparent and replicable tools that could be used to set investment priorities, monitor the distribution of funding in real time, and evaluate the impact of those investments. In this paper we present a methodology that addresses these three challenges. We call this approach PLANET, which stands for planning, monitoring and evaluation tool. Fundamentally, PLANET is based on crowdsourcing approach to obtaining information relevant to deployment of large-scale programs. Information is contributed in real time by a diverse group of participants involved in the program delivery. PLANET relies on real-time information from three levels of participants in large-scale programs: funders, managers and recipients. At each level, information is solicited to assess five key risks that are most relevant to each level of operations. The risks at the level of funders involve systematic neglect of certain areas, focus on donor's interests over that of program recipients, ineffective co-ordination between donors, questionable mechanisms of delivery and excessive loss of funding to "middle men". At the level of managers, the risks are corruption, lack of capacity and/or competence, lack of information and /or communication, undue avoidance of governmental structures / preference to non-governmental organizations and exclusion of local expertise. At the level of primary recipients, the risks are corruption, parallel operations / "verticalization", misalignment with local priorities and lack of community involvement, issues with ethics, equity and/or acceptability, and low likelihood of sustainability beyond the end of the program's implementation. PLANET is intended as an additional tool available to policy-makers to prioritize, monitor and evaluate large-scale development programs. In this, it should complement tools such as LiST (for health care/interventions), EQUIST (for health care/interventions) and CHNRI (for health research), which also rely on information from local experts and on local context to set priorities in a transparent, user-friendly, replicable, quantifiable and specific, algorithmic-like manner.

Planning, Management and Evaluation: Realizing PIC Potential. Private Industry Council Guide. Working Draft.

ERIC Educational Resources Information Center

National Alliance of Business, Inc., Washington, DC.

This Planning, Management, and Evaluation (PME) guide was developed by the National Alliance of Business as part of its program of management assistance for Private Industry Councils (PICs). The guide is a tool which PICs can use to improve their capability to plan, manage, and evaluate the programs which they administer, and to establish locally…

The Definition and Measurement of Evaluation Quality as a Management Tool.

ERIC Educational Resources Information Center

Chelimsky, Eleanor

1983-01-01

Evaluation management requires a system for measuring, improving, and accounting for quality. The Institute for Program Evaluation in the United States General Accounting Office is developing such a system. (Author)

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program.

PubMed

Davis, LaShara A; Morgan, Susan E; Mobley, Amy R

2016-06-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported as memorable and the characteristics of those memorable messages. A convenience sample of low-income, primarily African American adults (N = 58) who previously completed a series of community nutrition education lessons within an urban area of Indiana participated in a focus group (N = 8 focus groups). A lead moderator using a semistructured script conducted the focus groups to determine what information about fruits and vegetables was most memorable from the participants' nutrition lessons and why this information was memorable. All focus group audiotapes were transcribed verbatim and ATLAS.ti software was used to code and identify themes within the data. Participants cited quantity, variety, and the positive nutritional impact of eating fruits and vegetables as most memorable. Information given in the form of recipes was also cited as most memorable. For example, participants referred to the recipe demonstrations as not only fun but also key components of the program that helped with message retention and memorability. Key characteristics of memorable messages included personal relevance and message vividness. These findings indicated that the Memorable Messages Framework may serve as an intermediary program evaluation tool to identify what information and messages are most influential to participants in community nutrition education programs. © 2015 Society for Public Health Education.

7 CFR 275.19 - Monitoring and evaluation.

Code of Federal Regulations, 2012 CFR

2012-01-01

... AGRICULTURE FOOD STAMP AND FOOD DISTRIBUTION PROGRAM PERFORMANCE REPORTING SYSTEM Corrective Action § 275.19... data available through program management tools and other sources. (c) In instances where the State...

7 CFR 275.19 - Monitoring and evaluation.

Code of Federal Regulations, 2011 CFR

2011-01-01

... AGRICULTURE FOOD STAMP AND FOOD DISTRIBUTION PROGRAM PERFORMANCE REPORTING SYSTEM Corrective Action § 275.19... data available through program management tools and other sources. (c) In instances where the State...

7 CFR 275.19 - Monitoring and evaluation.

Code of Federal Regulations, 2013 CFR

2013-01-01

... AGRICULTURE FOOD STAMP AND FOOD DISTRIBUTION PROGRAM PERFORMANCE REPORTING SYSTEM Corrective Action § 275.19... data available through program management tools and other sources. (c) In instances where the State...

7 CFR 275.19 - Monitoring and evaluation.

Code of Federal Regulations, 2014 CFR

2014-01-01

... AGRICULTURE FOOD STAMP AND FOOD DISTRIBUTION PROGRAM PERFORMANCE REPORTING SYSTEM Corrective Action § 275.19... data available through program management tools and other sources. (c) In instances where the State...

Development of an Evaluation Tool for Online Food Safety Training Programs

ERIC Educational Resources Information Center

Neal, Jack A., Jr.; Murphy, Cheryl A.; Crandall, Philip G.; O'Bryan, Corliss A.; Keifer, Elizabeth; Ricke, Steven C.

2011-01-01

The objective of this study was to provide the person in charge and food safety instructors an assessment tool to help characterize, identify strengths and weaknesses, determine the completeness of the knowledge gained by the employee, and evaluate the level of content presentation and usability of current retail food safety training platforms. An…

Use of an Integrated Pest Management Assessment Administered through Turningpoint as an Educational, Needs Assessment, and Evaluation Tool

ERIC Educational Resources Information Center

Stahl, Lizabeth A. B.; Behnken, Lisa M.; Breitenbach, Fritz R.; Miller, Ryan P.; Nicolai, David; Gunsolus, Jeffrey L.

2016-01-01

University of Minnesota educators use an integrated pest management (IPM) survey conducted during private pesticide applicator training as an educational, needs assessment, and evaluation tool. By incorporating the IPM Assessment, as the survey is called, into a widely attended program and using TurningPoint audience response devices, Extension…

Monkeying around: Use of Survey Monkey as a Tool for School Social Work

ERIC Educational Resources Information Center

Massat, Carol Rippey; McKay, Cassandra; Moses, Helene

2009-01-01

This article describes the use of an online survey tool called Survey Monkey, which can be used by school social workers and school social work educators for evaluation of practice, needs assessment, and program evaluation. Examples of questions are given. Principles of writing good survey questions are described. (Contains 2 tables and 1…

The School Personnel Management System. Manual 1--Tools. Manual 2--Models. Manual 3--Results.

ERIC Educational Resources Information Center

National School Boards Association, Washington, DC.

The School Personnel Management System offers a correlated set of job descriptions, evaluative instruments, policies, tools, forms, and publications intended to aid local school officials in enhancing their personnel management programs. The materials are contained in two looseleaf binders entitled "Manual 1--Tools," and "Manual…

Graduate nurses' evaluation of mentorship: Development of a new tool.

PubMed

Tiew, Lay Hwa; Koh, Catherine S L; Creedy, Debra K; Tam, W S W

2017-07-01

Develop and test an instrument to measure graduate-nurses' perceptions of a structured mentorship program. New graduate nurses may experience difficulties in the transition from student to practitioner. Mentoring is commonly used to support graduates. However, there is a lack of published tools measuring graduate nurses' perceptions of mentorship. As mentoring is resource intensive, development and testing of a validated tool are important to assist in determining program effectiveness. A pretest-posttest interventional design was used. Following a critical review of literature and content experts' input, the 10-item National University Hospital Mentorship Evaluation (NUH ME) instrument was tested with a convenience sample of 83 graduate nurses. Psychometric tests included internal reliability, stability, content validity, and factor analysis. Changed scores were evaluated using paired samples t-test. Seventy-three graduates (88%) out of a possible 83 completed the pre-and post-program survey. Internal reliability was excellent with a Cronbach's alpha of 0.92. Test-retest reliability was stable over time (ICC=0.81). Exploratory factor analysis supported a 1-factor solution explaining 58.2% of variance. Paired samples t-test showed statistical significance between the pre- and post-program scores (p<0.001). The NUH-ME measure was found to be valid and reliable. Confirmatory Factor Analysis of the tool with different groups of nursing graduates is required. Mentorship programs can be an effective recruitment and retention strategy, but are also resource intensive. Measuring new graduates' perceptions of mentoring contributes to program relevance in addressing their personal, professional and clinical skill development needs. As mentoring engages a diverse range of mentors, feedback through measurement may also positively alter organizational learning culture. Copyright © 2017. Published by Elsevier Ltd.

Evaluating Effectiveness of Pair Programming as a Teaching Tool in Programming Courses

ERIC Educational Resources Information Center

Faja, Silvana

2014-01-01

This study investigates the effectiveness of pair programming on student learning and satisfaction in introductory programming courses. Pair programming, used in the industry as a practice of an agile development method, can be adopted in classroom settings to encourage peer learning, increase students' social skills, and enhance student…

Program audit, A management tool

NASA Technical Reports Server (NTRS)

Miller, T. J.

1971-01-01

Program gives in-depth view of organizational performance at all levels of the management structure, and provides means by which managers can effectively and efficiently evaluate adequacy of management direction, policies, and procedures.

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

PubMed

Charnley, Susan; Engelbert, Bruce

2005-11-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation project assesses how effective the Superfund community involvement program is in promoting public participation in decisions about how to clean up hazardous wastes at Superfund sites. We do three things in the article: (1) share our experience with evaluating an Agency public participation program, including lessons learned about methods of evaluation; (2) report evaluation results; and (3) address a number of issues pertaining to the evaluation of public participation in environmental decision-making. Our goal is to encourage more environmental managers to incorporate evaluation into their public participation programs as a tool for improving them. We found that written mail surveys were an effective and economical tool for obtaining feedback on EPA's community involvement program at Superfund sites. The evaluation focused on four criteria: citizen satisfaction with EPA information about the Superfund site, citizen understanding of environmental and human health risks associated with the site, citizen satisfaction with opportunities provided by EPA for community input, and citizen satisfaction with EPA's response to community input. While the evaluation results were mixed, in general, community members who were most informed about and involved in the cleanup process at Superfund sites generally were also the most satisfied with the community involvement process, and the job that EPA was doing cleaning up the site. We conclude that systematic evaluation provides meaningful and useful information that agencies can use to improve their public participation programs. However, there need to be institutionalized processes that ensure evaluation results are used to develop and implement strategies for improvement.

Identifying new technologies that save energy and reduce costs to the Federal sector: The New Technology Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hunt, W.D.M.; Conover, D.R.; Stockmeyer, M.K.

1995-11-01

In 1990 the New Technology Demonstration Program (formerly the Test Bed Demonstration Program) was initiated by the US Department of Energy`s Office (DOE`s) of Federal Energy Management Programs with the purpose of accelerating the introduction of new technologies into the Federal sector. The program has since expanded into a multi-laboratory collaborative effort that evaluates new technologies and shares the results with the Federal design and procurement communities. These evaluations are performed on a collaborative basis which typically includes technology manufacturers, Federal facilities, utilities, trade associations, research institutes, and other in partnership with DOE. The end result is a range ofmore » effective technology transfer tools that provide operations and performance data on new technologies to Federal designers, building managers, and procurement officials. These tools assist in accelerating a technology`s Federal application and realizing reductions in energy consumption and costs.« less

An Ada programming support environment

NASA Technical Reports Server (NTRS)

Tyrrill, AL; Chan, A. David

1986-01-01

The toolset of an Ada Programming Support Environment (APSE) being developed at North American Aircraft Operations (NAAO) of Rockwell International, is described. The APSE is resident on three different hosts and must support developments for the hosts and for embedded targets. Tools and developed software must be freely portable between the hosts. The toolset includes the usual editors, compilers, linkers, debuggers, configuration magnagers, and documentation tools. Generally, these are being supplied by the host computer vendors. Other tools, for example, pretty printer, cross referencer, compilation order tool, and management tools were obtained from public-domain sources, are implemented in Ada and are being ported to the hosts. Several tools being implemented in-house are of interest, these include an Ada Design Language processor based on compilable Ada. A Standalone Test Environment Generator facilitates test tool construction and partially automates unit level testing. A Code Auditor/Static Analyzer permits the Ada programs to be evaluated against measures of quality. An Ada Comment Box Generator partially automates generation of header comment boxes.

Numerical Implementation of Indicators and Statistical Control Tools in Monitoring and Evaluating CACEI-ISO Indicators of Study Program in Industrial Process by Systematization

ERIC Educational Resources Information Center

Ayala, Gabriela Cota; Real, Francia Angélica Karlos; Ivan, Ramirez Alvarado Edqar

2016-01-01

The research was conducted to determine if the study program of the career of industrial processes Technological University of Chihuahua, 1 year after that it was certified by CACEI, continues achieving the established indicators and ISO 9001: 2008, implementing quality tools, monitoring of essential indicators are determined, flow charts are…

Building Automatic Grading Tools for Basic of Programming Lab in an Academic Institution

NASA Astrophysics Data System (ADS)

Harimurti, Rina; Iwan Nurhidayat, Andi; Asmunin

2018-04-01

The skills of computer programming is a core competency that must be mastered by students majoring in computer sciences. The best way to improve this skill is through the practice of writing many programs to solve various problems from simple to complex. It takes hard work and a long time to check and evaluate the results of student labs one by one, especially if the number of students a lot. Based on these constrain, web proposes Automatic Grading Tools (AGT), the application that can evaluate and deeply check the source code in C, C++. The application architecture consists of students, web-based applications, compilers, and operating systems. Automatic Grading Tools (AGT) is implemented MVC Architecture and using open source software, such as laravel framework version 5.4, PostgreSQL 9.6, Bootstrap 3.3.7, and jquery library. Automatic Grading Tools has also been tested for real problems by submitting source code in C/C++ language and then compiling. The test results show that the AGT application has been running well.

Exploring an educational assessment tool to measure registered nurses' knowledge of hearing impairment and effective communication strategies: A USA study.

PubMed

Ruesch, Amy L

2018-01-01

Poor communication between the Registered Nurse and a hearing impaired patient can affect quality of care and health outcomes. Communication skills training programs for healthcare providers are needed to improve patient centered care. A descriptive research study, using a knowledge assessment tool developed and validated by the researcher, was conducted on 339 Registered Nurses to identify knowledge deficits to be addressed in a communication skills training program being designed. The educational tool measured the Registered Nurses' knowledge across four areas - hearing impairment, hearing aids, communication strategies, and regulations regarding access to care for a person with a hearing disability. Knowledge deficits were detected in all four areas. Using this educational assessment tool may enable nurse educators to tailor communication skills training programs to specifically address the gaps identified regarding hearing impairment and how to effectively communicate with the hearing impaired patient. Post training program, nurse educators can use the tool to evaluate effectiveness. Copyright © 2017 Elsevier Ltd. All rights reserved.

Can We Afford Not to Evaluate Services for Elderly Persons with Dementia?

PubMed Central

Worrall, Graham; Chambers, Larry W.

1989-01-01

With the increasing expenditure on health-care programs for seniors, there is an urgent need to evaluate such programs. The Measurement Iterative Loop is a tool that can provide both health administrators and health researchers with a method of evaluation of existing programs and identification of gaps in knowledge, and forms a rational basis for health-care policy decisions. In this article, the Loop is applied to one common problem of the elderly: dementia. PMID:21248993

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

More than a Conversation: Using Cogenerative Dialogues in the Professional Development of High School Chemistry Teachers

ERIC Educational Resources Information Center

Martin, Sonya N.; Scantlebury, Kathryn

2009-01-01

This paper focuses on content-based and pedagogical instructors' use of cogenerative dialogues to improve instructional practice and to evaluate program effectiveness in a professional development program for high school chemistry teachers. We share our research findings from using cogenerative dialogues as an evaluative tool for general…

Military Emergency Medical Service System Assessment: Application of the National Park Service Needs Assessment and Program Audit to Objectively Evaluate the Military EMS System of Okinawa, Japan.

PubMed

Ross, Elliot M; Harper, Stephen A; Cunningham, Cord; Walrath, Benjamin D; DeMers, Gerard; Kharod, Chetan U

2017-03-01

As part of a Military Emergency Medical Services (EMS) system process improvement initiative, the authors sought to objectively evaluate the U.S. military EMS system for the island of Okinawa. They applied a program evaluation tool currently utilized by the U.S. National Park Service (NPS). A comprehensive needs assessment was conducted to evaluate the current Military EMS system in Okinawa, Japan. The NPS EMS Program Audit Worksheet was used to get an overall "score" of our assessment. After all the data had been collected, a joint committee of Military EMS physicians reviewed the findings and made formal recommendations. From 2011 to 2014, U.S. military EMS on Okinawa averaged 1,345 ± 137 patient transports annually. An advanced life support (ALS) provider would have been dispatched on 558 EMS runs (38%) based on chief complaint in 2014 had they been available. Over 36,000 man-hours were expended during this period to provide National Registry Emergency Medical Technician (EMT)-accredited instruction to certify 141 Navy Corpsman as EMT Basics. The NPS EMS Program Audit Worksheet was used and the program scored a total of 31, suggesting the program is well planned and operating within standards. This evaluation of the Military EMS system on Okinawa using the NPS program assessment and audit worksheet demonstrates the NPS evaluation instruments may offer a useful assessment tool for the evaluation of Military EMS systems. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Strategic Analysis Overview

NASA Technical Reports Server (NTRS)

Cirillo, William M.; Earle, Kevin D.; Goodliff, Kandyce E.; Reeves, J. D.; Stromgren, Chel; Andraschko, Mark R.; Merrill, R. Gabe

2008-01-01

NASA s Constellation Program employs a strategic analysis methodology in providing an integrated analysis capability of Lunar exploration scenarios and to support strategic decision-making regarding those scenarios. The strategic analysis methodology integrates the assessment of the major contributors to strategic objective satisfaction performance, affordability, and risk and captures the linkages and feedbacks between all three components. Strategic analysis supports strategic decision making by senior management through comparable analysis of alternative strategies, provision of a consistent set of high level value metrics, and the enabling of cost-benefit analysis. The tools developed to implement the strategic analysis methodology are not element design and sizing tools. Rather, these models evaluate strategic performance using predefined elements, imported into a library from expert-driven design/sizing tools or expert analysis. Specific components of the strategic analysis tool set include scenario definition, requirements generation, mission manifesting, scenario lifecycle costing, crew time analysis, objective satisfaction benefit, risk analysis, and probabilistic evaluation. Results from all components of strategic analysis are evaluated a set of pre-defined figures of merit (FOMs). These FOMs capture the high-level strategic characteristics of all scenarios and facilitate direct comparison of options. The strategic analysis methodology that is described in this paper has previously been applied to the Space Shuttle and International Space Station Programs and is now being used to support the development of the baseline Constellation Program lunar architecture. This paper will present an overview of the strategic analysis methodology and will present sample results from the application of the strategic analysis methodology to the Constellation Program lunar architecture.

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation, volume 2, part 1. Appendix A: Software documentation

NASA Technical Reports Server (NTRS)

Lowrie, J. W.; Fermelia, A. J.; Haley, D. C.; Gremban, K. D.; Vanbaalen, J.; Walsh, R. W.

1982-01-01

Documentation of the preliminary software developed as a framework for a generalized integrated robotic system simulation is presented. The program structure is composed of three major functions controlled by a program executive. The three major functions are: system definition, analysis tools, and post processing. The system definition function handles user input of system parameters and definition of the manipulator configuration. The analysis tools function handles the computational requirements of the program. The post processing function allows for more detailed study of the results of analysis tool function executions. Also documented is the manipulator joint model software to be used as the basis of the manipulator simulation which will be part of the analysis tools capability.

PubMed Central

Worrall, Graham; Chambers, Larry W.

1990-01-01

With the increasing expenditure on health care programs for seniors, there is an urgent need to evaluate such programs. The Measurement Iterative Loop is a tool that can provide both health administrators and health researchers with a method of evaluation of existing programs and identification of gaps in knowledge, and forms a rational basis for health-care policy decisions. In this article, the Loop is applied to one common problem of the elderly: dementia. PMID:21233998

FIA BioSum: a tool to evaluate financial costs, opportunities and effectiveness of fuel treatments.

Treesearch

Jeremy Fried; Glenn Christensen

2004-01-01

FIA BioSum, a tool developed by the USDA Forest Services Forest Inventory and Analysis (FIA) Program, generates reliable cost estimates, identifies opportunities and evaluates the effectiveness of fuel treatments in forested landscapes. BioSum is an analytic framework that integrates a suite of widely used computer models with a foundation of attribute-rich,...

Opening the Conversation on REU Assessment and Evaluation

NASA Astrophysics Data System (ADS)

Pressley, S. N.; LeBeau, J. E.

2015-12-01

Project evaluation is a key component to ensuring success of any Research Experience for Undergraduates (REU) program. The Washington State University (WSU) Regional Atmospheric Chemistry: State-of-the-art Measurement and Modeling in the Pacific Northwest REU Site employs a mixed method approach to determine what is working well and what can use improvement (formative evaluation) and to determine impact and effectiveness of the project in reaching the stated goals (summative evaluation). Quantitative data is collected via a pre-/post-test measuring participants' research self-efficacy (RSE), motivation, background information, extent of socialization, and their interpretation of the value of the REU experience. Qualitative data is gathered through individual interviews with the REU students (at the beginning and end of the program) and faculty mentors (at the end). Beginning interviews focus on expectations for the REU program and student backgrounds. End interviews focus on student RSE development, interpretations of their experience, and the value of the experience. Faculty mentors are interviewed to gather insight on student performance in the program and perspectives on the overall success of the program in meeting the proposed goals. Students are provided an opportunity to comment on the strengths and weaknesses of workshops, providing critical feedback to the particular instructor and enabling the faculty to modify the workshop content and activities in future years. Finally, research results are evaluated during the final poster presentation, and faculty are interviewed to report on their perception of how each student learned and gained knowledge during the program. To evaluate the retention of students in engineering and science and identify chosen career paths, a longitudinal survey was created and it is administered via email each year. Many REU programs also employ the Undergraduate Research Students Self-Assessment (URSSA) online tool designed for evaluating REU experiences (University of Colorado at Boulder). Information presented in this presentation will include a discussion of the current tools used as described above as well as a discussion of the pros/cons of using URSSA. One of the concerns with using URSSA in conjunction with the other assessment tools is "survey fatigue".

An Introduction to Solar Decision-Making Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mow, Benjamin

2017-09-12

The National Renewable Energy Laboratory (NREL) offers a variety of models and analysis tools to help decision makers evaluate and make informed decisions about solar projects, policies, and programs. This fact sheet aims to help decision makers determine which NREL tool to use for a given solar project or policy question, depending on its scope.

Tool to Prioritize Energy Efficiency Investments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Farese, P.; Gelman, R.; Hendron, R.

2012-08-01

To provide analytic support of the U.S. Department of Energy's Office of the Building Technology Program (BTP), NREL developed a Microsoft Excel-based tool to provide an open and objective comparison of the hundreds of investment opportunities available to BTP. This tool uses established methodologies to evaluate the energy savings and cost of those savings.

Examining the Quality of IEPs for Young Children with Autism

ERIC Educational Resources Information Center

Ruble, Lisa A.; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine…

Employer evaluations of nurse graduates: a critical program assessment element.

PubMed

Ryan, M E; Hodson, K E

1992-05-01

Accountability in higher education dictates implementation of a comprehensive evaluation plan. Employer evaluation of graduates is an important component of program evaluation and contributes a different view that is rarely reported in the literature. The purpose of this study was to establish a database by surveying employers of baccalaureate-prepared nurses, postgraduation, over a five-year period. Employer surveys measured perceptions of graduates' functioning. Findings indicated that graduates function above expected levels for leadership skills, nursing skills, communication skills, and professionalism. Systematic program evaluation by employers is recommended at one and five years after graduation. A tool for employer evaluation of baccalaureate graduates is discussed.

TEAM-HF Cost-Effectiveness Model: A Web-Based Program Designed to Evaluate the Cost-Effectiveness of Disease Management Programs in Heart Failure

PubMed Central

Reed, Shelby D.; Neilson, Matthew P.; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H.; Polsky, Daniel E.; Graham, Felicia L.; Bowers, Margaret T.; Paul, Sara C.; Granger, Bradi B.; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara; Levy, Wayne C.

2015-01-01

Background Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. Methods We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics, use of evidence-based medications, and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model (SHFM). Projections of resource use and quality of life are modeled using relationships with time-varying SHFM scores. The model can be used to evaluate parallel-group and single-cohort designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. Results The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. Conclusion The TEAM-HF Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. PMID:26542504

Effective Tools and Resources from the MAVEN Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Mason, T.

2015-12-01

Since 2010, NASA's Mars Atmosphere and Volatile Evolution (MAVEN) Education and Public Outreach (E/PO) team has developed and implemented a robust and varied suite of projects, serving audiences of all ages and diverse backgrounds from across the country. With a program designed to reach formal K-12 educators and students, afterschool and summertime communities, museum docents, journalists, and online audiences, we have incorporated an equally varied approach to developing tools, resources, and evaluation methods to specifically reach each target population and to determine the effectiveness of our efforts. This poster will highlight some of the tools and resources we have developed to share the complex science and engineering of the MAVEN mission, as well as initial evaluation results and lessons-learned from each of our E/PO projects.

Systematic and Scalable Testing of Concurrent Programs

DTIC Science & Technology

2013-12-16

The evaluation of CHESS [107] checked eight different programs ranging from process management libraries to a distributed execution engine to a research...tool (§3.1) targets systematic testing of scheduling nondeterminism in multi- threaded components of the Omega cluster management system [129], while...tool for systematic testing of multithreaded com- ponents of the Omega cluster management system [129]. In particular, §3.1.1 defines a model for

Assessment of a human computer interface prototyping environment

NASA Technical Reports Server (NTRS)

Moore, Loretta A.

1993-01-01

A Human Computer Interface (HCI) prototyping environment with embedded evaluation capability has been successfully assessed which will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. The HCI prototyping environment is designed to include four components: (1) a HCI format development tool, (2) a test and evaluation simulator development tool, (3) a dynamic, interactive interface between the HCI prototype and simulator, and (4) an embedded evaluation capability to evaluate the adequacy of an HCI based on a user's performance.

Reflections on experiential learning in evaluation capacity building with a community organization, Dancing With Parkinson's.

PubMed

Nakaima, April; Sridharan, Sanjeev

2017-05-08

This paper discusses what was learned about evaluation capacity building with community organizations who deliver services to individuals with neurological disorders. Evaluation specialists engaged by the Ontario Brain Institute Evaluation Support Program were paired with community organizations, such as Dancing With Parkinson's. Some of the learning included: relationship building is key for this model of capacity building; community organizations often have had negative experiences with evaluation and the idea that evaluations can be friendly tools in implementing meaningful programs is one key mechanism by which such an initiative can work; community organizations often need evaluation most to be able to demonstrate their value; a strength of this initiative was that the focus was not just on creating products but mostly on developing a learning process in which capacities would remain; evaluation tools and skills that organizations found useful were developing a theory of change and the concept of heterogeneous mechanisms (informed by a realist evaluation lens). Copyright © 2017. Published by Elsevier Ltd.

Bellman's GAP--a language and compiler for dynamic programming in sequence analysis.

PubMed

Sauthoff, Georg; Möhl, Mathias; Janssen, Stefan; Giegerich, Robert

2013-03-01

Dynamic programming is ubiquitous in bioinformatics. Developing and implementing non-trivial dynamic programming algorithms is often error prone and tedious. Bellman's GAP is a new programming system, designed to ease the development of bioinformatics tools based on the dynamic programming technique. In Bellman's GAP, dynamic programming algorithms are described in a declarative style by tree grammars, evaluation algebras and products formed thereof. This bypasses the design of explicit dynamic programming recurrences and yields programs that are free of subscript errors, modular and easy to modify. The declarative modules are compiled into C++ code that is competitive to carefully hand-crafted implementations. This article introduces the Bellman's GAP system and its language, GAP-L. It then demonstrates the ease of development and the degree of re-use by creating variants of two common bioinformatics algorithms. Finally, it evaluates Bellman's GAP as an implementation platform of 'real-world' bioinformatics tools. Bellman's GAP is available under GPL license from http://bibiserv.cebitec.uni-bielefeld.de/bellmansgap. This Web site includes a repository of re-usable modules for RNA folding based on thermodynamics.

Situation Awareness and Workload Measures for SAFOR

NASA Technical Reports Server (NTRS)

DeMaio, Joe; Hart, Sandra G.; Allen, Ed (Technical Monitor)

1999-01-01

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

Adapting HIV patient and program monitoring tools for chronic non-communicable diseases in Ethiopia.

PubMed

Letebo, Mekitew; Shiferaw, Fassil

2016-06-02

Chronic non-communicable diseases (NCDs) have become a huge public health concern in developing countries. Many resource-poor countries facing this growing epidemic, however, lack systems for an organized and comprehensive response to NCDs. Lack of NCD national policy, strategies, treatment guidelines and surveillance and monitoring systems are features of health systems in many developing countries. Successfully responding to the problem requires a number of actions by the countries, including developing context-appropriate chronic care models and programs and standardization of patient and program monitoring tools. In this cross-sectional qualitative study we assessed existing monitoring and evaluation (M&E) tools used for NCD services in Ethiopia. Since HIV care and treatment program is the only large-scale chronic care program in the country, we explored the M&E tools being used in the program and analyzed how these tools might be adapted to support NCD services in the country. Document review and in-depth interviews were the main data collection methods used. The interviews were held with health workers and staff involved in data management purposively selected from four health facilities with high HIV and NCD patient load. Thematic analysis was employed to make sense of the data. Our findings indicate the apparent lack of information systems for NCD services, including the absence of standardized patient and program monitoring tools to support the services. We identified several HIV care and treatment patient and program monitoring tools currently being used to facilitate intake process, enrolment, follow up, cohort monitoring, appointment keeping, analysis and reporting. Analysis of how each tool being used for HIV patient and program monitoring can be adapted for supporting NCD services is presented. Given the similarity between HIV care and treatment and NCD services and the huge investment already made to implement standardized tools for HIV care and treatment program, adaptation and use of HIV patient and program monitoring tools for NCD services can improve NCD response in Ethiopia through structuring services, standardizing patient care and treatment, supporting evidence-based planning and providing information on effectiveness of interventions.

Use of Interactive Electronic Audience Response Tools (Clickers) to Evaluate Knowledge Gained in Extension Programming

ERIC Educational Resources Information Center

Gunn, Patrick; Loy, Dan

2015-01-01

Effectively measuring short-term impact, particularly a change in knowledge resulting from Extension programming, can prove to be challenging. Clicker-based technology, when used properly, is one alternative that may allow educators to better evaluate this aspect of the logic model. While the potential interface between clicker technology and…

Wilderness educators' evaluation of the Impact Monster Program

Treesearch

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

Students' Reactions to the Use of Animals as Instructional Tools for Science

ERIC Educational Resources Information Center

Gurzau, Vickie Anne

2013-01-01

Teaching science to students with special needs requires different approaches. A program at the study site supplemented packaged science kits with animal-assisted instruction, but such an approach was never evaluated. The purpose of this study was to provide a formative program evaluation documenting students' reactions to the use of animals…

Rule based design of conceptual models for formative evaluation

NASA Technical Reports Server (NTRS)

Moore, Loretta A.; Chang, Kai; Hale, Joseph P.; Bester, Terri; Rix, Thomas; Wang, Yaowen

1994-01-01

A Human-Computer Interface (HCI) Prototyping Environment with embedded evaluation capability has been investigated. This environment will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. This environment, which allows for rapid prototyping and evaluation of graphical interfaces, includes the following four components: (1) a HCI development tool; (2) a low fidelity simulator development tool; (3) a dynamic, interactive interface between the HCI and the simulator; and (4) an embedded evaluator that evaluates the adequacy of a HCI based on a user's performance. The embedded evaluation tool collects data while the user is interacting with the system and evaluates the adequacy of an interface based on a user's performance. This paper describes the design of conceptual models for the embedded evaluation system using a rule-based approach.

Rule based design of conceptual models for formative evaluation

NASA Technical Reports Server (NTRS)

Moore, Loretta A.; Chang, Kai; Hale, Joseph P.; Bester, Terri; Rix, Thomas; Wang, Yaowen

1994-01-01

A Human-Computer Interface (HCI) Prototyping Environment with embedded evaluation capability has been investigated. This environment will be valuable in developing and refining HCI standards and evaluating program/project interface development, especially Space Station Freedom on-board displays for payload operations. This environment, which allows for rapid prototyping and evaluation of graphical interfaces, includes the following four components: (1) a HCI development tool, (2) a low fidelity simulator development tool, (3) a dynamic, interactive interface between the HCI and the simulator, and (4) an embedded evaluator that evaluates the adequacy of a HCI based on a user's performance. The embedded evaluation tool collects data while the user is interacting with the system and evaluates the adequacy of an interface based on a user's performance. This paper describes the design of conceptual models for the embedded evaluation system using a rule-based approach.

7 CFR 210.29 - Management evaluations.

Code of Federal Regulations, 2011 CFR

2011-01-01

... evaluate all aspects of State agency management of the Program using tools such as State agency reviews as...: use of Federal funds; reporting and recordkeeping; agreements with school food authorities; review of...

Evaluation of Medical Education virtual Program: P3 model.

PubMed

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Evaluation of Medical Education virtual Program: P3 model

PubMed Central

REZAEE, RITA; SHOKRPOUR, NASRIN; BOROUMAND, MARYAM

2016-01-01

Introduction: In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way. PMID:27795971

Improving health aid for a better planet: The planning, monitoring and evaluation tool (PLANET)

PubMed Central

Sridhar, Devi; Car, Josip; Chopra, Mickey; Campbell, Harry; Woods, Ngaire; Rudan, Igor

2015-01-01

Background International development assistance for health (DAH) quadrupled between 1990 and 2012, from US$ 5.6 billion to US$ 28.1 billion. This generates an increasing need for transparent and replicable tools that could be used to set investment priorities, monitor the distribution of funding in real time, and evaluate the impact of those investments. Methods In this paper we present a methodology that addresses these three challenges. We call this approach PLANET, which stands for planning, monitoring and evaluation tool. Fundamentally, PLANET is based on crowdsourcing approach to obtaining information relevant to deployment of large–scale programs. Information is contributed in real time by a diverse group of participants involved in the program delivery. Findings PLANET relies on real–time information from three levels of participants in large–scale programs: funders, managers and recipients. At each level, information is solicited to assess five key risks that are most relevant to each level of operations. The risks at the level of funders involve systematic neglect of certain areas, focus on donor’s interests over that of program recipients, ineffective co–ordination between donors, questionable mechanisms of delivery and excessive loss of funding to “middle men”. At the level of managers, the risks are corruption, lack of capacity and/or competence, lack of information and /or communication, undue avoidance of governmental structures / preference to non–governmental organizations and exclusion of local expertise. At the level of primary recipients, the risks are corruption, parallel operations / “verticalization”, misalignment with local priorities and lack of community involvement, issues with ethics, equity and/or acceptability, and low likelihood of sustainability beyond the end of the program’s implementation. Interpretation PLANET is intended as an additional tool available to policy–makers to prioritize, monitor and evaluate large–scale development programs. In this, it should complement tools such as LiST (for health care/interventions), EQUIST (for health care/interventions) and CHNRI (for health research), which also rely on information from local experts and on local context to set priorities in a transparent, user–friendly, replicable, quantifiable and specific, algorithmic–like manner. PMID:26322228

Evaluation of work zone enhancement software programs.

DOT National Transportation Integrated Search

2009-09-01

The Missouri Department of Transportation (MoDOT) is looking for software tools that can assist in : developing effective plans to manage and communicate work zone activities. QuickZone, CA4PRS, : VISSIM, and Spreadsheet models are the tools that MoD...

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

Evaluating High School Libraries: Service Is Top Priority.

ERIC Educational Resources Information Center

Baldwin, Margaret

1988-01-01

Discusses the need for ongoing evaluation within high school libraries to ensure adequate library services, which, in turn, enhance the total educational program. The evaluation of library facilities, collections, and staff is discussed, and an annotated bibliography of evaluation tools is provided. (6 references) (CLB)

Support for and aspects of use of educational games in family medicine and internal medicine residency programs in the US: a survey.

PubMed

Akl, Elie A; Gunukula, Sameer; Mustafa, Reem; Wilson, Mark C; Symons, Andrew; Moheet, Amir; Schünemann, Holger J

2010-03-25

The evidence supporting the effectiveness of educational games in graduate medical education is limited. Anecdotal reports suggest their popularity in that setting. The objective of this study was to explore the support for and the different aspects of use of educational games in family medicine and internal medicine residency programs in the United States. We conducted a survey of family medicine and internal medicine residency program directors in the United States. The questionnaire asked the program directors whether they supported the use of educational games, their actual use of games, and the type of games being used and the purpose of that use. Of 434 responding program directors (52% response rate), 92% were in support of the use of games as an educational strategy, and 80% reported already using them in their programs. Jeopardy like games were the most frequently used games (78%). The use of games was equally popular in family medicine and internal medicine residency programs and popularity was inversely associated with more than 75% of residents in the program being International Medical Graduates. The percentage of program directors who reported using educational games as teaching tools, review tools, and evaluation tools were 62%, 47%, and 4% respectively. Given a widespread use of educational games in the training of medical residents, in spite of limited evidence for efficacy, further evaluation of the best approaches to education games should be explored.

Model Performance Evaluation and Scenario Analysis (MPESA)

EPA Pesticide Factsheets

Model Performance Evaluation and Scenario Analysis (MPESA) assesses the performance with which models predict time series data. The tool was developed Hydrological Simulation Program-Fortran (HSPF) and the Stormwater Management Model (SWMM)

Validation of Tendril TrueHome Using Software-to-Software Comparison

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maguire, Jeffrey B; Horowitz, Scott G; Moore, Nathan

This study performed comparative evaluation of EnergyPlus version 8.6 and Tendril TrueHome, two physics-based home energy simulation models, to identify differences in energy consumption predictions between the two programs and resolve discrepancies between them. EnergyPlus is considered a benchmark, best-in-class software tool for building energy simulation. This exercise sought to improve both software tools through additional evaluation/scrutiny.

Evaluation and process development of salt cedar and juniper biocomposites as tools to utilize exotic and invasive species and restore native ecosystems

Treesearch

Jerrold E. Winandy; Craig M. Clemons; Nicole M. Stark; James H. Muehl; R. Sam Williams

2005-01-01

This research program is developing and evaluating potential value-added uses for a variety of exotic invasive woody species, such as salt cedar (Tamarisk spp.), one-seed juniper (Juniperus monosperma), and eastern red- cedar (Juniperus virginiana). Because each of these species is encroaching into America's natural indigenous ecosystems, land managers need tools...

Structured learning for robotic surgery utilizing a proficiency score: a pilot study.

PubMed

Hung, Andrew J; Bottyan, Thomas; Clifford, Thomas G; Serang, Sarfaraz; Nakhoda, Zein K; Shah, Swar H; Yokoi, Hana; Aron, Monish; Gill, Inderbir S

2017-01-01

We evaluated feasibility and benefit of implementing structured learning in a robotics program. Furthermore, we assessed validity of a proficiency assessment tool for stepwise graduation. Teaching cases included robotic radical prostatectomy and partial nephrectomy. Procedure steps were categorized: basic, intermediate, and advanced. An assessment tool ["proficiency score" (PS)] was developed to evaluate ability to safely and autonomously complete a step. Graduation required a passing PS (PS ≥ 3) on three consecutive attempts. PS and validated global evaluative assessment of robotic skills (GEARS) were evaluated for completed steps. Linear regression was utilized to determine postgraduate year/PS relationship (construct validity). Spearman's rank correlation coefficient measured correlation between PS and GEARS evaluations (concurrent validity). Intraclass correlation (ICC) evaluated PS agreement between evaluator classes. Twenty-one robotic trainees participated within the pilot program, completing a median of 14 (2-69) cases each. Twenty-three study evaluators scored 14 (1-60) cases. Over 4 months, 229/294 (78 %) cases were designated "teaching" cases. Residents completed 91 % of possible evaluations; faculty completed 78 %. Verbal and quantitative feedback received by trainees increased significantly (p = 0.002, p < 0.001, respectively). Average PS increased with PGY (post-graduate year) for basic and intermediate steps (regression slopes: 0.402 (p < 0.0001), 0.323 (p < 0.0001), respectively) (construct validation). Overall, PS correlated highly with GEARS (ρ = 0.81, p < 0.0001) (concurrent validity). ICC was 0.77 (95 % CI 0.61-0.88) for resident evaluations. Structured learning can be implemented in an academic robotic program with high levels of trainee and evaluator participation, encouraging both quantitative and verbal feedback. A proficiency assessment tool developed for step-specific proficiency has construct and concurrent validity.

Symposium: A New Observation Tool for Looking at Inquiry-Based Teaching and Learning.

ERIC Educational Resources Information Center

Young, M. J.; And Others

This document comprises four papers from a symposium on using an inquiry-based observation tool for assessing teaching and learning on various educational levels. The first paper, "Introduction, and Overview and Use of the Tool for K-12 Science, Mathematics, and Technology Program Evaluation" (M. Jean Young), presents an overview of the tool…

Use of Online Assessment Tools by Instructional Designers-by-Assignment: Necessary Features and Functionalities

ERIC Educational Resources Information Center

Halloran, Jo-Ann

2013-01-01

Government entities set criteria for institutions that have teacher educator programs to use online assessment tools to show continuous ongoing evaluation, and use data from the tools to guide the improvement of courses. The purpose of this qualitative, multi-case study was to discover how Instructional Designers-by-Assignment (IDBA) are using…

Scratch as a Computational Modelling Tool for Teaching Physics

ERIC Educational Resources Information Center

Lopez, Victor; Hernandez, Maria Isabel

2015-01-01

The Scratch online authoring tool, which features a simple programming language that has been adapted to primary and secondary students, is being used more and more in schools as it offers students and teachers the opportunity to use a tool to build scientific models and evaluate their behaviour, just as can be done with computational modelling…

DECIDE: a software for computer-assisted evaluation of diagnostic test performance.

PubMed

Chiecchio, A; Bo, A; Manzone, P; Giglioli, F

1993-05-01

The evaluation of the performance of clinical tests is a complex problem involving different steps and many statistical tools, not always structured in an organic and rational system. This paper presents a software which provides an organic system of statistical tools helping evaluation of clinical test performance. The program allows (a) the building and the organization of a working database, (b) the selection of the minimal set of tests with the maximum information content, (c) the search of the model best fitting the distribution of the test values, (d) the selection of optimal diagnostic cut-off value of the test for every positive/negative situation, (e) the evaluation of performance of the combinations of correlated and uncorrelated tests. The uncertainty associated with all the variables involved is evaluated. The program works in a MS-DOS environment with EGA or higher performing graphic card.

Teaching and evaluation of ethics and professionalism

PubMed Central

Pauls, Merril A.

2012-01-01

Abstract Objective To document the scope of the teaching and evaluation of ethics and professionalism in Canadian family medicine postgraduate training programs, and to identify barriers to the teaching and evaluation of ethics and professionalism. Design A survey was developed in collaboration with the Committee on Ethics of the College of Family Physicians of Canada. The data are reported descriptively and in aggregate. Setting Canadian postgraduate family medicine training programs. Participants Between June and December of 2008, all 17 Canadian postgraduate family medicine training programs were invited to participate. Main outcome measures The first part of the survey explored the structure, resources, methods, scheduled hours, and barriers to teaching ethics and professionalism. The second section focused on end-of-rotation evaluations, other evaluation strategies, and barriers related to the evaluation of ethics and professionalism. Results Eighty-eight percent of programs completed the survey. Most respondents (87%) had learning objectives specifically for ethics and professionalism, and 87% had family doctors with training or interest in the area leading their efforts. Two-thirds of responding programs had less than 10 hours of scheduled instruction per year, and the most common barriers to effective teaching were the need for faculty development, competing learning needs, and lack of resident interest. Ninety-three percent of respondents assessed ethics and professionalism on their end-of-rotation evaluations, with 86% assessing specific domains. The most common barriers to evaluation were a lack of suitable tools and a lack of faculty comfort and interest. Conclusion By far most Canadian family medicine postgraduate training programs had learning objectives and designated faculty leads in ethics and professionalism, yet there was little curricular time dedicated to these areas and a perceived lack of resident interest and faculty expertise. Most programs evaluated ethics and professionalism as part of their end-of-rotation evaluations, but only a small number used novel means of evaluation, and most cited a lack of suitable assessment tools as an important barrier. PMID:23242906

Using standardized tools to improve immunization costing data for program planning: the cost of the Colombian Expanded Program on Immunization.

PubMed

Castañeda-Orjuela, Carlos; Romero, Martin; Arce, Patricia; Resch, Stephen; Janusz, Cara B; Toscano, Cristiana M; De la Hoz-Restrepo, Fernando

2013-07-02

The cost of Expanded Programs on Immunization (EPI) is an important aspect of the economic and financial analysis needed for planning purposes. Costs also are needed for cost-effectiveness analysis of introducing new vaccines. We describe a costing tool that improves the speed, accuracy, and availability of EPI costs and that was piloted in Colombia. The ProVac CostVac Tool is a spreadsheet-based tool that estimates overall EPI costs considering program inputs (personnel, cold chain, vaccines, supplies, etc.) at three administrative levels (central, departmental, and municipal) and one service delivery level (health facilities). It uses various costing methods. The tool was evaluated through a pilot exercise in Colombia. In addition to the costs obtained from the central and intermediate administrative levels, a survey of 112 local health facilities was conducted to collect vaccination costs. Total cost of the EPI, cost per dose of vaccine delivered, and cost per fully vaccinated child with the recommended immunization schedule in Colombia in 2009 were estimated. The ProVac CostVac Tool is a novel, user-friendly tool, which allows users to conduct an EPI costing study following guidelines for cost studies. The total costs of the Colombian EPI were estimated at US$ 107.8 million in 2009. The cost for a fully immunized child with the recommended schedule was estimated at US$ 153.62. Vaccines and vaccination supplies accounted for 58% of total costs, personnel for 21%, cold chain for 18%, and transportation for 2%. Most EPI costs are incurred at the central level (62%). The major cost driver at the department and municipal levels is personnel costs. The ProVac CostVac Tool proved to be a comprehensive and useful tool that will allow researchers and health officials to estimate the actual cost for national immunization programs. The present analysis shows that personnel, cold chain, and transportation are important components of EPI and should be carefully estimated in the cost analysis, particularly when evaluating new vaccine introduction. Copyright © 2013 Elsevier Ltd. All rights reserved.

Standards Based Reform. Abbott Implementation Resource Guide

ERIC Educational Resources Information Center

Passantino, Claire; Kenyon, Susan

2004-01-01

The goal of this guide is to provide information, support and practical tools that may help educators design, implement, and evaluate their school's standards-based education program. In order to work, a comprehensive, standards-based educational program must, by definition, be the organizing structure upon which the school program operates.…

Meeting Extension Programming Needs with Technology: A Case Study of Agritourism Webinars

ERIC Educational Resources Information Center

Rich, Samantha Rozier; Komar, Stephen; Schilling, Brian; Tomas, Stacy R.; Carleo, Jenny; Colucci, Susan J.

2011-01-01

As clientele needs diversify, Extension educators are examining new technologies, including online tools, to deliver educational programming and resources. Using agritourism as the educational topic, the study reported here sought to evaluate participants' acceptance of online educational programming (webinars) and the effectiveness of the…

Computing tools for implementing standards for single-case designs.

PubMed

Chen, Li-Ting; Peng, Chao-Ying Joanne; Chen, Ming-E

2015-11-01

In the single-case design (SCD) literature, five sets of standards have been formulated and distinguished: design standards, assessment standards, analysis standards, reporting standards, and research synthesis standards. This article reviews computing tools that can assist researchers and practitioners in meeting the analysis standards recommended by the What Works Clearinghouse: Procedures and Standards Handbook-the WWC standards. These tools consist of specialized web-based calculators or downloadable software for SCD data, and algorithms or programs written in Excel, SAS procedures, SPSS commands/Macros, or the R programming language. We aligned these tools with the WWC standards and evaluated them for accuracy and treatment of missing data, using two published data sets. All tools were tested to be accurate. When missing data were present, most tools either gave an error message or conducted analysis based on the available data. Only one program used a single imputation method. This article concludes with suggestions for an inclusive computing tool or environment, additional research on the treatment of missing data, and reasonable and flexible interpretations of the WWC standards. © The Author(s) 2015.

Prototype road weather performance management (RW-PM) tool and Minnesota Department of Transportation (MnDOT) field evaluation.

DOT National Transportation Integrated Search

2017-01-01

FHWAs Road Weather Management Program developed a Prototype Road Weather Management (RW-PM) Tool to help DOTs maximize the effectiveness of their maintenance resources and efficiently adjust deployments dynamically, as road conditions and traffic ...

National standards for the long-term care ombudsman program and a tool to assess compliance: the Huber Badrak Borders Scales.

PubMed

Huber, R; Borders, K W; Badrak, K; Netting, F E; Nelson, H W

2001-04-01

We propose national standards previously recommended for the Long-Term Care Ombudsman Program by an Institute of Medicine program evaluation committee, and introduce a tool to measure the compliance of local ombudsman programs to those standards: the Huber Badrak Borders Scales. The best practices for ombudsman programs detailed in the committee's report were adapted to 43 Likert-type scales that were then averaged into 10 infrastructure component scales: (a) program structure, (b) qualifications of local ombudsmen, (c) legal authority, (d) financial resources, (e) management information systems, (f) legal resources, (g) human resources, (h) resident advocacy services, (i) systemic advocacy, and (j) educational services. The scales were pilot-tested in 1996 and 1999 with Kentucky ombudsmen. The means of 9 of these 10 scales were higher in 1999 than in 1996, suggesting that local ombudsman programs were more in compliance with the proposed standards in 1999 than three years earlier. The development process consisted of 10 adopt-test-revise-retest steps that can be replicated by other types of programs to develop program compliance tools.

A Cost-Effectiveness/Benefit Analysis Model for Postsecondary Vocational Programs. Technical Report.

ERIC Educational Resources Information Center

Kim, Jin Eun

A cost-effectiveness/benefit analysis is defined as a technique for measuring the outputs of existing and new programs in relation to their specified program objectives, against the costs of those programs. In terms of its specific use, the technique is conceptualized as a systems analysis method, an evaluation method, and a planning tool for…

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

PubMed

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

EVALUATION TECHNIQUES AND TOOL DEVELOPMENT FOR FY 08 CMAQ RELEASE

EPA Science Inventory

In this task, research efforts are outlined that relate to the AMD Model Evaluation Program element and support CMAQ releases within the FY05-FY08 time period. Model evaluation serves dual purposes; evaluation is necessary to characterize the accuracy of model predictions, and e...

ENergy and Power Evaluation Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development,more » energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.« less

Employee assistance program evaluation. Employee perceptions, awareness, and utilization.

PubMed

Moore, T

1989-12-01

Periodic evaluation is necessary to maintain a quality employee assistance program. This survey was undertaken to determine employee awareness of the existing EAP and their satisfaction with the program. Likewise, the survey allowed for employee input on areas of the program they had concerns with that may have caused hesitancy in further use of the program. The survey not only documents to management that the program is of value to employees and identifies areas where changes may be focused in the future to meet employee needs, but actually serves as a communication tool in itself as a reminder of the availability of the Employee Assistance Program.

Supporting secure programming in web applications through interactive static analysis.

PubMed

Zhu, Jun; Xie, Jing; Lipford, Heather Richter; Chu, Bill

2014-07-01

Many security incidents are caused by software developers' failure to adhere to secure programming practices. Static analysis tools have been used to detect software vulnerabilities. However, their wide usage by developers is limited by the special training required to write rules customized to application-specific logic. Our approach is interactive static analysis, to integrate static analysis into Integrated Development Environment (IDE) and provide in-situ secure programming support to help developers prevent vulnerabilities during code construction. No additional training is required nor are there any assumptions on ways programs are built. Our work is motivated in part by the observation that many vulnerabilities are introduced due to failure to practice secure programming by knowledgeable developers. We implemented a prototype interactive static analysis tool as a plug-in for Java in Eclipse. Our technical evaluation of our prototype detected multiple zero-day vulnerabilities in a large open source project. Our evaluations also suggest that false positives may be limited to a very small class of use cases.

Supporting secure programming in web applications through interactive static analysis

PubMed Central

Zhu, Jun; Xie, Jing; Lipford, Heather Richter; Chu, Bill

2013-01-01

Many security incidents are caused by software developers’ failure to adhere to secure programming practices. Static analysis tools have been used to detect software vulnerabilities. However, their wide usage by developers is limited by the special training required to write rules customized to application-specific logic. Our approach is interactive static analysis, to integrate static analysis into Integrated Development Environment (IDE) and provide in-situ secure programming support to help developers prevent vulnerabilities during code construction. No additional training is required nor are there any assumptions on ways programs are built. Our work is motivated in part by the observation that many vulnerabilities are introduced due to failure to practice secure programming by knowledgeable developers. We implemented a prototype interactive static analysis tool as a plug-in for Java in Eclipse. Our technical evaluation of our prototype detected multiple zero-day vulnerabilities in a large open source project. Our evaluations also suggest that false positives may be limited to a very small class of use cases. PMID:25685513

Depression Awareness and Self-Management Through the Internet: Protocol for an Internationally Standardized Approach

PubMed Central

Koburger, Nicole; Larkin, Celine; Karwig, Gillian; Coffey, Claire; Maxwell, Margaret; Harris, Fiona; Rummel-Kluge, Christine; van Audenhove, Chantal; Sisask, Merike; Alexandrova-Karamanova, Anna; Perez, Victor; Purebl, György; Cebria, Annabel; Palao, Diego; Costa, Susana; Mark, Lauraliisa; Tóth, Mónika Ditta; Gecheva, Marieta; Ibelshäuser, Angela; Gusmão, Ricardo; Hegerl, Ulrich

2015-01-01

Background Depression incurs significant morbidity and confers increased risk of suicide. Many individuals experiencing depression remain untreated due to systemic and personal barriers to care. Guided Internet-based psychotherapeutic programs represent a promising means of overcoming such barriers and increasing the capacity for self-management of depression. However, existing programs tend to be available only in English and can be expensive to access. Furthermore, despite evidence of the effectiveness of a number of Internet-based programs, there is limited evidence regarding both the acceptability of such programs and feasibility of their use, for users and health care professionals. Objective This paper will present the protocol for the development, implementation, and evaluation of the iFightDepression tool, an Internet-based self-management tool. This is a cost-free, multilingual, guided, self-management program for mild to moderate depression cases. Methods The Preventing Depression and Improving Awareness through Networking in the European Union consortium undertook a comprehensive systematic review of the available evidence regarding computerized cognitive behavior therapy in addition to a consensus process involving mental health experts and service users to inform the development of the iFightDepression tool. The tool was implemented and evaluated for acceptability and feasibility of its use in a pilot phase in 5 European regions, with recruitment of users occurring through general practitioners and health care professionals who participated in a standardized training program. Results Targeting mild to moderate depression, the iFightDepression tool is based on cognitive behavioral therapy and addresses behavioral activation (monitoring and planning daily activities), cognitive restructuring (identifying and challenging unhelpful thoughts), sleep regulation, mood monitoring, and healthy lifestyle habits. There is also a tailored version of the tool for young people, incorporating less formal language and additional age-appropriate modules on relationships and social anxiety. The tool is accompanied by a 3-hour training intervention for health care professionals. Conclusions It is intended that the iFightDepression tool and associated training for health care professionals will represent a valuable resource for the management of depression that will complement existing resources for health care professionals. It is also intended that the iFightDepression tool and training will represent an additional resource within a multifaceted approach to improving the care of depression and preventing suicidal behavior in Europe. PMID:26251104

Benchmarking. Issues in the Design and Implementation of a Benchmarking System for Employment and Training Programs for Young People.

ERIC Educational Resources Information Center

Coughlin, David C.; Bielen, Rhonda P.

This paper has been prepared to assist the United States Department of Labor to explore new approaches to evaluating and measuring the performance of employment and training activities for youth. As one of several tools for evaluating success of local youth training programs, "benchmarking" provides a system for measuring the development…

Understanding the Influence of Independent Civil Society Monitoring and Evaluation at the District Level: A Case Study of Ghana

ERIC Educational Resources Information Center

Gildemyn, Marie

2014-01-01

In developing countries, an increasing number of civil society organizations (CSOs) engage in independent monitoring and evaluation (M&E) of government programs and policies. Most CSOs rely on a range of M&E tools in combination with advocacy strategies to hold government accountable and improve the implementation of programs and policies.…

Review and Evaluation of the College Level Examination Program for Introductory Macroeconomics for Providing Credit by Exam.

ERIC Educational Resources Information Center

Reichheld, Charles A., III

At Cuyahoga Community College (CCC), the College-Level Examination Program (CLEP) for Introductory Macroeconomics Test was evaluated to determine if it was an effective tool for providing credit by examination for the college's Principles of Economics course. Though students at the present time (1991) can take the CLEP to obtain up to 45 credits…

Developing and Evaluating an Interactive Multimedia Instructional Tool: Learning Outcomes and User Experiences of Optometry Students

ERIC Educational Resources Information Center

Wang, Ling

2008-01-01

This study developed an interactive multimedia-based software program for Optics instruction, which was expected to overcome the imperfection of traditional optical labs. The researcher evaluated the effectiveness of the program through an experimental study that compared the learning outcomes of the students who used and did not use the software.…

New Tools and Metrics for Evaluating Army Distributed Learning. Monograph

ERIC Educational Resources Information Center

Straus, Susan G.; Shanley, Michael G.; Yeung, Douglas; Rothenberg, Jeff; Steiner, Elizabeth D.; Leuschner, Kristin J.

2011-01-01

Distributed learning (DL) is a key element of the Army's training strategy, and the Army has ambitious goals for expanding the future use of DL and for changing how it is developed and delivered. Program-level evaluation of DL can play an essential role in accomplishing those goals and in identifying strategic directions for the overall program.…

Benefit-Cost Analysis of Undergraduate Education Programs: An Example Analysis of the Freshman Research Initiative

ERIC Educational Resources Information Center

Walcott, Rebecca L.; Corso, Phaedra S.; Rodenbusch, Stacia E.; Dolan, Erin L.

2018-01-01

Institutions and administrators regularly have to make difficult choices about how best to invest resources to serve students. Yet economic evaluation, or the systematic analysis of the relationship between costs and outcomes of a program or policy, is relatively uncommon in higher education. This type of evaluation can be an important tool for…

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

EPA Releases Guidance on a Voluntary Pilot Program to Reduce Animal Testing

EPA Pesticide Factsheets

EPA is announcing the start of a voluntary pilot program to evaluate the usefulness and acceptability of a mathematical tool that estimates the toxicological classification of a chemical, which is used in the GHS.

Wind-energy storage

NASA Technical Reports Server (NTRS)

Gordon, L. H.

1980-01-01

Program SIMWEST can model wind energy storage system using any combination of five types of storage: pumped hydro, battery, thermal, flywheel, and pneumatic. Program is tool to aid design of optional system for given application with realistic simulation for further evaluation and verification.

Mixtures Equation Pilot Program to Reduce Animal Testing

EPA Pesticide Factsheets

EPA is announcing the start of a pilot program to evaluate the usefulness and acceptability of a mathematical tool (the GHS Mixtures Equation), which is used in the Globally Harmonized System of Classification and Labeling of Chemicals (GHS).

Incorporation of lean methodology into pharmacy residency programs.

PubMed

John, Natalie; Snider, Holly; Edgerton, Lisa; Whalin, Laurie

2017-03-15

The implementation of lean methodology into pharmacy residency programs at a community teaching hospital is described. New Hanover Regional Medical Center, a community teaching hospital in southeastern North Carolina, fully adopted a lean culture in 2010. Given the success of lean strategies organizationally, this methodology was used to assist with the evaluation and development of its pharmacy residency programs in 2014. Lean tools and activities have also been incorporated into residency requirements and rotation learning activities. The majority of lean events correspond to the required competency areas evaluating leadership and management, teaching, and education. These events have included participation in and facilitation of various lean problem-solving and communication tools. The application of the 4 rules of lean has resulted in enhanced management of the programs and provides a set of tools by which continual quality improvement can be ensured. Regular communication and direct involvement of all invested parties have been critical in developing and sustaining new improvements. In addition to program enhancements, lean methodology offers novel methods by which residents may be incorporated into leadership activities. The incorporation of lean methodology into pharmacy residency programs has translated into a variety of realized and potential benefits for the programs, the preceptors and residents, and the health system. Specific areas of growth have included quality-improvement processes, the expansion of leadership opportunities for residents, and improved communication among program directors, preceptors, and residents. Copyright © 2017 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

NASA Technical Reports Server (NTRS)

DeMaio, Joe

1998-01-01

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

Validation of the German revised version of the program in palliative care education and practice questionnaire (PCEP-GR).

PubMed

Fetz, Katharina; Wenzel-Meyburg, Ursula; Schulz-Quach, Christian

2017-12-28

The evaluation of the effectiveness of undergraduate palliative care education (UPCE) programs is an essential foundation to providing high-quality UPCE programs. Therefore, the implementation of valid evaluation tools is indispensable. Until today, there has been no general consensus regarding concrete outcome parameters and their accurate measurement. The Program in Palliative Care Education and Practice Questionnaire (German Revised Version; PCEP-GR) is a promising assessment tool for UPCE. The aim of the current study was to evaluate the psychometric properties of PCEP-GR and to demonstrate its feasibility for the evaluation of UPCE programs. The practical feasibility of the PCEP-GR and its acceptance in medical students were investigated in a pilot study with 24 undergraduate medical students at Heinrich Heine University Dusseldorf, Germany. Subsequently, the PCEP-GR was surveyed in a representative sample (N = 680) of medical students in order to investigate its psychometric properties. Factorial validity was investigated by means of principal component analysis (PCA). Reliability was examined by means of split-half-reliability analysis and analysis of internal consistency. After taking into consideration the PCA and distribution analysis results, an evaluation instruction for the PCEP-GR was developed. The PCEP-GR proved to be feasible and well-accepted in medical students. PCA revealed a four-factorial solution indicating four PCEP-GR subscales: preparation to provide palliative care, attitudes towards palliative care, self-estimation of competence in communication with dying patients and their relatives and self-estimation of knowledge and skills in palliative care. The PCEP-GR showed good split-half-reliability and acceptable to good internal consistency of subscales. Attitudes towards palliative care slightly missed the criterion of acceptable internal consistency. The evaluation instruction suggests a global PCEP-GR index and four subscales. The PCEP-GR has proven to be a feasible, economic, valid and reliable tool for the assessment of UPCE that comprises self-efficacy expectation and relevant attitudes towards palliative care.

Integrated modeling of advanced optical systems

NASA Astrophysics Data System (ADS)

Briggs, Hugh C.; Needels, Laura; Levine, B. Martin

1993-02-01

This poster session paper describes an integrated modeling and analysis capability being developed at JPL under funding provided by the JPL Director's Discretionary Fund and the JPL Control/Structure Interaction Program (CSI). The posters briefly summarize the program capabilities and illustrate them with an example problem. The computer programs developed under this effort will provide an unprecedented capability for integrated modeling and design of high performance optical spacecraft. The engineering disciplines supported include structural dynamics, controls, optics and thermodynamics. Such tools are needed in order to evaluate the end-to-end system performance of spacecraft such as OSI, POINTS, and SMMM. This paper illustrates the proof-of-concept tools that have been developed to establish the technology requirements and demonstrate the new features of integrated modeling and design. The current program also includes implementation of a prototype tool based upon the CAESY environment being developed under the NASA Guidance and Control Research and Technology Computational Controls Program. This prototype will be available late in FY-92. The development plan proposes a major software production effort to fabricate, deliver, support and maintain a national-class tool from FY-93 through FY-95.

Knowledge-Acquisition Tool For Expert System

NASA Technical Reports Server (NTRS)

Disbrow, James D.; Duke, Eugene L.; Regenie, Victoria A.

1988-01-01

Digital flight-control systems monitored by computer program that evaluates and recommends. Flight-systems engineers for advanced, high-performance aircraft use knowlege-acquisition tool for expert-system flight-status monitor suppling interpretative data. Interpretative function especially important in time-critical, high-stress situations because it facilitates problem identification and corrective strategy. Conditions evaluated and recommendations made by ground-based engineers having essential knowledge for analysis and monitoring of performances of advanced aircraft systems.

The effectiveness of tools used to evaluate successful critical decision making skills for applicants to healthcare graduate educational programs: a systematic review.

PubMed

Benham, Brian; Hawley, Diane

2015-05-15

Students leave healthcare academic programs for a variety of reasons. When they attrite, it is disappointing for the student as well as their faculty. Advanced practice nursing and other healthcare professions require not only extensive academic preparation, but also the ability to critically evaluate patient care situations. The ability to critically evaluate a situation is not innate. Critical decision making skills are high level skills that are difficult to assess. For the purpose of this review, critical decision making and critical thinking skills refer to the same constructs and will be referred to globally as critical decision making skills. The objective of this review was to identify the effectiveness of tools used to evaluate critical decision making skills for applicants to healthcare graduate educational programs. Adult (18 years of age or older) applicants, students enrolled and/or recent graduates (within one year from completion) of healthcare graduate educational programs. Types of interventions: This review considered studies that evaluated the utilization of unique tools as well as standard tools, such as the Graduate Record Exam or grade point average, to evaluate critical decision making skills in graduate healthcare program applicants. Types of studies: Experimental and non-experimental studies were considered for inclusion. Types of outcomes: Successful quantitative evaluations based on specific field of study standards. The search strategy aimed to find both published and unpublished studies. Studies published in English after 1969 were considered for inclusion in this review. Databases that included both published and unpublished (grey) literature were searched. Additionally, reference lists from all articles retrieved were examined for articles for inclusion. Selected papers were assessed by two independent reviewers using standardized critical appraisal instruments from Joanna Briggs Institute. Any disagreement between reviewers was resolved through discussion or with a third reviewer. Data was extracted independently by each reviewer from papers included in the review using a Microsoft Excel spreadsheet. Included data included study type, 'r' values, number of subjects and reported 'p' values. These were indexed by author, year and study title. The meta-analysis was performed using the method for effect size analysis from Hunter and Schmidt. The syntax for equations was transposed into a Microsoft Excel spreadsheet for data entry, analysis and graph creation. No articles or paper addressing unique tools for ascertaining critical decision making skills met the inclusion criteria. Standard tools, which were represented in the literature, assess critical decision making skills via prediction of academic and clinical success, which indicates the presence of critical decision making skills in graduate healthcare students. A total of 16 studies addressing standard tools were included in this review. All were retrospective case series studies. The date range for the included studies was 1970 to 2009. The strongest relationship was undergraduate grade point average's correlation to graduate grade point average (small effect size with an 'r' value of 0.27, credibility interval of 0.18-0.37). The second strongest relationship was between Graduate Record Examination’s verbal section and graduate grade point average (small effect size with an r value of 0.24, CrI of 0.11-0.37). An applicant’s undergraduate GPA has the strongest correlation with graduate healthcare program success of the indicators analyzed (r = 0.27, small effect size). The next best predictor of graduate healthcare program success was the GRE Verbal score (r = 0.24, small effect size). However, all of the variables carried positive correlations with graduate success, just of lesser effect size strength. This review supports the continued use of traditional indicators of graduate school potential in the undergraduate grade point average and the various sections of the Graduate Record Examination for the selection of graduate healthcare applicants. Primary studies should be funded and performed to assess the use of unique tools in assessing critical thinking in graduate healthcare students. The Joanna Briggs Institute.

Evaluation of reliability modeling tools for advanced fault tolerant systems

NASA Technical Reports Server (NTRS)

Baker, Robert; Scheper, Charlotte

1986-01-01

The Computer Aided Reliability Estimation (CARE III) and Automated Reliability Interactice Estimation System (ARIES 82) reliability tools for application to advanced fault tolerance aerospace systems were evaluated. To determine reliability modeling requirements, the evaluation focused on the Draper Laboratories' Advanced Information Processing System (AIPS) architecture as an example architecture for fault tolerance aerospace systems. Advantages and limitations were identified for each reliability evaluation tool. The CARE III program was designed primarily for analyzing ultrareliable flight control systems. The ARIES 82 program's primary use was to support university research and teaching. Both CARE III and ARIES 82 were not suited for determining the reliability of complex nodal networks of the type used to interconnect processing sites in the AIPS architecture. It was concluded that ARIES was not suitable for modeling advanced fault tolerant systems. It was further concluded that subject to some limitations (the difficulty in modeling systems with unpowered spare modules, systems where equipment maintenance must be considered, systems where failure depends on the sequence in which faults occurred, and systems where multiple faults greater than a double near coincident faults must be considered), CARE III is best suited for evaluating the reliability of advanced tolerant systems for air transport.

GIS in Evaluation: Utilizing the Power of Geographic Information Systems to Represent Evaluation Data

ERIC Educational Resources Information Center

Azzam, Tarek; Robinson, David

2013-01-01

This article provides an introduction to geographic information systems (GIS) and how the technology can be used to enhance evaluation practice. As a tool, GIS enables evaluators to incorporate contextual features (such as accessibility of program sites or community health needs) into evaluation designs and highlights the interactions between…

The Surface Warfare Community’s 360-Degree Feedback Pilot Program: A Preliminary Analysis and Evaluation Plan

DTIC Science & Technology

2005-06-01

the effectiveness of this program as a development tool spurred the remarkable growth of acceptance and use within corporate America. Luthans and...that it is a useful development tool for an organization. The study on upward feedback of student leaders and followers at the United States Naval...The subjects were 978 student leaders in their junior year and 1,232 student followers in their freshman year. The followers provided upward

Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity.

PubMed

Kozica, S L; Lombard, C B; Harrison, C L; Teede, H J

2016-11-24

The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs. A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor. Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m 2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required. Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up. Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

NASA Technical Reports Server (NTRS)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Results of the Clarus regional demonstrations : evaluation of four decision support tools.

DOT National Transportation Integrated Search

2012-01-01

The Clarus Initiative is a research effort of the U.S. Department of Transportation Intelligent Transportation Systems (ITS) Joint Program Offi ce and the Federal Highway Administrations (FHWA) Road Weather Management Program (RWMP) to develop and...

Ohio Uses Wetlands Program Development Grants to Protect Wetlands

EPA Pesticide Factsheets

The wetland water quality standards require the use of ORAM score to determine wetland quality. OEPA has also used these tools to evaluate wetland mitigation projects, develop performance standards for wetland mitigation banks and In Lieu Fee programs an.

EPO Program and Product Evaluation Throughout the Development Lifecycle

NASA Astrophysics Data System (ADS)

Kaiser, C.; Butcher, G. J.

2013-12-01

Evaluation of successful education and public outreach (EPO) programs and products is becoming increasingly important for the continued development of such efforts. This presentation will detail the tools and techniques used to evaluate two EPO efforts- 1) NASA's REEL Science Communications Contest and Video Production Workshop, and 2) the 'Sensors, Circuits, and Satellites' product. A primary challenge with evaluating any EPO product geared towards children and students is the limitation on collecting information from minors. With regards to the REEL Science Contest, over 120 students participated in producing and entering 48 contest entries but because of the Office of Budget and Management (OBM) regulations that restrict collecting feedback from more than nine individuals, we were only able to collect evaluation data from a small subset of this group. The five winning students who participated in the final workshop took part in the evaluation. The benefit of a small group size is that it allowed for more in-depth one-on-one interviews with each student. The feedback collected from this evaluation offered valuable insight into what worked well along with areas of improvement for futures contests and workshops. The REEL Science video contest had another evaluation opportunity since NASA scientists, communications experts, and producers also participated in the program and worked directly with the students. A survey was administered for this audience in an effort to gauge the perceived value and success of the program from the perspective of the originating institution. We found that if a program is well received, the program is more likely to receive future support. Additionally, this component of the program evaluation provided useful feedback and lessons learned to help optimize the role of the internal audience for similar programs in the future. Implementing formative evaluation is key to developing a successful EPO product development. Collecting data at key stages during development allows for modifications and improvements to the product before time and money have been wasted going down the wrong path. Depending on the product and the stage of development, there are several evaluation tools to employ: surveys, observations, expert analysis, heuristic evaluations, feedback forms, diary studies, use case testing and interviews. In the case of developing the 'Sensors, Circuits, and Satellites' product, surveys were collected from teachers and students who participated in the lesson or activity. Audio recordings were also made of the teachers as they completed each activity to collect direct quotes, questions, concerns, and feedback. Facilitators completed feedback forms to capture quotes and observations of the students working through the activities and engaging with the product. All of these data provided valuable insight into the participants' experiences and effectiveness of the product. A complement of tools and techniques is the best approach to evaluating EPO products and programs. These will vary based on application, but can easily be implemented at key points in the development lifecycle to produce feedback and data used to assess and meet EPO goals and objectives.

Logic models as a tool for sexual violence prevention program development.

PubMed

Hawkins, Stephanie R; Clinton-Sherrod, A Monique; Irvin, Neil; Hart, Laurie; Russell, Sarah Jane

2009-01-01

Sexual violence is a growing public health problem, and there is an urgent need to develop sexual violence prevention programs. Logic models have emerged as a vital tool in program development. The Centers for Disease Control and Prevention funded an empowerment evaluation designed to work with programs focused on the prevention of first-time male perpetration of sexual violence, and it included as one of its goals, the development of program logic models. Two case studies are presented that describe how significant positive changes can be made to programs as a result of their developing logic models that accurately describe desired outcomes. The first case study describes how the logic model development process made an organization aware of the importance of a program's environmental context for program success; the second case study demonstrates how developing a program logic model can elucidate gaps in organizational programming and suggest ways to close those gaps.

The West Virginia Special Education Technology Integration Specialist (SETIS) Program: 2012-2014 Evaluation Report

ERIC Educational Resources Information Center

Stohr, Amber D.

2015-01-01

The Special Education Technology Integration Specialist (SETIS) program provides professional development for special education teachers to assist them in achieving proficiency with 21st Century Technology Tools. The program completed its eighth and ninth rounds during the 2012-2013 and 2013-2014 school years, training more than 30 special…

A Computer-Assisted Instruction Unit on Diffusion and Osmosis with a Conceptual Change Design.

ERIC Educational Resources Information Center

Jensen, Murray S.; And Others

1996-01-01

Describes the development, use, and evaluation of the "Osmosis Program" as a teaching tool to elicit and challenge college students' understanding about diffusion and osmosis. Results showed students using the program performed better on a diffusion and osmosis assessment test than students not using the program. (Author/MKR)

Space station interior noise analysis program

NASA Technical Reports Server (NTRS)

Stusnick, E.; Burn, M.

1987-01-01

Documentation is provided for a microcomputer program which was developed to evaluate the effect of the vibroacoustic environment on speech communication inside a space station. The program, entitled Space Station Interior Noise Analysis Program (SSINAP), combines a Statistical Energy Analysis (SEA) prediction of sound and vibration levels within the space station with a speech intelligibility model based on the Modulation Transfer Function and the Speech Transmission Index (MTF/STI). The SEA model provides an effective analysis tool for predicting the acoustic environment based on proposed space station design. The MTF/STI model provides a method for evaluating speech communication in the relatively reverberant and potentially noisy environments that are likely to occur in space stations. The combinations of these two models provides a powerful analysis tool for optimizing the acoustic design of space stations from the point of view of speech communications. The mathematical algorithms used in SSINAP are presented to implement the SEA and MTF/STI models. An appendix provides an explanation of the operation of the program along with details of the program structure and code.

An e-Learning Collaborative Filtering Approach to Suggest Problems to Solve in Programming Online Judges

ERIC Educational Resources Information Center

Toledo, Raciel Yera; Mota, Yailé Caballero

2014-01-01

The paper proposes a recommender system approach to cover online judge's domains. Online judges are e-learning tools that support the automatic evaluation of programming tasks done by individual users, and for this reason they are usually used for training students in programming contest and for supporting basic programming teachings. The…

Predicting Vandalism in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age, and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development model was a community-based planning and procedural tool to enhance and to prevent delinquency through a process of youth needs assessments, needs targeted programs, and program impact evaluation. The program's 12 Impact Scales have been found to have acceptable reliabilities, substantial…

To Be the Best That We Can Be: A Self-Study Guide for Early Childhood Special Education Programs and Staff.

ERIC Educational Resources Information Center

Gaetz, Joan; And Others

This self-study guide facilitates evaluation of early childhood special education programs by providing a tool for identifying both strengths and areas for improvement. Steps are outlined for completing a program self-study. Then forms are offered for assessing the quality of specific program areas. A section on necessary relationships examines…

Tools for Creating Mobile Applications for Extension

ERIC Educational Resources Information Center

Drill, Sabrina L.

2012-01-01

Considerations and tools for developing mobile applications for Extension include evaluating the topic, purpose, and audience. Different computing platforms may be used, and apps designed as modified Web pages or implicitly programmed for a particular platform. User privacy is another important consideration, especially for data collection apps.…

Structured Analysis and the Data Flow Diagram: Tools for Library Analysis.

ERIC Educational Resources Information Center

Carlson, David H.

1986-01-01

This article discusses tools developed to aid the systems analysis process (program evaluation and review technique, Gantt charts, organizational charts, decision tables, flowcharts, hierarchy plus input-process-output). Similarities and differences among techniques, library applications of analysis, structured systems analysis, and the data flow…

Evaluation through research of a three-track career ladder program for registered nurses.

PubMed

Korman, Carol; Eliades, Aris Beoglos

2010-01-01

A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.

Evaluating Internal Communication: The ICA Communication Audit.

ERIC Educational Resources Information Center

Goldhaber, Gerald M.

1978-01-01

The ICA Communication Audit is described in detail as an effective measurement procedure that can help an academic institution to evaluate its internal communication system. Tools, computer programs, analysis, and feedback procedures are described and illustrated. (JMF)

Nuclear medicine and quantitative imaging research (instrumentation and quantitative methods of evaluation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1990-09-01

This report summarizes goals and accomplishments of the research program supported under DOE Grant No. FG02-86ER60418 entitled Instrumentation and Quantitative Methods of Evaluation, with R. Beck, P. I. and M. Cooper, Co-P.I. during the period January 15, 1990 through September 1, 1990. This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development andmore » transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development of new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility. 7 figs.« less

Organization and use of a Software/Hardware Avionics Research Program (SHARP)

NASA Technical Reports Server (NTRS)

Karmarkar, J. S.; Kareemi, M. N.

1975-01-01

The organization and use is described of the software/hardware avionics research program (SHARP) developed to duplicate the automatic portion of the STOLAND simulator system, on a general-purpose computer system (i.e., IBM 360). The program's uses are: (1) to conduct comparative evaluation studies of current and proposed airborne and ground system concepts via single run or Monte Carlo simulation techniques, and (2) to provide a software tool for efficient algorithm evaluation and development for the STOLAND avionics computer.

A novel resident-as-teacher training program to improve and evaluate obstetrics and gynecology resident teaching skills.

PubMed

Ricciotti, Hope A; Dodge, Laura E; Head, Julia; Atkins, K Meredith; Hacker, Michele R

2012-01-01

Residents play a significant role in teaching, but formal training, feedback, and evaluation are needed. Our aims were to assess resident teaching skills in the resident-as-teacher program, quantify correlations of faculty evaluations with resident self-evaluations, compare resident-as-teacher evaluations with clinical evaluations, and evaluate the resident-as-teacher program. The resident-as-teacher training program is a simulated, videotaped teaching encounter with a trained medical student and standardized teaching evaluation tool. Evaluations from the resident-as-teacher training program were compared to evaluations of resident teaching done by faculty, residents, and medical students from the clinical setting. Faculty evaluation of resident teaching skills in the resident-as-teacher program showed a mean total score of 4.5 ± 0.5 with statistically significant correlations between faculty assessment and resident self-evaluations (r = 0.47; p < 0.001). However, resident self-evaluation of teaching skill was lower than faculty evaluation (mean difference: 0.4; 95% CI 0.3-0.6). When compared to the clinical setting, resident-as-teacher evaluations were significantly correlated with faculty and resident evaluations, but not medical student evaluations. Evaluations from both the resident-as-teacher program and the clinical setting improved with duration of residency. The resident-as-teacher program provides a method to train, give feedback, and evaluate resident teaching.

Problem Solving in a Middle School Robotics Design Classroom

NASA Astrophysics Data System (ADS)

Norton, Stephen J.; McRobbie, Campbell J.; Ginns, Ian S.

2007-07-01

Little research has been conducted on how students work when they are required to plan, build and evaluate artefacts in technology rich learning environments such as those supported by tools including flow charts, Labview programming and Lego construction. In this study, activity theory was used as an analytic tool to examine the social construction of meaning. There was a focus on the effect of teachers’ goals and the rules they enacted upon student use of the flow chart planning tool, and the tools of the programming language Labview and Lego construction. It was found that the articulation of a teacher’s goals via rules and divisions of labour helped to form distinct communities of learning and influenced the development of different problem solving strategies. The use of the planning tool flow charting was associated with continuity of approach, integration of problem solutions including appreciation of the nexus between construction and programming, and greater educational transformation. Students who flow charted defined problems in a more holistic way and demonstrated more methodical, insightful and integrated approaches to their use of tools. The findings have implications for teaching in design dominated learning environments.

Enabling Research Tools for Sustained Climate Assessment

NASA Technical Reports Server (NTRS)

Leidner, Allison K.; Bosilovich, Michael G.; Jasinski, Michael F.; Nemani, Ramakrishna R.; Waliser, Duane Edward; Lee, Tsengdar J.

2016-01-01

The U.S. Global Change Research Program Sustained Assessment process benefits from long-term investments in Earth science research that enable the scientific community to conduct assessment-relevant science. To this end, NASA initiated several research programs over the past five years to support the Earth observation community in developing indicators, datasets, research products, and tools to support ongoing and future National Climate Assessments. These activities complement NASA's ongoing Earth science research programs. One aspect of the assessment portfolio funds four "enabling tools" projects at NASA research centers. Each tool leverages existing capacity within the center, but has developed tailored applications and products for National Climate Assessments. The four projects build on the capabilities of a global atmospheric reanalysis (MERRA-2), a continental U.S. land surface reanalysis (NCA-LDAS), the NASA Earth Exchange (NEX), and a Regional Climate Model Evaluation System (RCMES). Here, we provide a brief overview of each enabling tool, highlighting the ways in which it has advanced assessment science to date. We also discuss how the assessment community can access and utilize these tools for National Climate Assessments and other sustained assessment activities.

Distributed learning or medical tourism? A Canadian residency program's experience in global health.

PubMed

Kelly, Kate; McCarthy, Anne; McLean, Laurie

2015-01-01

Global health experiences (GHEs) are becoming increasingly prevalent in surgical residency education. Although it may seem intuitive that participation in GHEs develops CanMEDS competencies, this has not been studied in depth in surgery. The purpose of this study is (1) to explore if and how otolaryngology-head and neck surgery (OHNS) resident participation in GHEs facilitates the development of CanMEDS competencies and (2) to develop an OHNS GHE tool to facilitate the integration of CanMEDS into GHE participation and evaluation. An online survey explored the GHEs of current and past OHNS residents in Canada. Based on the data collected and a literature review, a foundational tool was then created to (1) enable OHNS residents to structure their GHEs into CanMEDS-related learning objectives and (2) enable OHNS program directors to more effectively evaluate residents' GHEs with respect to CanMEDS competencies. Participants' GHEs varied widely. These experiences often contributed informally to the development of several CanMEDS competencies. However, few residents had concrete objectives, rarely were CanMEDS roles clearly incorporated, and most residents were not formally evaluated during their experience. Residents felt they achieved greater learning when predeparture objectives and postexperience reflections were integrated into their GHEs. Although GHEs vary widely, they can serve as valuable forums for developing CanMEDS competencies among participating residents. Without clear objectives that adhere to the CanMEDS framework or formal assessment methods however, residents in GHEs risk becoming medical tourists. The use of an objective and evaluation tool may facilitate the creation of predeparture learning objectives, encourage self-reflection on their GHE, and better enable program directors to evaluate residents participating in GHEs. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

DOCUMENTATION OF STEPS TO ESTABLISH A TECHNICAL COLLEGE, AND THE EVALUATION OF "PERT" AS A PLANNING TOOL FOR EDUCATORS, PHASE I.

ERIC Educational Resources Information Center

MCKEE, ROBERT L.; RIDLEY, KATHRYN J.

TO ESTABLISH A COLLEGE IN 100 DAYS PRESENTED AN OPPORTUNITY TO TEST THE VALUE OF PROGRAMED ORGANIZATIONAL PROCEDURES USING PROGRAM PERFORMANCE EVALUATION AND REVIEW TECHNIQUE (PERT) UNDER ACTUAL OPERATIONAL CONDITIONS, NOT IN A SIMULATED THEORETICAL SITUATION. THROUGH THE AID OF THE PERT PLANNING SYSTEM, IT WAS DETERMINED THAT THERE WERE NINE…

Computer program to assess impact of fatigue and fracture criteria on weight and cost of transport aircraft

NASA Technical Reports Server (NTRS)

Tanner, C. J.; Kruse, G. S.; Oman, B. H.

1975-01-01

A preliminary design analysis tool for rapidly performing trade-off studies involving fatigue, fracture, static strength, weight, and cost is presented. Analysis subprograms were developed for fatigue life, crack growth life, and residual strength; and linked to a structural synthesis module which in turn was integrated into a computer program. The part definition module of a cost and weight analysis program was expanded to be compatible with the upgraded structural synthesis capability. The resultant vehicle design and evaluation program is named VDEP-2. It is an accurate and useful tool for estimating purposes at the preliminary design stage of airframe development. A sample case along with an explanation of program applications and input preparation is presented.

A scoping review of assessment tools for laparoscopic suturing.

PubMed

Bilgic, Elif; Endo, Satoshi; Lebedeva, Ekaterina; Takao, Madoka; McKendy, Katherine M; Watanabe, Yusuke; Feldman, Liane S; Vassiliou, Melina C

2018-05-03

A needs assessment identified a gap in teaching and assessment of laparoscopic suturing (LS) skills. The purpose of this review is to identify assessment tools that were used to assess LS skills, to evaluate validity evidence available, and to provide guidance for selecting the right assessment tool for specific assessment conditions. Bibliographic databases were searched till April 2017. Full-text articles were included if they reported on assessment tools used in the operating room/simulation to (1) assess procedures that require LS or (2) specifically assess LS skills. Forty-two tools were identified, of which 26 were used for assessing LS skills specifically and 26 for procedures that require LS. Tools had the most evidence in internal structure and relationship to other variables, and least in consequences. Through identification and evaluation of assessment tools, the results of this review could be used as a guideline when implementing assessment tools into training programs.

A GIS-based approach for the screening assessment of noise and vibration impacts from transit projects.

PubMed

Hamed, Maged; Effat, Waleed

2007-08-01

Urban transportation projects are essential in increasing the efficiency of moving people and goods within a city, and between cities. Environmental impacts from such projects must be evaluated and mitigated, as applicable. Spatial modeling is a valuable tool for quantifying the potential level of environmental consequences within the context of an environmental impact assessment (EIA) study. This paper presents a GIS-based tool for the assessment of airborne-noise and ground-borne vibration from public transit systems, and its application to an actual project. The tool is based on the US Federal Transit Administration's (FTA) approach, and incorporates spatial information, satellite imaging, geostatistical modeling, and software programming. The tool is applied on a case study of initial environmental evaluation of a light rail transit project in an urban city in the Middle East, to evaluate alternative layouts. The tool readily allowed the alternative evaluation and the results were used as input to a multi-criteria analytic framework.

Assessment of Evidence-based Management Training Program: Application of a Logic Model.

PubMed

Guo, Ruiling; Farnsworth, Tracy J; Hermanson, Patrick M

2016-06-01

The purposes of this study were to apply a logic model to plan and implement an evidence-based management (EBMgt) educational training program for healthcare administrators and to examine whether a logic model is a useful tool for evaluating the outcomes of the educational program. The logic model was used as a conceptual framework to guide the investigators in developing an EBMgt educational training program and evaluating the outcomes of the program. The major components of the logic model were constructed as inputs, outputs, and outcomes/impacts. The investigators delineated the logic model based on the results of the needs assessment survey. Two 3-hour training workshops were delivered to 30 participants. To assess the outcomes of the EBMgt educational program, pre- and post-tests and self-reflection surveys were conducted. The data were collected and analyzed descriptively and inferentially, using the IBM Statistical Package for the Social Sciences (SPSS) 22.0. A paired sample t-test was performed to compare the differences in participants' EBMgt knowledge and skills prior to and after the training. The assessment results showed that there was a statistically significant difference in participants' EBMgt knowledge and information searching skills before and after the training (p< 0.001). Participants' confidence in using the EBMgt approach for decision-making was significantly increased after the training workshops (p< 0.001). Eighty-three percent of participants indicated that the knowledge and skills they gained through the training program could be used for future management decision-making in their healthcare organizations. The overall evaluation results of the program were positive. It is suggested that the logic model is a useful tool for program planning, implementation, and evaluation, and it also improves the outcomes of the educational program.

Flight Experiment Verification of Shuttle Boundary Layer Transition Prediction Tool

NASA Technical Reports Server (NTRS)

Berry, Scott A.; Berger, Karen T.; Horvath, Thomas J.; Wood, William A.

2016-01-01

Boundary layer transition at hypersonic conditions is critical to the design of future high-speed aircraft and spacecraft. Accurate methods to predict transition would directly impact the aerothermodynamic environments used to size a hypersonic vehicle's thermal protection system. A transition prediction tool, based on wind tunnel derived discrete roughness correlations, was developed and implemented for the Space Shuttle return-to-flight program. This tool was also used to design a boundary layer transition flight experiment in order to assess correlation uncertainties, particularly with regard to high Mach-number transition and tunnel-to-flight scaling. A review is provided of the results obtained from the flight experiment in order to evaluate the transition prediction tool implemented for the Shuttle program.

The Handbook of Leadership Development Evaluation

ERIC Educational Resources Information Center

Hannum, Kelly M., Ed.; Martineau, Jennifer W., Ed.; Reinelt, Claire, Ed.

2007-01-01

With the increase in the number of organizational leadership development programs, there is a pressing need for evaluation to answer important questions, improve practice, and inform decisions. The Handbook is a comprehensive resource filled with examples, tools, and the most innovative models and approaches designed to evaluate leadership…

An Evaluator of the Future.

ERIC Educational Resources Information Center

Hargreaves, William; Attkisson, C. Clifford

1978-01-01

For the evaluator, future expectations will be more demanding than at present. Operating staff, managers, and funders will be familiar with the program evaluation. Improved information tools will help by keeping the organization visible and manageable. A more fundamental change will be an improved "language of accountability." (Author/CTM)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Montano, Joshua Daniel

The following report is a review of ToolingU, an online manufacturing training website. ToolingU provided the author with a trail account where a number of courses were taken and the overall program was evaluated. A review of the classes revealed that most of the offerings directly align with work at the Laboratory. Ease of use, effectiveness of the system and price all make ToolingU an attractive option for manufacturing training needs.

Critical thinking as an educational outcome: an evaluation of current tools of measurement.

PubMed

Adams, M H; Whitlow, J F; Stover, L M; Johnson, K W

1996-01-01

Critical thinking, an outcome criterion of the National League for Nursing and the Council of Baccalaureate and Higher Degree Programs, is an abstract skill difficult to measure. The authors provide a comprehensive review of four instruments designed to measure critical thinking and summarize research in which the tools were used. Analysis of this information will empower nursing faculty members to select a critical-thinking instrument that is individualized to the needs of their respective nursing programs.

Psychometric Properties of an Intimate Partner Violence Tool for Health Care Students

ERIC Educational Resources Information Center

Connor, Pamela D.; Nouer, Simonne S.; Mackey, See Trail N.; Tipton, Nathan G.; Lloyd, Angela K.

2011-01-01

Health care professionals have acknowledged intimate partner violence (IPV) as a highly prevalent public health problem necessitating the creation of standardized education programs, survey tools, and well-defined outcome measures. Testing and evaluation of these measures, however, has been limited to specific populations of health care…

The Personnel Effectiveness Grid (PEG): A New Tool for Estimating Personnel Department Effectiveness

ERIC Educational Resources Information Center

Petersen, Donald J.; Malone, Robert L.

1975-01-01

Examines the difficulties inherent in attempting a formal personnel evaluation system, the major formal methods currently used for evaluating personnel department accountabilities, some parameters that should be part of a valid evaluation program, and a model for conducting the evaluation. (Available from Office of Publications, Graduate School of…

Providing Appropriate Evaluative Support for Valuing in the Public Interest

ERIC Educational Resources Information Center

Julnes, George; Bustelo, Maria

2016-01-01

Evaluation is increasingly accepted as a tool for understanding and assessing the value of public programs and policies. Less understood, however, is how and why evaluation helps to inform judgments of value. This "American Journal of Evaluation" ("AJE") section on Professional Values and Ethics focuses on how values are to…

[Assessing program sustainability in public health organizations: a tool-kit application in Haiti].

PubMed

Ridde, V; Pluye, P; Queuille, L

2006-10-01

Public health stakeholders are concerned about program sustainability. However, they usually conceive sustainability in accordance with financial criteria for at least one reason. No simple frameworks are operationally and theoretically sound enough to globally evaluate program sustainability. The present paper aims to describe an application of one framework assessment tool used to evaluate the sustainability level and process of a Nutritional Care Unit managed by a Swiss humanitarian agency to fight against severe child malnutrition in a Haitian area. The managing agency is committed to put this Unit back into the structure of a local public hospital. The evaluation was performed within the sustainability framework proposed in a former article. Data were collected with a combination of tools, semi-structured interviews (n=33, medical and support staff from the agency and the hospital), participatory observation and document review. Data concerned the four characteristics of organizational routines (memory, adaptation, values and rules) enabling assess to the level of sustainability. In addition, data were related to three types of events distinguishing routinization processes from implementation processes: specific events of routinization, routinization-implementation joint events, and specific events of implementation. Data analysis was thematic and results were validated by actors through a feed-back session and written comments. The current level of sustainability of the Nutritional Care Unit within the Hospital is weak: weak memory, high adaptation, weak sharing of values and rules. This may be explained by the sustainability process, and the absence of specific routinization events. The relevance of such processes is reasonable, while it has been strongly challenged in the troublesome Haitian context. Riots have been widespread over the last years, creating difficulties for the Hospital. This experience suggests the proposed framework and sustainability assessment tools are useful when the context permits scrutinization of program sustainability.

WINCADRE (COMPUTER-AIDED DATA REVIEW AND EVALUATION)

EPA Science Inventory

WinCADRE (Computer-Aided Data Review and Evaluation) is a Windows -based program designed for computer-assisted data validation. WinCADRE is a powerful tool which significantly decreases data validation turnaround time. The electronic-data-deliverable format has been designed ...

Feasibility Assessment of ITS Deployment Analysis System (IDAS) for ITS Evaluation

DOT National Transportation Integrated Search

2003-12-01

This study investigated the feasibility of utilizing the ITS Deployment Analysis System (IDAS) program version 2.2 as a tool for evaluating Intelligent Transportation Systems (ITS) deployment plans. Firstly, an online survey was conducted among metro...

The importance of employing computational resources for the automation of drug discovery.

PubMed

Rosales-Hernández, Martha Cecilia; Correa-Basurto, José

2015-03-01

The application of computational tools to drug discovery helps researchers to design and evaluate new drugs swiftly with a reduce economic resources. To discover new potential drugs, computational chemistry incorporates automatization for obtaining biological data such as adsorption, distribution, metabolism, excretion and toxicity (ADMET), as well as drug mechanisms of action. This editorial looks at examples of these computational tools, including docking, molecular dynamics simulation, virtual screening, quantum chemistry, quantitative structural activity relationship, principal component analysis and drug screening workflow systems. The authors then provide their perspectives on the importance of these techniques for drug discovery. Computational tools help researchers to design and discover new drugs for the treatment of several human diseases without side effects, thus allowing for the evaluation of millions of compounds with a reduced cost in both time and economic resources. The problem is that operating each program is difficult; one is required to use several programs and understand each of the properties being tested. In the future, it is possible that a single computer and software program will be capable of evaluating the complete properties (mechanisms of action and ADMET properties) of ligands. It is also possible that after submitting one target, this computer-software will be capable of suggesting potential compounds along with ways to synthesize them, and presenting biological models for testing.

Evaluating a program to build data capacity for core public health functions in local maternal child and adolescent health programs in california.

PubMed

Oliva, Geraldine; Rienks, Jennifer; Chavez, Gilberto F

2007-01-01

To improve local Maternal and Child Health programs' capacity to collect and analyze data to support core public health functions, the California Maternal and Child Health Branch (CAMCHB) and the University of California San Francisco Family Health Outcomes project (FHOP) entered into a cooperative agreement. FHOP utilizes a 6-pronged strategy: face-to-face training, telephone technical assistance, on-site consultation, development of automated analytic tools, development of written guidelines, and web dissemination of data and materials. We evaluated the acceptability and effectiveness of these approaches. Local Health Jurisdiction (LHJ) staff completed a self-administered questionnaire on use of and satisfaction with FHOP's services. A 34-item assessment tool was used to independently evaluate each 5-year community assessment plan submitted by LHJs to the CAMCHB. Administrative data on the use of FHOP's service was also considered. Correlational analyses were done to determine if use of FHOP services and materials was related to more adequate plans. LHJs with higher overall adequacy scores on their plans had an overall higher level of use of FHOP's products and services. LHJs with higher adequacy scores reported calling FHOP for technical assistance more frequently, using FHOP's book - "Developing an Effective Planning Process: A Guide for Local MCH Programs," and using FHOP's automated tools including EpiBC, an EpiINFO based program for birth certificate analysis, and Microsoft Excel data analysis templates. This 6-pronged strategy is well utilized and accepted by local MCH staff and appears to have some degree of association with better quality of local MCH plan documents.

Evaluation as a critical factor of success in local public health accreditation programs.

PubMed

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Evaluating the Effectiveness of Self-Created Student Screencasts as a Tool to Increase Student Learning Outcomes in a Hands-On Computer Programming Course

ERIC Educational Resources Information Center

Powell, Loreen M.; Wimmer, Hayden

2015-01-01

Computer programming is challenging to teach and difficult for students to learn. Instructors have searched for ways to improve student learning in programming courses. In an attempt to foster hands-on learning and to increase student learning outcomes in a programming course, the authors conducted an exploratory study to examine student created…

Visualization of Concurrent Program Executions

NASA Technical Reports Server (NTRS)

Artho, Cyrille; Havelund, Klaus; Honiden, Shinichi

2007-01-01

Various program analysis techniques are efficient at discovering failures and properties. However, it is often difficult to evaluate results, such as program traces. This calls for abstraction and visualization tools. We propose an approach based on UML sequence diagrams, addressing shortcomings of such diagrams for concurrency. The resulting visualization is expressive and provides all the necessary information at a glance.

Step-by-Step Guide to Effective PR for Large & Small School Districts. Special Bulletin No. 3.

ERIC Educational Resources Information Center

School Information and Research Service, Olympia, WA.

This guide to formulating and carrying out an effective school public relations program includes articles drawn from public relations and communications journals. The articles deal with planning public relations programs, communicating with the public and the news media, program evaluation, and the tools of communication, including newsletters,…

Evaluating the Facilities Planning, Design, and Construction Department: The Capital Programs Management Audit.

ERIC Educational Resources Information Center

Kaiser, Harvey H.; Kirkwood, Dennis M.

2000-01-01

Presents a diagnostic model for assessing the state of an institution's capital programs management (CPM) by delineating "work processes" which comprise that function. What capital programs management is, its resources, and its phases and work processes are described, followed by case studies of the CPM Process Model as an assessment tool. (GR)

Using Concept Mapping as as Tool for Program Theory Development

ERIC Educational Resources Information Center

Orsi, Rebecca

2011-01-01

The purpose of this methodological study is to explore how well a process called "concept mapping" (Trochim, 1989) can articulate the theory which underlies a social program. Articulation of a program's theory is a key step in completing a sound theory based evaluation (Weiss, 1997a). In this study, concept mapping is used to…

Neurobiological Formulations: Integrating Clinical and Biological Psychiatry

ERIC Educational Resources Information Center

Posner, Jonathan; Stewart, Jonathan; Rieder, Ronald

2007-01-01

Objective: The authors describe a pilot program allowing psychiatric residents to participate in neurobiological evaluations of patients with Axis I disorders. The program aimed to familiarize residents with available tools for assessing cognitive and neuroanatomical abnormalities in psychiatric patients and to foster greater interest among…

INTRINSIC BIOREMEDIATION OF A PETROLEUM-IMPACTED WETLAND

EPA Science Inventory

Following the 1994 San Jacinto River flood and oil spill in southeast Texas, a petroleum-contaminated wetland was reserved for a long-term research program to evaluate bioremediation as a viable spill response tool. The first phase of this program, presented in this paper, evalua...

ENVIRONMENTAL MONITORING AND ASSESSMENT PROGRAM-SURFACE WATERS WESTERN PILOT STUDY: FIELD OPERATIONS MANUAL FOR WADEABLE STREAMS

EPA Science Inventory

This document describes field procedures that were used during the Environmental Monitoring and Assessment Program (EMAP) Western Pilot Study, conducted from 1999 through 2004. Objectives for EMAP involve developing appropriate scientific and technical tools for evaluating ecolo...

Program evaluation of a model to integrate internationally educated health professionals into clinical practice

PubMed Central

2013-01-01

Background The demand for health professionals continues to increase, partially due to the aging population and the high proportion of practitioners nearing retirement. The University of British Columbia (UBC) has developed a program to address this demand, by providing support for internationally trained Physiotherapists in their preparation for taking the National Physiotherapy competency examinations. The aim was to create a program comprised of the educational tools and infrastructure to support internationally educated physiotherapists (IEPs) in their preparation for entry to practice in Canada and, to improve their pass rate on the national competency examination. Methods The program was developed using a logic model and evaluated using program evaluation methodology. Program tools and resources included educational modules and curricular packages which were developed and refined based on feedback from clinical experts, IEPs and clinical physical therapy mentors. An examination bank was created and used to include test-enhanced education. Clinical mentors were recruited and trained to provide clinical and cultural support for participants. Results The IEP program has recruited 124 IEPs, with 69 now integrated into the Canadian physiotherapy workforce, and more IEPs continuing to apply to the program. International graduates who participated in the program had an improved pass rate on the national Physiotherapy Competency Examination (PCE); participation in the program resulted in them having a 28% (95% CI, 2% to 59%) greater possibility of passing the written section than their counterparts who did not take the program. In 2010, 81% of all IEP candidates who completed the UBC program passed the written component, and 82% passed the clinical component. Conclusion The program has proven to be successful and sustainable. This program model could be replicated to support the successful integration of other international health professionals into the workforce. PMID:24119470

Space station common module power system network topology and hardware development

NASA Technical Reports Server (NTRS)

Landis, D. M.

1985-01-01

Candidate power system newtork topologies for the space station common module are defined and developed and the necessary hardware for test and evaluation is provided. Martin Marietta's approach to performing the proposed program is presented. Performance of the tasks described will assure systematic development and evaluation of program results, and will provide the necessary management tools, visibility, and control techniques for performance assessment. The plan is submitted in accordance with the data requirements given and includes a comprehensive task logic flow diagram, time phased manpower requirements, a program milestone schedule, and detailed descriptions of each program task.

Evaluation of Time Domain EM Coupling Techniques. Volume II.

DTIC Science & Technology

1980-08-01

tool for the analysis of elec- tromangetic coupling and shielding problems: the finite-difference, time-domain (FD- TD ) solution of Maxwell’s equations...The objective of the program was to evaluate the suitability of the FD- TD method to determine the amount of electromagnetic coupling through an...specific questfiowwere addressed during this program: 1. Can the FD- TD method accurately model electromagnetic coupling into a conducting structure for

Development of a Program Manager/User Communication Evaluation Tool.

DTIC Science & Technology

1987-09-01

Multinovich and Vlahovich , 1984; Packard and others, 1986; Smith, 1982; Wynn, 1981) but the program manager is left to his own means to evaluate communications...transferred to the user (Multinovich and Vlahovich , 1984:8). Translating the identified need into an engineering concept, choosing the prime developer...Kelly, 1984; Multinovich and Vlahovich , 1984; Smith, 1982; Wynn, 1981). Professionals in the field of communications have done extensive work to

Human Factors Evaluations of Two-Dimensional Spacecraft Conceptual Layouts

NASA Technical Reports Server (NTRS)

Kennedy, Kriss J.; Toups, Larry D.; Rudisill, Marianne

2010-01-01

Much of the human factors work done in support of the NASA Constellation lunar program has been with low fidelity mockups. These volumetric replicas of the future lunar spacecraft allow researchers to insert test subjects from the engineering and astronaut population and evaluate the vehicle design as the test subjects perform simulations of various operational tasks. However, lunar outpost designs must be evaluated without the use of mockups, creating a need for evaluation tools that can be performed on two-dimension conceptual spacecraft layouts, such as floor plans. A tool based on the Cooper- Harper scale was developed and applied to one lunar scenario, enabling engineers to select between two competing floor plan layouts. Keywords: Constellation, human factors, tools, processes, habitat, outpost, Net Habitable Volume, Cooper-Harper.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

Advanced composite elevator for Boeing 727 aircraft, volume 2

NASA Technical Reports Server (NTRS)

Chovil, D. V.; Grant, W. D.; Jamison, E. S.; Syder, H.; Desper, O. E.; Harvey, S. T.; Mccarty, J. E.

1980-01-01

Preliminary design activity consisted of developing and analyzing alternate design concepts and selecting the optimum elevator configuration. This included trade studies in which durability, inspectability, producibility, repairability, and customer acceptance were evaluated. Preliminary development efforts consisted of evaluating and selecting material, identifying ancillary structural development test requirements, and defining full scale ground and flight test requirements necessary to obtain Federal Aviation Administration (FAA) certification. After selection of the optimum elevator configuration, detail design was begun and included basic configuration design improvements resulting from manufacturing verification hardware, the ancillary test program, weight analysis, and structural analysis. Detail and assembly tools were designed and fabricated to support a full-scope production program, rather than a limited run. The producibility development programs were used to verify tooling approaches, fabrication processes, and inspection methods for the production mode. Quality parts were readily fabricated and assembled with a minimum rejection rate, using prior inspection methods.

An investigation of the validity of the Work Assessment Triage Tool clinical decision support tool for selecting optimal rehabilitation interventions for workers with musculoskeletal injuries.

PubMed

Qin, Ziling; Armijo-Olivo, Susan; Woodhouse, Linda J; Gross, Douglas P

2016-03-01

To evaluate the concurrent validity of a clinical decision support tool (Work Assessment Triage Tool (WATT)) developed to select rehabilitation treatments for injured workers with musculoskeletal conditions. Methodological study with cross-sectional and prospective components. Data were obtained from the Workers' Compensation Board of Alberta rehabilitation facility in Edmonton, Canada. A total of 432 workers' compensation claimants evaluated between November 2011 and June 2012. Percentage agreement between the Work Assessment Triage Tool and clinician recommendations was used to determine concurrent validity. In claimants returning to work, frequencies of matching were calculated and compared between clinician and Work Assessment Triage Tool recommendations and the actual programs undertaken by claimants. The frequency of each intervention recommended by clinicians, Work Assessment Triage Tool, and case managers were also calculated and compared. Percentage agreement between clinician and Work Assessment Triage Tool recommendations was poor (19%) to moderate (46%) and Kappa = 0.37 (95% CI -0.02, 0.76). The Work Assessment Triage Tool did not improve upon clinician recommendations as only 14 out of 31 claimants returning to work had programs that contradicted clinician recommendations, but were consistent with Work Assessment Triage Tool recommendations. Clinicians and case managers were inclined to recommend functional restoration, physical therapy, or no rehabilitation while the Work Assessment Triage Tool recommended additional evidence-based interventions, such as workplace-based interventions. Our findings do not provide evidence of concurrent validity for the Work Assessment Triage Tool compared with clinician recommendations. Based on these results, we cannot recommend further implementation of the Work Assessment Triage Tool. However, the Work Assessment Triage Tool appeared more likely than clinicians to recommend interventions supported by evidence; thus warranting further research. © The Author(s) 2015.

An international, multidisciplinary, service-learning program: an option in the dental school curriculum.

PubMed

Martinez-Mier, Esperanza A; Soto-Rojas, Armando E; Stelzner, Sarah M; Lorant, Diane E; Riner, Mary E; Yoder, Karen M

2011-04-01

Many health professions students who treat Spanish-speaking patients in the United States have little concept of their culture and health related traditions. The lack of understanding of these concepts may constitute major barriers to healthcare for these patients. International service-learning experiences allow students to work directly in communities from which patients immigrate and, as a result, students gain a better understanding of these barriers. This article describes the implementation of an international, multidisciplinary, service-learning program in a dental school in the United States. The Indiana University International Service-Learning program in Hidalgo, Mexico began in 1999 as an alternative spring break travel and clinical experience for medical students, focusing on the treatment of acute health problems. Travel-related preparatory sessions were offered, and no learning or service objectives had been developed. The program has evolved to include a multidisciplinary team of dental, medical, nursing, public health and social work students and faculty. The experience is now integrated into a curriculum based on the service-learning model that allows students to use their clinical skills in real-life situations and provides structured time for reflection. The program aims to enhance teaching and foster civic responsibility in explicit partnership with the community. Preparatory sessions have evolved into a multidisciplinary graduate level course with defined learning and service objectives. PROGRAM EVALUATION METHODS: In order to assess the program's operation as perceived by students and faculty and to evaluate student's perceptions of learning outcomes, evaluation tools were developed. These tools included student and faculty evaluation questionnaires, experiential learning journals, and a strengths, weaknesses, opportunities and threats analysis. Evaluation data show that after program participation, students perceived an increase in their cultural awareness, cross-cultural communication skills and understanding of barriers and disparities faced by Latinos in the United States. Faculty evaluations offer insights into the lessons learned through the implementation process. The development of a service-learning based curriculum has posed challenges but has enriched international service experiences.

Development and implementation of a competency-based clinical evaluation tool for midwifery education.

PubMed

Woeber, Kate

2018-07-01

The learning goals and evaluation strategies of competency-based midwifery programs must be explicit and well-defined. In the US, didactic learning is evaluated through a standardized certification examination, but standardized clinical competence evaluation is lacking. The Midwifery Competency Assessment Tool (MCAT) has been adapted from the International Confederation of Midwives' (ICM) "Essential Competencies" and from the American College of Nurse-Midwives' (ACNM) "Core Competencies", with student self-evaluation based on Benner's Novice-to-Expert theory. The MCAT allows for the measurement and monitoring of competence development in all domains of full-scope practice over the course of the midwifery program. Strengths of the MCAT are that it provides clear learning goals and performance evaluations for students, ensures and communicates content mapping across a curriculum, and highlights strengths and gaps in clinical opportunities at individual clinical sites and for entire programs. Challenges of the MCAT lie in balancing the number of competency items to be measured with the tedium of form completion, in ensuring the accuracy of student self-evaluation, and in determining "adequate" competence achievement when particular clinical opportunities are limited. Use of the MCAT with competency-based clinical education may facilitate a more standardized approach to clinical evaluation, as well as a more strategic approach to clinical site development and use. Copyright © 2018 Elsevier Ltd. All rights reserved.

Maternal influenza immunization in Malawi: Piloting a maternal influenza immunization program costing tool by examining a prospective program

PubMed Central

Pecenka, Clint; Munthali, Spy; Chunga, Paul; Levin, Ann; Morgan, Win; Lambach, Philipp; Bhat, Niranjan; Neuzil, Kathleen M.; Ortiz, Justin R.

2017-01-01

Background This costing study in Malawi is a first evaluation of a Maternal Influenza Immunization Program Costing Tool (Costing Tool) for maternal immunization. The tool was designed to help low- and middle-income countries plan for maternal influenza immunization programs that differ from infant vaccination programs because of differences in the target population and potential differences in delivery strategy or venue. Methods This analysis examines the incremental costs of a prospective seasonal maternal influenza immunization program that is added to a successful routine childhood immunization and antenatal care program. The Costing Tool estimates financial and economic costs for different vaccine delivery scenarios for each of the major components of the expanded immunization program. Results In our base scenario, which specifies a donated single dose pre-filled vaccine formulation, the total financial cost of a program that would reach 2.3 million women is approximately $1.2 million over five years. The economic cost of the program, including the donated vaccine, is $10.4 million over the same period. The financial and economic costs per immunized pregnancy are $0.52 and $4.58, respectively. Other scenarios examine lower vaccine uptake, reaching 1.2 million women, and a vaccine purchased at $2.80 per dose with an alternative presentation. Conclusion This study estimates the financial and economic costs associated with a prospective maternal influenza immunization program in a low-income country. In some scenarios, the incremental delivery cost of a maternal influenza immunization program may be as low as some estimates of childhood vaccination programs, assuming the routine childhood immunization and antenatal care systems are capable of serving as the platform for an additional vaccination program. However, purchasing influenza vaccines at the prices assumed in this analysis, instead of having them donated, is likely to be challenging for lower-income countries. This result should be considered as a starting point to understanding the costs of maternal immunization programs in low- and middle-income countries. PMID:29281710

Maternal influenza immunization in Malawi: Piloting a maternal influenza immunization program costing tool by examining a prospective program.

PubMed

Pecenka, Clint; Munthali, Spy; Chunga, Paul; Levin, Ann; Morgan, Win; Lambach, Philipp; Bhat, Niranjan; Neuzil, Kathleen M; Ortiz, Justin R; Hutubessy, Raymond

2017-01-01

This costing study in Malawi is a first evaluation of a Maternal Influenza Immunization Program Costing Tool (Costing Tool) for maternal immunization. The tool was designed to help low- and middle-income countries plan for maternal influenza immunization programs that differ from infant vaccination programs because of differences in the target population and potential differences in delivery strategy or venue. This analysis examines the incremental costs of a prospective seasonal maternal influenza immunization program that is added to a successful routine childhood immunization and antenatal care program. The Costing Tool estimates financial and economic costs for different vaccine delivery scenarios for each of the major components of the expanded immunization program. In our base scenario, which specifies a donated single dose pre-filled vaccine formulation, the total financial cost of a program that would reach 2.3 million women is approximately $1.2 million over five years. The economic cost of the program, including the donated vaccine, is $10.4 million over the same period. The financial and economic costs per immunized pregnancy are $0.52 and $4.58, respectively. Other scenarios examine lower vaccine uptake, reaching 1.2 million women, and a vaccine purchased at $2.80 per dose with an alternative presentation. This study estimates the financial and economic costs associated with a prospective maternal influenza immunization program in a low-income country. In some scenarios, the incremental delivery cost of a maternal influenza immunization program may be as low as some estimates of childhood vaccination programs, assuming the routine childhood immunization and antenatal care systems are capable of serving as the platform for an additional vaccination program. However, purchasing influenza vaccines at the prices assumed in this analysis, instead of having them donated, is likely to be challenging for lower-income countries. This result should be considered as a starting point to understanding the costs of maternal immunization programs in low- and middle-income countries.

Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences.

PubMed

Harman, Elena; Azzam, Tarek

2018-02-01

This exploratory study examines a novel tool for validating program theory through crowdsourced qualitative analysis. It combines a quantitative pattern matching framework traditionally used in theory-driven evaluation with crowdsourcing to analyze qualitative interview data. A sample of crowdsourced participants are asked to read an interview transcript and identify whether program theory components (Activities and Outcomes) are discussed and to highlight the most relevant passage about that component. The findings indicate that using crowdsourcing to analyze qualitative data can differentiate between program theory components that are supported by a participant's experience and those that are not. This approach expands the range of tools available to validate program theory using qualitative data, thus strengthening the theory-driven approach. Copyright © 2017 Elsevier Ltd. All rights reserved.

Impact of Parameter Uncertainty Assessment of Critical SWAT Output Simulations

USDA-ARS?s Scientific Manuscript database

Watershed models are increasingly being utilized to evaluate alternate management scenarios for improving water quality. The concern for using these tools in extensive programs such as the National Total Maximum Daily Load (TMDL) program is that the certainty of model results and efficacy of managem...

QUANTITATIVE DECISION TOOLS AND MANAGEMENT DEVELOPMENT PROGRAMS.

ERIC Educational Resources Information Center

BYARS, LLOYD L.; NUNN, GEOFFREY E.

THIS ARTICLE OUTLINED THE CURRENT STATUS OF QUANTITATIVE METHODS AND OPERATIONS RESEARCH (OR), SKETCHED THE STRENGTHS OF TRAINING EFFORTS AND ISOLATED WEAKNESSES, AND FORMULATED WORKABLE CRITERIA FOR EVALUATING SUCCESS OF OPERATIONS RESEARCH TRAINING PROGRAMS. A SURVEY OF 105 COMPANIES REVEALED THAT PERT, INVENTORY CONTROL THEORY AND LINEAR…

Logic Modeling as a Tool to Prepare to Evaluate Disaster and Emergency Preparedness, Response, and Recovery in Schools

ERIC Educational Resources Information Center

Zantal-Wiener, Kathy; Horwood, Thomas J.

2010-01-01

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

Personal digital assistant use in Florida obstetrics and gynecology residency programs.

PubMed

Joy, Saju; Benrubi, Guy

2004-05-01

Improvements in electronic technologies have resulted in affordable, smaller computers that operate at faster speeds. The personal digital assistant (PDA) is a tool that has the potential to enhance residency education by allowing residents immediate access to an abundance of information. This article assesses the current use of this tool at obstetrics and gynecology residency programs in the state of Florida. The authors conducted a statewide survey addressing the general question: is the PDA useful in an obstetrics and gynecology residency training program? Specifically, the authors asked residents how much time was perceived to be saved weekly with the use of this tool, and in what aspect of their training use of this tool was most helpful. At the survey's close, five of seven programs had returned the survey for evaluation. These five institutions included both university- and community-based residency programs. Forty percent of obstetrics and gynecology residents at these programs responded to this questionnaire. Resident responses to the survey revealed that most of the perceived benefit was in maintaining procedural statistics logs, pharmacology reference manuals, and personal clinical protocols. Most responses revealed that only minimal time savings (<2 h/wk) were gained with using this tool. However, many residents felt they were not using this tool to its maximum potential. Nearly 90% of those who responded felt that the PDA should be available at residency programs and anticipated using it after completing residency. This study posed the question of PDA usefulness at obstetric and gynecology residency programs in the state of Florida. Although not all programs provided their residents with a PDA, 95% of the respondents revealed that they owned one of these tools. Experience at the authors' institution revealed high expectations for the potential uses of a PDA. Although many residents were not using this tool to its full potential, a PDA tutorial session could educate residents on the many applications available for PDAs, including applications to maintain on-call schedules and sign-out lists, statistics and procedure logs for credentialing and board certification, electronic billing, and electronic prescriptions.

Development of a metrics dashboard for monitoring involvement in the 340B Drug Pricing Program.

PubMed

Karralli, Rusol; Tipton, Joyce; Dumitru, Doina; Scholz, Lisa; Masilamani, Santhi

2015-09-01

An electronic tool to support hospital organizations in monitoring and addressing financial and compliance challenges related to participation in the 340B Drug Pricing Program is described. In recent years there has been heightened congressional and regulatory scrutiny of the federal 340B program, which provides discounted drug prices on Medicaid-covered drugs to safety net hospitals and other 340B-eligible healthcare organizations, or "covered entities." Historically, the 340B program has lacked a metrics-driven reporting framework to help covered entities capture the value of 340B program involvement, community benefits provided to underserved populations, and costs associated with compliance with 340B eligibility requirements. As part of an initiative by a large health system to optimize its 340B program utilization and regulatory compliance efforts, a team of pharmacists led the development of an electronic dashboard tool to help monitor 340B program activities at the system's 340B-eligible facilities. After soliciting input from an array of internal and external 340B program stakeholders, the team designed the dashboard and associated data-entry tools to facilitate the capture and analysis of 340B program-related data in four domains: cost savings and revenue, program maintenance costs, community benefits, and compliance. A large health system enhanced its ability to evaluate and monitor 340B program-related activities through the use of a dashboard tool capturing key metrics on cost savings achieved, maintenance costs, and other aspects of program involvement. Copyright © 2015 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Process and outcomes evaluation of older driver screening programs : the Assessment of Driving-Related Skills (ADReS) older-driver screening tool

DOT National Transportation Integrated Search

2009-05-01

Physicians are one resource for identification of older drivers who may be at risk for decreased safe driving ability. However, : physicians have not had the tools to make decisions about the safe driving ability of their patients. With this in mind,...

Innovative Assessment Tools for a Short, Fast-Paced, Summer Field Course

ERIC Educational Resources Information Center

Baustian, Melissa M.; Bentley, Samuel J.; Wandersee, James H.

2008-01-01

An experiential science program, such as a summer course at a field station, requires unique assessment tools. Traditional assessment via a pencil-and-paper exam cannot capture the essential skills and concepts learned at a summer field station. Therefore, the authors developed a pre- and postcourse image-based analysis to evaluate student…

Efficacy of management tools for control of Pythium root rot of Douglas fir seedlings, 2010

USDA-ARS?s Scientific Manuscript database

This study investigated the efficacy of management tools for control of Pythium root rot of Douglas fir seedlings. This effort was conducted as part of the IR-4 Ornamental Horticulture program to evaluate fungicides and biopesticides for management of root, crown and stem rot of ornamental plants ca...

Fitbit and Fitabase Technology: Tracking and Evaluating Youth Physical Activity

ERIC Educational Resources Information Center

Franzen-Castle, Lisa; Dunker, Tara; Chai, Weiwen; Krehbiel, Michelle

2017-01-01

With the health of today's youth a national priority, professionals need tools for accurately assessing activity patterns and motivating behavior change. Fitness technology may be a promising tool for promoting positive behavior change. The afterschool program WeCook: Fun with Food and Fitness focused on improving food preparation skills,…

California Geriatric Education Center Logic Model: An Evaluation and Communication Tool

ERIC Educational Resources Information Center

Price, Rachel M.; Alkema, Gretchen E.; Frank, Janet C.

2009-01-01

A logic model is a communications tool that graphically represents a program's resources, activities, priority target audiences for change, and the anticipated outcomes. This article describes the logic model development process undertaken by the California Geriatric Education Center in spring 2008. The CGEC is one of 48 Geriatric Education…

Evaluation of Automated Configuration Management Tools in Ada Programming Support Environments.

DTIC Science & Technology

1984-03-01

82174.> 00. r11 2-. 4-42% wqC)e 0 000 CU 00 u 0 4 V to 4- 1 ( 1 ) ( 1 )Cl 0- onI I-n 0 4)U- (a 0 ca IVI 4-) 0 aI 0 - 4- 1 U .,4 4.1 934 0 a - 1 0 0 0 qva 41 04...AD--R14@ 982 EVALUATION OF AUTOMATED CONFIGURATION MANAGEMENT TOOLS 1 /2 IN ADA PROGRAMMING..(U) AIR FORCE INST OF TECH WRIGHT-PATTERSON AFB OH...SCHOOL OF ENGI. M S ORNDORFF UNCLASSIFIED MAR 84 AFIT/GCS/EE/84M- 1 F/’G 5/i N EEEEEEEEEEomiE EEEEohEEmhEmhE II LA1111 J2. L I,..6 MICROCOPY RESOLUTION TEST

Nuclear medicine and imaging research (Instrumentation and quantitative methods of evaluation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1989-09-01

This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development and transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development ofmore » new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility.« less

Web-Based Intervention Programs for Depression: A Scoping Review and Evaluation

PubMed Central

Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A

2014-01-01

Background Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. Objective The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Methods Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. Results The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. Conclusions There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool. PMID:25249003

Web-based intervention programs for depression: a scoping review and evaluation.

PubMed

Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A; Topolovec-Vranic, Jane

2014-09-23

Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool.

Freva - Freie Univ Evaluation System Framework for Scientific Infrastructures in Earth System Modeling

NASA Astrophysics Data System (ADS)

Kadow, Christopher; Illing, Sebastian; Kunst, Oliver; Schartner, Thomas; Kirchner, Ingo; Rust, Henning W.; Cubasch, Ulrich; Ulbrich, Uwe

2016-04-01

The Freie Univ Evaluation System Framework (Freva - freva.met.fu-berlin.de) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, including all features present in the shell and web environment. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). Freva indexes different data projects into one common search environment by storing the meta data information of the self-describing model, reanalysis and observational data sets in a database. This implemented meta data system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. The integrated web-shell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects HPC. Plugins are able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a database. Configurations and results of the tools can be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, if configurations match while starting an evaluation plugin, the system suggests to use results already produced by other users - saving CPU/h, I/O, disk space and time. The efficient interaction between different technologies improves the Earth system modeling science framed by Freva.

Reliability Centered Maintenance - Methodologies

NASA Technical Reports Server (NTRS)

Kammerer, Catherine C.

2009-01-01

Journal article about Reliability Centered Maintenance (RCM) methodologies used by United Space Alliance, LLC (USA) in support of the Space Shuttle Program at Kennedy Space Center. The USA Reliability Centered Maintenance program differs from traditional RCM programs because various methodologies are utilized to take advantage of their respective strengths for each application. Based on operational experience, USA has customized the traditional RCM methodology into a streamlined lean logic path and has implemented the use of statistical tools to drive the process. USA RCM has integrated many of the L6S tools into both RCM methodologies. The tools utilized in the Measure, Analyze, and Improve phases of a Lean Six Sigma project lend themselves to application in the RCM process. All USA RCM methodologies meet the requirements defined in SAE JA 1011, Evaluation Criteria for Reliability-Centered Maintenance (RCM) Processes. The proposed article explores these methodologies.

Bellman’s GAP—a language and compiler for dynamic programming in sequence analysis

PubMed Central

Sauthoff, Georg; Möhl, Mathias; Janssen, Stefan; Giegerich, Robert

2013-01-01

Motivation: Dynamic programming is ubiquitous in bioinformatics. Developing and implementing non-trivial dynamic programming algorithms is often error prone and tedious. Bellman’s GAP is a new programming system, designed to ease the development of bioinformatics tools based on the dynamic programming technique. Results: In Bellman’s GAP, dynamic programming algorithms are described in a declarative style by tree grammars, evaluation algebras and products formed thereof. This bypasses the design of explicit dynamic programming recurrences and yields programs that are free of subscript errors, modular and easy to modify. The declarative modules are compiled into C++ code that is competitive to carefully hand-crafted implementations. This article introduces the Bellman’s GAP system and its language, GAP-L. It then demonstrates the ease of development and the degree of re-use by creating variants of two common bioinformatics algorithms. Finally, it evaluates Bellman’s GAP as an implementation platform of ‘real-world’ bioinformatics tools. Availability: Bellman’s GAP is available under GPL license from http://bibiserv.cebitec.uni-bielefeld.de/bellmansgap. This Web site includes a repository of re-usable modules for RNA folding based on thermodynamics. Contact: robert@techfak.uni-bielefeld.de Supplementary information: Supplementary data are available at Bioinformatics online PMID:23355290

WINCADRE INORGANIC (WINDOWS COMPUTER-AIDED DATA REVIEW AND EVALUATION)

EPA Science Inventory

WinCADRE (Computer-Aided Data Review and Evaluation) is a Windows -based program designed for computer-assisted data validation. WinCADRE is a powerful tool which significantly decreases data validation turnaround time. The electronic-data-deliverable format has been designed in...

Managing personal health information in distributed research network environments.

PubMed

Bredfeldt, Christine E; Butani, Amy L; Pardee, Roy; Hitz, Paul; Padmanabhan, Sandy; Saylor, Gwyn

2013-10-08

Studying rare outcomes, new interventions and diverse populations often requires collaborations across multiple health research partners. However, transferring healthcare research data from one institution to another can increase the risk of data privacy and security breaches. A working group of multi-site research programmers evaluated the need for tools to support data security and data privacy. The group determined that data privacy support tools should: 1) allow for a range of allowable Protected Health Information (PHI); 2) clearly identify what type of data should be protected under the Health Insurance Portability and Accountability Act (HIPAA); and 3) help analysts identify which protected health information data elements are allowable in a given project and how they should be protected during data transfer. Based on these requirements we developed two performance support tools to support data programmers and site analysts in exchanging research data. The first tool, a workplan template, guides the lead programmer through effectively communicating the details of multi-site programming, including how to run the program, what output the program will create, and whether the output is expected to contain protected health information. The second performance support tool is a checklist that site analysts can use to ensure that multi-site program output conforms to expectations and does not contain protected health information beyond what is allowed under the multi-site research agreements. Together the two tools create a formal multi-site programming workflow designed to reduce the chance of accidental PHI disclosure.

A Novel Approach to Practice-Based Learning and Improvement Using a Web-Based Audit and Feedback Module.

PubMed

Boggan, Joel C; Cheely, George; Shah, Bimal R; Heffelfinger, Randy; Springall, Deanna; Thomas, Samantha M; Zaas, Aimee; Bae, Jonathan

2014-09-01

Systematically engaging residents in large programs in quality improvement (QI) is challenging. To coordinate a shared QI project in a large residency program using an online tool. A web-based QI tool guided residents through a 2-phase evaluation of performance of foot examinations in patients with diabetes. In phase 1, residents completed reviews of health records with online data entry. Residents were then presented with personal performance data relative to peers and were prompted to develop improvement plans. In phase 2, residents again reviewed personal performance. Rates of performance were compared at the program and clinic levels for each phase, with data presented for residents. Acceptability was measured by the number of residents completing each phase. Feasibility was measured by estimated faculty, programmer, and administrator time and costs. Seventy-nine of 86 eligible residents (92%) completed improvement plans and reviewed 1471 patients in phase 1, whereas 68 residents (79%) reviewed 1054 patient charts in phase 2. Rates of performance of examination increased significantly between phases (from 52% to 73% for complete examination, P < .001). Development of the tool required 130 hours of programmer time. Project analysis and management required 6 hours of administrator and faculty time monthly. An online tool developed and implemented for program-wide QI initiatives successfully engaged residents to participate in QI activities. Residents using this tool demonstrated improvement in a selected quality target. This tool could be adapted by other graduate medical education programs or for faculty development.

Evaluation of a Life Skills Program to Prevent Adolescent Alcohol Use in Two European Countries: One-Year Follow-Up

ERIC Educational Resources Information Center

Giannotta, Fabrizia; Weichold, Karina

2016-01-01

Background: Life skills programs are effective tools to combat youth substance use. However there is a lack of studies concerning their effectiveness in Europe. Objective: This study investigated the 1 year follow up effects and the program implementation of a life skills school-based intervention (IPSY: Information + Psychosocial…

An Analysis of Individual Teachers' Development of Instruction Based on ClassScape Program Data

ERIC Educational Resources Information Center

Parker, Jason L.

2011-01-01

This dissertation was designed to examine and assess the effectiveness of the ClassScape formative assessment tool on the planning, implementation, and evaluation of instruction at a rural middle school in western North Carolina. The teachers had the ClassScape program for 3 years, but were not using the program to plan future instruction. The…

A View from UMBC: Using Real-Time Labor-Market Data to Evaluate Professional Program Opportunities

ERIC Educational Resources Information Center

Steele, Christopher; Goldberger, Susan; Restuccia, Dan

2013-01-01

Continuing and professional education units are faced with the constant need to keep pace with dynamic labor markets when assessing program offerings and content. Real-time labor-market data derived from detailed analysis of online job postings offers a new tool for more easily aligning programs to local labor-market demand. The authors describe a…

Evaluating the Implementation of a Training Program for Improving Quality Service: An Action Research Study

ERIC Educational Resources Information Center

Pierre, Ketly Dieudonne

2014-01-01

There is a need to implement a comprehensive training program to build employees' knowledge, skills, and attitudes in order to improve quality service at ABC Restaurant because of a surge in customer complaints. The purpose of this study was to develop a training program that included an employee handbook as a training tool, a handbook designed…

Mass Spectral Library with Search Program, Data Version: NIST v17

National Institute of Standards and Technology Data Gateway

SRD 1A NIST/EPA/NIH Mass Spectral Library with Search Program, Data Version: NIST v17 (PC database for purchase)   Available with full-featured NIST MS Search Program for Windows integrated tools, the NIST '98 is a fully evaluated collection of electron-ionization mass spectra. (147,198 Compounds with Spectra; 147,194 Chemical Structures; 174,948 Spectra )

Phoenix Rising: use of a participatory approach to evaluate a federally funded HIV, hepatitis and substance abuse prevention program.

PubMed

Dryden, Eileen; Hyde, Justeen; Livny, Ayala; Tula, Monique

2010-11-01

This paper highlights the value of utilizing a participatory evaluation approach when working with community agencies receiving federal funding for prevention and intervention services. Drawing from our experience as evaluators of a SAMHSA-funded substance abuse, HIV and Hepatitis prevention program targeting homeless young adults, we describe the importance of and strategies for creating a participatory evaluation partnership with program implementers. By participatory evaluation we mean the active involvement of program implementers in defining the evaluation, developing instruments, collecting data, discussing findings, and disseminating results. There are a number of challenges faced when using this approach with federally funded programs that require the use of standardized measurement tools and data collection procedures. Strategies we used to strike a balance between federal requirements and local needs are presented. By increasing the understanding of and participation in the evaluation process, program implementers have greater support for data collection requirements and are appreciably more interested in learning from the evaluation data. This approach has helped to build the capacity of a program and stimulated new possibilities for learning, growing, and ultimately improving the services offered to those the program strives to reach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

The Early Development Instrument as an Evaluation and Improvement Tool for School-Based, Integrated Services for Young Children and Parents: The Toronto First Duty Project

ERIC Educational Resources Information Center

Corter, Carl; Patel, Sejal; Pelletier, Janette; Bertrand, Jane

2008-01-01

Research Findings: Integrated services for young children and families are part of the new policy landscape in early childhood, but there is limited evidence of the effectiveness of these programs and how they develop on the ground. This study examined the use of the Early Development Instrument (EDI) as both a summative program evaluation tool…

Competency-Based Evaluation in Higher Education--Design and Use of Competence Rubrics by University Educators

ERIC Educational Resources Information Center

Velasco-Martínez, Leticia-Concepción; Tójar-Hurtado, Juan-Carlos

2018-01-01

Competency-based learning requires making changes in the higher education model in response to current socio-educational demands. Rubrics are an innovative educational tool for competence evaluation, for both students and educators. Ever since arriving at the university systems, the application of rubrics in evaluation programs has grown…

Evaluation Checklist for Student Writing in Grades K-3, Ottawa County.

ERIC Educational Resources Information Center

Ottawa County Office of Education, OH.

Developed to assist teachers in Ottawa County, Ohio, in monitoring students' pupil performance objectives (PPOs) in grades K-3, this writing evaluation form is the primary record keeping tool in the Competency Based Education (CBE) Program. The form consists of: (1) the evaluation checklist; (2) the intervention code; and (3) record keeping…

[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].

PubMed

Nagahama, Elizabeth Eriko Ishida

2009-01-01

The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.

Latinos Improve Food Habits through Nutrition Education.

ERIC Educational Resources Information Center

Kaiser, Lucia L.; Sutherlin, Jeanette M.; Yoshida, Sallie C.; Murphy, Suzanne P.; Bresnick, Stuart D.

1998-01-01

The Expanded Food and Nutrition Education Program, a federally funded nutrition education program in California, is undertaking to assess the needs of Latino clients and develop culturally appropriate tools to evaluate changes in food-related behaviors. Latino participants in Fresno County reported improvements in reducing fat intake, using fruits…

Proposal of Modification Strategy of NC Program in the Virtual Manufacturing Environment

NASA Astrophysics Data System (ADS)

Narita, Hirohisa; Chen, Lian-Yi; Fujimoto, Hideo; Shirase, Keiichi; Arai, Eiji

Virtual manufacturing will be a key technology in process planning, because there are no evaluation tools for cutting conditions. Therefore, virtual machining simulator (VMSim), which can predict end milling processes, has been developed. The modification strategy of NC program using VMSim is proposed in this paper.

NASA Data for Water Resources Applications

NASA Technical Reports Server (NTRS)

Toll, David; Houser, Paul; Arsenault, Kristi; Entin, Jared

2004-01-01

Water Management Applications is one of twelve elements in the Earth Science Enterprise National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of: 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies including the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. This includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being eliminated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems WAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification validation. Water Management Applications is one of twelve elements in the Earth Science Enterprise s National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. T us includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being evaluated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems (LDAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification and validation.

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

NASA Technical Reports Server (NTRS)

Whitmore, Mihriban; Berman, Andrea; Chmielewski, Cynthia

1996-01-01

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

An innovative approach to enhance dermatology competencies for advanced practice nurses: service–learning with a migrant farm worker health clinic.

PubMed

Downes, Elizabeth A; Connor, Ann; Howett, Maeve

2014-12-01

The purpose of this article is to describe a novel service–learning opportunity for graduate nursing students that promotes competency in dermatology. A hybrid service–learning course with online didactic content is described, along with tools for evaluation of dermatology competencies. Student evaluation of the course is discussed, and selected research articles are reviewed. Advanced practice nursing and medical education frequently does not adequately prepare primary care providers to be competent in the assessment and management of dermatologic conditions. Embedding dermatology content in a service–learning program can optimize the provision of care, strengthen competencies in dermatology and inter-professional care, and allow students to gain a deeper understanding of the population with which they work. The innovative service–learning program presented is a model for advanced practice nursing education. Tools for evaluating clinical competency and courses often need validation. Copyright 2014, SLACK Incorporated.

NASA Electronic Parts and Packaging Program

NASA Technical Reports Server (NTRS)

Kayali, Sammy

2000-01-01

NEPP program objectives are to: (1) Access the reliability of newly available electronic parts and packaging technologies for usage on NASA projects through validations, assessments, and characterizations, and the development of test methods/tools; (2)Expedite infusion paths for advanced (emerging) electronic parts and packaging technologies by evaluations of readiness for manufacturability and project usage consideration; (3) Provide NASA projects with technology selection, application, and validation guidelines for electronic parts and packaging hardware and processes; nd (4) Retain and disseminate electronic parts and packaging quality assurance, reliability validations, tools, and availability information to the NASA community.

Exploring the acquisition of entry-to-practice competencies by second-degree nursing students during a preceptorship experience.

PubMed

Sedgwick, Monique; Kellett, Peter; Kalischuck, Ruth Grant

2014-03-01

Nursing programs across Canada have begun to implement at an unprecedented rate second-degree nursing programs in response to consumer demands and a nursing shortage. While these types of programs are enjoying considerable popularity among prospective students and employers, it is imperative that nursing programs assess their graduates' ability to meet Registered Nursing entry-to-practice competencies (ETCs). This study sought to determine if second-degree undergraduate nursing students achieved the entry-to-practice competencies established by the provincial regulatory body for registered nurses of Alberta, Canada. The study took place in southern Alberta, Canada as the first cohort of second-degree undergraduate nursing students were completing the final practice course for the program. In this exploratory study, quantitative and qualitative data generation approaches were used. Quantitative data were collected using the nursing program's standardized Clinical Evaluation Tool which is mapped to the 119 ETCs established by the regulatory body. Qualitative data were generated by conducting focus group interviews with students, faculty advisors, and preceptors. A convenience sample consisting of both male and female students (n=14) submitted their mid-term and final clinical evaluations for inclusion in the dataset. Thirteen preceptors submitted mid-term and final clinical evaluations. Three students, three faculty advisors, and two preceptors participated in focus group interviews. At mid-term, statistically significant differences were noted on 31% of the indicators within the clinical evaluation tool between students and preceptors with preceptors consistently ranking students higher than the students' ratings of their performance. Student and preceptor ratings of students' clinical performance were more consistent on the final evaluation. However, where there were differences, preceptors rated students higher than student ratings. Qualitative data analysis suggests that the concept of competence is complex and multifaceted and understood differently by students, preceptors, and advisors. The findings of this study suggest that there is ambiguity among second-degree students, preceptors and faculty advisors surrounding the concept of competence. In order to develop an understanding of competence, nursing program administrators must encourage faculty advisors, preceptors and students to engage in a discussion at the outset of the preceptored practice experience in regard to what is meant by competence within various practice setting. Further, we suggest nursing programs in collaboration with their clinical partners and re-examine their practice evaluation tools to determine the degree to which they are sensitive to the clinical practice context. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluation Criteria for Micro-CAI: A Psychometric Approach

PubMed Central

Wallace, Douglas; Slichter, Mark; Bolwell, Christine

1985-01-01

The increased use of microcomputer-based instructional programs has resulted in a greater need for third-party evaluation of the software. This in turn has prompted the development of micro-CAI evaluation tools. The present project sought to develop a prototype instrument to assess the impact of CAI program presentation characteristics on students. Data analysis and scale construction was conducted using standard item reliability analyses and factor analytic techniques. Adequate subscale reliabilities and factor structures were found, suggesting that a psychometric approach to CAI evaluation may possess some merit. Efforts to assess the utility of the resultant instrument are currently underway.

A semi-automated tool for treatment plan-quality evaluation and clinical trial quality assurance

NASA Astrophysics Data System (ADS)

Wang, Jiazhou; Chen, Wenzhou; Studenski, Matthew; Cui, Yunfeng; Lee, Andrew J.; Xiao, Ying

2013-07-01

The goal of this work is to develop a plan-quality evaluation program for clinical routine and multi-institutional clinical trials so that the overall evaluation efficiency is improved. In multi-institutional clinical trials evaluating the plan quality is a time-consuming and labor-intensive process. In this note, we present a semi-automated plan-quality evaluation program which combines MIMVista, Java/MATLAB, and extensible markup language (XML). More specifically, MIMVista is used for data visualization; Java and its powerful function library are implemented for calculating dosimetry parameters; and to improve the clarity of the index definitions, XML is applied. The accuracy and the efficiency of the program were evaluated by comparing the results of the program with the manually recorded results in two RTOG trials. A slight difference of about 0.2% in volume or 0.6 Gy in dose between the semi-automated program and manual recording was observed. According to the criteria of indices, there are minimal differences between the two methods. The evaluation time is reduced from 10-20 min to 2 min by applying the semi-automated plan-quality evaluation program.

Residency application screening tools: A survey of academic medical centers.

PubMed

Hillebrand, Kristen; Leinum, Corey J; Desai, Sonya; Pettit, Natasha N; Fuller, Patrick D

2015-06-01

The current use and content of screening tools utilized by ASHP-accredited pharmacy residency programs were assessed. A survey consisting of 19 questions assessing residency programs and the screening of pharmacy residency program applicants was e-mailed to residency directors of 362 pharmacy residency programs at 105 University HealthSystem Consortium (UHC)-member institutions. Questions gathered general program demographic information, data related to applicant growth from residency years 2010-11 to 2011-12, and information about the residency screening processes currently used. Responses were received from 73 residency program sites (69.5%) of the 105 UHC-member institutions to whom the e-mail was sent. Many sites used screening tools to calculate applicants' scores and then determined which candidates to invite for an onsite interview based on applicants' scores and group discussion. Seventy-eight percent (n = 57) of the 73 responding institutions reported the use of a screening tool or rubric to select applicants to invite for onsite interviews. The most common method of evaluation was individual applicant review before meeting as a group to discuss candidate selection. The most important factor for determining which residency candidate to interview was the overall impression based on the candidate's curriculum vitae (CV) and letters of recommendation. Most residency programs in UHC-member hospitals used a screening tool to determine which applicants to invite for an onsite interview. The most important factor for determining which residency candidate to interview was the overall impression based on the candidate's CV and letters of recommendation. Copyright © 2015 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Design and Assessment of an Associate Degree-Level Plant Operations Technical Education Program

NASA Astrophysics Data System (ADS)

Selwitz, Jason Lawrence

Research was undertaken to develop and evaluate an associate degree-level technical education program in Plant Operations oriented towards training students in applied science, technology, engineering, and mathematics (STEM) skills and knowledge relevant to a spectrum of processing industries. This work focuses on four aspects of the curriculum and course development and evaluation research. First, the context of, and impetus for, what was formerly called vocational education, now referred to as technical or workforce education, is provided. Second, the research that was undertaken to design and evaluate an associate degree-level STEM workforce education program is described. Third, the adaptation of a student self-assessment of learning gains instrument is reviewed, and an analysis of the resulting data using an adapted logic model is provided, to evaluate the extent to which instructional approaches, in two process control/improvement-focused courses, were effective in meeting course-level intended learning outcomes. Finally, eight integrative multiscale exercises were designed from two example process systems, wastewater treatment and fast pyrolysis. The integrative exercises are intended for use as tools to accelerate the formation of an operator-technician's multiscale vision of systems, unit operations, underlying processes, and fundamental reactions relevant to multiple industries. Community and technical colleges serve a vital function in STEM education by training workers for medium- and high-skilled technical careers and providing employers the labor necessary to operate and maintain thriving business ventures. Through development of the curricular, course, and assessment-related instruments and tools, this research helps ensure associate degree-level technical education programs can engage in a continual process of program evaluation and improvement.

TU-C-17A-03: An Integrated Contour Evaluation Software Tool Using Supervised Pattern Recognition for Radiotherapy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen, H; Tan, J; Kavanaugh, J

Purpose: Radiotherapy (RT) contours delineated either manually or semiautomatically require verification before clinical usage. Manual evaluation is very time consuming. A new integrated software tool using supervised pattern contour recognition was thus developed to facilitate this process. Methods: The contouring tool was developed using an object-oriented programming language C# and application programming interfaces, e.g. visualization toolkit (VTK). The C# language served as the tool design basis. The Accord.Net scientific computing libraries were utilized for the required statistical data processing and pattern recognition, while the VTK was used to build and render 3-D mesh models from critical RT structures in real-timemore » and 360° visualization. Principal component analysis (PCA) was used for system self-updating geometry variations of normal structures based on physician-approved RT contours as a training dataset. The inhouse design of supervised PCA-based contour recognition method was used for automatically evaluating contour normality/abnormality. The function for reporting the contour evaluation results was implemented by using C# and Windows Form Designer. Results: The software input was RT simulation images and RT structures from commercial clinical treatment planning systems. Several abilities were demonstrated: automatic assessment of RT contours, file loading/saving of various modality medical images and RT contours, and generation/visualization of 3-D images and anatomical models. Moreover, it supported the 360° rendering of the RT structures in a multi-slice view, which allows physicians to visually check and edit abnormally contoured structures. Conclusion: This new software integrates the supervised learning framework with image processing and graphical visualization modules for RT contour verification. This tool has great potential for facilitating treatment planning with the assistance of an automatic contour evaluation module in avoiding unnecessary manual verification for physicians/dosimetrists. In addition, its nature as a compact and stand-alone tool allows for future extensibility to include additional functions for physicians’ clinical needs.« less

A flexible tool for diagnosing water, energy, and entropy budgets in climate models

NASA Astrophysics Data System (ADS)

Lembo, Valerio; Lucarini, Valerio

2017-04-01

We have developed a new flexible software for studying the global energy budget, the hydrological cycle, and the material entropy production of global climate models. The program receives as input radiative, latent and sensible energy fluxes, with the requirement that the variable names are in agreement with the Climate and Forecast (CF) conventions for the production of NetCDF datasets. Annual mean maps, meridional sections and time series are computed by means of Climate Data Operators (CDO) collection of command line operators developed at Max-Planck Institute for Meteorology (MPI-M). If a land-sea mask is provided, the program also computes the required quantities separately on the continents and oceans. Depending on the user's choice, the program also calls the MATLAB software to compute meridional heat transports and location and intensities of the peaks in the two hemispheres. We are currently planning to adapt the program in order to be included in the Earth System Model eValuation Tool (ESMValTool) community diagnostics.

Randomized Trial of Smartphone-Based Evaluation for an Obstetrics and Gynecology Clerkship.

PubMed

Sobhani, Nasim C; Fay, Emily E; Schiff, Melissa A; Stephenson-Famy, Alyssa; Debiec, Katherine E

2017-12-19

We hypothesized that compared to paper evaluations, a smartphone-based quick response (QR) evaluation tool would improve timeliness of feedback, enhance efficacy of giving and receiving feedback, and be as easy to use. We performed a randomized controlled trial of student and instructor experience with two evaluation tools in the OB/GYN clerkship at University of Washington School of Medicine (UWSOM). Sites were randomized to the QR or paper tool; students at QR sites received individualized QR codes at the beginning of the clerkship. Instructors and students completed postintervention surveys regarding the evaluation tool and associated feedback. We compared responses between groups using chi-squared tests. Participating clerkship sites included primary, tertiary, private practice and institutional settings affiliated with the University of Washington in the Washington, Wyoming, Alaska, Montana and Idaho region. Of the 29 OB/GYN UWSOM clerkship sites, 18 agreed to participate and were randomized. Of 29 eligible instructors, 25 (86%) completed the survey, with n = 18 using QR and n = 7 using paper. Of 161 eligible students, 102 (63%) completed the survey, with n = 54 using QR and n = 48 using paper. Compared to those using paper evaluations, instructors using QR evaluations were significantly more likely to agree that the evaluation tool was easy to understand (100% QR vs 43% paper, p = 0.002), the tool was effective in providing feedback (78% QR vs 29% paper, p = 0.002), and they felt comfortable approaching students with the tool (89% QR vs 43% paper, p = 0.002). Compared to those using paper evaluations, students using QR evaluations were less likely to agree the tool was effective in eliciting feedback (QR 43% vs paper 55%, p = 0.042). Instructors found QR evaluations superior to paper evaluations for providing feedback to medical students, whereas students found QR evaluations less effective for feedback. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Exploratory research for the development of a computer aided software design environment with the software technology program

NASA Technical Reports Server (NTRS)

Hardwick, Charles

1991-01-01

Field studies were conducted by MCC to determine areas of research of mutual interest to MCC and JSC. NASA personnel from the Information Systems Directorate and research faculty from UHCL/RICIS visited MCC in Austin, Texas to examine tools and applications under development in the MCC Software Technology Program. MCC personnel presented workshops in hypermedia, design knowledge capture, and design recovery on site at JSC for ISD personnel. The following programs were installed on workstations in the Software Technology Lab, NASA/JSC: (1) GERM (Graphic Entity Relations Modeler); (2) gIBIS (Graphic Issues Based Information System); and (3) DESIRE (Design Recovery tool). These applications were made available to NASA for inspection and evaluation. Programs developed in the MCC Software Technology Program run on the SUN workstation. The programs do not require special configuration, but they will require larger than usual amounts of disk space and RAM to operate properly.

Expanded Capabilities for the Hydrogen Financial Analysis Scenario Tool (H2FAST)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bush, Brian; Melaina, Marc; Penev, Michael

This presentation describes how NREL expanded the capabilities for the Hydrogen Financial Analysis Scenario Tool (H2FAST) in FY16. It was presented at the U.S. Department of Energy Hydrogen and Fuel Cells Program 2016 Annual Merit Review and Peer Evaluation Meeting on June 8, 2016, in Washington, D.C.

Development of a Tool to Assess Resident Physicians' Perceived Competence for Patient-Centered Obesity Counseling

ERIC Educational Resources Information Center

Burton, Amy M.; Brezausek, Carl M.; Hendricks, Peter S.; Agne, April A.; Hankins, Shirley L.; Cherrington, Andrea L.

2015-01-01

Physicians report a number of barriers to obesity counseling, among them low perceived competence in the ability to counsel. While there is increasing recognition of the need for resident training on counseling, implementation requires residency programs to have the necessary curricula and tools to evaluate training effectiveness. This study's…

A Real-Time Plagiarism Detection Tool for Computer-Based Assessments

ERIC Educational Resources Information Center

Jeske, Heimo J.; Lall, Manoj; Kogeda, Okuthe P.

2018-01-01

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of…

Automatic programming of simulation models

NASA Technical Reports Server (NTRS)

Schroer, Bernard J.; Tseng, Fan T.; Zhang, Shou X.; Dwan, Wen S.

1988-01-01

The objective of automatic programming is to improve the overall environment for describing the program. This improved environment is realized by a reduction in the amount of detail that the programmer needs to know and is exposed to. Furthermore, this improved environment is achieved by a specification language that is more natural to the user's problem domain and to the user's way of thinking and looking at the problem. The goal of this research is to apply the concepts of automatic programming (AP) to modeling discrete event simulation system. Specific emphasis is on the design and development of simulation tools to assist the modeler define or construct a model of the system and to then automatically write the corresponding simulation code in the target simulation language, GPSS/PC. A related goal is to evaluate the feasibility of various languages for constructing automatic programming simulation tools.

A Usability Study of Users’ Perceptions Toward a Multimedia Computer-Assisted Learning Tool for Neuroanatomy

PubMed Central

Gould, Douglas J.; Terrell, Mark A.; Fleming, Jo

2015-01-01

This usability study evaluated users’ perceptions of a multimedia prototype for a new e-learning tool: Anatomy of the Central Nervous System: A Multimedia Course. Usability testing is a collection of formative evaluation methods that inform the developmental design of e-learning tools to maximize user acceptance, satisfaction, and adoption. Sixty-two study participants piloted the prototype and completed a usability questionnaire designed to measure two usability properties: program need and program applicability. Statistical analyses were used to test the hypothesis that the multimedia prototype was well designed and highly usable, it was perceived as: 1) highly needed across a spectrum of educational contexts, 2) highly applicable in supporting the pedagogical processes of teaching and learning neuroanatomy, and 3) was highly usable by all types of users. Three independent variables represented user differences: level of expertise (faculty vs. student), age, and gender. Analysis of the results supports the research hypotheses that the prototype was designed well for different types of users in various educational contexts and for supporting the pedagogy of neuroanatomy. In addition, the results suggest that the multimedia program will be most useful as a neuroanatomy review tool for health-professions students preparing for licensing or board exams. This study demonstrates the importance of integrating quality properties of usability with principles of human learning during the instructional design process for multimedia products. PMID:19177405

Predicting Wanton Assault in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development Model was a community-based planning and procedural tool designed to enhance positive youth development and prevent delinquency through a process of youth needs assessment, development of targeted programs, and program impact evaluation. A series of 12 Impact Scales most directly reflect the…

Supportive supervision and constructive relationships with healthcare workers support CHW performance: Use of a qualitative framework to evaluate CHW programming in Uganda.

PubMed

Ludwick, Teralynn; Turyakira, Eleanor; Kyomuhangi, Teddy; Manalili, Kimberly; Robinson, Sheila; Brenner, Jennifer L

2018-02-13

While evidence supports community health worker (CHW) capacity to improve maternal and newborn health in less-resourced countries, key implementation gaps remain. Tools for assessing CHW performance and evidence on what programmatic components affect performance are lacking. This study developed and tested a qualitative evaluative framework and tool to assess CHW team performance in a district program in rural Uganda. A new assessment framework was developed to collect and analyze qualitative evidence based on CHW perspectives on seven program components associated with effectiveness (selection; training; community embeddedness; peer support; supportive supervision; relationship with other healthcare workers; retention and incentive structures). Focus groups were conducted with four high/medium-performing CHW teams and four low-performing CHW teams selected through random, stratified sampling. Content analysis involved organizing focus group transcripts according to the seven program effectiveness components, and assigning scores to each component per focus group. Four components, 'supportive supervision', 'good relationships with other healthcare workers', 'peer support', and 'retention and incentive structures' received the lowest overall scores. Variances in scores between 'high'/'medium'- and 'low'-performing CHW teams were largest for 'supportive supervision' and 'good relationships with other healthcare workers.' Our analysis suggests that in the Bushenyi intervention context, CHW team performance is highly correlated with the quality of supervision and relationships with other healthcare workers. CHWs identified key performance-related issues of absentee supervisors, referral system challenges, and lack of engagement/respect by health workers. Other less-correlated program components warrant further study and may have been impacted by relatively consistent program implementation within our limited study area. Applying process-oriented measurement tools are needed to better understand CHW performance-related factors and build a supportive environment for CHW program effectiveness and sustainability. Findings from a qualitative, multi-component tool developed and applied in this study suggest that factors related to (1) supportive supervision and (2) relationships with other healthcare workers may be strongly associated with variances in performance outcomes within a program. Careful consideration of supervisory structure and health worker orientation during program implementation are among strategies proposed to increase CHW performance.

Integrating Computational Science Tools into a Thermodynamics Course

NASA Astrophysics Data System (ADS)

Vieira, Camilo; Magana, Alejandra J.; García, R. Edwin; Jana, Aniruddha; Krafcik, Matthew

2018-01-01

Computational tools and methods have permeated multiple science and engineering disciplines, because they enable scientists and engineers to process large amounts of data, represent abstract phenomena, and to model and simulate complex concepts. In order to prepare future engineers with the ability to use computational tools in the context of their disciplines, some universities have started to integrate these tools within core courses. This paper evaluates the effect of introducing three computational modules within a thermodynamics course on student disciplinary learning and self-beliefs about computation. The results suggest that using worked examples paired to computer simulations to implement these modules have a positive effect on (1) student disciplinary learning, (2) student perceived ability to do scientific computing, and (3) student perceived ability to do computer programming. These effects were identified regardless of the students' prior experiences with computer programming.

National Immunization Program: Computerized System as a tool for new challenges

PubMed Central

Sato, Ana Paula Sayuri

2015-01-01

The scope and coverage of the Brazilian Immunization Program can be compared with those in developed countries because it provides a large number of vaccines and has a considerable coverage. The increasing complexity of the program brings challenges regarding its development, high coverage levels, access equality, and safety. The Immunization Information System, with nominal data, is an innovative tool that can more accurately monitor these indicators and allows the evaluation of the impact of new vaccination strategies. The main difficulties for such a system are in its implementation process, training of professionals, mastering its use, its constant maintenance needs and ensuring the information contained remain confidential. Therefore, encouraging the development of this tool should be part of public health policies and should also be involved in the three spheres of government as well as the public and private vaccination services. PMID:26176746

Documenting Teacher Candidates' Professional Growth through Performance Evaluation

ERIC Educational Resources Information Center

Brown, Elizabeth Levine; Suh, Jennifer; Parsons, Seth A.; Parker, Audra K.; Ramirez, Erin M.

2015-01-01

In the United States, colleges of education are responding to demands for increased accountability. The purpose of this article is to describe one teacher education program's implementation of a performance evaluation tool during final internship that measures teacher candidates' development across four domains: Planning and Preparation,…

Computer-Aided Evaluation of Forage Management: Forage Manager.

ERIC Educational Resources Information Center

Panciera, M. T.; And Others

1993-01-01

Presents the Forage Manager spreadsheet, developed as a forage management teaching tool to integrate agronomic, livestock, and cost data to demonstrate the impact of forage management on livestock production costs. Teaching applications, examples involving agronomic data and conventional agronomic evaluation, and limitations of the program are…

Adaptive cover crop implementation and evaluation in the Chesapeake Bay watersheds

USDA-ARS?s Scientific Manuscript database

Four years of applied research, led by the USDA-ARS Choptank River Conservation Reserve Assessment Project (CEAP), have demonstrated that satellite remote sensing, used in combination with cost-share program farm implementation records, can provide a powerful tool for evaluating the nutrient conserv...

Evaluation of sketch-level VMT quantification tools : strategic growth council grant programs evaluation support project.

DOT National Transportation Integrated Search

2017-08-01

The State of California has enacted ambitious policies that aim to reduce the states greenhouse gas (GHG) emissions. Some of these policies focus on reducing the amount of driving throughout the state, measured in vehicle miles traveled (VMT), giv...

Pre-Then-Post Testing: A Tool To Improve the Accuracy of Management Training Program Evaluation.

ERIC Educational Resources Information Center

Mezoff, Bob

1981-01-01

Explains a procedure to avoid the detrimental biases of conventional self-reports of training outcomes. The evaluation format provided is a method for using statistical procedures to increase the accuracy of self-reports by overcoming response-shift-bias. (Author/MER)

[Distance education: use of the WebCT as a support tool for teaching intravenous therapy in nursing undergraduate programs].

PubMed

Dias, Denise Costa; Cassiani, Silvia Helena De Bortoli

2003-01-01

This investigation focused on a learning environment via internet, through which Intravenous Therapy (IVT) was taught. Due to its complexity, Intravenous Therapy was chosen against numerous subjects to be taught through an e-learning environment, by comprising both technical procedures and conceptual aspects that can be discussed through a virtual learning environment. The objectives of this study were to develop educational material about Intravenous Therapy to guide students through the learning related to intravenous therapy, to have the related educational material evaluated by experts, and to evaluate the students' use of this material, considering difficulties and/or advantages, participation/interaction in this environment, and usability of its tools. The interface used for the internet-based training program was WebCT.

Risk Acceptance Personality Paradigm: How We View What We Don't Know We Don't Know

NASA Technical Reports Server (NTRS)

Massie, Michael J.; Morris, A. Terry

2011-01-01

The purpose of integrated hazard analyses, probabilistic risk assessments, failure modes and effects analyses, fault trees and many other similar tools is to give managers of a program some idea of the risks associated with their program. All risk tools establish a set of undesired events and then try to evaluate the risk to the program by assessing the severity of the undesired event and the likelihood of that event occurring. Some tools provide qualitative results, some provide quantitative results and some do both. However, in the end the program manager and his/her team must decide which risks are acceptable and which are not. Even with a wide array of analysis tools available, risk acceptance is often a controversial and difficult decision making process. And yet, today's space exploration programs are moving toward more risk based design approaches. Thus, risk identification and good risk assessment is becoming even more vital to the engineering development process. This paper explores how known and unknown information influences risk-based decisions by looking at how the various parts of our personalities are affected by what they know and what they don't know. This paper then offers some criteria for consideration when making risk-based decisions.

Meeting IYA Goals for Diverse Science Center and Planetarium Audiences

NASA Astrophysics Data System (ADS)

Nichols Yehling, Michelle; Carney, K.

2008-05-01

The International Year of Astronomy provides the Adler Planetarium in Chicago, IL with a chance to bring astronomy into the greater Chicagoland area. 1) The presenters will outline Adler's program plans to date, from community outreach programs such as Café Scientifique and citizen science light pollution observations, to programs within the institution, like a temporary exhibit about how telescopes have shaped our understanding of the cosmos. The presenters will focus on the range of programming and how this suite of programs brings together IYA topical threads, addressing sustainability and the needs of our audiences. 2) How do we know that the IYA programs we design actually work for our audiences? How do we assess and improve our work? This session will introduce participants to the "backwards design” process through which Adler educators create experiences that begin with focused goals. Facilitators will take participants through the Adler's evaluation planning method that uncovers what we want to know about our educational programs and experiences. Tools for program design and evaluation will be shared. 3) Facilitators will present for discussion three activities that have been designed and evaluated for one of our audiences, the museum-going family. Workshop participants are invited to critique and discuss these activities, their rationale, their fit with identified audience and institutional needs, and IYA thematic strands. Participants will share any ideas they have for adaptation of these activities for other audiences in their own settings. 4) Finally, all of the educational design and evaluation tools, program descriptions, and lesson plans will be compiled into an electronic document. Participants are encouraged to bring program description examples and/or activity lesson plans that can be incorporated into the document to provide an IYA "workbook". This workbook will be sent to all interested session participants by no later than July 31, 2008.

Using a Theory of Change to Guide Grant Monitoring and Grantmaking.

PubMed

Glasgow, LaShawn; Adams, Elizabeth; Joshi, Sandhya; Curry, Laurel; Schmitt, Carol L; Rogers, Todd; Willett, Jeffrey; Van Hersh, Deanna

Charitable foundations play a significant role in advancing public health, funding billions of dollars in health grants each year. Evaluation is an important accountability tool for foundations and helps ensure that philanthropic investments contribute to the broader public health evidence base. While commitment to evaluation has increased among foundations over the past few decades, effective use of evaluation findings remains challenging. To facilitate use of evaluation findings among philanthropic organizations, evaluators can incorporate the foundation's theory of change-an illustration of the presumed causal pathways between a program's activities and its intended outcomes-into user-friendly products that summarize evaluation findings and recommendations. Using examples from the evaluation of the Kansas Health Foundation's Healthy Living Focus Area, we present a mapping technique that can be applied to assess and graphically depict alignment between program theory and program reality, refine the theory of change, and inform grantmaking.

Exploring Assessment Tools for Research and Evaluation in Astronomy Education and Outreach

NASA Astrophysics Data System (ADS)

Buxner, S. R.; Wenger, M. C.; Dokter, E. F. C.

2011-09-01

The ability to effectively measure knowledge, attitudes, and skills in formal and informal educational settings is an important aspect of astronomy education research and evaluation. Assessments may take the form of interviews, observations, surveys, exams, or other probes to help unpack people's understandings or beliefs. In this workshop, we discussed characteristics of a variety of tools that exist to assess understandings of different concepts in astronomy as well as attitudes towards science and science teaching; these include concept inventories, surveys, interview protocols, observation protocols, card sorting, reflection videos, and other methods currently being used in astronomy education research and EPO program evaluations. In addition, we discussed common questions in the selection of assessment tools including issues of reliability and validity, time to administer, format of implementation, analysis, and human subject concerns.

Promoting consistent use of the communication function classification system (CFCS).

PubMed

Cunningham, Barbara Jane; Rosenbaum, Peter; Hidecker, Mary Jo Cooley

2016-01-01

We developed a Knowledge Translation (KT) intervention to standardize the way speech-language pathologists working in Ontario Canada's Preschool Speech and Language Program (PSLP) used the Communication Function Classification System (CFCS). This tool was being used as part of a provincial program evaluation and standardizing its use was critical for establishing reliability and validity within the provincial dataset. Two theoretical foundations - Diffusion of Innovations and the Communication Persuasion Matrix - were used to develop and disseminate the intervention to standardize use of the CFCS among a cohort speech-language pathologists. A descriptive pre-test/post-test study was used to evaluate the intervention. Fifty-two participants completed an electronic pre-test survey, reviewed intervention materials online, and then immediately completed an electronic post-test survey. The intervention improved clinicians' understanding of how the CFCS should be used, their intentions to use the tool in the standardized way, and their abilities to make correct classifications using the tool. Findings from this work will be shared with representatives of the Ontario PSLP. The intervention may be disseminated to all speech-language pathologists working in the program. This study can be used as a model for developing and disseminating KT interventions for clinicians in paediatric rehabilitation. The Communication Function Classification System (CFCS) is a new tool that allows speech-language pathologists to classify children's skills into five meaningful levels of function. There is uncertainty and inconsistent practice in the field about the methods for using this tool. This study used combined two theoretical frameworks to develop an intervention to standardize use of the CFCS among a cohort of speech-language pathologists. The intervention effectively increased clinicians' understanding of the methods for using the CFCS, ability to make correct classifications, and intention to use the tool in the standardized way in the future.

78 FR 46674 - Agency Information Collection Activities: Request for Comments for a New Information Collection

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-01

... Facility, U.S. Department of Transportation, West Building Ground Floor, Room W12-140, 1200 New Jersey... education and research, and attract qualified students to the field of transportation. The Eisenhower... transportation education programs, also serving as a management tool to measure program performance and evaluate...

78 FR 48859 - Proposed Information Collection; Comment Request; 2013 NOAA Engagement Survey Tool

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-12

... Grimes, Director of Planning and Evaluation, NOAA National Sea Grant College Program, 301-734-1073 or... it serves. This survey instrument will be used by the National Sea Grant Program to obtain... provide NOAA Sea Grant with information and feedback from its constituents that will lead to greater...

"Pepsi": A Screening and Programming Tool for Understanding the Whole Child.

ERIC Educational Resources Information Center

Ellsworth, J'Anne

1996-01-01

This article discusses using "PEPSI", a screening and programming method that evaluates the physical, emotional, philosophical, social, and intellectual levels of development in children with disabilities. The steps in the PEPSI screening process are described and a case study is provided. A chart depicting indicators in teaching respect for self…

Crafting a Foundation for Evaluating a Worksite Wellness Program

ERIC Educational Resources Information Center

Hubley, Teresa A.; Dutram, Kay

2011-01-01

Background: Businesses have been exposed to many positive accounts of the benefits of employee wellness to improve employee performance as well as reduce health and injury claims costs for the employer. However, many do not have the tools or experience to effectively demonstrate the benefits of a workplace wellness program for their own management…

76 FR 30363 - Agency Information Collection Request. 30-Day Public Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-25

... a onetime pilot test of a post- only survey tool to be added to the BodyWorks toolkit/resources; and, (3) conducting a full evaluation of the revised BodyWorks program, including pre, post and follow-up components as well as similar tests of the Spanish BodyWorks program. [[Page 30364

A Collaborative Web-Based Approach to Planning Research, Integration, and Testing Using a Wiki

NASA Technical Reports Server (NTRS)

Delaney, Michael M.; Koshimoto, Edwin T.; Noble, Deleena; Duggan, Christopher

2010-01-01

The National Aeronautics and Space Administration Integrated Vehicle Health Management program touches on many different research areas while striving to enable the automated detection, diagnosis, prognosis, and mitigation of adverse events at the aircraft and system level. At the system level, the research focus is on the evaluation of multidisciplinary integrated methods, tools, and technologies for achieving the program goal. The participating program members form a diverse group of government, industry, and academic researchers. The program team developed the Research and Test Integration Plan in order to track significant test and evaluation activities, which are important for understanding, demonstrating, and communicating the overall project state and project direction. The Plan is a living document, which allows the project team the flexibility to construct conceptual test scenarios and to track project resources. The Plan also incorporates several desirable feature requirements for Plan users and maintainers. A wiki has proven to be the most efficient and effective means of implementing the feature requirements for the Plan. The wiki has proven very valuable as a research project management tool, and there are plans to expand its scope.

Development and Early Piloting of a CanMEDS Competency-Based Feedback Tool for Surgical Grand Rounds.

PubMed

Fahim, Christine; Bhandari, Mohit; Yang, Ilun; Sonnadara, Ranil

2016-01-01

Grand rounds offer an excellent opportunity for the evaluation of medical expertise, and other competencies, such as communication and professionalism. The purpose of this study was to develop a tool that would facilitate the provision of formative feedback for grand rounds to improve learning. The resulting CanMEDS-based evaluation tool was piloted in an academic surgical department. This study employed the use of a 3-phase, qualitatively-focused, embedded mixed methods approach. In Phase 1, an intrinsic case study was conducted to identify preliminary themes. These findings were crystallized using a quantitative survey. Following interpretation of these data, a grand rounds evaluation tool was developed in Phase 2. The tool was piloted in the Phase 3 focus group. This study was piloted at an academic surgical center among members of the Department of Surgery, McMaster University, Ontario, Canada. Purposive sampling was used for this study. A total of n = 7 individuals participated in the Phase 1 interviews, and n = 24 participants completed the Phase 1 survey. Participants included a representative sample of medical students, residents, fellows, and staff. The tool was piloted among n = 19 participants. The proposed evaluation tool contains 13 Likert-scale questions and 2 open-ended questions. The tool outlines specific questions to assess grand rounds presenters within the structure of the 7 CanMEDS competency domains. "Evaluation fatigue" was identified as a major barrier in the willingness to provide effective feedback. Further, a number of factors regarding the preferred content, structure, and format of surgical grand rounds were identified. This pilot study presents a CanMEDS-specific evaluation tool that can be applied to surgical grand rounds. With the increasing adoption of competency-based medical education, comprehensive evaluation of surgical activities is required. This form provides a template for the development of competency-based evaluation tools for medical and surgical learning activities. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Measurement of community empowerment in three community programs in Rapla (Estonia).

PubMed

Kasmel, Anu; Andersen, Pernille Tanggaard

2011-03-01

Community empowerment approaches have been proven to be powerful tools for solving local health problems. However, the methods for measuring empowerment in the community remain unclear and open to dispute. This study aims to describe how a context-specific community empowerment measurement tool was developed and changes made to three health promotion programs in Rapla, Estonia. An empowerment expansion model was compiled and applied to three existing programs: Safe Community, Drug/HIV Prevention and Elderly Quality of Life. The consensus workshop method was used to create the measurement tool and collect data on the Organizational Domains of Community Empowerment (ODCE). The study demonstrated considerable increases in the ODCE among the community workgroup, which was initiated by community members and the municipality's decision-makers. The increase was within the workgroup, which had strong political and financial support on a national level but was not the community's priority. The program was initiated and implemented by the local community members, and continuous development still occurred, though at a reduced pace. The use of the empowerment expansion model has proven to be an applicable, relevant, simple and inexpensive tool for the evaluation of community empowerment.

Measurement of Community Empowerment in Three Community Programs in Rapla (Estonia)

PubMed Central

Kasmel, Anu; Andersen, Pernille Tanggaard

2011-01-01

Community empowerment approaches have been proven to be powerful tools for solving local health problems. However, the methods for measuring empowerment in the community remain unclear and open to dispute. This study aims to describe how a context-specific community empowerment measurement tool was developed and changes made to three health promotion programs in Rapla, Estonia. An empowerment expansion model was compiled and applied to three existing programs: Safe Community, Drug/HIV Prevention and Elderly Quality of Life. The consensus workshop method was used to create the measurement tool and collect data on the Organizational Domains of Community Empowerment (ODCE). The study demonstrated considerable increases in the ODCE among the community workgroup, which was initiated by community members and the municipality’s decision-makers. The increase was within the workgroup, which had strong political and financial support on a national level but was not the community’s priority. The program was initiated and implemented by the local community members, and continuous development still occurred, though at a reduced pace. The use of the empowerment expansion model has proven to be an applicable, relevant, simple and inexpensive tool for the evaluation of community empowerment. PMID:21556179

Usability of a patient education and motivation tool using heuristic evaluation.

PubMed

Joshi, Ashish; Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-11-06

Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. PEMT was evaluated by three usability experts using Nielsen's usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT.

Usability of a Patient Education and Motivation Tool Using Heuristic Evaluation

PubMed Central

Arora, Mohit; Dai, Liwei; Price, Kathleen; Vizer, Lisa; Sears, Andrew

2009-01-01

Background Computer-mediated educational applications can provide a self-paced, interactive environment to deliver educational content to individuals about their health condition. These programs have been used to deliver health-related information about a variety of topics, including breast cancer screening, asthma management, and injury prevention. We have designed the Patient Education and Motivation Tool (PEMT), an interactive computer-based educational program based on behavioral, cognitive, and humanistic learning theories. The tool is designed to educate users and has three key components: screening, learning, and evaluation. Objective The objective of this tutorial is to illustrate a heuristic evaluation using a computer-based patient education program (PEMT) as a case study. The aims were to improve the usability of PEMT through heuristic evaluation of the interface; to report the results of these usability evaluations; to make changes based on the findings of the usability experts; and to describe the benefits and limitations of applying usability evaluations to PEMT. Methods PEMT was evaluated by three usability experts using Nielsen’s usability heuristics while reviewing the interface to produce a list of heuristic violations with severity ratings. The violations were sorted by heuristic and ordered from most to least severe within each heuristic. Results A total of 127 violations were identified with a median severity of 3 (range 0 to 4 with 0 = no problem to 4 = catastrophic problem). Results showed 13 violations for visibility (median severity = 2), 38 violations for match between system and real world (median severity = 2), 6 violations for user control and freedom (median severity = 3), 34 violations for consistency and standards (median severity = 2), 11 violations for error severity (median severity = 3), 1 violation for recognition and control (median severity = 3), 7 violations for flexibility and efficiency (median severity = 2), 9 violations for aesthetic and minimalist design (median severity = 2), 4 violations for help users recognize, diagnose, and recover from errors (median severity = 3), and 4 violations for help and documentation (median severity = 4). Conclusion We describe the heuristic evaluation method employed to assess the usability of PEMT, a method which uncovers heuristic violations in the interface design in a quick and efficient manner. Bringing together usability experts and health professionals to evaluate a computer-mediated patient education program can help to identify problems in a timely manner. This makes this method particularly well suited to the iterative design process when developing other computer-mediated health education programs. Heuristic evaluations provided a means to assess the user interface of PEMT. PMID:19897458

A Novel Approach to Practice-Based Learning and Improvement Using a Web-Based Audit and Feedback Module

PubMed Central

Boggan, Joel C.; Cheely, George; Shah, Bimal R.; Heffelfinger, Randy; Springall, Deanna; Thomas, Samantha M.; Zaas, Aimee; Bae, Jonathan

2014-01-01

Background Systematically engaging residents in large programs in quality improvement (QI) is challenging. Objective To coordinate a shared QI project in a large residency program using an online tool. Methods A web-based QI tool guided residents through a 2-phase evaluation of performance of foot examinations in patients with diabetes. In phase 1, residents completed reviews of health records with online data entry. Residents were then presented with personal performance data relative to peers and were prompted to develop improvement plans. In phase 2, residents again reviewed personal performance. Rates of performance were compared at the program and clinic levels for each phase, with data presented for residents. Acceptability was measured by the number of residents completing each phase. Feasibility was measured by estimated faculty, programmer, and administrator time and costs. Results Seventy-nine of 86 eligible residents (92%) completed improvement plans and reviewed 1471 patients in phase 1, whereas 68 residents (79%) reviewed 1054 patient charts in phase 2. Rates of performance of examination increased significantly between phases (from 52% to 73% for complete examination, P < .001). Development of the tool required 130 hours of programmer time. Project analysis and management required 6 hours of administrator and faculty time monthly. Conclusions An online tool developed and implemented for program-wide QI initiatives successfully engaged residents to participate in QI activities. Residents using this tool demonstrated improvement in a selected quality target. This tool could be adapted by other graduate medical education programs or for faculty development. PMID:26279782

Current trends in systematic program evaluation of online graduate nursing education: an integrative literature review.

PubMed

Horne, Eva M; Sandmann, Lorilee R

2012-10-01

Over the past decade, the Internet's e3 ect has transformed nursing education, particularly at the graduate level. Schools of nursing have embraced Internet-based course delivery technology to broaden students' access to academic degrees. However, the rush to stay competitive in online education raises questions. What is the quality of these online programs? To what extent are schools of nursing systematically evaluating the programs beyond the course level? What evaluation tools are used? What are the findings? How are the evaluation data used? By answering these questions, nurse educators can develop strategies for evaluating the quality and worth of online learning, thus improving instruction and learning outcomes. This integrative review of nursing and adult education literature identified as the current trends in program evaluation of online nursing education at the graduate level. Research articles were analyzed and perspectives were synthesized from a research agenda viewpoint. Recommendations and needs for future research are discussed. Copyright 2012, SLACK Incorporated.

Assessing change in perceived community leadership readiness in the Obesity Prevention and Lifestyle program.

PubMed

Kostadinov, Iordan; Daniel, Mark; Jones, Michelle; Cargo, Margaret

2016-02-01

Issue addressed The context of community-based childhood obesity prevention programs can influence the effects of these intervention programs. Leadership readiness for community mobilisation for childhood obesity prevention is one such contextual factor. This study assessed perceived community leadership readiness (PCLR) at two time points in a state-wide, multisite community-based childhood obesity prevention program. Methods PCLR was assessed across 168 suburbs of 20 intervention communities participating in South Australia's Obesity Prevention and Lifestyle (OPAL) program. Using a validated online PCLR tool, four key respondents from each community rated each suburb within their respective community on a nine-point scale for baseline and 2015. Average PCLR and change scores were calculated using the general linear model with suburbs nested in communities. Relationships between demographic variables and change in PCLR were evaluated using multiple regression. Ease of survey use was also assessed. Results Average PCLR increased between baseline (3.51, s.d.=0.82) and 2015 (5.23, s.d.=0.89). PCLR rose in 18 of 20 intervention communities. PCLR was inversely associated with suburb population size (r 2 =0.03, P=0.03, β=-0.25) and positively associated with intervention duration (r 2 change=0.08, P=0.00, β=0.29). Only 8% of survey respondents considered the online assessment tool difficult to use. Conclusions PCLR increased over the course of the OPAL intervention. PCLR varied between and within communities. Online assessment of PCLR has utility for multisite program evaluations. So what? Use of a novel, resource-efficient online tool to measure the key contextual factors of PCLR has enabled a better understanding of the success and generalisability of the OPAL program.

A mentor training program improves mentoring competency for researchers working with early-career investigators from underrepresented backgrounds.

PubMed

Johnson, Mallory O; Gandhi, Monica

2015-08-01

Mentoring is increasingly recognized as a critical element in supporting successful careers in academic research in medicine and related disciplines, particularly for trainees and early career investigators from underrepresented backgrounds. Mentoring is often executed ad hoc; there are limited programs to train faculty to become more effective mentors, and the few that exist have a dearth of empirical support of their impact. In 2013, we recruited 34 faculty from across the US engaged in HIV-related clinical research to participate in a 2-day Mentoring the Mentors workshop. The workshop included didactic and interactive content focused on a range of topics, such as mentor-mentee communication, leadership styles, emotional intelligence, understanding the impact of diversity (unconscious bias, microaggressions, discrimination, tokenism) for mentees, and specific tools and techniques for effective mentoring. Pre- and post-workshop online evaluations documented high rates of satisfaction with the program and statistically significant improvements in self-appraised mentoring skills (e.g. addressing diversity in mentoring, communication with mentees, aligning mentor-mentee expectations), as assessed via a validated mentoring competency tool. This is the first mentoring training program focused on enhancing mentors' abilities to nurture investigators of diversity, filling an important gap, and evaluation results offer support for its effectiveness. Results suggest a need for refinement and expansion of the program and for more comprehensive, long-term evaluation of distal mentoring outcomes for those who participate in the program.

A software technology evaluation program

NASA Technical Reports Server (NTRS)

Novaes-Card, David N.

1985-01-01

A set of quantitative approaches is presented for evaluating software development methods and tools. The basic idea is to generate a set of goals which are refined into quantifiable questions which specify metrics to be collected on the software development and maintenance process and product. These metrics can be used to characterize, evaluate, predict, and motivate. They can be used in an active as well as passive way by learning form analyzing the data and improving the methods and tools based upon what is learned from that analysis. Several examples were given representing each of the different approaches to evaluation. The cost of the approaches varied inversely with the level of confidence in the interpretation of the results.

Outcome Analysis Tool for Army Refractive Surgery Program

DTIC Science & Technology

2005-03-01

analysis function produces reports on the following information: " Evaluation of the safety of PRK and LASIK for maintenance of optimal visual...performance and ocular integrity. " Evaluation of the efficacy of PRK and LASIK by assessing the improvement in uncorrected vision for target detection...discrimination and recognition. "* Evaluation of the efficacy of PRK and LASIK by evaluating the stability of the refractive error over time

USEPA Waste Disposal Shareware: Purdue University and USEPA (1988-1989).

ERIC Educational Resources Information Center

Rubleske, Joseph B.; Lindsey, Greg

1997-01-01

Describes and evaluates two USEPA shareware programs called Principles of On-Site Wastewater Treatment (ONSITE) and Residential Waste Treatment Evaluation (RWASTE). ONSITE, a tutorial, provides an overview of septic systems and their relationship to soils. RWASTE builds on ONSITE. Both are effective tools for persons interested in acquiring…

Evaluation and development of tools to quantify the impacts of roadside vegetation barriers on near-road air quality

EPA Science Inventory

Regulatory and urban planning programs require an accurate evaluation of how traffic emissions transport and disperse from roads to fully determine exposures and health risks. Roadside vegetation barriers have shown the potential to reduce near-road air pollution concentrations; ...

Theory-Based Assessment in Environmental Education: A Tool for Formative Evaluation

ERIC Educational Resources Information Center

Granit-Dgani, Dafna; Kaplan, Avi; Flum, Hanoch

2017-01-01

This article reports on the development of a theory-informed assessment instrument for use in evaluating environmental education programs. The instrument involves coding learners' brief reflective writing on five established educational and social psychological constructs that correspond to five important goals of environmental education:…

Evaluating portfolio use as a tool for assessment and professional development in graduate nursing education.

PubMed

Ryan, Marybeth

2011-01-01

The portfolio is emerging as an efficient and effective method for evaluating program outcomes and professional development in nursing education. Although there is a host of literature about the use of portfolios in undergraduate nursing programs, fewer reports exist about their use in graduate nursing education. This article presents the results of a formative evaluation process, using student and faculty focus groups, conducted at a midsized university's graduate nursing education program to determine the effectiveness of portfolio use. Content analysis of the focus group data yielded three student themes and two faculty themes with associated theme clusters that revealed similarities and unique perceptions of students and faculty regarding the portfolio process. The information gleaned will provide direction to faculty as they make decisions about the use of this evaluation method in the graduate program. Copyright © 2011. Published by Elsevier Inc.

AVERT Main Module Quick Start Guide

EPA Pesticide Factsheets

Learn how to get started with the AVERT tool, which guides non-experts in evaluating county-level emissions displaced at electric power plants by energy efficiency and renewable energy policies and programs.

Veterinary students' perceptions of their learning environment as measured by the Dundee Ready Education Environment Measure.

PubMed

Pelzer, Jacquelyn M; Hodgson, Jennifer L; Werre, Stephen R

2014-03-24

The Dundee Ready Education Environment Measure (DREEM) has been widely used to evaluate the learning environment within health sciences education, however, this tool has not been applied in veterinary medical education. The aim of this study was to evaluate the reliability and validity of the DREEM tool in a veterinary medical program and to determine veterinary students' perceptions of their learning environment. The DREEM is a survey tool which quantitatively measures students' perceptions of their learning environment. The survey consists of 50 items, each scored 0-4 on a Likert Scale. The 50 items are subsequently analysed within five subscales related to students' perceptions of learning, faculty (teachers), academic atmosphere, and self-perceptions (academic and social). An overall score is obtained by summing the mean score for each subscale, with an overall possible score of 200. All students in the program were asked to complete the DREEM. Means and standard deviations were calculated for the 50 items, the five subscale scores and the overall score. Cronbach's alpha was determined for the five subscales and overall score to evaluate reliability. Confirmatory factor analysis was used to evaluate construct validity. 224 responses (53%) were received. The Cronbach's alpha for the overall score was 0.93 and for the five subscales were; perceptions of learning 0.85, perceptions of faculty 0.79, perceptions of atmosphere 0.81, academic self-perceptions 0.68, and social self-perceptions 0.72. Construct validity was determined to be acceptable (p < 0.001) and all items contributed to the overall validity of the DREEM. The overall DREEM score was 128.9/200, which is a positive result based on the developers' descriptors and comparable to other health science education programs. Four individual items of concern were identified by students. In this setting the DREEM was a reliable and valid tool to measure veterinary students' perceptions of their learning environment. The four items identified as concerning originated from four of the five subscales, but all related to workload. Negative perceptions regarding workload is a common concern of students in health education programs. If not addressed, this perception may have an unfavourable impact on veterinary students' learning environment.

Designing cost efficient buffer zone programs: An application of the FyrisSKZ tool in a Swedish catchment.

PubMed

Collentine, Dennis; Johnsson, Holger; Larsson, Peter; Markensten, Hampus; Persson, Kristian

2015-03-01

Riparian buffer zones are the only measure which has been used extensively in Sweden to reduce phosphorus losses from agricultural land. This paper describes how the FyrisSKZ web tool can be used to evaluate allocation scenarios using data from the Svärta River, an agricultural catchment located in central Sweden. Three scenarios are evaluated: a baseline, a uniform 6-m-wide buffer zone in each sub-catchment, and an allocation of areas of buffer zones to sub-catchments based on the average cost of reduction. The total P reduction increases by 30 % in the second scenario compared to the baseline scenario, and the average reduction per hectare increases by 90 % while total costs of the program fall by 32 %. In the third scenario, the average cost per unit of reduction (163 kg P(-1)) is the lowest of the three scenarios (58 % lower than the baseline) and has the lowest total program costs.

[Construction of abridged life table for health evaluation of local resident using Excel program].

PubMed

Chen, Qingsha; Wang, Feng; Li, Xiaozhen; Yang, Jian; Yu, Shouyi; Hu, Jun

2012-05-01

To provide an easy computational tool for evaluating the health condition of local residents. An abridged life table was programmed by applying mathematical functions and formula in Excel program and tested with the real study data to evaluate the results computed. The Excel was capable of computing group death probability of age in the life table ((n)q(x)), number of survivors (l(x)), number of death ((n)d(x)), survival per person-year ((n)L(x)), survival total per person-year (T(x)) and life expectancy (e(x)). The calculated results were consistent with those by SAS. The abridged life table constructed using Microsoft Excel can conveniently and accurately calculate the relevant indices for evaluating the health condition of the residents.

Process Engineering with the Evolutionary Spiral Process Model. Version 01.00.06

DTIC Science & Technology

1994-01-01

program . Process Definition and SPC-92041-CMC Provides methods for defining and Modeling Guidebook documenting processes so they can be analyzed, modified...and Program Evaluation and Review Technique (PERT) support the activity of developing a project schedule. A variety of automated tools, such as...keep the organiza- tion from becoming disoriented during the improvement program (Curtis, Kellner, and Over 1992). Analyzing and documenting how

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions.

PubMed

Baumel, Amit; Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-03-21

Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content-a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program's evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. ©Amit Baumel, Keren Faber, Nandita Mathur, John M Kane, Fred Muench. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.03.2017.

A Synthetic Comparator Approach to Local Evaluation of School-Based Substance Use Prevention Programming.

PubMed

Hansen, William B; Derzon, James H; Reese, Eric L

2014-06-01

We propose a method for creating groups against which outcomes of local pretest-posttest evaluations of evidence-based programs can be judged. This involves assessing pretest markers for new and previously conducted evaluations to identify groups that have high pretest similarity. A database of 802 prior local evaluations provided six summary measures for analysis. The proximity of all groups using these variables is calculated as standardized proximities having values between 0 and 1. Five methods for creating standardized proximities are demonstrated. The approach allows proximity limits to be adjusted to find sufficient numbers of synthetic comparators. Several index cases are examined to assess the numbers of groups available to serve as comparators. Results show that most local evaluations would have sufficient numbers of comparators available for estimating program effects. This method holds promise as a tool for local evaluations to estimate relative effectiveness. © The Author(s) 2012.

Deciding alternative left turn signal phases using expert systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chang, E.C.P.

1988-01-01

The Texas Transportation Institute (TTI) conducted a study to investigate the feasibility of applying artificial intelligence (AI) technology and expert systems (ES) design concepts to a traffic engineering problem. Prototype systems were developed to analyze user input, evaluate various reasoning, and suggest suitable left turn phase treatment. These systems were developed using AI programming tools on IBM PC/XT/AT-compatible microcomputers. Two slightly different systems were designed using AI languages; another was built with a knowledge engineering tool. These systems include the PD PROLOG and TURBO PROLOG AI programs, as well as the INSIGHT Production Rule Language.

Value of social media in reaching and engaging employers in Total Worker Health.

PubMed

Hudson, Heidi; Hall, Jennifer

2013-12-01

To describe the initial use of social media by the National Institute for Occupational Safety and Health (NIOSH) Total Worker Health™ (TWH) Program and the University of Iowa Healthier Workforce Center for Excellence (HWCE) Outreach Program. Social media analytics tools and process evaluation methods were used to derive initial insights on the social media strategies used by the NIOSH and the HWCE. The on-line community size for the NIOSH TWH Program indicated 100% growth in 6 months; however, social media platforms have been slow to gain participation among employers. The NIOSH TWH Program and the HWCE Outreach Program have found social media tools as an effective way to expand reach, foster engagement, and gain understanding of audience interests around TWH concepts. More needs to be known about how to best use social media to reach and engage target audiences on issues relevant to TWH.

The St. Jude Cancer Education for Children Program Pilot Study: Determining the Knowledge Acquisition and Retention of 4th-Grade Students.

PubMed

Ayers, Katherine; Villalobos, Aubrey Van Kirk; Li, Zhenghong; Krasin, Matthew

2016-03-01

In 2006, St. Jude Children's Research Hospital began developing a school-based outreach program known as the St. Jude Cancer Education for Children Program (SJCECP). The program aimed to teach children about cancer and healthy habits that can prevent the formation of cancers into adulthood. During the 2010-2011 academic years, we conducted a pilot evaluation of the SJCECP curriculum, with the primary objective of evaluating the impact of the intervention on knowledge acquisition and retention among 4th-grade students participating in the program. Seven local schools and 481 students from the Memphis area participated in the program evaluation. The results of this study show that 4th-grade students are able to acquire gains in knowledge related to cells, cancer, and healthy living after receiving the SJCECP intervention. We conclude that the program can be a useful tool for improving knowledge of cancer concepts at the 4th-grade level.

Space station thermal control surfaces. [space radiators

NASA Technical Reports Server (NTRS)

Maag, C. R.; Millard, J. M.; Jeffery, J. A.; Scott, R. R.

1979-01-01

Mission planning documents were used to analyze the radiator design and thermal control surface requirements for both space station and 25-kW power module, to analyze the missions, and to determine the thermal control technology needed to satisfy both sets of requirements. Parameters such as thermal control coating degradation, vehicle attitude, self eclipsing, variation in solar constant, albedo, and Earth emission are considered. Four computer programs were developed which provide a preliminary design and evaluation tool for active radiator systems in LEO and GEO. Two programs were developed as general programs for space station analysis. Both types of programs find the radiator-flow solution and evaluate external heat loads in the same way. Fortran listings are included.

One thousand words: evaluating an interdisciplinary art education program.

PubMed

Klugman, Craig M; Beckmann-Mendez, Diana

2015-04-01

Art Rounds, an innovative interdisciplinary program, began as a pilot project to determine if use of fine arts instructional strategies would be of benefit in health professional education. Specifically, students were exposed to fine art and taught to use visual thinking strategies (VTS). The initial evaluation of the pilot program revealed improved physical observation skills, increased tolerance for ambiguity, and increased interest in communication skills. More recently, the Art Rounds program has been expanded to an interdisciplinary elective course open to both nursing student and medical students at all levels. An evaluation of Art Rounds as a semester- long course was conducted by course faculty and compared to the original pilot program for differences and similarities. Outcomes have demonstrated that the use of visual arts and humanities continues to be highly effective in improving students' physical observation skills and a powerful tool for teaching nursing students how to be skilled clinicians. Copyright 2015, SLACK Incorporated.

The development of a plant risk evaluation (PRE) tool for assessing the invasive potential of ornamental plants.

PubMed

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W; Reichard, Sarah; DiTomaso, Joseph M

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when "needs further evaluation" classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When "needs further evaluation" classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program.

Constructing a competency-based bariatric surgery fellowship training curriculum.

PubMed

McBride, Corrigan L; Rosenthal, Raul J; Brethauer, Stacy; DeMaria, Eric; Kelly, John J; Morton, John M; Lo Menzo, Emanuele; Moore, Rachel; Pomp, Alfons; Nguyen, Ninh T

2017-03-01

Bariatric fellowship training after general surgery has historically been time based and competence was determined at completion based on a minimum number of cases during the fellowship. Graduate medical education is moving toward competency-based medical education where learners are evaluated during the course of their training and competence assessment occurs throughout. The Executive Council of the American Society of Metabolic and Bariatric Surgery (ASMBS) at the direction of the American Board of Surgery wanted to transition the bariatric surgery fellowship curriculum from its traditional format to a competency-based curriculum using competency-based medical education principles. The ASMBS Education and Training Committee established a task force of 9 members to create a new curriculum and all of the necessary evaluation tools to support the curriculum, and initiate a pilot program. A competency-based curriculum consisting of 6 modules with cognitive and technical milestones, and the innovative evaluation tools needed to evaluate the learners, was created. A pilot program consisting of 10 programs and 19 fellows has been undertaken for the 2016-2017 academic year. The Education Committee of the ASMBS is leading the charge in curriculum development for competency-based medical education for bariatric fellowship. Copyright © 2017 American Society for Bariatric Surgery. Published by Elsevier Inc. All rights reserved.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of Learning Environments for Object-Oriented Programming: Measuring Cognitive Load with a Novel Measurement Technique

ERIC Educational Resources Information Center

Uysal, Murat Pasa

2016-01-01

Various methods and tools have been proposed to overcome the learning obstacles for Object-Oriented Programming (OOP). However, it remains difficult especially for novice learners. The problem may be not only adopting an instructional method, but also an Integrated Development Environment (IDE). Learners employ IDEs as a means to solve programming…

Municipal Rebate Programs for Environmental Retrofits: An Evaluation of Additionality and Cost-Effectiveness

ERIC Educational Resources Information Center

Bennear, Lori S.; Lee, Jonathan M.; Taylor, Laura O.

2013-01-01

When policies incentivize voluntary activities that also take place in the absence of the incentive, it is critical to identify the additionality of the policy--that is, the degree to which the policy results in actions that would not have occurred otherwise. Rebate programs have become a common conservation policy tool for local municipalities…

Translational Neuroscience as a Tool for Intervention Development in the Context of High-Adversity Families

ERIC Educational Resources Information Center

Rutherford, Helena J. V.; Mayes, Linda C.; Fisher, Philip A.

2016-01-01

The use of theory-driven models to develop and evaluate family-based intervention programs has a long history in psychology. Some of the first evidence-based parenting programs to address child problem behavior, developed in the 1970s, were grounded in causal models derived from longitudinal developmental research. The same translational…

Public Value Posters: Conveying Societal Benefits of Extension Programs through Evaluation Evidence

ERIC Educational Resources Information Center

Chazdon, Scott; Meyer, Nathan; Mohr, Caryn; Troschinetz, Alexis

2017-01-01

The public value poster session is a new tool for effectively demonstrating and reporting the public value of Extension programming. Akin to the research posters that have long played a critical role in the sharing of findings from academic studies, the public value poster provides a consistent format for conveying the benefits to society of…

Interviews with College Students: Evaluating Computer Programming Environments for Introductory Courses

ERIC Educational Resources Information Center

Uysal, Murat Pasa

2014-01-01

Different methods, strategies, or tools have been proposed for teaching Object Oriented Programming (OOP). However, it is still difficult to introduce OOP to novice learners. The problem may be not only adopting a method or language, but also use of an appropriate integrated development environment (IDE). Therefore, the focus should be on the…

Creating Geographers: Evaluating Teacher Participation in a Geography-Based Summer Academy

ERIC Educational Resources Information Center

Foster, Ellen J.

2010-01-01

As part of a geography-based minority recruiting program (MRP), teachers were asked to serve as mentors for teams of high school students interested in both postsecondary education and geography as a major discipline or career path. The goal was to determine whether teacher participation in MRP programs was an effective tool to mentor…

Massachusetts Public Fire and Safety Education Curriculum Planning Guidebook. Second Version.

ERIC Educational Resources Information Center

Massachusetts Department of Fire Services, Stow.

This updated curriculum planning guidebook is a resource for fire educators throughout the state of Massachusetts. It is designed to be a tool in efforts to: identify fire problems in the community; select appropriate behaviors and lessons to correct the fire problems; design fire education programs; and implement and evaluate the programs. The…

An Assessment Instrument for Families: Evaluating Community-Based Residential Programs for Individuals with Deaf-Blindness.

ERIC Educational Resources Information Center

Helen Keller National Center - Technical Assistance Center, Sands Point, NY.

This community living assessment tool for parents of children with deaf-blindness was developed to help parents identify the strengths and weaknesses of their child's residential program using a user-friendly instrument. Three areas of assessment are covered: physical attributes of the home, available resources for promoting capabilities, and…

Evaluation of Teaching the IS-LM Model through a Simulation Program

ERIC Educational Resources Information Center

Pablo-Romero, Maria del Populo; Pozo-Barajas, Rafael; Gomez-Calero, Maria de la Palma

2012-01-01

The IS-ML model is a basic tool used in the teaching of short-term macroeconomics. Teaching is essentially done through the use of graphs. However, the way these graphs are traditionally taught does not allow the learner to easily visualise changes in the curves. The IS-LM simulation program overcomes difficulties encountered in understanding the…

Intern evaluation strategies in family medicine residency education: what is-and is not-being done.

PubMed

Yates, Jennifer E

2013-06-01

Family medicine interns often have deficiencies that are not initially appreciated. By recognizing those growth opportunities early, programs may be able to better meet their interns' training needs. This study provides a needs assessment to ascertain what evaluation tools are being utilized by residency programs to assess their incoming interns. A questionnaire was sent to all US family medicine residency program coordinators (439 programs) via Survey Monkey© inquiring about whether intern evaluation is performed and, if so, what strategies are used. A mixed mode methodology was used: mailing with incentive, email prompts, and telephone calls. Of 439 programs, 220 (50%) responded to the survey. Most respondents (145, 66%) think intern evaluation is needed. However, only 79 (36%) programs are actually doing intern evaluations-only 14 (6.4%) extensively. Most programs are performing simulations (81, 45%) and assessing knowledge/comfort levels (79, 36%); less than one third are considering personality/learning styles, and almost no programs are evaluating skills such as typing (three, 1.4%) and math (one, 0.5%). Many programs use evaluations to guide future planning, help with early identification of challenging learners, and to match training to the residents' needs. Several programs expressed concern about how they would use the information once obtained. The majority of respondents agreed that a baseline intern evaluation is useful; few are actually doing it. This area is not well-described in the literature; residency programs could benefit from information sharing. The next step is to encourage interest in and implementation of such strategies.

Comparing 2 National Organization-Level Workplace Health Promotion and Improvement Tools, 2013–2015

PubMed Central

Lang, Jason E.; Davis, Whitney D.; Jones-Jack, Nkenge H.; Mukhtar, Qaiser; Lu, Hua; Acharya, Sushama D.; Molloy, Meg E.

2016-01-01

Creating healthy workplaces is becoming more common. Half of employers that have more than 50 employees offer some type of workplace health promotion program. Few employers implement comprehensive evidence-based interventions that reach all employees and achieve desired health and cost outcomes. A few organization-level assessment and benchmarking tools have emerged to help employers evaluate the comprehensiveness and rigor of their health promotion offerings. Even fewer tools exist that combine assessment with technical assistance and guidance to implement evidence-based practices. Our descriptive analysis compares 2 such tools, the Centers for Disease Control and Prevention’s Worksite Health ScoreCard and Prevention Partners’ WorkHealthy America, and presents data from both to describe workplace health promotion practices across the United States. These tools are reaching employers of all types (N = 1,797), and many employers are using a comprehensive approach (85% of those using WorkHealthy America and 45% of those using the ScoreCard), increasing program effectiveness and impact. PMID:27685429

Measuring general surgery residents' communication skills from the patient's perspective using the Communication Assessment Tool (CAT).

PubMed

Stausmire, Julie M; Cashen, Constance P; Myerholtz, Linda; Buderer, Nancy

2015-01-01

The Communication Assessment Tool (CAT) has been used and validated to assess Family and Emergency Medicine resident communication skills from the patient's perspective. However, it has not been previously reported as an outcome measure for general surgery residents. The purpose of this study is to establish initial benchmarking data for the use of the CAT as an evaluation tool in an osteopathic general surgery residency program. Results are analyzed quarterly and used by the program director to provide meaningful feedback and targeted goal setting for residents to demonstrate progressive achievement of interpersonal and communication skills with patients. The 14-item paper version of the CAT (developed by Makoul et al. for residency programs) asks patients to anonymously rate surgery residents on discrete communication skills using a 5-point rating scale immediately after the clinical encounter. Results are reported as the percentage of items rated as "excellent" (5) by the patient. The setting is a hospital-affiliated ambulatory urban surgery office staffed by the residency program. Participants are representative of adult patients of both sexes across all ages with diverse ethnic backgrounds. They include preoperative and postoperative patients, as well as those needing diagnostic testing and follow-up. Data have been collected on 17 general surgery residents from a single residency program representing 5 postgraduate year levels and 448 patient encounters since March 2012. The reliability (Cronbach α) of the tool for surgery residents was 0.98. The overall mean percentage of items rated as excellent was 70% (standard deviations = 42%), with a median of 100%. The CAT is a useful tool for measuring 1 facet of resident communication skills-the patient's perception of the physician-patient encounter. The tool provides a unique and personalized outcome measure for identifying communication strengths and improvement opportunities, allowing residents to receive specific feedback and mentoring by program directors. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Nuclear medicine and imaging research (instrumentation and quantitative methods of evaluation): Comprehensive 3-year progress report for the period January 15, 1986-January 14, 1989

DOE Office of Scientific and Technical Information (OSTI.GOV)

Beck, R.N.; Cooper, M.D.

1988-06-01

This program addresses the problems involving the basic science and technology underlying the physical and conceptual tools of radioactive tracer methodology as they relate to the measurement of structural and functional parameters of physiologic importance in health and disease. The principal tool is quantitative radionuclide imaging. The overall objective of this program is to further the development and transfer of radiotracer methodology from basic theory to routine clinical practice in order that individual patients and society as a whole will receive the maximum net benefit from the new knowledge gained. The focus of the research is on the development ofmore » new instruments and radiopharmaceuticals, and the evaluation of these through the phase of clinical feasibility. 58 refs., 15 figs., 4 tabs.« less

User-friendly program for multitask analysis

NASA Astrophysics Data System (ADS)

Caporali, Sergio A.; Akladios, Magdy; Becker, Paul E.

2000-10-01

Research on lifting activities has led to the design of several useful tools for evaluating tasks that involve lifting and material handling. The National Institute for Occupational Safety and Health (NIOSH) has developed a single task lifting equation. This formula has been frequently used as a guide in the field of ergonomics and material handling. While being much more complicated, the multi-task formula will provide a more realistic analysis for the evaluation of lifting and material handling jobs. A user friendly tool has been developed to assist professionals in the field of ergonomics in analyzing multitask types of material handling jobs. The program allows for up to 10 different tasks to be evaluated. The program requires a basic understanding of the NIOSH lifting guidelines and the six multipliers that are involved in the analysis of each single task. These multipliers are: Horizontal Distance Multiplier (HM), Vertical Distance Multiplier (VM), Vertical Displacement Multiplier (DM), Frequency of lifting Multiplier (FM), Coupling Multiplier (CM), and the Asymmetry Multiplier (AM). Once a given job is analyzed, a researched list of recommendations is provided to the user in an attempt to reduce the potential risk factors that are associated with each task.

The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System

PubMed Central

Hunter, Sarah B.; Ebener, Patricia; Paddock, Susan M.; Stillman, Lindsey; Imm, Pamela; Wandersman, Abraham

2010-01-01

Communities are increasingly being required by state and federal funders to achieve outcomes and be accountable, yet are often not provided the guidance or the tools needed to successfully meet this challenge. To improve the likelihood of achieving positive outcomes, the Getting To Outcomes (GTO) intervention (manual, training, technical assistance) is designed to provide the necessary guidance and tools, tailored to community needs, in order to build individual capacity and program performance. GTO is an example of a Prevention Support System intervention, which as conceptualized by the Interactive Systems Framework, plays a key role in bridging the gap between prevention science (Prevention Synthesis and Translation System) and prevention practice (Prevention Delivery System). We evaluated the impact of GTO on individual capacity and program performance using survey- and interview-based methods. We tracked the implementation of GTO and gathered user feedback about its utility and acceptability. The evaluation of GTO suggests that it can build individual capacity and program performance and as such demonstrates that the Prevention Support System can successfully fulfill its intended role. Lessons learned from the implementation of GTO relevant to illuminating the framework are discussed. PMID:18278551

Analyzing the effectiveness of teaching and factors in clinical decision-making.

PubMed

Hsieh, Ming-Chen; Lee, Ming-Shinn; Chen, Tsung-Ying; Tsai, Tsuen-Chiuan; Pai, Yi-Fong; Sheu, Min-Muh

2017-01-01

The aim of this study is to prepare junior physicians, clinical education should focus on the teaching of clinical decision-making. This research is designed to explore teaching of clinical decision-making and to analyze the benefits of an "Analogy guide clinical decision-making" as a learning intervention for junior doctors. This study had a "quasi-experimental design" and was conducted in a medical center in eastern Taiwan. Participants and Program Description: Thirty junior doctors and three clinical teachers were involved in the study. The experimental group (15) received 1 h of instruction from the "Analogy guide for teaching clinical decision-making" every day for 3 months. Program Evaluation: A "Clinical decision-making self-evaluation form" was used as the assessment tool to evaluate participant learning efficiency before and after the teaching program. Semi-structured qualitative research interviews were also conducted. We found using the analogy guide for teaching clinical decision-making could help enhance junior doctors' self-confidence. Important factors influencing clinical decision-making included workload, decision-making, and past experience. Clinical teaching using the analogy guide for clinical decision-making may be a helpful tool for training and can contribute to a more comprehensive understanding of decision-making.

Open source software in a practical approach for post processing of radiologic images.

PubMed

Valeri, Gianluca; Mazza, Francesco Antonino; Maggi, Stefania; Aramini, Daniele; La Riccia, Luigi; Mazzoni, Giovanni; Giovagnoni, Andrea

2015-03-01

The purpose of this paper is to evaluate the use of open source software (OSS) to process DICOM images. We selected 23 programs for Windows and 20 programs for Mac from 150 possible OSS programs including DICOM viewers and various tools (converters, DICOM header editors, etc.). The programs selected all meet the basic requirements such as free availability, stand-alone application, presence of graphical user interface, ease of installation and advanced features beyond simple display monitor. Capabilities of data import, data export, metadata, 2D viewer, 3D viewer, support platform and usability of each selected program were evaluated on a scale ranging from 1 to 10 points. Twelve programs received a score higher than or equal to eight. Among them, five obtained a score of 9: 3D Slicer, MedINRIA, MITK 3M3, VolView, VR Render; while OsiriX received 10. OsiriX appears to be the only program able to perform all the operations taken into consideration, similar to a workstation equipped with proprietary software, allowing the analysis and interpretation of images in a simple and intuitive way. OsiriX is a DICOM PACS workstation for medical imaging and software for image processing for medical research, functional imaging, 3D imaging, confocal microscopy and molecular imaging. This application is also a good tool for teaching activities because it facilitates the attainment of learning objectives among students and other specialists.

Plastic surgery residency websites: a critical analysis of accessibility and content.

PubMed

Silvestre, Jason; Tomlinson-Hansen, Sandra; Fosnot, Joshua; Taylor, Jesse A

2014-03-01

Medical students applying for plastic surgery residency utilize the Internet to manage their residency applications. Applicants often apply to many programs and rely on advice from colleagues, mentors, and information gathered from plastic surgery residency websites (PSRWs). The purpose of the present study was to evaluate integrated and combined PSRWs with respect to accessibility, resident recruitment, and education. Websites from all 63 integrated and combined plastic surgery residencies available to graduating medical students during the 2013 academic year were available for study inclusion. Databases from national bodies for plastic surgery education were analyzed for accessibility of information. PSRWs were evaluated for comprehensiveness in the domains of resident education and recruitment. Residency programs were compared according to program characteristics using the Student t test and ANOVA with Tukey method. Of the 63 residencies available to graduating medical students, only 57 had combined or integrated program information on their PSRWs (90.5%). In the domain of resident recruitment, evaluators found an average of 5.5 of 15 content items (36.7%). As a whole, 26.3% of PSRWs had academic conference schedules, 17.5% had call schedules, and only 8.8% had operative case listings. For resident education, PSRWs provided an average of 4.6 of 15 content items (30.7%). Only 31.6% of PSRWs had interview schedules, 24.6% had graduate fellowship information, and 5.3% had information on board exam performance. Upon comparison, programs in the Midwest had more online recruitment content than programs in the West (47.1% vs. 24.2%, P < 0.01). Additionally, programs with a larger class of incoming residents (2 vs. 1) had greater online recruitment content (40.0% vs. 26.7%, P < 0.05). Larger programs with 3 integrated spots had more online education content than smaller programs with only 1 integrated spot (40.0% vs. 19.4%, P < 0.01). PSRWs are often not readily accessible and do not provide basic information that allow residency applicants to use this recruitment tool effectively. The paucity of online content suggests PSRWs are underutilized as an educational and recruitment tool. These findings have implications for applicants and plastic surgery residency programs, and there may be future opportunity to utilize this tool more effectively.

Process evaluation of software using the international classification of external causes of injuries for collecting burn injury data at burn centers in the United States.

PubMed

Villaveces, Andrés; Peck, Michael; Faraklas, Iris; Hsu-Chang, Naiwei; Joe, Victor; Wibbenmeyer, Lucy

2014-01-01

Detailed information on the cause of burns is necessary to construct effective prevention programs. The International Classification of External Causes of Injury (ICECI) is a data collection tool that allows comprehensive categorization of multiple facets of injury events. The objective of this study was to conduct a process evaluation of software designed to improve the ease of use of the ICECI so as to identify key additional variables useful for understanding the occurrence of burn injuries, and compare this software with existing data-collection practices conducted for burn injuries. The authors completed a process evaluation of the implementation and ease of use of the software in six U.S. burn centers. They also collected preliminary burn injury data and compared them with existing variables reported to the American Burn Association's National Burn Repository (NBR). The authors accomplished their goals of 1) creating a data-collection tool for the ICECI, which can be linked to existing operational programs of the NBR, 2) training registrars in the use of this tool, 3) establishing quality-control mechanisms for ensuring accuracy and reliability, 4) incorporating ICECI data entry into the weekly routine of the burn registrar, and 5) demonstrating the quality differences between data collected using this tool and the NBR. Using this or similar tools with the ICECI structure or key selected variables can improve the quantity and quality of data on burn injuries in the United States and elsewhere and thus can be more useful in informing prevention strategies.

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

PubMed

Wroe, Emily B; McBain, Ryan K; Michaelis, Annie; Dunbar, Elizabeth L; Hirschhorn, Lisa R; Cancedda, Corrado

2017-08-01

Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field. To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, professionalism and self-care, patient care, mentoring, teaching, management, and personal motivation and experience. The Global Health Delivery Competency Assessment Tool presents 15 case vignettes and open-ended questions related to situations a global health practitioner might encounter, and grades the quality of responses on a 6-point ordinal scale. We interviewed 17 of 18 possible global health residents (94%), matched with 17 residents not training in global health, for a total of 34 interviews. A second reviewer independently scored recordings of 13 interviews for reliability. Pilot testing indicated a high degree of discriminant validity, as measured by the instrument's ability to distinguish between residents who were and were not enrolled in a global health program ( P  < .001). It also demonstrated acceptable consistency, as assessed by interrater reliability (κ = 0.53), with a range of item-level agreement from 84%-96%. The tool has potential applicability to a variety of academic and programmatic activities, including evaluation of candidates for global health positions and evaluating the success of training programs in equipping practitioners for entry into this field.

Color postprocessing for 3-dimensional finite element mesh quality evaluation and evolving graphical workstation

NASA Technical Reports Server (NTRS)

Panthaki, Malcolm J.

1987-01-01

Three general tasks on general-purpose, interactive color graphics postprocessing for three-dimensional computational mechanics were accomplished. First, the existing program (POSTPRO3D) is ported to a high-resolution device. In the course of this transfer, numerous enhancements are implemented in the program. The performance of the hardware was evaluated from the point of view of engineering postprocessing, and the characteristics of future hardware were discussed. Second, interactive graphical tools implemented to facilitate qualitative mesh evaluation from a single analysis. The literature was surveyed and a bibliography compiled. Qualitative mesh sensors were examined, and the use of two-dimensional plots of unaveraged responses on the surface of three-dimensional continua was emphasized in an interactive color raster graphics environment. Finally, a postprocessing environment was designed for state-of-the-art workstation technology. Modularity, personalization of the environment, integration of the engineering design processes, and the development and use of high-level graphics tools are some of the features of the intended environment.

Analysis of a mammography teaching program based on an affordance design model.

PubMed

Luo, Ping; Eikman, Edward A; Kealy, William; Qian, Wei

2006-12-01

The wide use of computer technology in education, particularly in mammogram reading, asks for e-learning evaluation. The existing media comparative studies, learner attitude evaluations, and performance tests are problematic. Based on an affordance design model, this study examined an existing e-learning program on mammogram reading. The selection criteria include content relatedness, representativeness, e-learning orientation, image quality, program completeness, and accessibility. A case study was conducted to examine the affordance features, functions, and presentations of the selected software. Data collection and analysis methods include interviews, protocol-based document analysis, and usability tests and inspection. Also some statistics were calculated. The examination of PBE identified that this educational software designed and programmed some tools. The learner can use these tools in the process of optimizing displays, scanning images, comparing different projections, marking the region of interests, constructing a descriptive report, assessing one's learning outcomes, and comparing one's decisions with the experts' decisions. Further, PBE provides some resources for the learner to construct one's knowledge and skills, including a categorized image library, a term-searching function, and some teaching links. Besides, users found it easy to navigate and carry out tasks. The users also reacted positively toward PBE's navigation system, instructional aids, layout, pace and flow of information, graphics, and other presentation design. The software provides learners with some cognitive tools, supporting their perceptual problem-solving processes and extending their capabilities. Learners can internalize the mental models in mammogram reading through multiple perceptual triangulations, sensitization of related features, semantic description of mammogram findings, and expert-guided semantic report construction. The design of these cognitive tools and the software interface matches the findings and principles in human learning and instructional design. Working with PBE's case-based simulations and categorized gallery, learners can enrich and transfer their experience to their jobs.

Assessing face validity of a physical activity questionnaire for Spanish-speaking women in California

USDA-ARS?s Scientific Manuscript database

Background: A review of the literature produced no rigorously tested and validated Spanish-language physical activity survey or evaluation tools for use by USDA’s food assistance and education programs. The purpose of the current study was to develop and evaluate the face validity of a visually enha...

Phonetic Training in the Foreign Language Curriculum

ERIC Educational Resources Information Center

Burnham, Kevin R.

2014-01-01

In this experiment we evaluate phonetic training as a tool for language learning. Specifically, we take a group of native speakers (NS) of English (n=24) currently enrolled in Arabic classes at American universities, and evaluate the effectiveness of a high variability phonetic training program (HVPT) to improve their perception of a difficult…

Phonetic Training in the Foreign Language Curriculum

ERIC Educational Resources Information Center

Burnham, Kevin R.

2014-01-01

In this experiment we evaluate phonetic training as a tool for language learning. Specifically, we take a group of native speakers (NS) of English (n = 24) currently enrolled in Arabic classes at American universities, and evaluate the effectiveness of a high variability phonetic training program (HVPT) to improve their perception of a difficult…

Novel effects-based monitoring approaches to evaluate chemicals of emerging concern in Great Lakes areas of concern

EPA Science Inventory

As part of an on-going program of research in support of the Great Lakes Restoration Initiative, we have been developing effects-based biomonitoring tools to evaluate the occurrence and potential hazards associated with Chemicals of Emerging Concern (CECs). Over three field seaso...

Novel effects-based monitoring approaches to evaluate chemicals of emerging concern in the St. Louis River estuary

EPA Science Inventory

As part of an on-going program of research in support of the Great Lakes Restoration Initiative, the US EPA MED laboratory has been developing effects-based biomonitoring tools to evaluate the occurrence and potential hazards associated with Chemicals of Emerging Concern (CECs). ...

METAPHOR: Programmer's guide, Version 1

NASA Technical Reports Server (NTRS)

Furchtgott, D. G.

1979-01-01

The internal structure of the Michigan Evaluation Aid for Perphormability (METAPHOR), an interactive software package to facilitate performability modeling and evaluation is described. Revised supplemented guides are prepared in order to maintain an up-to-date documentation of the system. Programmed tools to facilitate each step of performability model construction and model solution are given.

"Will It Be You?" A Public Information and Recruitment Tool for Rehabilitation Counseling

ERIC Educational Resources Information Center

Jaques, Marceline E.; And Others

1971-01-01

A film developed to increase the public's understanding of rehabilitation and to aid in recruitment for rehabilitation education programs was evaluated by surveying the reactions of professionals and students, by evaluating both the affect and cognitive impact, and by examining the influence upon vocational choice. Objectives of the film were…

Faculty Processes Used to Evaluate Self-Reflective Journals in an Online RN-BSN Program

ERIC Educational Resources Information Center

Polley-Payne, Kathleen E.

2017-01-01

Evaluation of student learning activities is part of the fabric of higher education. Expected by accrediting agencies within the health professions disciplines in curricula aimed at the development of reflective practitioners. Student self-reflecting journaling is a strategy frequently employed as a tool to develop reflective practitioners and…

Process Evaluation of the Instant Word Notebook

ERIC Educational Resources Information Center

Roberts, Jeannie Ellen

2010-01-01

This program evaluation of The Instant Word Notebook was conducted by two educators who created an instructional tool to teach and assess the most frequently occurring words in written text, commonly known as Instant Words. In an effort to increase the reading scores of first and second grade students, teachers were instructed to teach Instant…

Evaluating Mobile Survey Tools (MSTs) for Field-Level Monitoring and Data Collection: Development of a Novel Evaluation Framework, and Application to MSTs for Rural Water and Sanitation Monitoring

PubMed Central

Fisher, Michael B.; Mann, Benjamin H.; Cronk, Ryan D.; Shields, Katherine F.; Klug, Tori L.; Ramaswamy, Rohit

2016-01-01

Information and communications technologies (ICTs) such as mobile survey tools (MSTs) can facilitate field-level data collection to drive improvements in national and international development programs. MSTs allow users to gather and transmit field data in real time, standardize data storage and management, automate routine analyses, and visualize data. Dozens of diverse MST options are available, and users may struggle to select suitable options. We developed a systematic MST Evaluation Framework (EF), based on International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) software quality modeling standards, to objectively assess MSTs and assist program implementers in identifying suitable MST options. The EF is applicable to MSTs for a broad variety of applications. We also conducted an MST user survey to elucidate needs and priorities of current MST users. Finally, the EF was used to assess seven MSTs currently used for water and sanitation monitoring, as a validation exercise. The results suggest that the EF is a promising method for evaluating MSTs. PMID:27563916

Evaluating Mobile Survey Tools (MSTs) for Field-Level Monitoring and Data Collection: Development of a Novel Evaluation Framework, and Application to MSTs for Rural Water and Sanitation Monitoring.

PubMed

Fisher, Michael B; Mann, Benjamin H; Cronk, Ryan D; Shields, Katherine F; Klug, Tori L; Ramaswamy, Rohit

2016-08-23

Information and communications technologies (ICTs) such as mobile survey tools (MSTs) can facilitate field-level data collection to drive improvements in national and international development programs. MSTs allow users to gather and transmit field data in real time, standardize data storage and management, automate routine analyses, and visualize data. Dozens of diverse MST options are available, and users may struggle to select suitable options. We developed a systematic MST Evaluation Framework (EF), based on International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) software quality modeling standards, to objectively assess MSTs and assist program implementers in identifying suitable MST options. The EF is applicable to MSTs for a broad variety of applications. We also conducted an MST user survey to elucidate needs and priorities of current MST users. Finally, the EF was used to assess seven MSTs currently used for water and sanitation monitoring, as a validation exercise. The results suggest that the EF is a promising method for evaluating MSTs.

Using intervention mapping to deconstruct cognitive work hardening: a return-to-work intervention for people with depression.

PubMed

Wisenthal, Adeena; Krupa, Terry

2014-12-12

Mental health related work disability leaves are increasing at alarming rates with depression emerging as the most common mental disorder in the workforce. Treatments are available to alleviate depressive symptoms and associated functional impacts; however, they are not specifically aimed at preparing people to return to work. Cognitive work hardening (CWH) is a novel intervention that addresses this gap in the health care system. This paper presents a theoretical analysis of the components and underlying mechanisms of CWH using Intervention Mapping (IM) as a tool to deconstruct its elements. The cognitive sequelae of depression and their relevance to return-to-work (RTW) are examined together with interpersonal skills and other work-related competencies that affect work ability. IM, a tool typically used to create programs, is used to deconstruct an existing program, namely CWH, into its component parts and link them to theories and models in the literature. CWH has been deconstructed into intervention elements which are linked to program performance objectives through underlying theoretical models. In this way, linkages are made between tools and materials of the intervention and the overall program objective of 'successful RTW for people with depression'. An empirical study of the efficacy of CWH is currently underway which should provide added insight and understanding into this intervention. The application of IM to CWH illustrates the theoretical underpinnings of the treatment intervention and assists with better understanding the linkage between intervention elements and intervention objective. Applying IM to deconstruct an existing program (rather than create a program) presents an alternate application of the IM tool which can have implications for other programs in terms of enhancing understanding, grounding in theoretical foundations, communicating program design, and establishing a basis for program evaluation and improvement.

Using WebQuest as a Universal Design for Learning Tool to Enhance Teaching and Learning in Teacher Preparation Programs

ERIC Educational Resources Information Center

Yang, Chien-Hui; Tzuo, Pei Wen; Komara, Cecile

2011-01-01

Developed by Dodge (1995), WebQuest is an inquiry-based teaching tool, in which students of all ages and levels participate in an authentic task that use pre-designed, pre-defined internet resources, though other print resources can also be used. Learners will put the focus on gathering, summarizing, synthesizing, and evaluating the information…

Concept mapping in a critical care orientation program: a pilot study to develop critical thinking and decision-making skills in novice nurses.

PubMed

Wahl, Stacy E; Thompson, Anita M

2013-10-01

Newly graduated registered nurses who were hired into a critical care intensive care unit showed a lack of critical thinking skills to inform their clinical decision-making abilities. This study evaluated the effectiveness of concept mapping as a teaching tool to improve critical thinking and clinical decision-making skills in novice nurses. A self-evaluation tool was administered before and after the learning intervention. The 25-item tool measured five key indicators of the development of critical thinking skills: problem recognition, clinical decision-making, prioritization, clinical implementation, and reflection. Statistically significant improvements were seen in 10 items encompassing all five indicators. Concept maps are an effective tool for educators to use in assisting novice nurses to develop their critical thinking and clinical decision-making skills. Copyright 2013, SLACK Incorporated.

Virtual Environment Computer Simulations to Support Human Factors Engineering and Operations Analysis for the RLV Program

NASA Technical Reports Server (NTRS)

Lunsford, Myrtis Leigh

1998-01-01

The Army-NASA Virtual Innovations Laboratory (ANVIL) was recently created to provide virtual reality tools for performing Human Engineering and operations analysis for both NASA and the Army. The author's summer research project consisted of developing and refining these tools for NASA's Reusable Launch Vehicle (RLV) program. Several general simulations were developed for use by the ANVIL for the evaluation of the X34 Engine Changeout procedure. These simulations were developed with the software tool dVISE 4.0.0 produced by Division Inc. All software was run on an SGI Indigo2 High Impact. This paper describes the simulations, various problems encountered with the simulations, other summer activities, and possible work for the future. We first begin with a brief description of virtual reality systems.

Got CER? Educating Pharmacists for Practice in the Future: New Tools for New Challenges.

PubMed

Perfetto, Eleanor M; Anyanwu, Chinenye; Pickering, Matthew K; Zaghab, Roxanne Ward; Graff, Jennifer S; Eichelberger, Bernadette

2016-06-01

Understanding how treatments work in the real world and in real patients is an important and complex task. In recent years, comparative effectiveness research (CER) studies have become more available for health care providers to inform evidence-based decision making. There is variability in the strengths and limitations of this new evidence, and researchers and decision makers are faced with challenges when assessing the quality of these new methods and CER studies. To (a) describe an online tool developed by the CER Collaborative, composed of the Academy of Managed Care Pharmacy, the International Society for Pharmacoeconomics and Outcomes Research, and the National Pharmaceutical Council, and (b) provide an early evaluation of the training program impact on learners' self-reported abilities to evaluate and incorporate CER studies into their decision making. To encourage greater transparency, consistency, and uniformity in the development and assessment of CER studies, the CER Collaborative developed an online tool to assist researchers, new and experienced clinicians, and decision makers in producing and evaluating CER studies. A training program that supports the use of the online tool was developed to improve the ability and confidence of individuals to apply CER study findings in their daily work. Seventy-one health care professionals enrolled in 3 separate cohorts for the training program. Upon completion, learners assessed their abilities to interpret and apply findings from CER studies by completing on online evaluation questionnaire. The first 3 cohorts of learners to complete the training program consisted of 71 current and future health care practitioners and researchers. At completion, learners indicated high confidence in their CER evidence assessment abilities (mean = 4.2). Learners reported a 27.43%-59.86% improvement in capabilities to evaluate various CER studies and identify study design flaws (mean evaluation before CER Certificate Program [CCP] scores = 1.86-3.14 and post-CCP scores = 3.92-4.24). Additionally, 63% of learners indicated that they expected to increase their use of evidence from CER studies in at least 1-2 problem decisions per month. The CER Collaborative has responded to the need for increased practitioner training to improve understanding and application of new CER studies. The CER Collaborative tool and certificate training program are innovative solutions to help decision makers meet the challenges they face in honing their skills to best incorporate credible and relevant CER evidence into their decision making. The CER Collaborative, the development of the questionnaires and web-based tool, and the development of the CER Certificate Program were supported by grants and in-kind contributions from the Academy of Managed Care Pharmacy (AMCP), the International Society for Pharmacoeconomics and Outcomes Research (ISPOR), and the National Pharmaceutical Council (NPC). The University of Maryland School of Pharmacy conducted its work under a contract with the AMCP Foundation and grant funding from the NPC. Perfetto is employed by the University of Maryland and the National Health Council and serves as assistant editor for the Journal of Managed Care & Specialty Pharmacy, consults for Avelere, and serves as a member of advisory boards for the PQA and CMTP. Pickering received support from the NPC for activities related to this research. Eichelberger is employed by the Academy of Managed Care Pharmacy. Eichelberger and Graff are with the CER Collaborative. Graff is employed by the National Pharmaceutical Council. Study concept and design were primarily contributed by Perfetto, Graff, and Eichelberger, along with Anyanwu and assisted by Pickering and Ward Zaghab. Pickering and Ward Zaghab took the lead in data collection, with assistance from the other authors, and data interpretation was performed by Perfetto, Graff, Pickering, and Ward Zaghab, with assistance from the other authors. The manuscript was written by Perfetto and Anyanwu, with assistance from the other authors, and revised by Graff, Perfetto, Anyanwu, and Pickering, assisted by Eichelberger and Ward Zaghab.

Enterprise tools to promote interoperability: MonitoringResources.org supports design and documentation of large-scale, long-term monitoringprograms

NASA Astrophysics Data System (ADS)

Weltzin, J. F.; Scully, R. A.; Bayer, J.

2016-12-01

Individual natural resource monitoring programs have evolved in response to different organizational mandates, jurisdictional needs, issues and questions. We are establishing a collaborative forum for large-scale, long-term monitoring programs to identify opportunities where collaboration could yield efficiency in monitoring design, implementation, analyses, and data sharing. We anticipate these monitoring programs will have similar requirements - e.g. survey design, standardization of protocols and methods, information management and delivery - that could be met by enterprise tools to promote sustainability, efficiency and interoperability of information across geopolitical boundaries or organizational cultures. MonitoringResources.org, a project of the Pacific Northwest Aquatic Monitoring Partnership, provides an on-line suite of enterprise tools focused on aquatic systems in the Pacific Northwest Region of the United States. We will leverage on and expand this existing capacity to support continental-scale monitoring of both aquatic and terrestrial systems. The current stakeholder group is focused on programs led by bureaus with the Department of Interior, but the tools will be readily and freely available to a broad variety of other stakeholders. Here, we report the results of two initial stakeholder workshops focused on (1) establishing a collaborative forum of large scale monitoring programs, (2) identifying and prioritizing shared needs, (3) evaluating existing enterprise resources, (4) defining priorities for development of enhanced capacity for MonitoringResources.org, and (5) identifying a small number of pilot projects that can be used to define and test development requirements for specific monitoring programs.

Simulation of the XV-15 tilt rotor research aircraft

NASA Technical Reports Server (NTRS)

Churchill, G. B.; Dugan, D. C.

1982-01-01

The effective use of simulation from issuance of the request for proposal through conduct of a flight test program for the XV-15 Tilt Rotor Research Aircraft is discussed. From program inception, simulation complemented all phases of XV-15 development. The initial simulation evaluations during the source evaluation board proceedings contributed significantly to performance and stability and control evaluations. Eight subsequent simulation periods provided major contributions in the areas of control concepts; cockpit configuration; handling qualities; pilot workload; failure effects and recovery procedures; and flight boundary problems and recovery procedures. The fidelity of the simulation also made it a valuable pilot training aid, as well as a suitable tool for military and civil mission evaluations. Simulation also provided valuable design data for refinement of automatic flight control systems. Throughout the program, fidelity was a prime issue and resulted in unique data and methods for fidelity evaluation which are presented and discussed.

An overview of ethical frameworks in public health: can they be supportive in the evaluation of programs to prevent overweight?

PubMed Central

2010-01-01

Background The prevention of overweight sometimes raises complex ethical questions. Ethical public health frameworks may be helpful in evaluating programs or policy for overweight prevention. We give an overview of the purpose, form and contents of such public health frameworks and investigate to which extent they are useful for evaluating programs to prevent overweight and/or obesity. Methods Our search for frameworks consisted of three steps. Firstly, we asked experts in the field of ethics and public health for the frameworks they were aware of. Secondly, we performed a search in Pubmed. Thirdly, we checked literature references in the articles on frameworks we found. In total, we thus found six ethical frameworks. We assessed the area on which the available ethical frameworks focus, the users they target at, the type of policy or intervention they propose to address, and their aim. Further, we looked at their structure and content, that is, tools for guiding the analytic process, the main ethical principles or values, possible criteria for dealing with ethical conflicts, and the concrete policy issues they are applied to. Results All frameworks aim to support public health professionals or policymakers. Most of them provide a set of values or principles that serve as a standard for evaluating policy. Most frameworks articulate both the positive ethical foundations for public health and ethical constraints or concerns. Some frameworks offer analytic tools for guiding the evaluative process. Procedural guidelines and concrete criteria for solving important ethical conflicts in the particular area of the prevention of overweight or obesity are mostly lacking. Conclusions Public health ethical frameworks may be supportive in the evaluation of overweight prevention programs or policy, but seem to lack practical guidance to address ethical conflicts in this particular area. PMID:20969761

49 CFR 26.41 - What is the role of the statutory 10 percent goal in this program?

Code of Federal Regulations, 2011 CFR

2011-10-01

... PARTICIPATION BY DISADVANTAGED BUSINESS ENTERPRISES IN DEPARTMENT OF TRANSPORTATION FINANCIAL ASSISTANCE... as a tool in evaluating and monitoring DBEs' opportunities to participate in DOT-assisted contracts...

49 CFR 26.41 - What is the role of the statutory 10 percent goal in this program?

Code of Federal Regulations, 2010 CFR

2010-10-01

... PARTICIPATION BY DISADVANTAGED BUSINESS ENTERPRISES IN DEPARTMENT OF TRANSPORTATION FINANCIAL ASSISTANCE... as a tool in evaluating and monitoring DBEs' opportunities to participate in DOT-assisted contracts...

Creativity and dementia: does artistic activity affect well-being beyond the art class?

PubMed

Gross, Susan M; Danilova, Deana; Vandehey, Michael A; Diekhoff, George M

2015-01-01

The Alzheimer's Association's Memories in the Making (MIM) art activity program is intended to enhance the well-being of individuals who are living with dementia. Previous evaluations of MIM have found that participants show benefits on several well-being domains measured by the Greater Cincinnati Chapter Well-Being Observation Tool. The current study extended those findings by looking for evidence of carry-over effects beyond the temporal boundaries of MIM sessions. Additionally, this study evaluated key psychometric qualities of the assessment instrument. Seventy-six MIM participants with middle- to late-stage dementia were evaluated by interns and care facility staff at the beginning, middle and end of a 12-week MIM program. Interns focused on behavior within MIM sessions and staff rated functioning outside MIM sessions. Staff reported no significant changes in resident well-being across the 12-week program. Interns reported significant improvements from the beginning to middle and end of the program on five well-being domains. Psychometric analyses of the Greater Cincinnati Chapter Well-Being Observation Tool identified weaknesses in inter-rater reliability and found that the instrument measures two orthogonal factors--interpreted as 'Well-Being' and 'Ill-Being' - not the seven domains claimed. Quantitative evidence for the effectiveness of MIM is ambiguous, but anecdotal observations indicate that the program is beneficial for some participants, if only fleetingly. © The Author(s) 2013 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.

Centers of excellence: an assessment tool for cardiovascular and orthopedic programs.

PubMed

Ronning, P L; Meyer, J W

1996-10-01

As payers place more weight on contracting with hospital/health system programs that can differentiate themselves in the market as a "true" center of excellence (COE), it becomes imperative that hospitals/health systems understand the payer perspective about those programmatic attributes that can truly differentiate them from other programs. This report describes an evaluation and rating methodology for hospital/health system subspecialty programs, particularly cardiovascular and orthopedic programs, that can be used as a self-assessment tool. Using as its core a Rating Scale and Ranking Taxonomy, the evaluation and rating methodology presented here allow cardiovascular and orthopedic programs to do the following: Understand the differentiating characteristic of COE. Rate itself against detailed criteria that are being used by payers. Compare aspects of its program to premier or benchmark programs. Interpret the results to assist with strategic and operational direction. Allocate scarce resources to implement a subspecialty program that will attract payers. The Rating Scale and Ranking Taxonomy has 20 criteria for assessing cardiovascular programs and 18 criteria for orthopedic programs. The assessment process is designed to produce two important results: dialogue and action. The underpinnings of any action is a solid business plan that clarifies the program's vision, values, and mission. They are important because most programs will ultimately pursue very similar strategies and tactics; however, the most successful subspecialty programs and practices will be the ones that can execute the strategies and tactics quickly and effectively. In addition, the changes that are engendered by this targeted yet comprehensive assessment process can lead to improved clinical and functional outcomes for patients, as well as systemic improvements in the delivery of care.

Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool.

PubMed

Sajjad, Madiha; Khan, Rehan Ahmed; Yasmeen, Rahila

2018-01-01

To develop a tool to evaluate faculty perceptions of assessment quality in an undergraduate medical program. The Assessment Implementation Measure (AIM) tool was developed by a mixed method approach. A preliminary questionnaire developed through literature review was submitted to a panel of 10 medical education experts for a three-round 'Modified Delphi technique'. Panel agreement of > 75% was considered the criterion for inclusion of items in the questionnaire. Cognitive pre-testing of five faculty members was conducted. Pilot study was done with 30 randomly selected faculty members. Content validity index (CVI) was calculated for individual items (I-CVI) and composite scale (S-CVI). Cronbach's alpha was calculated to determine the internal consistency reliability of the tool. The final AIM tool had 30 items after the Delphi process. S-CVI was 0.98 with the S-CVI/Avg method and 0.86 by S-CVI/UA method, suggesting good content validity. Cut-off value of < 0.9 I-CVI was taken as criterion for item deletion. Cognitive pre-testing revealed good item interpretation. Cronbach's alpha calculated for the AIM was 0.9, whereas Cronbach's alpha for the four domains ranged from 0.67 to 0.80. 'AIM' is a relevant and useful instrument with good content validity and reliability of results, and may be used to evaluate the teachers´ perceptions about assessment quality.

Interest of the Ergo-Kit(®) for the clinical practice of the occupational physician. A study of 149 patients recruited in a rehabilitation program.

PubMed

Caron, J; Ronzi, Y; Bodin, J; Richard, I; Bontoux, L; Roquelaure, Y; Petit, A

2015-10-01

Functional capacity evaluation is commonly used to assess the abilities of patients to perform some tasks. Ergo-Kit(®) is a validated tool assessing both functional capacities of patients and workplace demands. The objective of this study was to evaluate the relevance of the Ergo-Kit(®) data for occupational physicians during the return-to-work process. A retrospective and monocenter study was conducted on all patients included in a rehabilitation program and assessed with the Ergo-Kit(®) tool between 2005 and 2014. Workplace demands and patients' functional capacities were evaluated and confronted. Self-beliefs and perceived disability were also assessed and compared to the functional capacity evaluation. One hundred and forty-nine working-age patients (85 men, 64 women; 39±12 years) suffering from musculoskeletal disorders or other diseases were included. Main causes of mismatch between workplace demands and functional capacities were manual handling of loads, postures with arms away from the body and repetitive motions at work; sitting posture was correlated with a lesser physical workload; and Oswestry score was correlated with functional capacities evaluated by the Ergo-Kit(®). Ergo-Kit(®) is a relevant tool to assess the multidimensional aspects of workplace demands and functional capacities. It could be very helpful for occupational physicians to manage return-to-work. Copyright © 2015 Elsevier Masson SAS. All rights reserved.

The Quantitative Evaluation of the Clinical and Translational Science Awards (CTSA) Program Based on Science Mapping and Scientometric Analysis

PubMed Central

Zhang, Yin; Wang, Lei

2013-01-01

Abstract The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. PMID:24330689

The quantitative evaluation of the Clinical and Translational Science Awards (CTSA) program based on science mapping and scientometric analysis.

PubMed

Zhang, Yin; Wang, Lei; Diao, Tianxi

2013-12-01

The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. © 2013 Wiley Periodicals, Inc.

Is the digitization of laparoscopic movement using accessible alternative technologies possible?

PubMed

Lorias Espinoza, Daniel; Gutiérrez Gnecchi, José Antonio; Martínez, Arturo Minor

2012-05-01

It is widely documented that laparoscopic surgeons require training, and an objective evaluation of the training that they receive. The most advanced evaluation systems integrate the digitization of the movement of laparoscopic tools. A great number of these systems, however, do not permit the use of real tools and their high cost limits their academic impact. Likewise, it is documented that new and accessible systems need to be developed. The aim of this article is to explore the possibility of digitizing the movement of laparoscopic tools in a three-dimensional workspace, using accessible alternative technology. Our proposal uses a commercial Wii video game control in conjunction with a program for determining kinematic variables during the execution of a recognition task.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

Benchmarking 10 Major Canadian Universities at the Divisional Level: A Powerful Tool for Strategic Decision Making

ERIC Educational Resources Information Center

Proulx, Roland

2010-01-01

A consortium of 10 Canadian research-intensive universities launched a data exchange program in 1999 to share information that could be used to identify and evaluate the best practices of each institution and to help each institution position itself strategically to achieve its mission. One part of the program was devoted to collecting…

'SINAMI': a tool for the economic evaluation of forest fire management programs in Mediterranean ecosystems

Treesearch

Francisco Rodriguez y Silva; Armando Gonzalez-Caban

2010-01-01

Historically, in Spain and most European countries, forest fire budgets have never been subjected to an objective and rigorous economic analysis indicative of the returns on investments in fire management protection programs. Thus far we have witnessed expansive growth of costs without any investment planning. New economic realities and more focussed oversight by...

TRSys: A hardwood lumber grading training and remanufacturing system

Treesearch

P. Klinkhachorn; R. Kothari; R. Annavajjhala; Charles W. McMillin

1994-01-01

The Training and Remanufacturing System (TRSys) is a new training tool for teaching both hardwood lumber grading and remanufacturing of lower grade boards into smaller boards of higher total value. TRSys is based on the HaLT2, ReGS, and enhanced HaRem computer programs. The most important feature of this new program is its ablilty to evaluate remanufacturing beyond...

TRSys: a hardwood lumber grading training and remanufacturing system

Treesearch

P. Klinkhachorn; R. Kotharl; R. annavajjhala; Charles W. McMilling

1994-01-01

The training and remanufacturing system( TRsys) is a new training tool for teaching both hardwood lumber and grading and remanufacturing of lower grade boards into smaller boards of higher total value. TRSys is based on HaLT2. REGS, and enhanced HARem computer programs. The mosti mportant feature of this new program is its ability to evaluate remanufacturing beyond...

Standards for Teaching about the Federal Reserve System: An Initiative by Two Federal Reserve Banks

ERIC Educational Resources Information Center

Bosshardt, William D.; Grimes, Paul W.; Suiter, Mary C.

2011-01-01

In the fall of 2008, the Federal Reserve Banks of Atlanta and St. Louis began a systematic evaluation of their economic and personal finance educational outreach programs. Both banks were interested in developing tools to assess the success of their existing economic and financial education programs. However, before any assessment could begin, a…

BIOSIM2 USER'S MANUAL, VERSION 2.0.03 - A PROGRAM THAT APPLIES THE COEFFICIENT OF BIOTIC SIMILARITY, B, TO COMPLEX DATA MATRICES

EPA Science Inventory

The Pinkham-Pearson index of similarity has been evaluated by EPA as one of the more powerful tools for comparing community structure in its rapid bioassessment protocol. However, its use has been limited because the program that ran it, BioSim1, was only available in DOS format....

An Assessment Instrument for Families: Evaluating Employment Programs for Individuals with Deaf-Blindness.

ERIC Educational Resources Information Center

Helen Keller National Center - Technical Assistance Center, Sands Point, NY.

This employment assessment tool for parents of young adults with deaf-blindness was created to assist in examining strengths and weaknesses of various employment programs in relation to their child's employment wants and needs, to guide parents in advocating for what is needed from a specific job to ensure their child's success, and to provide a…

Outcome evaluation of a 3-year senior health and wellness initiative.

PubMed

Kuczmarksi, Marie Fanelli; Cotugna, Nancy

2009-02-01

The Wilmington Senior Center developed a 3-year multidisciplinary health and wellness initiative entitled The Time of Your Life to promote healthy aging for participants attending countywide senior centers. The purpose of this paper is to describe the development and implementation of the evaluation methodology and outcomes of this senior health and wellness project that consisted of 11 programs in total. Long-term programming can present several challenges in both implementation and evaluation, but assessing outcomes is critical to documenting program value and accountability. Participant-completed surveys and post-series focus groups were utilized as the evaluation tools. Our findings indicate that the program's objectives of increasing knowledge and motivating adoption or maintenance of a healthy lifestyle were met to varying degrees, while a third objective of assessing the usefulness of resources to inform health-related decisions was unable to be evaluated due to the cross-sectional nature of the data collection. Post-series focus groups indicated that topics of most interest to seniors were money management, medications and staying mentally and physically fit. The evaluations showed that long-term programming, while challenging, can be a successful and sustainable format for senior health education.

An overview of tools for the validation of protein NMR structures.

PubMed

Vuister, Geerten W; Fogh, Rasmus H; Hendrickx, Pieter M S; Doreleijers, Jurgen F; Gutmanas, Aleksandras

2014-04-01

Biomolecular structures at atomic resolution present a valuable resource for the understanding of biology. NMR spectroscopy accounts for 11% of all structures in the PDB repository. In response to serious problems with the accuracy of some of the NMR-derived structures and in order to facilitate proper analysis of the experimental models, a number of program suites are available. We discuss nine of these tools in this review: PROCHECK-NMR, PSVS, GLM-RMSD, CING, Molprobity, Vivaldi, ResProx, NMR constraints analyzer and QMEAN. We evaluate these programs for their ability to assess the structural quality, restraints and their violations, chemical shifts, peaks and the handling of multi-model NMR ensembles. We document both the input required by the programs and output they generate. To discuss their relative merits we have applied the tools to two representative examples from the PDB: a small, globular monomeric protein (Staphylococcal nuclease from S. aureus, PDB entry 2kq3) and a small, symmetric homodimeric protein (a region of human myosin-X, PDB entry 2lw9).

Improved health behaviors persist over two years for employees in a worksite wellness program.

PubMed

LeCheminant, James D; Merrill, Ray M

2012-10-01

This study evaluates whether improvements in health behaviors related to a worksite wellness program persist through 2 years. The program was designed to build behavioral capability and self-efficacy by yielding immediately applicable skills and tools and segmenting the behavior change process into weekly, manageable doses. Analyses are based on 267 individuals employed from 2009 through 2011. Significant improvements were observed in the frequency and volume of exercise, and the consumption of vegetables and fruits over 12 and 24 months. Requests for health coaching significantly increased over the study period. Thus, the type of wellness program evaluated in this study produced sustainable health behaviors through 24 months, which likely will translate into future positive health outcomes and improved employee productivity.

Impact of the Use of a Standardized Guidance Tool on the Development of a Teaching Philosophy in a Pharmacy Residency Teaching and Learning Curriculum Program

PubMed Central

Wesner, Amber R.; Jones, Ryan; Schultz, Karen; Johnson, Mark

2016-01-01

The purpose of this study was to evaluate the impact of a standardized reflection tool on the development of a teaching philosophy statement in a pharmacy residency teaching and learning curriculum program (RTLCP). Pharmacy residents participating in the RTLCP over a two-year period were surveyed using a pre/post method to assess perceptions of teaching philosophy development before and after using the tool. Responses were assessed using a 5-point Likert scale to indicate level of agreement with each statement. For analysis, responses were divided into high (strongly agree/agree) and low (neutral/disagree/strongly disagree) agreement. The level of agreement increased significantly for all items surveyed (p < 0.05), with the exception of one area pertaining to the ability to describe characteristics of outstanding teachers, which was noted to be strong before and after using the tool (p = 0.5027). Overall results were positive, with 81% of participants responding that the reflection tool was helpful in developing a teaching philosophy, and 96% responding that the resulting teaching philosophy statement fully reflected their views on teaching and learning. The standardized reflection tool developed at Shenandoah University assisted pharmacy residents enrolled in a teaching and learning curriculum program to draft a comprehensive teaching philosophy statement, and was well received by participants. PMID:28970382

Evaluation of automated decisionmaking methodologies and development of an integrated robotic system simulation. Volume 1: Study results

NASA Technical Reports Server (NTRS)

Lowrie, J. W.; Fermelia, A. J.; Haley, D. C.; Gremban, K. D.; Vanbaalen, J.; Walsh, R. W.

1982-01-01

A variety of artificial intelligence techniques which could be used with regard to NASA space applications and robotics were evaluated. The techniques studied were decision tree manipulators, problem solvers, rule based systems, logic programming languages, representation language languages, and expert systems. The overall structure of a robotic simulation tool was defined and a framework for that tool developed. Nonlinear and linearized dynamics equations were formulated for n link manipulator configurations. A framework for the robotic simulation was established which uses validated manipulator component models connected according to a user defined configuration.

Competency-Based Education for the Molecular Genetic Pathology Fellow

PubMed Central

Talbert, Michael L.; Dunn, S. Terence; Hunt, Jennifer; Hillyard, David R.; Mirza, Imran; Nowak, Jan A.; Van Deerlin, Vivianna; Vnencak-Jones, Cindy L.

2009-01-01

The following report represents guidelines for competency-based fellowship training in Molecular Genetic Pathology (MGP) developed by the Association for Molecular Pathology Training and Education Committee and Directors of MGP Programs in the United States. The goals of the effort were to describe each of the Accreditation Council for Graduate Medical Education competencies as they apply to MGP fellowship training, provide a summary of goals and objectives, and recommend assessment tools. These guidelines are particularly pertinent to MGP training, which is a relatively new specialty that operates within a rapidly changing scientific and technological arena. It is hoped that this document will provide additional material for directors of existing MGP programs to consider for improvement of program objectives and enhancement of evaluation tools already in place. In addition, the guidelines should provide a valuable framework for the development of new MGP programs. PMID:19797613

Use of PRA in Shuttle Decision Making Process

NASA Technical Reports Server (NTRS)

Boyer, Roger L.; Hamlin, Teri L.

2010-01-01

How do you use PRA to support an operating program? This presentation will explore how the Shuttle Program Management has used the Shuttle PRA in its decision making process. It will reveal how the PRA has evolved from a tool used to evaluate Shuttle upgrades like Electric Auxiliary Power Unit (EAPU) to a tool that supports Flight Readiness Reviews (FRR) and real-time flight decisions. Specific examples of Shuttle Program decisions that have used the Shuttle PRA as input will be provided including how it was used in the Hubble Space Telescope (HST) manifest decision. It will discuss the importance of providing management with a clear presentation of the analysis, applicable assumptions and limitations, along with estimates of the uncertainty. This presentation will show how the use of PRA by the Shuttle Program has evolved overtime and how it has been used in the decision making process providing specific examples.

Meet EPA Scientist Susan Yee, Ph.D.

EPA Pesticide Factsheets

Susan Yee, Ph.D., is an ecologist at EPA's Gulf Ecology Division. She is working on the Puerto Rico Sustainable Communities program, developing decision support tools to evaluate how alternative decisions impact coastal ecosystem goods and services

Addressing the Needs of Preschool Children in the Context of Disasters and Terrorism: Assessment, Prevention, and Intervention.

PubMed

Wolmer, Leo; Hamiel, Daniel; Pardo-Aviv, Lee; Laor, Nathaniel

2017-07-01

The goal of this paper is to review the research literature regarding the needs of preschoolers in the context of disasters and terrorism with the aim of understanding the existing methods for assessment, prevention, and intervention to provide recommendations and point out required research and development. We differentiate between screening tools that provide initial evaluation and assessment tools for diagnosing preschooler children's pathology and review possible interventions that address the preschool child's needs before, during, and after the incident itself. We also emphasize the lack of dissemination and research of prevention programs and mass interventions for preschoolers. Programs for community mass prevention and intervention for preschoolers should be developed and evaluated and interventions should be adapted for individual and group delivery. Moreover, the increase in the number of children refugees requires cultural adaptations of assessment measures and interventions.

Investigation, Development, and Evaluation of Performance Proving for Fault-tolerant Computers

NASA Technical Reports Server (NTRS)

Levitt, K. N.; Schwartz, R.; Hare, D.; Moore, J. S.; Melliar-Smith, P. M.; Shostak, R. E.; Boyer, R. S.; Green, M. W.; Elliott, W. D.

1983-01-01

A number of methodologies for verifying systems and computer based tools that assist users in verifying their systems were developed. These tools were applied to verify in part the SIFT ultrareliable aircraft computer. Topics covered included: STP theorem prover; design verification of SIFT; high level language code verification; assembly language level verification; numerical algorithm verification; verification of flight control programs; and verification of hardware logic.

Evaluation of an Educational Program to Improve School Nursing Staff Perceptions of Bullying In Pinellas County, Florida.

PubMed

Salmeron, Patricia A; Christian, Becky J

2016-01-01

The purpose of this project was to determine if a bullying educational program for school nurses and certified nursing assistants/health technicians (CNAs/HTs) would increase knowledge of bullying, probability of reporting a bully, and probability of assisting a bullied victim. This educational program and evaluation employed a retrospective, post-then-pre-test design. Instruments used included a 17-item demographic questionnaire and the 12-item Reduced Aggression/ Victimization Scale Bullying Assessment Tool (BAT), a 5-point Likert Scale de - signed to assess school nurses’ and CNAs’/HTs’ understanding of bullying, the probability of reporting bullies, and the probability of assisting bullied victims before and after the educational presentation. Findings of this educational evaluation program indicated that the majority of school nurses and CNAs/HTs had an increased understanding of bullying, higher probability of reporting a bully, and assisting a bullied victim after the presentation.

Evaluation of a Brazilian Postgraduate Dental Program by the Dundee Ready Educational Environment Measure

ERIC Educational Resources Information Center

do Vale Placa, Rebeca; Ragghianti Zangrando, Mariana S.; Sant'Ana, Adriana C. P.; Greghi, Sebastião L. A.; de Rezende, Maria Lucia R.; Damante, Carla A.

2015-01-01

The evaluation of education environment is essential to provide to the professors a better understanding of the teaching process. One valuable tool for this assessment is the Dundee Ready Educational Environment Measure (DREEM). This questionnaire has 50 questions and is divided in five dimensions: D1--Perceptions of teaching, D2--Perceptions of…

Teaching Information Evaluation and Critical Thinking Skills in Physics Classes

ERIC Educational Resources Information Center

Popescu, Adriana; Morgan, James

2007-01-01

The physics curriculum at all educational levels can be enriched to include tools for strengthening students' information evaluation skills. The "Report of the Joint APS-AAPT Task Force on Graduate Education in Physics" calls for such training to be part of graduate programs, but training to acquire these lifetime skills can be incorporated in the…

Student Views about a Flipped Physics Course: A Tool for Program Evaluation and Improvement

ERIC Educational Resources Information Center

Ramlo, Susan

2015-01-01

Flipped classrooms are a relatively new teaching strategy where the typical lecture and homework elements of a course are reversed. Although flipped classrooms are gaining popularity, evaluations of this type of pedagogical model are limited. The purpose of this study was to investigate student views related to the effectiveness of a flipped…

Web Accessibility and Usability of the Homepages from Academy of Human Resource Development Members' Institutions

ERIC Educational Resources Information Center

Zeng, Xiaoming; Sligar, Steven R.

2008-01-01

Human resource development programs in various institutions communicate with their constituencies including persons with disabilities through websites. Web sites need to be accessible for legal, economic and ethical reasons. We used an automated web usability evaluation tool, aDesigner, to evaluate 205 home pages from the organizations of AHRD…

Granting Teachers the "Benefit of the Doubt" in Performance Evaluations

ERIC Educational Resources Information Center

Rogge, Nicky

2011-01-01

Purpose: This paper proposes a benefit of the doubt (BoD) approach to construct and analyse teacher effectiveness scores (i.e. SET scores). Design/methodology/approach: The BoD approach is related to data envelopment analysis (DEA), a linear programming tool for evaluating the relative efficiency performance of a set of similar units (e.g. firms,…

Utility in a Fallible Tool: A Multi-Site Case Study of Automated Writing Evaluation

ERIC Educational Resources Information Center

Grimes, Douglas; Warschauer, Mark

2010-01-01

Automated writing evaluation (AWE) software uses artificial intelligence (AI) to score student essays and support revision. We studied how an AWE program called MY Access![R] was used in eight middle schools in Southern California over a three-year period. Although many teachers and students considered automated scoring unreliable, and teachers'…

GLOBE Mission Earth: The evaluation of the first year's implementation.

NASA Astrophysics Data System (ADS)

Adaktylou, N. E.; Hedley, M. L.; Darche, S.; Harris-Stefanakis, E.; Silberglitt, M. D.; Struble, J.; Bingham, P.; Czajkowski, K.

2017-12-01

Here we present the evaluation findings for the first year of implementation of the `Mission Earth' Program.`Mission Earth' proposes the systematic embedding of GLOBE (Global Learning and Observations to Benefit the Environment) resources and NASA assets into the curricula of schools along the K-12 continuum, leveraging existing partnerships and networks. The main goal of the program is to create developmentally appropriate, vertically-integrated K-12 materials and activities,, supported by high quality professional development and ongoing support, engaging teachers from all grades. Its team consists of 5 geographically distributed universities and research institutions that have developed a curriculum progression following research-based best practices, have conducted the year's trainings for selected cohorts of teachers. The evaluation is a continuous process over the program's five year duration to examine implementation and opportunities for improvement. A broad set of data collection tools include a diagnostic component (needs assessment for teachers, capacity assessment for the school environment) and an assessment of implementation component (surveys for teachers and trainers, pre- and post tests for students, classroom observations, teacher interviews, portfolios). The tools used are validated instruments or ones modified to serve the program needs. The patterns emerging from the data provided information on: i) the quality of the intervention as to its design and content, ii) the alignment with the needs of the participants, iii) the implementation phase, iii) changes in the content knowledge of the students and their attitudes toward science, iv) changes in the facility of teachers to teach science in their classrooms after the professional development and materials provided, v) challenges and facilitators of implementation. Based on findings the program evaluation identifies additions/adjustments to be adopted in the following year.

A Quality Improvement Activity to Promote Interprofessional Collaboration Among Health Professions Students

PubMed Central

Stevenson, Katherine; Busch, Angela; Scott, Darlene J.; Henry, Carol; Wall, Patricia A.

2009-01-01

Objectives To develop and evaluate a classroom-based curriculum designed to promote interprofessional competencies by having undergraduate students from various health professions work together on system-based problems using quality improvement (QI) methods and tools to improve patient-centered care. Design Students from 4 health care programs (nursing, nutrition, pharmacy, and physical therapy) participated in an interprofessional QI activity. In groups of 6 or 7, students completed pre-intervention and post-intervention reflection tools on attitudes relating to interprofessio nal teams, and a tool designed to evaluate group process. Assessment One hundred thirty-four students (76.6%) completed both self-reflection instruments, and 132 (74.2%) completed the post-course group evaluation instrument. Although already high prior to the activity, students' mean post-intervention reflection scores increased for 12 of 16 items. Post-intervention group evaluation scores reflected a high level of satisfaction with the experience. Conclusion Use of a quality-based case study and QI methodology were an effective approach to enhancing interprofessional experiences among students. PMID:19657497

Cost effectiveness of pediatric pneumococcal conjugate vaccines: a comparative assessment of decision-making tools.

PubMed

Chaiyakunapruk, Nathorn; Somkrua, Ratchadaporn; Hutubessy, Raymond; Henao, Ana Maria; Hombach, Joachim; Melegaro, Alessia; Edmunds, John W; Beutels, Philippe

2011-05-12

Several decision support tools have been developed to aid policymaking regarding the adoption of pneumococcal conjugate vaccine (PCV) into national pediatric immunization programs. The lack of critical appraisal of these tools makes it difficult for decision makers to understand and choose between them. With the aim to guide policymakers on their optimal use, we compared publicly available decision-making tools in relation to their methods, influential parameters and results. The World Health Organization (WHO) requested access to several publicly available cost-effectiveness (CE) tools for PCV from both public and private provenance. All tools were critically assessed according to the WHO's guide for economic evaluations of immunization programs. Key attributes and characteristics were compared and a series of sensitivity analyses was performed to determine the main drivers of the results. The results were compared based on a standardized set of input parameters and assumptions. Three cost-effectiveness modeling tools were provided, including two cohort-based (Pan-American Health Organization (PAHO) ProVac Initiative TriVac, and PneumoADIP) and one population-based model (GlaxoSmithKline's SUPREMES). They all compared the introduction of PCV into national pediatric immunization program with no PCV use. The models were different in terms of model attributes, structure, and data requirement, but captured a similar range of diseases. Herd effects were estimated using different approaches in each model. The main driving parameters were vaccine efficacy against pneumococcal pneumonia, vaccine price, vaccine coverage, serotype coverage and disease burden. With a standardized set of input parameters developed for cohort modeling, TriVac and PneumoADIP produced similar incremental costs and health outcomes, and incremental cost-effectiveness ratios. Vaccine cost (dose price and number of doses), vaccine efficacy and epidemiology of critical endpoint (for example, incidence of pneumonia, distribution of serotypes causing pneumonia) were influential parameters in the models we compared. Understanding the differences and similarities of such CE tools through regular comparisons could render decision-making processes in different countries more efficient, as well as providing guiding information for further clinical and epidemiological research. A tool comparison exercise using standardized data sets can help model developers to be more transparent about their model structure and assumptions and provide analysts and decision makers with a more in-depth view behind the disease dynamics. Adherence to the WHO guide of economic evaluations of immunization programs may also facilitate this process. Please see related article: http://www.biomedcentral.com/1741-7007/9/55.

Collaboration as a Strategy to Transform the Impact of EPO Efforts in the New York Center for Astrobiology

NASA Astrophysics Data System (ADS)

Svirsky, A.; Rogers, K. L.; Meissner, M.; Busby, G.; Roberge, W.

2014-12-01

The New York Center for Astrobiology (NYCA) EPO effort is a collaboration combining expertise in evaluation and assessment of STEM educational modules with disciplinary expertise in astrobiology. In practice, the NYCA partners with external experts in professional development, informal education and evaluation to assist in developing and implementing certain programs of the NYCA EPO activities. Two specific program initiatives of the NYCA EPO effort offer excellent examples of programs with strong science content knowledge as well as using effective tools to address the NSF impact categories. These are the ExxonMobil Bernard Harris Summer Science Camp (EMBHSSC, in conjunction with RPI's STEM Pipeline Initiative) and the Astrobiology Teachers Academy (ATA). The EMBHSSC for middle school students focuses on NASA astrobiology initiatives around the "Quest for Life" theme. The Camp has a comprehensive evaluation component and uses pre-and post- assessment of student knowledge and interest in STEM. Recent data suggest that every student has shown a measurable gain in these areas. The ATA is a weeklong summer intensive professional development program for P-12 STEM teachers that combines discipline scientists in the NYCA with an external evaluation organization, the Association for the Cooperative Advancement of Science and Education (ACASE). The goal is for teachers to develop a new learning module for a course they teach that uses astrobiology as a content focus to engage students. The Academy has scientists collaborating with teachers in this effort, providing content and assistance in designing instructional activities. Assessments are woven into the fabric of the work in a few ways: 1. There is a purposeful focus on assessment as part of the learning module, and the content of the ATA; 2. ACASE offers teachers a tool for tracking their students' attainment of the learning goals identified in their learning module; 3. There are daily evaluations of the teachers' experiences to enable mid-course corrections, and a final evaluation of the ATA at the end of the experience. NYCA scientists support the approach of working collaboratively with external experts in evaluation as a paradigm for EPO activities sponsored by NASA. Our presentation will highlight the myriad of tools used to measure outcomes of these activities.

Emergency radiobioassay preparedness exercises through the NIST radiochemistry intercomparison program.

PubMed

Nour, Svetlana; LaRosa, Jerry; Inn, Kenneth G W

2011-08-01

The present challenge for the international emergency radiobioassay community is to analyze contaminated samples rapidly while maintaining high quality results. The National Institute of Standards and Technology (NIST) runs a radiobioassay measurement traceability testing program to evaluate the radioanalytical capabilities of participating laboratories. The NIST Radiochemistry Intercomparison Program (NRIP) started more than 10 years ago, and emergency performance testing was added to the program seven years ago. Radiobioassay turnaround times under the NRIP program for routine production and under emergency response scenarios are 60 d and 8 h, respectively. Because measurement accuracy and sample turnaround time are very critical in a radiological emergency, response laboratories' analytical systems are best evaluated and improved through traceable Performance Testing (PT) programs. The NRIP provides participant laboratories with metrology tools to evaluate their performance and to improve it. The program motivates the laboratories to optimize their methodologies and minimize the turnaround time of their results. Likewise, NIST has to make adjustments and periodical changes in the bioassay test samples in order to challenge the participating laboratories continually. With practice, radioanalytical measurements turnaround time can be reduced to 3-4 h.

Information System and Geographic Information System Tools in the Data Analyses of the Control Program for Visceral Leishmaniases from 2006 to 2010 in the Sanitary District of Venda Nova, Belo Horizonte, Minas Gerais, Brazil

PubMed Central

Saraiva, Lara; Leite, Camila Gonçalves; de Carvalho, Luiz Otávio Alves; Andrade Filho, José Dilermando; de Menezes, Fernanda Carvalho; Fiúza, Vanessa de Oliveira Pires

2012-01-01

The aim of this paper is to report a brief history of control actions for Visceral Leishmaniasis (VL) from 2006 to 2010 in the Sanitary District (DS) of Venda Nova, Belo Horizonte, Minas Gerais, Brazil, focusing on the use of information systems and Geographic Information System (GIS) tools. The analyses showed that the use of an automated database allied with geoprocessing tools may favor control measures of VL, especially with regard to the evaluation of control actions carried out. Descriptive analyses of control measures allowed to evaluating that the information system and GIS tools promoted greater efficiency in making decisions and planning activities. These analyses also pointed to the necessity of new approaches to the control of VL in large urban centers. PMID:22518168

An Evaluation of Operational Airspace Sectorization Integrated System (OASIS) Advisory Tool

NASA Technical Reports Server (NTRS)

Lee, Paul U.; Mogford, Richard H.; Bridges, Wayne; Buckley, Nathan; Evans, Mark; Gujral, Vimmy; Lee, Hwasoo; Peknik, Daniel; Preston, William

2013-01-01

In January 2013, a human-in-the-loop evaluation of the Operational Airspace Sectorization Integrated System (OASIS) was conducted in the Airspace Operations Laboratory of the Human Systems Integration Division (Code TH) in conjunction with the Aviation Systems Division (Code AF). The development of OASIS is a major activity of the Dynamic Airspace Configuration (DAC) research focus area within the Aeronautics Research Mission Directorate (ARMD) Airspace Systems Program. OASIS is an advisory tool to assist Federal Aviation Administration (FAA) En Route Area Supervisors in their planning of sector combinedecombine operations as well as opening closing of Data-side (D-side) control positions. These advisory solutions are tailored to the predicted traffic demand over the next few hours. During the experiment, eight retired FAA personnel served as participants for a part-task evaluation of OASIS functionality, covering the user interface as well as the underlying algorithm. Participants gave positive feedback on both the user interface and the algorithm solutions for airspace configuration, including an excellent average rating of 94 on the tool usability scales. They also suggested various enhancements to the OASIS tool, which will be incorporated into the next tool development cycle for the full-scale human-in-the-loop evaluation to be conducted later this year.

The Effect of Reflective Garden Walking on Adults With Increased Levels of Psychological Stress.

PubMed

McCaffrey, Ruth; Liehr, Patricia

2016-06-01

The purpose of this evaluation was to determine the benefits of a reflective garden walking program on adults with increased levels of psychological stress. Outcomes measured included levels of hopefulness, personal growth, and quality of life. The evaluation used a one-group, pretest-posttest to determine the success of the Stroll for Well-Being to assist participants to overcome psychological stressors. Participants were recruited through local support groups. All participants signed informed consent to participate in the study program. A total of 195 participants completed the 6-week program, attended all meetings, and completed all measurement tools. All of the outcome measures statistically improved on the posttest compared to the pretest scores. The outcome measure that had the largest change in mean score was the Personal Growth Scale. Holistic nursing as a specialty should continue to explore the use of green spaces and nature on patients. More research is needed to increase the amount of evidence regarding spending time in nature and using reflection and journaling as a tool to reconnect with the natural environment. © The Author(s) 2015.

The Development of a Plant Risk Evaluation (PRE) Tool for Assessing the Invasive Potential of Ornamental Plants

PubMed Central

Conser, Christiana; Seebacher, Lizbeth; Fujino, David W.; Reichard, Sarah; DiTomaso, Joseph M.

2015-01-01

Weed Risk Assessment (WRA) methods for evaluating invasiveness in plants have evolved rapidly in the last two decades. Many WRA tools exist, but none were specifically designed to screen ornamental plants prior to being released into the environment. To be accepted as a tool to evaluate ornamental plants for the nursery industry, it is critical that a WRA tool accurately predicts non-invasiveness without falsely categorizing them as invasive. We developed a new Plant Risk Evaluation (PRE) tool for ornamental plants. The 19 questions in the final PRE tool were narrowed down from 56 original questions from existing WRA tools. We evaluated the 56 WRA questions by screening 21 known invasive and 14 known non-invasive ornamental plants. After statistically comparing the predictability of each question and the frequency the question could be answered for both invasive and non-invasive species, we eliminated questions that provided no predictive power, were irrelevant in our current model, or could not be answered reliably at a high enough percentage. We also combined many similar questions. The final 19 remaining PRE questions were further tested for accuracy using 56 additional known invasive plants and 36 known non-invasive ornamental species. The resulting evaluation demonstrated that when “needs further evaluation” classifications were not included, the accuracy of the model was 100% for both predicting invasiveness and non-invasiveness. When “needs further evaluation” classifications were included as either false positive or false negative, the model was still 93% accurate in predicting invasiveness and 97% accurate in predicting non-invasiveness, with an overall accuracy of 95%. We conclude that the PRE tool should not only provide growers with a method to accurately screen their current stock and potential new introductions, but also increase the probability of the tool being accepted for use by the industry as the basis for a nursery certification program. PMID:25803830

Mission Systems Open Architecture Science and Technology (MOAST) program

NASA Astrophysics Data System (ADS)

Littlejohn, Kenneth; Rajabian-Schwart, Vahid; Kovach, Nicholas; Satterthwaite, Charles P.

2017-04-01

The Mission Systems Open Architecture Science and Technology (MOAST) program is an AFRL effort that is developing and demonstrating Open System Architecture (OSA) component prototypes, along with methods and tools, to strategically evolve current OSA standards and technical approaches, promote affordable capability evolution, reduce integration risk, and address emerging challenges [1]. Within the context of open architectures, the program is conducting advanced research and concept development in the following areas: (1) Evolution of standards; (2) Cyber-Resiliency; (3) Emerging Concepts and Technologies; (4) Risk Reduction Studies and Experimentation; and (5) Advanced Technology Demonstrations. Current research includes the development of methods, tools, and techniques to characterize the performance of OMS data interconnection methods for representative mission system applications. Of particular interest are the OMS Critical Abstraction Layer (CAL), the Avionics Service Bus (ASB), and the Bulk Data Transfer interconnects, as well as to develop and demonstrate cybersecurity countermeasures techniques to detect and mitigate cyberattacks against open architecture based mission systems and ensure continued mission operations. Focus is on cybersecurity techniques that augment traditional cybersecurity controls and those currently defined within the Open Mission System and UCI standards. AFRL is also developing code generation tools and simulation tools to support evaluation and experimentation of OSA-compliant implementations.

Detection of Pathogenic Protozoa in the Diagnostic Laboratory: Result Reproducibility, Specimen Pooling, and Competency Assessment▿

PubMed Central

Libman, M. D.; Gyorkos, T. W.; Kokoskin, E.; MacLean, J. D.

2008-01-01

Stool microscopy as performed in clinical parasitology laboratories is a complex procedure with subjective interpretation. Quality assurance (QA) programs often emphasize proficiency testing as an assessment tool. We describe a result reproducibility assessment tool, which can form part of a broader QA program, and which is based on the blinded resubmission of selected clinical samples, using concordance between the reports of the initial and resubmitted specimen as an indicator. Specimens preserved in sodium acetate-acetic acid-formalin can be stored for several months for use in such a program. The presence of multiple protozoa in one specimen does not affect concordance. Some dilution of specimens occurs in this process, and this may explain poor concordance when specimens with low protozoal concentrations are resubmitted. Evaluation of this tool in a large parasitology laboratory revealed concordance rates for pathogenic protozoa (Entamoeba histolytica/Entamoeba dispar, Giardia lamblia, and Dientamoeba fragilis) of about 80%, which may be considered for use as a benchmark value. We also used this tool to demonstrate that when pairs of specimens from one patient are pooled to create a single specimen, concordance between the results of the individual and pooled specimens is high. PMID:18448690

Field Assessment of Energy Audit Tools for Retrofit Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Edwards, J.; Bohac, D.; Nelson, C.

2013-07-01

This project focused on the use of home energy ratings as a tool to promote energy retrofits in existing homes. A home energy rating provides a quantitative appraisal of a home's asset performance, usually compared to a benchmark such as the average energy use of similar homes in the same region. Home rating systems can help motivate homeowners in several ways. Ratings can clearly communicate a home's achievable energy efficiency potential, provide a quantitative assessment of energy savings after retrofits are completed, and show homeowners how they rate compared to their neighbors, thus creating an incentive to conform to amore » social standard. An important consideration is how rating tools for the retrofit market will integrate with existing home energy service programs. For residential programs that target energy savings only, home visits should be focused on key efficiency measures for that home. In order to gain wide adoption, a rating tool must be easily integrated into the field process, demonstrate consistency and reasonable accuracy to earn the trust of home energy technicians, and have a low monetary cost and time hurdle for homeowners. Along with the Home Energy Score, this project also evaluated the energy modeling performance of SIMPLE and REM/Rate.« less

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Das, S.

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamentalmore » materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal projects concentrate on specific classes of materials and nonproprietary components and are done jointly by DOE and the Automotive Composites Consortium of U.S. Council for Automotive Research (USCAR). The third project developed a rapid tooling process that reduces tooling time, originally some 48-52 weeks, to less than 12 weeks by means of rapid generation of die-casting die inserts and development of generic holding blocks, suitable for use with large casting applications. This project was conducted by the United States Automotive Materials Partnership, another USCAR consortium.« less

Vehicle Design Evaluation Program (VDEP). A computer program for weight sizing, economic, performance and mission analysis of fuel-conservative aircraft, multibodied aircraft and large cargo aircraft using both JP and alternative fuels

NASA Technical Reports Server (NTRS)

Oman, B. H.

1977-01-01

The NASA Langley Research Center vehicle design evaluation program (VDEP-2) was expanded by (1) incorporating into the program a capability to conduct preliminary design studies on subsonic commercial transport type aircraft using both JP and such alternate fuels as hydrogen and methane;(2) incorporating an aircraft detailed mission and performance analysis capability; and (3) developing and incorporating an external loads analysis capability. The resulting computer program (VDEP-3) provides a preliminary design tool that enables the user to perform integrated sizing, structural analysis, and cost studies on subsonic commercial transport aircraft. Both versions of the VDEP-3 Program which are designated preliminary Analysis VDEP-3 and detailed Analysis VDEP utilize the same vehicle sizing subprogram which includes a detailed mission analysis capability, as well as a geometry and weight analysis for multibodied configurations.

HKHC Community Dashboard: design, development, and function of a Web-based performance monitoring system.

PubMed

Bors, Philip A; Kemner, Allison; Fulton, John; Stachecki, Jessica; Brennan, Laura K

2015-01-01

As part of Robert Wood Johnson Foundation's Healthy Kids, Healthy Communities (HKHC) national grant program, a technical assistance team designed the HKHC Community Dashboard, an online progress documentation and networking system. The Dashboard was central to HKHC's multimethod program evaluation and became a communication interface for grantees and technical assistance providers. The Dashboard was designed through an iterative process of identifying needs and priorities; designing the user experience, technical development, and usability testing; and applying visual design. The system was created with an open-source content management system and support for building an online community of users. The site developer trained technical assistance providers at the national program office and evaluators, who subsequently trained all 49 grantees. Evaluators provided support for Dashboard users and populated the site with the bulk of its uploaded tools and resource documents. The system tracked progress through an interactive work plan template, regular documentation by local staff and partners, and data coding and analysis by the evaluation team. Other features included the ability to broadcast information to Dashboard users via e-mail, event calendars, discussion forums, private messaging, a resource clearinghouse, a technical assistance diary, and real-time progress reports. The average number of Dashboard posts was 694 per grantee during the grant period. Technical assistance providers and grantees uploaded a total of 1304 resource documents. The Dashboard functions with the highest grantee satisfaction were its interfaces for sharing and progress documentation. A majority of Dashboard users (69%) indicated a preference for continued access to the Dashboard's uploaded resource documents. The Dashboard was a useful and innovative tool for participatory evaluation of a large national grant program. While progress documentation added some burden to local project staff, the system proved to be a useful resource-sharing technology.

Developing community-driven quality improvement initiatives to enhance chronic disease care in Indigenous communities in Canada: the FORGE AHEAD program protocol.

PubMed

Naqshbandi Hayward, Mariam; Paquette-Warren, Jann; Harris, Stewart B

2016-07-26

Given the dramatic rise and impact of chronic diseases and gaps in care in Indigenous peoples in Canada, a shift from the dominant episodic and responsive healthcare model most common in First Nations communities to one that places emphasis on proactive prevention and chronic disease management is urgently needed. The Transformation of Indigenous Primary Healthcare Delivery (FORGE AHEAD) Program partners with 11 First Nations communities across six provinces in Canada to develop and evaluate community-driven quality improvement (QI) initiatives to enhance chronic disease care. FORGE AHEAD is a 5-year research program (2013-2017) that utilizes a pre-post mixed-methods observational design rooted in participatory research principles to work with communities in developing culturally relevant innovations and improved access to available services. This intensive program incorporates a series of 10 inter-related and progressive program activities designed to foster community-driven initiatives with type 2 diabetes mellitus as the action disease. Preparatory activities include a national community profile survey, best practice and policy literature review, and readiness tool development. Community-level intervention activities include community and clinical readiness consultations, development of a diabetes registry and surveillance system, and QI activities. With a focus on capacity building, all community-level activities are driven by trained community members who champion QI initiatives in their community. Program wrap-up activities include readiness tool validation, cost-analysis and process evaluation. In collaboration with Health Canada and the Aboriginal Diabetes Initiative, scale-up toolkits will be developed in order to build on lessons-learned, tools and methods, and to fuel sustainability and spread of successful innovations. The outcomes of this research program, its related cost and the subsequent policy recommendations, will have the potential to significantly affect future policy decisions pertaining to chronic disease care in First Nations communities in Canada. Current ClinicalTrial.gov protocol ID NCT02234973 . Date of Registration: July 30, 2014.

Clinical ladder program implementation: a project guide.

PubMed

Ko, Yu Kyung; Yu, Soyoung

2014-11-01

This article describes the development of a clinical ladder program (CLP) implementation linked to a promotion system for nurses. The CLP task force developed criteria for each level of performance and a performance evaluation tool reflecting the self-motivation of the applicant for professional development. One year after implementation, the number of nurses taking graduate courses increased, and 7 nurses were promoted to nurse manager positions.

Wildfire ignition resistant home design(WIRHD) program: Full-scale testing and demonstration final report.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Quarles, Stephen, L.; Sindelar, Melissa

2011-12-13

The primary goal of the Wildfire ignition resistant home design(WIRHD) program was to develop a home evaluation tool that could assess the ignition potential of a structure subjected to wildfire exposures. This report describes the tests that were conducted, summarizes the results, and discusses the implications of these results with regard to the vulnerabilities to homes and buildings.

Balanced scorecards for performance management.

PubMed

Park, Eun-Jun; Huber, Diane L

2007-01-01

Nurse administrators who manage nursing case management programs are challenged to demonstrate the improved quality of patient care and financial outcomes to their organization that result from such programs. This article introduces the balanced scorecard and discusses its benefits and practical concerns for adopting the scorecard. The balanced scorecard is a useful performance management tool used to both evaluate and direct case management performance in meeting organizational missions and strategies.

Mathematical model of ambulance resources in Saint-Petersburg

NASA Astrophysics Data System (ADS)

Shavidze, G. G.; Balykina, Y. E.; Lejnina, E. A.; Svirkin, M. V.

2016-06-01

Emergency medical system is one of the main elements in city infrastructure. The article contains analysis of existing system of ambulance resource distribution. Paper considers the idea of using multiperiodicity as a tool to increase the efficiency of the Emergency Medical Services. The program developed in programming environment Matlab helps to evaluate the changes in the functioning of the system of emergency medical service.

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

PubMed Central

Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-01-01

Background Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. Objective The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. Methods As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). Results A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content—a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. Conclusions This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program’s evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. PMID:28325712

Evaluating community and campus environmental public health programs.

PubMed

Pettibone, Kristianna G; Parras, Juan; Croisant, Sharon Petronella; Drew, Christina H

2014-01-01

The National Institute of Environmental Health Sciences' (NIEHS) Partnerships for Environmental Public Health (PEPH) program created the Evaluation Metrics Manual as a tool to help grantees understand how to map out their programs using a logic model, and to identify measures for documenting their achievements in environmental public health research. This article provides an overview of the manual, describing how grantees and community partners contributed to the manual, and how the basic components of a logic model can be used to identify metrics. We illustrate how the approach can be implemented, using a real-world case study from the University of Texas Medical Branch, where researchers worked with community partners to develop a network to address environmental justice issues.

Expert opinions on good practice in evaluation of health promotion and primary prevention measures related to children and adolescents in Germany.

PubMed

Korber, Katharina; Becker, Christian

2017-10-02

Determining what constitutes "good practice" in the measurement of the costs and effects of health promotion and disease prevention measures is of particular importance. The aim of this paper was to gather expert knowledge on (economic) evaluations of health promotion and prevention measures for children and adolescents, especially on the practical importance, the determinants of project success, meaningful parameters for evaluations, and supporting factors, but also on problems in their implementation. This information is targeted at people responsible for the development of primary prevention or health promotion programs. Partially structured open interviews were conducted by two interviewers and transcribed, paraphrased, and summarized for further use. Eight experts took part in the interviews. The interviewed experts saw evaluation as a useful tool to establish the effects of prevention programs, to inform program improvement and further development, and to provide arguments to decision making. The respondents' thought that determinants of a program's success were effectiveness with evidence of causality, cost benefit relation, target-group reach and sustainability. It was considered important that hard and soft factors were included in an evaluation; costs were mentioned only by one expert. According to the experts, obstacles to evaluation were lacking resources, additional labor requirements, and the evaluators' unfamiliarity with a program's contents. It was recommended to consider evaluation design before a program is launched, to co-operate with people involved in a program and to make use of existing structures. While in in this study only a partial view of expert knowledge is represented, it could show important points to consider when developing evaluations of prevention programs. By considering these points, researchers could further advance towards a more comprehensive approach of evaluation targeting measures in children and adolescents.

Behavioral patterns of environmental performance evaluation programs.

PubMed

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Let's Stop Trying to Quantify Household Vulnerability: The Problem With Simple Scales for Targeting and Evaluating Economic Strengthening Programs.

PubMed

Moret, Whitney M

2018-03-21

Economic strengthening practitioners are increasingly seeking data collection tools that will help them target households vulnerable to HIV and poor child well-being outcomes, match households to appropriate interventions, monitor their status, and determine readiness for graduation from project support. This article discusses efforts in 3 countries to develop simple, valid tools to quantify and classify economic vulnerability status. In Côte d'Ivoire, we conducted a cross-sectional survey with 3,749 households to develop a scale based on the definition of HIV-related economic vulnerability from the U.S. President's Emergency Plan for AIDS Relief (PEPFAR) for the purpose of targeting vulnerable households for PEPFAR-funded programs for orphans and vulnerable children. The vulnerability measures examined did not cluster in ways that would allow for the creation of a small number of composite measures, and thus we were unable to develop a scale. In Uganda, we assessed the validity of a vulnerability index developed to classify households according to donor classifications of economic status by measuring its association with a validated poverty measure, finding only a modest correlation. In South Africa, we developed monitoring and evaluation tools to assess economic status of individual adolescent girls and their households. We found no significant correlation with our validation measures, which included a validated measure of girls' vulnerability to HIV, a validated poverty measure, and subjective classifications generated by the community, data collector, and respondent. Overall, none of the measures of economic vulnerability used in the 3 countries varied significantly with their proposed validation items. Our findings suggest that broad constructs of economic vulnerability cannot be readily captured using simple scales to classify households and individuals in a way that accounts for a substantial amount of variance at locally defined vulnerability levels. We recommend that researchers and implementers design monitoring and evaluation instruments to capture narrower definitions of vulnerability based on characteristics programs intend to affect. We also recommend using separate tools for targeting based on context-specific indicators with evidence-based links to negative outcomes. Policy makers and donors should avoid reliance on simplified metrics of economic vulnerability in the programs they support. © Moret.

Simulation modelling as a tool for knowledge mobilisation in health policy settings: a case study protocol.

PubMed

Freebairn, L; Atkinson, J; Kelly, P; McDonnell, G; Rychetnik, L

2016-09-21

Evidence-informed decision-making is essential to ensure that health programs and services are effective and offer value for money; however, barriers to the use of evidence persist. Emerging systems science approaches and advances in technology are providing new methods and tools to facilitate evidence-based decision-making. Simulation modelling offers a unique tool for synthesising and leveraging existing evidence, data and expert local knowledge to examine, in a robust, low risk and low cost way, the likely impact of alternative policy and service provision scenarios. This case study will evaluate participatory simulation modelling to inform the prevention and management of gestational diabetes mellitus (GDM). The risks associated with GDM are well recognised; however, debate remains regarding diagnostic thresholds and whether screening and treatment to reduce maternal glucose levels reduce the associated risks. A diagnosis of GDM may provide a leverage point for multidisciplinary lifestyle modification interventions. This research will apply and evaluate a simulation modelling approach to understand the complex interrelation of factors that drive GDM rates, test options for screening and interventions, and optimise the use of evidence to inform policy and program decision-making. The study design will use mixed methods to achieve the objectives. Policy, clinical practice and research experts will work collaboratively to develop, test and validate a simulation model of GDM in the Australian Capital Territory (ACT). The model will be applied to support evidence-informed policy dialogues with diverse stakeholders for the management of GDM in the ACT. Qualitative methods will be used to evaluate simulation modelling as an evidence synthesis tool to support evidence-based decision-making. Interviews and analysis of workshop recordings will focus on the participants' engagement in the modelling process; perceived value of the participatory process, perceived commitment, influence and confidence of stakeholders in implementing policy and program decisions identified in the modelling process; and the impact of the process in terms of policy and program change. The study will generate empirical evidence on the feasibility and potential value of simulation modelling to support knowledge mobilisation and consensus building in health settings.

Health Sciences Information Tools 2000: a cooperative health sciences library/public school information literacy program for medical assistant students.

PubMed Central

Spang, L; Marks, E; Adams, N

1998-01-01

Educating diverse groups in how to access, use, and evaluate information available through information technologies is emerging as an essential responsibility for health sciences librarians in today's complex health care system. One group requiring immediate attention is medical assistants. Projections indicate that medical assistant careers will be among the fastest growing occupations in the twenty-first century. The expanding use and importance of information in all health care settings requires that this workforce be well versed in information literacy skills. But, for public school vocational education staff charged with educating entry level workers to meet this specialized demand, the expense of hiring qualified professionals and acquiring the sophisticated technology necessary to teach such skills poses a dilemma. Health Sciences Information Tools 2000, a cooperative work-study information literacy program jointly formulated by the Wayne State University's Shiffman Medical Library and the Detroit Public Schools' Crockett Career and Technical Center, demonstrates that cooperation between the health sciences library and the public school is a mutually beneficial and constructive solution. This article describes the background, goals, curriculum, personnel, costs, and evaluation methods of Tools 2000. The Shiffman-Crockett information literacy program, adaptable to a variety of library settings, is an innovative means of preparing well-trained high school vocational education students for beginning level medical assistant positions as well as further education in the health care field. PMID:9803297

Improved Aerodynamic Analysis for Hybrid Wing Body Conceptual Design Optimization

NASA Technical Reports Server (NTRS)

Gern, Frank H.

2012-01-01

This paper provides an overview of ongoing efforts to develop, evaluate, and validate different tools for improved aerodynamic modeling and systems analysis of Hybrid Wing Body (HWB) aircraft configurations. Results are being presented for the evaluation of different aerodynamic tools including panel methods, enhanced panel methods with viscous drag prediction, and computational fluid dynamics. Emphasis is placed on proper prediction of aerodynamic loads for structural sizing as well as viscous drag prediction to develop drag polars for HWB conceptual design optimization. Data from transonic wind tunnel tests at the Arnold Engineering Development Center s 16-Foot Transonic Tunnel was used as a reference data set in order to evaluate the accuracy of the aerodynamic tools. Triangularized surface data and Vehicle Sketch Pad (VSP) models of an X-48B 2% scale wind tunnel model were used to generate input and model files for the different analysis tools. In support of ongoing HWB scaling studies within the NASA Environmentally Responsible Aviation (ERA) program, an improved finite element based structural analysis and weight estimation tool for HWB center bodies is currently under development. Aerodynamic results from these analyses are used to provide additional aerodynamic validation data.

The Impact of IEEE-1076 on VHDL (Hardware Description Language)

DTIC Science & Technology

1988-12-01

Portability simply refers to how machine-independent the language is defined. The Efficiency criterion looks at how fast a program compiles and how ...if a programming language is good. The evaluation was done to determine if IEEE Standard 1076-1987 was indeed a better version of VHDL than its...must be UNIX-based and be able to * use the tools that are common to that operating system such as lex [Lesk78I, yacc [John78] and the programming