Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

PubMed Central

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Using RUFDATA to guide a logic model for a quality assurance process in an undergraduate university program.

PubMed

Sherman, Paul David

2016-04-01

This article presents a framework to identify key mechanisms for developing a logic model blueprint that can be used for an impending comprehensive evaluation of an undergraduate degree program in a Canadian university. The evaluation is a requirement of a comprehensive quality assurance process mandated by the university. A modified RUFDATA (Saunders, 2000) evaluation model is applied as an initiating framework to assist in decision making to provide a guide for conceptualizing a logic model for the quality assurance process. This article will show how an educational evaluation is strengthened by employing a RUFDATA reflective process in exploring key elements of the evaluation process, and then translating this information into a logic model format that could serve to offer a more focussed pathway for the quality assurance activities. Using preliminary program evaluation data from two key stakeholders of the undergraduate program as well as an audit of the curriculum's course syllabi, a case is made for, (1) the importance of inclusivity of key stakeholders participation in the design of the evaluation process to enrich the authenticity and accuracy of program participants' feedback, and (2) the diversification of data collection methods to ensure that stakeholders' narrative feedback is given ample exposure. It is suggested that the modified RUFDATA/logic model framework be applied to all academic programs at the university undergoing the quality assurance process at the same time so that economies of scale may be realized. Copyright © 2015 Elsevier Ltd. All rights reserved.

Cognitive Restructuring through Dreams and Imagery: Descriptive Analysis of a Women's Prison-Based Program

ERIC Educational Resources Information Center

DeHart, Dana

2010-01-01

This report describes process and outcome evaluation of an innovative program based in a women's maximum-security correctional facility. Methodology included review of program materials, unobtrusive observation of group process, participant evaluation forms, focus groups, and individual interviews with current and former program participants.…

Institution Building and Evaluation.

ERIC Educational Resources Information Center

Wedemeyer, Charles A.

Institutional modeling and program evaluation in relation to a correspondence program are discussed. The evaluation process is first considered from the viewpoint that it is an add-on activity, which is largely summative, and is the least desirable type of evaluation. Formative evaluation is next considered as a part of the process of institution…

Health Care Merged With Senior Housing: Description and Evaluation of a Successful Program.

PubMed

Barry, Theresa Teta

2017-01-01

Objective: This article describes and evaluates a successful partnership between a large health care organization and housing for seniors. The program provides on-site, primary care visits by a physician and a nurse in addition to intensive social services to residents in an affordable senior housing apartment building located in Pennsylvania. Per Donabedian's "Structure-Process-Outcome" model, the program demonstrated positive health care outcomes for its participants via a prescribed structure. To provide guidance for replication in similar settings, we qualitatively evaluated the processes by which successful outcomes were obtained. Methods: With program structures in place and outcomes measured, this case study collected and analyzed qualitative information taken from key informant interviews on care processes involved in the program. Themes were extracted from semistructured interviews and used to describe the processes that helped and hindered the program. Results and Discussion: Common processes were identified across respondents; however, the nuanced processes that lead to successful outcomes suggest that defined structures and processes may not be sufficient to produce similar outcomes in other settings. Further research is needed to determine the program's replicability and policy implications.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

PubMed

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

A data collection and processing procedure for evaluating a research program

Treesearch

Giuseppe Rensi; H. Dean Claxton

1972-01-01

A set of computer programs compiled for the information processing requirements of a model for evaluating research proposals are described. The programs serve to assemble and store information, periodically update it, and convert it to a form usable for decision-making. Guides for collecting and coding data are explained. The data-processing options available and...

Formative Process Evaluation for Implementing a Social Marketing Intervention to Increase Walking Among African Americans in the Positive Action for Today’s Health Trial

PubMed Central

Wilson, Dawn K.; Griffin, Sarah; St. George, Sara M.; Alia, Kassandra A.; Trumpeter, Nevelyn N.; Wandersman, Abraham K.; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-01-01

Objectives. Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today’s Health trial. Methods: We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Results: Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Conclusions: Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities. PMID:23078486

Non-formal educator use of evaluation results.

PubMed

Baughman, Sarah; Boyd, Heather H; Franz, Nancy K

2012-08-01

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

PubMed

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of Career Guidance Programs: Models, Methods, and Microcomputers. Information Series No. 317.

ERIC Educational Resources Information Center

Crites, John O.

Evaluating the effectiveness of career guidance programs is a complex process, and few comprehensive models for evaluating such programs exist. Evaluation of career guidance programs has been hampered by the myth that program outcomes are uniform and monolithic. Findings from studies of attribute treatment interactions have revealed only a few…

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

ERIC Educational Resources Information Center

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

PubMed Central

2013-01-01

Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

A Product Evaluation of the Selective Abandonment Process for School Budgeting

ERIC Educational Resources Information Center

Loofe, Christopher M.

2016-01-01

The purpose of this study is to evaluate the degree to which the Selective Abandonment budget process objectives were achieved by analyzing stakeholder perceptions. Use of this evaluation may enable the district to become more effective, efficient, and more fiscally responsible when developing future program budgeting plans. Program evaluation was…

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

48 CFR 719.273-6 - Application process.

Code of Federal Regulations, 2010 CFR

2010-10-01

... SOCIOECONOMIC PROGRAMS SMALL BUSINESS PROGRAMS The U.S. Agency for International Development (USAID) Mentor-Protégé Program 719.273-6 Application process. Entities interested in becoming a Mentor firm must... the Mentor-Protégé Agreement and shall be evaluated for approval. Evaluations will consider the nature...

An Evaluation Program for the Eckerd Foundation Therapeutic Wilderness Camping Program: An Evaluation of an Atypical Alternative Education Program.

ERIC Educational Resources Information Center

Griffin, William H.; Carter, James D.

The strategy used in evaluating an out-of-doors resident camping program for emotionally disturbed children is outlined. This strategy calls for examining the following elements in the program: (1) program goals and objectives; (2) collection and processing program data; (3) camper progress assessment; (4) program audit; (5) assessment of past…

The Evaluation and Research of Multi-Project Programs: Program Component Analysis.

ERIC Educational Resources Information Center

Baker, Eva L.

1977-01-01

It is difficult to base evaluations on concepts irrelevant to state policy making. Evaluation of a multiproject program requires both time and differentiation of method. Data from the California Early Childhood Program illustrate process variables for program component analysis, and research questions for intraprogram comparison. (CP)

Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

ERIC Educational Resources Information Center

Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

2004-01-01

This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

Comparative Evaluation of Financing Programs: Insights From California’s Experience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deason, Jeff

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less

Semi-Markov adjunction to the Computer-Aided Markov Evaluator (CAME)

NASA Technical Reports Server (NTRS)

Rosch, Gene; Hutchins, Monica A.; Leong, Frank J.; Babcock, Philip S., IV

1988-01-01

The rule-based Computer-Aided Markov Evaluator (CAME) program was expanded in its ability to incorporate the effect of fault-handling processes into the construction of a reliability model. The fault-handling processes are modeled as semi-Markov events and CAME constructs and appropriate semi-Markov model. To solve the model, the program outputs it in a form which can be directly solved with the Semi-Markov Unreliability Range Evaluator (SURE) program. As a means of evaluating the alterations made to the CAME program, the program is used to model the reliability of portions of the Integrated Airframe/Propulsion Control System Architecture (IAPSA 2) reference configuration. The reliability predictions are compared with a previous analysis. The results bear out the feasibility of utilizing CAME to generate appropriate semi-Markov models to model fault-handling processes.

Process evaluation of the project P.A.T.H.S. (secondary 2 program): findings based on the co-walker scheme.

PubMed

Shek, Daniel T L; Tam, Suet-yan

2009-01-01

To understand the implementation quality of the Tier 1 Program (Secondary 2 Curriculum) of the P.A.T.H.S. Project, process evaluation was carried out by co-walkers through classroom observation of 195 units in 131 schools. Results showed that the overall level of program adherence was generally high with an average of 84.55%, and different factors of the implementation process were evaluated as positive. Quality of program implementation and achievement of program objectives were predicted by students' participation and involvement, strategies to enhance students' motivation, opportunity for reflection, time management, and class preparation. Success in program implementation was predicted by students' participation and involvement, classroom control, interactive delivery method, strategies to enhance students' motivation, opportunity for reflection, and lesson preparation.

Implementing Impact Evaluations of Malaria Control Interventions: Process, Lessons Learned, and Recommendations

PubMed Central

Hershey, Christine L.; Bhattarai, Achuyt; Florey, Lia S.; McElroy, Peter D.; Nielsen, Carrie F.; Yé, Yazoume; Eckert, Erin; Franca-Koh, Ana Cláudia; Shargie, Estifanos; Komatsu, Ryuichi; Smithson, Paul; Thwing, Julie; Mihigo, Jules; Herrera, Samantha; Taylor, Cameron; Shah, Jui; Mouzin, Eric; Yoon, Steven S.; Salgado, S. René

2017-01-01

Abstract. As funding for malaria control increased considerably over the past 10 years resulting in the expanded coverage of malaria control interventions, so did the need to measure the impact of these investments on malaria morbidity and mortality. Members of the Roll Back Malaria (RBM) Partnership undertook impact evaluations of malaria control programs at a time when there was little guidance in terms of the process for conducting an impact evaluation of a national-level malaria control program. The President’s Malaria Initiative (PMI), as a member of the RBM Partnership, has provided financial and technical support for impact evaluations in 13 countries to date. On the basis of these experiences, PMI and its partners have developed a streamlined process for conducting the evaluations with a set of lessons learned and recommendations. Chief among these are: to ensure country ownership and involvement in the evaluations; to engage stakeholders throughout the process; to coordinate evaluations among interested partners to avoid duplication of efforts; to tailor the evaluation to the particular country context; to develop a standard methodology for the evaluations and a streamlined process for completion within a reasonable time; and to develop tailored dissemination products on the evaluation for a broad range of stakeholders. These key lessons learned and resulting recommendations will guide future impact evaluations of malaria control programs and other health programs. PMID:28990921

A Participatory Action Research Approach To Evaluating Inclusive School Programs.

ERIC Educational Resources Information Center

Dymond, Stacy K.

2001-01-01

This article proposes a model for evaluating inclusive schools. Key elements of the model are inclusion of stakeholders in the evaluation process through a participatory action research approach, analysis of program processes and outcomes, use of multiple methods and measures, and obtaining perceptions from diverse stakeholder groups. (Contains…

Statistical Process Control in the Practice of Program Evaluation.

ERIC Educational Resources Information Center

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Evaluating the Child Care Director: The Collaborative Professional Assessment Process.

ERIC Educational Resources Information Center

Freeman, Nancy K.; Brown, Mac H.

2000-01-01

Describes the Collaborative Professional Assessment Process (CPAP) to guide the evaluation of the director of early childhood programs. Examines the assumptions upon which the CPAP is based. Lists the management skills and leadership abilities of successful child care directors. Includes the Director Self-Evaluation form and a program evaluation…

Program Evaluation: Roles and Responsibilities of Boards of Education Relative to Thorough and Efficient Legislation.

ERIC Educational Resources Information Center

Research for Better Schools, Inc., Philadelphia, PA.

The process for providing a "thorough and efficient" (T & E) education according to New Jersey statutes and regulations involves six basic steps. This document suggests procedures for handling the fifth step, educational program evaluation. Processes discussed include committee formation, evaluation planning, action plan…

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

ERIC Educational Resources Information Center

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Evaluation Strategies in Financial Education: Evaluation with Imperfect Instruments

ERIC Educational Resources Information Center

Robinson, Lauren; Dudensing, Rebekka; Granovsky, Nancy L.

2016-01-01

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

Library Programs. Evaluating Federally Funded Public Library Programs.

ERIC Educational Resources Information Center

Office of Educational Research and Improvement (ED), Washington, DC.

Following an introduction by Betty J. Turock, nine reports examine key issues in library evaluation: (1) "Output Measures and the Evaluation Process" (Nancy A. Van House) describes measurement as a concept to be understood in the larger context of planning and evaluation; (2) "Adapting Output Measures to Program Evaluation"…

The Judicial Process as a Form of Program Evaluation.

ERIC Educational Resources Information Center

Ellsberry, James

1980-01-01

Maintaining that the judicial process is particularly effective as a form of program evaluation, this article details organizational procedures and lists the following advantages for use of the judicial process: issues are investigated in an open forum, the community can participate, and exciting opportunities for teaching and learning are…

Evidence of the Adoption and Implementation of a Statewide Childhood Obesity Prevention Initiative in the New York State WIC Program: The "NY Fit WIC" Process Evaluation

ERIC Educational Resources Information Center

Sekhobo, Jackson P.; Egglefield, Katherine; Edmunds, Lynn S.; Shackman, Gene

2012-01-01

Process evaluations are critical in determining whether outcome evaluations are warranted. This study assessed the extent to which a childhood obesity prevention initiative, "NY Fit WIC", was adopted and implemented by the New York State Supplemental Nutrition Program for Women, Infants and Children (WIC). Process data came from…

Some Evaluative Comments Based on a Review of the Curriculum Development Processes Operating in the Stanford Program on International and Cross Cultural Education. [and] A Review of the Curriculum. Development Processes Operating in the Stanford Program on International and Cross-Cultural Education.

ERIC Educational Resources Information Center

Kennedy, Kerry J.

The processes of instructional materials development and dissemination used in four Stanford Program on International and Cross Cultural Education (SPICE) projects dealing with Latin America, Africa, China, and Japan are described, and evaluative comments based on a review of the curriculum development process are made. The major purpose of the…

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

NASA Technical Reports Server (NTRS)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Creating an Information Literacy Badges Program in Blackboard: A Formative Program Evaluation

ERIC Educational Resources Information Center

Tunon, Johanna; Ramirez, Laura Lucio; Ryckman, Brian; Campbell, Loy; Mlinar, Courtney

2015-01-01

A formative program evaluation using Stufflebeam's (2010) Context, Input, Process, Product (CIPP) model was conducted to assess the use of digital badges for tracking basic library instructional skills across academic programs at Nova Southeastern University. Based on the evaluation of pilot library modules and Blackboard Learn's badges…

US-VISIT Identity Matching Algorithm Evaluation Program: ADIS Algorithm Evaluation Project Plan Update

DOE Office of Scientific and Technical Information (OSTI.GOV)

Grant, C W; Lenderman, J S; Gansemer, J D

This document is an update to the 'ADIS Algorithm Evaluation Project Plan' specified in the Statement of Work for the US-VISIT Identity Matching Algorithm Evaluation Program, as deliverable II.D.1. The original plan was delivered in August 2010. This document modifies the plan to reflect modified deliverables reflecting delays in obtaining a database refresh. This document describes the revised schedule of the program deliverables. The detailed description of the processes used, the statistical analysis processes and the results of the statistical analysis will be described fully in the program deliverables. The US-VISIT Identity Matching Algorithm Evaluation Program is work performed bymore » Lawrence Livermore National Laboratory (LLNL) under IAA HSHQVT-07-X-00002 P00004 from the Department of Homeland Security (DHS).« less

An example of international drug politics--the development and distribution of substance prevention programs directed at adolescents.

PubMed

Lilja, John; Giota, Joanna; Hamilton, David; Larsson, Sam

2007-01-01

Many substance use prevention programs directed at adolescents exist that have been developed by researchers in the United States and are intended to be used in school settings. Some of the problems associated with such programs are reviewed, including their accessibility, ease of use, copyright status, evaluation options, program scales, and ratings, together with an overall consideration of the factors and processes posited to be associated with substance use and non-use (posited "at-risk" and "protective" mechanisms). The authors contend that there is a great need to: (a) develop substance use prevention programs which are commercially available but are not protected by copyright, (b) assess empirically each component in a program separately, and (c) encourage funding bodies to be more active in supporting the production of manuals and evaluation instruments for substance use prevention programs directed at adolescents. We need more and better process evaluations that are also sensitive to both endogenous and exogenous forces in order to know the processes by which a successful prevention program achieves its effects, is prevented from doing so and which processes are irrelevant. A social competence framework might be used as both a goal and as a theoretical base to achieve a better understanding of the processes by which substance use prevention programs reach their effects.

Using Multi-Objective Genetic Programming to Synthesize Stochastic Processes

NASA Astrophysics Data System (ADS)

Ross, Brian; Imada, Janine

Genetic programming is used to automatically construct stochastic processes written in the stochastic π-calculus. Grammar-guided genetic programming constrains search to useful process algebra structures. The time-series behaviour of a target process is denoted with a suitable selection of statistical feature tests. Feature tests can permit complex process behaviours to be effectively evaluated. However, they must be selected with care, in order to accurately characterize the desired process behaviour. Multi-objective evaluation is shown to be appropriate for this application, since it permits heterogeneous statistical feature tests to reside as independent objectives. Multiple undominated solutions can be saved and evaluated after a run, for determination of those that are most appropriate. Since there can be a vast number of candidate solutions, however, strategies for filtering and analyzing this set are required.

Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

Improve the Quality of Teaching in Your Schools.

ERIC Educational Resources Information Center

Greene, Brenda Z.

1985-01-01

Teacher quality can be improved through teacher evaluation, intervention programs, incentives or rewards, and counseling. In the Toledo, Ohio, peer evaluation program, evaluation and staff development go hand in hand. The program was developed through a collaborative and cooperative process and uses teacher consultants to evaluate and supervise…

Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

ERIC Educational Resources Information Center

Bruhns, Arthur E.

Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

Practical Considerations in Evaluating Patient/Consumer Health Education Programs.

ERIC Educational Resources Information Center

Bryant, Nancy H.

This report contains brief descriptions of seven evaluative efforts and outcomes of health education programs, some considerations of problems encountered in evaluating the programs, and detailed descriptions of two case studies: (1) a process evaluation of preoperative teaching and (2) a retrospective study of visiting nurse association use by…

Evaluation of the Capillary Blood Glucose Self-monitoring Program

PubMed Central

Augusto, Mariana Cristina; Nitsche, Maria José Trevizani; Parada, Cristina Maria Garcia de Lima; Zanetti, Maria Lúcia; Carvalhaes, Maria Antonieta de Barros Leite

2014-01-01

OBJECTIVE: to evaluate the structure, process and results of the Capillary Blood Glucose Self-monitoring Program in a Brazilian city. METHOD: epidemiological, cross-sectional study. The methodological framework of Donabedian was used to construct indicators of structure, process and outcome. A random sample (n = 288) of users enrolled and 96 health professionals who worked in the program was studied. Two questionnaires were used that were constructed for this study, one for professionals and one for users, both containing data for the evaluation of structure, process and outcome. Anthropometric measures and laboratory results were collected by consulting the patients' health records. The analysis involved descriptive statistics. RESULTS: most of the professionals were not qualified to work in the program and were not knowledgeable about the set of criteria for patient registration. None of the patients received complete and correct orientations about the program and the percentage with skills to perform conducts autonomously was 10%. As regards the result indicators, 86.4% of the patients and 81.3% of the professionals evaluated the program positively. CONCLUSION: the evaluation indicators designed revealed that one of the main objectives of the program, self-care skills, has not been achieved. PMID:25493676

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

Evaluation of the Academic Occupational Program of the County of Leduc, From September, 1981 to June, 1984. Executive Summary.

ERIC Educational Resources Information Center

Nyberg, V. R.

The paper reports results of an academic occupational program intended for educable mentally handicapped and learning disabled secondary students in Leduc, Alberta. An introduction reviews history of the program and the evaluation process. The evaluation plan, based on R. Stake's model for program evaluation, is described, and sources of data…

An Evaluation System for the Online Training Programs in Meteorology and Hydrology

ERIC Educational Resources Information Center

Wang, Yong; Zhi, Xiefei

2009-01-01

This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…

Evaluation of a PhD Program: Paving the Way.

ERIC Educational Resources Information Center

Germain, Carol P.; And Others

1994-01-01

During the evolution of an evaluation process for the University of Pennsylvania's doctoral program in nursing, a task force developed criteria and sources for program evaluation and surveyed students, alumni, and faculty to write a self-study report for external reviewers. (JOW)

An Evaluation of the Employee Training and Development Process for Nicolet Area Technical College's Basic Education Program.

ERIC Educational Resources Information Center

Karl, Luis C.

The adult basic education (ABE) program at Nicolet Area Technical College (NATC) evaluated its training and development (T&D) process for new basic education instructors. The study gathered monitoring and screening criteria that addressed valuable components for use in an instrument for validating effectiveness of the ABE program (T&D)…

Evaluation of programs to improve complementary feeding in infants and young children.

PubMed

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Legislative Evaluation.

ERIC Educational Resources Information Center

Fox, Harrison

The speaker discusses Congressional program evaluation. From the Congressional perspective, good evaluators understand the political, social, and economic processes; are familiar with various evaluation methods; and know how to use authority and power within their roles. Program evaluation serves three major purposes: to anticipate social impact…

Process evaluation to explore internal and external validity of the "Act in Case of Depression" care program in nursing homes.

PubMed

Leontjevas, Ruslan; Gerritsen, Debby L; Koopmans, Raymond T C M; Smalbrugge, Martin; Vernooij-Dassen, Myrra J F J

2012-06-01

A multidisciplinary, evidence-based care program to improve the management of depression in nursing home residents was implemented and tested using a stepped-wedge design in 23 nursing homes (NHs): "Act in case of Depression" (AiD). Before effect analyses, to evaluate AiD process data on sampling quality (recruitment and randomization, reach) and intervention quality (relevance and feasibility, extent to which AiD was performed), which can be used for understanding internal and external validity. In this article, a model is presented that divides process evaluation data into first- and second-order process data. Qualitative and quantitative data based on personal files of residents, interviews of nursing home professionals, and a research database were analyzed according to the following process evaluation components: sampling quality and intervention quality. Nursing home. The pattern of residents' informed consent rates differed for dementia special care units and somatic units during the study. The nursing home staff was satisfied with the AiD program and reported that the program was feasible and relevant. With the exception of the first screening step (nursing staff members using a short observer-based depression scale), AiD components were not performed fully by NH staff as prescribed in the AiD protocol. Although NH staff found the program relevant and feasible and was satisfied with the program content, individual AiD components may have different feasibility. The results on sampling quality implied that statistical analyses of AiD effectiveness should account for the type of unit, whereas the findings on intervention quality implied that, next to the type of unit, analyses should account for the extent to which individual AiD program components were performed. In general, our first-order process data evaluation confirmed internal and external validity of the AiD trial, and this evaluation enabled further statistical fine tuning. The importance of evaluating the first-order process data before executing statistical effect analyses is thus underlined. Copyright © 2012 American Medical Directors Association, Inc. Published by Elsevier Inc. All rights reserved.

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

PubMed Central

Van der Wees, Philip J; Hendriks, Erik JM; Custers, Jan WH; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-01-01

Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program. PMID:18036215

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

PubMed

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program.

Development Process and Outcome Evaluation of a Program for Raising Awareness of Indirect and Relational Aggression in Elementary Schools: A Preliminary Study

ERIC Educational Resources Information Center

Verlaan, Pierrette; Turmel, France

2010-01-01

The development process of a program for raising awareness of indirect and relational aggression in elementary school children and teachers is described and a preliminary outcome evaluation of the program was conducted. The 188 participants were derived from 8 fourth- through sixth-grade elementary classes in two lower-middle-class schools from…

Process Evaluation of "Learn Young, Learn Fair": A Stress Management Programme for 5th and 6th Graders

ERIC Educational Resources Information Center

Kraag, Gerda; Van Breukelen, Gerard; Lamberts, Petra; Vugts, Odette; Kok, Gerjo; Fekkes, Minne; Abu-Saad, Huda Huijer

2007-01-01

This article describes the process evaluation of a stress management program called "Learn Young, Learn Fair" for 5th and 6th graders. Studies, reviews and meta-analyses of prevention programs report that a common limitation in studies is the restricted documentation of process factors that contribute to the success of interventions. Program…

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers.

PubMed

Viester, Laura; Verhagen, Evert A L M; Bongers, Paulien M; van der Beek, Allard J

2014-11-01

To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions. Effectiveness was assessed on motivational stage-of-change, self-efficacy, and decisional balance for physical activity and dietary behavior. The external validity of the trial was satisfactory with representative reach of workers and adoption of workplace units in the participating construction company. The extent to which the program was implemented as intended was modest. The intervention was effective on participants' progress through stages of behavior change. Based on the RE-AIM dimensions, it is concluded that for construction workers, the program is feasible and potentially effective, but adjustments are required before widespread implementation.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

PubMed

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

PubMed

Charnley, Susan; Engelbert, Bruce

2005-11-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation project assesses how effective the Superfund community involvement program is in promoting public participation in decisions about how to clean up hazardous wastes at Superfund sites. We do three things in the article: (1) share our experience with evaluating an Agency public participation program, including lessons learned about methods of evaluation; (2) report evaluation results; and (3) address a number of issues pertaining to the evaluation of public participation in environmental decision-making. Our goal is to encourage more environmental managers to incorporate evaluation into their public participation programs as a tool for improving them. We found that written mail surveys were an effective and economical tool for obtaining feedback on EPA's community involvement program at Superfund sites. The evaluation focused on four criteria: citizen satisfaction with EPA information about the Superfund site, citizen understanding of environmental and human health risks associated with the site, citizen satisfaction with opportunities provided by EPA for community input, and citizen satisfaction with EPA's response to community input. While the evaluation results were mixed, in general, community members who were most informed about and involved in the cleanup process at Superfund sites generally were also the most satisfied with the community involvement process, and the job that EPA was doing cleaning up the site. We conclude that systematic evaluation provides meaningful and useful information that agencies can use to improve their public participation programs. However, there need to be institutionalized processes that ensure evaluation results are used to develop and implement strategies for improvement.

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

PubMed

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Program Evaluation: Where Instruction and School Business Meet

ERIC Educational Resources Information Center

Ayers, Steven V.

2011-01-01

In this article, the author talks about program evaluation, a strategy commonly used by instructional leaders that can help school business officials improve their budget process. As districts struggle to develop budgets in these challenging economic times, school business officials might consider turning to program evaluation for help. Program…

Evaluating Injury Prevention Programs: The Oklahoma City Smoke Alarm Project.

ERIC Educational Resources Information Center

Mallonee, Sue

2000-01-01

Illustrates how evaluating the Oklahoma City Smoke Alarm Project increased its success in reducing residential fire-related injuries and deaths. The program distributed and tested smoke alarms in residential dwellings and offered educational materials on fire prevention and safety. Evaluation provided sound data on program processes and outcomes,…

Cost Analysis for Educational Program Evaluation.

ERIC Educational Resources Information Center

Haller, Emil J.

Concerned with the problem of determining program costs as part of the evaluation process, this article helps the practitioner arrive at useful conceptions of the term "cost" and procedures for assessing the costs of an educational program. Its purpose is to help design costing procedures for evaluation situations that are commonly encountered. An…

Evaluation development for a physical activity positive youth development program for girls.

PubMed

Ullrich-French, Sarah; Cole, Amy N; Montgomery, Anna K

2016-04-01

Girls on the Run (GOTR) is an after school program for girls in third through fifth grade which utilizes a physical activity based positive youth development curriculum that culminates with completing a 5K run. Unfortunately, there is little empirical data documenting GOTR participant changes that align with the curriculum and describe the evaluation process. Therefore, this study presents an evaluation of GOTR consisting of three main processes: curriculum content analysis and stakeholder focus groups (N=11) to identify key outcomes of the program; community-based participatory research to collaborate with program personnel to further identify important outcomes; and the design and pilot testing of an instrument (N=104) for assessing changes in the theoretically grounded outcomes over time. Findings demonstrated a positive collaborative process that led to important information to be used for an impact evaluation of Girls on the Run and for future evaluation development efforts for physical activity based positive youth development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Community outreach: from measuring the difference to making a difference with health information*

PubMed Central

Ottoson, Judith M.; Green, Lawrence W.

2005-01-01

Background: Community-based outreach seeks to move libraries beyond their traditional institutional boundaries to improve both access to and effectiveness of health information. The evaluation of such outreach needs to involve the community in assessing the program's process and outcomes. Purpose: Evaluation of community-based library outreach programs benefits from a participatory approach. To explain this premise of the paper, three components of evaluation theory are paired with relevant participatory strategies. Concepts: The first component of evaluation theory is also a standard of program evaluation: use. Evaluation is intended to be useful for stakeholders to make decisions. A useful evaluation is credible, timely, and of adequate scope. Participatory approaches to increase use of evaluation findings include engaging end users early in planning the program itself and in deciding on the outcomes of the evaluation. A second component of evaluation theory seeks to understand what is being evaluated, such as specific aspects of outreach programs. A transparent understanding of the ways outreach achieves intended goals, its activities and linkages, and the context in which it operates precedes any attempt to measure it. Participatory approaches to evaluating outreach include having end users, such as health practitioners in other community-based organizations, identify what components of the outreach program are most important to their work. A third component of evaluation theory is concerned with the process by which value is placed on outreach. What will count as outreach success or failure? Who decides? Participatory approaches to valuing include assuring end-user representation in the formulation of evaluation questions and in the interpretation of evaluation results. Conclusions: The evaluation of community-based outreach is a complex process that is not made easier by a participatory approach. Nevertheless, a participatory approach is more likely to make the evaluation findings useful, ensure that program knowledge is shared, and make outreach valuing transparent. PMID:16239958

A Discrepancy-Based Methodology for Nuclear Training Program Evaluation.

ERIC Educational Resources Information Center

Cantor, Jeffrey A.

1991-01-01

A three-phase comprehensive process for commercial nuclear power training program evaluation is presented. The discrepancy-based methodology was developed after the Three Mile Island nuclear reactor accident. It facilitates analysis of program components to identify discrepancies among program specifications, actual outcomes, and industry…

Tailoring a video-feedback intervention for sensitive discipline to parents with intellectual disabilities: a process evaluation.

PubMed

Hodes, Marja W; Meppelder, H Marieke; Schuengel, Carlo; Kef, Sabina

2014-01-01

Parenting support programs for the general population may not be effective for parents with intellectual disabilities (ID). A videobased intervention program based on attachment and coercion theory (Video-feedback Intervention to promote Positive Parenting with additional focus on Sensitive Discipline; VIPP-SD) was tailored to parents with ID and the implementation of the adapted program was evaluated by the home visitors conducting the program. Home visitors (N = 17) of 36 families rated the intervention process during each session. Home visitors' evaluations showed a significant increase in positive ratings of parents' easiness to work with, amenability to influence, and openness. Cooperation remained stable. A case example illustrated this process, showing how feedback using video facilitated changes in the perceptions and attributions of a mother with mild ID.

SITE PROGRAM DEMONSTRATION ECO LOGIC INTERNATIONAL GAS-PHASE CHEMICAL REDUCTION PROCESS, BAY CITY, MICHIGAN TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

The SITE Program funded a field demonstration to evaluate the Eco Logic Gas-Phase Chemical Reduction Process developed by ELI Eco Logic International Inc. (ELI), Ontario, Canada. The Demonstration took place at the Middleground Landfill in Bay City, Michigan using landfill wa...

Evaluator's Guide for Word Processing Software.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

This guide provides a detailed evaluation form, together with complete instructions for using it, which is designed to elicit answers to the following questions: (1) What features and abilities does a specific word processing program have? (2) On which computer(s) will the program work? (3) Is additional hardware/software necessary before the…

Evaluation of the Cosmetology Program at Caldwell Community College and Technical Institute--Fall, 1981.

ERIC Educational Resources Information Center

Pipes, V. David

In fall 1981, the cosmetology program at Caldwell Community College and Technical Institute (CCC&TI) was evaluated as part of a process to create a model for the periodic evaluation of all occupational programs at the school. In addition to collecting information for planning and program improvement, the study sought to assess the achievement of…

Special Education Program Evaluation: A Planning Guide. An Overview. CASE Commissioned Series.

ERIC Educational Resources Information Center

McLaughlin, John A.

This resource guide is intended to help in planning special education program evaluations. It focuses on: basic evaluation concepts, identification of special education decision makers and their information needs, specific evaluation questions, procedures for gathering relevant information, and evaluation of the evaluation process itself.…

Engaging partners to initiate evaluation efforts: tactics used and lessons learned from the prevention research centers program.

PubMed

Wright, Demia Sundra; Anderson, Lynda A; Brownson, Ross C; Gwaltney, Margaret K; Scherer, Jennifer; Cross, Alan W; Goodman, Robert M; Schwartz, Randy; Sims, Tom; White, Carol R

2008-01-01

The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.

The Perfect Marriage: Integrated Word Processing and Data Base Management Programs.

ERIC Educational Resources Information Center

Pogrow, Stanley

1983-01-01

Discussion of database integration and how it operates includes recommendations on compatible brand name word processing and database management programs, and a checklist for evaluating essential and desirable features of the available programs. (MBR)

Evaluating Math Drill and Practice Programs.

ERIC Educational Resources Information Center

Schnorr, Janice M.; Semmel, Dorothy S.

1986-01-01

General guidelines for a process evaluation of software for a specific subject and grade include: (1) Specify instructional objectives and list desired software program characteristics; (2) Access and review descriptions of programs (information sources for math programs are listed); (3) Preview software; and (4) Compare and make purchase…

TEXACO GASIFICATION PROCESS - INNOVATIVE TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

This report summarizes the evaluation of the Texaco Gasification Process (TGP) conducted under the U.S. Environmental Protection Agency (EPA) Superfund Innovative Technology Evaluation (SITE) Program. The Texaco Gasification Process was developed by Texaco Inc. The TGP is a comm...

A Structure and Scheme for the Evaluation of Innovative Programs. The EPIC Brief, Issue No. 2.

ERIC Educational Resources Information Center

Objective evaluation of school programs is a process in which a school staff collects information used to provide feedback as to whether or not a given set of objectives has been met. The Evaluative Programs for Innovativ e Curriculums (EPIC) four-step scheme of objective evaluation is based on a three-dimensional structure of variables…

Structuring an Internal Evaluation Process.

ERIC Educational Resources Information Center

Gordon, Sheila C.; Heinemann, Harry N.

1980-01-01

The design of an internal program evaluation system requires (1) formulation of program, operational, and institutional objectives; (2) establishment of evaluation criteria; (3) choice of data collection and evaluation techniques; (4) analysis of results; and (5) integration of the system into the mainstream of operations. (SK)

Federally Mandated Evaluation of Vocational Programs: One College's Response.

ERIC Educational Resources Information Center

Stevenson, Mike; Walleri, R. Dan

The process and findings of the evaluation of seven of the 52 vocational preparatory programs at Mount Hood Community College are described with a focus on demonstrating the feasibility, utility, and problems associated with making program evaluations meet both internal needs and federal requirements. Summaries of data collected are provided in…

A treatment program for individuals with deficient evaluative processing and consequent impaired social and risk judgement.

PubMed

Park, Norman W; Conrod, Brian; Hussain, Zahra; Murphy, Kelly J; Rewilak, Dmytro; Black, Sandra E

2003-01-01

The current study evaluated the effectiveness of a rehabilitation program developed to assist individuals such as AM who have impaired social and risk judgement. AM's difficulties developed after a severe traumatic brain injury that resulted in bilateral frontal and temporal lobe damage including damage to the amygdala. Previous work (Park et al., 2001) established that AM had impaired automatic processing of negative, but not positive evaluative information, and relatively spared processing of both types of evaluative information when using controlled or strategic processing. In the Strategic Evaluation of Alternatives (SEA) treatment program, AM was trained to compensate for his impairments by explicitly retrieving positive and negative attributes associated with potential actions prior to performing them. The SEA treatment focused specifically on improving AM's ability to obtain financial compensation for his work-related activities. Results showed improved performance on work-related activities and evidence of generalization. Analyses suggested that the process underlying improved performance was compensatory rather than restorative in nature. We discuss the implications of these results for the development of rehabilitation treatment for patients with impaired social and risk judgement.

A Case Study of the Impact of a Sytematic Evaluation Process in a Graduate Medical Education Residency Program

ERIC Educational Resources Information Center

Kromrei, Heidi T.

2014-01-01

The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if…

Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

ERIC Educational Resources Information Center

Greci, Dana

2016-01-01

Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

76 FR 30696 - Technology Evaluation Process

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-26

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... (DOE) seeks comments and information related to a commercial buildings technology evaluation process... technologies for commercial buildings based on the voluntary submittal of product test data. The program would...

Preparing Youth for College and Career: A Process Evaluation of Urban Alliance

ERIC Educational Resources Information Center

Theodos, Brett; Pergamit, Michael R.; Edelstein, Sara; George, Taz; Freiman, Lesley

2014-01-01

This report presents baseline and process study findings of an evaluation of the Urban Alliance high school internship program, which provides training, mentoring, and work experience to high school seniors from distressed communities in Washington, DC, Baltimore, Northern Virginia, and Chicago. The report, which focuses on the program's…

Process Evaluation of a Parenting Program for Low-Income Families in South Africa

ERIC Educational Resources Information Center

Lachman, Jamie M.; Kelly, Jane; Cluver, Lucie; Ward, Catherine L.; Hutchings, Judy; Gardner, Frances

2018-01-01

Objective: This mixed-methods process evaluation examined the feasibility of a parenting program delivered by community facilitators to reduce the risk of child maltreatment in low-income families with children aged 3-8 years in Cape Town, South Africa (N = 68). Method: Quantitative measures included attendance registers, fidelity checklists,…

A methodology for evaluation of an interactive multispectral image processing system

NASA Technical Reports Server (NTRS)

Kovalick, William M.; Newcomer, Jeffrey A.; Wharton, Stephen W.

1987-01-01

Because of the considerable cost of an interactive multispectral image processing system, an evaluation of a prospective system should be performed to ascertain if it will be acceptable to the anticipated users. Evaluation of a developmental system indicated that the important system elements include documentation, user friendliness, image processing capabilities, and system services. The criteria and evaluation procedures for these elements are described herein. The following factors contributed to the success of the evaluation of the developmental system: (1) careful review of documentation prior to program development, (2) construction and testing of macromodules representing typical processing scenarios, (3) availability of other image processing systems for referral and verification, and (4) use of testing personnel with an applications perspective and experience with other systems. This evaluation was done in addition to and independently of program testing by the software developers of the system.

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

A process evaluation of a social cognitive theory-based childhood obesity prevention intervention: the Comics for Health program.

PubMed

Branscum, Paul; Sharma, Manoj; Wang, Lihshing Leigh; Wilson, Bradley; Rojas-Guyler, Liliana

2013-03-01

Process evaluations are an often overlooked yet essential component of health promotion interventions. This study reports the results of a comprehensive process evaluation for the "Comics for Health" program, a childhood obesity prevention intervention implemented at 12 after-school programs. Qualitative and quantitative process data were collected using surveys, field notes, and open-item questionnaires, which assessed program fidelity, dose delivered, dose received, reach, recruitment, and context. Triangulation of methods was also employed to better understand how the program was implemented and received by the facilitator, staff members, and children in the program. Results indicated that program implementation had an almost perfect rate of fidelity with most lessons recording 100% tasks completed. Lessons were implemented in their intended order and lasted approximately 30 minutes as planned. After-school staff members reported that the program was well received by children, and this program should be replicated in the future. Attendance records showed that a majority of the children attended each lesson on the initial day of delivery (70.4%) and informal make-up lessons were implemented to compensate for the other children. Finally, several known sources of contamination were found such as past and concurrent exposure to similar health promotion interventions, which could potentially influence study outcomes. These findings will be used to help explain the results of this intervention and make recommendations for future intervention efforts.

Is the Closet Door Still Closed in 2014? A CIPP Model Program Evaluation of Preservice Diversity Training Regarding LGBT Issues

ERIC Educational Resources Information Center

Woodruff, Joseph

2014-01-01

The purpose of this program evaluation was to examine the four components of the CIPP evaluation model (Context, Input, Process, and Product evaluations) in the diversity training program conceptualization and design delivered to College of Education K-12 preservice teachers at a large university in the southeastern United States (referred to in…

"Compassion, pleasantry, and hope": a process evaluation of a volunteer-based nonprofit.

PubMed

Mye, Sarah C; Moracco, Kathryn E

2015-06-01

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Using Faculty-Developed Exit Examinations to Evaluate Academic Programs.

ERIC Educational Resources Information Center

Banta, Trudy W.; Schneider, Janet A.

1988-01-01

Four dozen departments at the University of Tennessee, Knoxville, are using faculty-developed exit examinations for majors as one component of a comprehensive program evaluation process. The experience of 11 program faculties in developing and using such examinations are summarized. (Author/MLW)

The intervention process in the European Fans in Training (EuroFIT) trial: a mixed method protocol for evaluation.

PubMed

van de Glind, I; Bunn, C; Gray, C M; Hunt, K; Andersen, E; Jelsma, J; Morgan, H; Pereira, H; Roberts, G; Rooksby, J; Røynesdal, Ø; Silva, M; Sorensen, M; Treweek, S; van Achterberg, T; van der Ploeg, H; van Nassau, F; Nijhuis-van der Sanden, M; Wyke, S

2017-07-27

EuroFIT is a gender-sensitised, health and lifestyle program targeting physical activity, sedentary time and dietary behaviours in men. The delivery of the program in football clubs, led by the clubs' community coaches, is designed to both attract and engage men in lifestyle change through an interest in football or loyalty to the club they support. The EuroFIT program will be evaluated in a multicentre pragmatic randomised controlled trial (RCT), for which ~1000 overweight men, aged 30-65 years, will be recruited in 15 top professional football clubs in the Netherlands, Norway, Portugal and the UK. The process evaluation is designed to investigate how implementation within the RCT is achieved in the various football clubs and countries and the processes through which EuroFIT affects outcomes. This mixed methods evaluation is guided by the Medical Research Council (MRC) guidance for conducting process evaluations of complex interventions. Data will be collected in the intervention arm of the EuroFIT trial through: participant questionnaires (n = 500); attendance sheets and coach logs (n = 360); observations of sessions (n = 30); coach questionnaires (n = 30); usage logs from a novel device for self-monitoring physical activity and non-sedentary behaviour (SitFIT); an app-based game to promote social support for physical activity outside program sessions (MatchFIT); interviews with coaches (n = 15); football club representatives (n = 15); and focus groups with participants (n = 30). Written standard operating procedures are used to ensure quality and consistency in data collection and analysis across the participating countries. Data will be analysed thematically within datasets and overall synthesis of findings will address the processes through which the program is implemented in various countries and clubs and through which it affects outcomes, with careful attention to the context of the football club. The process evaluation will provide a comprehensive account of what was necessary to implement the EuroFIT program in professional football clubs within a trial setting and how outcomes were affected by the program. This will allow us to re-appraise the program's conceptual base, optimise the program for post-trial implementation and roll out, and offer suggestions for the development and implementation of future initiatives to promote health and wellbeing through professional sports clubs. ISRCTN81935608 . Registered on 16 June 2015.

Implementing and Evaluating School-Based Primary Prevention Programs and the Importance of Differential Effects on Outcomes

ERIC Educational Resources Information Center

Hussey, David L.; Flannery, Daniel J.

2007-01-01

In 2004, Second Step (Committee for Children, 2002), a violence prevention program, was implemented in the Cleveland Heights-University Heights school district for 1,416 K through second grade students. Both process and outcome measures were used to evaluate program impact and examine issues related to the implementation and evaluation of…

Chapter I Mathematics Program, 1983-84. Report of Evaluation.

ERIC Educational Resources Information Center

Tompkins, John F.

This report provides an evaluation of the Chapter I mathematics program for 1,020 first through eighth grade students in the Des Moines Independent Community School District. Included is a description of the program, information on program budget and expenditures, and narrative accounts of the attainment of 17 performance and process objectives.…

Evaluation of the Olweus Bullying Prevention Program in Nine Urban Schools: Effective Practices and next Steps

ERIC Educational Resources Information Center

Black, Sally; Washington, Ericka

2008-01-01

The Olweus Bullying Prevention Program (BPP) is an internationally recognized school-based bullying prevention program. This project sought to evaluate pilot implementation of the program in one urban district using fidelity of implementation, bullying incident density (BID), student surveys, and serious incident reports as process and outcome…

Lessons learned from evaluating launch-site processing problems of Space Shuttle payloads

NASA Technical Reports Server (NTRS)

Flores, Carlos A.; Heuser, Robert E.; Sales, Johnny R.; Smith, Anthony M.

1992-01-01

The authors discuss a trend analysis program that is being conducted on the problem reports written during the processing of Space Shuttle payloads at Kennedy Space Center. The program is aimed at developing lessons learned that can both improve the effectiveness of the current payload processing cycles as well as help to guide the processing strategies for Space Station Freedom. The payload processing reports from STS 26R and STS 41 are used. A two-tier evaluation activity is described, and some typical results from the tier one analyses are presented.

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

Transportation infrastructure : review of project selection process for five FHWA discretionary programs

DOT National Transportation Integrated Search

1997-11-01

DOT uses a two-phase process for selecting and funding transportation : projects for the five discretionary programs we reviewed. In the first : phase, FHWA program staff in the field and headquarters compile and : evaluate the applications that stat...

15 CFR 2301.17 - Evaluation criteria for construction and planning applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... PUBLIC TELECOMMUNICATIONS FACILITIES PROGRAM Evaluation and Selection Process § 2301.17 Evaluation... significant diversity in the ownership of, operation of, and participation in public telecommunications... attitudes of diverse listeners by promoting the development of more effective programming strategies...

A Comparison of Participant and Practitioner Beliefs About Evaluation

PubMed Central

Whitehall, Anna K.; Hill, Laura G.; Koehler, Christian R.

2014-01-01

The move to build capacity for internal evaluation is a common organizational theme in social service delivery, and in many settings, the evaluator is also the practitioner who delivers the service. The goal of the present study was to extend our limited knowledge of practitioner evaluation. Specifically, the authors examined practitioner concerns about administering pretest and posttest evaluations within the context of a multisite 7-week family strengthening program and compared those concerns with self-reported attitudes of the parents who completed evaluations. The authors found that program participants (n = 105) were significantly less likely to find the evaluation process intrusive, and more likely to hold positive beliefs about the evaluation process, than practitioners (n = 140) expected. Results of the study may address a potential barrier to effective practitioner evaluation—the belief that having to administer evaluations interferes with establishing a good relationship with program participants. PMID:25328379

10 CFR 712.36 - Medical assessment process.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Medical assessment process. 712.36 Section 712.36 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.36 Medical assessment process. (a) The... the SOMD must integrate the medical evaluations, psychological evaluations, psychiatric evaluations...

A Process Evaluation of Project Developmental Continuity. Interim Report IV, Volume 2: Development of the Implementation and Cost Studies.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This interim report describes the development of program implementation and cost studies for Year II of the process evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Specific areas focused…

Experience Based Career Education at Wichita East High School: A Third-Party Evaluation for Year Two, 1977-78.

ERIC Educational Resources Information Center

Crawford, George; Miskel, Cecil

A third-party evaluation was conducted to assess the second year's operation of the Experience Based Career Education (EBCE) program at Wichita (Kansas) High School East. The program proposal contained fourteen process objectives and twelve outcome objectives. The status of the process objective achievement was determined by interviewing program…

A Process Evaluation of the Alaska Native Colorectal Cancer Family Outreach Program

ERIC Educational Resources Information Center

Redwood, Diana; Provost, Ellen; Lopez, Ellen D. S.; Skewes, Monica; Johnson, Rhonda; Christensen, Claudia; Sacco, Frank; Haverkamp, Donald

2016-01-01

This article presents the results of a process evaluation of the Alaska Native (AN) Colorectal Cancer (CRC) Family Outreach Program, which encourages CRC screening among AN first-degree relatives (i.e., parents, siblings, adult children; hereafter referred to as relatives) of CRC patients. Among AN people incidence and death rates from CRC are the…

DEP : a computer program for evaluating lumber drying costs and investments

Treesearch

Stewart Holmes; George B. Harpole; Edward Bilek

1983-01-01

The DEP computer program is a modified discounted cash flow computer program designed for analysis of problems involving economic analysis of wood drying processes. Wood drying processes are different from other processes because of the large amounts of working capital required to finance inventories, and because of relatively large shares of costs charged to inventory...

Evaluating the Facilities Planning, Design, and Construction Department: The Capital Programs Management Audit.

ERIC Educational Resources Information Center

Kaiser, Harvey H.; Kirkwood, Dennis M.

2000-01-01

Presents a diagnostic model for assessing the state of an institution's capital programs management (CPM) by delineating "work processes" which comprise that function. What capital programs management is, its resources, and its phases and work processes are described, followed by case studies of the CPM Process Model as an assessment tool. (GR)

45 CFR 309.145 - What costs are allowable for Tribal IV-D programs carried out under § 309.65(a) of this part?

Code of Federal Regulations, 2010 CFR

2010-10-01

.... (h) Automated data processing computer systems, including: (1) Planning efforts in the identification, evaluation, and selection of an automated data processing computer system solution meeting the program... existing automated data processing computer system to support Tribal IV-D program operations, and...

45 CFR 309.145 - What costs are allowable for Tribal IV-D programs carried out under § 309.65(a) of this part?

Code of Federal Regulations, 2013 CFR

2013-10-01

.... (h) Automated data processing computer systems, including: (1) Planning efforts in the identification, evaluation, and selection of an automated data processing computer system solution meeting the program... existing automated data processing computer system to support Tribal IV-D program operations, and...

45 CFR 309.145 - What costs are allowable for Tribal IV-D programs carried out under § 309.65(a) of this part?

Code of Federal Regulations, 2014 CFR

2014-10-01

.... (h) Automated data processing computer systems, including: (1) Planning efforts in the identification, evaluation, and selection of an automated data processing computer system solution meeting the program... existing automated data processing computer system to support Tribal IV-D program operations, and...

45 CFR 309.145 - What costs are allowable for Tribal IV-D programs carried out under § 309.65(a) of this part?

Code of Federal Regulations, 2012 CFR

2012-10-01

.... (h) Automated data processing computer systems, including: (1) Planning efforts in the identification, evaluation, and selection of an automated data processing computer system solution meeting the program... existing automated data processing computer system to support Tribal IV-D program operations, and...

45 CFR 309.145 - What costs are allowable for Tribal IV-D programs carried out under § 309.65(a) of this part?

Code of Federal Regulations, 2011 CFR

2011-10-01

.... (h) Automated data processing computer systems, including: (1) Planning efforts in the identification, evaluation, and selection of an automated data processing computer system solution meeting the program... existing automated data processing computer system to support Tribal IV-D program operations, and...

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

Evaluating the Healthy Start program. Design development to evaluative assessment.

PubMed

Raykovich, K S; McCormick, M C; Howell, E M; Devaney, B L

1996-09-01

The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could be used to evaluate 15 diverse grantees. This article discusses the experience of creating a process and outcomes evaluation design that was both substantively and methodologically appropriate given such issues as the diversity of grantees and their community-based intervention strategies; the process of accessing secondary data sources, including vital records; the quality of client level data submissions; and the need to incorporate both qualitative and quantitative approaches into the evaluation design. The relevance of this experience for the conduct of other field studies of public health interventions is discussed.

Evaluating Community College Personnel: A Research Report.

ERIC Educational Resources Information Center

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

The Development of MUMPS-Based Rehabilitation Psychology Computer Applications.

ERIC Educational Resources Information Center

Dutro, Kenneth R.

The use of computer assisted programs in career exploration and occupational information is well documented. Various phases of the vocational counseling process, i.e., diagnostic evaluation, program planning, career exploration, case management, and program evaluation, offer similarly promising opportunities for computerization. Using the…

Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

PubMed

MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

2006-01-01

The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

Empowerment evaluation with programs designed to prevent first-time male perpetration of sexual violence.

PubMed

Noonan, Rita K; Gibbs, Deborah

2009-01-01

This special issue captures several threads in the ongoing evolution of sexual violence prevention. The articles that follow examine an empowerment evaluation process with four promising programs dedicated to preventing first-time male perpetration of sexual violence, as well as evaluation findings. Both the evaluation approach and the programs examined shed light on how sexual violence prevention can continue to be improved in the future.

The Vanderbilt Professional Nursing Practice Program: part 1: Growing and supporting professional nursing practice.

PubMed

Robinson, Karen; Eck, Carol; Keck, Becky; Wells, Nancy

2003-09-01

Professional practice programs are designed to attract, retain, and reward nurses. This three-part series will describe Vanderbilt's performance-based career advancement system, the Vanderbilt Professional Nursing Practice Program (VPNPP). Part 1 outlines the overall program's foundation, philosophical background, and basic structure. The VPNPP is built upon Benner's work, distinguishing among four levels of practice: novice, competent, proficient, and expert. Work by many in the organization identified the expected behaviors for nurses at each level, which were then used to develop clear process evaluation criteria. Part 2 will examine the performance measurement and evaluation system created to support the program. The process of advancing within the program will be described in part 3.

The Vanderbilt Professional Nursing Practice Program, part 3: managing an advancement process.

PubMed

Steaban, Robin; Fudge, Mitzie; Leutgens, Wendy; Wells, Nancy

2003-11-01

Consistency of performance standards across multiple clinical settings is an essential component of a credible advancement system. Our advancement process incorporates a central committee, composed of nurses from all clinical settings within the institution, to ensure consistency of performance in inpatient, outpatient, and procedural settings. An analysis of nurses advanced during the first 18 months of the program indicates that performance standards are applicable to nurses in all clinical settings. The first article (September 2003) in this 3-part series described the foundation for and the philosophical background of the Vanderbilt Professional Nursing Practice Program (VPNPP), the career advancement program underway at Vanderbilt University Medical Center. Part 2 described the development of the evaluation tools used in the VPNPP, the implementation and management of this new system, program evaluation, and improvements since the program's inception. The purpose of this article is to review the advancement process, review the roles of those involved in the process, and to describe outcomes and lessons learned.

Process evaluation of the Regional Biomass Energy Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describemore » experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.« less

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

A Formal Language Selection Process for Introductory Programming Courses

ERIC Educational Resources Information Center

Parker, Kevin R.; Chao, Joseph T.; Ottaway, Thomas A.; Chang, Jane

2006-01-01

The selection of a programming language for introductory courses has long been an informal process involving faculty evaluation, discussion, and consensus. As the number of faculty, students, and language options grows, this process becomes increasingly unwieldy. As it stands, the process currently lacks structure and replicability. Establishing a…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

The Evaluation of a North Carolina Truancy Intervention Program: Is It Culturally Sensitive?

ERIC Educational Resources Information Center

Carson, Deborah

2013-01-01

Truancy issues are longstanding and the desires to develop programs that are effective have been just as enduring. More striking is the lack of evidence of a truancy program evaluation process that includes collaboration with the clients that it serves. Truancy intervention programs have a wide range of effects on participants from multiple ethnic…

Process Engineering with the Evolutionary Spiral Process Model. Version 01.00.06

DTIC Science & Technology

1994-01-01

program . Process Definition and SPC-92041-CMC Provides methods for defining and Modeling Guidebook documenting processes so they can be analyzed, modified...and Program Evaluation and Review Technique (PERT) support the activity of developing a project schedule. A variety of automated tools, such as...keep the organiza- tion from becoming disoriented during the improvement program (Curtis, Kellner, and Over 1992). Analyzing and documenting how

Design and Assessment of an Associate Degree-Level Plant Operations Technical Education Program

NASA Astrophysics Data System (ADS)

Selwitz, Jason Lawrence

Research was undertaken to develop and evaluate an associate degree-level technical education program in Plant Operations oriented towards training students in applied science, technology, engineering, and mathematics (STEM) skills and knowledge relevant to a spectrum of processing industries. This work focuses on four aspects of the curriculum and course development and evaluation research. First, the context of, and impetus for, what was formerly called vocational education, now referred to as technical or workforce education, is provided. Second, the research that was undertaken to design and evaluate an associate degree-level STEM workforce education program is described. Third, the adaptation of a student self-assessment of learning gains instrument is reviewed, and an analysis of the resulting data using an adapted logic model is provided, to evaluate the extent to which instructional approaches, in two process control/improvement-focused courses, were effective in meeting course-level intended learning outcomes. Finally, eight integrative multiscale exercises were designed from two example process systems, wastewater treatment and fast pyrolysis. The integrative exercises are intended for use as tools to accelerate the formation of an operator-technician's multiscale vision of systems, unit operations, underlying processes, and fundamental reactions relevant to multiple industries. Community and technical colleges serve a vital function in STEM education by training workers for medium- and high-skilled technical careers and providing employers the labor necessary to operate and maintain thriving business ventures. Through development of the curricular, course, and assessment-related instruments and tools, this research helps ensure associate degree-level technical education programs can engage in a continual process of program evaluation and improvement.

Californium-252 Program Equipment Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chattin, Fred Rhea; Wilson, Kenton; Ezold, Julie G.

2017-12-01

To successfully continue the 252Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

42 CFR 460.18 - CMS evaluation of applications.

Code of Federal Regulations, 2010 CFR

2010-10-01

... (CONTINUED) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PACE Organization Application and Waiver Process § 460.18 CMS evaluation of applications...

42 CFR 460.18 - CMS evaluation of applications.

Code of Federal Regulations, 2011 CFR

2011-10-01

... (CONTINUED) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PROGRAMS OF ALL-INCLUSIVE CARE FOR THE ELDERLY (PACE) PACE Organization Application and Waiver Process § 460.18 CMS evaluation of applications...

49 CFR 40.291 - What is the role of the SAP in the evaluation, referral, and treatment process of an employee who...

Code of Federal Regulations, 2010 CFR

2010-10-01

... employee to an appropriate education and/or treatment program; (3) Conducting a face-to-face follow-up evaluation to determine if the employee has actively participated in the education and/or treatment program..., referral, and treatment process of an employee who has violated DOT agency drug and alcohol testing...

Process Evaluation of the Boost-A™ Transition Planning Program for Adolescents on the Autism Spectrum: A Strengths-Based Approach

ERIC Educational Resources Information Center

Hatfield, Megan; Falkmer, Marita; Falkmer, Torbjörn; Ciccarelli, Marina

2018-01-01

A process evaluation was conducted to determine the effectiveness, usability, and barriers and facilitators related to the Better OutcOmes & Successful Transitions for Autism (BOOST-A™), an online transition planning program. Adolescents on the autism spectrum (n = 33) and their parents (n = 39) provided feedback via an online questionnaire.…

Care management program evaluation: constituents, conflicts, and moves toward standardization.

PubMed

Long, D Adam; Perry, Theodore L; Pelletier, Kenneth R; Lehman, Gregg O

2006-06-01

Care management program evaluations bring together constituents from finance, medicine, and social sciences. The differing assumptions and scientific philosophies that these constituents bring to the task often lead to frustrations and even contentions. Given the forms and variations of care management programs, the difficulty associated with program outcomes measurement should not be surprising. It is no wonder then that methods for clinical and economic evaluations of program efficacy continue to be debated and have yet to be standardized. We describe these somewhat hidden processes, examine where the industry stands, and provide recommendations for steps to standardize evaluation methodology.

Study of Former Students of the Word Processing Program. Volume XXIII, No. 5.

ERIC Educational Resources Information Center

Lucas, John A.; Zilkowski, Robert R.

As part of the program evaluation and review process at William Rainey Harper College (WRHC) in Illinois, a follow-up study was conducted of students who had enrolled in the college's Word Processing Program between summer 1989 and spring 1994. A survey was mailed to 500 former students, receiving a response rate of 37.6%. Study findings included…

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

NASA Astrophysics Data System (ADS)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

Practical strategies for nursing education program evaluation.

PubMed

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

ERIC Educational Resources Information Center

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Developing Evaluation Capacity through Process Use

ERIC Educational Resources Information Center

King, Jean A.

2007-01-01

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

Health Services, Student Services Department: Program Evaluation. 1990-91.

ERIC Educational Resources Information Center

Jeschke, Thomas; And Others

This document evaluates the Des Moines Public Schools health services and education program, which utilizes the professional expertise of school nurses throughout the district. The program promotes success in the learning process for students (including those with complex health care needs, conditions, and disabilities), employees, and the…

Situated Research Design and Methodological Choices in Formative Program Evaluation

ERIC Educational Resources Information Center

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Program Review/Evaluation Policy and Procedures.

ERIC Educational Resources Information Center

Colorado Northwestern Community Coll., Rangely.

At Colorado Northwestern Community College (CNCC), all educational programs, as well as student services and support functions, are formally reviewed/evaluated in depth at least once every five years. This nine-part outline, providing a step-by-step description of the program review process at CNCC, includes the following sections: (1) the value…

Evaluating and Selecting Sport Management Undergraduate Programs.

ERIC Educational Resources Information Center

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

Labor Market Assessments: An Essential Data Element for Program Development and Evaluation.

ERIC Educational Resources Information Center

Friedel, Janice N.

The Eastern Iowa Community College District (EICCD) has conducted labor market assessments in 17 occupations related to its programs. These assessments are an integral component of the EICCD program evaluation process. These assessments provide valuable information in the specific occupational areas regarding (1) characteristics of the local…

External quality-assurance programs managed by the U.S. Geological Survey in support of the National Atmospheric Deposition Program/National Trends Network

USGS Publications Warehouse

Latysh, Natalie E.; Wetherbee, Gregory A.

2005-01-01

The U.S. Geological Survey, Branch of Quality Systems, operates the external quality-assurance programs for the National Atmospheric Deposition Program/National Trends Network (NADP/NTN). Beginning in 1978, six different programs have been implemented?the intersite-comparison program, the blind-audit program, the sample-handling evaluation program, the field-audit program, the interlaboratory-comparison program, and the collocated-sampler program. Each program was designed to measure error contributed by specific components in the data-collection process. The intersite-comparison program, which was discontinued in 2004, was designed to assess the accuracy and reliability of field pH and specific-conductance measurements made by site operators. The blind-audit and sample-handling evaluation programs, which also were discontinued in 2002 and 2004, respectively, assessed contamination that may result from sampling equipment and routine handling and processing of the wet-deposition samples. The field-audit program assesses the effects of sample handling, processing, and field exposure. The interlaboratory-comparison program evaluates bias and precision of analytical results produced by the contract laboratory for NADP, the Illinois State Water Survey, Central Analytical Laboratory, and compares its performance with the performance of international laboratories. The collocated-sampler program assesses the overall precision of wet-deposition data collected by NADP/NTN. This report documents historical operations and the operating procedures for each of these external quality-assurance programs. USGS quality-assurance information allows NADP/NTN data users to discern between actual environmental trends and inherent measurement variability.

A merged model of quality improvement and evaluation: maximizing return on investment.

PubMed

Woodhouse, Lynn D; Toal, Russ; Nguyen, Trang; Keene, DeAnna; Gunn, Laura; Kellum, Andrea; Nelson, Gary; Charles, Simone; Tedders, Stuart; Williams, Natalie; Livingood, William C

2013-11-01

Quality improvement (QI) and evaluation are frequently considered to be alternative approaches for monitoring and assessing program implementation and impact. The emphasis on third-party evaluation, particularly associated with summative evaluation, and the grounding of evaluation in the social and behavioral science contrast with an emphasis on the integration of QI process within programs or organizations and its origins in management science and industrial engineering. Working with a major philanthropic organization in Georgia, we illustrate how a QI model is integrated with evaluation for five asthma prevention and control sites serving poor and underserved communities in rural and urban Georgia. A primary foundation of this merged model of QI and evaluation is a refocusing of the evaluation from an intimidating report card summative evaluation by external evaluators to an internally engaged program focus on developmental evaluation. The benefits of the merged model to both QI and evaluation are discussed. The use of evaluation based logic models can help anchor a QI program in evidence-based practice and provide linkage between process and outputs with the longer term distal outcomes. Merging the QI approach with evaluation has major advantages, particularly related to enhancing the funder's return on investment. We illustrate how a Plan-Do-Study-Act model of QI can (a) be integrated with evaluation based logic models, (b) help refocus emphasis from summative to developmental evaluation, (c) enhance program ownership and engagement in evaluation activities, and (d) increase the role of evaluators in providing technical assistance and support.

Adaptation of Lean Six Sigma Methodologies for the Evaluation of Veterans Choice Program at 3 Urban Veterans Affairs Medical Centers.

PubMed

Ball, Sherry L; Stevenson, Lauren D; Ladebue, Amy C; McCreight, Marina S; Lawrence, Emily C; Oestreich, Taryn; Lambert-Kerzner, Anne C

2017-07-01

The Veterans Health Administration (VHA) is adapting to meet the changing needs of our Veterans. VHA leaders are promoting quality improvement strategies including Lean Six Sigma (LSS). This study used LSS tools to evaluate the Veterans Choice Program (VCP), a program that aims to improve access to health care services for eligible Veterans by expanding health care options to non-VHA providers. LSS was utilized to assess the current process and efficiency patterns of the VCP at 3 VHA Medical Centers. LSS techniques were used to assess data obtained through semistructured interviews with Veterans, staff, and providers to describe and evaluate the VCP process by identifying wastes and defects. The LSS methodology facilitated the process of targeting priorities for improvement and constructing suggestions to close identified gaps and inefficiencies. Identified key process wastes included inefficient exchange of clinical information between stakeholders in and outside of the VHA; poor dissemination of VCP programmatic information; shortages of VCP-participating providers; duplication of appointments; declines in care coordination; and lack of program adaptability to local processes. Recommendations for improvement were formulated using LSS. This evaluation illustrates how LSS can be utilized to assess a nationally mandated health care program. By focusing on stakeholder, staff, and Veteran perspectives, process defects in the VCP were identified and improvement recommendations were made. However, the current LSS language used is not intuitive in health care and similar applications of LSS may consider using new language and goals adapted specifically for health care.

A Guide to Program Planning Vol. II.

ERIC Educational Resources Information Center

Allen, Earl, Sr.

This booklet is a simplified guide for program planning and is intended to complement a somewhat lengthier companion booklet on program evaluation. It spells out in outline fashion the basic elements and steps involved in the planning process. Brief sections focus in turn on different phases of the planning process, including problem…

Evaluating participation in water resource management: A review

NASA Astrophysics Data System (ADS)

Carr, G.; BlöSchl, G.; Loucks, D. P.

2012-11-01

Key documents such as the European Water Framework Directive and the U.S. Clean Water Act state that public and stakeholder participation in water resource management is required. Participation aims to enhance resource management and involve individuals and groups in a democratic way. Evaluation of participatory programs and projects is necessary to assess whether these objectives are being achieved and to identify how participatory programs and projects can be improved. The different methods of evaluation can be classified into three groups: (i) process evaluation assesses the quality of participation process, for example, whether it is legitimate and promotes equal power between participants, (ii) intermediary outcome evaluation assesses the achievement of mainly nontangible outcomes, such as trust and communication, as well as short- to medium-term tangible outcomes, such as agreements and institutional change, and (iii) resource management outcome evaluation assesses the achievement of changes in resource management, such as water quality improvements. Process evaluation forms a major component of the literature but can rarely indicate whether a participation program improves water resource management. Resource management outcome evaluation is challenging because resource changes often emerge beyond the typical period covered by the evaluation and because changes cannot always be clearly related to participation activities. Intermediary outcome evaluation has been given less attention than process evaluation but can identify some real achievements and side benefits that emerge through participation. This review suggests that intermediary outcome evaluation should play a more important role in evaluating participation in water resource management.

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

A Preliminary Evaluation of a School Support Program for Children with Autism Spectrum Disorders: Educator and School Level Outcomes and Program Processes

ERIC Educational Resources Information Center

McDougall, Janette; Servais, Michelle; Meyer, Katherine; Case, Sheila; Dannenhold, Kara; Johnson, Sue; Riggin, Colleen

2009-01-01

This is a preliminary evaluation of a program aimed at providing training, consultation, and resource materials to educators in public schools in order to build the capacity of those educators and schools to meet the needs of students with autism spectrum disorders. Educator and school level outcomes were evaluated and information about program…

Participation versus Privacy in the Training of Group Counselors.

ERIC Educational Resources Information Center

Pierce, Keith A.; Baldwin, Cynthia

1990-01-01

Examines the process of requiring and evaluating personal growth group participation for students in counselor education programs. Discusses the key components in the dilemma of protecting privacy while evaluating competencies, including ethical practices and program alternatives to avoid evaluation. Proposes a model that will enable participation…

What is actually measured in process evaluations for worksite health promotion programs: a systematic review

PubMed Central

2013-01-01

Background Numerous worksite health promotion program (WHPPs) have been implemented the past years to improve employees’ health and lifestyle (i.e., physical activity, nutrition, smoking, alcohol use and relaxation). Research primarily focused on the effectiveness of these WHPPs. Whereas process evaluations provide essential information necessary to improve large scale implementation across other settings. Therefore, this review aims to: (1) further our understanding of the quality of process evaluations alongside effect evaluations for WHPPs, (2) identify barriers/facilitators affecting implementation, and (3) explore the relationship between effectiveness and the implementation process. Methods Pubmed, EMBASE, PsycINFO, and Cochrane (controlled trials) were searched from 2000 to July 2012 for peer-reviewed (randomized) controlled trials published in English reporting on both the effectiveness and the implementation process of a WHPP focusing on physical activity, smoking cessation, alcohol use, healthy diet and/or relaxation at work, targeting employees aged 18-65 years. Results Of the 307 effect evaluations identified, twenty-two (7.2%) published an additional process evaluation and were included in this review. The results showed that eight of those studies based their process evaluation on a theoretical framework. The methodological quality of nine process evaluations was good. The most frequently reported process components were dose delivered and dose received. Over 50 different implementation barriers/facilitators were identified. The most frequently reported facilitator was strong management support. Lack of resources was the most frequently reported barrier. Seven studies examined the link between implementation and effectiveness. In general a positive association was found between fidelity, dose and the primary outcome of the program. Conclusions Process evaluations are not systematically performed alongside effectiveness studies for WHPPs. The quality of the process evaluations is mostly poor to average, resulting in a lack of systematically measured barriers/facilitators. The narrow focus on implementation makes it difficult to explore the relationship between effectiveness and implementation. Furthermore, the operationalisation of process components varied between studies, indicating a need for consensus about defining and operationalising process components. PMID:24341605

Superfund Site Assessment Process

EPA Pesticide Factsheets

Learn about the site assessment process used by the federal Superfund program to evaluate releases of hazardous substances that may pose a threat to human health or the environment and select an appropriate program for sites needing cleanup.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

PubMed

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.

Process evaluation of the Living Green, Healthy and Thrifty (LiGHT) web-based child obesity management program: combining health promotion with ecology and economy.

PubMed

Jogova, Maria; Song, Joshua Eun-Soo; Campbell, Audrey Clare; Warbuton, Darren; Warshawski, Tom; Chanoine, Jean-Pierre

2013-04-01

To conduct a process evaluation of the Living Green, Healthy and Thrifty (LiGHT) program, a novel virtual child obesity management program that combines health promotion with ecology and economy (Phase 1). We carried out a mixed methods process evaluation involving qualitative and quantitative data collection in 3 phases: among 3 child-parent units, (group 1) that informed program development; 9 child-parent units (group 2) that tested the draft program and further aided program refinement; and 17 child-parent units (group 3) for a 4-week pilot of the program. In the program pilot, we assessed participants' knowledge and readiness to change pre- and postintervention and explored perceptions of the program. Participants generally felt that the online format for program delivery was convenient and accessible, the content was practical, and the integration of health-environment-economy was well received. Many parents also appreciated the involvement of the family. However, the lack of visual appeal and overabundance of text was identified as a challenge, and children/youth in particular requested assurance that their personal information (e.g. weight) was not seen by their parents. The online method of program delivery holds the unique challenge of requiring special efforts to create a sense of personal connection and community. The presence of a "Way-finder" to assist participants and discussion boards/forums are potential solutions. The LiGHT online weight management program offers an accessible, convenient weight management resource that children and families appreciate for its availability, broader educational scope, and practicality. Outcome evaluation of LiGHT will be carried out in Phase 2 of the project. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

Measuring the Impact of Employment-Related Social Programs. A Primer on the Evaluation of Employment and Training, Vocational Education, Vocational Rehabilitation, and Other Job-Oriented Programs.

ERIC Educational Resources Information Center

Borus, Michael E.

An approach and methodology for the systematic measurement of the impact of employment-related social programs is presented in this primer. Chapter 1 focuses on evaluation as the third step (the first two being planning and operation) in the process of program implementation. Chapter 2 examines the impacts of social programs. Topics include…

Integrate Evaluation into the Planning Process.

ERIC Educational Resources Information Center

Camp, William

1985-01-01

In an attempt to correct for limitations in the Program Evaluation and Review Technique-Critical Path Method (PERT-CPM), the Graphical Evaluation and Review Technique (GERT) has been developed. This management tool allows for evaluation during the facilities' development process. Two figures and two references are provided. (DCS)

Improving Processual Quality in Early Education and Care: Process Findings from the Evaluation of the Benevolent Society's Partnerships in Early Education Program

ERIC Educational Resources Information Center

Valentine, Kylie; Thomson, Cathy

2009-01-01

This paper describes the facilitators and barriers to implementing an attachment-based intervention in early education and care settings, the Partnerships in Early Childhood program (PIEC), based on findings from the process evaluation of its first year of implementation. The paper focuses on four areas: the nature of the partnership and program…

Evaluation of English as a Foreign Language Program--Using CIPP (Context, Input, Process and Product) Model

ERIC Educational Resources Information Center

Ulum, Ömer Gökhan

2016-01-01

The aim of this study is to evaluate a state high school EFL Program through CIPP (context, input, process and product) model. The participants of the study include 504 students. The source of data has been obtained through a 46-itemed questionnaire and an interview for the students. In the study, the data has been analysed using statistical…

Evaluation on Social Internship Program of Iain Sultan Thaha Saifuddin Jambi Students: Using Context, Input, Process and Product Model (CIPP Model)

ERIC Educational Resources Information Center

Hurmaini, M.; Abdillah

2015-01-01

The purpose of the research is to know the context, input, process and product evaluation on the Social Internship Program (Kukerta) of IAIN Sulthan Thaha Saifuddin Jambi Students by using Participatory Action Research (PAR) system. The research is conducted in four locations of IAIN Sultan Thaha Saifuddin Jambi students' Kukerta in first period…

Implemented or Not Implemented? Process Evaluation of the School-Based Obesity Prevention Program DOiT and Associations with Program Effectiveness

ERIC Educational Resources Information Center

van Nassau, Femke; Singh, Amika S.; Hoekstra, Trynke; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J. M.

2016-01-01

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators: recruitment, reach, dosage, fidelity, satisfaction,…

Curated Collections for Educators: Five Key Papers about Program Evaluation.

PubMed

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Curated Collections for Educators: Five Key Papers about Program Evaluation

PubMed Central

Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-01-01

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

NASA Astrophysics Data System (ADS)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in its vision, mission, goals and activities. In addition to the documentation of evaluative process, the case study also provides insight on the establishment of mutually supportive principal investigator and evaluator partnerships as necessary foundations for building effective teams. The study addresses frequently asked questions (FAQ's) on the formation and sustenance of partnerships among visionaries and evaluators and the impact of this partnership on the achievement of program outcomes.

Evaluating portfolio use as a tool for assessment and professional development in graduate nursing education.

PubMed

Ryan, Marybeth

2011-01-01

The portfolio is emerging as an efficient and effective method for evaluating program outcomes and professional development in nursing education. Although there is a host of literature about the use of portfolios in undergraduate nursing programs, fewer reports exist about their use in graduate nursing education. This article presents the results of a formative evaluation process, using student and faculty focus groups, conducted at a midsized university's graduate nursing education program to determine the effectiveness of portfolio use. Content analysis of the focus group data yielded three student themes and two faculty themes with associated theme clusters that revealed similarities and unique perceptions of students and faculty regarding the portfolio process. The information gleaned will provide direction to faculty as they make decisions about the use of this evaluation method in the graduate program. Copyright © 2011. Published by Elsevier Inc.

Cyber-Evaluation: Evaluating a Distance Learning Program.

ERIC Educational Resources Information Center

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Multi-Dimensional Planning/Evaluation Schema for Community Education.

ERIC Educational Resources Information Center

Merkel-Keller, Claudia; Herr, Audrey

A model for planning and evaluating community education programs--Stufflebeam's context, input, process, product (CIPP) evaluation model--was described and field-tested with the community education programs in Lakewood, New Jersey. Community education was defined as a concern for everything that affects the well-being of all citizens within a…

The Boeing Company's Manufacturing Technology Student Internship. Evaluation Report (1994-95).

ERIC Educational Resources Information Center

Wang, Changhua; Owens, Thomas R.

An evaluation was conducted of the Boeing Company's summer internship program for students enrolled in a manufacturing technology program after grades 11, 12, and 13 (first year of community college). The evaluation included the following activities: a review of documents describing the internship structure, student selection process, and…

Teacher Evaluations in Leisure Studies Programs: An Old Issue with a New Slant.

ERIC Educational Resources Information Center

Butts, Frank B.; Swearingen, Tommy

1994-01-01

This paper examines teacher evaluation practices in leisure studies programs, noting the perceived effectiveness of rating instruments. Surveys of leisure studies professors nationwide indicated many institutions used evaluation instruments and processes that were not statistically validated; key decisions were often made on the basis of these…

Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting.

PubMed

Harris, Claire; Garrubba, Marie; Allen, Kelly; King, Richard; Kelly, Cate; Thiagarajan, Malar; Castleman, Beverley; Ramsey, Wayne; Farjou, Dina

2015-12-28

This paper reports the process of establishing a transparent, accountable, evidence-based program for introduction of new technologies and clinical practices (TCPs) in a large Australian healthcare network. Many countries have robust evidence-based processes for assessment of new TCPs at national level. However many decisions are made by local health services where the resources and expertise to undertake health technology assessment (HTA) are limited and a lack of structure, process and transparency has been reported. An evidence-based model for process change was used to establish the program. Evidence from research and local data, experience of health service staff and consumer perspectives were incorporated at each of four steps: identifying the need for change, developing a proposal, implementation and evaluation. Checklists assessing characteristics of success, factors for sustainability and barriers and enablers were applied and implementation strategies were based on these findings. Quantitative and qualitative methods were used for process and outcome evaluation. An action research approach underpinned ongoing refinement to systems, processes and resources. A Best Practice Guide developed from the literature and stakeholder consultation identified seven program components: Governance, Decision-Making, Application Process, Monitoring and Reporting, Resources, Administration, and Evaluation and Quality Improvement. The aims of transparency and accountability were achieved. The processes are explicit, decisions published, outcomes recorded and activities reported. The aim of ascertaining rigorous evidence-based information for decision-making was not achieved in all cases. Applicants proposing new TCPs provided the evidence from research literature and local data however the information was often incorrect or inadequate, overestimating benefits and underestimating costs. Due to these limitations the initial application process was replaced by an Expression of Interest from applicants followed by a rigorous HTA by independent in-house experts. The program is generalisable to most health care organisations. With one exception, the components would be achievable with minimal additional resources; the lack of skills and resources required for HTA will limit effective application in many settings. A toolkit containing details of the processes and sample materials is provided to facilitate replication or local adaptation by those wishing to establish a similar program.

A Guidebook for Evaluating Programs for the Gifted in Virginia School Divisions. A Cooperative Project.

ERIC Educational Resources Information Center

Pulaski County Schools, VA.

This guidebook aims to provide clear, non-technical descriptions of procedures for evaluating the effectiveness of local gifted education programs in Virginia. The procedures were developed with both external and internal evaluations in mind. The evaluation process is described in four phases: planning, collecting the data, interpreting the data…

Translation Training in the Jordanian Context: Curriculum Evaluation in Translator Education

ERIC Educational Resources Information Center

Mahasneh, Anjad

2013-01-01

This study aims at drawing a clear picture of translator training in Jordan through the evaluation of translation programs at the Master's level. The framework of the Context, Input, Process, and Product components of the CIPP evaluation model developed by Daniel Stufflebeam in 1971 was used to evaluate the three translation Master's programs at…

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Evaluation of Consumer Health Training and Education Programs.

ERIC Educational Resources Information Center

Kellogg, Muriel; And Others

PL89-749, passed in 1966, included a number of provisions for increasing participation of consumers in the improvement of the health care delivery system, including development of training programs to equip consumers for participation in the health planning process. The evaluation attempts to ascertain the direct effect of training programs on…

PAL[R] Services Being Measured through Scientifically-Based Evaluation Process

ERIC Educational Resources Information Center

Perspectives in Peer Programs, 2007

2007-01-01

In January 2006, PAL[R] Peer Assistance and Leadership, a Promising Prevention Program of Workers Assistance Program, Inc. (WAP), received a $30,000 grant from the Center for Substance Abuse Prevention (CSAP) in order to be scientifically-evaluated on the outcomes and effectiveness of its programs and services. According to the grant, the…

An Inservice Program for Elementary Teachers: Components, Instructional Procedures, and Evaluation.

ERIC Educational Resources Information Center

Horak, Willis J.; And Others

A description and evaluation of a year-long science in-service program for elementary teachers is provided. Consisting of three components, the program was designed to expand teachers' understandings of physics and chemistry concepts and processes and to encourage more science teaching and science activities in their classrooms. The on-campus…

Regional Medical Program; Guidelines for Evaluation.

ERIC Educational Resources Information Center

Dean, Gary S., And Others

This set of guidelines was written to provide a systematic explanation of the process of evaluation applied to Regional Medical Programs, as required by Public Law 89-239. Goals of the programs are the improvement of health care of patients suffering from heart disease, cancer, stroke and related diseases and improvement in the practice of health…

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

PubMed

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.

The Role of Evaluation in the School Improvement Process

ERIC Educational Resources Information Center

Lindahl, Ronald A.; Beach, Robert H.

2013-01-01

Although evaluation serves many purposes in education, there is virtually unanimous agreement that evaluation is a critical component of all school improvement processes. Hamilton et al. (2003) asserted that "assessment and evaluation should be built into reform programs from the outset" (p. 26). Kimball, Lander, and Thorn (2010)…

An Evaluation Model Applied to a Mathematics-Methods Program Involving Three Characteristics of Teaching Style and Their Relationship to Pupil Achievement. Teacher Education Forum; Volume 3, Number 4.

ERIC Educational Resources Information Center

Dodd, Carol Ann

This study explores a technique for evaluating teacher education programs in terms of teaching competencies, as applied to the Indiana University Mathematics Methods Program (MMP). The evaluation procedures formulated for the study include a process product design in combination with a modification of Pophan's performance test paradigm and Gage's…

What works in implementation of integrated care programs for older adults with complex needs? A realist review

PubMed Central

Kirst, Maritt; Im, Jennifer; Burns, Tim; Baker, G. Ross; Goldhar, Jodeme; O'Campo, Patricia; Wojtak, Anne; Wodchis, Walter P

2017-01-01

Abstract Purpose A realist review of the evaluative evidence was conducted on integrated care (IC) programs for older adults to identify key processes that lead to the success or failure of these programs in achieving outcomes such as reduced healthcare utilization, improved patient health, and improved patient and caregiver experience. Data sources International academic literature was searched in 12 indexed, electronic databases and gray literature through internet searches, to identify evaluative studies. Study selection Inclusion criteria included evaluative literature on integrated, long-stay health and social care programs, published between January 1980 and July 2015, in English. Data extraction Data were extracted on the study purpose, period, setting, design, population, sample size, outcomes, and study results, as well as explanations of mechanisms and contextual factors influencing outcomes. Results of data synthesis A total of 65 articles, representing 28 IC programs, were included in the review. Two context-mechanism-outcome configurations (CMOcs) were identified: (i) trusting multidisciplinary team relationships and (ii) provider commitment to and understanding of the model. Contextual factors such as strong leadership that sets clear goals and establishes an organizational culture in support of the program, along with joint governance structures, supported team collaboration and subsequent successful implementation. Furthermore, time to build an infrastructure to implement and flexibility in implementation, emerged as key processes instrumental to success of these programs. Conclusions This review included a wide range of international evidence, and identified key processes for successful implementation of IC programs that should be considered by program planners, leaders and evaluators. PMID:28992156

Developing Mathematical Processes (DMP). Field Test Evaluation, 1973-1974.

ERIC Educational Resources Information Center

Schall, William; And Others

The Developing Mathematical Processes (DMP) program was field-tested in the kindergarten and first three grades of one parochial and five public schools. DMP is an activity-based program developed around a comprehensive list of behavioral objectives. The program is concerned with the development of intuitive geometric concepts as well as…

76 FR 13648 - Proposed Collection; Comment Request; Process Evaluation of the NIH Roadmap Epigenomics Program

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-14

... assess program process and progress, is non-experimental. The assessment is based on secondary source... programs of the Agency. To reduce response bias and to make the survey as accessible as possible to busy principal investigators, the survey will be Web-based. Frequency of Response: Once. Affected Public...

System Analysis in Instructional Programming: The Initial Phases of the Program Construction Process.

ERIC Educational Resources Information Center

Bjerstedt, Ake

A three-volume series describes the construction of a self-instructional system as a work process with three main phases: system analysis, system synthesis, and system modification and evaluation. After an introductory discussion of some basic principles of instructional programing, this first volume focuses on the system analysis phase,…

ASTEP user's guide and software documentation

NASA Technical Reports Server (NTRS)

Gliniewicz, A. S.; Lachowski, H. M.; Pace, W. H., Jr.; Salvato, P., Jr.

1974-01-01

The Algorithm Simulation Test and Evaluation Program (ASTEP) is a modular computer program developed for the purpose of testing and evaluating methods of processing remotely sensed multispectral scanner earth resources data. ASTEP is written in FORTRAND V on the UNIVAC 1110 under the EXEC 8 operating system and may be operated in either a batch or interactive mode. The program currently contains over one hundred subroutines consisting of data classification and display algorithms, statistical analysis algorithms, utility support routines, and feature selection capability. The current program can accept data in LARSC1, LARSC2, ERTS, and Universal formats, and can output processed image or data tapes in Universal format.

Resident Evaluation and Remediation: A Comprehensive Approach

PubMed Central

Wu, Jim S.; Siewert, Bettina; Boiselle, Phillip M.

2010-01-01

Background A comprehensive evaluation and remediation program is an essential component of any residency program. The evaluation system should identify problems accurately and early and allow residents with problems to be assigned to a remediation program that effectively deals with them. Elements of a proactive remediation program include a process for outlining deficiencies, providing resources for improvement, communicating clear goals for acceptable performance, and reevaluating performance against these goals. Intervention In recognition of the importance of early detection and prompt remediation of the struggling resident, we sought to develop a multifaceted approach to resident evaluation with the aim of early identification and prompt remediation of difficulties. This article describes our comprehensive evaluation program and remediation program, which uses resources within our radiology department and institutional graduate medical education office. Discussion An effective evaluation system should identify problems accurately and early, whereas a proactive remediation program should effectively deal with issues once they are identified. PMID:21975628

Methodological approach to a multidimensional evaluation of food and nutrition policies.

PubMed

Santos, Leonor Maria Pacheco; dos Santos, Sandra Maria Chaves

2003-01-01

Recommendations arising from global conferences and summits, expressed the need to formulate and implement public policies to improve household food security. In the context of maximizing benefits given available resources, comprehensive evaluations of the nutrition policies and programs are needed. One obstacle to overcome was a clear definition of terminology; the words efficiency, effectiveness, efficacy and impact, widely used in the context of program evaluation, are sometimes interchanged and there is no consensus about their precise definition. Another approach to health evaluation is based in the paradigm structure-process-outcome. The level structure contemplated the installations, resources, instruments (physical and discursive), as well as the technical bureaucratic organizational structures. Process encompassed the whole set of intervention activities developed, whereas the dimension of outcome comprised the effects of interventions on the health and nutrition of beneficiaries. Each of the three dimensions constitutes a continuum in the evaluation procedure: the structure only fulfills its purposes if the processes are adequate and conversely, processes cannot alone supersede structural limitations. Moreover, all the three dimensions only reach their ultimate objectives through the completion of outcomes. The methodology proposed here has been tested in the case of Bahia, Northeast Brazil, and it was found to be adequate for this type of analysis. We hope this approach of a comprehensive multidimensional evaluation, constitutes an effective contribution for program planners and program managers, in particular with regard to the obstacles detected, some of which can surely be overcome.

Evaluation of the ion implantation process for production of solar cells from silicon sheet materials

NASA Technical Reports Server (NTRS)

Spitzer, M. B.

1983-01-01

The objective of this program is the investigation and evaluation of the capabilities of the ion implantation process for the production of photovoltaic cells from a variety of present-day, state-of-the-art, low-cost silicon sheet materials. Task 1 of the program concerns application of ion implantation and furnace annealing to fabrication of cells made from dendritic web silicon. Task 2 comprises the application of ion implantation and pulsed electron beam annealing (PEBA) to cells made from SEMIX, SILSO, heat-exchanger-method (HEM), edge-defined film-fed growth (EFG) and Czochralski (CZ) silicon. The goals of Task 1 comprise an investigation of implantation and anneal processes applied to dendritic web. A further goal is the evaluation of surface passivation and back surface reflector formation. In this way, processes yielding the very highest efficiency can be evaluated. Task 2 seeks to evaluate the use of PEBA for various sheet materials. A comparison of PEBA to thermal annealing will be made for a variety of ion implantation processes.

Who Is Afraid of Evaluation? Ethics in Evaluation Research as a Way to Cope with Excessive Evaluation Anxiety: Insights from a Case Study

ERIC Educational Resources Information Center

Bechar, Shlomit; Mero-Jaffe, Irit

2014-01-01

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

Tailoring an educational program on the AHRQ Patient Safety Indicators to meet stakeholder needs: lessons learned in the VA.

PubMed

Shin, Marlena H; Rivard, Peter E; Shwartz, Michael; Borzecki, Ann; Yaksic, Enzo; Stolzmann, Kelly; Zubkoff, Lisa; Rosen, Amy K

2018-02-14

Given that patient safety measures are increasingly used for public reporting and pay-for performance, it is important for stakeholders to understand how to use these measures for improvement. The Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicators (PSIs) are one particularly visible set of measures that are now used primarily for public reporting and pay-for-performance among both private sector and Veterans Health Administration (VA) hospitals. This trend generates a strong need for stakeholders to understand how to interpret and use the PSIs for quality improvement (QI). The goal of this study was to develop an educational program and tailor it to stakeholders' needs. In this paper, we share what we learned from this program development process. Our study population included key VA stakeholders involved in reviewing performance reports and prioritizing and initiating quality/safety initiatives. A pre-program formative evaluation through telephone interviews and web-based surveys assessed stakeholders' educational needs/interests. Findings from the formative evaluation led to development and implementation of a cyberseminar-based program, which we tailored to stakeholders' needs/interests. A post-program survey evaluated program participants' perceptions about the PSI educational program. Interview data confirmed that the concepts we had developed for the interviews could be used for the survey. Survey results informed us on what program delivery mode and content topics were of high interest. Six cyberseminars were developed-three of which focused on two content areas that were noted of greatest interest: learning how to use PSIs for monitoring trends and understanding how to interpret PSIs. We also used snapshots of VA PSI reports so that participants could directly apply learnings. Although initial interest in the program was high, actual attendance was low. However, post-program survey results indicated that perceptions about the program were positive. Conducting a formative evaluation was a highly important process in program development. The useful information that we collected through the interviews and surveys allowed us to tailor the program to stakeholders' needs and interests. Our experiences, particularly with the formative evaluation process, yielded valuable lessons that can guide others when developing and implementing similar educational programs.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

PubMed

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic sensitivities, classroom management challenges, and fitting new programs into already busy school schedules. Overall, the program content and individual lessons were well received by the teachers and students. The lessons learned from the development, implementation and evaluation of this program can provide health professionals with key pedagogical strategies for designing culturally responsive educational programs. Culturally responsive programs are critical for ensuring interventions are effective for their specific context.

Evaluative Research of the Mentoring Process of the PGDT, with Particular Reference to Cluster Centers under Jimma University Facilitation

ERIC Educational Resources Information Center

Tegegne, Worku Fentie; Gelaneh, Alebachew Hailu

2015-01-01

The objective of the study is to evaluate the mentoring process of the PGDT program which was under the supervision of Jimma University in the regional states of Oromia and SNNP, Ethiopia. The overall intention was to see whether the program was being underway as expected. Because, there was uncertainty regarding the proper running of it as it was…

Development of the Joint Committee Standards for Evaluations of Educational Programs, Projects, and Materials.

ERIC Educational Resources Information Center

Diamond, Esther E.

The growing demand for program evaluation in the 1970s gave rise to a need for a comprehensive, carefully developed, objective set of guiding principles for the evaluation process, from initial planning to final report. The Joint Committee on Standards for Education Evaluation was established to meet this need. This broad-based group, representing…

Insights on Using Developmental Evaluation for Innovating: A Case Study on the Cocreation of an Innovative Program

ERIC Educational Resources Information Center

Lam, Chi Yan; Shulha, Lyn M.

2015-01-01

This article contributes to research on evaluation by examining the capacity and contribution of developmental evaluation for innovating. This case study describes the "preformative development" of an educational program (from conceptualization to pilot implementation) and analyzes the processes of innovation within a developmental…

Benefits of Using the "NADE Self-Evaluation Guides" for Program Development, Improvement, and Evaluation

ERIC Educational Resources Information Center

Neuburger, Jane

2018-01-01

The "NADE Self-Evaluation Guides" are a compendium of best practices in four areas: (1) Tutoring Services; (2) Course-based Learning Assistance; (3) the Teaching & Learning Process; and (4) Developmental Coursework, also recently known as transitional, co-requisite, accelerated, or bridge programs, all of which are…

Evaluation of Training Programs in Russian Manufacturing Companies

ERIC Educational Resources Information Center

Kucherov, Dmitry; Manokhina, Daria

2017-01-01

Purpose: This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels…

The Program Evaluator's Role in Cross-Project Pollination.

ERIC Educational Resources Information Center

Yasgur, Bruce J.

An expanded duties role of the multiple-program evaluator as an integral part of the ongoing decision-making process in all projects served is defended. Assumptions discussed included that need for projects with related objectives to pool resources and avoid duplication of effort and the evaluator's unique ability to provide an objective…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations.

PubMed

Wasserman, Deborah L

2010-05-01

This paper offers a framework for using a systems orientation and "foundational theory" to enhance theory-driven evaluations and logic models. The framework guides the process of identifying and explaining operative relationships and perspectives within human service program systems. Self-Determination Theory exemplifies how a foundational theory can be used to support the framework in a wide range of program evaluations. Two examples illustrate how applications of the framework have improved the evaluators' abilities to observe and explain program effect. In both exemplars improvements involved addressing and organizing into a single logic model heretofore seemingly disparate evaluation issues regarding valuing (by whose values); the role of organizational and program context; and evaluation anxiety and utilization. Copyright 2009 Elsevier Ltd. All rights reserved.

Introduction of new technologies and decision making processes: a framework to adapt a Local Health Technology Decision Support Program for other local settings.

PubMed

Poulin, Paule; Austen, Lea; Scott, Catherine M; Poulin, Michelle; Gall, Nadine; Seidel, Judy; Lafrenière, René

2013-01-01

Introducing new health technologies, including medical devices, into a local setting in a safe, effective, and transparent manner is a complex process, involving many disciplines and players within an organization. Decision making should be systematic, consistent, and transparent. It should involve translating and integrating scientific evidence, such as health technology assessment (HTA) reports, with context-sensitive evidence to develop recommendations on whether and under what conditions a new technology will be introduced. However, the development of a program to support such decision making can require considerable time and resources. An alternative is to adapt a preexisting program to the new setting. We describe a framework for adapting the Local HTA Decision Support Program, originally developed by the Department of Surgery and Surgical Services (Calgary, AB, Canada), for use by other departments. The framework consists of six steps: 1) development of a program review and adaptation manual, 2) education and readiness assessment of interested departments, 3) evaluation of the program by individual departments, 4) joint evaluation via retreats, 5) synthesis of feedback and program revision, and 6) evaluation of the adaptation process. Nine departments revised the Local HTA Decision Support Program and expressed strong satisfaction with the adaptation process. Key elements for success were identified. Adaptation of a preexisting program may reduce duplication of effort, save resources, raise the health care providers' awareness of HTA, and foster constructive stakeholder engagement, which enhances the legitimacy of evidence-informed recommendations for introducing new health technologies. We encourage others to use this framework for program adaptation and to report their experiences.

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Evaluating Knowledge, Attitudinal, and Behavioral Change Effects from a Multinational HIV/AIDS Education Program for Youth

ERIC Educational Resources Information Center

Hardre, Patricia L.; Garcia, Fe; Apamo, Peter; Mutheu, Lucy; Ndege, Monica; Bois, Iderle

2010-01-01

This project tracked the mid-term evaluation processes, practices, and products of a multinational program to reduce at-risk behaviors for HIV/AIDS among children in Kenya, Tanzania, and Haiti. It focused on participant and community perceptions; program effectiveness in promoting abstinence and monogamy decisions; and factors supporting ongoing…

Process Use as a Usefulism

ERIC Educational Resources Information Center

Patton, Michael Quinn

2007-01-01

Process use refers to changes in attitude, thinking, and behavior that result from participating in an evaluation. Process use includes individual learnings from evaluation involvement as well as effects on program functioning and organizational culture. The "Encyclopedia of Social Science Research Methods," in an entry on operationalization,…

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

PubMed

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Institutional Oversight of the Graduate Medical Education Enterprise: Development of an Annual Institutional Review

PubMed Central

Amedee, Ronald G.; Piazza, Janice C.

2016-01-01

Background: The Accreditation Council for Graduate Medical Education (ACGME) fully implemented all aspects of the Next Accreditation System (NAS) on July 1, 2014. In lieu of periodic accreditation site visits of programs and institutions, the NAS requires active, ongoing oversight by the sponsoring institutions (SIs) to maintain accreditation readiness and program quality. Methods: The Ochsner Health System Graduate Medical Education Committee (GMEC) has instituted a process that provides a structured, process-driven improvement approach at the program level, using a Program Evaluation Committee to review key performance data and construct an annual program evaluation for each accredited residency. The Ochsner GMEC evaluates the aggregate program data and creates an Annual Institutional Review (AIR) document that provides direction and focus for ongoing program improvement. This descriptive article reviews the 2014 process and various metrics collected and analyzed to demonstrate the program review and institutional oversight provided by the Ochsner graduate medical education (GME) enterprise. Results: The 2014 AIR provided an overview of performance and quality of the Ochsner GME program for the 2013-2014 academic year with particular attention to program outcomes; resident supervision, responsibilities, evaluation, and compliance with duty‐hour standards; results of the ACGME survey of residents and core faculty; and resident participation in patient safety and quality activities and curriculum. The GMEC identified other relevant institutional performance indicators that are incorporated into the AIR and reflect SI engagement in and contribution to program performance at the individual program and institutional levels. Conclusion: The Ochsner GME office and its program directors are faced with the ever-increasing challenges of today's healthcare environment as well as escalating institutional and program accreditation requirements. The overall commitment of this SI to advancing our GME enterprise is clearly evident, and the opportunity for continued improvement resulting from institutional oversight is being realized. PMID:27046412

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

PubMed

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design in evaluating the training program, the training program is expected to be efficiently and rapidly implemented into and adjusted to care practice and medical education.

Error Analysis Of Students Working About Word Problem Of Linear Program With NEA Procedure

NASA Astrophysics Data System (ADS)

Santoso, D. A.; Farid, A.; Ulum, B.

2017-06-01

Evaluation and assessment is an important part of learning. In evaluation process of learning, written test is still commonly used. However, the tests usually do not following-up by further evaluation. The process only up to grading stage not to evaluate the process and errors which done by students. Whereas if the student has a pattern error and process error, actions taken can be more focused on the fault and why is that happen. NEA procedure provides a way for educators to evaluate student progress more comprehensively. In this study, students’ mistakes in working on some word problem about linear programming have been analyzed. As a result, mistakes are often made students exist in the modeling phase (transformation) and process skills (process skill) with the overall percentage distribution respectively 20% and 15%. According to the observations, these errors occur most commonly due to lack of precision of students in modeling and in hastiness calculation. Error analysis with students on this matter, it is expected educators can determine or use the right way to solve it in the next lesson.

Space Station Water Processor Process Pump

NASA Technical Reports Server (NTRS)

Parker, David

1995-01-01

This report presents the results of the development program conducted under contract NAS8-38250-12 related to the International Space Station (ISS) Water Processor (WP) Process Pump. The results of the Process Pumps evaluation conducted on this program indicates that further development is required in order to achieve the performance and life requirements for the ISSWP.

A participatory evaluation model for Healthier Communities: developing indicators for New Mexico.

PubMed Central

Wallerstein, N

2000-01-01

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline findings. The evaluation model shows the links between process, community-level system impacts, and population health changes. PMID:10968754

48 CFR 1019.202-70-10 - Application process for mentor firms to participate in the program.

Code of Federal Regulations, 2010 CFR

2010-10-01

... mentor firms to participate in the program. 1019.202-70-10 Section 1019.202-70-10 Federal Acquisition...-70-10 Application process for mentor firms to participate in the program. (a) Firm interested in becoming a mentor firm may apply in writing to Treasury's OSBD. The application will be evaluated based...

Public Relations for Brazilian Libraries: Process, Principles, Program Planning, Planning Techniques and Suggestions.

ERIC Educational Resources Information Center

Kies, Cosette N.

A brief overview of the functions of public relations in libraries introduces this manual, which provides an explanation of the public relations (PR) process, including fact-finding, planning, communicating, evaluating, and marketing; some PR principles; a 10-step program that could serve as a model for planning a PR program; a discussion of PR…

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Using evaluation to improve program quality based on the BELL model.

PubMed

Phalen, Earl Martin; Cooper, Tiffany M

2007-01-01

Building Educated Leaders for Life (BELL) is a national not-for-profit organization whose mission is to increase the educational achievements, self-esteem, and life opportunities of elementary school children living in low-income urban communities. BELL has been engaged in formal evaluation, internally and externally, for more than five years and has built internal evaluation capacity by investing in a specialized full-time evaluation team. As part of a continuous program improvement model of evaluation, BELL uses the data to refine program implementation and replicate successful elements of the services and operations. In this chapter, the authors highlight best practices from the field by outlining BELL's approach to using evaluation data for continuous program improvement. Key strategies include (1) carefully identifying intended users of the evaluation throughout the organization and among its external stakeholders, then working closely with intended users throughout the evaluation process, ensuring full engagement at every step of the process; (2) reporting findings in a readable, user-friendly format and timing the reporting so that it is aligned with programmatic decision making and planning cycles; and (3) making and supporting explicit recommendations for the next program cycle, where intended users have agreed to recommendations and ownership is assigned. BELL's successful use of data for improvement is evidenced by the consistently strong outcomes for the students it serves as well as increased efficiency and satisfaction related to service delivery that has supported the replication of BELL's programs nationally.

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Handbook of evaluation of utility DSM programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hirst, E.; Reed, J.; Bronfman, B.

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough tomore » highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.« less

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hirst, E.; Reed, J.; Bronfman, B.

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough tomore » highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.« less

Optimizing the post-graduate institutional program evaluation process.

PubMed

Lypson, Monica L; Prince, Mark E P; Kasten, Steven J; Osborne, Nicholas H; Cohan, Richard H; Kowalenko, Terry; Dougherty, Paul J; Reynolds, R Kevin; Spires, M Catherine; Kozlow, Jeffrey H; Gitlin, Scott D

2016-02-17

Reviewing program educational efforts is an important component of postgraduate medical education program accreditation. The post-graduate review process has evolved over time to include centralized oversight based on accreditation standards. The institutional review process and the impact on participating faculty are topics not well described in the literature. We conducted multiple Plan-Do-Study-Act (PDSA) cycles to identify and implement areas for change to improve productivity in our institutional program review committee. We also conducted one focus group and six in-person interviews with 18 committee members to explore their perspectives on the committee's evolution. One author (MLL) reviewed the transcripts and performed the initial thematic coding with a PhD level research associate and identified and categorized themes. These themes were confirmed by all participating committee members upon review of a detailed summary. Emergent themes were triangulated with the University of Michigan Medical School's Admissions Executive Committee (AEC). We present an overview of adopted new practices to the educational program evaluation process at the University of Michigan Health System that includes standardization of meetings, inclusion of resident members, development of area content experts, solicitation of committed committee members, transition from paper to electronic committee materials, and focus on continuous improvement. Faculty and resident committee members identified multiple improvement areas including the ability to provide high quality reviews of training programs, personal and professional development, and improved feedback from program trainees. A standing committee that utilizes the expertise of a group of committed faculty members and which includes formal resident membership has significant advantages over ad hoc or other organizational structures for program evaluation committees.

DYNSYL: a general-purpose dynamic simulator for chemical processes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Patterson, G.K.; Rozsa, R.B.

1978-09-05

Lawrence Livermore Laboratory is conducting a safeguards program for the Nuclear Regulatory Commission. The goal of the Material Control Project of this program is to evaluate material control and accounting (MCA) methods in plants that handle special nuclear material (SNM). To this end we designed and implemented the dynamic chemical plant simulation program DYNSYL. This program can be used to generate process data or to provide estimates of process performance; it simulates both steady-state and dynamic behavior. The MCA methods that may have to be evaluated range from sophisticated on-line material trackers such as Kalman filter estimators, to relatively simplemore » material balance procedures. This report describes the overall structure of DYNSYL and includes some example problems. The code is still in the experimental stage and revision is continuing.« less

The Evaluation of Teaching the Nursing Process Using Traditional Lecture, Campus Laboratory, Clinical, and the Addition of High Fidelity Human Simulation (HFHS) Unfolding Scenarios

ERIC Educational Resources Information Center

Irwin, Ruth E.

2013-01-01

It is not sufficient to just make changes in a nursing curriculum without a plan to evaluate the impact on program outcomes. This study sought to determine the outcomes of teaching the nursing process to Foundation of Nursing students in an Associate Degree Nursing program using a factorial design study. Four groups of students were taught the…

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

PubMed

Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

2017-02-01

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

TECHNOLOGY EVALUATION REPORT: CHEMFIX TECHNOLOGIES, INC. - SOLIDIFICATION/STABILIZATION PROCESS - CLACKAMAS, OREGON - VOLUME I

EPA Science Inventory

The CHEMFIX solidification/stabilization process was evaluated in the U.S. Environment Protection Agency's SITE program. Waste from an uncontrolled hazardous waste site was treated by the CHEMFIX process and subjected to a variety of physical and chemical test methods. Physical t...

TECHNOLOGY EVALUATION REPORT: CHEMFIX TECHNOLOGIES, INC. - SOLIDIFICATION/STABILIZATION PROCESS - CLACKAMAS, OREGON - VOLUME II

EPA Science Inventory

The CHEMFIX solidification/stabilization process was evaluated in the U.S. Environmental Protection Agency's SITE program. Waste from an uncontrolled hazardous waste site was treated by the CHEMFIX process and subjected to a variety of physical and chemical test methods. Physical...

REMOVAL OF PCBS FROM A CONTAMINATED SOIL USING CF-SYSTEMS SOLVENT EXTRACTION PROCESS

EPA Science Inventory

The US EPA's START team in cooperation with EPA's SITE program evaluated a pilot scale solvent extraction process developed by CF-Systems. This process uses liquified propane to extract organic contaminants from soils, sludges, and sediments. A pilot-scale evaluation was conducte...

[Documenting a rehabilitation program using a logic model: an advantage to the assessment process].

PubMed

Poncet, Frédérique; Swaine, Bonnie; Pradat-Diehl, Pascale

2017-03-06

The cognitive and behavioral disorders after brain injury can result in severe limitations of activities and restrictions of participation. An interdisciplinary rehabilitation program was developed in physical medicine and rehabilitation at the Pitié-Salpêtriere Hospital, Paris, France. Clinicians believe this program decreases activity limitations and improves participation in patients. However, the program’s effectiveness had never been assessed. To do this, we had to define/describe this program. However rehabilitation programs are holistic and thus complex making them difficult to describe. Therefore, to facilitate the evaluation of complex programs, including those for rehabilitation, we illustrate the use of a theoretical logic model, as proposed by Champagne, through the process of documentation of a specific complex and interdisciplinary rehabilitation program. Through participatory/collaborative research, the rehabilitation program was analyzed using three “submodels” of the logic model of intervention: causal model, intervention model and program theory model. This should facilitate the evaluation of programs, including those for rehabilitation.

Evaluator's Guide for Microcomputer-Based Instructional Packages. Developed by MicroSIFT, a Project of the Computer Technology Program. Sixth Revision.

ERIC Educational Resources Information Center

Northwest Regional Educational Lab., Portland, OR.

This guide developed by MicroSIFT, a clearinghouse for microcomputer-based educational software and courseware, provides background information and forms to aid teachers and other educators in evaluating available microcomputer courseware. The evaluation process comprises six stages: (1) sifting, which screens out those programs that are not…

An Evaluation of the Federal Class-Size Reduction Program in Wake County, North Carolina--1999-2000.

ERIC Educational Resources Information Center

Scudder, David F.

An empirical evaluation of the federal class-size reduction (CSR) program in Wake County, North Carolina, during the 1999-2000 school year is presented. The qualitative process evaluation showed implementation issues involving the mechanics and the meaning of CSR. Often, schools did not understand where CSR occurred because of changing enrollment…

Library Services and Technology Act: Five-Year Program Evaluation Report for the State of Utah, 1998-2002.

ERIC Educational Resources Information Center

Utah State Library Div., Salt Lake City. Dept. of Community and Economic Development.

This document presents the evaluation report for Utah's Library Services and Technology Act (LSTA) program for 1998-2002. Part I, "Executive Summary," describes the evaluation study process and summarizes recommendations related to goals in the following areas: (1) basic library technology; (2) enhanced library technology; (3) PIONEER:…

Models and Procedures for Improving the Planning, Management, and Evaluation of Cooperative Education Programs. Final Report. Volume I.

ERIC Educational Resources Information Center

Blaschke, Charles L.; Steiger, JoAnn

This report of a project to design a set of training guidelines for planning, managing, and evaluating cooperative education programs describes briefly the procedures used in developing the guidelines and model; discusses the various components of the planning, management, and evaluation process; and presents guidelines and criteria for designing…

Evaluation of the Student Engagement Process in a Criminal Justice Program at a Technical College

ERIC Educational Resources Information Center

Totzke, Martin W.

2007-01-01

This applied dissertation was an evaluation of the student engagement practices offered to students in a criminal justice program at a Midwestern technical college. The problem was that an evaluation of the practices had not been conducted to provide data to indicate whether the current practices were effective. The researcher developed an…

Evaluating complex health financing interventions: using mixed methods to inform further implementation of a novel PBI intervention in rural Malawi.

PubMed

McMahon, Shannon A; Brenner, Stephan; Lohmann, Julia; Makwero, Christopher; Torbica, Aleksandra; Mathanga, Don P; Muula, Adamson S; De Allegri, Manuela

2016-08-19

Gaps remain in understanding how performance-based incentive (PBI) programs affect quality of care and service quantity, whether programs are cost effective and how programs could be tailored to meet client and provider needs while remaining operationally viable. In 2014, Malawi's Ministry of Health launched the Service Delivery Integration-PBI (SSDI-PBI) program. The program is unique in that no portion of performance bonuses are paid to individual health workers, and it shifts responsibility for infrastructure and equipment procurement from facility staff to implementing partners. This protocol outlines an approach that analyzes processes and outcomes, considers expected and unexpected consequences of the program and frames the program's outputs relative to its costs. Findings from this evaluation will inform the intended future scale-up of PBI in Malawi. This study employs a prospective controlled before-and-after triangulation design to assess effects of the PBI program by analyzing quantitative and qualitative data from intervention and control facilities. Guided by a theoretical framework, the evaluation consists of four main components: service provision, health worker motivation, implementation processes and costing. Quality and access outcomes are assessed along four dimensions: (1) structural elements (related to equipment, drugs, staff); (2) process elements (providers' compliance with standards); (3) outputs (service utilization); (4) experiential elements (experiences of service delivery). The costing component includes costs related to start-up, ongoing management, and the cost of incentives themselves. The cost analysis considers costs incurred within the Ministry of Health, funders, and the implementing agency. The evaluation relies on primary data (including interviews and surveys) and secondary data (including costing and health management information system data). Through the lens of a PBI program, we illustrate how complex interventions can be evaluated via not only primary, mixed-methods data collection, but also through a wealth of secondary data from program implementers (including monitoring, evaluation and financial data), and the health system (including service utilization and service readiness data). We also highlight the importance of crafting a theory and using theory to inform the nature of data collected. Finally, we highlight the need to be responsive to stakeholders in order to enhance a study's relevance.

Improving the Textbook Selection Process: Case Studies of the Textbook Adoption Guidelines Project. Technical Report No. 478.

ERIC Educational Resources Information Center

Dole, Janice; And Others

A study followed three textbook adoption committees as they evaluated basal reading programs. The committees used "A Guide to Selecting Basal Reading Programs" (developed at the Center for the Study of Reading) to help them evaluate the quality of instruction in existing programs. Case studies of the three committees sought to address the…

National Home Start Evaluation Interim Report VII. Twenty-Month Program Analysis and Findings.

ERIC Educational Resources Information Center

Love, John M.; And Others

This interim evaluation report focuses on process (formative) and outcome (summative) data collected in spring 1975 on the National Home Start Program. Home Start, a federally-funded 3-year (1972-1975) home-based demonstration program for low-income families with 3- to 5-year-old children was designed to enhance a mother's skills in dealing with…

Information Needs to Support an Evaluation Process for Bureau of Indian Affairs Educational Programs.

ERIC Educational Resources Information Center

Jeffery, James R., Comp.

The purpose of this paper is to provide the Director of the Office of Education Programs with an instrument with which to develop an educational data base for providing information to evaluate the education programs of the Bureau of Indian Affairs (BIA). Some specific issues and questions are presented along with background information. BIA…

Measuring Outcomes in Children's Services.

ERIC Educational Resources Information Center

Christner, Anne Marshall, Ed.

Outcomes evaluation can provide program managers and clinical directors in child welfare, juvenile justice, child mental health, and child protective services the necessary tools for program quality assurance and accountability. This guide describes the outcomes evaluation process and provides a summary of articles and reports detailing current…

SITE DEMONSTRATION OF THE BASIC EXTRACTIVE SLUDGE TREATMENT PROCESS

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program, in cooperation with EPA Region 5, the Great Lakes National Program Office (GLNPO), and the U.S. Army Corps of Engineers (COE) planned and executed a pilot-scla e evaluation of the Basic Extyractive Sludge Treatment (B...

BUILDING MODEL ANALYSIS APPLICATIONS WITH THE JOINT UNIVERSAL PARAMETER IDENTIFICATION AND EVALUATION OF RELIABILITY (JUPITER) API

EPA Science Inventory

The open-source, public domain JUPITER (Joint Universal Parameter IdenTification and Evaluation of Reliability) API (Application Programming Interface) provides conventions and Fortran-90 modules to develop applications (computer programs) for analyzing process models. The input ...

EPA SITE DEMONSTRATION OF THE INTERNATIONAL WASTE TECHNOLOGIES/GEO-CON IN SITU STABILIZATION/ SOLIDIFICATION PROCESS

EPA Science Inventory

This paper presents an EPA evaluation of the first field demonstration of an in situ stabilization/solidification process for contaminated soil under the EPA Superfund Innovative Technology Evaluation (SITE) program. Demonstration of this process was a joint effort of two vendors...

Evaluating theory-based evaluation: information, norms, and adherence.

PubMed

Jacobs, W Jake; Sisco, Melissa; Hill, Dawn; Malter, Frederic; Figueredo, Aurelio José

2012-08-01

Programmatic social interventions attempt to produce appropriate social-norm-guided behavior in an open environment. A marriage of applicable psychological theory, appropriate program evaluation theory, and outcome of evaluations of specific social interventions assures the acquisition of cumulative theory and the production of successful social interventions--the marriage permits us to advance knowledge by making use of both success and failures. We briefly review well-established principles within the field of program evaluation, well-established processes involved in changing social norms and social-norm adherence, the outcome of several program evaluations focusing on smoking prevention, pro-environmental behavior, and rape prevention and, using the principle of learning from our failures, examine why these programs often do not perform as expected. Finally, we discuss the promise of learning from our collective experiences to develop a cumulative science of program evaluation and to improve the performance of extant and future interventions. Copyright © 2012. Published by Elsevier Ltd.

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

Evaluating the Fabreville Heart Health Program in Laval, Canada: a dialogue between two paradigms, positivism and constructivism.

PubMed

Nguyen, Minh Nguyet; Otis, Joanne

2003-06-01

As part of the Canadian Federal-Provincial Initiative in Heart Health, the goal of the Fabreville Heart Health Program was to sensitize a district of Laval, Quebec's second most populous city, to heart-healthy behaviours. The program was planned and implemented by a committee composed of Fabreville community leaders and professionals from the Public Health Department. Between 1992 and 1994, intervention objectives were defined by the department in terms of changing individual behaviours associated with cardiovascular risk factors, namely diet, sedentariness and smoking, as well as adapting physical and social environments to facilitate these changes. However, from 1994 to its conclusion in 1997, the program was re-oriented to engage the population in mobilizing their own community and taking charge of interventions themselves. Actions then became dependent on the interests and motivation of Fabreville residents to transform their lifestyles and aspects of their physical environment. The initial evaluation process, based on the positivist paradigm, was designed to measure changes in individual behaviours and certain physical environments, such as an increase in designated non-smoking areas. However, following the re-orientation towards community mobilization, it was decided that evaluation should go beyond the professional production of data to include a process of the collective construction of knowledge. Evaluation methodology then became based on the constructivist paradigm. Yet field constraints such as lack of community involvement in both leadership and process evaluation, and the need to ensure evaluation standards and fulfil sponsor obligations, compelled the Public Health Department to return to using a certain number of positivist methods. The ensuing inter-paradigm dialogue helped broaden the scope of evaluation and contributed to gaining a more in-depth understanding of the processes and outcomes of community mobilization.

Use of a structured template to facilitate practice-based learning and improvement projects.

PubMed

McClain, Elizabeth K; Babbott, Stewart F; Tsue, Terance T; Girod, Douglas A; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-06-01

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008-2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level.

Use of a Structured Template to Facilitate Practice-Based Learning and Improvement Projects

PubMed Central

McClain, Elizabeth K.; Babbott, Stewart F.; Tsue, Terance T.; Girod, Douglas A.; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-01-01

Background The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. Purpose We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. Methods We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008–2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. Results An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. Discussion The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level. PMID:23730444

Monitoring and Evaluating the Transition of Large-Scale Programs in Global Health

PubMed Central

Bao, James; Rodriguez, Daniela C; Paina, Ligia; Ozawa, Sachiko; Bennett, Sara

2015-01-01

Purpose: Donors are increasingly interested in the transition and sustainability of global health programs as priorities shift and external funding declines. Systematic and high-quality monitoring and evaluation (M&E) of such processes is rare. We propose a framework and related guiding questions to systematize the M&E of global health program transitions. Methods: We conducted stakeholder interviews, searched the peer-reviewed and gray literature, gathered feedback from key informants, and reflected on author experiences to build a framework on M&E of transition and to develop guiding questions. Findings: The conceptual framework models transition as a process spanning pre-transition and transition itself and extending into sustained services and outcomes. Key transition domains include leadership, financing, programming, and service delivery, and relevant activities that drive the transition in these domains forward include sustaining a supportive policy environment, creating financial sustainability, developing local stakeholder capacity, communicating to all stakeholders, and aligning programs. Ideally transition monitoring would begin prior to transition processes being implemented and continue for some time after transition has been completed. As no set of indicators will be applicable across all types of health program transitions, we instead propose guiding questions and illustrative quantitative and qualitative indicators to be considered and adapted based on the transition domains identified as most important to the particular health program transition. The M&E of transition faces new and unique challenges, requiring measuring constructs to which evaluators may not be accustomed. Many domains hinge on measuring “intangibles” such as the management of relationships. Monitoring these constructs may require a compromise between rigorous data collection and the involvement of key stakeholders. Conclusion: Monitoring and evaluating transitions in global health programs can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Further investment and stronger methodological work are needed. PMID:26681706

Health promotion in young adults at a university in Korea: A cross-sectional study of 625 participants in a university.

PubMed

Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

2017-02-01

Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program.A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test.The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants' overall evaluation score (83% rated "excellent" or "good") and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events.In conclusion, the university-wide health promotion program was effective in improving university members' health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs.

Health promotion in young adults at a university in Korea

PubMed Central

Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

2017-01-01

Abstract Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program. A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test. The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants’ overall evaluation score (83% rated “excellent” or “good”) and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events. In conclusion, the university-wide health promotion program was effective in improving university members’ health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs. PMID:28207551

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

The Ergonomic Program Implementation Continuum (EPIC): integration of health and safety--a process evaluation in the healthcare sector.

PubMed

Baumann, Andrea; Holness, D Linn; Norman, Patrica; Idriss-Wheeler, Dina; Boucher, Patricia

2012-07-01

This article presents a health and safety intervention model and the use of process evaluation to assess a participatory ergonomic intervention. The effectiveness of the Ergonomic Program Implementation Continuum (EPIC) was assessed at six healthcare pilot sites in Ontario, Canada. The model provided a framework to demonstrate evaluation findings. Participants reported that EPIC was thorough and identified improvements related to its use. Participants believed the program contributed to advancing an organizational culture of safety (COS). Main barriers to program uptake included resistance to change and need for adequate funding and resources. The dedication of organizational leaders and consultant coaches was identified as essential to the program's success. In terms of impact on industry, findings contribute to the evidence-based knowledge of health and safety interventions and support use of the framework for creating a robust infrastructure to advance organizational COS and link staff safety and wellness with patient safety in healthcare. Copyright © 2012 National Safety Council and Elsevier Ltd. All rights reserved.

Process and impact evaluation of a legal assistance and health care community partnership.

PubMed

Teufel, James A; Brown, Stephen L; Thorne, Woody; Goffinet, Diane M; Clemons, Latesha

2009-07-01

Community health partnerships have increased in popularity, but their effectiveness is often not evaluated. Through secondary data analysis, this study evaluates a program that offered access to legal services to address health-related issues, such as Medicaid reimbursement, Social Security benefits, medication coverage, and divorce. Based on the analysis reimbursements to expenditures, the health and law program appears to be cost-effective and thereby economically sustainable. The cost-effectiveness of this program increases the likelihood that it will be institutionalized and/or expanded. This program evaluation is used to exemplify how community stakeholders could partner to leverage resources to establish a sustainable community health and law program to address the needs of people living in medically underserved areas.

A combined disease management and process modeling approach for assessing and improving care processes: a fall management case-study.

PubMed

Askari, Marjan; Westerhof, Richard; Eslami, Saied; Medlock, Stephanie; de Rooij, Sophia E; Abu-Hanna, Ameen

2013-10-01

To propose a combined disease management and process modeling approach for evaluating and improving care processes, and demonstrate its usability and usefulness in a real-world fall management case study. We identified essential disease management related concepts and mapped them into explicit questions meant to expose areas for improvement in the respective care processes. We applied the disease management oriented questions to a process model of a comprehensive real world fall prevention and treatment program covering primary and secondary care. We relied on interviews and observations to complete the process models, which were captured in UML activity diagrams. A preliminary evaluation of the usability of our approach by gauging the experience of the modeler and an external validator was conducted, and the usefulness of the method was evaluated by gathering feedback from stakeholders at an invitational conference of 75 attendees. The process model of the fall management program was organized around the clinical tasks of case finding, risk profiling, decision making, coordination and interventions. Applying the disease management questions to the process models exposed weaknesses in the process including: absence of program ownership, under-detection of falls in primary care, and lack of efficient communication among stakeholders due to missing awareness about other stakeholders' workflow. The modelers experienced the approach as usable and the attendees of the invitational conference found the analysis results to be valid. The proposed disease management view of process modeling was usable and useful for systematically identifying areas of improvement in a fall management program. Although specifically applied to fall management, we believe our case study is characteristic of various disease management settings, suggesting the wider applicability of the approach. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Program Costing in a Community College

ERIC Educational Resources Information Center

Balinsky, Warren; Burns, John

1975-01-01

This paper discusses improving the budget control process for a community college by use of program cost accounting. The authors suggest that adoption of such a program will improve resource allocation and program evaluation, aid planning, and better inform the public about the purposes, costs, and results of school programs. (JG)

Evaluation and implementation of highly challenging balance training in clinical practice for people with Parkinson's disease: protocol for the HiBalance effectiveness-implementation trial.

PubMed

Leavy, Breiffni; Kwak, Lydia; Hagströmer, Maria; Franzén, Erika

2017-02-07

If people with progressive neurological diseases are to avail of evidence-based rehabilitation, programs found effective in randomized controlled trials (RCT's) must firstly be adapted and tested in clinical effectiveness studies as a means of strengthening their evidence base. This paper describes the protocol for an effectiveness-implementation trial that will assess the clinical effectiveness of a highly challenging balance training program (the HiBalance program) for people with mild-moderate Parkinson's disease (PD) while simultaneously collecting data concerning the way in which the program is implemented. The HiBalance program is systemically designed to target balance impairments in PD and has been shown effective at improving balance control and gait in a previous RCT. Study aims are to i) determine the effectiveness of the adapted HiBalance program on performance and self-rated outcomes such as balance control, gait and physical activity level ii) conduct a process evaluation of program implementation at the various clinics iii) determine barriers and facilitators to program implementation in these settings. This effectiveness-implementation type 1 hybrid study will use a non-randomized controlled design with consecutive inclusion of people with PD at multiple clinical sites. A mixed method approach will be used to collect clinical effectiveness data and process evaluation data which is both quantitative and qualitative in nature. The consolidated framework for implementation research (CFIR) will be used to guide the planning and collection of data concerning implementation barriers and facilitators. The HiBalance program will be provided by physical therapists as a part of standard rehabilitation care at the clinical sites, while the evaluation of the implementation process will be performed by the research group and funded by research grants. An effectiveness-implementation study design benefits patients by speeding up the process of translating findings from research settings to routine health care. Findings from this study will also be highly relevant for those working with neurological rehabilitation when faced with decisions concerning the translation of training programs from efficacy studies to everyday clinical practice. ClinicalTrials.gov march 2016, NCT02727478 .

Evaluating the Implementation of Performance Improvement Training: The E[superscript 3] Process for Success

ERIC Educational Resources Information Center

Larbi-Apau, Josephine A.; Moseley, James L.

2008-01-01

This article provides a comprehensive approach to careful review and evaluation of the implementation of performance training intervention. It discusses the E[superscript 3] process for success, a basic framework for evaluating the implementation phase of a training program implemented as a broad-based performance improvement strategy. The intent…

A Process and Outcome Evaluation of an Affective Teacher Training Primary Prevention Program.

ERIC Educational Resources Information Center

Schaps, Eric; And Others

Effective Classroom Management (ECM)-Elementary, an in-service course in which teachers were taught various communication, problem solving, and self-esteem enhancement techniques was evaluated. Process evaluation data included: (1) documentation of in-service training by outside observers; (2) teacher feedback on the individual training sessions;…

44 CFR 152.5 - Review process and evaluation criteria.

Code of Federal Regulations, 2010 CFR

2010-10-01

... criteria and the program priorities. Eligible applicants that best address the priorities will advance to a... Review process and evaluation criteria. (a) Every application will be evaluated based on the answers to... screening will be in the “competitive range” and subject to a second level of review. We will use the...

Improving Adherence to Mediterranean-Style Diet With a Community Culinary Coaching Program: Methodology Development and Process Evaluation.

PubMed

Polak, Rani; Pober, David; Morris, Avigail; Arieli, Rakefet; Moore, Margaret; Berry, Elliot; Ziv, Mati

The Community Culinary Coaching Program is a community-based participatory program aimed at improving communal settlement residents' nutrition. The residents, central kitchens, preschools, and communal dining rooms were identified as areas for intervention. Evaluation included goals accomplishment assessed by food purchases by the central kitchens, and residents' feedback through focus groups. Purchasing included more vegetables (mean (standard error) percent change), (+7% (4); P = .32), fish (+115% (11); P < .001), whole grains, and legumes (+77% (9); P < .001); and less soup powders (-40% (9); P < .05), processed beef (-55% (8); P < .001), and margarine (-100% (4); P < .001). Residents recommended continuing the program beyond the project duration. This model might be useful in organizations with communal dining facilities.

Process evaluation of TXT2BFiT: a multi-component mHealth randomised controlled trial to prevent weight gain in young adults.

PubMed

Partridge, Stephanie R; Allman-Farinelli, Margaret; McGeechan, Kevin; Balestracci, Kate; Wong, Annette T Y; Hebden, Lana; Harris, Mark F; Bauman, Adrian; Phongsavan, Philayrath

2016-01-19

TXT2BFiT was one of the first few innovative mHealth programs designed for young adults (18-35 years) with demonstrated efficacy in weight management. However, research is lacking to understand intervention effectiveness, especially in complex, multi-component mHealth programs. This paper investigates participant perceptions of and engagement with the mHealth program components in the TXT2BFiT to understand program effects. Process evaluation data were collected continuously for the study duration. The TXT2BFiT program was a multi-component lifestyle program delivered intensively for 3-month followed by a 6-month maintenance phase. Program components included personalised coaching calls, text messages, emails, smartphone apps and website access. Process evaluation measures included frequency of use of components and frequency for number of components used (online survey data); dose delivered and engagement with program components (researcher logs and web platform reports); frequency, timing and difficulties experienced with program components (online survey data) and overall perceptions of program components (online survey data and semi-structured telephone interviews). Qualitative data analysis was performed using NVivo10. Over 80% of participants completed post-intervention (3-months, intervention, n = 110, control n = 104) and follow-up surveys (9-months, intervention, n = 96, control n = 104). Thirty intervention participants completed semi-structured telephone interviews. Participants reported high use of coaching calls, text messages and emails and no issues in content delivery from these components. These components were described as helping them to achieve their goals. Website and app use and engagement was low for the duration of the program. Participants would prefer incorporation of the self-monitoring apps and website resources into one smartphone application that can be individualised by entry of their personal data. Our process evaluation has allowed a comprehensive understanding of use and preference for different program components. The high value placed on the coaching calls is consistent with a desire for personalisation of the mHealth program and even further tailoring of text messages and emails. The findings of this study will be used to revise TXT2BFiT for future users. The trial is registered with the Australian New Zealand Clinical Trials Registry ( ACTRN12612000924853 ).

COPES Report: System Reliability Study.

ERIC Educational Resources Information Center

Foothill-De Anza Community Coll. District, Los Altos Hills, CA.

The study examines the reliability of the Community College Occupational Programs Evaluation System (COPES). The COPES process is a system for evaluating program strengths and needs. A two-way test, college self-appraisal with third party validation of the self-appraisal, is utilized to assist community colleges in future institutional planning…

An Evaluation of Project Gifted 1971-1972.

ERIC Educational Resources Information Center

Renzulli, Joseph S.

Evaluated was Project Gifted, a tri-city (Cranston, East Providence, and Warwick, Rhode Island) program which focused on the training of gifted children in grades 4-6 in the creative thinking process. Project goals were identification of gifted students, development of differential experiences, and development of innovative programs. Cranston's…

Computer software management, evaluation, and dissemination

NASA Technical Reports Server (NTRS)

1983-01-01

The activities of the Computer Software Management and Information Center involving the collection, processing, and distribution of software developed under the auspices of NASA and certain other federal agencies are reported. Program checkout and evaluation, inventory control, customer services and marketing, dissemination, program maintenance, and special development tasks are discussed.

Evaluating Technology Integration in the Elementary School: A Site-Based Approach.

ERIC Educational Resources Information Center

Mowe, Richard

This book enables educators at the elementary level to conduct formative evaluations of their technology programs in minimum time. Most of the technology is computer related, including word processing, graphics, desktop publishing, spreadsheets, databases, instructional software, programming, and telecommunications. The design of the book is aimed…

Evaluating Cooperative Education Programs.

ERIC Educational Resources Information Center

Alvir, Howard P.

This document defines cooperative education as any form of occupational or professional activity that required the cooperation of both school and the labor market. In some cases, this might be the school and industry or business. In this process, evaluation is defined as the improvement of learner success through measurement of program components.…

Parity in Designing, Conducting, and Evaluating Teacher Education Programs: A Conceptual Definition.

ERIC Educational Resources Information Center

Caruso, Joseph J.

Individuals, agencies, and institutions involved in the education and employment of teachers conceptually defined parity relevant to the decision-making process in planning, conducting, and evaluating teacher education programs and translated the conceptual definition into an instrument for describing parity in consortium-centered teacher…

14 CFR 1214.1102 - Evaluation of applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... Astronaut Candidate Recruitment and Selection Program § 1214.1102 Evaluation of applications. (a) All... obtained. This evaluation process will be monitored to ensure adherence to applicable policy, laws, and...

Designing cost effective water demand management programs in Australia.

PubMed

White, S B; Fane, S A

2002-01-01

This paper describes recent experience with integrated resource planning (IRP) and the application of least cost planning (LCP) for the evaluation of demand management strategies in urban water. Two Australian case studies, Sydney and Northern New South Wales (NSW) are used in illustration. LCP can determine the most cost effective means of providing water services or alternatively the cheapest forms of water conservation. LCP contrasts to a traditional approach of evaluation which looks only at means of increasing supply. Detailed investigation of water usage, known as end-use analysis, is required for LCP. End-use analysis allows both rigorous demand forecasting, and the development and evaluation of conservation strategies. Strategies include education campaigns, increasing water use efficiency and promoting wastewater reuse or rainwater tanks. The optimal mix of conservation strategies and conventional capacity expansion is identified based on levelised unit cost. IRP uses LCP in the iterative process, evaluating and assessing options, investing in selected options, measuring the results, and then re-evaluating options. Key to this process is the design of cost effective demand management programs. IRP however includes a range of parameters beyond least economic cost in the planning process and program designs, including uncertainty, benefit partitioning and implementation considerations.

A Module Experimental Process System Development Unit (MEPSDU)

NASA Technical Reports Server (NTRS)

1981-01-01

The purpose of this program is to demonstrate the technical readiness of a cost effective process sequence that has the potential for the production of flat plate photovoltaic modules which met the price goal in 1986 of $.70 or less per watt peak. Program efforts included: preliminary design review, preliminary cell fabrication using the proposed process sequence, verification of sandblasting back cleanup, study of resist parameters, evaluation of pull strength of the proposed metallization, measurement of contact resistance of Electroless Ni contacts, optimization of process parameter, design of the MEPSDU module, identification and testing of insulator tapes, development of a lamination process sequence, identification, discussions, demonstrations and visits with candidate equipment vendors, evaluation of proposals for tabbing and stringing machine.

Changing recruitment outcomes: the 'why' and the 'how'.

PubMed

MacLean, Lisa; Pato, Michèle T

2011-01-01

Residency programs compete for applicants and commit extensive resources to the recruitment process. After failing to fill in the match for 5 years (1999-2004), this program decided to make changes in its recruitment process. The authors describe one program's experience in improving recruitment outcomes. The new training director surveyed other program directors, reviewed medical student feedback, and evaluated previous recruitment processes, developing and implementing a new plan. Tracked outcome measures included USMLE scores, COMLEX scores, match results, and American graduate ratios. After implementation of the new process in 2004-2005, the program has filled all six positions every year. Average median COMLEX 1 and 2 scores increased from 35.0 to 77.5 (p<0.012). The American graduate-to-International medical graduate ratio (AMG/IMG ratio) for the program changed from 7/16 in 1999 to 19/5 for Years 2006-2009. Changes in the recruitment process can favorably alter match outcomes.

FOOD PROCESSING TECHNOLOGY, A SUGGESTED 2-YEAR POST HIGH SCHOOL CURRICULUM.

ERIC Educational Resources Information Center

KNOEBEL, ROBERT M.; AND OTHERS

ADMINISTRATORS, ADVISORY COMMITTEES, SUPERVISORS, AND TEACHERS MAY USE THIS GUIDE IN PLANNING AND DEVELOPING NEW PROGRAMS OR EVALUATING EXISTING PROGRAMS IN POST-HIGH SCHOOL FOOD PROCESSING TECHNOLOGY. BASIC MATERIALS WERE PREPARED BY THE STATE UNIVERSITY OF NEW YORK AGRICULTURAL AND TECHNICAL COLLEGE AT MORRISVILLE AND FINAL PREPARATION WAS…

Proposal of Modification Strategy of NC Program in the Virtual Manufacturing Environment

NASA Astrophysics Data System (ADS)

Narita, Hirohisa; Chen, Lian-Yi; Fujimoto, Hideo; Shirase, Keiichi; Arai, Eiji

Virtual manufacturing will be a key technology in process planning, because there are no evaluation tools for cutting conditions. Therefore, virtual machining simulator (VMSim), which can predict end milling processes, has been developed. The modification strategy of NC program using VMSim is proposed in this paper.

NDE Process Development Specification for SRB Composite Nose Cap

NASA Technical Reports Server (NTRS)

Suits, M.

1999-01-01

The Shuttle Upgrade program is a continuing improvement process to enable the Space Shuttle to be an effective space transportation vehicle for the next few decades. The Solid Rocket Booster (SRB), as a component of that system, is currently undergoing such an improvement. Advanced materials, such as composites, have given us a chance to improve performance and to reduce weight. The SRB Composite Nose Cap (CNC) program aims to replace the current aluminum nose cap, which is coated with a Thermal Protection System and poses a possible debris hazard, with a lighter, stronger, CNC. For the next 2 years, this program will evaluate the design, material selection, properties, and verification of the CNC. This particular process specification cites the methods and techniques for verifying the integrity of such a nose cap with nondestructive evaluation.

77 FR 35665 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-14

... evaluations may include both formative implementation and process evaluations that evaluate a program as it is unfolding, and summative descriptive evaluations that examine changes in final outcomes in a non-causal...

Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Disease management interventions: what's in the black box?

PubMed

Linden, Ariel; Roberts, Nancy

2004-01-01

In discussing evaluation techniques to assess disease management (DM) program outcomes, it is often assumed that DM program interventions are premised on sound clinical judgment, an understanding of the disease process, and knowledge of the psychosocial models of behavioral change that must be used to effect those processes and ultimately improve the health outcomes that are being evaluated. This paper describes eight commonly used behavioral change models applied in the healthcare industry today. They represent programs designed to address individual, interpersonal, and community level factors as well as "packaged" comprehensive approaches. These models illustrate the breadth of approaches to consider when designing or assessing DM program interventions. Careful consideration of the type of behavioral change desired and the theories of how to effect such change should be an integral part of designing disease management program interventions.

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

PubMed

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluation of STD/AIDS prevention programs: a review of approaches and methodologies.

PubMed

da Cruz, Marly Marques; dos Santos, Elizabeth Moreira; Monteiro, Simone

2007-05-01

The article presents a review of approaches and methodologies in the evaluation of STD/AIDS prevention programs, searching for theoretical and methodological support for the institutionalization of evaluation and decision-making. The review included the MEDLINE, SciELO, and ISI Web of Science databases and other sources like textbooks and congress abstracts from 1990 to 2005, with the key words: "evaluation", "programs", "prevention", "STD/AIDS", and similar terms. The papers showed a predominance of quantitative outcome or impact evaluative studies with an experimental or quasi-experimental design. The main use of evaluation is accountability, although knowledge output and program improvement were also identified in the studies. Only a few evaluative studies contemplate process evaluation and its relationship to the contexts. The review aimed to contribute to the debate on STD/AIDS, which requires more effective, consistent, and sustainable decisions in the field of prevention.

Increasing the use of evaluation data collection in an EPO program

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.

Experiential Learning in Engineering Education.

ERIC Educational Resources Information Center

Harrisberger, Lee; And Others

After a discussion of experiential learning as an element in higher education and of the program evaluation process used in this study, six different but successful experiential learning programs in engineering are described and compared. From these comparisons some conclusions are drawn about important program elements. The six programs described…

Duke University's Quality Appearance Program

ERIC Educational Resources Information Center

Jackson, Joe

2008-01-01

The Grounds Services Unit at Duke University has implemented a new program that involves a process of self evaluation, which embraces the concept of perpetual and continuous improvement. The Quality Appearance Program (QAP) embellishes and expands upon the Quality Assurance Program concept, but with a twist to grounds management improvement…

Developing Leadership for Life: Outcomes from a Collegiate Student-Alumni Mentoring Program

ERIC Educational Resources Information Center

Priest, Kerry L.; Donley, Sarah

2014-01-01

This application brief describes the exploratory assessment of a mentoring program between current students and alumni of a leadership studies minor program. We connect leadership education research and practice in two ways: first, we describe a process of qualitative program evaluation to inform program best practices and improvement. In doing…

Independence Community College Program Review Process.

ERIC Educational Resources Information Center

Romine, Robert J.

Program review at Independence Community College (ICC) is structured so that every program of study will undergo review within a 5-year period. The purpose of the program review effort is to assess the relationship of inputs to outcomes, so that actual outcomes can be compared to expected outcomes. Each program of study is evaluated according to…

Investigating the criteria and processes used in the selection, implementation, and evaluation of STEM within K-12 education

NASA Astrophysics Data System (ADS)

Delp, Matthew J.

This study utilized survey research to investigate how school districts within K-12 education select, implement, and evaluate Science, Technology, Engineering, and Mathematics (STEM) programs. Thirty school districts within the Math and Science Collaborative located in Western Pennsylvania participated in this research. In addition to characterizing the STEM programs of the participating school districts, this study also analyzed the alignment of these programs to the components of comprehensive STEM programs and critical approaches to substantiate STEM program implementation as stated in the literature (Augustine, 2005; Bybee, 2010a, 2010b; Carnevale et al., 2011; DeJarnette, 2010; Epstein & Miller, 2011b; Gardner et al., 1983; Hossain & Robinson, 2011, 2012; Kuenzi, 2008). Findings suggest that the primary goal for school districts, as it relates to STEM program implementation, is to influence students' interest and pursuit of STEM-related careers and degrees. In order to achieve this goal, results of this study indicate the focus of STEM program implementation occurs with the greatest frequency at the middle school (grades seven and eight) level, are developed as an adaptation to the curriculum, and are very diverse from one school district to the next. In addition, findings suggest that although school districts maintain they aim to promote careers and degrees in STEM, districts rely on traditional methods of evaluating STEM program implementation (i.e. standardized test scores) and do not track the longitudinal impact their STEM programs as they related to degrees and careers in STEM. Furthermore, results indicate district STEM programs are not aligned to the characteristics of comprehensive STEM programs as defined by the literature. In order to address the misalignment of school district goals and evaluation processes involved in STEM program implementation and the absence of the characteristics commensurate with comprehensive STEM programs, this study has created a framework to guide school districts in STEM program selection, implementation, and evaluation.

Separations in the STATS report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Choppin, G.R.

1996-12-31

The Separations Technology and Transmutation Systems (STATS) Committee formed a Subcommittee on Separations. This subcommittee was charged with evaluating the separations proposed for the several reactor and accelerator transmutation systems. It was also asked to review the processing options for the safe management of high-level waste generated by the defense programs, in particular, the special problems involved in dealing with the waste at the U.S. Department of Energy (DOE) facility in Hanford, Washington. Based on the evaluations from the Subcommittee on Separations, the STATS Committee concluded that for the reactor transmutation programs, aqueous separations involving a combination of PUREX andmore » TRUEX solvent extraction processes could be used. However, additional research and development (R&D) would be required before full plant-scale use of the TRUEX technology could be employed. Alternate separations technology for the reactor transmutation program involves pyroprocessing. This process would require a significant amount of R&D before its full-scale application can be evaluated.« less

Quality Assurance Program Plan for SFR Metallic Fuel Data Qualification

DOE Office of Scientific and Technical Information (OSTI.GOV)

Benoit, Timothy; Hlotke, John Daniel; Yacout, Abdellatif

2017-07-05

This document contains an evaluation of the applicability of the current Quality Assurance Standards from the American Society of Mechanical Engineers Standard NQA-1 (NQA-1) criteria and identifies and describes the quality assurance process(es) by which attributes of historical, analytical, and other data associated with sodium-cooled fast reactor [SFR] metallic fuel and/or related reactor fuel designs and constituency will be evaluated. This process is being instituted to facilitate validation of data to the extent that such data may be used to support future licensing efforts associated with advanced reactor designs. The initial data to be evaluated under this program were generatedmore » during the US Integral Fast Reactor program between 1984-1994, where the data includes, but is not limited to, research and development data and associated documents, test plans and associated protocols, operations and test data, technical reports, and information associated with past United States Nuclear Regulatory Commission reviews of SFR designs.« less

Cultural adaptation process for international dissemination of the strengthening families program.

PubMed

Kumpfer, Karol L; Pinyuchon, Methinin; Teixeira de Melo, Ana; Whiteside, Henry O

2008-06-01

The Strengthening Families Program (SFP) is an evidence-based family skills training intervention developed and found efficacious for substance abuse prevention by U.S researchers in the 1980s. In the 1990s, a cultural adaptation process was developed to transport SFP for effectiveness trials with diverse populations (African, Hispanic, Asian, Pacific Islander, and Native American). Since 2003, SFP has been culturally adapted for use in 17 countries. This article reviews the SFP theory and research and a recommended cultural adaptation process. Challenges in international dissemination of evidence-based programs (EBPs) are discussed based on the results of U.N. and U.S. governmental initiatives to transport EBP family interventions to developing countries. The technology transfer and quality assurance system are described, including the language translation and cultural adaptation process for materials development, staff training, and on-site and online Web-based supervision and technical assistance and evaluation services to assure quality implementation and process evaluation feedback for improvements.

Self Evaluation of Organizations.

ERIC Educational Resources Information Center

Pooley, Richard C.

Evaluation within human service organizations is defined in terms of accepted evaluation criteria, with reasonable expectations shown and structured into a model of systematic evaluation practice. The evaluation criteria of program effort, performance, adequacy, efficiency and process mechanisms are discussed, along with measurement information…

EVALUATION OF FGD DRY INJECTION SORBENTS AND ADDITIVES - VOLUME 2 - PILOT PLANT EVALUATION OF HIGH REACTIVITY SORBENTS

EPA Science Inventory

The report describes a mini-pilot test program to investigate potential new sorbents and processes for dry SO2 removal. Initial tests showed that the 85 cu m/h pilot plant could be used successfully to evaluate both spray dryer and dry injection processes using traditional calciu...

Integrating team resource management program into staff training improves staff's perception and patient safety in organ procurement and transplantation: the experience in a university-affiliated medical center in Taiwan.

PubMed

Hsu, Ya-Chi; Jerng, Jih-Shuin; Chang, Ching-Wen; Chen, Li-Chin; Hsieh, Ming-Yuan; Huang, Szu-Fen; Liu, Yueh-Ping; Hung, Kuan-Yu

2014-08-11

The process involved in organ procurement and transplantation is very complex that requires multidisciplinary coordination and teamwork. To prevent error during the processes, teamwork education and training might play an important role. We wished to evaluate the efficacy of implementing a Team Resource Management (TRM) program on patient safety and the behaviors of the team members involving in the process. We implemented a TRM training program for the organ procurement and transplantation team members of the National Taiwan University Hospital (NTUH), a teaching medical center in Taiwan. This 15-month intervention included TRM education and training courses for the healthcare workers, focused group skill training for the procurement and transplantation team members, video demonstration and training, and case reviews with feedbacks. Teamwork culture was evaluated and all procurement and transplantation cases were reviewed to evaluate the application of TRM skills during the actual processes. During the intervention period, a total of 34 staff members participated the program, and 67 cases of transplantations were performed. Teamwork framework concept was the most prominent dimension that showed improvement from the participants for training. The team members showed a variety of teamwork behaviors during the process of procurement and transplantation during the intervention period. Of note, there were two potential donors with a positive HIV result, for which the procurement processed was timely and successfully terminated by the team. None of the recipients was transplanted with an infected organ. No error in communication or patient identification was noted during review of the case records. Implementation of a Team Resource Management program improves the teamwork culture as well as patient safety in organ procurement and transplantation.

Integrating team resource management program into staff training improves staff’s perception and patient safety in organ procurement and transplantation: the experience in a university-affiliated medical center in Taiwan

PubMed Central

2014-01-01

Background The process involved in organ procurement and transplantation is very complex that requires multidisciplinary coordination and teamwork. To prevent error during the processes, teamwork education and training might play an important role. We wished to evaluate the efficacy of implementing a Team Resource Management (TRM) program on patient safety and the behaviors of the team members involving in the process. Methods We implemented a TRM training program for the organ procurement and transplantation team members of the National Taiwan University Hospital (NTUH), a teaching medical center in Taiwan. This 15-month intervention included TRM education and training courses for the healthcare workers, focused group skill training for the procurement and transplantation team members, video demonstration and training, and case reviews with feedbacks. Teamwork culture was evaluated and all procurement and transplantation cases were reviewed to evaluate the application of TRM skills during the actual processes. Results During the intervention period, a total of 34 staff members participated the program, and 67 cases of transplantations were performed. Teamwork framework concept was the most prominent dimension that showed improvement from the participants for training. The team members showed a variety of teamwork behaviors during the process of procurement and transplantation during the intervention period. Of note, there were two potential donors with a positive HIV result, for which the procurement processed was timely and successfully terminated by the team. None of the recipients was transplanted with an infected organ. No error in communication or patient identification was noted during review of the case records. Conclusion Implementation of a Team Resource Management program improves the teamwork culture as well as patient safety in organ procurement and transplantation. PMID:25115403

Investigating the Gap Between Estimated and Actual Energy Efficiency and Conservation Savings for Public Buildings Projects & Programs in United States

NASA Astrophysics Data System (ADS)

Qaddus, Muhammad Kamil

The gap between estimated and actual savings in energy efficiency and conservation (EE&C) projects or programs forms the problem statement for the scope of public and government buildings. This gap has been analyzed first on impact and then on process-level. On the impact-level, the methodology leads to categorization of the gap as 'Realization Gap'. It then views the categorization of gap within the context of past and current narratives linked to realization gap. On process-level, the methodology leads to further analysis of realization gap on process evaluation basis. The process evaluation criterion, a product of this basis is then applied to two different programs (DESEU and NYC ACE) linked to the scope of this thesis. Utilizing the synergies of impact and process level analysis, it offers proposals on program development and its structure using our process evaluation criterion. Innovative financing and benefits distribution structure is thus developed and will remain part of the proposal. Restricted Stakeholder Crowd Financing and Risk-Free Incentivized return are the products of proposed financing and benefit distribution structure respectively. These products are then complimented by proposing an alternative approach in estimating EE&C savings. The approach advocates estimation based on range-allocation rather than currently utilized unique estimated savings approach. The Way Ahead section thus explores synergy between financial and engineering ranges of energy savings as a multi-discipline approach for future research. Moreover, it provides the proposed program structure with risk aversion and incentive allocation while dealing with uncertainty. This set of new approaches are believed to better fill the realization gap between estimated and actual energy efficiency savings.

CAV-OX CAVITATION OXIDIATION PROCESS - MAGNUM WATER TECHNOLOGY, INC. - APPLICATIONS ANALYSIS REPORT

EPA Science Inventory

This report evaluates the ability of the CAV-OX cavitation oxidation process to remove volatile organic compounds (VOC) present in aqueous wastes. This report also presents economic data based on the Superfund Innovative Technology Evaluation (SITE) Program demonstration and nine...

Process Evaluation of an Effective Church-Based Diet Intervention: Body & Soul

ERIC Educational Resources Information Center

Campbell, Marci Kramish; Resnicow, Ken; Carr, Carol; Wang, Terry; Williams, Alexis

2007-01-01

Body & Soul has demonstrated effectiveness as a dietary intervention among African American church members. The process evaluation assessed relationships between program exposure and implementation factors and study outcomes and characterized factors important for adoption, implementation, and maintenance. Data sources included participant surveys…

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM Evaluation of Soil Amendment Technologies at the Crooksville/RosevillePottery Area of Concern Rocky Mountain Remediation ServicesEnvirobond™ Process

EPA Science Inventory

RMRS developed the Envirobond™ process to treat heavy metals in soil.This phosphate-based technology consists of a proprietary powder and solution that binds with metals in contaminated waste. RMRS claims that the Envirobond™ process converts metal contaminants from their leach...

Screening programme to select a resin for Gravity Probe-B composites

NASA Technical Reports Server (NTRS)

Will, E. T.

1992-01-01

The Gravity Probe-B (GP-B) program undertook a screening program to select a possible replacement resin for the E-787 resin currently used in composite neck tubes and support struts. The goal was to find a resin with good cryogenic and structural properties, low-helium permeation and an easily repeatable fabrication process. Cycom 92, SCI REZ 081 and RS-3 were selected for comparison with E-787. Identical composite tubes made from each resin and gamma-alumina fiber (85 percent Al2O3, 15 percent SiO2) were evaluated for cryogenic and structural performance and for processability. Cryogenic performance was evaluated by measuring low-temperature permeation and leaks to determine cryogenic strain behavior. Structural performance was evaluated by comparing the resin-dominated shear strength of the composites. Processability was evaluated from fabrication comments and GP-B's own experience. SCI REZ 081 was selected as the best overall resin with superior strength and cryogenic performance and consistent processability.

78 FR 59666 - Transmission Infrastructure Program; Proposed Transmission Infrastructure Program Updates and...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-09-27

... Loan Programs Office into the process. The FRN also identifies the principles Western will continue using to ensure (1) that the Program is separate and distinct from Western's power marketing functions... obtain project funding. Table of Contents I. Definitions II. Principles III. Project Evaluation Criteria...

Project Developmental Continuity Evaluation: Final Report. Volume II: The Process of Program Implementation in PDC.

ERIC Educational Resources Information Center

Wacker, Sally; And Others

The second of two volumes, this document continues the final evaluation report of Project Developmental Continuity (PDC), a Head Start demonstration project initiated in 1974 to develop program models which enhance children's social competence by fostering developmental continuity from preschool through the early elementary grades. In particular,…

The Design, Implementation, and Formative Evaluation of a Classroom Aide Professional Development Training Program

ERIC Educational Resources Information Center

Dulfer, Katherine J.

2013-01-01

This dissertation focused on the process of designing, implementing, and formatively evaluating an eight week Classroom Aide Professional Development Training Program (CAPD-TP) on behavior management and academic instruction within the context of a New Jersey state approved private special education school for students with behavioral and/or…

Evaluation of the U.S. Environmental Protection Agency's Public Outreach Program during the Certification Process at the Waste Isolation Pilot Plant in New Mexico

EPA Pesticide Factsheets

The EPA Office of Radiation and Indoor Air (ORIA) contracted with Phoenix Environmental and EnviroIssues to evaluate the effectiveness of its public outreach program during its certification of the Waste Isolation Pilot Plant (WIPP) in Carlsbad, NM.

Evaluating Computer Integration in the Elementary School: A Step-by-Step Guide.

ERIC Educational Resources Information Center

Mowe, Richard

This handbook was written to enable elementary school educators to conduct formative evaluations of their computer integrated instruction (CII) programs in minimum time. CII is defined as the use of computer software, such as word processing, database, and graphics programs, to help students solve problems or work more productively. The first…

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

Evaluation Program on the Implementation of Industrial Apprenticeship (Prakerin) in Electrical Engineering

NASA Astrophysics Data System (ADS)

Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.

2018-02-01

This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.

Jump start: a targeted substance abuse prevention program.

PubMed

Harrington, N G; Donohew, L

1997-10-01

A substance abuse prevention and life skills program for economically disadvantaged, high sensation seeking African American teens was developed and tested in Cincinnati, Ohio. Formative research was conducted to determine program content and format. Over two implementations, 289 individuals in the target population were recruited as participants for the field test of the program. For the first implementation, participants were randomly selected from the city's summer youth employment program. For the second, a media campaign was designed to recruit participants. Process evaluation indicated that participants evaluated the program extremely positively. Outcome evaluation indicated that significant pretest differences between high and low sensation seekers were neutralized for liquor and marijuana in both years of the program and for attitude toward drugs in the first year of the program. These results suggest that sensation seeking is a useful message design and audience-targeting variable for substance abuse prevention program design. Implications and recommendations for future research are discussed.

Assessing communications effectiveness in meeting corporate goals of public health organizations.

PubMed

Brown, Gordon D; Bopp, Kenneth D; Boren, Suzanne Austin

2005-01-01

Much evaluation of health communications in public health is considered from a program perspective of smoking cessation, weight reduction, education on sexually transmitted diseases, etc. These studies have advanced the knowledge base of communications theory and evaluation and have contributed to program effectiveness. In program-based evaluation the communications process is structured as part of the program itself. This article extends program-based communications evaluation to view communications from the perspective of the consumer and how effectively public health departments respond to consumer expectations. It develops a conceptual model for evaluating elements of communications such as its importance in defining mission and goals within the community, managing strategic constituencies, and enlisting individuals and groups as customers and co-producers of health. It gives a broader perspective on how communications in public heath organizations are managed and a basis for assessing whether they are being managed effectively.

Phoenix Rising: use of a participatory approach to evaluate a federally funded HIV, hepatitis and substance abuse prevention program.

PubMed

Dryden, Eileen; Hyde, Justeen; Livny, Ayala; Tula, Monique

2010-11-01

This paper highlights the value of utilizing a participatory evaluation approach when working with community agencies receiving federal funding for prevention and intervention services. Drawing from our experience as evaluators of a SAMHSA-funded substance abuse, HIV and Hepatitis prevention program targeting homeless young adults, we describe the importance of and strategies for creating a participatory evaluation partnership with program implementers. By participatory evaluation we mean the active involvement of program implementers in defining the evaluation, developing instruments, collecting data, discussing findings, and disseminating results. There are a number of challenges faced when using this approach with federally funded programs that require the use of standardized measurement tools and data collection procedures. Strategies we used to strike a balance between federal requirements and local needs are presented. By increasing the understanding of and participation in the evaluation process, program implementers have greater support for data collection requirements and are appreciably more interested in learning from the evaluation data. This approach has helped to build the capacity of a program and stimulated new possibilities for learning, growing, and ultimately improving the services offered to those the program strives to reach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Ohio's Abandoned Mine Lands Reclamation Program: a Study of Data Collection and Evaluation Techniques

NASA Technical Reports Server (NTRS)

Sperry, S. L.

1982-01-01

The planning process for a statewide reclamation plan of Ohio abandoned minelands in response to the Federal Surface Mining Control and Reclamation Act of 1977 included: (1) the development of a screening and ranking methodology; (2) the establishment of a statewide review of major watersheds affected by mining; (3) the development of an immediate action process; and (4) a prototypical study of a priority watershed demonstrating the data collection, analysis, display and evaluation to be used for the remaining state watersheds. Historical methods for satisfying map information analysis and evaluation, as well as current methodologies being used were discussed. Various computer mapping and analysis programs were examined for their usability in evaluating the priority reclamation sites. Hand methods were chosen over automated procedures; intuitive evaluation was the primary reason.

Early Evolution of the Toxicity Identification Evaluation Process: Contributions from the USEPA Effluent Testing Program

EPA Science Inventory

As part of its whole effluent testing program, the USEPA developed an effects-directed analysis (EDA) approach to identifying the cause of toxicity in toxic effluents or ambient waters, an EDA process termed a “Toxicity Identification Evaluation” (TIE), which is the focus of this...

Puerto Rico's PLATO Learning Program: An Independent Evaluation of the PLATO Learning Model

ERIC Educational Resources Information Center

Shillady, Lucinda; Miller, Libbie

2004-01-01

The Comprehensive School Reform (CSR) program has become a valuable resource in the implementation of the Puerto Rico Department of Education's educational reform process. To support the process, the Commonwealth of Puerto Rico granted computerized equipment, reading and mathematics software and training designed for schools. This included reading…

The Use of Outcome Mapping in the Educational Context

ERIC Educational Resources Information Center

Lewis, Anna

2014-01-01

Outcome Mapping is intended to measure the process by which change occurs, it shifts away from the products of the program to focus on changes in behaviors, relationships, actions, and/or activities of the people involved in the treatment program. This process-oriented methodology, most often used in designing and evaluating community development…

Development and implementation of a comprehensive quality assurance program at a community endoscopy facility.

PubMed

Hilsden, Robert Jay; Rostom, Alaa; Dubé, Catherine; Pontifex, Darlene; McGregor, S Elizabeth; Bridges, Ronald J

2011-10-01

Quality assurance (QA) is a process that includes the systematic evaluation of a service, institution of improvements and ongoing evaluation to ensure that effective changes were made. QA is a fundamental component of any organized colorectal cancer screening program. However, it should play an equally important role in opportunistic screening. Establishing the processes and procedures for a comprehensive QA program can be a daunting proposition for an endoscopy unit. The present article describes the steps taken to establish a QA program at the Forzani & MacPhail Colon Cancer Screening Centre (Calgary, Alberta) - a colorectal cancer screening centre and nonhospital endoscopy unit that is dedicated to providing colorectal cancer screening-related colonoscopies. Lessons drawn from the authors' experience may help others develop their own initiatives. The Global Rating Scale, a quality assessment and improvement tool developed for the gastrointestinal endoscopy services of the United Kingdom's National Health Service, was used as the framework to develop the QA program. QA activities include monitoring the patient experience through surveys, creating endoscopist report cards on colonoscopy performance, tracking and evaluating adverse events and monitoring wait times.

Using Implementation and Program Theory to Examine Communication Strategies in National Wildlife Federation's Backyard Wildlife Habitat Program

ERIC Educational Resources Information Center

Palmer, Dain; Dann, Shari L.

2004-01-01

Our evaluative approach used implementation theory and program theory, adapted from Weiss (1998) to examine communication processes and results for a national wildlife habitat stewardship education program. Using a mail survey of 1427 participants certified in National Wildlife Federation's (NWF) Backyard Wildlife Habitat (BWH) program and a study…

Interim reliability evaluation program, Browns Ferry fault trees

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stewart, M.E.

1981-01-01

An abbreviated fault tree method is used to evaluate and model Browns Ferry systems in the Interim Reliability Evaluation programs, simplifying the recording and displaying of events, yet maintaining the system of identifying faults. The level of investigation is not changed. The analytical thought process inherent in the conventional method is not compromised. But the abbreviated method takes less time, and the fault modes are much more visible.

CHEMICAL STABILIZATION OF MIXED ORGANIC AND METAL COMPOUNDS - EPA SITE PROGRAM DEMONSTRATION OF THE SILICATE TECHNOLOGY CORPORATION PROCESS

EPA Science Inventory

In November 1990, the Silicate Technology Corporation`s (STC) proprietary process for treating soil contaminated with toxic semivolatile organic and inorganic contaminants was evaluated in a Superfund Innovative Technology Evaluation (SITE) field demonstration at the Selma Pressu...

Evaluating an interdisciplinary undergraduate training program in health promotion research.

PubMed

Misra, Shalini; Harvey, Richard H; Stokols, Daniel; Pine, Kathleen H; Fuqua, Juliana; Shokair, Said M; Whiteley, John M

2009-04-01

The University of California at Irvine Interdisciplinary Summer Undergraduate Research Experience (ID-SURE) program had three objectives: (1) designing an interdisciplinary health promotion training curriculum for undergraduate research fellows; (2) developing measures for evaluating and assessing program-related educational processes and products; and (3) comparing these educational process and product measures between groups of students who did or did not receive the training. A total of 101 students participated in the ID-SURE program during 2005, 2006, and 2007. A longitudinal research design was employed whereby students' interdisciplinary attitudes and behaviors were assessed at the beginning and end of the training program. The interdisciplinary and intellectual qualities of students' academic and research products were assessed at the conclusion of the training activities. In addition, ID-SURE participants' interdisciplinary attitudes, behaviors, and research products were compared to those of 70 participants in another fellowship program that did not have an interdisciplinary training component. Exposing undergraduate research fellows to the interdisciplinary curriculum led to increased participation in, and positive attitudes about, interdisciplinary classroom and laboratory activities. Products, such as the integrative and interdisciplinary quality of student research projects, showed no differences when compared to those of undergraduates who were not exposed to the interdisciplinary curriculum. However, undergraduates exposed to the training engaged in more interdisciplinary behaviors at the end of the program than students who were not trained in interdisciplinary research techniques. The findings from this study offer evidence for the efficacy of the ID-SURE program for training undergraduate students in transdisciplinary concepts, methods, and skills that are needed for effective scientific collaboration. Additionally, this study makes two important contributions to the development and evaluation of interdisciplinary health research training programs: (1) It presents and evaluates a novel curriculum for training undergraduate students in interdisciplinary theories, concepts, and methods of health promotion that can be replicated in other settings and contexts; (2) It provides and tests the reliability of new measures for evaluating interdisciplinary collaborative processes and develops objective criteria for rating the integrative and intellectual quality of students' research products.

Final Project Report to NSF.

ERIC Educational Resources Information Center

National Inst. for Science Education, Madison, WI.

The National Institute for Science Education's (NISE) focused mission is to improve mathematics and science education from kindergarten through college. This document reports on NISE's research programs, dissemination programs, and organizational process programs. Contents include: (1) "Systemic Reform: Policy and Evaluation" (William H. Clune and…

HYDROLOGIC EVALUATION OF LANDFILL PERFORMANCE (HELP) MODEL - USER'S GUIDE FOR VERSION 3

EPA Science Inventory

This report documents the solution methods and process descriptions used in the Version 3 of the HELP model. Program documentation including program options, system and operating requirements, file structures, program structure and variable descriptions are provided in a separat...

The Faculty Learning Outcome Assessment Framework

ERIC Educational Resources Information Center

Hurney, Carol A.; Brantmeier, Edward J.; Good, Megan R.; Harrison, Douglas; Meixner, Cara

2016-01-01

Assessment is a cyclical process within which educators construct outcomes, implement programs, assess constructs such as learning, evaluate results, and utilize results to craft stronger programs and services. Within educational and faculty development, assessment measures program impact on faculty, students, and/or institutional culture.…

Evaluation of thermal network correction program using test temperature data

NASA Technical Reports Server (NTRS)

Ishimoto, T.; Fink, L. C.

1972-01-01

An evaluation process to determine the accuracy of a computer program for thermal network correction is discussed. The evaluation is required since factors such as inaccuracies of temperatures, insufficient number of temperature points over a specified time period, lack of one-to-one correlation between temperature sensor and nodal locations, and incomplete temperature measurements are not present in the computer-generated information. The mathematical models used in the evaluation are those that describe a physical system composed of both a conventional and a heat pipe platform. A description of the models used, the results of the evaluation of the thermal network correction, and input instructions for the thermal network correction program are presented.

Process Evaluation of Two Participatory Approaches: Implementing Total Worker Health® Interventions in a Correctional Workforce

PubMed Central

Dugan, Alicia G.; Farr, Dana A.; Namazi, Sara; Henning, Robert A.; Wallace, Kelly N.; El Ghaziri, Mazen; Punnett, Laura; Dussetschleger, Jeffrey L.; Cherniack, Martin G.

2018-01-01

Background Correctional Officers (COs) have among the highest injury rates and poorest health of all the public safety occupations. The HITEC-2 (Health Improvement Through Employee Control-2) study uses Participatory Action Research (PAR) to design and implement interventions to improve health and safety of COs. Method HITEC-2 compared two different types of participatory program, a CO-only “Design Team” (DT) and “Kaizen Event Teams” (KET) of COs and supervisors, to determine differences in implementation process and outcomes. The Program Evaluation Rating Sheet (PERS) was developed to document and evaluate program implementation. Results Both programs yielded successful and unsuccessful interventions, dependent upon team-, facility-, organizational, state-, facilitator-, and intervention-level factors. Conclusions PAR in corrections, and possibly other sectors, depends upon factors including participation, leadership, continuity and timing, resilience, and financial circumstances. The new PERS instrument may be useful in other sectors to assist in assessing intervention success. PMID:27378470

"Volunteering by chance" to promote civic responsibility and civic engagement: does it work?

PubMed

Santinello, Massimo; Cristini, Francesca; Vieno, Alessio; Scacchi, Luca

2012-01-01

This study investigated the effectiveness of a program to promote civic responsibility and prevent antisocial behavior in a sample of Italian adolescents. Participants were 83 Italian male adolescents, attending the second year of high school (Mean age = 15.79; SD = 0.87). In order to test the efficacy of different strategies (in-classroom training and service activity in a voluntary organization) we divided students into two experimental groups--one classroom of students participated in both strategies (training + volunteering group) and another classroom only participated in the training (training only group)--and one control group. Process and efficacy evaluations were completed. Data were collected before and following the intervention. The process evaluation revealed that the program was highly accepted and appreciated by students. The efficacy evaluation revealed no intervention effects on civic responsibility. However, the training + volunteering group reported a significant decrease in antisocial behavior after the program. Thus, the program was effective in preventing antisocial behavior but not in promoting civic responsibility in our sample.

Process evaluation of two participatory approaches: Implementing total worker health® interventions in a correctional workforce.

PubMed

Dugan, Alicia G; Farr, Dana A; Namazi, Sara; Henning, Robert A; Wallace, Kelly N; El Ghaziri, Mazen; Punnett, Laura; Dussetschleger, Jeffrey L; Cherniack, Martin G

2016-10-01

Correctional Officers (COs) have among the highest injury rates and poorest health of all the public safety occupations. The HITEC-2 (Health Improvement Through Employee Control-2) study uses Participatory Action Research (PAR) to design and implement interventions to improve health and safety of COs. HITEC-2 compared two different types of participatory program, a CO-only "Design Team" (DT) and "Kaizen Event Teams" (KET) of COs and supervisors, to determine differences in implementation process and outcomes. The Program Evaluation Rating Sheet (PERS) was developed to document and evaluate program implementation. Both programs yielded successful and unsuccessful interventions, dependent upon team-, facility-, organizational, state-, facilitator-, and intervention-level factors. PAR in corrections, and possibly other sectors, depends upon factors including participation, leadership, continuity and timing, resilience, and financial circumstances. The new PERS instrument may be useful in other sectors to assist in assessing intervention success. Am. J. Ind. Med. 59:897-918, 2016. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

The RESTORE program of restorative justice for sex crimes: vision, process, and outcomes.

PubMed

Koss, Mary P

2014-06-01

The article reports empirical evaluation of RESTORE, a restorative justice (RJ) conferencing program adapted to prosecutor-referred adult misdemeanor and felony sexual assaults. RESTORE conferences included voluntary enrollment, preparation, and a face-to-face meeting where primary and secondary victims voice impacts, and responsible persons acknowledge their acts and together develop a re-dress plan that is supervised for 1 year. Process data included referral and consent rates, participant characteristics, observational ratings of conferences compared with program design, services delivered, and safety monitoring. Outcome evaluation used 22 cases to assess (a) pre-post reasons for choosing RESTORE, (b) preparation and conference experiences, (c) overall program and justice satisfaction, and (d) completion rates. This is the first peer-reviewed quantitative evaluation of RJ conferencing for adult sexual assault. Although the data have limitations, the results support cautious optimism regarding feasibility, safety, and satisfactory outcomes. They help envision how conferencing could expand and individualize justice options for sexual assault.

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

Methods for design and evaluation of parallel computating systems (The PISCES project)

NASA Technical Reports Server (NTRS)

Pratt, Terrence W.; Wise, Robert; Haught, Mary JO

1989-01-01

The PISCES project started in 1984 under the sponsorship of the NASA Computational Structural Mechanics (CSM) program. A PISCES 1 programming environment and parallel FORTRAN were implemented in 1984 for the DEC VAX (using UNIX processes to simulate parallel processes). This system was used for experimentation with parallel programs for scientific applications and AI (dynamic scene analysis) applications. PISCES 1 was ported to a network of Apollo workstations by N. Fitzgerald.

Use of a business excellence model to improve conservation programs.

PubMed

Black, Simon; Groombridge, Jim

2010-12-01

The current shortfall in effectiveness within conservation biology is illustrated by increasing interest in "evidence-based conservation," whose proponents have identified the need to benchmark conservation initiatives against actions that lead to proven positive effects. The effectiveness of conservation policies, approaches, and evaluation is under increasing scrutiny, and in these areas models of excellence used in business could prove valuable. Typically, conservation programs require years of effort and involve rigorous long-term implementation processes. Successful balance of long-term efforts alongside the achievement of short-term goals is often compromised by management or budgetary constraints, a situation also common in commercial businesses. "Business excellence" is an approach many companies have used over the past 20 years to ensure continued success. Various business excellence evaluations have been promoted that include concepts that could be adapted and applied in conservation programs. We describe a conservation excellence model that shows how scientific processes and results can be aligned with financial and organizational measures of success. We applied the model to two well-documented species conservation programs. In the first, the Po'ouli program, several aspects of improvement were identified, such as more authority for decision making in the field and better integration of habitat management and population recovery processes. The second example, the black-footed ferret program, could have benefited from leadership effort to reduce bureaucracy and to encourage use of best-practice species recovery approaches. The conservation excellence model enables greater clarity in goal setting, more-effective identification of job roles within programs, better links between technical approaches and measures of biological success, and more-effective use of resources. The model could improve evaluation of a conservation program's effectiveness and may be used to compare different programs, for example during reviews of project performance by sponsoring organizations. © 2010 Society for Conservation Biology.

Program management model study

NASA Technical Reports Server (NTRS)

Connelly, J. J.; Russell, J. E.; Seline, J. R.; Sumner, N. R., Jr.

1972-01-01

Two models, a system performance model and a program assessment model, have been developed to assist NASA management in the evaluation of development alternatives for the Earth Observations Program. Two computer models were developed and demonstrated on the Goddard Space Flight Center Computer Facility. Procedures have been outlined to guide the user of the models through specific evaluation processes, and the preparation of inputs describing earth observation needs and earth observation technology. These models are intended to assist NASA in increasing the effectiveness of the overall Earth Observation Program by providing a broader view of system and program development alternatives.

Program evaluation of an Integrated Basic Science Medical Curriculum in Shiraz Medical School, Using CIPP Evaluation Model

PubMed Central

ROOHOLAMINI, AZADEH; AMINI, MITRA; BAZRAFKAN, LEILA; DEHGHANI, MOHAMMAD REZA; ESMAEILZADEH, ZOHREH; NABEIEI, PARISA; REZAEE, RITA; KOJURI, JAVAD

2017-01-01

Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by stablishing the horizontal basic science integration model and Early Clinical Exposure (ECE) for undergraduate medical education. The purpose of this study was to provide the required data for the program evaluation of this curriculum for undergraduate medical students, using CIPP program evaluation model. Methods: This study is an analytic descriptive and triangulation mixed method study which was carried out in Shiraz Medical School in 2012, based on the views of professors of basic sciences courses and first and second year medical students. The study evaluated the quality of the relationship between basic sciences and clinical courses and the method of presenting such courses based on the Context, Input, Process and Product (CIPP) model. The tools for collecting data, both quantitatively and qualitatively, were some questionnaires, content analysis of portfolios, semi- structured interview and brain storming sessions. For quantitative data analysis, SPSS software, version 14, was used. Results: In the context evaluation by modified DREEM questionnaire, 77.75%of the students believed that this educational system encourages them to actively participate in classes. Course schedule and atmosphere of class were reported suitable by 87.81% and 83.86% of students. In input domain that was measured by a researcher made questionnaire, the facilities for education were acceptable except for shortage of cadavers. In process evaluation, the quality of integrated modules presentation and Early Clinical Exposure (ECE) was good from the students’ viewpoint. In product evaluation, students’ brain storming, students’ portfolio and semi-structured interview with faculties were done, showing some positive aspects of integration and some areas that need improvement. Conclusion: The main advantage of assessing an educational program based on CIPP evaluation model is that the context, input, process and product of the program are viewed and evaluated systematically. This will help the educational authorities to make proper decisions based on the weaknesses and strengths of the program on its continuation, cessation and revision. Based on the results of this study, the integrated basic sciences course for undergraduate medical students in Shiraz Medical School is at a desirable level. However, attempts to improve or reform some sections and continual evaluation of the program and its accreditation seem to be necessary. PMID:28761888

Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

NASA Astrophysics Data System (ADS)

Warburton, J.; Crowley, S.; Larson, A.

2012-12-01

PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

Biodesign process and culture to enable pediatric medical technology innovation.

PubMed

Wall, James; Wynne, Elizabeth; Krummel, Thomas

2015-06-01

Innovation is the process through which new scientific discoveries are developed and promoted from bench to bedside. In an effort to encourage young entrepreneurs in this area, Stanford Biodesign developed a medical device innovation training program focused on need-based innovation. The program focuses on teaching systematic evaluation of healthcare needs, invention, and concept development. This process can be applied to any field of medicine, including Pediatric Surgery. Similar training programs have gained traction throughout the United States and beyond. Equally important to process in the success of these programs is an institutional culture that supports transformative thinking. Key components of this culture include risk tolerance, patience, encouragement of creativity, management of conflict, and networking effects. Copyright © 2015 Elsevier Inc. All rights reserved.

Educational Program Audit Handbook. Revised.

ERIC Educational Resources Information Center

Cohen, Ruth I., Ed.; And Others

Our publics could be better served if verification of a program evaluation were made by an educational program auditor (EPA). The role of the EPA would be to enter the educational cycle after the objectives have been determined and before the programs and criterion measures have been adopted. The audit process would begin with the hiring of the…

Process and Outcomes Evaluation of an Even Start Program.

ERIC Educational Resources Information Center

Meehan, Merrill L.; Walsh, Sandra; Swisher, Angie; Spring, Janet; Lewis, Harry

The Even Start Family Literacy Program is a national program that addresses the literacy and educational needs of adults in eligible families, teaches effective parenting skills, and addresses the preschool readiness needs of young children in the family. The Monongalia County (West Virginia) Even Start Program was unusual in that it took place in…

Quality Indicators of Online Programs

ERIC Educational Resources Information Center

Hirner, Leo; Kochtanek, Thomas

2012-01-01

The continued growth of online programs in higher education has resulted in concerns about how institutions monitor the quality of their online programs. These concerns indicate a need for a process by which online programs may be evaluated and compared. They provided the impetus for this study, the goals of which were to identify quality…

A Healthy Lifestyle Program for Latino Daughters and Mothers: The BOUNCE Overview and Process Evaluation

ERIC Educational Resources Information Center

Olvera, Norma N.; Knox, Brook; Scherer, Rhonda; Maldonado, Gabriela; Sharma, Shreela V.; Alastuey, Lisa; Bush, Jill A.

2008-01-01

Background: Few family-based healthy lifestyle programs for Latinos have been conducted, especially family programs targeting mother-daughter dyads. Purpose: To assess the acceptability and feasibility of the Behavior Opportunities Uniting Nutrition Counseling and Exercise (BOUNCE) program designed for Latino mother-daughter pairs. Methods: 92…

Teaching Teachers through Distance Methods: An Evaluation of a Sri Lankan Programme. Education Division Document, No. 40.

ERIC Educational Resources Information Center

Dock, Alan W.; And Others

This report describes the development process of a distance education program in Sri Lanka run by the Institute of Distance Education for nongraduate teachers inservice, and presents results of the program's evaluation. Two teacher education courses--an elementary education course and a combined science/mathematics course--were offered. The…

The Effect of Persuasion on the Utilization of Program Evaluation Information: A Preliminary Study.

ERIC Educational Resources Information Center

Eason, Sandra H.; Thompson, Bruce

The utilization of program evaluation may be made more effective by means of the application of contemporary persuasion theory. The Elaboration Likelihood Model--a model of cognitive processing, ability, and motivation--was used in this study to test the persuasive effects of source credibility and involvement on message acceptance of evaluation…

Evaluation of a College Curriculum Advisory Program Utilizing Student Advisors. Final Report.

ERIC Educational Resources Information Center

Brown, Coke R.

This study was designed to evaluate the viability of using students as academic advisors for freshmen students and to document the process of the advising program at Idaho State University. Results show that students advised by students did as well academically and had a lower dropout rate than students advised by faculty. Descriptions of advisor…

Family Assessment/Treatment/Evaluation Methods Integrated for Helping Teen Suicide Attempters/Families in Short Term Psychiatric Hospitalization Programs.

ERIC Educational Resources Information Center

Shepard, Suzanne

The assessment process can be integrated with treatment and evaluation for helping teenage suicide attempters and families in short term psychiatric hospitalization programs. The method is an extremely efficient way for the therapist to work within a given time constraint. During family assessment sufficient information can be gathered to…

Participatory Action Research: Reflections on Critical Incidents in a PAR Project.

ERIC Educational Resources Information Center

Santelli, Betsy; Singer, George H. S.; DiVenere, Nancy; Ginsberg, Connie; Powers, Laurie E.

1998-01-01

This article describes a participatory action research (PAR) project designed to evaluate Parent to Parent programs in five states. The process of developing a shared understanding of the program and of the purpose for evaluating them, along with an on-going willingness of parents and researchers to compromise, led to creative solutions to…

Sensitizing Children to the Social and Emotional Mechanisms Involved in Racism: A Program Evaluation

ERIC Educational Resources Information Center

Triliva, Sofia; Anagnostopoulou, Tanya; Vleioras, Georgios

2014-01-01

This paper describes and discusses the results of an intervention aiming to sensitize children to the social and emotional processes involved in racism. The intervention was applied and evaluated in 10 Greek elementary schools. The goals and the intervention methods of the program modules are briefly outlined and the results of the program…

Creating a Culture of Safety Around Bar-Code Medication Administration: An Evidence-Based Evaluation Framework.

PubMed

Kelly, Kandace; Harrington, Linda; Matos, Pat; Turner, Barbara; Johnson, Constance

2016-01-01

Bar-code medication administration (BCMA) effectiveness is contingent upon compliance with best-practice protocols. We developed a 4-phased BCMA evaluation program to evaluate the degree of integration of current evidence into BCMA policies, procedures, and practices; identify barriers to best-practice BCMA use; and modify BCMA practice in concert with changes to the practice environment. This program provides an infrastructure for frontline nurses to partner with hospital leaders to continually evaluate and improve BCMA using a systematic process.

Federal Workplace Literacy Project. Internal Evaluation Report.

ERIC Educational Resources Information Center

Matuszak, David J.

This report describes the following components of the Nestle Workplace Literacy Project: six job task analyses, curricula for six workplace basic skills training programs, delivery of courses using these curricula, and evaluation of the process. These six job categories were targeted for training: forklift loader/checker, BB's processing systems…

XPERT DESIGN AND DIAGNOSTICS' (XDD) IN-SITU CHEMICAL OXIDATION PROCESS USING POTASSIUM PERMANGANATE (KMNO4)

EPA Science Inventory

Xpert Design and Diagnostic's (XDD)potassium permanganate in situ chemical oxidation (ISCO) process was evaluated under the EPA Superfund Innovative Technology Evaluation (SITE) Program at the former MEC Building site located in Hudson, New Hampshire. At this site, both soil and ...

EPA SITE DEMONSTRATION OF THE TERRA VAC IN SITU VACUUM EXTRACTION PROCESS IN GROVELAND, MASSACHUSETTS

EPA Science Inventory

This paper presents an EPA evaluation of the patented Terra Vac, Inc.'s in situ vacuum extraction process that was field-demonstrated on a trichloroethylene (TCE) contaminated soil in Groveland, MA, under the EPA Superfund Innovative Technology Evaluation (SITE) program. he Terra...

A semi-automated tool for treatment plan-quality evaluation and clinical trial quality assurance

NASA Astrophysics Data System (ADS)

Wang, Jiazhou; Chen, Wenzhou; Studenski, Matthew; Cui, Yunfeng; Lee, Andrew J.; Xiao, Ying

2013-07-01

The goal of this work is to develop a plan-quality evaluation program for clinical routine and multi-institutional clinical trials so that the overall evaluation efficiency is improved. In multi-institutional clinical trials evaluating the plan quality is a time-consuming and labor-intensive process. In this note, we present a semi-automated plan-quality evaluation program which combines MIMVista, Java/MATLAB, and extensible markup language (XML). More specifically, MIMVista is used for data visualization; Java and its powerful function library are implemented for calculating dosimetry parameters; and to improve the clarity of the index definitions, XML is applied. The accuracy and the efficiency of the program were evaluated by comparing the results of the program with the manually recorded results in two RTOG trials. A slight difference of about 0.2% in volume or 0.6 Gy in dose between the semi-automated program and manual recording was observed. According to the criteria of indices, there are minimal differences between the two methods. The evaluation time is reduced from 10-20 min to 2 min by applying the semi-automated plan-quality evaluation program.

PORTABLE LISP; a list-processing interpreter. [CDC7600; PASCAL

DOE Office of Scientific and Technical Information (OSTI.GOV)

Taylor, W.P.

The program constitutes a complete, basic LISP (LIST-Processing language) interpreter. LISP expressions are evaluated one by one with both the input expression and the resulting evaluated expression printed. Expressions are evaluated until a FIN card is encountered. Between expression evaluations a garbage-collection algorithm is invoked to recover list space used in the previous evaluation.CDC7600; PASCAL; SCOPE; The sample problem was executed in 7000 (octal) words of memory on a CDC7600.

Buckle up safely (shoalhaven): a process and impact evaluation of a pragmatic, multifaceted preschool-based pilot program to increase correct use of age-appropriate child restraints.

PubMed

Hunter, Kate; Keay, Lisa; Clapham, Kathleen; Lyford, Marilyn; Brown, Julie; Bilston, Lynne; Simpson, Judy M; Stevenson, Mark; Ivers, Rebecca Q

2014-01-01

To conduct a process and impact evaluation of a multifaceted education-based pilot program targeting correct use of age-appropriate restraints in a regional setting with a high proportion of Aboriginal and Torres Strait Islander families. The program was delivered in 2010 in 3 early learning centers where 31 percent of the children were of Aboriginal and Torres Strait Islander descent. Each component of the program was assessed for message consistency and uptake. To measure program effectiveness, participating children were matched 1:1 by age, language spoken at home, and annual household income with 71 children from the control arm of a contemporaneous trial. The outcome measure in the control and program centers (a 4-category ordinal scale of restraint use) was compared using ordinal logistic regression accounting for age of the parent. Process evaluation found that though program components were delivered with a consistency of message, uptake was affected by turnover of all staff at one center and by parents experiencing difficulty in paying for subsidized restraints at each of the centers. Impact evaluation found that children from the centers receiving the program had nearly twice the odds of being in a better restraint category than children matched from the control group (adjusted odds ratio [ORadj] = 2.06, 95% confidence interval [CI], 1.09-3.90). This was a pragmatic study reflecting the real-life issues of implementing a program in preschools where 57 percent of families had a low income and turnover of staff was high. Despite these issues, impact evaluation showed that the integrated educational program showed promise in increasing correct use of age-appropriate restraints. The findings from this pilot study support the use of an integrated educational program that includes access to subsidized restraints to promote best practice child restraint use among communities that include a high proportion of Aboriginal and Torres Strait Islander families in New South Wales. Future trials in similar settings should consider offering more support in centers with high turnover of staff and offering alternative methods of payment when families experience financial difficulties in purchasing the subsidized restraints. If proven in larger trials, this approach could reduce death and injuries in child passengers in this vulnerable group.

Evaluation as a critical factor of success in local public health accreditation programs.

PubMed

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Satellite Power System (SPS) FY 79 program summary

NASA Technical Reports Server (NTRS)

1980-01-01

The Satellite Power System (SPS) program a joint effort to develop an initial understanding of the technical feasibility, the economic practicality, and the social and environmental acceptability of the SPS concept is discussed. This is being accomplished through implementation of the Concept Development and Evaluation Program Plan which is scheduled for completion by the end of FY 1980. This Program Summary not only covers FY 1979 but includes work completed in FY 1977 and FY 1978 in order to give a comprehensive picture of the DOE involvement in the SPS concept development and evaluation process.

Computer program determines performance efficiency of remote measuring systems

NASA Technical Reports Server (NTRS)

Merewether, E. K.

1966-01-01

Computer programs control and evaluate instrumentation system performance for numerous rocket engine test facilities and prescribe calibration and maintenance techniques to maintain the systems within process specifications. Similar programs can be written for other test equipment in an industry such as the petrochemical industry.

[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].

PubMed

Nagahama, Elizabeth Eriko Ishida

2009-01-01

The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.

DECISION-MAKING ALIGNED WITH RAPID-CYCLE EVALUATION IN HEALTH CARE.

PubMed

Schneeweiss, Sebastian; Shrank, William H; Ruhl, Michael; Maclure, Malcolm

2015-01-01

Availability of real-time electronic healthcare data provides new opportunities for rapid-cycle evaluation (RCE) of health technologies, including healthcare delivery and payment programs. We aim to align decision-making processes with stages of RCE to optimize the usefulness and impact of rapid results. Rational decisions about program adoption depend on program effect size in relation to externalities, including implementation cost, sustainability, and likelihood of broad adoption. Drawing on case studies and experience from drug safety monitoring, we examine how decision makers have used scientific evidence on complex interventions in the past. We clarify how RCE alters the nature of policy decisions; develop the RAPID framework for synchronizing decision-maker activities with stages of RCE; and provide guidelines on evidence thresholds for incremental decision-making. In contrast to traditional evaluations, RCE provides early evidence on effectiveness and facilitates a stepped approach to decision making in expectation of future regularly updated evidence. RCE allows for identification of trends in adjusted effect size. It supports adapting a program in midstream in response to interim findings, or adapting the evaluation strategy to identify true improvements earlier. The 5-step RAPID approach that utilizes the cumulating evidence of program effectiveness over time could increase policy-makers' confidence in expediting decisions. RCE enables a step-wise approach to HTA decision-making, based on gradually emerging evidence, reducing delays in decision-making processes after traditional one-time evaluations.

Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program.

PubMed

van Holland, Berry J; de Boer, Michiel R; Brouwer, Sandra; Soer, Remko; Reneman, Michiel F

2012-11-20

Sustained employability and health are generating awareness of employers in an aging and more complex work force. To meet these needs, employers may offer their employees health surveillance programs, to increase opportunities to work on health and sustained employability. However, evidence for these health surveillance programs is lacking. The FLESH study (Functional Labour Evaluation for Sustained Health and employment) was developed to evaluate a comprehensive workers' health promotion program on its effectiveness, cost-benefit, and process of the intervention. The study is designed as a cluster randomised stepped wedge trial with randomisation at company plant level and is carried out in a large meat processing company. Every contracted employee is offered the opportunity to participate in the POSE program (Promotion Of Sustained Employability). The main goals of the POSE program are 1) providing employee's insight into their current employability and health status, 2) offering opportunities to improve employability and decrease health risks and 3) improving employability and health sustainably in order to keep them healthy at work. The program consists of a broad assessment followed by a counselling session and, if needed, a tailored intervention. Measurements will be performed at baseline and will be followed up at 20, 40, 60, 80, 106 and 132 weeks. The primary outcome measures are work ability, productivity and absenteeism. Secondary outcomes include health status, vitality, and psychosocial workload. A cost-benefit study will be conducted from the employers' perspective. A process evaluation will be conducted and the satisfaction of employer and employees with the program will be assessed. This study provides information on the effectiveness of the POSE program on sustained employment. When the program proves to be effective, employees benefit by improved work ability, and health. Employers benefit from healthier employees, reduced sick leave (costs) and higher productivity. The study can expose key elements for a successful implementation and execution of the POSE program and may serve as an example to other companies inside and outside the industry. The trial is registered at the Dutch Trial Register (http://www.trialregister.nl): NTR3445.

Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program

PubMed Central

2012-01-01

Background Sustained employability and health are generating awareness of employers in an aging and more complex work force. To meet these needs, employers may offer their employees health surveillance programs, to increase opportunities to work on health and sustained employability. However, evidence for these health surveillance programs is lacking. The FLESH study (Functional Labour Evaluation for Sustained Health and employment) was developed to evaluate a comprehensive workers’ health promotion program on its effectiveness, cost-benefit, and process of the intervention. Methods The study is designed as a cluster randomised stepped wedge trial with randomisation at company plant level and is carried out in a large meat processing company. Every contracted employee is offered the opportunity to participate in the POSE program (Promotion Of Sustained Employability). The main goals of the POSE program are 1) providing employee’s insight into their current employability and health status, 2) offering opportunities to improve employability and decrease health risks and 3) improving employability and health sustainably in order to keep them healthy at work. The program consists of a broad assessment followed by a counselling session and, if needed, a tailored intervention. Measurements will be performed at baseline and will be followed up at 20, 40, 60, 80, 106 and 132 weeks. The primary outcome measures are work ability, productivity and absenteeism. Secondary outcomes include health status, vitality, and psychosocial workload. A cost-benefit study will be conducted from the employers’ perspective. A process evaluation will be conducted and the satisfaction of employer and employees with the program will be assessed. Discussion This study provides information on the effectiveness of the POSE program on sustained employment. When the program proves to be effective, employees benefit by improved work ability, and health. Employers benefit from healthier employees, reduced sick leave (costs) and higher productivity. The study can expose key elements for a successful implementation and execution of the POSE program and may serve as an example to other companies inside and outside the industry. Trial registration The trial is registered at the Dutch Trial Register (http://www.trialregister.nl): NTR3445 PMID:23164366

Education of Music Teachers: A Study of the Brazilian Higher Education Programs

ERIC Educational Resources Information Center

Mateiro, Teresa

2011-01-01

With reference to educational policies in the globalization process, the purpose of this article is to show the status of higher Music Teacher Education Programs in Brazil after the enactment of the "Directives and Bases Act No. 9.394", in 1996. This law emphasizes the evaluation process for higher education, including teaching quality…

Evaluation of radiological dispersion/consequence codes supporting DOE nuclear facility SARs

DOE Office of Scientific and Technical Information (OSTI.GOV)

O`Kula, K.R.; Paik, I.K.; Chung, D.Y.

1996-12-31

Since the early 1990s, the authorization basis documentation of many U.S. Department of Energy (DOE) nuclear facilities has been upgraded to comply with DOE orders and standards. In this process, many safety analyses have been revised. Unfortunately, there has been nonuniform application of software, and the most appropriate computer and engineering methodologies often are not applied. A DOE Accident Phenomenology and Consequence (APAC) Methodology Evaluation Program was originated at the request of DOE Defense Programs to evaluate the safety analysis methodologies used in nuclear facility authorization basis documentation and to define future cost-effective support and development initiatives. Six areas, includingmore » source term development (fire, spills, and explosion analysis), in-facility transport, and dispersion/ consequence analysis (chemical and radiological) are contained in the APAC program. The evaluation process, codes considered, key results, and recommendations for future model and software development of the Radiological Dispersion/Consequence Working Group are summarized in this paper.« less

Ongoing quality control in digital radiography: Report of AAPM Imaging Physics Committee Task Group 151.

PubMed

Jones, A Kyle; Heintz, Philip; Geiser, William; Goldman, Lee; Jerjian, Khachig; Martin, Melissa; Peck, Donald; Pfeiffer, Douglas; Ranger, Nicole; Yorkston, John

2015-11-01

Quality control (QC) in medical imaging is an ongoing process and not just a series of infrequent evaluations of medical imaging equipment. The QC process involves designing and implementing a QC program, collecting and analyzing data, investigating results that are outside the acceptance levels for the QC program, and taking corrective action to bring these results back to an acceptable level. The QC process involves key personnel in the imaging department, including the radiologist, radiologic technologist, and the qualified medical physicist (QMP). The QMP performs detailed equipment evaluations and helps with oversight of the QC program, the radiologic technologist is responsible for the day-to-day operation of the QC program. The continued need for ongoing QC in digital radiography has been highlighted in the scientific literature. The charge of this task group was to recommend consistency tests designed to be performed by a medical physicist or a radiologic technologist under the direction of a medical physicist to identify problems with an imaging system that need further evaluation by a medical physicist, including a fault tree to define actions that need to be taken when certain fault conditions are identified. The focus of this final report is the ongoing QC process, including rejected image analysis, exposure analysis, and artifact identification. These QC tasks are vital for the optimal operation of a department performing digital radiography.

Ongoing quality control in digital radiography: Report of AAPM Imaging Physics Committee Task Group 151

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jones, A. Kyle, E-mail: kyle.jones@mdanderson.org; Geiser, William; Heintz, Philip

Quality control (QC) in medical imaging is an ongoing process and not just a series of infrequent evaluations of medical imaging equipment. The QC process involves designing and implementing a QC program, collecting and analyzing data, investigating results that are outside the acceptance levels for the QC program, and taking corrective action to bring these results back to an acceptable level. The QC process involves key personnel in the imaging department, including the radiologist, radiologic technologist, and the qualified medical physicist (QMP). The QMP performs detailed equipment evaluations and helps with oversight of the QC program, the radiologic technologist ismore » responsible for the day-to-day operation of the QC program. The continued need for ongoing QC in digital radiography has been highlighted in the scientific literature. The charge of this task group was to recommend consistency tests designed to be performed by a medical physicist or a radiologic technologist under the direction of a medical physicist to identify problems with an imaging system that need further evaluation by a medical physicist, including a fault tree to define actions that need to be taken when certain fault conditions are identified. The focus of this final report is the ongoing QC process, including rejected image analysis, exposure analysis, and artifact identification. These QC tasks are vital for the optimal operation of a department performing digital radiography.« less

Evaluation of pressurized water cleaning systems for hardware refurbishment

NASA Technical Reports Server (NTRS)

Dillard, Terry W.; Deweese, Charles D.; Hoppe, David T.; Vickers, John H.; Swenson, Gary J.; Hutchens, Dale E.

1995-01-01

Historically, refurbishment processes for RSRM motor cases and components have employed environmentally harmful materials. Specifically, vapor degreasing processes consume and emit large amounts of ozone depleting compounds. This program evaluates the use of pressurized water cleaning systems as a replacement for the vapor degreasing process. Tests have been conducted to determine if high pressure water washing, without any form of additive cleaner, is a viable candidate for replacing vapor degreasing processes. This paper discusses the findings thus far of Engineering Test Plan - 1168 (ETP-1168), 'Evaluation of Pressurized Water Cleaning Systems for Hardware Refurbishment.'

Evaluate Yourself. Evaluation: Research-Based Decision Making Series, Number 9304.

ERIC Educational Resources Information Center

Fetterman, David M.

This document considers both self-examination and external evaluation of gifted and talented education programs. Principles of the self-examination process are offered, noting similarities to external evaluation models. Principles of self-evaluation efforts include the importance of maintaining a nonjudgmental orientation, soliciting views from…

Meta-Evaluation Applied To Results Of ITS Initiatives

DOT National Transportation Integrated Search

1995-04-01

META-EVALUATION : META-EVALUATION IS A PROCESS TO BE USED FOR THE COMPARISON OF RESULTS ACROSS INTELLIGENT TRANSPORTATION SYSTEMS (ITS). OPERATIONAL TESTS, A COMPONENT OF THE ITS PROGRAM ADMINISTERED BY THE FEDERAL HIGHWAY ADMINISTRATION (FHWA), A...

The Evaluation Process: The Place to Start Is with the Groundwork

ERIC Educational Resources Information Center

Wood, George S., Jr.

1975-01-01

Stresses the importance of careful planning prior to the beginning of an evaluation effort and discusses a number of basic questions that a community educator should consider in planning any evaluation program. (JG)

Radar target classification studies: Software development and documentation

NASA Astrophysics Data System (ADS)

Kamis, A.; Garber, F.; Walton, E.

1985-09-01

Three computer programs were developed to process and analyze calibrated radar returns. The first program, called DATABASE, was developed to create and manage a random accessed data base. The second program, called FTRAN DB, was developed to process horizontal and vertical polarizations radar returns into different formats (i.e., time domain, circular polarizations and polarization parameters). The third program, called RSSE, was developed to simulate a variety of radar systems and to evaluate their ability to identify radar returns. Complete computer listings are included in the appendix volumes.

Development of a cervical cancer educational program for Chinese women using intervention mapping.

PubMed

Hou, Su-I; Fernandez, Maria E; Parcel, Guy S

2004-01-01

This article describes the development of a program to increase Pap screening behavior among women in Taiwan. Intervention mapping, an innovative process of intervention design, guided the development of this program. The development process included a needs assessment identifying factors influencing Pap screening behavior relevant to Chinese women. The program used methods such as information transmission, modeling, persuasion, and facilitation. Strategies included direct mail communication, role-model stories and testimonials, and a telephone-counseling component. The delineation of specific plans for implementation and evaluation are also described.

Evaluation of a case-based urology learning program.

PubMed

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Evaluation Procedures in the Charlotte-Mecklenburg Career Ladder Plan.

ERIC Educational Resources Information Center

Schlechty, Phillip C.

1985-01-01

Describes faculty evaluation procedures used in the Charlotte-Mecklenburg (North Carolina) Public Schools in conjunction with career development. Covers the program's philosophy, purposes, and special characteristics; expectations set and competencies sought; the areas evaluation; evaluator characteristics; the observation process; teachers'…

Test implementation of a school-oriented drug prevention program "Study without Drugs": pre- and post-testing for effectiveness.

PubMed

Ishaak, Fariel; de Vries, Nanne Karel; van der Wolf, Kees

2014-06-11

In this article, the test implementation of a school-oriented drug prevention program "Study without Drugs" is discussed. The aims of this study were to determine the results of the process evaluation and to determine whether the proposed school-oriented drug prevention program during a pilot project was effective for the participating pupils. Sixty second-grade pupils at a junior high school in Paramaribo, Suriname participated in the test implementation. They were divided into two classes. For the process evaluation the students completed a structured questionnaire focusing on content and teaching method after every lesson. Lessons were qualified with a score from 0-10. The process was also evaluated by the teachers through structured interviews. Attention was paid to reach, dose delivered, dose received, fidelity, connection, achieved effects/observed behaviors, areas for improvement, and lesson strengths. The effect evaluation was conducted by using the General Liniair Model (repeated measure). The research (-design) was a pre-experimental design with pre-and post-test. No class or sex differences were detected among the pupils with regard to the assessment of content, methodology, and qualification of the lessons. Post-testing showed that participating pupils obtained an increased knowledge of drugs, their drug-resisting skills were enhanced, and behavior determinants (attitude, subjective norm, self-efficacy, and intention) became more negative towards drugs. From the results of the test implementation can be cautiously concluded that the program "Study without Drugs" may yield positive results when applied in schools). Thus, this pilot program can be considered a step towards the development and implementation of an evidence-based school-oriented program for pupils in Suriname.

Test implementation of a school-oriented drug prevention program “Study without Drugs”: pre- and post-testing for effectiveness

PubMed Central

2014-01-01

Background In this article, the test implementation of a school-oriented drug prevention program “Study without Drugs” is discussed. The aims of this study were to determine the results of the process evaluation and to determine whether the proposed school-oriented drug prevention program during a pilot project was effective for the participating pupils. Methods Sixty second-grade pupils at a junior high school in Paramaribo, Suriname participated in the test implementation. They were divided into two classes. For the process evaluation the students completed a structured questionnaire focusing on content and teaching method after every lesson. Lessons were qualified with a score from 0–10. The process was also evaluated by the teachers through structured interviews. Attention was paid to reach, dose delivered, dose received, fidelity, connection, achieved effects/observed behaviors, areas for improvement, and lesson strengths. The effect evaluation was conducted by using the General Liniair Model (repeated measure). The research (-design) was a pre-experimental design with pre-and post-test. Results No class or sex differences were detected among the pupils with regard to the assessment of content, methodology, and qualification of the lessons. Post-testing showed that participating pupils obtained an increased knowledge of drugs, their drug-resisting skills were enhanced, and behavior determinants (attitude, subjective norm, self-efficacy, and intention) became more negative towards drugs. Conclusions From the results of the test implementation can be cautiously concluded that the program “Study without Drugs” may yield positive results when applied in schools). Thus, this pilot program can be considered a step towards the development and implementation of an evidence-based school-oriented program for pupils in Suriname. PMID:24920468

Effects of a Community-Based, Post-Rehabilitation Exercise Program in COPD: Protocol for a Randomized Controlled Trial With Embedded Process Evaluation.

PubMed

Desveaux, Laura; Beauchamp, Marla K; Lee, Annemarie; Ivers, Noah; Goldstein, Roger; Brooks, Dina

2016-05-11

This manuscript (1) outlines the intervention, (2) describes how its effectiveness is being evaluated in a pragmatic randomized controlled trial, and (3) summarizes the embedded process evaluation aiming to understand key barriers and facilitators for implementation in new environments. Participating centers refer eligible individuals with COPD following discharge from their local PR program. Consenting patients are assigned to a year-long community exercise program or usual care using block randomization and stratifying for supplemental oxygen use. Patients in the intervention arm are asked to attend an exercise session at least twice per week at their local community facility where their progress is supervised by a case manager. Each exercise session includes a component of aerobic exercise, and activities designed to optimize balance, flexibility, and strength. All study participants will have access to routine follow-up appointments with their respiratory physician, and additional health care providers as part of their usual care. Assessments will be completed at baseline (post-PR), 6, and 12 months, and include measures of functional exercise capacity, quality of life, self-efficacy, and health care usage. Intervention effectiveness will be assessed by comparing functional exercise capacity between intervention and control groups. A mixed-methods process evaluation will be conducted to better understand intervention implementation, guided by Normalization Process Theory and the Consolidated Framework for Implementation Research. Based on results from our pilot work, we anticipate a maintenance of exercise capacity and improved health-related quality of life in the intervention group, compared with a decline in exercise capacity in the usual care group. Findings from this study will improve our understanding of the effectiveness of community-based exercise programs for maintaining benefits following PR in patients with COPD and provide information on how best to implement them. If effective, the intervention represents an opportunity to transition patients from institutionally-based rehabilitative management to community-based care. The results of the process evaluation will contribute to the science of translating evidence-based programs into regular practice.

A Verification Method of Inter-Task Cooperation in Embedded Real-time Systems and its Evaluation

NASA Astrophysics Data System (ADS)

Yoshida, Toshio

In software development process of embedded real-time systems, the design of the task cooperation process is very important. The cooperating process of such tasks is specified by task cooperation patterns. Adoption of unsuitable task cooperation patterns has fatal influence on system performance, quality, and extendibility. In order to prevent repetitive work caused by the shortage of task cooperation performance, it is necessary to verify task cooperation patterns in an early software development stage. However, it is very difficult to verify task cooperation patterns in an early software developing stage where task program codes are not completed yet. Therefore, we propose a verification method using task skeleton program codes and a real-time kernel that has a function of recording all events during software execution such as system calls issued by task program codes, external interrupts, and timer interrupt. In order to evaluate the proposed verification method, we applied it to the software development process of a mechatronics control system.

A Problem Based Learning Project Analyzing Rubrics Used to Evaluate Elementary STEM Immersion Programs

NASA Astrophysics Data System (ADS)

Pearson, Roxanne N.

In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.

The Role of the School Nurse in the Special Education Process: Part 2: Eligibility Determination and the Individualized Education Program.

PubMed

Shannon, Robin Adair; Yonkaitis, Catherine Falusi

2017-07-01

This is the second of two articles outlining the professional school nurse's role in the special education process for students with disabilities. The Individuals with Disabilities in Education Improvement Act of 2004 mandates the special education process: identification, full and individual evaluation, eligibility determination, and development of the individual education program (IEP), including special education placement. Part 1 focused on the importance of the school nurse's role in student identification, response to intervention, and the full and individual evaluation. Part 2 highlights the school nurse's vital and unique contribution to the subsequent special education steps of eligibility determination, IEP development, and special education services placement and minutes.

Conceptual Soundness, Metric Development, Benchmarking, and Targeting for PATH Subprogram Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mosey. G.; Doris, E.; Coggeshall, C.

The objective of this study is to evaluate the conceptual soundness of the U.S. Department of Housing and Urban Development (HUD) Partnership for Advancing Technology in Housing (PATH) program's revised goals and establish and apply a framework to identify and recommend metrics that are the most useful for measuring PATH's progress. This report provides an evaluative review of PATH's revised goals, outlines a structured method for identifying and selecting metrics, proposes metrics and benchmarks for a sampling of individual PATH programs, and discusses other metrics that potentially could be developed that may add value to the evaluation process. The frameworkmore » and individual program metrics can be used for ongoing management improvement efforts and to inform broader program-level metrics for government reporting requirements.« less

Aid effectiveness and programmatic effectiveness: a proposed framework for comparative evaluation of different aid interventions in a particular health system.

PubMed

Haque, Hasibul; Hill, Philip C; Gauld, Robin

2017-01-01

Against a backdrop of changing concepts of aid effectiveness, development effectiveness, health systems strengthening, and increasing emphasis on impact evaluation, this article proposes a theory-driven impact evaluation framework to gauge the effect of aid effectiveness principles on programmatic outcomes of different aid funded programs in the health sector of a particular country. The foundation and step-by-step process of implementing the framework are described. With empirical evidence from the field, the steps involve analysis of context, program designs, implementation mechanisms, outcomes, synthesis, and interpretation of findings through the programs' underlying program theories and interactions with the state context and health system. The framework can be useful for comparatively evaluating different aid interventions both in fragile and non-fragile state contexts.

An Online Tailored Self-Management Program for Patients With Rheumatoid Arthritis: A Developmental Study.

PubMed

Zuidema, Rixt M; van Gaal, Betsie Gi; van Dulmen, Sandra; Repping-Wuts, Han; Schoonhoven, Lisette

2015-12-25

Every day rheumatoid arthritis (RA) patients make many decisions about managing their disease. An online, computer-tailored, self-management program can support this decision making, but development of such a program requires the active participation of patients. To develop an online, computer-tailored, self-management program integrated with the nursing care, as nurses have an important role in supporting self-management behavior. The intervention mapping framework was used to develop the program. Development was a multistep process: (1) needs assessment; (2) developing program and change objectives in a matrix; (3) selecting theory-based intervention methods and practical application strategies; (4) producing program components; (5) planning and adoption, implementation, and sustainability; and (6) planning for evaluation. After conducting the needs assessment (step 1), nine health-related problems were identified: (1) balancing rest and activity, (2) setting boundaries, (3) asking for help and support, (4) use of medicines, (5) communicating with health professionals, (6) use of assistive devices, (7) performing physical exercises, (8) coping with worries, and (9) coping with RA. After defining performance and change objectives (step 2), we identified a number of methods which could be used to achieve them (step 3), such as provision of general information about health-related behavior, self-monitoring of behavior, persuasive communication, modeling, and self-persuasion and tailoring. We described and operationalized these methods in texts, videos, exercises, and a medication intake schedule. The resulting program (step 4) consisted of an introduction module and nine modules dealing with health-related problems. The content of these modules is tailored to the user's self-efficacy, and patients can use the online program as often as they want, working through a module or modules at their own speed. After implementation (step 5), the program will be evaluated in a two-center pilot trial involving 200 RA patients. Log-in data and qualitative interviews will used for a process evaluation. The intervention mapping framework was used to guide development of an online computer-tailored self-management program via a process which could serve as a model for the development of other interventions. A pilot randomized controlled trial (RCT) will provide insight into the important outcome measures in preparation for a larger RCT. The process evaluation will provide insight into how RA patients use the program and the attrition rate. Netherlands Trial Register (NTR): NTR4871; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4871 [accessed 13-NOV-15] http://www.webcitation.org/6d1ZyIoEy.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnson, Gary E.; Diefenderfer, Heida L.; Ebberts, Blaine D.

The purpose ofthis document is to describe research, monitoring, and evaluation (RME) for the Federal Columbia River Estuary Program. The intent of this RME effort is to provide data and information to evaluate progress toward meeting program goals and objectives and support decision-making in the Estuary Program. The goal of the Estuary Program is to understand, conserve, and restore the estuary ecosystem to improve the performance of listed salmonid populations. The Estuary Program has five general objectives, designed to fulfill the program goal, as follows. 1. Understand the primary stressors affecting ecosystem controlling factors, such as ocean conditions and invasivemore » species. 2. Conserve and restore factors controlling ecosystem structures and processes, such as hydrodynamics and water quality. 3. Increase the quantity and quality of ecosystem structures, i.e., habitats, juvenile salmonids use during migration through the estuary. 4. Maintain the food web to benefit salmonid performance. 5. Improve salmonid performance in terms of life history diversity, foraging success, growth, and survival. The goal of estuary RME is to provide pertinent and timely research and monitoring information to planners, implementers, and managers of the Estuary Program. In conclusion, the estuary RME effort is designed to meet the research and monitoring needs of the estuary Program using an adaptive management process. Estuary RME's success and usefulness will depend on the actual conduct of adaptive management, as embodied in the objectives, implrementation, data, reporting, and synthesis, evaluation, and decision-making described herein.« less

Orthorectification by Using Gpgpu Method

NASA Astrophysics Data System (ADS)

Sahin, H.; Kulur, S.

2012-07-01

Thanks to the nature of the graphics processing, the newly released products offer highly parallel processing units with high-memory bandwidth and computational power of more than teraflops per second. The modern GPUs are not only powerful graphic engines but also they are high level parallel programmable processors with very fast computing capabilities and high-memory bandwidth speed compared to central processing units (CPU). Data-parallel computations can be shortly described as mapping data elements to parallel processing threads. The rapid development of GPUs programmability and capabilities attracted the attentions of researchers dealing with complex problems which need high level calculations. This interest has revealed the concepts of "General Purpose Computation on Graphics Processing Units (GPGPU)" and "stream processing". The graphic processors are powerful hardware which is really cheap and affordable. So the graphic processors became an alternative to computer processors. The graphic chips which were standard application hardware have been transformed into modern, powerful and programmable processors to meet the overall needs. Especially in recent years, the phenomenon of the usage of graphics processing units in general purpose computation has led the researchers and developers to this point. The biggest problem is that the graphics processing units use different programming models unlike current programming methods. Therefore, an efficient GPU programming requires re-coding of the current program algorithm by considering the limitations and the structure of the graphics hardware. Currently, multi-core processors can not be programmed by using traditional programming methods. Event procedure programming method can not be used for programming the multi-core processors. GPUs are especially effective in finding solution for repetition of the computing steps for many data elements when high accuracy is needed. Thus, it provides the computing process more quickly and accurately. Compared to the GPUs, CPUs which perform just one computing in a time according to the flow control are slower in performance. This structure can be evaluated for various applications of computer technology. In this study covers how general purpose parallel programming and computational power of the GPUs can be used in photogrammetric applications especially direct georeferencing. The direct georeferencing algorithm is coded by using GPGPU method and CUDA (Compute Unified Device Architecture) programming language. Results provided by this method were compared with the traditional CPU programming. In the other application the projective rectification is coded by using GPGPU method and CUDA programming language. Sample images of various sizes, as compared to the results of the program were evaluated. GPGPU method can be used especially in repetition of same computations on highly dense data, thus finding the solution quickly.

Issues in NASA Program and Project Management. Special Edition: A Collection of Papers on NASA Procedures and Guidance 7120.5A. Volume 14

NASA Technical Reports Server (NTRS)

Hoffman, Edward J. (Editor); Lawbaugh, William M. (Editor)

1998-01-01

A key aspect of NASA's new Strategic Management System is improving the way we plan, approve, execute and evaluate our programs and projects. To this end, NASA has developed the NASA Program and Project Management processes and Requirements-NASA Procedures and Guidelines (NPG) 7120.5A, which formally documents the "Provide Aerospace Products and Capabilities" crosscutting process, and defines the processes and requirements that are responsive to the Program/Project Management-NPD 7120.4A. The Program/Project Management-NPD 7120.4A, issued November 14, 1996, provides the policy for managing programs and projects in a new way that is aligned with the new NASA environment. An Agencywide team has spent thousands of hours developing the NASA Program and Project Management Processes and Requirements-NPG 7120.5A. We have created significant flexibility, authority and discretion for the program and project managers to exercise and carry out their duties, and have delegated the responsibility and the accountability for their programs and projects.

Monitoring of health care personnel employee and occupational health immunization program practices in the United States.

PubMed

Carrico, Ruth M; Sorrells, Nikka; Westhusing, Kelly; Wiemken, Timothy

2014-01-01

Recent studies have identified concerns with various elements of health care personnel immunization programs, including the handling and management of the vaccine. The purpose of this study was to assess monitoring processes that support evaluation of the care of vaccines in health care settings. An 11-question survey instrument was developed for use in scripted telephone surveys. State health departments in all 50 states in the United States and the District of Columbia were the target audience for the surveys. Data from a total of 47 states were obtained and analyzed. No states reported an existing monitoring process for evaluation of health care personnel immunization programs in their states. Our assessment indicates that vaccine evaluation processes for health care facilities are rare to nonexistent in the United States. Identifying existing practice gaps and resultant opportunities for improvements may be an important safety initiative that protects patients and health care personnel. Copyright © 2014 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

Developing and Implementing a Counselor Evaluation Program.

ERIC Educational Resources Information Center

Bell, Priscilla J.; Acker, Kathleen E.

In the past several years, Tacoma Community College (TCC) has devoted increasing attention to evaluating faculty and staff performance. In recognition of the benefits of a growth-oriented evaluation process over a summative evaluation, the counselors and the Dean for Student Services at TCC developed a comprehensive evaluation system for…

Development of an existential support training program for healthcare professionals.

PubMed

Henoch, Ingela; Strang, Susann; Browall, Maria; Danielson, Ella; Melin-Johansson, Christina

2015-12-01

Our aim was to describe the developmental process of a training program for nurses to communicate existential issues with severely ill patients. The Medical Research Council (MRC) framework for the development and evaluation of complex interventions was used to develop a training program for nurses to communicate about existential issues with their patients. The steps in the framework were employed to describe the development of the training intervention, and the development, feasibility and piloting, evaluation, and implementation phases. The development and feasibility phases are described in the Methods section. The evaluation and implementation phases are described in the Results section. In the evaluation phase, the effectiveness of the intervention was shown as nurses' confidence in communication increased after training. The understanding of the change process was considered to be that the nurses could describe their way of communicating in terms of prerequisites, process, and content. Some efforts have been made to implement the training intervention, but these require further elaboration. Existential and spiritual issues are very important to severely ill patients, and healthcare professionals need to be attentive to such questions. It is important that professionals be properly prepared when patients need this communication. An evidence-based training intervention could provide such preparation. Healthcare staff were able to identify situations where existential issues were apparent, and they reported that their confidence in communication about existential issues increased after attending a short-term training program that included reflection. In order to design a program that should be permanently implemented, more knowledge is needed of patients' perceptions of the quality of the healthcare staff's existential support.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

PubMed

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

An evaluation of geographic trends in the otolaryngology residency match: home is where the heart is.

PubMed

Johnson, Andrew P; Svider, Peter F; Folbe, Adam J; Raza, Syed N; Shkoukani, Mahdi; Eloy, Jean Anderson; Zuliani, Giancarlo

2015-05-01

Securing an otolaryngology residency position has become an increasingly competitive endeavor in recent years. Recent studies have investigated the applicant criteria used by residency programs as part of the ranking process. However, to our knowledge, no studies have comprehensively investigated the role of geographic location in the match process. To evaluate geographic trends in the otolaryngology national residency match process. We conducted a cross-sectional examination of 56 otolaryngology residency programs including 810 residents to determine resident demographic information, including matriculated medical schools. The geographic locations of residency programs and the residents' matriculated medical schools were evaluated for trends. Residents' program locations were compared with the locations of their medical schools of matriculation, and the numbers of residents attending a program affiliated with their medical schools were also identified. Overall, 810 residents were identified from the 56 programs included in our study. Of these, 169 residents (20.9%) attended the program affiliated with their medical school. The Midwest had the highest proportion of residents graduating from the affiliated medical school (25.7%), and the West had the lowest proportion (12.5%) (P = .008). A total of 473 residents attended a program within the same region as their medical school (58.4%). The South had the highest proportion of residents from the same region (68.2%), and the West had the lowest proportion (31.3%) (P < .001). While it is not clear why a geographic bias was identified, a significant proportion of residents in our study attended a program in the same region as their medical school. This geographic association was strongest in the Midwest and South. Furthermore, a significant proportion of residents attended the program affiliated with their medical schools. This information is valuable to all future applicants as they choose where to apply, and to all residency programs as they decide how geographic location factors in to whom they decide to interview.

49 CFR 1014.110 - Self-evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... or organizations representing handicapped persons, to participate in the self-evaluation process by... 49 Transportation 8 2014-10-01 2014-10-01 false Self-evaluation. 1014.110 Section 1014.110... HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY THE SURFACE TRANSPORTATION BOARD § 1014.110 Self-evaluation...

40 CFR 12.110 - Self-evaluation.

Code of Federal Regulations, 2014 CFR

2014-07-01

... organizations representing individuals with handicaps to, participate in the self-evaluation process by... 40 Protection of Environment 1 2014-07-01 2014-07-01 false Self-evaluation. 12.110 Section 12.110... IN PROGRAMS OR ACTIVITIES CONDUCTED BY THE ENVIRONMENTAL PROTECTION AGENCY § 12.110 Self-evaluation...

1 CFR 500.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 1 General Provisions 1 2010-01-01 2010-01-01 false Self-evaluation. 500.110 Section 500.110... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL COMMISSION FOR EMPLOYMENT POLICY § 500.110 Self-evaluation... or organizations representing handicapped persons, to participate in the self-evaluation process by...

49 CFR 1014.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 8 2010-10-01 2010-10-01 false Self-evaluation. 1014.110 Section 1014.110... HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY THE SURFACE TRANSPORTATION BOARD § 1014.110 Self-evaluation... or organizations representing handicapped persons, to participate in the self-evaluation process by...

1 CFR 457.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 1 General Provisions 1 2010-01-01 2010-01-01 false Self-evaluation. 457.110 Section 457.110... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL CAPITAL PLANNING COMMISSION § 457.110 Self-evaluation. (a... organizations representing handicapped persons, to participate in the self-evaluation process by submitting...

49 CFR 28.110 - Self-evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

... HANDICAP IN PROGRAMS OR ACTIVITIES CONDUCTED BY THE DEPARTMENT OF TRANSPORTATION § 28.110 Self-evaluation... persons, including individuals with handicaps, agency employees with handicaps, and organizations representing individuals with handicaps, to participate in the self-evaluation process by submitting comments...

GEOSAFE CORPORATION IN SITU VITRIFICATION: INNOVATIVE TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

This report summarizes the findings associated with a Demonstration of the Geosafe Corporation (Geosafe) In Situ Vitrification (ISV) Process. The Geosafe ISV Technology was evaluated under the EPA Superfund Innovative Technology Evaluation (SITE) Program in conjuction with remedi...

A Process Evaluation of Project Developmental Continuity, Interim Report VII, Volume 1: Findings from the PDC Implementation Study.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This third year interim report, one of a series of documents on the evaluation of Project Developmental Continuity (PDC), presents findings from three major analyses of program implementation; measurement of the extent each program has implemented the basic PDC Guidelines; a description of patterns of that implementation; and analysis of some…

A Process Evaluation of Project Developmental Continuity. Interim Report II, Part A: Program Case Studies. Volume 2.

ERIC Educational Resources Information Center

Spencer, Lynn, Ed.

These 7 case studies are part of a series of documents on the evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Each case study reviews the planning year at a PDC demonstration site in one…

A Process Evaluation of Project Developmental Continuity. Interim Report II, Part A: Program Case Studies. Volume I.

ERIC Educational Resources Information Center

Spencer, Lynn, Ed.

These 8 case studies are part of a series of documents on the evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Each case study reviews the planning year at a PDC demonstration site in one…

Self-Study and Evaluation Guide/1968 Edition. Section D-2B: Orientation on Mobility Services. (Dog Guide Program Only).

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on orientation and mobility services (dog guide program emphasis) is one of 28 guides designed for organizations undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of…

Evaluation of a Health Professionals' Training Program to Conduct Research in New York City's Asian American Community

ERIC Educational Resources Information Center

Zhang, Pao San Lucy; Sim, Shao-Chee; Pong, Perry; Islam, Nadia; Trinh-Shevrin, Chau; Li, Shijian; Tsang, Thomas; Rey, Mariano

2014-01-01

Background: Because health disparities among Asian Americans are understudied, a partnership program between the Charles B. Wang Community Health Center and the Center for the Study of Asian American Health was created to increase awareness and interest in Asian American research. Purpose: To evaluate the process, outcome, and impact of a health…

PROCEEDINGS OF NATIONAL SEMINAR ON PROGRAM PLANNING, BUDGETING AND EVALUATION, VOCATIONAL-TECHNICAL EDUCATION. FINAL REPORT.

ERIC Educational Resources Information Center

CONNOLLY, JOHN; SMITH, CLODUS R.

THIRTY-NINE FEDERAL AND STATE EDUCATORS FROM 33 STATES, 23 RESOURCE PERSONNEL, AND 15 STAFF AND CHAIRMEN PARTICIPATED IN A SEMINAR TO (1) DEVELOP INSIGHTS INTO THE PRINCIPLES AND PROCESS OF PROGRAM PLANNING, BUDGETING, AND EVALUATION, (2) INVOLVE STATE, REGIONAL, AND LOCAL STAFF MEMBERS, (3) DEVELOP A CADRE OF KNOWLEDGEABLE VOCATIONAL EDUCATORS,…

Get on Board the Cost Effective Way: A Tech Prep Replication Process.

ERIC Educational Resources Information Center

Moore, Wayne A.; Szul, Linda F.; Rivosecchi, Karen

1997-01-01

The Northwestern Pennsylvania Tech Prep Consortium model for replicating tech prep programs includes these steps: fact finding, local industry analysis, curriculum development, detailed description, marketing strategies, implementation, and program evaluation. (SK)

Are we measuring what matters in health technology assessment of disease management? Systematic literature review.

PubMed

Steuten, Lotte; Vrijhoef, Bert; Severens, Hans; van Merode, Frits; Spreeuwenberg, Cor

2006-01-01

An overview was produced of indicators currently used to assess disease management programs and, based on these findings, provide a framework regarding sets of indicators that should be used when taking the aims and types of disease management programs into account. A systematic literature review was performed. Thirty-six studies met the inclusion criteria. It appeared that a link between aims of disease management and evaluated structure, process, as well as outcome indicators does not exist in a substantial part of published studies on disease management of diabetes and asthma/chronic obstructive pulmonary disease, especially when efficiency of care is concerned. Furthermore, structure indicators are largely missing from the evaluations, although these are of major importance for the interpretation of outcomes for purposes of decision-making. Efficiency of disease management is mainly evaluated by means of process indicators; the use of outcome indicators is less common. Within a framework, structure, process, and outcome indicators for effectiveness and efficiency are recommended for each type of disease management program. The link between aims of disease management and evaluated structure, process, and outcome indicators does not exist in a substantial part of published studies on disease management. The added value of this study mainly lies in the development of a framework to guide the choice of indicators for health technology assessment of disease management.

Furniture rough mill costs evaluated by computer simulation

Treesearch

R. Bruce Anderson

1983-01-01

A crosscut-first furniture rough mill was simulated to evaluate processing and raw material costs on an individual part basis. Distributions representing the real-world characteristics of lumber, equipment feed speeds, and processing requirements are programed into the simulation. Costs of parts from a specific cutting bill are given, and effects of lumber input costs...

Psychometric characteristics of process evaluation measures for a school-based childhood obesity prevention study: Louisiana Health

USDA-ARS?s Scientific Manuscript database

Process evaluations of large-scale school based programs are necessary to aid in the interpretation of the outcome data. The Louisiana Health (LA Health) study is a multi-component childhood obesity prevention study for middle school children. The Physical Education (PEQ), Intervention (IQ), and F...

Process Evaluation of an Intervention to Increase Provision of Adolescent Vaccines at School Health Centers

ERIC Educational Resources Information Center

Golden, Shelley D.; Moracco, Kathryn E.; Feld, Ashley L.; Turner, Kea L.; DeFrank, Jessica T.; Brewer, Noel T.

2014-01-01

Background: Vaccination programs in school health centers (SHCs) may improve adolescent vaccine coverage. We conducted a process evaluation of an intervention to increase SHC-located vaccination to better understand the feasibility and challenges of such interventions. Method: Four SHCs participated in an intervention to increase provision of…

Improving Survey Methods with Cognitive Interviews in Small- and Medium-Scale Evaluations

ERIC Educational Resources Information Center

Ryan, Katherine; Gannon-Slater, Nora; Culbertson, Michael J.

2012-01-01

Findings derived from self-reported, structured survey questionnaires are commonly used in evaluation and applied research to inform policy-making and program decisions. Although there are a variety of issues related to the quality of survey evidence (e.g., sampling precision), the validity of response processes--how respondents process thoughts…

The Differential Effects of Rape Prevention Programming on Attitudes, Behavior, and Knowledge.

ERIC Educational Resources Information Center

Heppner, Mary J.; And Others

1995-01-01

Evaluates whether type of programming differentially affects the processing of rape prevention messages, attitudes, knowledge, behaviors, and stability of change. Participants (n=258) were assigned to a didactic-video program, an interactive drama, or control. Results indicated that the interactive video was most effective in central route…

Television Linguistics Program. 1967 Report.

ERIC Educational Resources Information Center

Glassner, Leonard E.

The program teaches comtemporary English grammar through principles of linguistic science to 12,000 students in Pittsburgh. Structural grammar is presented to eighth and ninth grade students, and transformational grammar to tenth graders. In 1966-67, the effectiveness of the program was evaluated by data processing of final examination results.…

Engagement Theory in Action: An Investigation of Athletic Training Program Directors

ERIC Educational Resources Information Center

Peer, Kimberly S.

2007-01-01

Objective: To examine the use of good practice indicators by athletic training program directors and to provide a theoretical framework using engagement theory, a learner-centered process focusing on program improvement through continuous planning and evaluation, as a foundation for implementing good practices in athletic training education…

An Assessment of an Operational Educational Accountability System for Continuing Education in the Health Professions.

ERIC Educational Resources Information Center

Walsh, Patrick L.

1982-01-01

The Educational Quality Assessment and Assurance System for continuing education in health sciences includes three components to measure inputs, processes, and outcomes. They are (1) Program Coordinator Competency List, (2) Quality Assessment and Assurance Program, and (3) evaluation of educational programs. (SK)

Evaluation of Nosocomial Infection Control Programs in health services 1

PubMed Central

Menegueti, Mayra Gonçalves; Canini, Silvia Rita Marin da Silva; Bellissimo-Rodrigues, Fernando; Laus, Ana Maria

2015-01-01

OBJECTIVES: to evaluate the Nosocomial Infection Control Programs in hospital institutions regarding structure and process indicators. METHOD: this is a descriptive, exploratory and quantitative study conducted in 2013. The study population comprised 13 Nosocomial Infection Control Programs of health services in a Brazilian city of the state of São Paulo. Public domain instruments available in the Manual of Evaluation Indicators of Nosocomial Infection Control Practices were used. RESULTS: The indicators with the highest average compliance were "Evaluation of the Structure of the Nosocomial Infection Control Programs" (75%) and "Evaluation of the Epidemiological Surveillance System of Nosocomial Infection" (82%) and those with the lowest mean compliance scores were "Evaluation of Operational Guidelines" (58.97%) and "Evaluation of Activities of Control and Prevention of Nosocomial Infection" (60.29%). CONCLUSION: The use of indicators identified that, despite having produced knowledge about prevention and control of nosocomial infections, there is still a large gap between the practice and the recommendations. PMID:25806637

The Relationship of Explicit-Implicit Evaluative Discrepancy to Exercise Dropout in Middle-Aged Adults.

PubMed

Berry, Tanya R; Rodgers, Wendy M; Divine, Alison; Hall, Craig

2018-06-19

Discrepancies between automatically activated associations (i.e., implicit evaluations) and explicit evaluations of motives (measured with a questionnaire) could lead to greater information processing to resolve discrepancies or self-regulatory failures that may affect behavior. This research examined the relationship of health and appearance exercise-related explicit-implicit evaluative discrepancies, the interaction between implicit and explicit evaluations, and the combined value of explicit and implicit evaluations (i.e., the summed scores) to dropout from a yearlong exercise program. Participants (N = 253) completed implicit health and appearance measures and explicit health and appearance motives at baseline, prior to starting the exercise program. The sum of implicit and explicit appearance measures was positively related to weeks in the program, and discrepancy between the implicit and explicit health measures was negatively related to length of time in the program. Implicit exercise evaluations and their relationships to oft-cited motives such as appearance and health may inform exercise dropout.

Reengineering of waste management at the Oak Ridge National Laboratory. Volume 1

DOE Office of Scientific and Technical Information (OSTI.GOV)

Myrick, T.E.

1997-08-01

A reengineering evaluation of the waste management program at the Oak Ridge National Laboratory (ORNL) was conducted during the months of February through July 1997. The goal of the reengineering was to identify ways in which the waste management process could be streamlined and improved to reduce costs while maintaining full compliance and customer satisfaction. A Core Team conducted preliminary evaluations and determined that eight particular aspects of the ORNL waste management program warranted focused investigations during the reengineering. The eight areas included Pollution Prevention, Waste Characterization, Waste Certification/Verification, Hazardous/Mixed Waste Stream, Generator/WM Teaming, Reporting/Records, Disposal End Points, and On-Sitemore » Treatment/Storage. The Core Team commissioned and assembled Process Teams to conduct in-depth evaluations of each of these eight areas. The Core Team then evaluated the Process Team results and consolidated the 80 process-specific recommendations into 15 overall recommendations. Benchmarking of a commercial nuclear facility, a commercial research facility, and a DOE research facility was conducted to both validate the efficacy of these findings and seek additional ideas for improvement. The outcome of this evaluation is represented by the 15 final recommendations that are described in this report.« less

Informatics in radiology (infoRAD): free DICOM image viewing and processing software for the Macintosh computer: what's available and what it can do for you.

PubMed

Escott, Edward J; Rubinstein, David

2004-01-01

It is often necessary for radiologists to use digital images in presentations and conferences. Most imaging modalities produce images in the Digital Imaging and Communications in Medicine (DICOM) format. The image files tend to be large and thus cannot be directly imported into most presentation software, such as Microsoft PowerPoint; the large files also consume storage space. There are many free programs that allow viewing and processing of these files on a personal computer, including conversion to more common file formats such as the Joint Photographic Experts Group (JPEG) format. Free DICOM image viewing and processing software for computers running on the Microsoft Windows operating system has already been evaluated. However, many people use the Macintosh (Apple Computer) platform, and a number of programs are available for these users. The World Wide Web was searched for free DICOM image viewing or processing software that was designed for the Macintosh platform or is written in Java and is therefore platform independent. The features of these programs and their usability were evaluated. There are many free programs for the Macintosh platform that enable viewing and processing of DICOM images. (c) RSNA, 2004.

Do Workplace Literacy Programs Promote High Skills or Low Wages? Suggestions for Future Evaluations of Workplace Literacy Programs.

ERIC Educational Resources Information Center

Sarmiento, Tony

Workplace literacy programs can support the path toward either low wages or high skills. Instead of the "high skill" path, most U.S. companies follow the "low wage" path. Depending on who is involved, which program goals are selected, and what planning process is followed, a workplace literacy program can maintain outdated workplaces or foster…

15 CFR 2301.18 - Selection process.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 3 2010-01-01 2010-01-01 false Selection process. 2301.18 Section... PROGRAM Evaluation and Selection Process § 2301.18 Selection process. (a) The PTFP Director will consider... OTIA Associate Administrator's review and approval will take into account the following selection...

Evaluating International Research Ethics Capacity Development: An Empirical Approach

PubMed Central

Ali, Joseph; Kass, Nancy E.; Sewankambo, Nelson K.; White, Tara D.; Hyder, Adnan A.

2014-01-01

The US National Institutes of health, Fogarty International Center (NIH-FIC) has, for the past 13 years, been a leading funder of international research ethics education for resource-limited settings. Nearly half of the NIH-FIC funding in this area has gone to training programs that train individuals from sub-Saharan Africa. Identifying the impact of training investments, as well as the potential predictors of post-training success, can support curricular decision-making, help establish funding priorities, and recognize the ultimate outcomes of trainees and training programs. Comprehensive evaluation frameworks and targeted evaluation tools for bioethics training programs generally, and for international research ethics programs in particular, are largely absent from published literature. This paper shares an original conceptual framework, data collection tool, and detailed methods for evaluating the inputs, processes, outputs, and outcomes of research ethics training programs serving individuals in resource-limited settings. This paper is part of a collection of papers analyzing the Fogarty International Center’s International Research Ethics Education and Curriculum Development program. PMID:24782071

Fossil Energy Program

NASA Astrophysics Data System (ADS)

McNeese, L. E.

1981-01-01

Increased utilization of coal and other fossil fuel alternatives as sources of clean energy is reported. The following topics are discussed: coal conversion development, chemical research and development, materials technology, component development and process evaluation studies, technical support to major liquefaction projects, process analysis and engineering evaluations, fossil energy environmental analysis, flue gas desulfurization, solid waste disposal, coal preparation waste utilization, plant control development, atmospheric fluidized bed coal combustor for cogeneration, TVA FBC demonstration plant program technical support, PFBC systems analysis, fossil fuel applications assessments, performance assurance system support for fossil energy projects, international energy technology assessment, and general equilibrium models of liquid and gaseous fuel supplies.

Evaluating Payments for Environmental Services: Methodological Challenges

PubMed Central

2016-01-01

Over the last fifteen years, Payments for Environmental Services (PES) schemes have become very popular environmental policy instruments, but the academic literature has begun to question their additionality. The literature attempts to estimate the causal effect of these programs by applying impact evaluation (IE) techniques. However, PES programs are complex instruments and IE methods cannot be directly applied without adjustments. Based on a systematic review of the literature, this article proposes a framework for the methodological process of designing an IE for PES schemes. It revises and discusses the methodological choices at each step of the process and proposes guidelines for practitioners. PMID:26910850

Defining a staged-based process for economic and financial evaluations of mHealth programs.

PubMed

LeFevre, Amnesty E; Shillcutt, Samuel D; Broomhead, Sean; Labrique, Alain B; Jones, Tom

2017-01-01

Mobile and wireless technology for health (mHealth) has the potential to improve health outcomes by addressing critical health systems constraints that impede coverage, utilization, and effectiveness of health services. To date, few mHealth programs have been implemented at scale and there remains a paucity of evidence on their effectiveness and value for money. This paper aims to improve understanding among mHealth program managers and key stakeholders of how to select methods for economic evaluation (comparative analysis for determining value for money) and financial evaluation (determination of the cost of implementing an intervention, estimation of costs for sustaining or expanding an intervention, and assessment of its affordability). We outline a 6 stage-based process for selecting and integrating economic and financial evaluation methods into the monitoring and evaluation of mHealth solutions including (1) defining the program strategy and linkages with key outcomes, (2) assessment of effectiveness, (3) full economic evaluation or partial evaluation, (4) sub-group analyses, (5) estimating resource requirements for expansion, (6) affordability assessment and identification of models for financial sustainability. While application of these stages optimally occurs linearly, finite resources, limited technical expertise, and the timing of evaluation initiation may impede this. We recommend that analysts prioritize economic and financial evaluation methods based on programmatic linkages with health outcomes; alignment with an mHealth solution's broader stage of maturity and stage of evaluation; overarching monitoring and evaluation activities; stakeholder evidence needs; time point of initiation; and available resources for evaluations.

Process evaluation of a community-based mental health promotion intervention for refugee children

PubMed Central

Nakkash, Rima T.; Alaouie, Hala; Haddad, Pascale; El Hajj, Taghreed; Salem, Heba; Mahfoud, Ziyad; Afifi, Rema A.

2012-01-01

Public health interventions are complex in nature and composed of multiple components. Evaluation of process and impact is necessary to build evidence of effectiveness. Process evaluation involves monitoring extent of implementation and comparison against the program plan. This article describes the process evaluation of the ‘Qaderoon’ (We are Capable) intervention; a community-based mental health promotion intervention for children living in a Palestinian refugee camp of Beirut, Lebanon. The manuscript describes the context of Palestinian refugees in Lebanon, the intervention, the process evaluation plan and results. The process evaluation was guided by the literature and by a Community Youth Committee. Findings indicated that attendance was 54 and 38% for summer and fall sessions, respectively. Session objectives and activities were commonly achieved. Over 78.4% of activities were reported to be implemented fully as planned. Over 90% of the children indicated high satisfaction with the sessions. Contextual facilitators and challenges to implementing the intervention are discussed. The most challenging were maintaining attendance and the actual implementation of the process evaluation plan. Findings from process evaluation will strengthen interpretation of impact evaluation results. PMID:21908850

Psychometric Characteristics of Process Evaluation Measures for a Rural School-based Childhood Obesity Prevention Study: Louisiana Health

PubMed Central

Newton, R. L.; Thomson, J. L.; Rau, K.; Duhe’, S.; Sample, A.; Singleton, N.; Anton, S. D.; Webber, L. S.; Williamson, D. A.

2011-01-01

Purpose To evaluate the implementation of intervention components of the Louisiana Health study, which was a multi-component childhood obesity prevention program conducted in rural schools. Design Content analysis. Setting Process evaluation assessed implementation in the classrooms, gym classes, and cafeterias. Subjects Classroom teachers (n = 232), physical education teachers (n = 53), food service managers (n = 33), and trained observers (n = 9). Measures Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO) and School Nutrition Environment Observation (SNEO). Analysis Inter-rater reliability and internal consistency were conducted on all measures. ANOVA and Chi-square were used to compare differences across study groups on questionnaires and observations. Results The PEQ and one sub-scale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The sub-scale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach’s α > .60) were acceptable. Conclusions After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions. PMID:21721969

Psychometric characteristics of process evaluation measures for a rural school-based childhood obesity prevention study: Louisiana Health.

PubMed

Newton, Robert L; Thomson, Jessica L; Rau, Kristi K; Ragusa, Shelly A; Sample, Alicia D; Singleton, Nakisha N; Anton, Stephen D; Webber, Larry S; Williamson, Donald A

2011-01-01

To evaluate the implementation of intervention components of the Louisiana Health study, which was a multicomponent childhood obesity prevention program conducted in rural schools. Content analysis. Process evaluation assessed implementation in classrooms, gym classes, and cafeterias. Classroom teachers (n  =  232), physical education teachers (n  =  53), food service managers (n  =  33), and trained observers (n  =  9). Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO), and School Nutrition Environment Observation (SNEO). Interrater reliability and internal consistency were assessed on all measures. Analysis of variance and χ(2) were used to compare differences across study groups on questionnaires and observations. The PEQ and one subscale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The subscale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach α > .60) were acceptable. After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions.

45 CFR 1175.110 - Self-evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

... organizations representing handicapped persons, to participate in the self-evaluation process by submitting... 45 Public Welfare 3 2013-10-01 2013-10-01 false Self-evaluation. 1175.110 Section 1175.110 Public... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL ENDOWMENT FOR THE HUMANITIES § 1175.110 Self-evaluation...

45 CFR 1175.110 - Self-evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... organizations representing handicapped persons, to participate in the self-evaluation process by submitting... 45 Public Welfare 3 2014-10-01 2014-10-01 false Self-evaluation. 1175.110 Section 1175.110 Public... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL ENDOWMENT FOR THE HUMANITIES § 1175.110 Self-evaluation...

Individualised Qualitative Evaluation.

ERIC Educational Resources Information Center

O'Sullivan, Denis

1987-01-01

The author discusses student evaluation in relation to adult and continuing education programs offered by the Department of Adult Education, University College, Cork. He highlights the need for a more individualized and interactive approach to evaluation, allowing the student to benefit from qualitative feedback in the process of being evaluated.…

10 CFR 1041.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Self-evaluation. 1041.110 Section 1041.110 Energy... PROGRAMS OR ACTIVITIES CONDUCTED BY THE DEPARTMENT OF ENERGY § 1041.110 Self-evaluation. (a) The agency... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

45 CFR 1175.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self-evaluation. 1175.110 Section 1175.110 Public... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL ENDOWMENT FOR THE HUMANITIES § 1175.110 Self-evaluation... organizations representing handicapped persons, to participate in the self-evaluation process by submitting...

22 CFR 1005.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 2 2010-04-01 2010-04-01 true Self-evaluation. 1005.110 Section 1005.110... PROGRAMS OR ACTIVITIES CONDUCTED BY THE INTER-AMERICAN FOUNDATION § 1005.110 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

DOE standard: The Department of Energy Laboratory Accreditation Program for radiobioassay

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

1998-12-01

This technical standard describes the US Department of Energy Laboratory Accreditation Program (DOELAP) for Radiobioassay, for use by the US Department of Energy (DOE) and DOE Contractor radiobioassay programs. This standard is intended to be used in conjunction with the general administrative technical standard that describes the overall DOELAP accreditation process--DOE-STD-1111-98, Department of Energy Laboratory Accreditation Program Administration. This technical standard pertains to radiobioassay service laboratories that provide either direct or indirect (in vivo or in vitro) radiobioassay measurements in support of internal dosimetry programs at DOE facilities or for DOE and DOE contractors. Similar technical standards have been developedmore » for other DOELAP dosimetry programs. This program consists of providing an accreditation to DOE radiobioassay programs based on successful completion of a performance-testing process and an on-site evaluation by technical experts. This standard describes the technical requirements and processes specific to the DOELAP Radiobioassay Accreditation Program as required by 10 CFR 835 and as specified generically in DOE-STD-1111-98.« less

A Management Information System Model for Program Management. Ph.D. Thesis - Oklahoma State Univ.; [Computerized Systems Analysis

NASA Technical Reports Server (NTRS)

Shipman, D. L.

1972-01-01

The development of a model to simulate the information system of a program management type of organization is reported. The model statistically determines the following parameters: type of messages, destinations, delivery durations, type processing, processing durations, communication channels, outgoing messages, and priorites. The total management information system of the program management organization is considered, including formal and informal information flows and both facilities and equipment. The model is written in General Purpose System Simulation 2 computer programming language for use on the Univac 1108, Executive 8 computer. The model is simulated on a daily basis and collects queue and resource utilization statistics for each decision point. The statistics are then used by management to evaluate proposed resource allocations, to evaluate proposed changes to the system, and to identify potential problem areas. The model employs both empirical and theoretical distributions which are adjusted to simulate the information flow being studied.

The Burden of the Fellowship Interview Process on General Surgery Residents and Programs.

PubMed

Watson, Shawna L; Hollis, Robert H; Oladeji, Lasun; Xu, Shin; Porterfield, John R; Ponce, Brent A

This study evaluated the effect of the fellowship interview process in a cohort of general surgery residents. We hypothesized that the interview process would be associated with significant clinical time lost, monetary expenses, and increased need for shift coverage. An online anonymous survey link was sent via e-mail to general surgery program directors in June 2014. Program directors distributed an additional survey link to current residents in their program who had completed the fellowship interview process. United States allopathic general surgery programs. Overall, 50 general surgery program directors; 72 general surgery residents. Program directors reported a fellowship application rate of 74.4%. Residents most frequently attended 8 to 12 interviews (35.2%). Most (57.7%) of residents reported missing 7 or more days of clinical training to attend interviews; these shifts were largely covered by other residents. Most residents (62.3%) spent over $4000 on the interview process. Program directors rated fellowship burden as an average of 6.7 on a 1 to 10 scale of disruption, with 10 being a significant disruption. Most of the residents (57.3%) were in favor of change in the interview process. We identified potential areas for improvement including options for coordinated interviews and improved content on program websites. The surgical fellowship match is relatively burdensome to residents and programs alike, and merits critical assessment for potential improvement. Published by Elsevier Inc.

Designing a National Longitudinal Faculty Development Curriculum Focused on Educational Scholarship: Process, Outcomes, and Lessons Learned.

PubMed

Chandran, Latha; Gusic, Maryellen E; Lane, J Lindsey; Baldwin, Constance D

2017-01-01

Clinical educators at U.S. academic health centers are frequently disadvantaged in the academic promotion system, lacking needed faculty development, mentoring, and networking support. In 2006, we implemented the national Educational Scholars Program to offer faculty development in educational scholarship for early career educators in pediatrics. We aimed to provide them with skills, experience, and initial success in educational scholarship and dissemination. The 3-year curriculum is delivered in interactive sessions at the annual pediatric academic meetings and online intersession modules. Curriculum content progresses from educational scholarship and implementing scholarly projects to dissemination and professional networking. Intersession modules address project planning, building an educator portfolio, reviewing the literature, using technology, authorship, and peer review. Concurrently, all scholars must complete a mentored educational project and demonstrate national dissemination of a peer-reviewed product to obtain a Certificate of Excellence in Educational Scholarship. The setting of this study was a national, longitudinal, cohort-based faculty development program built within the Academic Pediatric Association, a 2,000-member professional organization. In 10 years, the Educational Scholars Program has enrolled 172 scholars in 8 cohorts; 94 have graduated so far. We describe how formative evaluation guided curriculum refinement and process improvement. Summative evaluations show that faculty and scholars were satisfied with the program. Participant outcomes from Cohort 1, assessed at Kirkpatrick's four levels of evaluation, demonstrate increases in scholarly productivity, leadership activities, and academic promotions. Curriculum building is a dynamic process of ongoing evaluation and modification. Our program benefited from designing an integrated and focused curriculum, developing educational principles to guide program improvements, creating curricular tools to help learners organize and document their efforts, supporting project-based learning with expert mentoring, and facilitating peer and faculty networking and collaboration. A national, longitudinal faculty development program can support growth in academic knowledge and skills, promote professional networking, and thereby enrich educators' career opportunities.

Use of process evaluation to guide health education in Forsyth County's project to prevent cervical cancer.

PubMed

Dignan, M B; Michielutte, R; Sharp, P C; Young, L D; Daniels, L A

1991-01-01

The Forsyth County, NC, Cervical Cancer Prevention Project is a 5-year public health education program designed to increase the proportion of black women in the county who are appropriately screened for cervical cancer. In this paper, the authors report on process evaluation--the procedures used to monitor the intervention and to insure that the target population was reached with a high quality, community-based health education program. A system that encompasses documentation of program activities, interviews with women in waiting rooms of primary care providers, semiannual interviews with a panel of approximately 100 women from the target population, and telephone followup with participants in direct education workshops was designed and implemented. Through October 1990, more than 2,100 interviews had been conducted. Data from these activities have facilitated continued development and refinement of educational materials, provided guidance for developing new strategies for reaching the target population, and provided continuous feedback to program managers to allow monitoring the impact of all program activities.

Development and Use of a Goal Setting/Attainment Process Designed To Measure a Teacher's Ability To Engage in Professional Growth and Leadership Initiatives.

ERIC Educational Resources Information Center

Minix, Nancy; And Others

The process used to evaluate progress in identifying the goals to be used in evaluating teacher performance under the Kentucky Career Ladder Program is described. The process pertains to two areas of teacher development: (1) professional growth and development, and (2) professional leadership and initiative. A total of 1,650 individuals were asked…

[Evaluation of a program to promote network building between disciplinary agencies and informal community organizations: trial in a community comprehensive support center].

PubMed

Murayama, Hiroshi; Kojima, Tomoko; Tomaru, Meiko; Narabu, Harumi; Tachibana, Reiko; Yamaguchi, Takuhiro; Murashima, Sachiyo

2010-10-01

To examine the effectiveness of a program promoting network building between disciplinary agencies and informal community organizations (IGOs) comprising community residents, by implemention with staff of a community comprehensive support center (CJCSG). The program was implemented for nine staff of a GGSG in Setagaya Ward, Tokyo for a year. For process evaluation, items were assessed concerning the contents of the program such as satisfaction and understandability, participants' goal attainment level at each period of the program, and program satisfaction as a whole. Outcome evaluation included measurement of participants' self-efficacy regarding network building with ICOs before and after the program, using interviews of the members who completed the program. Eight out of the nine participants completed the program. All positively evaluated the contents of the program and their own goal attainment at each period of the program. After its completion, they felt highly satisfied. Moreover, there was an improvement in the cognition of the participants, including self-efficacy on network building with IGOs and the atmosphere in the GGSG with regard to network building. The efficacy of this program could be confirmed as demonstrated by the staff of the CCSC, although a more detailed assessment of validity and effectiveness will be necessary in the future.

APPLICATIONS ANALYSIS REPORT: SITE PROGRAM DEMONSTRATION TEST SOLIDITECH, INC. SOLIDIFICATION/ STABILIZATION PROCESS

EPA Science Inventory

This Applications Analysis Report evaluates the Soliditech, Inc., solidification/ stabilization process for the on-site treatment of waste materials. The Soliditech process mixes and chemically treats waste material with Urrichem (a proprietary reagent), additives, pozzolanic mat...

Design and Implementation of a Pilot Obesity Prevention Program in a Low-Resource School: Lessons Learned and Research Recommendations

ERIC Educational Resources Information Center

Baskin, Monica L.; Zunker, Christie; Worley, Courtney B.; Dial, Brenda; Kimbrough, Linda

2009-01-01

Purpose: This paper seeks to describe the design, implementation, and lessons learned from an obesity prevention pilot program delivered in a low resource school in the USA. Design/methodology/approach: A planned program evaluation was conducted to: document explicitly the process of designing and implementing the program; and assess the…

Predicting Vandalism in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age, and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development model was a community-based planning and procedural tool to enhance and to prevent delinquency through a process of youth needs assessments, needs targeted programs, and program impact evaluation. The program's 12 Impact Scales have been found to have acceptable reliabilities, substantial…

Leveraging Process Evaluation for Project Development and Sustainability: The Case of the CAMPUS Asia Program in Korea

ERIC Educational Resources Information Center

Kim, Seon-Joo

2017-01-01

CAMPUS Asia (Collective Action for Mobility Program of University Students in Asia) is a student-exchange program designed to promote student mobility between South Korea, China, and Japan. Begun in 2011, the program aims to foster the next generation of leaders in Asia by nurturing young talents with shared visions. This article provides an…

The Economic and Workforce Development Program (ED>Net) Annual Report, 2001-02 [and] Addendum to FY 01-02 Annual Report.

ERIC Educational Resources Information Center

California Community Colleges, Sacramento. Economic Development Coordination Network (EDNet).

This document contains an annual report and its addendum from the Economic and Workforce Development Program of California Community Colleges. The annual report provides an overview of the Program's evaluation processes, regional centers, short-term projects, legislation, strategic plan, etc. It also provides vital facts about the program such as…

The Mais Médicos (More Doctors) Program: panorama of the scientific output.

PubMed

Kemper, Elisandréa Sguario; Mendonça, Ana Valeria Machado; Sousa, Maria Fátima de

2016-09-01

Despite the progress achieved by the Primary Health Care and Family Health Strategy in the Unified Health System (SUS) challenges still remain with regard to the universality of access and the quality of services, one of the factors being the unequal distribution of physicians. The Brazilian Government established the Mais Médicos Program (More Doctors Program), in order to move forward in the provision, placement and training of physicians in the SUS. This study consists of a review of the literature of the Mais Médicos Program, in order to map and assess the scientific production on the Program, as well as summarize the findings and present the results of the analysis. Fifty-four publications were selected, which evaluate the Program in terms of effectiveness, analysis of the implementation process, the media and the statements of the actors and assessment of the legal and constitutional precepts. The criticisms and limitations found were also systematically analyzed. With respect to the analysis, evaluations of the Program are overwhelmingly positive, showing important changes in the work processes in services and training. The studies that show the Program as being an important instrument for the effective implementation of the right to health are highlighted.

Creating Robust Evaluation of ATE Projects

ERIC Educational Resources Information Center

Eddy, Pamela L.

2017-01-01

Funded grant projects all involve some form of evaluation, and Advanced Technological Education (ATE) grants are no exception. Program evaluation serves as a critical component not only for evaluating if a project has met its intended and desired outcomes, but the evaluation process is also a central feature of the grant application itself.…

A Process Evaluation of Project Developmental Continuity, Interim Report VII, Volume 3: Assessment of Program Impact Through the Head Start Year.

ERIC Educational Resources Information Center

Granville, Arthur C.; And Others

This interim report, part of a series of documents examining the feasibility of the longitudinal evaluation of Project Developmental Continuity (PDC), presents the results of an analysis of PDC impact at the Head Start level, using Spring 1977 data. PDC is a Head Start Demonstration Program aimed at providing educational and developmental…

An Evaluation of Immediate Outcomes and Fidelity of a Drug Abuse Prevention Program in Continuation High Schools: Project towards No Drug Abuse (TND)

ERIC Educational Resources Information Center

Lisha, Nadra E.; Sun, Ping; Rohrbach, Louise A.; Spruijt-Metz, Donna; Unger, Jennifer B.; Sussman, Steve

2012-01-01

The present study provides an implementation fidelity, process, and immediate outcomes evaluation of Project Towards No Drug Abuse (TND), a drug prevention program targeting continuation high school youth (n = 1426) at risk for drug abuse. A total of 24 schools participated in three randomized conditions: TND Only, TND and motivational…

Self-Study Report for Candidacy. Prepared by Mennonite College of Nursing for the North Central Association of Colleges and Schools.

ERIC Educational Resources Information Center

Mennonite Coll. of Nursing, Bloomington, IN.

A self-evaluation report by the Mennonite College of Nursing, which is applying for candidacy status with the North Central Association of Colleges and Schools, is presented. Information is provided on the evolution of the program and the program evaluation process, as well as strengths and concerns of the college and plans for further…

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

NASA Astrophysics Data System (ADS)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

Formative Evaluation of ETV Programmes.

ERIC Educational Resources Information Center

Duby, Aliza

A process of formative evaluation which considers moral, scientific, and social values as its criteria and which is conducted by project staff is proposed for the evaluation of educational television (ETV) programs produced by the South African Broadcasting Corporation. The theoretical framework of ETV evaluation is outlined in the first section,…

22 CFR 530.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 2 2010-04-01 2010-04-01 true Self-evaluation. 530.110 Section 530.110 Foreign... PROGRAMS OR ACTIVITIES CONDUCTED BY THE BROADCASTING BOARD OF GOVERNORS § 530.110 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

10 CFR 4.510 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Self-evaluation. 4.510 Section 4.510 Energy NUCLEAR... Programs or Activities Conducted by the U.S. Nuclear Regulatory Commission § 4.510 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

45 CFR 1153.110 - Self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self-evaluation. 1153.110 Section 1153.110 Public... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL ENDOWMENT FOR THE ARTS § 1153.110 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

Are We There Yet? Evaluating Library Collections, Reference Services, Programs, and Personnel.

ERIC Educational Resources Information Center

Robbins-Carter, Jane; Zweizig, Douglas L.

1985-01-01

This second in a five-lesson tutorial on library evaluation focuses on the evaluation of library collections. Highlights include the seven-step evaluation process described in lesson one; quantitative methods (total size, unfilled requests, circulation, turnover rate); and qualitative methods (impressionistic, list-checking). One required and…

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Open source software in a practical approach for post processing of radiologic images.

PubMed

Valeri, Gianluca; Mazza, Francesco Antonino; Maggi, Stefania; Aramini, Daniele; La Riccia, Luigi; Mazzoni, Giovanni; Giovagnoni, Andrea

2015-03-01

The purpose of this paper is to evaluate the use of open source software (OSS) to process DICOM images. We selected 23 programs for Windows and 20 programs for Mac from 150 possible OSS programs including DICOM viewers and various tools (converters, DICOM header editors, etc.). The programs selected all meet the basic requirements such as free availability, stand-alone application, presence of graphical user interface, ease of installation and advanced features beyond simple display monitor. Capabilities of data import, data export, metadata, 2D viewer, 3D viewer, support platform and usability of each selected program were evaluated on a scale ranging from 1 to 10 points. Twelve programs received a score higher than or equal to eight. Among them, five obtained a score of 9: 3D Slicer, MedINRIA, MITK 3M3, VolView, VR Render; while OsiriX received 10. OsiriX appears to be the only program able to perform all the operations taken into consideration, similar to a workstation equipped with proprietary software, allowing the analysis and interpretation of images in a simple and intuitive way. OsiriX is a DICOM PACS workstation for medical imaging and software for image processing for medical research, functional imaging, 3D imaging, confocal microscopy and molecular imaging. This application is also a good tool for teaching activities because it facilitates the attainment of learning objectives among students and other specialists.

EDCATS: An Evaluation Tool

NASA Technical Reports Server (NTRS)

Heard, Pamala D.

1998-01-01

The purpose of this research is to explore the development of Marshall Space Flight Center Unique Programs. These academic tools provide the Education Program Office with important information from the Education Computer Aided Tracking System (EDCATS). This system is equipped to provide on-line data entry, evaluation, analysis, and report generation, with full archiving for all phases of the evaluation process. Another purpose is to develop reports and data that is tailored to Marshall Space Flight Center Unique Programs. It also attempts to acquire knowledge on how, why, and where information is derived. As a result, a user will be better prepared to decide which available tool is the most feasible for their reports.

Thermoelectric materials evaluation program. Technical summary report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hinderman, J.D.

1979-04-01

Research progress on the thermoelectric materials evaluation program is reported covering the period January 1, 1976 to September 30, 1978. Topical reports are presented on (1) hot and cold end ..delta..T's, (2) hardware mobility, (3) p-leg sublimation suppression, (4) thermodynamic stability of p-legs, (5) n-leg material process improvements to reduce extraneous resistance, (6) n-leg cracking, (7) dynamic evaluation of converter, and (8) data base and degradation modes. Twenty attachments are included which present supporting drawings, specifications, procedures, and data. (WHK)

Nuclear education and training: marriages that work

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hanson, H.D.

1985-11-01

Public Service Electric and Gas Company is meeting the education and training needs of its nuclear department operations, support, and services personnel through a variety of activities in association with institutions of higher education. Activities include credit or credit recommendation programs at the associates, undergraduate, and graduate degree level. The paper emphasizes the process of working with a local college in the development of a new degree program for submission through the State Board of Education. The development, review, evaluation, and approval process is detailed as well as lessons learned. Plans for further development of the program toward ABET accreditationmore » are also described. Samples of the surveys conducted to determine employee interest in terms of academic area, academic level, offering strategies, etc. are presented. The process of soliciting program proposals from universities and colleges, the selection process, and implementation of the programs are also discussed. More briefly described is the preparation for credit recommendation process from regionally accredited groups. External degree programs, off-hours course presentations on-site for undergraduate and graduate credit, faculty extern, student intern, and co-op activities are also discussed.« less

A Process Evaluation of Project Developmental Continuity, Interim Report VI: Recommendations for Continuing the Impact Study.

ERIC Educational Resources Information Center

Granville, Arthur; And Others

This interim report re-examines data on instrument suitability, comparability of groups, and adequacy of sample size in Year III of the process evaluation of Project Developmental Continuity (PDC) and offers preliminary recommendations concerning the feasibility of continuing the impact study. PDC is a Head Start demonstration program aimed at…

Evaluation Processes of Regional and National Education Accrediting Agencies: Implications for Redesigning an Evaluation Process in California.

ERIC Educational Resources Information Center

Bernhardt, Victoria L.

Colleges and universities in California may be accredited or approved by four different agencies to offer approved programs of teacher education: the State Department of Education's Office of Private Postsecondary Education (OPPE) (for private institutions); the Western Association of Schools and Colleges (WASC); the Commission on Teacher…

Implementation as a Focus of Consultation to Evaluate Academic Tutoring Services in an Urban School District: A Case Study Example

ERIC Educational Resources Information Center

Morrison, Julie Q.; English, Sarah Baker

2012-01-01

This article describes a multiagency initiative to evaluate academic tutoring services by focusing on the processes that contribute to effective program implementation. Community-based tutoring service providers serving students in the Cincinnati Public Schools (OH) partnered to initiate a "Seal of Approval" process for promoting…

A Case Study of Group Processes and Student Evaluation of Teaching

ERIC Educational Resources Information Center

Mortenson, Kristian G.; Sathe, Richard S.

2017-01-01

This paper documents a case study undertaken to understand the effect of group processes on student evaluation of teaching (SET). The study used interviews to investigate the experiences of students in a cohort model Master of Science in Accountancy degree program and how those experiences influenced SET. The cohort served as an extreme example in…

Developing Common Measures in Evaluation Capacity Building: An Iterative Science and Practice Process

ERIC Educational Resources Information Center

Labin, Susan N.

2014-01-01

A fundamental reason for doing evaluation capacity building (ECB) is to improve program outcomes. Developing common measures of outcomes and the activities, processes, and factors that lead to these outcomes is an important step in moving the science and the practice of ECB forward. This article identifies a number of existing ECB measurement…

Understanding Leisure-related Program Effects by Using Process Data in the HealthWise South Africa Project.

PubMed

Caldwell, Linda L; Younker, Anita S; Wegner, Lisa; Patrick, Megan E; Vergnani, Tania; Smith, Edward A; Flisher, Alan J

2008-01-01

As the push for evidence-based programming gathers momentum, many human services programs and interventions are under increased scrutiny to justify their effectiveness across different conditions and populations. Government agencies and the public want to be assured that their resources are being put to good use on programs that are effective and efficient (Guskey, 2000). Thus, programs are increasingly based on theory and evaluated through randomized control trials using longitudinal data. Despite this progress, hypothesized outcomes are often not detected and/or their effect sizes are small (Gingiss, Roberts-Gray, Boerm, 2006). Moreover, findings may go against intuition or "gut feelings" on the part of project staff. Given the need to understand how program implementation issues relate to outcomes, this study focuses on whether process measures that focus on program implementation and fidelity can shed light on associated outcomes. In particular, we linked the process evaluation of the HealthWise motivation lesson with outcomes across four waves of data collection. We hypothesized that HealthWise would increase learners' intrinsic and identified forms of motivation, and decrease amotivation and extrinsic motivation. We did not hypothesize a direction of effects on introjected motivation due to its conceptual ambiguity. Data came from youth in four intervention schools (n = 902, 41.1%) and five control schools (n = 1291, 58.9%) who were participating in a multi-cohort, longitudinal study. The schools were in a township near Cape Town, South Africa. For each cohort, baseline data are collected on learners as they begin Grade 8. We currently have four waves of data collected on the first cohort, which is the focus of this paper. The mean age of the sample at Wave 3 was 15.0 years (SD = .86) and 51% of students were female. Results suggested that there was evidence of an overall program effect of the curriculum on amotivation regardless of fidelity of implementation. Compared to the control schools, all treatment school learners reported lower levels of amotivation in Wave 4 compared to Wave 3, as hypothesized. Using process evaluation data to monitor implementation fidelity, however, we also conclude that the school with better trained teachers who also reported higher levels of program fidelity had better outcomes than the other schools. We discuss the implications of linking process data with outcome data and associated methodological challenges in linking these data.

High Tech Educators Network Evaluation.

ERIC Educational Resources Information Center

O'Shea, Dan

A process evaluation was conducted to assess the High Tech Educators Network's (HTEN's) activities. Four basic components to the evaluation approach were documentation review, program logic model, written survey, and participant interviews. The model mapped the basic goals and objectives, assumptions, activities, outcome expectations, and…

EVALUATION OF THE MART CORPORATION'S EQ-1 WASTEWATER PROCESSING SYSTEM

EPA Science Inventory

The USEPA has created the Environmental Technology Verification (ETV) Program to facilitate the deployment of innovative or improved environmental technologies through performance verification and dissemination of information. The goal of the ETV Program is to further environment...

76 FR 30178 - Submission for OMB review; Comment Request; Process Evaluation of the NIH Roadmap Epigenomics...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-24

... identify areas for program improvement and lessons learned that might be useful to other research programs..., NSC--Neuroscience Center, 5229, 6001 Executive Blvd., Rockville, MD, 20852, or call non-toll-free...

Computer program for discounted cash flow/rate of return evaluations

NASA Technical Reports Server (NTRS)

Robson, W. D.

1971-01-01

Technique, incorporated into set of three computer programs, provides economic methodology for reducing all parameters to financially sound common denominator of present worth, and calculates resultant rate of return on new equipment, processes, or systems investments.

Numerical Implementation of Indicators and Statistical Control Tools in Monitoring and Evaluating CACEI-ISO Indicators of Study Program in Industrial Process by Systematization

ERIC Educational Resources Information Center

Ayala, Gabriela Cota; Real, Francia Angélica Karlos; Ivan, Ramirez Alvarado Edqar

2016-01-01

The research was conducted to determine if the study program of the career of industrial processes Technological University of Chihuahua, 1 year after that it was certified by CACEI, continues achieving the established indicators and ISO 9001: 2008, implementing quality tools, monitoring of essential indicators are determined, flow charts are…

What Works: The Results of Evaluations on Two Interactive Multimedia Programs.

ERIC Educational Resources Information Center

Schmidt, Kathy J.

The American Institute for Learning (AIL) has developed two interactive multimedia drug-awareness programs for secondary students who have used substances experimentally or are being challenged by others to experiment with drugs. The first, "Addiction and Its Processes," is an awareness program with video and computer capabilities and an…

Workplace Literacy Programs: Variations of Approach and Limits of Impact.

ERIC Educational Resources Information Center

Mikulecky, Larry

Six workplace literacy programs were evaluated for impact upon learners, learners' families, and learners' productivity. Site 1 was an automotive plant where learners were involved in technical preparation, the General Educational Development program, and English as a Second Language (ESL). Site 2 was a wood-processing plant with a communication…

The Husky Byte Program: Delivering Nutrition Education One Sound Byte at a Time

ERIC Educational Resources Information Center

Pierce, Michelle B.; Hudson, Kerrian A.; Lora, Karina R.; Havens, Erin K.; Ferris, Ann M.

2011-01-01

The Husky Byte program uses interactive displays to deliver quick sound bytes of nutrition information to adults in frequented community settings. This innovative program considers time constraints, adult learning theory, diverse learning styles, and is easily accessible to adults. Both process and impact evaluations have demonstrated positive…

Automated Error Detection for Developing Grammar Proficiency of ESL Learners

ERIC Educational Resources Information Center

Feng, Hui-Hsien; Saricaoglu, Aysel; Chukharev-Hudilainen, Evgeny

2016-01-01

Thanks to natural language processing technologies, computer programs are actively being used not only for holistic scoring, but also for formative evaluation of writing. CyWrite is one such program that is under development. The program is built upon Second Language Acquisition theories and aims to assist ESL learners in higher education by…

Integrating the Full Range of Security Cooperation Programs into Air Force Planning: An Analytic Primer

DTIC Science & Technology

2011-01-01

Exchange Program ( IEP ) Authority 10 U.S.C. §2358, “Research and development projects” Processes and agreements IEP agreements with the...2015.4, “Defense Research, Development, Test and Evaluation (RDT&E) Information Exchange Program ( IEP )”; DoDD 5134.1, “Under Secretary of Defense for

Putting Empirical Knowledge to Work: Linking Research and Programming on Marital Quality

ERIC Educational Resources Information Center

Adler-Baeder, Francesca; Higginbotham, Brian; Lamke, Leanne

2004-01-01

When selecting a marriage education curriculum, educators can turn to programs that have been evaluated for effectiveness; however, few curricula have undergone such study. An alternative approach, consistent with best practices, is to ensure a research base for program content. A translation process model is offered as an initial attempt to…

Influence of Students' Feedback on the Quality of Adult Higher Distance Education Service Delivery

ERIC Educational Resources Information Center

Oduaran, Akpovire

2017-01-01

The evaluation of a program's compliance with service delivery and features necessary for the attainment of the program's educational objectives, student outcomes and continuous improvement is an important element in program accreditation and continuous improvement process. The study reported in this paper investigated the possible effects of…

Empowering Organizations: Approaches to Tobacco Control through Youth Empowerment Programs

ERIC Educational Resources Information Center

LeRoy, Lisa; Benet, Dana Jones; Mason, Theresa; Austin, W. David; Mills, Sherry

2004-01-01

Whereas most evaluations of youth empowerment focus on individual outcomes (i.e., were individual youths empowered?), this article focuses on the program as the unit of analysis and seeks to explain how organizational structures, program design features, and processes lead to organizational empowerment (OE). OE is defined as organizational efforts…

Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.