Non-formal educator use of evaluation results.
Baughman, Sarah; Boyd, Heather H; Franz, Nancy K
2012-08-01
Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.
Some Methods for Evaluating Program Implementation.
ERIC Educational Resources Information Center
Hardy, Roy A.
An approach to evaluating program implementation is described. This approach includes the development of a project description which includes a structure matrix, sampling from the structure matrix, and preparing an implementation evaluation plan. The implementation evaluation plan should include: (1) verification of implementation of planned…
An Evaluation System for the Online Training Programs in Meteorology and Hydrology
ERIC Educational Resources Information Center
Wang, Yong; Zhi, Xiefei
2009-01-01
This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…
From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation
NASA Astrophysics Data System (ADS)
Shebby, S.
2015-12-01
Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.
Teacher Education Program Evaluation: An Annotated Bibliography and Guide to Research.
ERIC Educational Resources Information Center
Ayers, Jerry B.; Berney, Mary F.
This book includes an annotated bibliography of the essentials needed to conduct an effective evaluation of a teacher education program. Specific information on evaluation includes: (1) general evaluation techniques, (2) evaluation of candidates and students, (3) evaluation of the knowledge base, (4) quality controls, (5) evaluation of laboratory…
42 CFR 491.11 - Program evaluation.
Code of Federal Regulations, 2010 CFR
2010-10-01
... 42 Public Health 5 2010-10-01 2010-10-01 false Program evaluation. 491.11 Section 491.11 Public... Certification; and FQHCs Conditions for Coverage § 491.11 Program evaluation. (a) The clinic or center carries out, or arranges for, an annual evaluation of its total program. (b) The evaluation includes review of...
Evaluation of Environmental Education in Schools.
ERIC Educational Resources Information Center
Connect, 1984
1984-01-01
This newsletter discusses the evaluation of environmental education (EE) in schools, highlighting an introductory chapter of a proposed Unesco-United Nations environmental program guide on evaluating such programs. The benefits of evaluating an EE program (including program improvement, growth in student learning, better environment, and program…
Leisure Today. Leisure Programming: The State of the Art.
ERIC Educational Resources Information Center
Busser, James A.; And Others
1993-01-01
Nine articles examine current topics in leisure programing, including program design and evaluation, program design through imagery, keys to quality leisure programing, programing with style, total quality program planning, evaluation of leisure programs, programing for older adults, and the intergenerational entrepreneurship demonstration…
Design and Operation of the Transformed National Healthy Start Evaluation.
Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K
2017-12-01
Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.
Effective Practices for Evaluating Education and Public Outreach Programs
NASA Astrophysics Data System (ADS)
Wilkerson, S.
2013-12-01
Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.
Statewide ITS earmark evaluation, Part B : executive summary
DOT National Transportation Integrated Search
2003-11-01
As the recipient of ITS Integration Program funds, WisDOT is required to perform a self-evaluation on each program supported : by the funds. The report includes the results of that evaluation for five projects. Specific projects include: 1) Statewide...
A systematic review of evaluated suicide prevention programs targeting indigenous youth.
Harlow, Alyssa F; Bohanna, India; Clough, Alan
2014-01-01
Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.
Non-Formal Educator Use of Evaluation Results
ERIC Educational Resources Information Center
Baughman, Sarah; Boyd, Heather H.; Franz, Nancy K.
2012-01-01
Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational…
ERIC Educational Resources Information Center
Bhola, H. S.
Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…
Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.
ERIC Educational Resources Information Center
Heath, Robert W.; And Others
Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…
The Software Line-up: What Reviewers Look for When Evaluating Software.
ERIC Educational Resources Information Center
ELECTRONIC Learning, 1982
1982-01-01
Contains a check list to aid teachers in evaluating software used in computer-assisted instruction on microcomputers. The evaluation form contains three sections: program description, program evaluation, and overall evaluation. A brief description of a software evaluation program in use at the Granite School District in Utah is included. (JJD)
Modification and Adaptation of the Program Evaluation Standards in Saudi Arabia
ERIC Educational Resources Information Center
Alyami, Mohammed
2013-01-01
The Joint Committee on Standards for Educational Evaluation's Program Evaluation Standards is probably the most recognized and applied set of evaluation standards globally. The most recent edition of The Program Evaluation Standards includes five categories and 30 standards. The five categories are Utility, Feasibility, Propriety, Accuracy, and…
Responsive Meta-Evaluation: A Participatory Approach to Enhancing Evaluation Quality
ERIC Educational Resources Information Center
Sturges, Keith M.; Howley, Caitlin
2017-01-01
In an era of ever-deepening budget cuts and a concomitant demand for substantiated programs, many organizations have elected to conduct internal program evaluations. Internal evaluations offer advantages (e.g., enhanced evaluator program knowledge and ease of data collection) but may confront important challenges, including credibility threats,…
Adult Literacy Education: Program Evaluation and Learner Assessment. Information Series No. 338.
ERIC Educational Resources Information Center
Lytle, Susan L.; Wolfe, Marcie
Adult literacy programs need reliable information about program quality and effectiveness for accountability, improvement of practice, and expansion of knowledge. Evaluation and assessment reflect fundamental beliefs about adult learners, concepts of literacy, and educational settings. Resources for planning program evaluations include surveys,…
How To Design a Program Evaluation. CSE Program Evaluation Kit, Volume 3. Second Edition.
ERIC Educational Resources Information Center
Fitz-Gibbon, Carol Taylor; Morris, Lynn Lyons
The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…
Rorrer, Audrey S
2016-04-01
This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.
Colantonio, A
1989-01-01
Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.
Colantonio, A.
1989-01-01
Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498
Evaluation of Consumer Health Training and Education Programs.
ERIC Educational Resources Information Center
Kellogg, Muriel; And Others
PL89-749, passed in 1966, included a number of provisions for increasing participation of consumers in the improvement of the health care delivery system, including development of training programs to equip consumers for participation in the health planning process. The evaluation attempts to ascertain the direct effect of training programs on…
Evaluations of reproductive health programs in humanitarian settings: a systematic review
2015-01-01
Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and the results must be shared. The papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality. PMID:25685183
Issues Involved in the Evaluation of Gifted Programmes.
ERIC Educational Resources Information Center
Ali, A. Sidiq
2001-01-01
This article discusses the purpose of gifted program evaluation and identifies some of the pertinent issues involved in evaluating gifted programs. The gifted program delivered by the Peel District Board of Education in Ontario, Canada, is used to illustrate key evaluation considerations, including gifted identification procedures and gifted…
Kolomitro, Klodiana; Stockley, Denise; Egan, Rylan; MacDonald, Michelle L
2015-01-01
The Technology Evaluation in the Elderly Network (TVN) was funded in July 2012 under the Canadian Networks of Centres of Excellence program. This article highlights the development and preliminary evaluation of the TVN Interdisciplinary Training Program. This program is based on an experiential learning approach that crosses a multitude of disciplines including health sciences, law, social sciences, and ethical aspects of working with the frail elderly. Opportunities within the program include mentorship, interdisciplinary online collaborative projects, external placements, academic products, pre-grant submission, trainee-driven requirements, Network meetings, online modules/webinars, and most importantly active involvement with patients, families, and their support systems. The authors have 120 trainees from approximately 23 different disciplines including law, ethics, public policy, social work, and engineering engaged in the program. Based on our evaluation this program has been perceived as highly valuable by the participants and the community.
Experiments in evaluation capacity building: Enhancing brain disorders research impact in Ontario.
Nylen, Kirk; Sridharan, Sanjeev
2017-05-08
This paper is the introductory paper on a forum on evaluation capacity building for enhancing impacts of research on brain disorders. It describes challenges and opportunities of building evaluation capacity among community-based organizations in Ontario involved in enhancing brain health and supporting people living with a brain disorder. Using an example of a capacity building program called the "Evaluation Support Program", which is run by the Ontario Brain Institute, this forum discusses multiple themes including evaluation capacity building, evaluation culture and evaluation methodologies appropriate for evaluating complex community interventions. The goal of the Evaluation Support Program is to help community-based organizations build the capacity to demonstrate the value that they offer in order to improve, sustain, and spread their programs and activities. One of the features of this forum is that perspectives on the Evaluation Support Program are provided by multiple stakeholders, including the community-based organizations, evaluation team members involved in capacity building, thought leaders in the fields of evaluation capacity building and evaluation culture, and the funders. Copyright © 2017. Published by Elsevier Ltd.
ERIC Educational Resources Information Center
Brookland-Cayce Schools, West Columbia, SC.
An evaluation of the second phase of a projected 3-year Title III inservice reading instruction program for teaching personnel is presented after one and one-half years of operation in 16 Cayce-West Columbia, South Carolina, schools. Included is an evaluation prepared by each of the 11 elementary supervisors which includes objectives and how they…
Process Evaluation for a Prison-based Substance Abuse Program.
ERIC Educational Resources Information Center
Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick
2000-01-01
Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…
Program Evaluation in Gifted Education. Essential Readings in Gifted Education Series
ERIC Educational Resources Information Center
Callahan, Carolyn M., Ed.; Reis, Sally M., Ed.
2004-01-01
The readings in this ready-reference report on specific program evaluations, offer critical guidance in the development and utilization of instruments for assessing gifted and talented programs, and are designed to stimulate the discussion of issues surrounding the evaluation of gifted programs. Key features include: (1) Carolyn M. Callahan's…
Evaluation of a Community-Based Aging Intervention Program
ERIC Educational Resources Information Center
Hsu, Hui-Chuan; Wang, Chun-Hou; Chen, Yi-Chun; Chang, Ming-Chen; Wang, Jean
2010-01-01
This study evaluated the outcome and process of a community-based aging intervention program for the elderly in Taiwan. The program included education on nutrition and dietary behavior and on physical activities. Outcome and process evaluations were conducted. The program may have had some effects on decreasing some dietary behavioral problems and…
Practice guidelines for program evaluation in community-based rehabilitation.
Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel
2017-06-01
This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.
ERIC Educational Resources Information Center
Youtie, Jan; Bozeman, Barry; Shapira, Philip
1999-01-01
Describes an evaluability assessment of the Georgia Research Alliance (GRA), a technology development program. Presents the steps involved in conducting an evaluability assessment, including development of an understanding of the program and its stakeholders. Analyzes and compares different methods by which the GRA could be evaluated. (SLD)
State Guidelines for School Athletic Programs.
ERIC Educational Resources Information Center
California State Dept. of Education, Sacramento.
The guidelines presented here are designed to assist school personnel in developing, administering, and evaluating school athletic programs in California. Topics include: (1) the basic philosophy for school athletic programs; (2) procedures for evaluating school athletic programs; (3) the three-phase school athletic program; (4) resources to…
Recommended Resources for Planning to Evaluate Program Improvement Efforts (Including the SSIP)
ERIC Educational Resources Information Center
National Center for Systemic Improvement at WestEd, 2015
2015-01-01
This document provides a list of recommended existing resources for state Part C and Part B 619 staff and technical assistance (TA) providers to utilize to support evaluation planning for program improvement efforts (including the State Systemic Improvement Plan, SSIP). There are many resources available related to evaluation and evaluation…
Evaluation Design 1977-1978 ESEA Title VII Bilingual Program.
ERIC Educational Resources Information Center
Matuszek, Paula; And Others
A design for the evaluation of ESEA Title VII bilingual programs in the Austin Independent School District is presented. The following topics are included: (1) Evaluation Design Review Form; (2) decision questions including the actual questions addressed on three levels: the Office of Education-Level, the system-level and the project-level; (3) a…
Improving Accreditor's Evaluation of Experiential Learning Programs.
ERIC Educational Resources Information Center
Keeton, Morris T.
1980-01-01
Principles of good practice in assessing experiential learning include better self-evaluation of the learning outcomes of experiential components, systematic program auditing, and training of external evaluators. (SK)
Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.
Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson
2015-01-01
US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.
Planning, Implementation, and Evaluation of AIDS Education Programs for Dentists.
ERIC Educational Resources Information Center
Gerbert, Barbara; And Others
1991-01-01
An office-based continuing education program on acquired immune deficiency syndrome (AIDS) for dentists is described, including needs assessment, model development, local piloting, national implementation with 119 dentists, and evaluation phases. Program evaluation indicated an improvement in risk perception, knowledge, and practice resulted, but…
Evaluation of a seven state criminal history screening pilot program for long-term care workers.
Radcliff, Tiffany A; White, Alan; West, David R; Hurd, Donna; Côté, Murray J
2013-01-01
This article summarizes results from an evaluation of a federally sponsored criminal history screening (CHS) pilot program to improve screening for workers in long-term care settings. The evaluation addressed eight key issues specified through enabling legislation, including efficiency, costs, and outcomes of screening procedures. Of the 204,339 completed screenings, 3.7% were disqualified due to criminal history, and 18.8% were withdrawn prior to completion for reasons that may include relevant criminal history. Lessons learned from the pilot program experiences may inform a new national background check demonstration program.
ERIC Educational Resources Information Center
Guerrero, Frank; Abbott, Lori
This second volume of a four-volume evaluation of the 1988-89 New York City School Community Education Program (also known as the Umbrella Program) comprises reports evaluating nine innovative elementary school projects on social, ethnical, and environmental studies, four of which included staff development workshops. Evaluation sources included…
Mandarins and Lemons--The Executive Investment in Program Evaluation.
ERIC Educational Resources Information Center
MacDonald, Barry
The author contends that within executive government, which already has all the information it needs to make decisions, program evaluation is seen as a symbolic rather than a substantive enterprise. If it is assumed that program evaluation is an end of policy, not a means, the reasons for government investment in evaluation include: (1) no choice;…
Community outreach: from measuring the difference to making a difference with health information*
Ottoson, Judith M.; Green, Lawrence W.
2005-01-01
Background: Community-based outreach seeks to move libraries beyond their traditional institutional boundaries to improve both access to and effectiveness of health information. The evaluation of such outreach needs to involve the community in assessing the program's process and outcomes. Purpose: Evaluation of community-based library outreach programs benefits from a participatory approach. To explain this premise of the paper, three components of evaluation theory are paired with relevant participatory strategies. Concepts: The first component of evaluation theory is also a standard of program evaluation: use. Evaluation is intended to be useful for stakeholders to make decisions. A useful evaluation is credible, timely, and of adequate scope. Participatory approaches to increase use of evaluation findings include engaging end users early in planning the program itself and in deciding on the outcomes of the evaluation. A second component of evaluation theory seeks to understand what is being evaluated, such as specific aspects of outreach programs. A transparent understanding of the ways outreach achieves intended goals, its activities and linkages, and the context in which it operates precedes any attempt to measure it. Participatory approaches to evaluating outreach include having end users, such as health practitioners in other community-based organizations, identify what components of the outreach program are most important to their work. A third component of evaluation theory is concerned with the process by which value is placed on outreach. What will count as outreach success or failure? Who decides? Participatory approaches to valuing include assuring end-user representation in the formulation of evaluation questions and in the interpretation of evaluation results. Conclusions: The evaluation of community-based outreach is a complex process that is not made easier by a participatory approach. Nevertheless, a participatory approach is more likely to make the evaluation findings useful, ensure that program knowledge is shared, and make outreach valuing transparent. PMID:16239958
Revisioning the Process: A Case Study in Feminist Program Evaluation.
ERIC Educational Resources Information Center
Beardsley, Rebecca M.; Miller, Michelle Hughes
2002-01-01
Conducted a case study of the evaluation of a women's substance abuse prevention program and identified three key aspects of negotiated evaluation. Discusses the processes involved in feminist evaluation, including collaborative agenda setting and cooperative teamwork. (SLD)
Foreign Language K-12. Program Evaluation 1991-92.
ERIC Educational Resources Information Center
Wadden, Jerry M.
The Des Moines (Iowa) Public Schools foreign language program for K-12 is described and evaluated. The evaluation report focuses on six areas, including: (1) school district mission and philosophy of foreign language instruction; (2) context (state policies and standards, foreign language program overview and enrollment, fiber-optic communication…
ERIC Educational Resources Information Center
Repp, Charles A.; Brach, Ronald C.
The manual provides a rationale, procedural guidelines, time-schedules, instruments, and supporting documentation for student services program evaluation at SUNY Agricultural and Technical College, Delhi. Six procedural guidelines include: (1) all programs and services should be evaluated at least once every four years, with provision for annual…
A Program Evaluation of a Leadership Academy for School Principals
ERIC Educational Resources Information Center
Wagner, Kristi E.
2014-01-01
This program evaluation focused on mid-range outcomes of a leadership academy for school principals. The mixed-methods evaluation included interviews, principals' instructional observation database, and teacher surveys. The Principal Academy program was designed to build principals' knowledge of high-yield instructional strategies (Hattie, 2009),…
Evaluation of School Library Media Centers: Demonstrating Quality.
ERIC Educational Resources Information Center
Everhart, Nancy
2003-01-01
Discusses ways to evaluate school library media programs and how to demonstrate quality. Topics include how principals evaluate programs; sources of evaluative data; national, state, and local instruments; surveys and interviews; Colorado benchmarks; evaluating the use of electronic resources; and computer reporting options. (LRW)
Evaluating Math Drill and Practice Programs.
ERIC Educational Resources Information Center
Schnorr, Janice M.; Semmel, Dorothy S.
1986-01-01
General guidelines for a process evaluation of software for a specific subject and grade include: (1) Specify instructional objectives and list desired software program characteristics; (2) Access and review descriptions of programs (information sources for math programs are listed); (3) Preview software; and (4) Compare and make purchase…
Comparative Evaluation of Financing Programs: Insights From California’s Experience
DOE Office of Scientific and Technical Information (OSTI.GOV)
Deason, Jeff
Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less
ERIC Educational Resources Information Center
Forster, Greg; D'Andrea, Christian
2009-01-01
This study examines the Florida Tax Credit Scholarship program, one of the nation's largest school choice programs. It is the first ever completed empirical evaluation of a tax-credit scholarship program, a type of program that creates school choice through the tax code. Earlier reports, including a recent one on the Florida program, have not…
MiBLSi Program Evaluation of Participatory Elementary Schools from 2003-2009
ERIC Educational Resources Information Center
Gibbs, Marvin
2012-01-01
This dissertation details the use of the Program Evaluations Metaevaluation Checklist (PEMC), Stufflebeam, 1999, which is for performing final, summative metaevaluations. It is organized according to the Joint Committee Program Evaluation Standards. For each of the 30 standards the checklist includes 6 checkpoints drawn from the substance of the…
Healing by Creating: Patient Evaluations of Art-Making Program
ERIC Educational Resources Information Center
Heiney, Sue P.; Darr-Hope, Heidi; Meriwether, Marian P.; Adams, Swann Arp
2017-01-01
The benefits of using art in health care, especially with cancer patients, have been described anecdotally. However, few manuscripts include a conceptual framework to describe the evaluation of patient programs. This paper describes patients' evaluation of a healing arts program developed within a hospital for cancer patients that used art-making,…
Program Evaluation of Services for the Homeless: Challenges and Strategies.
ERIC Educational Resources Information Center
Mercier, Celine; And Others
1992-01-01
Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)
10 CFR 420.36 - Evaluation criteria.
Code of Federal Regulations, 2014 CFR
2014-01-01
... 10 Energy 3 2014-01-01 2014-01-01 false Evaluation criteria. 420.36 Section 420.36 Energy DEPARTMENT OF ENERGY ENERGY CONSERVATION STATE ENERGY PROGRAM Implementation of Special Projects Financial Assistance § 420.36 Evaluation criteria. The evaluation criteria, including program activity-specific...
10 CFR 420.36 - Evaluation criteria.
Code of Federal Regulations, 2011 CFR
2011-01-01
... 10 Energy 3 2011-01-01 2011-01-01 false Evaluation criteria. 420.36 Section 420.36 Energy DEPARTMENT OF ENERGY ENERGY CONSERVATION STATE ENERGY PROGRAM Implementation of Special Projects Financial Assistance § 420.36 Evaluation criteria. The evaluation criteria, including program activity-specific...
10 CFR 420.36 - Evaluation criteria.
Code of Federal Regulations, 2012 CFR
2012-01-01
... 10 Energy 3 2012-01-01 2012-01-01 false Evaluation criteria. 420.36 Section 420.36 Energy DEPARTMENT OF ENERGY ENERGY CONSERVATION STATE ENERGY PROGRAM Implementation of Special Projects Financial Assistance § 420.36 Evaluation criteria. The evaluation criteria, including program activity-specific...
10 CFR 420.36 - Evaluation criteria.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 10 Energy 3 2010-01-01 2010-01-01 false Evaluation criteria. 420.36 Section 420.36 Energy DEPARTMENT OF ENERGY ENERGY CONSERVATION STATE ENERGY PROGRAM Implementation of Special Projects Financial Assistance § 420.36 Evaluation criteria. The evaluation criteria, including program activity-specific...
10 CFR 420.36 - Evaluation criteria.
Code of Federal Regulations, 2013 CFR
2013-01-01
... 10 Energy 3 2013-01-01 2013-01-01 false Evaluation criteria. 420.36 Section 420.36 Energy DEPARTMENT OF ENERGY ENERGY CONSERVATION STATE ENERGY PROGRAM Implementation of Special Projects Financial Assistance § 420.36 Evaluation criteria. The evaluation criteria, including program activity-specific...
Program Evaluation: A Review and Synthesis.
ERIC Educational Resources Information Center
Webber, Charles F.
This paper reviews models of program evaluation. Major topics and issues found in the evaluation literature include quantitative versus qualitative approaches, identification and involvement of stakeholders, formulation of research questions, collection of data, analysis and interpretation of data, reporting of results, evaluation utilization, and…
Tailored program evaluation: Past, present, future.
Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B
2006-11-01
This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.
ERIC Educational Resources Information Center
DeHart, Dana
2010-01-01
This report describes process and outcome evaluation of an innovative program based in a women's maximum-security correctional facility. Methodology included review of program materials, unobtrusive observation of group process, participant evaluation forms, focus groups, and individual interviews with current and former program participants.…
Final Evaluation Report. 1976-1977. Title I Migrant Program. Publication Number: 76.59.
ERIC Educational Resources Information Center
Austin Independent School District, TX. Office of Research and Evaluation.
The final evaluation of the Elementary and Secondary Education Act Title I Migrant Program in the Austin, Texas Independent School District is reported. The program consisted of instructional, student recruitment, parental involvement, health services, and clothing components. The instructional component included programs for pre-kindergarten…
Assessing the Value of the Enviroscape Watershed Learning Module
ERIC Educational Resources Information Center
Edwards, Warren Patrick
2013-01-01
Scope and Method of Study: The researcher's evaluation of the West Atlanta Watershed Alliance's (WAWA) programs highlighted that few if any of the offered educational programs included a program evaluation, especially the most promising, the Enviroscape® Watershed learning module. The education programs that were customized and developed by the…
METRO Achievement Program: Summer 1988. External Evaluation Report.
ERIC Educational Resources Information Center
Thompson, Denise R.
This document comprises an evaluation of the 1988 METRO Achievement Program, a summer educational program to help develop the academic potential of primarily Black and Hispanic girls entering the seventh and eighth grades in Chicago. The 5-week program included the following components: (1) mathematics, science, and communication skills classes;…
McMahon, Shannon A; Brenner, Stephan; Lohmann, Julia; Makwero, Christopher; Torbica, Aleksandra; Mathanga, Don P; Muula, Adamson S; De Allegri, Manuela
2016-08-19
Gaps remain in understanding how performance-based incentive (PBI) programs affect quality of care and service quantity, whether programs are cost effective and how programs could be tailored to meet client and provider needs while remaining operationally viable. In 2014, Malawi's Ministry of Health launched the Service Delivery Integration-PBI (SSDI-PBI) program. The program is unique in that no portion of performance bonuses are paid to individual health workers, and it shifts responsibility for infrastructure and equipment procurement from facility staff to implementing partners. This protocol outlines an approach that analyzes processes and outcomes, considers expected and unexpected consequences of the program and frames the program's outputs relative to its costs. Findings from this evaluation will inform the intended future scale-up of PBI in Malawi. This study employs a prospective controlled before-and-after triangulation design to assess effects of the PBI program by analyzing quantitative and qualitative data from intervention and control facilities. Guided by a theoretical framework, the evaluation consists of four main components: service provision, health worker motivation, implementation processes and costing. Quality and access outcomes are assessed along four dimensions: (1) structural elements (related to equipment, drugs, staff); (2) process elements (providers' compliance with standards); (3) outputs (service utilization); (4) experiential elements (experiences of service delivery). The costing component includes costs related to start-up, ongoing management, and the cost of incentives themselves. The cost analysis considers costs incurred within the Ministry of Health, funders, and the implementing agency. The evaluation relies on primary data (including interviews and surveys) and secondary data (including costing and health management information system data). Through the lens of a PBI program, we illustrate how complex interventions can be evaluated via not only primary, mixed-methods data collection, but also through a wealth of secondary data from program implementers (including monitoring, evaluation and financial data), and the health system (including service utilization and service readiness data). We also highlight the importance of crafting a theory and using theory to inform the nature of data collected. Finally, we highlight the need to be responsive to stakeholders in order to enhance a study's relevance.
Assessing the Subsequent Effect of a Formative Evaluation on a Program.
ERIC Educational Resources Information Center
Brown, J. Lynne; Kiernan, Nancy Ellen
2001-01-01
Conducted a formative evaluation of an osteoporosis prevention health education program using several methods, including questionnaires completed by 256 women, and then compared formative evaluation results to those of a summative evaluation focusing on the same target group. Results show the usefulness of formative evaluation for strengthening…
ERIC Educational Resources Information Center
Nelson, Steve; Clark, Robey
Comparing program objectives with program outcomes, 4 program components targeted at 1,100 American Indian students in 9 school districts in Pierce County, Washington were evaluated. Program objectives operationalized by an 11-member staff including 9 specialists and 1 coordinator were to develop: (1) basic skills via tutoring services for…
Management of an affiliated Physics Residency Program using a commercial software tool.
Zacarias, Albert S; Mills, Michael D
2010-06-01
A review of commercially available allied health educational management software tools was performed to evaluate their capacity to manage program data associated with a CAMPEP-accredited Therapy Physics Residency Program. Features of these software tools include: a) didactic course reporting and organization, b) competency reporting by topic, category and didactic course, c) student time management and accounting, and d) student patient case reporting by topic, category and course. The software package includes features for recording school administrative information; setting up lists of courses, faculty, clinical sites, categories, competencies, and time logs; and the inclusion of standardized external documents. There are provisions for developing evaluation and survey instruments. The mentors and program may be evaluated by residents, and residents may be evaluated by faculty members using this feature. Competency documentation includes the time spent on the problem or with the patient, time spent with the mentor, date of the competency, and approval by the mentor and program director. Course documentation includes course and lecture title, lecturer, topic information, date of lecture and approval by the Program Director. These software tools have the facility to include multiple clinical sites, with local subadministrators having the ability to approve competencies and attendance at clinical conferences. In total, these software tools have the capability of managing all components of a CAMPEP-accredited residency program. The application database lends the software to the support of multiple affiliated clinical sites within a single residency program. Such tools are a critical and necessary component if the medical physics profession is to meet the projected needs for qualified medical physicists in future years.
Evaluating community-based public health leadership training.
Ceraso, Marion; Gruebling, Kirsten; Layde, Peter; Remington, Patrick; Hill, Barbara; Morzinski, Jeffrey; Ore, Peggy
2011-01-01
Addressing the nation's increasingly complex public health challenges will require more effective multisector collaboration and stronger public health leadership. In 2005, the Healthy Wisconsin Leadership Institute launched an annual, year-long intensive "community teams" program. The goal of this program is to develop collaborative leadership and public health skills among Wisconsin-based multisectoral teams mobilizing their communities to improve public health. To measure the scope of participation and program impacts on individual learning and practice, including application of new knowledge and collective achievements of teams on coalition and short-term community outcomes. End-of-year participant program evaluations and follow-up telephone interviews with participants 20 months after program completion. Community-based public health leadership training program. Sixty-eight participants in the Community Teams Program during the years 2006 to 2007 and 2007 to 2008. Professional diversity of program participants; individual learning and practice, including application of new knowledge; and collective achievements of teams, including coalition and short-term community outcomes. Participants in the Community Teams Program represent a diversity of sectors, including nonprofit, governmental, academic, business, and local public health. Participation increased knowledge across all public health and leadership competency areas covered in the program. Participating teams reported outcomes, including increased engagement of community leadership, expansion of preventive services, increased media coverage, strengthened community coalitions, and increased grant funding. Evaluation of this community-based approach to public health leadership training has shown it to be a promising model for building collaborative and public health leadership skills and initiating sustained community change for health improvement.
Evaluation of Teacher Training in a Title III Center.
ERIC Educational Resources Information Center
Reid, Ethna R.
This study is a report on a series of exemplary and instructional reading programs conducted by the Exemplary Center for Reading Instruction and designed to improve reading instruction in kindergarten through grade 12. The following topics are included: (1) evaluation of beginning reading programs, including materials selection, materials…
Assessment of Effectiveness in Preprimary and School Social Work Programs.
ERIC Educational Resources Information Center
Radin, Norma
A model for evaluating effectiveness in preschool and school social work programs is proposed. The paradigm has two major dimensions: criteria for evaluating success, and modalities for assessing whether the criteria have been met. Three criteria are suggested including improved views of significant others, and seven modalities including test…
Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence
Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson
2015-01-01
Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271
Evaluating AIDS Prevention: Contributions of Multiple Disciplines.
ERIC Educational Resources Information Center
Leviton, Laura C., Ed.; And Others
1990-01-01
Seven essays on efforts of evaluate prevention programs aimed at the acquired immune deficiency syndrome (AIDS) are presented. Topics include public health psychology, mathematical models of epidemiology, estimates of incubation periods, ethnographic evaluations of AIDS prevention programs, an AIDS education model, theory-based evaluation, and…
Code of Federal Regulations, 2011 CFR
2011-10-01
... Corporation will conduct independent evaluations of programs, including in-depth studies of selected programs... adversely affected by reductions in defense spending, or in areas that have an unemployment rate greater...
Alternatives to Piloting Textbooks.
ERIC Educational Resources Information Center
Muther, Connie
1985-01-01
Using short-term pilot programs to evaluate textbooks can lead to unreliable results and interfere with effective education. Alternative methods for evaluating textbook-based programs include obtaining documented analyses of competitors' products from sales agents, visiting districts using programs being considered, and examining publishers' own…
Program review: resource evaluation, reservoir confirmation, and exploration technology
DOE Office of Scientific and Technical Information (OSTI.GOV)
Ward, S.H.
1978-05-01
The details of the program review are reported. A summary of the recommendations, means for their implementation, and a six year program of expenditures which would accomplish the objectives of the recommendations are presented. Included in appendices are the following: DOE/DGE consortia participants; program managers contacted for opinion; communications received from program managers; participants, program review panel; and program strategy for resource evaluation and reservoir confirmation. (MHR)
An Evaluation of an Alternative Teacher Certification Program: A Matter of Trust
ERIC Educational Resources Information Center
Grubbs, Scott T.
2009-01-01
For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…
The Nature and Frequency of Inclusion of People with Disabilities in Program Evaluation
ERIC Educational Resources Information Center
Jacobson, Miriam R.; Azzam, Tarek; Baez, Jeanette G.
2013-01-01
Although evaluation theorists over the last two decades have argued for the importance of including stakeholders from marginalized groups in program planning and research, little is known about the degree of inclusion in program evaluation practice. In particular, we know little about the type and level of inclusion of people with intellectual,…
NASA Technical Reports Server (NTRS)
Berger, P. E.; Thornton, E. A.
1976-01-01
The APAS program a multistation structural synthesis procedure developed to evaluate material, geometry, and configuration with various design criteria usually considered for the primary structure of transport aircraft is described and evaluated. Recommendations to improve accuracy and extend the capabilities of the APAS program are given. Flow diagrams are included.
Chapter I Mathematics Program, 1983-84. Report of Evaluation.
ERIC Educational Resources Information Center
Tompkins, John F.
This report provides an evaluation of the Chapter I mathematics program for 1,020 first through eighth grade students in the Des Moines Independent Community School District. Included is a description of the program, information on program budget and expenditures, and narrative accounts of the attainment of 17 performance and process objectives.…
ERIC Educational Resources Information Center
Du Plessis, Karin; Green, Emma
2013-01-01
A financial awareness education program was implemented with construction industry apprentices in Victoria, Australia. The program included face-to-face delivery of education around a range of financial management issues that apprentices face as they begin their apprenticeship. The paper reports on an evaluation of the program, which included…
Laser Electro-Optic Engineering Technology. Florida Vocational Program Guide.
ERIC Educational Resources Information Center
University of South Florida, Tampa. Dept. of Adult and Vocational Education.
This program guide identifies particular considerations in the organization, operation, and evaluation of laser electro-optic engineering technology programs. Contents include an occupational description and information on the following: program content, including a curriculum framework that details major concepts and intended outcomes and a list…
Transition Room Program, 1967 Report.
ERIC Educational Resources Information Center
Glassner, Leonard E.
The Transition Room Program of the Pittsburgh Schools was defined and evaluated by the staff, the administration, and a program evaluator from the Office of Research. The definition included general objectives, anticipated outcomes, student criteria and characteristics, staff qualifications and functions, media, student activities, and staff…
Soliman, Amr S; Mullan, Patricia B; Chamberlain, Robert M
2010-06-01
This article describes the development and evaluation of an NCI-sponsored short-term summer cancer research education program. The study questions examined: the feasibility of conducting a cancer education program in special populations at multiple US and international field sites for masters students; the merit and worth that students and faculty attribute to the program; and students' scholarly and cancer-related career outcomes. Developing a new curriculum, increasing the pool of mentors, utilizing and increasing the number of field sites, and program dissemination were also evaluated. Evidence of the program's success included students' completion of field experiences at multiple sites and their subsequent 70% project-related publication rate, with 79% of trainees reporting themselves as likely to pursue future cancer-related careers. Evaluation-guided future plans for the program include implementing faculty development to further enhance the program outcomes.
Ahmed, Sara; Ware, Patrick; Visca, Regina; Bareil, Celine; Chouinard, Maud-Christine; Desforges, Johanne; Finlayson, Roderick; Fortin, Martin; Gauthier, Josée; Grimard, Dominique; Guay, Maryse; Hudon, Catherine; Lalonde, Lyne; Lévesque, Lise; Michaud, Cecile; Provost, Sylvie; Sutton, Tim; Tousignant, Pierre; Travers, Stella; Ware, Mark; Gogovor, Amede
2015-10-15
Seven chronic disease prevention and management programs were implemented across Quebec with funding support from a provincial-private industry funding initiative. Given the complexity of implementing integrated primary care chronic disease management programs, a knowledge transfer meeting was held to share experiences across programs and synthesize common challenges and success factors for implementation. The knowledge translation meeting was held in February 2014 in Montreal, Canada. Seventy-five participants consisting of 15 clinicians, 14 researchers, 31 knowledge users, and 15 representatives from the funding agencies were broken up into groups of 10 or 11 and conducted a strengths, weaknesses, opportunities, and threats analysis on either the implementation or the evaluation of these chronic disease management programs. Results were reported back to the larger group during a plenary and recorded. Audiotapes were transcribed and summarized using pragmatic thematic analysis. Strengths to leverage for the implementation of the seven programs include: (1) synergy between clinical and research teams; (2) stakeholders working together; (3) motivation of clinicians; and (4) the fact that the programs are evidence-based. Weaknesses to address include: (1) insufficient resources; (2) organizational change within the clinical sites; (3) lack of referrals from primary care physicians; and (4) lack of access to programs. Strengths to leverage for the evaluation of these programs include: (1) engagement of stakeholders and (2) sharing of knowledge between clinical sites. Weaknesses to address include: (1) lack of referrals; (2) difficulties with data collection; and (3) difficulties in identifying indicators and control groups. Opportunities for both themes include: (1) fostering new and existing partnerships and stakeholder relations; (2) seizing funding opportunities; (3) knowledge transfer; (4) supporting the transformation of professional roles; (5) expand the use of health information technology; and (6) conduct cost evaluations. Fifteen recommendations related to mobilisation of primary care physicians, support for the transformation of professional roles, and strategies aimed at facilitating the implementation and evaluation of chronic disease management programs were formulated based on the discussions at this knowledge translation event. The results from this knowledge translation day will help inform the sustainability of these seven chronic disease management programs in Quebec and the implementation and evaluation of similar programs elsewhere.
Evaluation of ridesharing programs in Michigan
DOE Office of Scientific and Technical Information (OSTI.GOV)
Kulp, G.; Tsao, H.J.; Webber, R.E.
1982-10-01
The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less
ERIC Educational Resources Information Center
Davis, Jamie D., Ed.; Erickson, Jill Shepard, Ed.; Johnson, Sharon R., Ed.; Marshall, Catherine A., Ed.; Running Wolf, Paulette, Ed.; Santiago, Rolando L., Ed.
This first symposium of the Work Group on American Indian Research and Program Evaluation Methodology (AIRPEM) explored American Indian and Alaska Native cultural considerations in relation to "best practices" in research and program evaluation. These cultural considerations include the importance of tribal consultation on research…
ERIC Educational Resources Information Center
Pasch, Marvin
Techniques and procedures used to evaluate the outcomes of the student development program, and to use the evaluation results, are presented. Specific evaluation questions are posed that address overall outcomes, not individual student outcomes, and quantitative measures are suggested to accompany the questions. The measures include statistical…
Evaluating Federal Education Programs.
ERIC Educational Resources Information Center
Baker, Eva L., Ed.
A series of papers was developed by the authors as part of their deliberations as members of the National Research Council's Committee of Program Evaluation in Education. The papers provide a broad range of present evaluative thinking. The conflict between preferences in evaluation methodology comes through in these papers. The selections include:…
Murayama, Hiroshi; Kojima, Tomoko; Tomaru, Meiko; Narabu, Harumi; Tachibana, Reiko; Yamaguchi, Takuhiro; Murashima, Sachiyo
2010-10-01
To examine the effectiveness of a program promoting network building between disciplinary agencies and informal community organizations (IGOs) comprising community residents, by implemention with staff of a community comprehensive support center (CJCSG). The program was implemented for nine staff of a GGSG in Setagaya Ward, Tokyo for a year. For process evaluation, items were assessed concerning the contents of the program such as satisfaction and understandability, participants' goal attainment level at each period of the program, and program satisfaction as a whole. Outcome evaluation included measurement of participants' self-efficacy regarding network building with ICOs before and after the program, using interviews of the members who completed the program. Eight out of the nine participants completed the program. All positively evaluated the contents of the program and their own goal attainment at each period of the program. After its completion, they felt highly satisfied. Moreover, there was an improvement in the cognition of the participants, including self-efficacy on network building with IGOs and the atmosphere in the GGSG with regard to network building. The efficacy of this program could be confirmed as demonstrated by the staff of the CCSC, although a more detailed assessment of validity and effectiveness will be necessary in the future.
Evaluation of an online continuing education program from the perspective of new graduate nurses.
Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike
2014-05-01
The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.
Lessons from the trenches: meeting evaluation challenges in school health education.
Young, Michael; Denny, George; Donnelly, Joseph
2012-11-01
Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.
Power, Sinead; Hegarty, Josephine
2010-01-01
Peer support programs are associated with the provision of emotional, informational, and appraisal support. The benefits of peer support for women with breast cancer include reduced social isolation, enhanced coping, and access to information. The aim of this study was to conduct a pre- and post-program evaluation of a 7-week facilitated breast cancer peer support program in a cancer support house. Women with primary breast cancer (n = 8) participated in pre- and post-program focus groups. The interviews were recorded and were transcribed verbatim by the researcher. The data were analyzed using content analysis. Eight themes were identified. The key themes emerging from the pre and post programme focus groups included: The need for mutual identification; Post-treatment isolation; Help with moving on; The impact of hair loss; Consolidation of information; Enablement/empowerment; The importance of the cancer survivor; Mutual sharing. It is essential that facilitated peer support programs are tailored to meet the support needs of women with breast cancer. There is a particular need to facilitate mutual sharing and support for hair loss within these programs. Implications for practice emerging from this study include the importance of pre- and post-program evaluations in identifying whether peer support programs meet the expectations of women with breast cancer, the need for peer/professional programs to support women with treatment-induced hair loss, the importance of including cancer survivors in support programs, and the need to allow more informal sharing to occur in facilitated peer support programs.
Evaluation of the 1987-1988 EIA Remedial and Compensatory Program.
ERIC Educational Resources Information Center
South Carolina State Dept. of Education, Columbia. Office of Research.
Evaluation of South Carolina's 1987-88 Remedial and Compensatory Program, funded by the state's Education Improvement Act of 1984 (EIA), shows that the program was successful in raising the participants' achievement. The programs include basic skills learning in reading and mathematics in all grades, and writing in grades 6-12, but not all grades…
ERIC Educational Resources Information Center
Underwood, Lee A.; Dailey, Frances L. L.; Merino, Carrie; Crump, Yolanda
2015-01-01
The results of the Program Evaluation show the OJJ Statewide Sex Offender Treatment program is exceptionally productive in meeting over 90% of its established performance markers. These markers included successful screening and assessment of risk and psychosocial needs, completion of initial and master treatment plans, establishment of sex…
The Evaluation of a North Carolina Truancy Intervention Program: Is It Culturally Sensitive?
ERIC Educational Resources Information Center
Carson, Deborah
2013-01-01
Truancy issues are longstanding and the desires to develop programs that are effective have been just as enduring. More striking is the lack of evidence of a truancy program evaluation process that includes collaboration with the clients that it serves. Truancy intervention programs have a wide range of effects on participants from multiple ethnic…
Sarah J. Hale High School Project SABER. ESEA Title VII. Final Evaluation Report, 1979-80.
ERIC Educational Resources Information Center
New York City Board of Education, Brooklyn, NY. Office of Educational Evaluation.
This is an evaluation of a Title VII Bilingual Program conducted at a New York City High School in 1979-80. The report contains information on the program goals and objectives, the school site, and the student characteristics. Aspects of the instructional component discussed include programming, mainstreaming, and program funding.…
ERIC Educational Resources Information Center
Chapman, Robert J.
This report presents descriptive and evaluative information on the Alcohol and Other Drug Program (A & D Program) developed at Pennsylvania's La Salle University and supported by the Fund for the Improvement of Postsecondary Education. The program includes an alcohol awareness project, a peer education program, a resident educator with A &…
ERIC Educational Resources Information Center
Stake, Robert E.; Gjerde, Craig
This evaluation of the Twin City Institute for Talented Youth, a summer program for gifted students in grades 9 through 12, consists of two parts: a description of the program; and the evaluators' assessments, including advocate and adversary reports. Achievement tests were not used for evaluation. Evaluative comments follow each segment of the…
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
1992-12-31
The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less
How To Design a Program Evaluation. Program Evaluation Kit, 3.
ERIC Educational Resources Information Center
Fitz-Gibbon, Carol Taylor; Morris, Lynn Lyons
The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…
Designing and evaluating a STEM teacher learning opportunity in the research university.
Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D
2014-04-01
This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.
Hardré, Patricia L; Slater, Janis; Nanny, Mark
2010-11-01
This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.
Evaluated community fire safety interventions in the United States: a review of current literature.
Ta, Van M; Frattaroli, Shannon; Bergen, Gwendolyn; Gielen, Andrea Carlson
2006-06-01
The purpose of the study was to assess the state of fire prevention research, provide an updated synthesis of evaluated fire prevention programs, and discuss the role of fire fighters and data systems in prevention efforts. The review included all evaluations of U.S. based fire prevention interventions published between January 1998 and September 2004 and any earlier articles about U.S. fire prevention interventions not included in two prior review articles. We retrieved information from each identified study including evaluation findings, involvement of fire service personnel and use of existing data systems. We identified twelve articles: seven reported on smoke alarm interventions, three on multi-faceted programs, and two other programs. Five programs involved fire service personnel in the design, implementation, and/or evaluation, and three used existing data systems. Studies reviewed suggest that canvassing and smoke alarm installations are the most effective means of distributing alarms and increasing the functional status of distributed alarms. The functionality of smoke alarms, an issue noted in earlier reviews, remains a problem. Programs involving partnerships with fire departments have indicated success in preventing fires and deaths, improving smoke alarm ownership and functional status, and improving children's fire safety knowledge. Using existing data systems to target and to evaluate interventions was effective. In the years since prior reviews, some improvements in the rigor of evaluation designs have been made, but there is still a need for high quality evaluations that will inform fire injury prevention efforts.
ERIC Educational Resources Information Center
Washington, Taren L.
2015-01-01
This study evaluated a comprehensive mentoring program on selected at-risk students with specific school problems (attendance, discipline referrals, and core area grades). The sample included youths in Grades 4-8 who differed on some characteristics including grade-level, ethnicity, and gender. For the purpose of this mixed methods study, the…
NASA Astrophysics Data System (ADS)
Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.
2014-07-01
The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.
The iEvaluate OSD Guidelines and Exemplars: A Disability Services Evaluation Tool
ERIC Educational Resources Information Center
Dukes, Lyman, III
2011-01-01
Program evaluation is rapidly becoming the norm in higher education and this includes disability services. Postsecondary institutions increasingly encourage disability service programs to demonstrate accountability specified through appropriate benchmarks. However, professionals in disability service offices typically report that while they…
Evaluation of overhead support inspection program.
DOT National Transportation Integrated Search
2015-01-01
This study evaluated the adequacy and frequency of the current structural support inspection program for overhead : sign supports (including bridge mounted), mast arm signal supports and high mast light supports. While ODOT provides : statewide guida...
Building Evaluation Capacity in Local Programs for Multisite Nutrition Education Interventions
ERIC Educational Resources Information Center
Fourney, Andrew; Gregson, Jennifer; Sugerman, Sharon; Bellow, Andrew
2011-01-01
From 2004-2008, capacity to conduct program evaluation was built among the "Network for a Healthy California's" 48 largest local partners. Capacity building was done within a framework of Empowerment Evaluation and Utility-Focused evaluation. Tools included: a Scope of Work template, a handbook, a compendium of surveys, an evaluation…
Program Impact Evaluations: An Introduction for Managers of Title VII Projects. A Draft Guidebook.
ERIC Educational Resources Information Center
Bissell, Joan S.
Intended to assist administrators in the planning, management, and utilization of evaluation, this guidebook is designed as an introduction and supplement to other evaluation materials for bilingual education programs being developed under federal sponsorship, including evaluation models for Title VII projects. General information is provided on…
Students Training for Academic Readiness (STAR): Year Three Evaluation Report
ERIC Educational Resources Information Center
Rainey, Katharine; Sheehan, Daniel; Maloney, Catherine
2010-01-01
This report presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation considers…
Taiji for individuals with Parkinson disease and their support partners: a program evaluation.
Klein, Penelope J; Rivers, Lynn
2006-03-01
Exercise is advocated in the management of Parkinson disease (PD), however, little is known regarding the potential benefits of complementary mind/body exercise for this clinical population. The purpose of this pilot program evaluation was to gain insight into participant and instructor perceptions of the perceived benefits and potential utility of a taiji exercise program. Program participants (N=15) included 8 individuals with PD and 7 support partners with no history of PD. Group taiji instruction was offered in 45-minute weekly sessions, for 12 weeks at a community facility. Post-program evaluation included administration of a survey questionnaire, thematic analysis of a focus group discussion, instructor reflections, and review of attendance records. Benefits were perceived by participants in physical, psychological, and social domains. Thirteen of the survey respondents, including 6 of the 8 respondents with PD reported perceiving a physical benefit attributed to taiji practice. Improved balance was reported most frequently. Instructor observations and participant testimony suggest movement capability for individuals with Parkinsons may also be improved by performing taiji. This preliminary research provides support for further Taiji Buddy program examination and application.
An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.
Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M
1982-01-01
Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues.
An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.
Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M
1982-01-01
Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues. PMID:7096223
Outcome Evaluation of the Hands-On Parent Empowerment (HOPE) Program
ERIC Educational Resources Information Center
Leung, Cynthia; Tsang, Sandra; Dean, Suzanne
2011-01-01
This study evaluated the effectiveness of the HOPE program. Participants included 120 Chinese new immigrant parents with preschool children in Hong Kong from 13 preschools which were randomized into intervention group (HOPE) and comparison group (6-session parent education program). Parent participants completed measures on child behavior,…
Utilizing Staff Perceptions to Guide and Shape Future Program Planning
ERIC Educational Resources Information Center
Sherwood, Heather
2010-01-01
This paper describes an action research project evaluating an elementary school counseling program in a large suburban Georgia city. Using staff surveys (which include homeroom teachers as well as support teachers and paraprofessionals), interviews, and researcher observations the program was evaluated to determine strengths and weaknesses. The…
Health Services, Student Services Department: Program Evaluation. 1990-91.
ERIC Educational Resources Information Center
Jeschke, Thomas; And Others
This document evaluates the Des Moines Public Schools health services and education program, which utilizes the professional expertise of school nurses throughout the district. The program promotes success in the learning process for students (including those with complex health care needs, conditions, and disabilities), employees, and the…
Distance Education: A Consumer's Guide. What Distance Learners Need To Know.
ERIC Educational Resources Information Center
Western Interstate Commission for Higher Education, Boulder, CO. Western Cooperative for Educational Communications.
This pamphlet is intended to assist the consumer in making informed decisions when choosing between distance learning programs. Distance education and distance learners are defined. Included is advice on beginning a program search; choosing a school; accreditation; evaluating quality of electronically offered programs; evaluate non-accredited…
45 CFR 2522.700 - How does evaluation differ from performance measurement?
Code of Federal Regulations, 2010 CFR
2010-10-01
... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...
Program Review/Evaluation Policy and Procedures.
ERIC Educational Resources Information Center
Colorado Northwestern Community Coll., Rangely.
At Colorado Northwestern Community College (CNCC), all educational programs, as well as student services and support functions, are formally reviewed/evaluated in depth at least once every five years. This nine-part outline, providing a step-by-step description of the program review process at CNCC, includes the following sections: (1) the value…
7 CFR 1486.209 - How are program applications evaluated and approved?
Code of Federal Regulations, 2011 CFR
2011-01-01
... or new uses. Examples include food service development, market research on potential for consumer... MARKETS PROGRAM Eligibility, Applications, and Funding § 1486.209 How are program applications evaluated... affecting the level of U.S. exports and market share for the agricultural commodity/product; (4) The degree...
ERIC Educational Resources Information Center
Turner, Gordon; And Others
This courseware evaluation rates a set of 25 industrial education general software programs developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include measurement drill, fraction drill, loan and interest cost analysis, assault vehicle speeds, sun's rays, Ohm's law, concrete calculations, roof…
Wood Programs. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Kaylor, Robert; And Others
This courseware evaluation rates the Wood Programs software developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include understanding board feet, wood characteristics, wood safety drill, wood dimensions, wood moisture, operating the table saw, radial arm, measurement drill, fraction drill, and…
ERIC Educational Resources Information Center
Sarle, Ruth; And Others
This courseware evaluation rates the "Microcomputer Applications in Vocational Education: Home Economics" program developed by the Illinois State Board of Education. (This series of programs--not contained in this document--includes interior decorating estimating, pounds away program, decision analysis, fiber care, clothing figure…
CAI Programs and Macros for Formative Curriculum Evaluation.
ERIC Educational Resources Information Center
Dasenbrock, David; Teates, Thomas
This technical memo is designed for persons who are interested in research with and development of curriculum material. Detailed information regarding computer programs, and program documentation used in the development and evaluation of ISCS curriculum materials is provided. The memo includes supplemental information to ISCS Technical Report I…
Evaluation of an Educational Program for Adolescents with Asthma
ERIC Educational Resources Information Center
Berg, Jill; Tichacek, Mary J.; Theodorakis, Renee
2004-01-01
In addition to challenges of adolescence itself, teens with asthma face demands of asthma management and risks of asthma sequelae, including fatalities. Few asthma educational programs specifically address their needs. In response to school nurse concern, this pilot study evaluated an adolescent asthma education program, the "Power Breathing[TM]…
Supporting School Leaders in Blended Learning with Blended Learning
ERIC Educational Resources Information Center
Acree, Lauren; Gibson, Theresa; Mangum, Nancy; Wolf, Mary Ann; Kellogg, Shaun; Branon, Suzanne
2017-01-01
This study provides a mixed-methods case-study design evaluation of the Leadership in Blended Learning (LBL) program. The LBL program uses blended approaches, including face-to-face and online, to prepare school leaders to implement blended learning initiatives in their schools. This evaluation found that the program designers effectively…
RISE-306; State Facilitator Program Evaluation, 1975-1976.
ERIC Educational Resources Information Center
Communication Technology Corp., Marlton, NJ.
As an arm of the National Diffusion Network, the Pennsylvania State Facilitator's responsibilities include informing the schools about Title III approved programs and aiding in the actual adoption of such programs by school districts. Two aspects of the facilitator's role were identified for evaluation: (1) whether the facilitator had implemented…
Bean, Corliss N; Forneris, Tanya; Halsall, Tanya
2014-01-01
Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.
A natural history of behavioral health program evaluation in Arizona.
Braun, S H; Irving, D
1984-01-01
This article examines the history of behavioral health program evaluation efforts in the state of Arizona during the years 1974-1982. Program Evaluation in Arizona has been carried out in an environment where planning, monitoring, contracting, appropriations, and evaluation have been inter-related--sometimes loosely, sometimes closely. Here we trace the year-by-year evolution of the evaluation system and its connections with the other parts of the environment. This history illustrates the gradual development of an evaluation system in an organizational context, including the sidetracks and setbacks .
Base Realignment and Closure Environmental Evaluation (BRAC EE) Fort Devens, Massachusetts
1995-09-01
Not Sampled ......... 6 2.3.2 Transformer Sites Sampled ........................ 7 2.4 Soil Sampling Protocol and Analytical Program ...Evaluation (AREE) 66. The study included evaluating the current PCB Transformer Management Program administered by the Fort Devens Environmental Management...Office (EMO), the Fort Devens Spill Contingency Plan, and the ongoing transformer inspection program . Personnel in both the Fort Devens EMO and the Fort
ERIC Educational Resources Information Center
Murphy, Philip J.
The paper reports the final evaluation of a program for approximately 143 learning disabled (LD) students (grades 6-to-12) from six school districts. A number of test instruments were used to evaluate student progress during the program, including the Wide Range Achievement Test (WRAT), the Durrell Analysis of Reading Difficulty, and the…
Resident Evaluation and Remediation: A Comprehensive Approach
Wu, Jim S.; Siewert, Bettina; Boiselle, Phillip M.
2010-01-01
Background A comprehensive evaluation and remediation program is an essential component of any residency program. The evaluation system should identify problems accurately and early and allow residents with problems to be assigned to a remediation program that effectively deals with them. Elements of a proactive remediation program include a process for outlining deficiencies, providing resources for improvement, communicating clear goals for acceptable performance, and reevaluating performance against these goals. Intervention In recognition of the importance of early detection and prompt remediation of the struggling resident, we sought to develop a multifaceted approach to resident evaluation with the aim of early identification and prompt remediation of difficulties. This article describes our comprehensive evaluation program and remediation program, which uses resources within our radiology department and institutional graduate medical education office. Discussion An effective evaluation system should identify problems accurately and early, whereas a proactive remediation program should effectively deal with issues once they are identified. PMID:21975628
New York City Russian Bilingual Program, 1981-1982. O.E.E. Final Evaluation Report.
ERIC Educational Resources Information Center
New York City Board of Education, Brooklyn, NY. Office of Educational Evaluation.
The New York City Russian Bilingual Program, evaluated here, serves students in grades 9-12 in three public and eight private schools. Three groups of subjects are included in the program: English as a second language, native language arts, and content-area subjects. All students take some mainstream classes from the beginning of the program. In…
Hanford internal dosimetry program manual
DOE Office of Scientific and Technical Information (OSTI.GOV)
Carbaugh, E.H.; Sula, M.J.; Bihl, D.E.
1989-10-01
This document describes the Hanford Internal Dosimetry program. Program Services include administrating the bioassay monitoring program, evaluating and documenting assessments of internal exposure and dose, ensuring that analytical laboratories conform to requirements, selecting and applying appropriate models and procedures for evaluating internal radionuclide deposition and the resulting dose, and technically guiding and supporting Hanford contractors in matters regarding internal dosimetry. 13 refs., 16 figs., 42 tabs.
ERIC Educational Resources Information Center
Zucker, Marla; Spinazzola, Joseph; Pollack, Amie Alley; Pepe, Lauren; Barry, Stephanie; Zhang, Lynda; van der Kolk, Bessel
2010-01-01
This study replicated and extended our previous evaluation of Urban Improv (UI), a theater-based youth violence prevention (YVP) program developed for urban youth. It assessed the replicability of positive program impacts when implemented by nonprogram originators, as well as the utility of a comprehensive version of the UI program that included a…
ERIC Educational Resources Information Center
Martin, Wendy; Strother, Scott; Weatherholt, Tara; Dechaume, Merav
2008-01-01
The eMINTS professional development programs are designed to help teachers learn how to integrate technology into their teaching, using instructional strategies that promote inquiry-based learning and encourage collaboration and community building among students and teachers. The eMINTS programs considered in this evaluation include: (1) eMINTS…
ERIC Educational Resources Information Center
Chen, Ming-Puu
2009-01-01
The purpose of this study was to examine the appropriateness of a nationwide quality assurance framework for e-learning from participants' perspectives. Two types of quality evaluation programs were examined in this study, including the e-Learning Service Certification program (eLSC) and the e-Learning Courseware Certification program (eLCC). Gap…
ERIC Educational Resources Information Center
Prevost, Luanna B.; Vergara, Claudia E.; Urban-Lurain, Mark; Campa, Henry, III.
2018-01-01
Higher education institutions prepare future faculty members for multiple roles, including teaching. However, teaching professional development programs for graduate students vary widely. We present evaluation data from a high engagement program for STEM doctoral students. We analyzed the impact on three cohorts of participants over three academic…
NASA Technical Reports Server (NTRS)
Benbenek, Daniel; Soloff, Jason; Lieb, Erica
2010-01-01
Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.
Meeting the Pepsi Challenge: Preparing Evaluation Programs for Scholastic Improvement.
ERIC Educational Resources Information Center
Hopkins, Mona S.
This document provides guidelines for preparing evaluation programs for scholastic improvement. The philosophy underlying assessment and accountability is discussed, with specific reference to the positive and negative aspects of assessment. The design of a curriculum evaluation model is presented, including goal identification, data gathering,…
8 CFR 212.15 - Certificates for foreign health care workers.
Code of Federal Regulations, 2012 CFR
2012-01-01
... for authorization to issue such certificates. The DHS will evaluate CGFNS' expertise with respect to... 8 CFR 103.3. (k) Standards for credentialing organizations. The DHS will evaluate organizations... resources to conduct the program(s) including the authority to approve selection of, evaluate, and initiate...
8 CFR 212.15 - Certificates for foreign health care workers.
Code of Federal Regulations, 2014 CFR
2014-01-01
... for authorization to issue such certificates. The DHS will evaluate CGFNS' expertise with respect to... 8 CFR 103.3. (k) Standards for credentialing organizations. The DHS will evaluate organizations... resources to conduct the program(s) including the authority to approve selection of, evaluate, and initiate...
8 CFR 212.15 - Certificates for foreign health care workers.
Code of Federal Regulations, 2013 CFR
2013-01-01
... for authorization to issue such certificates. The DHS will evaluate CGFNS' expertise with respect to... 8 CFR 103.3. (k) Standards for credentialing organizations. The DHS will evaluate organizations... resources to conduct the program(s) including the authority to approve selection of, evaluate, and initiate...
Participation versus Privacy in the Training of Group Counselors.
ERIC Educational Resources Information Center
Pierce, Keith A.; Baldwin, Cynthia
1990-01-01
Examines the process of requiring and evaluating personal growth group participation for students in counselor education programs. Discusses the key components in the dilemma of protecting privacy while evaluating competencies, including ethical practices and program alternatives to avoid evaluation. Proposes a model that will enable participation…
Training of Personnel to Work with Young Children in India.
ERIC Educational Resources Information Center
Kahalakdina, M.
1984-01-01
Describes recruitment procedures for child care workers in India. Includes a description of training programs, training needs and approaches, and curriculum and training procedures. Monitoring and evaluation of child welfare programs are discussed. Appendices include descriptions of and norms for training programs. (AS)
DOE Office of Scientific and Technical Information (OSTI.GOV)
Schuster, E.G.; Jones, J.G.; Meacham, M.L.
1995-08-01
Presents a guide to operation and interpretation of TSPAS Sale Program (TSPAS SP), a menu-driven computer program that is one of two programs in the Timber Sale Planning and Analysis System. TSPAS SP is intended to help field teams design and evaluate timber sale alternatives. TSPAS SP evaluate current and long-term timber implications along with associated nontimber outputs. Features include multiple entries and products, real value change, and graphical input. Guide includes user instructions, a glossary, a listing of data needs, and an explanation of error messages.
Seeff, Laura C; DeGroff, Amy; Joseph, Djenaba A; Royalty, Janet; Tangka, Florence K L; Nadel, Marion R; Plescia, Marcus
2013-08-01
The Centers for Disease Control and Prevention (CDC) established and supported a 4-year Colorectal Cancer Screening Demonstration Program (CRCSDP) from 2005 to 2009 for low-income, under- or uninsured men and women aged 50-64 at 5 sites in the United States. A multiple methods evaluation was conducted including 1) a longitudinal, comparative case study of program implementation, 2) the collection and analysis of client-level screening and diagnostic services outcome data, and 3) the collection and analysis of program- and patient-level cost data. Several themes emerged from the results reported in the series of articles in this Supplement. These included the benefit of building on an existing infrastructure, strengths and weakness of both the 2 most frequently used screening tests (colonoscopy and fecal occult blood tests), variability in costs of maintaining this screening program, and the importance of measuring the quality of screening tests. Population-level evaluation questions could not be answered because of the small size of the participating population and the limited time frame of the evaluation. The comprehensive evaluation of the program determined overall feasibility of this effort. Critical lessons learned through the implementation and evaluation of the CDC's CRCSDP led to the development of a larger population-based program, the CDC's Colorectal Cancer Control Program (CRCCP). © 2013 American Cancer Society.
State Compliance Monitoring Expectations | ECHO | US EPA
EPA sets national goals for how frequently facilities should be evaluated by the authorized enforcement agency for three programs included in ECHO (Clean Air Act, Clean Water Act, and Resource Conservation and Recovery Act). EPA develops Compliance Monitoring Strategies (CMSs) to ensure that the regulated facilities across the country are evaluated for compliance on a regular basis. Information on CMSs, evaluations (such as on-site inspections), and inspection frequency goals that are defined by each program is included.
Evaluation through research of a three-track career ladder program for registered nurses.
Korman, Carol; Eliades, Aris Beoglos
2010-01-01
A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.
Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F
2016-06-01
Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.
NASA Technical Reports Server (NTRS)
Shaykhian, Gholam Ali
2007-01-01
C++ Programming Language: The C++ seminar covers the fundamentals of C++ programming language. The C++ fundamentals are grouped into three parts where each part includes both concept and programming examples aimed at for hands-on practice. The first part covers the functional aspect of C++ programming language with emphasis on function parameters and efficient memory utilization. The second part covers the essential framework of C++ programming language, the object-oriented aspects. Information necessary to evaluate various features of object-oriented programming; including encapsulation, polymorphism and inheritance will be discussed. The last part of the seminar covers template and generic programming. Examples include both user defined and standard templates.
Hopfer, S; Davis, D; Kam, J A; Shin, Y; Elek, E; Hecht, M L
2010-01-01
This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary school-based substance use prevention programs were reviewed. The study selection criteria included searching for program evaluations from 1980 to 2008. Among 27 evaluation studies that examined program effects on substance use, 56% (n = 15) found significant decreases. In addition, programs most often demonstrated effects on increasing negative substance use attitudes, increasing knowledge, decreasing perceptions of prevalence rates (i.e., descriptive norms), and improving resistance skills. These results have implications for the appropriateness and value of introducing substance use prevention programs to youth in elementary school.
ERIC Educational Resources Information Center
Kao, Chen-yao
2012-01-01
This study examines the current problems affecting Taiwan's gifted education through a large-scale gifted program evaluation. Fifty-one gifted classes at 15 elementary schools and 62 gifted classes at 18 junior high schools were evaluated. The primary activities included in this biennial evaluation were document review, observation of…
ERIC Educational Resources Information Center
Texas State Dept. of Human Resources, Austin.
This evaluation report describes programs funded by the Texas Department of Human Resources to develop and implement child abuse and neglect services. Yearly evaluation reports and other related information are included for each of the seven programs funded. In addition to this basic information, the evaluation of the Special Investigative…
Cyber-Evaluation: Evaluating a Distance Learning Program.
ERIC Educational Resources Information Center
Henderson, Denise L.
This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…
Widening Our Evaluative Lenses of Formal, Facilitated, and Spontaneous Academic Development
ERIC Educational Resources Information Center
Hoessler, Carolyn; Godden, Lorraine; Hoessler, Brian
2015-01-01
As conceptions of academic development expand to encompass a more diverse and flexible set of supports, traditional approaches to evaluation, including impact studies of formal programming, become insufficient. A program may appear ineffective when evaluation ignores additional supports that interact to counteract implementation or alternatively…
Evaluation of an Annual Community-Focused Agricultural Literacy Event
ERIC Educational Resources Information Center
Sandlin, M'Randa R.; Perez, Kauahi
2017-01-01
Agricultural literacy programs are effective pathways to informally teach the public about agriculture through stakeholder (attendee and exhibitor) interaction. Such programs are generally evaluated using attendee feedback but fail to include exhibitors' experience. The purpose of this study was to evaluate a local community agricultural event by…
ACORN's Accelerated Income Redistribution Project: A Program Evaluation
ERIC Educational Resources Information Center
Brooks, Fred; Russell, Daniel; Fisher, Robert
2006-01-01
Objective: This study evaluated the Association of Community Organizations for Reform Now's (ACORN) efforts to increase the uptake of families claiming the earned income tax credit through door-to-door canvassing and managing free tax preparation clinics in three pilot cities. Method: The mixed-method program evaluation included administrative…
In Vitro Evaluation of a Program for Machine-Aided Indexing.
ERIC Educational Resources Information Center
Jacquemin, Christian; Daille, Beatrice; Royaute, Jean; Polanco, Xavier
2002-01-01
Presents the human evaluation of ILIAD, a program for machine-aided indexing that was designed to assist expert librarians in computer-aided indexing and document analysis. Topics include controlled indexing and free indexing; natural language and concept-based information retrieval; evaluation methodology; syntactic variations; and a comparison…
Evaluating the Child Care Director: The Collaborative Professional Assessment Process.
ERIC Educational Resources Information Center
Freeman, Nancy K.; Brown, Mac H.
2000-01-01
Describes the Collaborative Professional Assessment Process (CPAP) to guide the evaluation of the director of early childhood programs. Examines the assumptions upon which the CPAP is based. Lists the management skills and leadership abilities of successful child care directors. Includes the Director Self-Evaluation form and a program evaluation…
Doing Your Community Education Evaluation: A Guide.
ERIC Educational Resources Information Center
Young, Malcolm B.; And Others
Intended to assist in the evaluation of community education programs, this guide is for program decision makers, primarily at the local level, including staff of school districts, park and recreation departments, other local and state agencies, and private citizens serving on community education boards and councils. Part 1, Evaluation and…
The Boeing Company's Manufacturing Technology Student Internship. Evaluation Report (1994-95).
ERIC Educational Resources Information Center
Wang, Changhua; Owens, Thomas R.
An evaluation was conducted of the Boeing Company's summer internship program for students enrolled in a manufacturing technology program after grades 11, 12, and 13 (first year of community college). The evaluation included the following activities: a review of documents describing the internship structure, student selection process, and…
ERIC Educational Resources Information Center
Research for Better Schools, Inc., Philadelphia, PA.
The process for providing a "thorough and efficient" (T & E) education according to New Jersey statutes and regulations involves six basic steps. This document suggests procedures for handling the fifth step, educational program evaluation. Processes discussed include committee formation, evaluation planning, action plan…
Urban Rail Supporting Technology Program Fiscal Year 1974 Year End Summary
DOT National Transportation Integrated Search
1975-03-01
Major areas include program management, technical support and application engineering, facilities development, test and evaluation, and technology development. Specific technical discussion includes track measurement systems; UMTA facilities developm...
NURSING 911: an orientation program to improve retention of online RN-BSN students.
Gilmore, Melanie; Lyons, Evadna M
2012-01-01
This article describes the implementation and evaluation of an eight-hour, comprehensive, face-to-face orientation program designed to improve student retention in a newly developed online RN to BSN program. A total of 179 newly enrolled RN to BSN students participated in the orientation program and evaluated the process. Student attrition decreased from 20 percent to less than 1 percent after the orientation program was extended and improved to include a technology assessment and an online practice course. A quality online program requires a well-designed orientation that includes technological assessments and hands-on, active participation by the learner. The newly improved and designed course has become effective in student retention and transition into the online learning environment.
ERIC Educational Resources Information Center
Dodd, Carol Ann
This study explores a technique for evaluating teacher education programs in terms of teaching competencies, as applied to the Indiana University Mathematics Methods Program (MMP). The evaluation procedures formulated for the study include a process product design in combination with a modification of Pophan's performance test paradigm and Gage's…
Cost Savings Threshold Analysis of a Capacity-Building Program for HIV Prevention Organizations
ERIC Educational Resources Information Center
Dauner, Kim Nichols; Oglesby, Willie H.; Richter, Donna L.; LaRose, Christopher M.; Holtgrave, David R.
2008-01-01
Although the incidence of HIV each year remains steady, prevention funding is increasingly competitive. Programs need to justify costs in terms of evaluation outcomes, including economic ones. Threshold analyses set performance standards to determine program effectiveness relative to that threshold. This method was used to evaluate the potential…
ERIC Educational Resources Information Center
Taylor, William H.
The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…
Innovations in Doctoral Education: Distance Education Methodology Applied
ERIC Educational Resources Information Center
Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan
2009-01-01
This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…
Who Am I? Self-Exploration Series 1. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Miller, Sandra; And Others
This courseware evaluation rates the Who Am I? program developed by Instructional Enterprises. (This program--not contained in this document--is an interactive guidance course including four inventories students use to learn more about themselves.) Part A describes the program in terms of subject area (personal development) and hardware…
ERIC Educational Resources Information Center
Levin, Sandra R.; Levin, James A.; Guell, James G.; Waddoups, Gregory L.
2002-01-01
Describes a Master of Education program at the University of Illinois, Urbana-Champaign called Curriculum, Technology, and Education Reform OnLine (CTER) that is aimed at K-12 teachers. The evaluation based on program stakeholders includes interface design; instructional design; faculty satisfaction; student attitudes; economic viability;…
ERIC Educational Resources Information Center
Zaback, Tosha; Becker, Thomas M.; Dignan, Mark B.; Lambert, William E.
2010-01-01
In this article, the authors describe a unique summer program to train American Indian/Alaska Native (AI/AN) health professionals in a variety of health research-related skills, including epidemiology, data management, statistical analysis, program evaluation, cost-benefit analysis, community-based participatory research, grant writing, and…
ERIC Educational Resources Information Center
Ellis, Ronald S.
Evaluated was the Summer Education Program for Neurologically and Physically Handicapped Children, designed to improve the performance of 145 children (6-16 years old) in the following areas--gross motor skills, swimming, fine motor skills, socialization with nonhandicapped peers, and independent daily living skills. The program included the…
ERIC Educational Resources Information Center
Simons-Morton, Bruce G.; Cummings, Sharon Snider
1997-01-01
Evaluates the impact of beverage servers' interventions at five establishments participating in the Houston Techniques for Effective Alcohol Management (TEAM) program. The intervention included server training, a designated-driver program, and "Safe Ride Home" taxi vouchers. Findings are discussed within the context of scant public and…
How to Recognize a Quality Technical Education Program.
ERIC Educational Resources Information Center
Doty, Charles R.
Criteria for the evaluation of quality technical educational programs must be identified if follow-up studies are to be effective. Current research shows that problems in the development of such criteria include the tendency to evaluate programs on the basis of organizational structure rather than on the quality of the instructional program…
Evaluating the Australian Traineeship System.
ERIC Educational Resources Information Center
Ryan, R. J.
1987-01-01
Describes the Australian Traineeship System (ATS), a program integrating formal education and employment designed to increase options for dropouts. Discusses problems involving the centrality of ATS's educational component and implementation of a program evaluation strategy. Includes two references. (MLH)
Site operator program final report for fiscal years 1992 through 1996
DOE Office of Scientific and Technical Information (OSTI.GOV)
Francfort, J.E.; Bassett, R.R.; Birasco, S.
The Site Operator Program was an electric vehicle testing and evaluation program sponsored by US Department of Energy and managed at the Idaho National Engineering and Environmental Laboratory. The Program`s goals included the field evaluation of electric vehicles in real-world applications and environments; the support of electric vehicle technology advancement; the development of infrastructure elements necessary to support significant electric vehicle use; and increasing the awareness and acceptance of electric vehicles. This report covers Program activities from 1992 to 1996. The Site Operator Program ended in September 1996, when it was superseded by the Field Operations Program. Electric vehicle testingmore » included baseline performance testing, which was performed in conjunction with EV America. The baseline performance parameters included acceleration, braking, range, energy efficiency, and charging time. The Program collected fleet operations data on electric vehicles operated by the Program`s thirteen partners, comprising electric utilities, universities, and federal agencies. The Program`s partners had over 250 electric vehicles, from vehicle converters and original equipment manufacturers, in their operating fleets. Test results are available via the World Wide Web site at http://ev.inel.gov/sop.« less
Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E
2012-04-01
Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.
ERIC Educational Resources Information Center
Peisner-Feinberg, Ellen S.; Schaaf, Jennifer M.; Hildebrandt, Lisa M.; Pan, Yi; Warnaar, Bethany L.
2015-01-01
The 2013-2014 North Carolina Pre-Kindergarten (NC Pre-K) Evaluation study was designed to examine the longitudinal outcomes through kindergarten for children who attended the Pre-K program, along with comparisons to previous cohorts of program attendees. A sample of 561 children was included in the study, with data gathered at the beginning and…
Evaluation of a clinical medical librarianship program at a university Health Sciences Library.
Schnall, J G; Wilson, J W
1976-01-01
An evaluation of the clinical medical librarianship program at the University of Washington Health Sciences Library was undertaken to determine the benefits of the program to patient care and to the education of the recipients of the service. Results of a questionnaire reflected overwhelming acceptance of the clinical medical librarianship program. Guidelines for the establishment of a limited clinical medical librarianship program are described. A statistical cost analysis of the program is included. PMID:938773
Environmental test program for superconducting materials and devices
NASA Technical Reports Server (NTRS)
Haertling, Gene; Randolph, Henry; Hsi, Chi-Shiung; Verbelyi, Darren
1991-01-01
This report is divided into two parts. The first dealing with work involved with Clemson University and the second with the results from Westinghouse/Savannah River. Both areas of work involved low noise, low thermal conductivity superconducting grounding links used in the NASA-sponsored Spectroscopy of the Atmosphere using Far Infrared Emission (SAFIRE) Project. Clemson prepared the links from YBa2Cu3O(7-x) superconductor tape that was mounted on a printed circuit board and encapsulated with epoxy resin. The Clemson program includes temperature vs. resistance, liquid nitrogen immersion, water immersion, thermal cycling, humidity, and radiation testing. The evaluation of the links under a long term environmental test program is described. The Savannah River program includes gamma irradiation, vibration, and long-term evaluation. The progress made in these evaluations is discussed.
Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J
2017-02-02
Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic sensitivities, classroom management challenges, and fitting new programs into already busy school schedules. Overall, the program content and individual lessons were well received by the teachers and students. The lessons learned from the development, implementation and evaluation of this program can provide health professionals with key pedagogical strategies for designing culturally responsive educational programs. Culturally responsive programs are critical for ensuring interventions are effective for their specific context.
Kirst, Maritt; Im, Jennifer; Burns, Tim; Baker, G. Ross; Goldhar, Jodeme; O'Campo, Patricia; Wojtak, Anne; Wodchis, Walter P
2017-01-01
Abstract Purpose A realist review of the evaluative evidence was conducted on integrated care (IC) programs for older adults to identify key processes that lead to the success or failure of these programs in achieving outcomes such as reduced healthcare utilization, improved patient health, and improved patient and caregiver experience. Data sources International academic literature was searched in 12 indexed, electronic databases and gray literature through internet searches, to identify evaluative studies. Study selection Inclusion criteria included evaluative literature on integrated, long-stay health and social care programs, published between January 1980 and July 2015, in English. Data extraction Data were extracted on the study purpose, period, setting, design, population, sample size, outcomes, and study results, as well as explanations of mechanisms and contextual factors influencing outcomes. Results of data synthesis A total of 65 articles, representing 28 IC programs, were included in the review. Two context-mechanism-outcome configurations (CMOcs) were identified: (i) trusting multidisciplinary team relationships and (ii) provider commitment to and understanding of the model. Contextual factors such as strong leadership that sets clear goals and establishes an organizational culture in support of the program, along with joint governance structures, supported team collaboration and subsequent successful implementation. Furthermore, time to build an infrastructure to implement and flexibility in implementation, emerged as key processes instrumental to success of these programs. Conclusions This review included a wide range of international evidence, and identified key processes for successful implementation of IC programs that should be considered by program planners, leaders and evaluators. PMID:28992156
Wright, Demia Sundra; Anderson, Lynda A; Brownson, Ross C; Gwaltney, Margaret K; Scherer, Jennifer; Cross, Alan W; Goodman, Robert M; Schwartz, Randy; Sims, Tom; White, Carol R
2008-01-01
The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.
Methods for evaluating a mature substance abuse prevention/early intervention program.
Becker, L R; Hall, M; Fisher, D A; Miller, T R
2000-05-01
The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.
Methodologies for Evaluating the Impact of Contraceptive Social Marketing Programs.
ERIC Educational Resources Information Center
Bertrand, Jane T.; And Others
1989-01-01
An overview of the evaluation issues associated with contraceptive social marketing programs is provided. Methodologies covered include survey techniques, cost-effectiveness analyses, retail audits of sales data, time series analysis, nested logit analysis, and discriminant analysis. (TJH)
What HIV programs work for adolescent girls?
Hardee, Karen; Gay, Jill; Croce-Galis, Melanie; Afari-Dwamena, Nana Ama
2014-07-01
Adolescent girls face unique challenges in reducing their risk of acquiring HIV because of gender inequalities, but much of HIV programming and evaluation lacks a specific focus on female adolescents. This article, based on a review of 150 studies and evaluations from 2001 to June 2013, reviews evidence on programming for adolescents that is effective for girls or could be adapted to be effective for girls. The evidence suggests specific interventions for adolescent girls across 3 critical areas: (1) an enabling environment, including keeping girls in school, promoting gender equity, strengthening protective legal norms, and reducing gender-based violence; (2) information and service needs, including provision of age-appropriate comprehensive sex education, increasing knowledge about and access to information and services, and expanding harm reduction programs for adolescent girls who inject drugs; and (3) social support, including promoting caring relationships with adults and providing support for adolescent female orphans and vulnerable children. Numerous gaps remain in evidence-based programming for adolescent girls, including a lack of sex- and age-disaggregated data and the fact that many programs are not explicitly designed or evaluated with adolescents in mind. However, evidence reinforces bolstering critical areas such as education, services, and support for adolescent girls. This article contributes to the growing body of literature on HIV and adolescent girls and reviews the vulnerabilities of girls, articulates the challenges of programming, develops a framework for addressing the needs of girls, and reviews the evidence for successful programming for adolescent girls.
Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L
2014-03-01
There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.
Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily
2017-10-01
Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.
NASA Astrophysics Data System (ADS)
Pearson, Roxanne N.
In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.
ERIC Educational Resources Information Center
Chicago Public Schools, IL.
This is a report on government-funded kindergarten programs that were conducted in 1983-84 in more than 110 Chicago schools, most of them in poverty areas. Three funding sources and various instructional models are included in this assessment. The programs differed in format, including half day and all day programs, and in class size. Funds came…
ERIC Educational Resources Information Center
Persons, Edgar A.; Swanson, Gordon I.
The purpose of the small business management program is to help families improve the effectiveness of their business operation and enable them to reach family and business goals. Similar to a successful program in farm management education operational in Minnesota since 1952, the program includes classroom instruction, small group instruction,…
Interactive debug program for evaluation and modification of assembly-language software
NASA Technical Reports Server (NTRS)
Arpasi, D. J.
1979-01-01
An assembly-language debug program written for the Honeywell HDC-601 and DDP-516/316 computers is described. Names and relative addressing to improve operator-machine interaction are used. Features include versatile display, on-line assembly, and improved program execution and analysis. The program is discussed from both a programmer's and an operator's standpoint. Functional diagrams are included to describe the program, and each command is illustrated.
Mugabo, Lambert; Rouleau, Dominique; Odhiambo, Jackline; Nisingizwe, Marie Paul; Amoroso, Cheryl; Barebwanuwe, Peter; Warugaba, Christine; Habumugisha, Lameck; Hedt-Gauthier, Bethany L
2015-06-09
Research is essential to identify and prioritize health needs and to develop appropriate strategies to improve health outcomes. In the last decade, non-academic research capacity strengthening trainings in sub-Saharan Africa, coupled with developing research infrastructure and the provision of individual mentorship support, has been used to build health worker skills. The objectives of this review are to describe different training approaches to research capacity strengthening in sub-Saharan Africa outside academic programs, assess methods used to evaluate research capacity strengthening activities, and learn about the challenges facing research capacity strengthening and the strategies/innovations required to overcome them. The PubMed database was searched using nine search terms and articles were included if 1) they explicitly described research capacity strengthening training activities, including information on program duration, target audience, immediate program outputs and outcomes; 2) all or part of the training program took place in sub-Saharan African countries; 3) the training activities were not a formal academic program; 4) papers were published between 2000 and 2013; and 5) both abstract and full paper were available in English. The search resulted in 495 articles, of which 450 were retained; 14 papers met all inclusion criteria and were included and analysed. In total, 4136 people were trained, of which 2939 were from Africa. Of the 14 included papers, six fell in the category of short-term evaluation period and eight in the long-term evaluation period. Conduct of evaluations and use of evaluation frameworks varied between short and long term models and some trainings were not evaluated. Evaluation methods included tests, surveys, interviews, and systems approach matrix. Research capacity strengthening activities in sub-Saharan Africa outside of academic settings provide important contributions to developing in-country capacity to participate in and lead research. Institutional support, increased funds, and dedicated time for research activities are critical factors that lead to the development of successful programs. Further, knowledge sharing through scientific articles with sufficient detail is needed to enable replication of successful models in other settings.
An Examination of the Indiana State University Aerospace Administration Program
NASA Technical Reports Server (NTRS)
Schwab, Gregory L.
2005-01-01
Declining enrollments in the Indiana State University (ISU) aerospace administration program prompted this case study. which evaluates the program in comparison with parallel programs at other universities, industry standards, and an independent audit. Survey instruments were administered to graduates, faculty, and employers for their views on competencies of an excellent aerospace administration program Results show the deficiency of the ISU program. Graduates, faculty, and employers rated all competencies-from moderate to considerable importance-similarly for an excellent program. Recommendations for program improvement were made, and suggestions for further research include studies to evaluate the effectiveness of a revised aerospace administration program.
ERIC Educational Resources Information Center
Geber, Beverly
1989-01-01
Discusses how to select the best training program for your needs. Includes information on deciding whether to develop your own program or buy one; identifying the kind of program you need; examining what is available; networking; choosing a supplier; and evaluating programs. (JOW)
NASA Astrophysics Data System (ADS)
Wasser, L. A.; Gold, A. U.
2017-12-01
There is a deluge of earth systems data available to address cutting edge science problems yet specific skills are required to work with these data. The Earth analytics education program, a core component of Earth Lab at the University of Colorado - Boulder - is building a data intensive program that provides training in realms including 1) interdisciplinary communication and collaboration 2) earth science domain knowledge including geospatial science and remote sensing and 3) reproducible, open science workflows ("earth analytics"). The earth analytics program includes an undergraduate internship, undergraduate and graduate level courses and a professional certificate / degree program. All programs share the goals of preparing a STEM workforce for successful earth analytics driven careers. We are developing an program-wide evaluation framework that assesses the effectiveness of data intensive instruction combined with domain science learning to better understand and improve data-intensive teaching approaches using blends of online, in situ, asynchronous and synchronous learning. We are using targeted online search engine optimization (SEO) to increase visibility and in turn program reach. Finally our design targets longitudinal program impacts on participant career tracts over time.. Here we present results from evaluation of both an interdisciplinary undergrad / graduate level earth analytics course and and undergraduate internship. Early results suggest that a blended approach to learning and teaching that includes both synchronous in-person teaching and active classroom hands-on learning combined with asynchronous learning in the form of online materials lead to student success. Further we will present our model for longitudinal tracking of participant's career focus overtime to better understand long-term program impacts. We also demonstrate the impact of SEO optimization on online content reach and program visibility.
Teaching Note--Keeping It Real: Program Evaluation Projects for an Undergraduate Research Class
ERIC Educational Resources Information Center
John, Aesha; Bang, Eun-Jun
2017-01-01
This article describes a teaching innovation that focused on the redesign of an undergraduate social work research class. Students enrolled in the redesigned class had an opportunity to conduct program evaluation projects in community agencies. The projects included (a) pretest and posttest evaluation of reminiscence approach in improving the…
A Model for Evaluating Programs for the Gifted under Non-Experimental Conditions.
ERIC Educational Resources Information Center
Carter, Kyle R.
1992-01-01
The article presents and illustrates use of an evaluation model for assessing programs for the gifted where tight experimental control is not possible. The model consists of four components: ex post factor designs including intact groups; comparative evaluation; strength of treatment; and multiple outcome assessment from flexible data sources. (DB)
Evaluation Report: ESEA Program of Compensatory Education (Including Abstract and Appendix).
ERIC Educational Resources Information Center
Badal, Alden W.
This document is an evaluation of 1967-68 compensatory education programs in Oakland, California, funded by the Elementary and Secondary Education Act, Title I. It consists of three parts: (1) the evaluation report; (2) an appendix containing tables, questionnaire summaries, sample forms, etc.; and (3) an abstract of the total document. Reported…
Evaluation of the Science, Technology, and Engineering Leadership Program, Year Three
ERIC Educational Resources Information Center
Wolanin, Natalie; Wade, Julie
2014-01-01
The Office of Shared Accountability conducted an evaluation of the implementation of the third and final year (2012-2013) of the "Science, Technology, and Engineering Leadership Program" (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard…
1993 at a Glance: Executive Summaries of Reports from the Office of Research and Evaluation.
ERIC Educational Resources Information Center
Austin Independent School District, TX. Office of Research and Evaluation.
This compilation contains executive summaries of 13 program evaluations conducted by the Office of Research and Evaluation of the Austin Independent School District (AISD) (Texas), as well as short summary reports on 3 programs. The following summaries are included: (1) "1991-92 Dropout Report"; (2) "Faculty/Staff Recruitment…
Students Training for Academic Readiness (STAR): Year Three Evaluation Report. Executive Summary
ERIC Educational Resources Information Center
Texas Center for Educational Research, 2010
2010-01-01
This executive summary presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation…
ERIC Educational Resources Information Center
Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.
2001-01-01
Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…
Independent Living Evaluation-Training Program. Reprint Series No. 16.
ERIC Educational Resources Information Center
Van Soest, Eileen; And Others
Intended to be used both as a guide for general program direction and as an individual evaluation and training tool this rehabilitation training guide includes materials and evaluation devices for use with mentally and/or physically handicapped clients on basic, intermediate and advanced living center levels. The eight independent living skill…
Evaluation of the Science, Technology, and Engineering Leadership Program, Year Two
ERIC Educational Resources Information Center
Wolanin, Natalie L.; Wade, Julie H.
2013-01-01
The Office of Shared Accountability (OSA) conducted an evaluation of the implementation of the second year (2011-2012) of the Science, Technology, and Engineering Leadership Program (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard Hughes Medical…
The Program Evaluator's Role in Cross-Project Pollination.
ERIC Educational Resources Information Center
Yasgur, Bruce J.
An expanded duties role of the multiple-program evaluator as an integral part of the ongoing decision-making process in all projects served is defended. Assumptions discussed included that need for projects with related objectives to pool resources and avoid duplication of effort and the evaluator's unique ability to provide an objective…
Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela
2018-01-01
Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594
Literacy Block: Meeting the Needs of All Learners; A Summative Program Evaluation
ERIC Educational Resources Information Center
Pelletier, Nancy L.
2011-01-01
This summative program evaluation study investigated the Response to Intervention (RTI) pilot literacy block program that was implemented in first and second grade classrooms in a small southeastern suburban school. All 111 students in the first and second grade were involved in this RTI model during the 2010-2011 school year including special…
ERIC Educational Resources Information Center
Friedenberg, Joan E.
An external evaluation was conducted of the Workplace Literacy Program at Chinatown Manpower Project, Inc., which provided oral and written job-specific instruction in English as a second language to Chinese garment workers. The program was designed for underemployed garment industry workers with low English proficiency, including seamstresses,…
LANDSAT activities in the Republic of Zaire
NASA Technical Reports Server (NTRS)
Ilunga, S.
1975-01-01
An overview of the LANDSAT data utilization program of the Republic of Zaire is presented. The program emphasizes topics of economic significance to the national development program of Zaire: (1) agricultural land use capability analysis, including evaluation of the effects of large-scale burnings; (2) mineral resources evaluation; and (3) production of mapping materials for poorly covered regions.
ERIC Educational Resources Information Center
Hobson, Charles J.; Strupeck, David; Griffin, Andrea; Szostek, Jana; Rominger, Anna S.
2014-01-01
A comprehensive educational program for teaching behavioral teamwork and team leadership skills was rigorously evaluated with 148 MBA students enrolled at an urban regional campus of a Midwestern public university. Major program components included (1) videotaped student teams in leaderless group discussion (LGD) exercises at the course beginning…
Federal Register 2010, 2011, 2012, 2013, 2014
2011-03-08
... the program (60 percent) or the control (40 percent) group. The evaluation includes: An implementation... participants to either the program group, which was offered program services, or the control group, which was... control groups (the latter could access non-RExO services) as well as variations across grantees. By...
Evaluation of College Reading and Study Skills Programs; Problems and Approaches.
ERIC Educational Resources Information Center
Anderson, William W.
The purpose of this paper was to bring together some of the most outstanding and significant research in recent years relating to the problems of evaluating college reading and study skills programs and the corresponding prospects and implications for improvement. The sections of the paper include: "Criterion Measures of Program Success," which is…
Federal Programs in PUHSS: An Evaluation Report.
ERIC Educational Resources Information Center
Phoenix Union High School District, AZ.
The programs described in this report, including the South Mountain High School Reading Program, the Carl Hayden High School Reading Program, the Phoenix Union High School Reading Program, the South Mountain High School Saturation Guidance and Counseling Program (SGCP), the Work Incentive Program (WIN), the Phoenix Union High School Star Reach…
An Improved Version of the NASA-Lockheed Multielement Airfoil Analysis Computer Program
NASA Technical Reports Server (NTRS)
Brune, G. W.; Manke, J. W.
1978-01-01
An improved version of the NASA-Lockheed computer program for the analysis of multielement airfoils is described. The predictions of the program are evaluated by comparison with recent experimental high lift data including lift, pitching moment, profile drag, and detailed distributions of surface pressures and boundary layer parameters. The results of the evaluation show that the contract objectives of improving program reliability and accuracy have been met.
Reliability analysis of laminated CMC components through shell subelement techniques
NASA Technical Reports Server (NTRS)
Starlinger, A.; Duffy, S. F.; Gyekenyesi, J. P.
1992-01-01
An updated version of the integrated design program C/CARES (composite ceramic analysis and reliability evaluation of structures) was developed for the reliability evaluation of CMC laminated shell components. The algorithm is now split in two modules: a finite-element data interface program and a reliability evaluation algorithm. More flexibility is achieved, allowing for easy implementation with various finite-element programs. The new interface program from the finite-element code MARC also includes the option of using hybrid laminates and allows for variations in temperature fields throughout the component.
DOT National Transportation Integrated Search
2015-03-01
This report examines potential methods for evaluating the economic benefits from nonmotorized transportation investments. The variety of potential economic benefits of bicycle and pedestrian infrastructure and programming investments discussed includ...
DOT National Transportation Integrated Search
2003-01-01
This study evaluated existing traffic signal optimization programs including Synchro,TRANSYT-7F, and genetic algorithm optimization using real-world data collected in Virginia. As a first step, a microscopic simulation model, VISSIM, was extensively ...
Problems, Perplexities, and Politics of Program Evaluation.
ERIC Educational Resources Information Center
Schneider, Gail Thierbach
All educational evaluations share common problems, perplexities, and political considerations. Logistic problems include incomplete definition of purpose, unclear timelines and personnel allocations, inadequate support services, and the lack of a program plan. Interpersonal dynamics and conflicts plus unwieldy committee structures are perplexities…
Statewide intelligent transportation systems earmark evaluation. Part B, final report
DOT National Transportation Integrated Search
2003-11-01
As a recipient of Intelligent Transportation System (ITS) Integration Program funds, the Wisconsin Department of Transportation is required to perform a self-evaluation on each program supported by the funds. The report includes the results of that e...
NEW PROGRAMS IN VOCATIONAL EDUCATION.
ERIC Educational Resources Information Center
Great Cities Research Council, Chicago, IL.
DESCRIBED ARE APPROXIMATELY 55 VOCATIONAL EDUCATION PROGRAMS DEVELOPED BY THE MEMBER GREAT CITIES WITHIN THE PAST 2 YEARS. THE BRIEF DESCRIPTION OF EACH PROGRAM INCLUDES--THE YOUTH INVOLVED, PROGRAM FEATURES, PROGRAM GOALS AND/OR EVALUATIONS AND SOURCES FOR FURTHER INFORMATION. THE FOLLOWING ARE AMONG THE PROGRAMS REPORTED--JOB PREPARATION…
Online evaluation programs: benefits and limitations.
Burhansstipanov, Linda; Clark, Richard E; Watanabe-Galloway, Shinobu; Petereit, Daniel G; Eschiti, Valerie; Krebs, Linda U; Pingatore, Noel L
2012-04-01
Patient navigation programs are increasing throughout the USA, yet some evaluation measures are too vague to determine what and how navigation functions. Through collaborative efforts an online evaluation program was developed. The goal of this evaluation program is to make data entry accurate, simple, and efficient. This comprehensive program includes major components on staff, mentoring, committees, partnerships, grants/studies, products, dissemination, patient navigation, and reports. Pull down menus, radio buttons, and check boxes are incorporated whenever possible. Although the program has limitations, the benefits of having access to current, up-to-date program data 24/7 are worth overcoming the challenges. Of major benefit is the ability of the staff to tailor summary reports to provide anonymous feedback in a timely manner to community partners and participants. The tailored data are useful for the partners to generate summaries for inclusion in new grant applications.
Abuya, Timothy O.; Fegan, Greg; Amin, Abdinasir A.; Akhwale, Willis S.; Noor, Abdisalan M.; Snow, Robert W.; Marsh, Vicki
2010-01-01
Background Private medicine retailers (PMRs) are key partners in the home management of fevers in many settings. Current evidence on effectiveness for PMR interventions at scale is limited. This study presents evaluation findings of two different programs implemented at moderate scale targeting PMRs for malaria control in the Kisii and Kwale districts of Kenya. Key components of this evaluation were measurement of program performance, including coverage, PMR knowledge, practices, and utilization based on spatial analysis. Methodology/Principal Findings The study utilized mixed quantitative methods including retail audits and surrogate client surveys based on post-intervention cross-sectional surveys in intervention and control areas and mapping of intervention outlets. There was a large and significant impact on PMR knowledge and practices of the program in Kisii, with 60.5% of trained PMRs selling amodiaquine medicines in adequate doses compared to 2.8% of untrained ones (OR; 53.5: 95% CI 6.7, 428.3), a program coverage of 69.7% targeted outlets, and a potential utilization of about 30,000 children under five. The evaluation in Kwale also indicates a significant impact with 18.8% and 2.3% intervention and control PMRs selling amodiaquine with correct advice, respectively (OR; 9.4: 95% CI 1.1, 83.7), a program coverage of 25.3% targeted outlets, and a potential utilization of about 48,000 children under five. A provisional benchmark of 7.5 km was a reasonable threshold distance for households to access PMR services. Conclusions/Significance This evaluation show that PMR interventions operationalized in the district level settings are likely to impact PMR knowledge and practices and lead to increased coverage of appropriate treatment to target populations. There is value of evaluating different dimensions of public health programs, including quality, spatial access, and implementation practice. This approach strengthens the potential contribution of pragmatic study designs to evaluating public health programs in the real world. PMID:20126620
Medication Exposure in Pregnancy Risk Evaluation Program
Andrade, Susan E.; Davis, Robert L.; Cheetham, T. Craig; Cooper, William O.; Li, De-Kun; Amini, Thushi; Beaton, Sarah J.; Dublin, Sascha; Hammad, Tarek A.; Pawloski, Pamala A.; Raebel, Marsha A.; Smith, David H.; Staffa, Judy A.; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E.
2011-01-01
To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy. PMID:22002179
Medication Exposure in Pregnancy Risk Evaluation Program.
Andrade, Susan E; Davis, Robert L; Cheetham, T Craig; Cooper, William O; Li, De-Kun; Amini, Thushi; Beaton, Sarah J; Dublin, Sascha; Hammad, Tarek A; Pawloski, Pamala A; Raebel, Marsha A; Smith, David H; Staffa, Judy A; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E
2012-10-01
To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy.
ERIC Educational Resources Information Center
Pfeffer, Eileen; Kester, Donald L.
Described is a procedure (Audit Dress Rehearsal) used in a special education program audit consultation service which included a practice audit designed to lower anxiety and raise awareness of concern for program success. The introduction includes sections dealing with evaluation and audit personnel, planning and implementing an audit, and stages…
Using archived data to measure operational benefits of ITS investments, volume 1 : ramp meters.
DOT National Transportation Integrated Search
2004-06-01
develop two case study evaluations for Oregon, including an evaluation of the COMET incident management program and the : Portland ramp metering system. The COMET evaluation will include a thorough literature review of other incident management : pro...
Systematic review of positive youth development programs for adolescents with chronic illness.
Maslow, Gary R; Chung, Richard J
2013-05-01
The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.
Field and Simulator Evaluations of a PC-Based Attention Maintenance Training Program
DOT National Transportation Integrated Search
2011-07-01
This report presents the results of three research studies regarding driver distraction from the forward roadway due to : secondary in-vehicle tasks. Study 1 included the development and evaluation of a PC-based training program named : FOrward Conce...
Design and evaluation of brushless electrical generators
NASA Technical Reports Server (NTRS)
Collins, F. A.; Ellis, J. N.
1970-01-01
Ten design manuals assembled and nine computer programs are developed for evaluation of proposed designs of brushless rotating electrical generators. Design manual package provides all information required for generator design, and computer programs permit calculation of performance of specific designs including effects of materials.
Warda, L.; Tenenbein, M.; Moffatt, M.
1999-01-01
Objective—To evaluate and summarize the house fire injury prevention literature. Methods—MEDLINE (1983 to March 1997) was searched by keyword: fire, burn, etiology, cause, prevention, epidemiology, and smoke detector/alarm. ERIC (1966 to March 1997) and PSYCLIT (1974 to June 1997) were searched by keyword: as above, and safety, skills, education, and training. Other sources included references of retrieved publications, review articles, and books; Injury Prevention hand search; government documents; and internet sources. Sources relevant to residential fire injury prevention were selected, evaluated, and summarized. Results—Forty three publications were selected for review, including seven randomized controlled trials, nine quasiexperiments, two natural experiments, 21 prospective cohort studies, two cross sectional surveys, one case report, and one program evaluation. These studies examined the following types of interventions: school (9), preschool (1), and community based educational programs (5); fire response training programs for children (7), blind adolescents (2), and mentally retarded adults (5) and children (1); office based counseling (4); home inspection programs (3); smoke detector giveaway campaigns (5); and smoke detector legislation (1). Conclusions—This review of house fire prevention interventions underscores the importance of program evaluation. There is a need for more rigorous evaluation of educational programs, particularly those targeted at schools. An evidence based, coordinated approach to house fire injury prevention is critical, given current financial constraints and the potential for program overload for communities and schools. PMID:10518271
A Review of Hazard Anticipation Training Programs for Young Drivers
McDonald, Catherine C.; Goodwin, Arthur H.; Pradhan, Anuj K.; Romoser, Matthew R.E.; Williams, Allan F.
2015-01-01
Purpose Poor hazard anticipation skills are a risk factor associated with high motor vehicle crash rates of young drivers. A number of programs have been developed to improve these skills. The purpose of this review was to assess the empirical literature on hazard anticipation training for young drivers. Methods Studies were included if they: 1) included an assessment of hazard anticipation training outcomes; 2) were published between January 1, 1980 and December 31, 2013 in an English language peer-reviewed journal or conference proceeding; and 3) included at least one group that uniquely comprised a cohort of participants <21 years. Nineteen studies met inclusion criteria. Results Studies used a variety of training methods including interactive computer programs, videos, simulation, commentary driving, or a combination of approaches. Training effects were predominantly measured through computer-based testing and driving simulation with eye tracking. Four studies included an on-road evaluation. Most studies evaluated short-term outcomes (immediate or few days). In all studies, young drivers showed improvement in selected hazard anticipation outcomes, but none investigated crash effects. Conclusions Although there is promise in existing programs, future research should include long-term follow up, evaluate crash outcomes, and assess the optimal timing of hazard anticipation training taking into account the age and experience level of young drivers. PMID:26112734
Evolution and outcomes of a quality improvement program.
Thor, Johan; Herrlin, Bo; Wittlöv, Karin; Øvretveit, John; Brommels, Mats
2010-01-01
The purpose of this paper is to examine the outcomes and evolution over a five-year period of a Swedish university hospital quality improvement program in light of enduring uncertainty regarding the effectiveness of such programs in healthcare and how best to evaluate it. The paper takes the form of a case study, using data collected as part of the program, including quality indicators from clinical improvement projects and participants' program evaluations. Overall, 58 percent of the program's projects (39/67) demonstrated success. A greater proportion of projects led by female doctors demonstrated success (91 percent, n=11) than projects led by male doctors (51 percent, n=55). Facilitators at the hospital continuously adapted the improvement methods to the local context. A lack of dedicated time for improvement efforts was the participants' biggest difficulty. The dominant benefits included an increased ability to see the "bigger picture" and the improvements achieved for patients and employees. Quality measurement, which is important for conducting and evaluating improvement efforts, was weak with limited reliability. Nevertheless, the present study adds evidence about the effectiveness of healthcare improvement programs. Gender differences in improvement team leadership merit further study. Improvement program evaluation should assess the extent to which improvement methods are locally adapted and applied. This case study reports the outcomes of all improvement projects undertaken in one healthcare organization over a five-year period and provides in-depth insight into an improvement program's changeable nature.
Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M
2017-02-01
As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.
An Evaluation of the English Language Skills Acceleration Project, FY 1974.
ERIC Educational Resources Information Center
Trust Territory of the Pacific Islands
An evaluation of the English Language Skills Acceleration Project, a program used in ninth-grade reading instruction in two high schools in the Marshall Islands, is provided in this report. Included are a description of the program and its activities, a discussion and comparison of test results, an evaluation of the behavioral objectives with…
Day Care in Caracas: A Day Care Homes Program Evaluation Report. Volume I: Executive Summary.
ERIC Educational Resources Information Center
de Ruesta, Maria Carlota; de Vidal, Amalia Barrios
This document provides a summary of a formative evaluation research project concerning the neighborhood day care homes program in Caracas, Venezuela. The evaluation included nine lines of study: (1) an assessment of sociodemographic conditions of Venezuelan preschool age children, legal and employment status of Venezuelan women, and general social…
ERIC Educational Resources Information Center
Lee, Helen; Crowne, Sarah; Faucetta, Kristen; Hughes, Rebecca
2016-01-01
The Mother and Infant Home Visiting Program Evaluation-Strong Start (MIHOPE-Strong Start) is the largest random assignment study to date to examine the effectiveness of home visiting services on improving birth outcomes and infant and maternal health care use for expectant mothers. The study includes local home visiting programs that use one of…
Evaluation of a data dictionary system. [information dissemination and computer systems programs
NASA Technical Reports Server (NTRS)
Driggers, W. G.
1975-01-01
The usefulness was investigated of a data dictionary/directory system for achieving optimum benefits from existing and planned investments in computer data files in the Data Systems Development Branch and the Institutional Data Systems Division. Potential applications of the data catalogue system are discussed along with an evaluation of the system. Other topics discussed include data description, data structure, programming aids, programming languages, program networks, and test data.
ERIC Educational Resources Information Center
Finucane, Mariel McKenzie; Martinez, Ignacio; Cody, Scott
2018-01-01
In the coming years, public programs will capture even more and richer data than they do now, including data from web-based tools used by participants in employment services, from tablet-based educational curricula, and from electronic health records for Medicaid beneficiaries. Program evaluators seeking to take full advantage of these data…
ERIC Educational Resources Information Center
Gidycz, Christine A.; Rich, Cindy L.; Orchowski, Lindsay; King, Carrie; Miller, Audrey K.
2006-01-01
The present study evaluated the efficacy of a sexual assault risk-reduction program that included a physical self-defense component for college women ("N"=500). Program group women significantly increased their protective behaviors over the 6-month follow-up period compared to the waiting-list control group. However, there were no significant…
ERIC Educational Resources Information Center
Afterschool Alliance, 2011
2011-01-01
Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before school, afterschool and summer learning programs, is needed to keep up with the growing…
ERIC Educational Resources Information Center
Afterschool Alliance, 2014
2014-01-01
Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before-school, afterschool and summer learning programs, is needed to keep up with the growing…
ERIC Educational Resources Information Center
Afterschool Alliance, 2015
2015-01-01
Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before school, afterschool and summer learning programs, is needed to keep up with the growing…
ERIC Educational Resources Information Center
Afterschool Alliance, 2013
2013-01-01
Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before-school, afterschool and summer learning programs, is needed to keep up with the growing…
ERIC Educational Resources Information Center
Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Hermann, Jack
This document summarizes findings from the Center for Substance Abuse Prevention's National Cross-Site Evaluation of High-Risk Youth Programs, which identified characteristics associated with strong substance abuse prevention outcomes in 48 prevention programs. Major findings include: as youth age, levels of risk and protection shift considerably,…
Innovative strategies for nursing education program evaluation.
Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley
2010-06-01
Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.
[Documenting a rehabilitation program using a logic model: an advantage to the assessment process].
Poncet, Frédérique; Swaine, Bonnie; Pradat-Diehl, Pascale
2017-03-06
The cognitive and behavioral disorders after brain injury can result in severe limitations of activities and restrictions of participation. An interdisciplinary rehabilitation program was developed in physical medicine and rehabilitation at the Pitié-Salpêtriere Hospital, Paris, France. Clinicians believe this program decreases activity limitations and improves participation in patients. However, the program’s effectiveness had never been assessed. To do this, we had to define/describe this program. However rehabilitation programs are holistic and thus complex making them difficult to describe. Therefore, to facilitate the evaluation of complex programs, including those for rehabilitation, we illustrate the use of a theoretical logic model, as proposed by Champagne, through the process of documentation of a specific complex and interdisciplinary rehabilitation program. Through participatory/collaborative research, the rehabilitation program was analyzed using three “submodels” of the logic model of intervention: causal model, intervention model and program theory model. This should facilitate the evaluation of programs, including those for rehabilitation.
Berlowitz, David J; Graco, Marnie
2010-05-01
The Northern Alliance Hospital Admission Risk Program-Chronic Disease Management comprises 13 services delivering care to those with chronic disease and older people with complex care needs, who are frequent hospital users. To develop and implement a system-wide approach to the evaluation of this existing program. The Northern Clinical Research Centre audited all existing, routinely collected administrative data within the program and then met with each service to develop service specific outcome measures. The evaluators then developed and implemented a system-wide evaluation approach to measure performance in terms of: client profile; access and entry; service efficiency; client outcomes; and hospital demand. Data are collected electronically and more than 80% are derived from existing, administrative datasets, minimising staff and client burden. Additional data include client outcomes and a health related quality of life measure. The preliminary twelve month data suggest that clients have the equivalent of 'fair' or 'poor' self-reported health status (n = 862) and the average health utility scores are significantly (P < 0.05) worse than population control data. These analyses reveal, for the first time, that the Northern Alliance Hospital Admission Risk Program-Chronic Disease Management program is targeting appropriate clients. This methodology will enable many prospective assessments to be performed including; client outcome evaluation, service model comparisons, and cost-utility analyses. This evaluation approach demonstrates the feasibility of a highly coordinated 'whole of system' evaluation. Such an approach may ultimately contribute to the development of evidence-based policy.
Pilot Evaluation of an In-Store Nutrition Label Education Program.
Dukeshire, Steven; Nicks, Emily; Ferguson, Jennifer
2014-12-01
To describe and provide recommendations for the implementation of an evaluation for an already existing, in-store Nutrition Label Education Program (NLEP). We describe the development and implementation of an evaluation consisting of a pre- and postsurvey and one month follow-up. The evaluation was designed to assess satisfaction with the NLEP as well as changes in participant nutrition label knowledge, confidence in using nutrition labels, and actual changes in nutrition label use. Nineteen participants took part in the pilot evaluation. The evaluation was successful in demonstrating high levels of satisfaction with the NLEP as well as positive changes in participant confidence and some increased knowledge in using nutrition labels. However, only 3 people participated in the follow-up, limiting the ability to assess behaviour change. Ideally, NLEPs should include ongoing evaluation that extends beyond just assessing participant satisfaction. Recommendations are provided for conducting such evaluations, including the importance of incorporating the evaluation into the program itself, using existing questionnaires when possible, and employing pre- and postsurveys as well as follow-up interviews to assess change.
Optimizing the post-graduate institutional program evaluation process.
Lypson, Monica L; Prince, Mark E P; Kasten, Steven J; Osborne, Nicholas H; Cohan, Richard H; Kowalenko, Terry; Dougherty, Paul J; Reynolds, R Kevin; Spires, M Catherine; Kozlow, Jeffrey H; Gitlin, Scott D
2016-02-17
Reviewing program educational efforts is an important component of postgraduate medical education program accreditation. The post-graduate review process has evolved over time to include centralized oversight based on accreditation standards. The institutional review process and the impact on participating faculty are topics not well described in the literature. We conducted multiple Plan-Do-Study-Act (PDSA) cycles to identify and implement areas for change to improve productivity in our institutional program review committee. We also conducted one focus group and six in-person interviews with 18 committee members to explore their perspectives on the committee's evolution. One author (MLL) reviewed the transcripts and performed the initial thematic coding with a PhD level research associate and identified and categorized themes. These themes were confirmed by all participating committee members upon review of a detailed summary. Emergent themes were triangulated with the University of Michigan Medical School's Admissions Executive Committee (AEC). We present an overview of adopted new practices to the educational program evaluation process at the University of Michigan Health System that includes standardization of meetings, inclusion of resident members, development of area content experts, solicitation of committed committee members, transition from paper to electronic committee materials, and focus on continuous improvement. Faculty and resident committee members identified multiple improvement areas including the ability to provide high quality reviews of training programs, personal and professional development, and improved feedback from program trainees. A standing committee that utilizes the expertise of a group of committed faculty members and which includes formal resident membership has significant advantages over ad hoc or other organizational structures for program evaluation committees.
Parekh, Jenita; Tunçalp, Özge; Turke, Shani; Blum, Robert William
2014-01-01
We systematically reviewed peer-reviewed and gray literature on comprehensive adolescent health (CAH) programs (1998–2013), including sexual and reproductive health services. We screened 36 119 records and extracted articles using predefined criteria. We synthesized data into descriptive characteristics and assessed quality by evidence level. We extracted data on 46 programs, of which 19 were defined as comprehensive. Ten met all inclusion criteria. Most were US based; others were implemented in Egypt, Ethiopia, and Mexico. Three programs displayed rigorous evidence; 5 had strong and 2 had modest evidence. Those with rigorous or strong evidence directly or indirectly influenced adolescent sexual and reproductive health. The long-term impact of many CAH programs cannot be proven because of insufficient evaluations. Evaluation approaches that take into account the complex operating conditions of many programs are needed to better understand mechanisms behind program effects. PMID:25320876
Curriculum Development and Evaluation for a Cancer Education Program.
ERIC Educational Resources Information Center
Deslauriers, Marc P.
1980-01-01
The Mid-America Cancer Center Program has developed a comprehensive approach for evaluating the cancer education curriculum at the University of Kansas Medical Center. The project included a review of all cancer-related teaching objectives and the development of an interdepartmental oncology curriculum. (JMD)
Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo
2012-07-01
Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.
An Integrated Nutrition Education Program for Dental Students.
ERIC Educational Resources Information Center
DePaola, Dominick P.; And Others
1978-01-01
Presents a diagonal system of nutrition education in a dental program that integrates didactic, clinical work, and community sites. Discusses the three phases including educational methodology, evaluation strategy, and unique program features. (MA)
Program of Policy Studies in Science and Technology, supplement to seven year review
NASA Technical Reports Server (NTRS)
Mayo, L. H.
1975-01-01
The activities of the Program of Policy Studies are described and evaluated. Awards, seminars, publications are included along with student researcher profiles, graduate program in science, technology, and public policy, and a statement of program capability.
ERIC Educational Resources Information Center
Liebler, Scott
1999-01-01
Evaluated a daily exercise program to determine the impact on Head Start children's physical fitness. Found that children in treatment programs improved in strength, balance, endurance, and enthusiasm. Children in comparison programs showed little physical improvement. Parent components of the program included workshops, newsletters, activity…
Outer Space...Calling All Readers. 1991 Summer Reading Program Manual.
ERIC Educational Resources Information Center
North Carolina State Dept. of Cultural Resources, Raleigh. Div. of State Library.
This manual provides guidelines and materials for librarians planning a summer reading program for children in North Carolina on the theme of outer space. An evaluation form to be returned to the State Library of North Carolina at the end of the summer is included. The introduction includes discussions of summer reading materials and programs;…
Step-by-Step Guide to Effective PR for Large & Small School Districts. Special Bulletin No. 3.
ERIC Educational Resources Information Center
School Information and Research Service, Olympia, WA.
This guide to formulating and carrying out an effective school public relations program includes articles drawn from public relations and communications journals. The articles deal with planning public relations programs, communicating with the public and the news media, program evaluation, and the tools of communication, including newsletters,…
McGraw-Hill Programmed Reading Evaluation.
ERIC Educational Resources Information Center
Norfolk Public Schools, VA.
One of the programs included in "Effective Reading Programs...," this program, begun in 1972, serves about 3,600 disadvantaged first through fourth grade students. The independent learning approach is featured in this program. Placement tests help teachers determine each child's needs, and diagnostic tests monitor student progress.…
Are You Making an Impact? Evaluating the Population Health Impact of Community Benefit Programs.
Rains, Catherine M; Todd, Greta; Kozma, Nicole; Goodman, Melody S
The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years. Such health care entities are challenged to evaluate the effectiveness of community benefit programs addressing the health needs identified. In an effort to determine the population health impact of community benefit programs in 1 hospital outreach department, researchers and staff conducted an impact evaluation to develop priority areas and overarching goals along with program- and department-level objectives. The longitudinal impact evaluation study design consists of retrospective and prospective secondary data analyses. As an urban pediatric hospital, St Louis Children's Hospital provides an array of community benefit programs to the surrounding community. Hospital staff and researchers came together to form an evaluation team. Data from program evaluation and administrative data for analysis were provided by hospital staff. Impact scores were calculated by scoring objectives as met or unmet and averaged across goals to create impact scores that measure how closely programs meet the overarching departmental mission and goals. Over the 4-year period, there is an increasing trend in program-specific impact scores across all programs except one, Healthy Kids Express Asthma, which had a slight decrease in year 4 only. Current work in measuring and assessing the population health impact of community benefit programs is mostly focused on quantifying dollars invested into community benefit work rather than measuring the quality and impact of services. This article provides a methodology for measuring population health impact of community benefit programs that can be used to evaluate the effort of hospitals in providing community benefit. This is particularly relevant in our changing health care climate, as hospitals are being asked to justify community benefit and make meaningful contributions to population health. The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years, and requires evaluation of program effectiveness; yet, it does not require any quantification of the impact of community benefit programs. The IRS Schedule H 990 policies could be strengthened by requiring an impact evaluation such as outlined in this article. As hospitals are being asked to justify community benefit and make meaningful contributions to population health, impact evaluations can be utilized to demonstrate the cumulative community benefit of programs and assess population health impact of community benefit programs.
Ullrich, A; Schöpf, A C; Nagl, M; Farin, E
2015-04-01
The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.
Impact of a Non-small Cell Lung Cancer Educational Program for Interdisciplinary Teams.
Murgu, Septimiu; Rabito, Robb; Lasko, Greg; Jackson, Chad; Mino-Kenudson, Mari; Ettinger, David S; Ramalingam, Suresh S; Edell, Eric S
2018-04-01
Successful implementation of non-small cell lung cancer (NSCLC) evidence-based guideline recommendations requires effective educational programs that target all clinicians from interdisciplinary teams. This study describes and evaluates the Engaging an Interdisciplinary Team for NSCLC (GAIN 3.0) experiential learning-based educational curriculum. GAIN 3.0 was designed to enhance interdisciplinary collaboration for effective NSCLC diagnosis, assessment, and treatment. The program used a flipped classroom model that included an e-learning component prior to a live 6-hour interactive program. The interactive program included hands-on simulations, small group workshops, gamification, and case discussions. Participants included academic and community members of multidisciplinary lung cancer teams. Assessments included an online baseline survey, a pretest and posttest, a program evaluation, a long-term survey (LTS), and on-site faculty evaluation of participants. Of 416 attendees to 13 live GAIN 3.0 programs (nine in the United States and four in Europe), 304 (73%) completed the pretest and 187 (45%) completed the posttest. Out of a perfect score of 12 points, program participants had a mean test score of 6.3 ± 2.1 on the pretest (52%) and 7.8 ± 2.1 on the posttest (65%) (P = .03). There was an overall knowledge increase of 13% from pretest to posttest. Most LTS respondents (65%) rated the GAIN 3.0 live programs as "high impact." On the LTS, the areas with the greatest gains in participants who had very high confidence were communication across disciplines, use of a team-based approach, and personalized treatment. GAIN 3.0 was a highly successful interdisciplinary activity that improved participants' knowledge, competence, and likely the clinical care provided to patients with NSCLC. Copyright © 2017 American College of Chest Physicians. Published by Elsevier Inc. All rights reserved.
Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules
NASA Astrophysics Data System (ADS)
Harlan, Jessica M.
This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.
NASA Astrophysics Data System (ADS)
Luera, Gail Rose
As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.
Evaluation of STD/AIDS prevention programs: a review of approaches and methodologies.
da Cruz, Marly Marques; dos Santos, Elizabeth Moreira; Monteiro, Simone
2007-05-01
The article presents a review of approaches and methodologies in the evaluation of STD/AIDS prevention programs, searching for theoretical and methodological support for the institutionalization of evaluation and decision-making. The review included the MEDLINE, SciELO, and ISI Web of Science databases and other sources like textbooks and congress abstracts from 1990 to 2005, with the key words: "evaluation", "programs", "prevention", "STD/AIDS", and similar terms. The papers showed a predominance of quantitative outcome or impact evaluative studies with an experimental or quasi-experimental design. The main use of evaluation is accountability, although knowledge output and program improvement were also identified in the studies. Only a few evaluative studies contemplate process evaluation and its relationship to the contexts. The review aimed to contribute to the debate on STD/AIDS, which requires more effective, consistent, and sustainable decisions in the field of prevention.
INSTRUMENT FOR EVALUATING A DEPARTMENT OF VOCATIONAL AGRICULTURE.
ERIC Educational Resources Information Center
Pennsylvania State Dept. of Public Instruction, Harrisburg. Agricultural Education Section.
AN EVALUATION TEAM MAY USE THIS INSTRUMENT IN IDENTIFYING STRENGTHS AND WEAKNESSES IN A DEPARTMENT OF VOCATIONAL AGRICULTURE. INSTRUCTIONS ON PREPARING FOR THE EVALUATION, INVITING PARTICIPANTS, AND DISTRIBUTING SUMMARIES ARE INCLUDED. SECTIONS ARE INCLUDED FOR DIFFERENT ASPECTS OF THE PROGRAM--(1) MAINTAINING RELATIONSHIPS WITH THE SCHOOL…
Personal Consumerism. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Smizer, Janet; And Others
This courseware evaluation rates the "Personal Consumerism" program developed by Aquarius People Materials. (The eight-program series--not contained in this document--includes understanding labels, consumer help, consumer fraud, consumer law, comparative shopping, consumerism and you, reading an advertisement, and tips on buying a used…
Formative Evaluation of the ACSC Distance Learning Program: A Status Study.
ERIC Educational Resources Information Center
MacCuish, Donald A.
2001-01-01
Describes a formative evaluation of the Air Command and Staff College (ACSC) distance learning program, which offers professional military education (PME). Highlights include use of the status study methodology; curriculum development; course design; learning theories; instructional systems design; best practices; and student assessment. (LRW)
DOT National Transportation Integrated Search
2004-06-01
The objective of this project is to use the existing data, surveillance and communications infrastructure (to the extent possible) to : develop two case study evaluations for Oregon, including an evaluation of the COMET incident management program an...
This manuscript presents the history and evolution of the U.S. Environmental Protection Agency's (EPA) Superfund Innovative Technology Evaluation (SITE) Monitoring and Measurement Technology (MMT) Program. This includes a discussion of how the fundamental concepts of a performanc...
ERIC Educational Resources Information Center
Lorch, S. C.; And Others
1992-01-01
This paper describes and evaluates a Hebrew immersion program for Jewish day school students at Mt. Scopus College in Melbourne, Australia. Specific sections address the following: (1) the first year; (2) the second year; (3) designing the evaluation of the program; (4) results of the evaluation (including academic outcomes, student and parent…
Increasing the use of evaluation data collection in an EPO program
NASA Astrophysics Data System (ADS)
Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.
2017-12-01
Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.
ERIC Educational Resources Information Center
Litchfield, Carolyn G.
A project was conducted to develop a model for evaluating specialized and traditional programs in marketing and distributive education. The project included a review of literature containing information regarding the points of view expressed by advocates of the specialized, traditional, and middle-of-the-road approaches to program planning in…
Evaluation of the Military Spouse Employment Partnership: Progress Report on First Stage of Analysis
2015-12-01
effort to support the monitoring and evaluation of Military Community and Family Policy’s portfolio of Spouse Education and Career Opportunities...SECO) programs and initiatives. Other programs in the SECO portfolio include the My Career Advancement Account Program, career counseling services...available through the Military OneSource SECO Career Center, and Department of Defense State Liaison Office initiatives to expand unemployment
40 CFR 1.49 - Office of Water.
Code of Federal Regulations, 2011 CFR
2011-07-01
... programs, is responsible for management of EPA's water programs. Functions of the Office include program... assistance to the regional activities in both enforcement and permitting programs. (b) Office of Water... for monitoring and evaluating the performance, progress, and fiscal status of the organization in...
40 CFR 1.49 - Office of Water.
Code of Federal Regulations, 2010 CFR
2010-07-01
... programs, is responsible for management of EPA's water programs. Functions of the Office include program... assistance to the regional activities in both enforcement and permitting programs. (b) Office of Water... for monitoring and evaluating the performance, progress, and fiscal status of the organization in...
Multicultural Training in Doctoral School Psychology Programs: In Search of the Model Program?
ERIC Educational Resources Information Center
Kearns, Tori; Ford, Laurie; Brown, Kimberly
The multicultural training (MCT) of APA-accredited School Psychology programs was studied. The sample included faculty and students from five programs nominated for strong MCT and five comparison programs randomly selected from the list of remaining APA-accredited programs. Program training was evaluated using a survey based on APA guidelines for…
A CAD (Classroom Assessment Design) of a Computer Programming Course
ERIC Educational Resources Information Center
Hawi, Nazir S.
2012-01-01
This paper presents a CAD (classroom assessment design) of an entry-level undergraduate computer programming course "Computer Programming I". CAD has been the product of a long experience in teaching computer programming courses including teaching "Computer Programming I" 22 times. Each semester, CAD is evaluated and modified…
Urban Rail Supporting Technology Program Fiscal Year 1975 - Year End Summary
DOT National Transportation Integrated Search
1975-12-01
The Urban Rail Supporting Technology Program is described for the 1975 fiscal year period. Important areas include program management, technical support and applications engineering, facilities development, test and evaluation, and technology develop...
D'Andrea, Elvira; Marzuillo, Carolina; De Vito, Corrado; Di Marco, Marco; Pitini, Erica; Vacchio, Maria Rosaria; Villari, Paolo
2016-12-01
There is considerable evidence regarding the efficacy and effectiveness of BRCA genetic testing programs, but whether they represent good use of financial resources is not clear. Therefore, we aimed to identify the main health-care programs for BRCA testing and to evaluate their cost-effectiveness. We performed a systematic review of full economic evaluations of health-care programs involving BRCA testing. Nine economic evaluations were included, and four main categories of BRCA testing programs were identified: (i) population-based genetic screening of individuals without cancer, either comprehensive or targeted based on ancestry; (ii) family history (FH)-based genetic screening, i.e., testing individuals without cancer but with FH suggestive of BRCA mutation; (iii) familial mutation (FM)-based genetic screening, i.e., testing individuals without cancer but with known familial BRCA mutation; and (iv) cancer-based genetic screening, i.e., testing individuals with BRCA-related cancers. Currently BRCA1/2 population-based screening represents good value for the money among Ashkenazi Jews only. FH-based screening is potentially very cost-effective, although further studies that include costs of identifying high-risk women are needed. There is no evidence of cost-effectiveness for BRCA screening of all newly diagnosed cases of breast/ovarian cancers followed by cascade testing of relatives, but programs that include tools for identifying affected women at higher risk for inherited forms are promising. Cost-effectiveness is highly sensitive to the cost of BRCA1/2 testing.Genet Med 18 12, 1171-1180.
A systematic review on how to conduct evaluations in community-based rehabilitation.
Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel
2014-01-01
Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.
A systematic review on how to conduct evaluations in community-based rehabilitation
Hébert, Michèle; Thibeault, Rachel
2014-01-01
Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357
Jaafaripooyan, Ebrahim
2014-09-01
Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.
Evaluation of the Florida coordinated school health program pilot schools project.
Weiler, Robert M; Pigg, R Morgan; McDermott, Robert J
2003-01-01
The Florida Department of Education, with CDC funding, designed the Florida Coordinated School Health Program Pilot Schools Project (PSP) to encourage innovative approaches to promote coordinated school health programs (CSHP) in Florida schools. Each of eight pilot schools received $15,000 in project funding, three years of technical assistance including on-site and off-site assistance, a project office resource center, mailings of resource materials, needs assessment and evaluation assistance, and three PSP Summer Institutes. Project evaluators created a context evaluation, approaching each school independently as a "case study" to measure the school's progress in meeting goals established at baseline. Data were collected using the How Healthy is Your School? needs assessment instrument, a School Health Portfolio constructed by each school team, a Pilot Schools Project Team Member Survey instrument, midcourse team interviews, final team interviews, and performance indicator data obtained from pilot and control schools. The PSP posed two fundamental questions: "Can financial resources, professional training, and technical assistance enable individual schools to create and sustain a coordinated school health program?" and "What outcomes reasonably can one expect from a coordinated school health program, assuming programs receive adequate support over time?" First, activities at the eight schools confirmed that a coordinated school health programs can be established and sustained. Program strength and sustainability depend on long-term resources, qualified personnel, and administrative support. Second, though coordinated school health programs may improve school performance indicators, the PSP yielded insufficient evidence to support that belief. Future projects should include robust measurement and evaluation designs, thereby producing conclusive evidence about the influence of a coordinated school health program on such outcomes.
Frih, Bechir; Mkacher, Wajdi; Jaafar, Hamdi; Frih, Ameur; Ben Salah, Zohra; El May, Mezry; Hammami, Mohamed
2018-04-01
The purpose of this study was to evaluate the effects of 6 months of specific balance training included in endurance-resistance program on postural balance in haemodialysis (HD) patients. Forty-nine male patients undergoing HD were randomly assigned to an intervention group (balance training included in an endurance-resistance training, n = 26) or a control group (resistance-endurance training only, n = 23). Postural control was assessed using six clinical tests; Timed Up and Go test, Tinetti Mobility Test, Berg Balance Scale, Unipodal Stance test, Mini-Balance Evaluation Systems Test and Activities Balance Confidence scale. All balance measures increased significantly after the period of rehabilitation training in the intervention group. Only the Timed Up and Go, Berg Balance Scale, Mini-Balance Evaluation Systems Test and Activities Balance Confidence scores were improved in the control group. The ranges of change in these tests were greater in the balance training group. In HD patients, specific balance training included in a usual endurance-resistance training program improves static and dynamic balance better than endurance-resistance training only. Implications for rehabilitation Rehabilitation using exercise in haemodialysis patients improved global mobility and functional abilities. Specific balance training included in usual endurance resistance training program could lead to improved static and dynamic balance.
Code of Federal Regulations, 2010 CFR
2010-01-01
... 10 Energy 4 2010-01-01 2010-01-01 false Consequences of a refusal to complete a CI evaluation including a polygraph examination. 709.14 Section 709.14 Energy DEPARTMENT OF ENERGY COUNTERINTELLIGENCE EVALUATION PROGRAM CI Evaluation Protocols and Protection of National Security § 709.14 Consequences of a...
Caffeine. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Ohio State Univ., Columbus. National Center for Research in Vocational Education.
This courseware evaluation rates the "Caffeine" program developed by Lane Community College and sold by the Oregon Department of Education. (The program--not included in this document--is part of a computer-assisted instruction project with nursing applications.) Part A describes "Caffeine" in terms of topics (food and…
Evaluation of Selected Recycling Curricula: Educating the Green Citizen.
ERIC Educational Resources Information Center
Boerschig, Sally; De Young, Raymond
1993-01-01
Solid waste curricula from various programs around the country were reviewed using eight variables identified as predictors of conservation behavior. Scores demonstrated that solid waste curricula focus mainly on knowledge and include, to a lesser extent, attitude change and action strategies. Lists the 14 programs evaluated in the study. (MDH)
45 CFR 2516.820 - What types of internal evaluation activities are required of programs?
Code of Federal Regulations, 2013 CFR
2013-10-01
... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2013-10-01 2013-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...
45 CFR 2516.820 - What types of internal evaluation activities are required of programs?
Code of Federal Regulations, 2012 CFR
2012-10-01
... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2012-10-01 2012-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...
45 CFR 2516.820 - What types of internal evaluation activities are required of programs?
Code of Federal Regulations, 2014 CFR
2014-10-01
... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2014-10-01 2014-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...
Program Evaluation of a School District's Multisensory Reading Initiative
ERIC Educational Resources Information Center
Asip, Michael Patrick
2012-01-01
The purpose of this study was to conduct a formative program evaluation of a school district's multisensory reading initiative. The mixed methods study involved semi-structured interviews, online survey, focus groups, document review, and analysis of extant special education student reading achievement data. Participants included elementary…
Nutri-Calc. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Biddle, James; And Others
This courseware evaluation rates the Nutri-Calc microcomputer program developed by CAMDE of Tempe, Arizona. (The program--not included in this document--consists of Nutri-Calc, which calculates total nutritional intake and Recommended Daily Allowances, and Calorie-Magic, which calculates individual ideal caloric intake.) Part A describes…
Evaluating Technology Integration in the Elementary School: A Site-Based Approach.
ERIC Educational Resources Information Center
Mowe, Richard
This book enables educators at the elementary level to conduct formative evaluations of their technology programs in minimum time. Most of the technology is computer related, including word processing, graphics, desktop publishing, spreadsheets, databases, instructional software, programming, and telecommunications. The design of the book is aimed…
Colorado Even Start. 1998-1999 Progress Report.
ERIC Educational Resources Information Center
Anderson, Beckie
Even Start programs integrate early childhood education, adult literacy or basic education, parenting education and support, and parent and child time to help break the cycle of poverty and illiteracy. This report describes the Even Start program in Colorado, and includes evaluation questions and methods. The report presents evaluation findings…
ERIC Educational Resources Information Center
Lynch, Linda L.; Purnawarman, Pupung
2004-01-01
In recent years portfolios have served increasingly as a vehicle for individual and program evaluation, as well as for career purposes in many fields including education (Galloway, 2001). Nationwide, teacher development programs are being asked to include their students' artifacts in some form of teaching portfolio that will ultimately be used as…
Overview of a pharmacist anticoagulation certificate program.
Kirk, Julienne K; Edwards, Rebecca; Brewer, Andrew; Miller, Cathey; Bray, Bryan; Groce, James B
2017-07-01
To describe the design of an ongoing anticoagulation certificate program and annual renewal update for pharmacists. Components of the anticoagulation certificate program include home study, pre- and posttest, live sessions, case discussions with evaluation and presentation, an implementation plan, and survey information (program evaluation and use in practice). Clinical reasoning skills were assessed through case work-up and evaluation prior to live presentation. An annual renewal program requires pharmacists to complete home study and case evaluations. A total of 361 pharmacists completed the anticoagulation certificate program between 2002 and 2015. Most (62%) practiced in ambulatory care and 38% in inpatient care settings (8% in both). In the past four years, 71% were working in or starting anticoagulation clinics in ambulatory and inpatient settings. In their evaluations of the program, an average of 90% of participants agreed or strongly agreed the lecture material was relevant and objectives were met. Pharmacists are able to apply knowledge and skills in management of anticoagulation. This structured practice-based continuing education program was intended to enhance pharmacy practice and has achieved that goal. The certificate program in anticoagulation was relevant to pharmacists who attended the program. Copyright © 2017. Published by Elsevier Inc.
Resilience Training for Healthcare Staff (RTHS) Implementation Evaluation Phase 1
2017-01-05
Healthcare Staff (RTHS) Implementation Evaluation Phase 1 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) Start, Amanda...been evaluated . As of September 2016, 149 MRTs had been certified to teach the MRT Medical Program. Between October and November 2016, 149 MRTs received...an online survey invitation. A follow up phone survey was attempted to 97 MRTs stationed INCONUS. Results of the evaluation included
Roadmap for creating an accelerated three-year medical education program
Leong, Shou Ling; Cangiarella, Joan; Fancher, Tonya; Dodson, Lisa; Grochowski, Colleen; Harnik, Vicky; Hustedde, Carol; Jones, Betsy; Kelly, Christina; Macerollo, Allison; Reboli, Annette C.; Rosenfeld, Melvin; Rundell, Kristen; Thompson, Tina; Whyte, Robert; Pusic, Martin
2017-01-01
ABSTRACT Medical education is undergoing significant transformation. Many medical schools are moving away from the concept of seat time to competency-based education and introducing flexibility in the curriculum that allows individualization. In response to rising student debt and the anticipated physician shortage, 35% of US medical schools are considering the development of accelerated pathways. The roadmap described in this paper is grounded in the experiences of the Consortium of Accelerated Medical Pathway Programs (CAMPP) members in the development, implementation, and evaluation of one type of accelerated pathway: the three-year MD program. Strategies include developing a mission that guides curricular development – meeting regulatory requirements, attaining institutional buy-in and resources necessary to support the programs, including student assessment and mentoring – and program evaluation. Accelerated programs offer opportunities to innovate and integrate a mission benefitting students and the public. Abbreviations: CAMPP: Consortium of accelerated medical pathway programs; GME: Graduate medical education; LCME: Liaison committee on medical education; NRMP: National residency matching program; UME: Undergraduate medical education PMID:29117817
Roadmap for creating an accelerated three-year medical education program.
Leong, Shou Ling; Cangiarella, Joan; Fancher, Tonya; Dodson, Lisa; Grochowski, Colleen; Harnik, Vicky; Hustedde, Carol; Jones, Betsy; Kelly, Christina; Macerollo, Allison; Reboli, Annette C; Rosenfeld, Melvin; Rundell, Kristen; Thompson, Tina; Whyte, Robert; Pusic, Martin
2017-01-01
Medical education is undergoing significant transformation. Many medical schools are moving away from the concept of seat time to competency-based education and introducing flexibility in the curriculum that allows individualization. In response to rising student debt and the anticipated physician shortage, 35% of US medical schools are considering the development of accelerated pathways. The roadmap described in this paper is grounded in the experiences of the Consortium of Accelerated Medical Pathway Programs (CAMPP) members in the development, implementation, and evaluation of one type of accelerated pathway: the three-year MD program. Strategies include developing a mission that guides curricular development - meeting regulatory requirements, attaining institutional buy-in and resources necessary to support the programs, including student assessment and mentoring - and program evaluation. Accelerated programs offer opportunities to innovate and integrate a mission benefitting students and the public. CAMPP: Consortium of accelerated medical pathway programs; GME: Graduate medical education; LCME: Liaison committee on medical education; NRMP: National residency matching program; UME: Undergraduate medical education.
The Perfect Marriage: Integrated Word Processing and Data Base Management Programs.
ERIC Educational Resources Information Center
Pogrow, Stanley
1983-01-01
Discussion of database integration and how it operates includes recommendations on compatible brand name word processing and database management programs, and a checklist for evaluating essential and desirable features of the available programs. (MBR)
Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool
Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna
2008-01-01
Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963
A Review of Hazard Anticipation Training Programs for Young Drivers.
McDonald, Catherine C; Goodwin, Arthur H; Pradhan, Anuj K; Romoser, Matthew R E; Williams, Allan F
2015-07-01
Poor hazard anticipation skills are a risk factor associated with high motor vehicle crash rates of young drivers. A number of programs have been developed to improve these skills. The purpose of this review was to assess the empirical literature on hazard anticipation training for young drivers. Studies were included if they (1) included an assessment of hazard anticipation training outcomes; (2) were published between January 1, 1980 and December 31, 2013 in an English language peer-reviewed journal or conference proceeding; and (3) included at least one group that uniquely comprised a cohort of participants aged <21 years. Nineteen studies met inclusion criteria. Studies used a variety of training methods including interactive computer programs, videos, simulation, commentary driving, or a combination of approaches. Training effects were predominantly measured through computer-based testing and driving simulation with eye tracking. Four studies included an on-road evaluation. Most studies evaluated short-term outcomes (immediate or few days). In all studies, young drivers showed improvement in selected hazard anticipation outcomes but none investigated crash effects. Although there is promise in existing programs, future research should include long-term follow-up, evaluate crash outcomes, and assess the optimal timing of hazard anticipation training taking into account the age and experience level of young drivers. Copyright © 2015 Society for Adolescent Health and Medicine. All rights reserved.
The University of North Carolina Medical Center pharmacy resident leadership certificate program.
Lyons, Kayley; Griggs, Danielle; Lebovic, Rachel; Roth, Mary E; South, David A; Hatfield, Chad
2017-03-15
The development and implementation of a certificate program for pharmacy residents are described. University of North Carolina (UNC) Medical Center met the call for increased efforts in the area of pharmacy residency leadership training through the design, implementation, and evaluation of a leadership certificate program. The purpose of the UNC certificate program is to develop leaders who will serve others, improve their communities, and advance the profession. The program is designed to (1) foster self-awareness, social awareness, and altruism, (2) provide transferable and individualized leadership experiences, (3) enrich other residency components through integration of leadership development opportunities, and (4) create role models for departmental leadership. A team of preceptors and residents implemented the certificate program by integrating program components into the existing pharmacy residency infrastructure. The certificate program includes required and flexible components to allow residents to set and achieve their determined leadership development goals. Overall, residents are satisfied with the program and perceive it as worthwhile. During the first 3 years since implementation of the certification initiative, program facilitators improved the feasibility of, participant engagement in, and sustainability of the program. Future directions include an effectiveness evaluation and a "scale-up" to other institutions. The need for a pharmacy residency leadership certificate was met by designing, implementing, and evaluating such a program at UNC. Through its first 3 years, the program was feasible, sustainable, and valued by program participants. Copyright © 2017 by the American Society of Health-System Pharmacists, Inc. All rights reserved.
Polak, Rani; Pober, David; Morris, Avigail; Arieli, Rakefet; Moore, Margaret; Berry, Elliot; Ziv, Mati
The Community Culinary Coaching Program is a community-based participatory program aimed at improving communal settlement residents' nutrition. The residents, central kitchens, preschools, and communal dining rooms were identified as areas for intervention. Evaluation included goals accomplishment assessed by food purchases by the central kitchens, and residents' feedback through focus groups. Purchasing included more vegetables (mean (standard error) percent change), (+7% (4); P = .32), fish (+115% (11); P < .001), whole grains, and legumes (+77% (9); P < .001); and less soup powders (-40% (9); P < .05), processed beef (-55% (8); P < .001), and margarine (-100% (4); P < .001). Residents recommended continuing the program beyond the project duration. This model might be useful in organizations with communal dining facilities.
The Total Impact of Manpower Programs: A Four-City Case Study. Volume II--Final Report.
ERIC Educational Resources Information Center
Olympus Research Corp., Washington, DC.
Based on followup interviews with 1700 participants, this study is an evaluation of Federal manpower programs in Boston, Denver, and San Francisco-Oakland. Included are Manpower Development and Training Act Programs, Work Incentive Programs, and Concentrated Employment Program from late 1969 to early 1970. Program impact on enrollees, employers,…
NASA Astrophysics Data System (ADS)
Moin, Laura
2009-10-01
The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.
About the mechanism of ERP-system pilot test
NASA Astrophysics Data System (ADS)
Mitkov, V. V.; Zimin, V. V.
2018-05-01
In the paper the mathematical problem of defining the scope of pilot test is stated, which is a task of quadratic programming. The procedure of the problem solving includes the method of network programming based on the structurally similar network representation of the criterion and constraints and which reduces the original problem to a sequence of simpler evaluation tasks. The evaluation tasks are solved by the method of dichotomous programming.
ERIC Educational Resources Information Center
Bentley, Kia J.
2013-01-01
This article presents a framework for evaluation in social work doctoral education and details 10 years of successes and challenges in one PhD program's use of the framework, including planning and implementing specific assessment activities around student learning outcomes and larger program goals. The article argues that a range of…
ERIC Educational Resources Information Center
Westat, Inc., Rockville, MD.
This report gathers papers prepared for a design conference for the evaluation of the Federal Talent Search Program, an early intervention program to identify gifted and talented financially needy students and connect them with discretionary grants for higher education. An introductory paper synthesizes major conference themes. These include: (1)…
JobTIPS: A Transition to Employment Program for Individuals with Autism Spectrum Disorders
Strickland, Dorothy C.; Coles, Claire D.; Southern, Louise B.
2013-01-01
This study evaluated the effectiveness of an Internet accessed training program that included Theory of Mind-based guidance, video models, visual supports, and virtual reality practice sessions in teaching appropriate job interview skills to individuals with high functioning ASD. In a randomized study, twenty two youth, ages 16 to 19, were evaluated during two employment interviews. Half received a training intervention following the initial interview and the half who served as a contrast group did not. Their performance pre and post intervention was assessed by four independent raters using a scale that included evaluation of both Content and Delivery. Results suggest that youth who completed the JobTIPS employment program demonstrated significantly more effective verbal content skills than those who did not. PMID:23494559
Federal Register 2010, 2011, 2012, 2013, 2014
2012-06-14
... evaluations may include both formative implementation and process evaluations that evaluate a program as it is unfolding, and summative descriptive evaluations that examine changes in final outcomes in a non-causal...
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
The purpose of this report is to present to Secretary of Energy James Watkins the findings and recommendations of the Occupational Safety and Health Administration's (OSHA) evaluation of the Department of Energy's (DOE) programs for worker safety and health at DOE's government-owned contractor-operated (GOCO) nuclear facilities. The OSHA evaluation is based on an intensive and comprehensive review and analysis of DOE's worker safety and health programs including: written programs; safety and health inspection programs; and the adequacy of resource, training, and management controls. The evaluation began on April 10, 1990 and involved over three staff years before its conclusion. Themore » evaluation was initiated by former Secretary of Labor Elizabeth Dole in response to Secretary of Energy James Watkins' request that OSHA assist him in determining the actions needed to assure that DOE has an exemplary safety and health program in place at its GOCOs. 6 figs.« less
Conceptual framework for development of comprehensive e-health evaluation tool.
Khoja, Shariq; Durrani, Hammad; Scott, Richard E; Sajwani, Afroz; Piryani, Usha
2013-01-01
The main objective of this study was to develop an e-health evaluation tool based on a conceptual framework including relevant theories for evaluating use of technology in health programs. This article presents the development of an evaluation framework for e-health programs. The study was divided into three stages: Stage 1 involved a detailed literature search of different theories and concepts on evaluation of e-health, Stage 2 plotted e-health theories to identify relevant themes, and Stage 3 developed a matrix of evaluation themes and stages of e-health programs. The framework identifies and defines different stages of e-health programs and then applies evaluation theories to each of these stages for development of the evaluation tool. This framework builds on existing theories of health and technology evaluation and presents a conceptual framework for developing an e-health evaluation tool to examine and measure different factors that play a definite role in the success of e-health programs. The framework on the horizontal axis divides e-health into different stages of program implementation, while the vertical axis identifies different themes and areas of consideration for e-health evaluation. The framework helps understand various aspects of e-health programs and their impact that require evaluation at different stages of the life cycle. The study led to the development of a new and comprehensive e-health evaluation tool, named the Khoja-Durrani-Scott Framework for e-Health Evaluation.
Implementing an Evidence Based Preceptorship Program in a Military Center
2014-11-05
included 34 interdisciplinary staff (Rehab, Education, Respiratory Therapy , and Clinic Staff), Staff Nurses (n=43) and 100% of identified preceptors (n...program. VNIP training (n=110) included 34 interdisciplinary staff (Rehab, Education, Respiratory Therapy , and Clinic Staff), Staff Nurses (n=43...disciplines (Administrative Leaders, Specialties to include: burn clinic, respiratory, occupational, and physical therapists). -VNIP Course Evaluation
Bottorff, Joan L; Oliffe, John L; Sarbit, Gayl; Caperchione, Cristina; Clark, Marianne; Anand, Anima; Howay, Kym
2017-03-01
Evidence related to the effects of tobacco exposure in pregnancy and on infant and child health have focused on women's smoking cessation. Less often addressed is men's smoking, which when continued in fatherhood, reduces the chances of female partners' cessation and can negatively impact children's health as well as men's health. Dads in Gear (DIG) is an innovative program designed specifically for new fathers who want to reduce and quit smoking that includes three components: smoking cessation, fathering, and physical activity. The over-arching purpose of this study is to evaluate the feasibility of the DIG program and provide estimates of program efficacy. The purpose of this article is to describe the rationale and protocol for evaluating the DIG program's feasibility, acceptability and potential effectiveness. Using a prospective, non-comparative design, the DIG program will be implemented and evaluated in six communities. The program will be offered by trained facilitators to fathers who currently smoke and want to quit. The RE-AIM framework will guide the evaluation. Open-ended questions in participant surveys, and semi-structured interviews and weekly telephone de-briefs with facilitators will provide data for a process evaluation. Estimates of effectiveness include smoking behavior, fathering and physical activity measures at baseline, end of program, and 3-month follow up. The DIG program could support positive changes with respect to smoking cessation, physical activity and overall health for men. These effects could also promote family health. The program might also provide an effective model for engaging men in other health behavior change. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.
Schubert, Erin C; Duininck, Megan; Shlafer, Rebecca J
2016-01-01
We describe an evaluation of a prison visiting program, Extended Visiting (EV), for incarcerated mothers and their children. Mothers ( N = 24) and caregivers ( N = 19) were interviewed regarding experiences with the program. Mothers identified benefits including maintaining a relationship with children, physical contact, motivation, privacy, peer support, and personal growth. Caregivers echoed mothers' appreciation for the opportunity to maintain mother-child relationships and physical contact. Mothers identified barriers including desire for overnight visits and more age-appropriate activities. Caregivers perceived travel time and costs and children's adverse reactions as barriers. When comparing EV to typical visiting, participants unanimously preferred EV.
NASA Astrophysics Data System (ADS)
Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.
2018-02-01
This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.
Implementing a centralized institutional peer tutoring program.
Gaughf, Natalie White; Foster, Penni Smith
2016-01-01
Peer tutoring has been found to be beneficial to both students and peer tutors in health sciences education programs. This article describes the implementation of a centralized, institutional peer tutoring program at the University of Mississippi Medical Center, an academic health science center in the U.S. The Program: This multispecialty peer tutoring program paired students experiencing academic difficulties with peer tutors who showed prior academic success, professionalism and effective communication skills. The program allowed students and peer tutors to coordinate their own tutoring services. Evaluations by both students and peer tutors showed satisfaction with the program. Recommendations for developing and implementing an effective peer tutoring program are presented, including utilization of an online system, consistent program policy with high professionalism expectations, funding, program evaluation and data tracking.
Project Career REACH: Marketing Strategies for Effective Guidance Programs.
ERIC Educational Resources Information Center
Bollendorf, Marsha; And Others
1990-01-01
Outlines the practical marketing strategies used to implement Project Career REACH, a career development program for high school freshmen. Marketing basics for guidance programs are discussed, including mission analysis, market analysis, resource analysis, strategic planning, and evaluation. (TE)
Designing cost effective water demand management programs in Australia.
White, S B; Fane, S A
2002-01-01
This paper describes recent experience with integrated resource planning (IRP) and the application of least cost planning (LCP) for the evaluation of demand management strategies in urban water. Two Australian case studies, Sydney and Northern New South Wales (NSW) are used in illustration. LCP can determine the most cost effective means of providing water services or alternatively the cheapest forms of water conservation. LCP contrasts to a traditional approach of evaluation which looks only at means of increasing supply. Detailed investigation of water usage, known as end-use analysis, is required for LCP. End-use analysis allows both rigorous demand forecasting, and the development and evaluation of conservation strategies. Strategies include education campaigns, increasing water use efficiency and promoting wastewater reuse or rainwater tanks. The optimal mix of conservation strategies and conventional capacity expansion is identified based on levelised unit cost. IRP uses LCP in the iterative process, evaluating and assessing options, investing in selected options, measuring the results, and then re-evaluating options. Key to this process is the design of cost effective demand management programs. IRP however includes a range of parameters beyond least economic cost in the planning process and program designs, including uncertainty, benefit partitioning and implementation considerations.
Jaafaripooyan, Ebrahim
2014-01-01
Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381
Empowerment evaluation: building communities of practice and a culture of learning.
Fetterman, David M
2002-02-01
Empowerment evaluation is the use of evaluation concepts, techniques, and findings to foster improvement and self-determination. Program participants--including clients--conduct their own evaluations: an outside evaluator often serves as a coach or additional facilitator depending on internal program capabilities. Empowerment evaluation has three steps: 1) establishing a mission; 2) taking stock; and 3) planning for the future. These three steps build capacity. They also build a sense of community, often referred to as communities of practice. Empowerment evaluation also helps to create a culture of learning and evaluation within an organization or community.
Systematic Review of Empirically Evaluated School-Based Gambling Education Programs.
Keen, Brittany; Blaszczynski, Alex; Anjoul, Fadi
2017-03-01
Adolescent problem gambling prevalence rates are reportedly five times higher than in the adult population. Several school-based gambling education programs have been developed in an attempt to reduce problem gambling among adolescents; however few have been empirically evaluated. The aim of this review was to report the outcome of studies empirically evaluating gambling education programs across international jurisdictions. A systematic review following guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement searching five academic databases: PubMed, Scopus, Medline, PsycINFO, and ERIC, was conducted. A total of 20 papers and 19 studies were included after screening and exclusion criteria were applied. All studies reported intervention effects on cognitive outcomes such as knowledge, perceptions, and beliefs. Only nine of the studies attempted to measure intervention effects on behavioural outcomes, and only five of those reported significant changes in gambling behaviour. Of these five, methodological inadequacies were commonly found including brief follow-up periods, lack of control comparison in post hoc analyses, and inconsistencies and misclassifications in the measurement of gambling behaviour, including problem gambling. Based on this review, recommendations are offered for the future development and evaluation of school-based gambling education programs relating to both methodological and content design and delivery considerations.
The Linear Programming to evaluate the performance of Oral Health in Primary Care.
Colussi, Claudia Flemming; Calvo, Maria Cristina Marino; Freitas, Sergio Fernando Torres de
2013-01-01
To show the use of Linear Programming to evaluate the performance of Oral Health in Primary Care. This study used data from 19 municipalities of Santa Catarina city that participated of the state evaluation in 2009 and have more than 50,000 habitants. A total of 40 indicators were evaluated, calculated using the Microsoft Excel 2007, and converted to the interval [0, 1] in ascending order (one indicating the best situation and zero indicating the worst situation). Applying the Linear Programming technique municipalities were assessed and compared among them according to performance curve named "quality estimated frontier". Municipalities included in the frontier were classified as excellent. Indicators were gathered, and became synthetic indicators. The majority of municipalities not included in the quality frontier (values different of 1.0) had lower values than 0.5, indicating poor performance. The model applied to the municipalities of Santa Catarina city assessed municipal management and local priorities rather than the goals imposed by pre-defined parameters. In the final analysis three municipalities were included in the "perceived quality frontier". The Linear Programming technique allowed to identify gaps that must be addressed by city managers to enhance actions taken. It also enabled to observe each municipal performance and compare results among similar municipalities.
Social Actions Education Evaluation Program.
1986-04-01
ID-R1EE ?36 SOCIAL . ACTIONS EDUCATION EVALUATION P*OMRA(U) AIR v CONMAN AND STAFF COLL NAXUELL SF3 AL J L SKIDMORE APR 96 RCSC-S6-2215 UNCLRSSIFIED F...34 : AND STAFF COLLEGE -: [ -. STUDENT REPORT- TC SOCIAL ACTIONS EDUCATION - 1 $-EVALUATION PROGRAM D=TLC Lliii! MAIOR OANL.SIMMAND-35 IAP3 36 0- MAOR...must be included with any reproduced or adapted portions of this -_ document. 7-. Pk ~REPORT NUMBER 86-2315 TIT LE SOCIAL ACTIONS EDUCATION EVALUATION
22 CFR 62.15 - Annual reports.
Code of Federal Regulations, 2011 CFR
2011-04-01
... engaged, including an evaluation of program effectiveness; (b) Reciprocity. A description of the nature and extent of reciprocity occurring in the sponsor's exchange visitor program during the reporting...
22 CFR 62.15 - Annual reports.
Code of Federal Regulations, 2013 CFR
2013-04-01
... engaged, including an evaluation of program effectiveness; (b) Reciprocity. A description of the nature and extent of reciprocity occurring in the sponsor's exchange visitor program during the reporting...
22 CFR 62.15 - Annual reports.
Code of Federal Regulations, 2010 CFR
2010-04-01
... engaged, including an evaluation of program effectiveness; (b) Reciprocity. A description of the nature and extent of reciprocity occurring in the sponsor's exchange visitor program during the reporting...
22 CFR 62.15 - Annual reports.
Code of Federal Regulations, 2012 CFR
2012-04-01
... engaged, including an evaluation of program effectiveness; (b) Reciprocity. A description of the nature and extent of reciprocity occurring in the sponsor's exchange visitor program during the reporting...
22 CFR 62.15 - Annual reports.
Code of Federal Regulations, 2014 CFR
2014-04-01
... engaged, including an evaluation of program effectiveness; (b) Reciprocity. A description of the nature and extent of reciprocity occurring in the sponsor's exchange visitor program during the reporting...
Overview of Workplace Issues in the 2002 Status of the Armed Forces Survey
2003-11-01
Metropolitan Area (American University and George Mason University) Defense Manpower Data Center Survey & Program Evaluation Division 1600 Wilson...Research Fellows Program contributed to the production of this report. A team including Elizabeth Willis, Rachel Lipari, and Eric Wetzel from DMDC, and...members took more active steps related to leaving the military, including: preparing a resume (23%), attending programs that prepare for civilian
[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].
Nagahama, Elizabeth Eriko Ishida
2009-01-01
The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.
42 CFR 8.5 - Periodic evaluation of accreditation bodies.
Code of Federal Regulations, 2012 CFR
2012-10-01
... PROVISIONS CERTIFICATION OF OPIOID TREATMENT PROGRAMS Accreditation § 8.5 Periodic evaluation of... accreditation body are in compliance with the Federal opioid treatment standards. The evaluation will include a...
42 CFR 8.5 - Periodic evaluation of accreditation bodies.
Code of Federal Regulations, 2014 CFR
2014-10-01
... PROVISIONS CERTIFICATION OF OPIOID TREATMENT PROGRAMS Accreditation § 8.5 Periodic evaluation of... accreditation body are in compliance with the Federal opioid treatment standards. The evaluation will include a...
42 CFR 8.5 - Periodic evaluation of accreditation bodies.
Code of Federal Regulations, 2013 CFR
2013-10-01
... PROVISIONS CERTIFICATION OF OPIOID TREATMENT PROGRAMS Accreditation § 8.5 Periodic evaluation of... accreditation body are in compliance with the Federal opioid treatment standards. The evaluation will include a...
Web-Based Intervention Programs for Depression: A Scoping Review and Evaluation
Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A
2014-01-01
Background Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. Objective The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Methods Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. Results The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. Conclusions There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool. PMID:25249003
Web-based intervention programs for depression: a scoping review and evaluation.
Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A; Topolovec-Vranic, Jane
2014-09-23
Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool.
Measuring the Impact of a New Faculty Program Using Institutional Data
ERIC Educational Resources Information Center
Meizlish, Deborah S.; Wright, Mary C.; Howard, Joseph; Kaplan, Matthew L.
2018-01-01
This paper presents a quasi-experimental evaluation of a required, teaching-focused, new faculty program at a large research university. The study makes use of institutional data, including student evaluations of teaching and faculty participation in educational development activities, which are available on many campuses yet rarely used in…
ERIC Educational Resources Information Center
Berk, Saban
2018-01-01
Using the participants-oriented approach, this study evaluated public schools' out-of-school time academic support programs, corresponding to the corrective/enrichment stage of Bloom's Mastery Learning Model and offered outside formal education's weekday hours and on weekends. Study participants included 50 principals, 110 teachers, 170 students…
Pilot Evaluation of a Home Visit Parent Training Program in Disadvantaged Families
ERIC Educational Resources Information Center
Leung, Cynthia; Tsang, Sandra; Heung, Kitty
2013-01-01
Objectives: The study reported the pilot evaluation of the Healthy Start Home Visit Program for disadvantaged Chinese parents with preschool children, delivered by trained parent assistants. Home visiting was used to make services more accessible to disadvantaged families. Method: The participants included 21 parent-child dyads. Outcome measures…
ERIC Educational Resources Information Center
Deignan, Gerard M.; And Others
This report contains a comparative analysis of the differential effectiveness of computer-assisted instruction (CAI), programmed instructional text (PIT), and lecture methods of instruction in three medical courses--Medical Laboratory, Radiology, and Dental. The summative evaluation includes (1) multiple regression analyses conducted to predict…
NASA Technical Reports Server (NTRS)
Dupnick, E.; Wiggins, D.
1980-01-01
The scheduling algorithm for mission planning and logistics evaluation (SAMPLE) is presented. Two major subsystems are included: The mission payloads program; and the set covering program. Formats and parameter definitions for the payload data set (payload model), feasible combination file, and traffic model are documented.
Area III Valley Intercultural Report; 1970-71 Final Evaluation Report.
ERIC Educational Resources Information Center
Ayala, Armando; Vatsula, John
Evaluation of a bilingual-bicultural education program indicates that significant progress was made in enabling all students to function equally well in both Spanish and English, in providing basic coping skills, and in developing the basis for a pluralistic society. The program included 210 kindergarten and first-grade children consisting of…
ERIC Educational Resources Information Center
Frank, Austin
Student Affirmative Action (SAA) outreach programs to increase the participation of underrepresented minorities and the economically disadvantaged in higher education in California started with little or no coordination and scant thought of evaluation. For a variety of reasons, which include how they were planned, how they are staffed and…
Process Evaluation of a Parenting Program for Low-Income Families in South Africa
ERIC Educational Resources Information Center
Lachman, Jamie M.; Kelly, Jane; Cluver, Lucie; Ward, Catherine L.; Hutchings, Judy; Gardner, Frances
2018-01-01
Objective: This mixed-methods process evaluation examined the feasibility of a parenting program delivered by community facilitators to reduce the risk of child maltreatment in low-income families with children aged 3-8 years in Cape Town, South Africa (N = 68). Method: Quantitative measures included attendance registers, fidelity checklists,…
ERIC Educational Resources Information Center
Florida State Univ., Tallahassee. Program of Vocational Education.
Part of a system by which local education agency (LEA) personnel may evaluate secondary and postsecondary vocational education programs, this third of eight components focuses on assessment of student career interests. Procedures covered include determination of the student population to be surveyed, selection of the instrument, and discrepancy…
ERIC Educational Resources Information Center
Burchard, John D.; And Others
This monograph presents an evaluative description of the Alaska Youth Initiative (AYI), a community-based interagency program serving children and adolescents with severe emotional and behavioral disorders. Principles of the program include a no reject policy and a "wraparound" service delivery approach. The monograph offers information…
Home Start Evaluation Study. Interim Case Studies IIa.
ERIC Educational Resources Information Center
Fein, Robert
This formative evaluation study of Home Start uses a case study approach. A brief case study focuses on the administrative structure and staff resources and responsibilities of National Home Start. Also included are reports on seven local programs developed after two field visits had been made to each program. In the first visit, objectives chosen…
FloorPlan. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Rosenfeld, Vila M.; And Others
This courseware evaluation rates the "FloorPlan" program developed by the Learning Seed. (The program--not included in this document--allows room design and arrangement to be performed on the computer screen.) The courseware was rated by a team of home economists participating in a network for the dissemination of courseware reviews.…
Grab a Byte. Courseware Evaluation for Vocational and Technical Education.
ERIC Educational Resources Information Center
Rosenfeld, Vila M.; And Others
This courseware evaluation rates the "Grab a Byte" program developed by tne National Dairy Council. (The program--not included in this document--is divided into three sections: Grab-a-Grape uses a quiz-show format to examine students' knowledge of food groups; Nutrition Sleuth reinforces students' nutrient knowledge; and Have-a-Byte…
76 FR 26147 - Caregivers Program
Federal Register 2010, 2011, 2012, 2013, 2014
2011-05-05
... VA's medical benefits package, which include but are not limited to ``noninstitutional geriatric...'s Physical Evaluation Board, and a date of medical discharge has been issued.'' This term is used to... will include evaluation of the eligible veteran's and caregiver's physical and emotional states...
Guidelines for Establishing and Evaluating High School Technical Electromechanics Programs.
ERIC Educational Resources Information Center
Florida State Dept. of Education, Tallahassee. Div. of Vocational, Technical and Adult Education.
Educators and industrial representatives developed these guidelines for school officials, instructors in technical education, and program and facility planners to use in planning a high school program in technical electromechanics. Designed to train students for entry into industry in applied electromechanics, the program includes electricity,…
Improving Participation in After-School Programs
ERIC Educational Resources Information Center
Walker, Karen E.; Arbreton, Amy J. A.
2005-01-01
After-school programs attempt to provide safe havens that keep youth off the streets and offer them a variety of opportunities to enhance their experiences and skills, including educational outcomes such as grades. What the programs actually accomplish has been somewhat different. Major evaluations of after-school programs have shown that they do…
An Evaluation of a High School Peer Mediation Program.
ERIC Educational Resources Information Center
Terry, Brenda L.; Gerber, Sterling
This article provides results about a high school's support for its peer mediation program and the effectiveness of that program. The four subject groups surveyed included faculty, students in eight home room classes, trained student mediators, and students who had used the program to resolve an interpersonal conflict. Individuals directly…
EVALUATION OF EXPERIMENTAL PRESCHOOL PROGRAM FOR EDUCATIONALLY DEPRIVED CHILDREN (1964).
ERIC Educational Resources Information Center
STEWART, LUCILLE M.
THE AIM OF AN EXPERIMENTAL PRESCHOOL PROGRAM FOR EDUCATIONALLY DEPRIVED CHILDREN WAS TO PREPARE THEM FOR REGULAR KINDERGARTEN CLASSES. ACTIVITIES AND EXPERIENCES WERE PROVIDED WHICH HELPED THE CHILDREN EXPRESS THEMSELVES VERBALLY AND BECOME AWARE OF THEIR ENVIRONMENT. THE BUDGET FOR A 6-WEEK PROGRAM, INCLUDING STAFF, PROGRAM SUPPLIES, AND…
A National Program for Instructional Development in Veterinary Pathology.
ERIC Educational Resources Information Center
Ward, Billy, C.
1979-01-01
Results of a study by the American College of Veterinary Pathologists to investigate mechanisms to facilitate sharing of audiovisual programs include a content analysis in veterinary pathology, a guidebook for the preparation of instruction, 20 instructional programs, a lesson evaluation mechanism, and a proposal for sharing programs. (JMD)
Lorden, Andrea L; Radcliff, Tiffany A; Jiang, Luohua; Horel, Scott A; Smith, Matthew L; Lorig, Kate; Howell, Benjamin L; Whitelaw, Nancy; Ory, Marcia
2016-06-01
In community-based wellness programs, Social Security Numbers (SSNs) are rarely collected to encourage participation and protect participant privacy. One measure of program effectiveness includes changes in health care utilization. For the 65 and over population, health care utilization is captured in Medicare administrative claims data. Therefore, methods as described in this article for linking participant information to administrative data are useful for program evaluations where unique identifiers such as SSN are not available. Following fuzzy matching methodologies, participant information from the National Study of the Chronic Disease Self-Management Program was linked to Medicare administrative data. Linking variables included participant name, date of birth, gender, address, and ZIP code. Seventy-eight percent of participants were linked to their Medicare claims data. Linking program participant information to Medicare administrative data where unique identifiers are not available provides researchers with the ability to leverage claims data to better understand program effects. © The Author(s) 2014.
Knaak, Stephanie; Modgill, Geeta; Patten, Scott B
2014-10-01
As part of its ongoing effort to combat stigma against mental illness among health care providers, the Mental Health Commission of Canada partnered with organizations conducting anti-stigma interventions. Our objective was to evaluate program effectiveness and to better understand what makes some programs more effective than others. Our paper reports the elements of these programs found to be most strongly associated with favourable outcomes. Our study employed a multi-phased, mixed-methods design. First, a grounded theory qualitative study was undertaken to identify key program elements. Next, each program (n = 22) was coded according to the presence or absence of the identified key program ingredients. Then, random-effects, meta-regression modelling was used to examine the association between program outcomes and the key ingredients. The qualitative analysis led to a 6-ingredient model of key program elements. Results of the quantitative analysis showed that programs that included all 6 of these ingredients performed significantly better than those that did not. Individual analyses of each of the 6 ingredients showed that including multiple forms of social contact and emphasizing recovery were characteristics of the most effective programs. The results provide a validation of a 6-ingredient model of key program elements for anti-stigma programming for health care providers. Emphasizing recovery and including multiple types of social contact are of particular importance for maximizing the effectiveness of anti-stigma programs for health care providers.
The SBIRT program matrix: a conceptual framework for program implementation and evaluation.
Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna
2017-02-01
Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.
The transfer of safety training in work organizations: a systems perspective to continuous learning.
Ford, J K; Fisher, S
1994-01-01
The effectiveness of safety and health programs can be evaluated from a "transfer" perspective, which evaluates the effectiveness of training in individual programs, and from a "systems" perspective that contends that a safety training program cannot be isolated from the organizational system of which it is a part. This chapter explores the effectiveness of training from a systems perspective and includes recommendations for improving safety and health training.
Guidelines for Gifted/Talented Programs.
ERIC Educational Resources Information Center
Christensen, Genelle
Presented are guidelines for planning, establishing, and operating gifted/talented programs for exceptional children in Idaho. Topics are outlined which include definitions of terms related to gifted/talented education; general and specific program criteria; criteria for student selection (identification, comprehensive evaluation/assessment,…
Autotronics. Florida Vocational Program Guide.
ERIC Educational Resources Information Center
University of South Florida, Tampa. Dept. of Adult and Vocational Education.
The program guide for autotronics (electronics mechanic) courses in Florida identifies primary considerations for the organization, operation, and evaluation of a vocational education program. Following an occupational description for the job title for electronics mechanic (including communication technician and electronics technician), and its…
Petrunoff, Nick; Lloyd, Beverley; Watson, Natalie; Morrisey, David
2009-04-01
Early childhood presents an opportunity to encourage development of Fundamental Movement Skills (FMS). Implementation of a structured program in the Long Day Care (LDC) setting presents challenges. Implementation of a structured FMS program FunMoves was assessed in LDC in metropolitan New South Wales. LDC staff attended a training session conducted by trained Health Promotion Officers (HPOs) and completed an evaluation. During implementation HPOs completed lesson observations. De-identified attendance data was collected and director and staff feedback on the program including barriers to implementation was obtained via questionnaire. Qualitative information relevant to process evaluation was obtained via open questions on questionnaires, and a de-brief diary recording feedback from directors and staff. Knowledge of FMS and FunMoves and staff confidence to deliver the program were high after training. On average, staff stated they ran lessons more than the suggested twice weekly and the majority of children attended 1-3 lessons per week. However, lesson delivery was not as designed, and staff found FunMoves disruptive and time consuming. Six directors and the majority of staff thought that FunMoves could be improved. Structured program delivery was hampered by contextual issues including significant staff turnover and program length and structure being at odds with the setting. Implementation could be enhanced by guidelines for more flexible delivery options including less structured approaches, shorter and simpler lessons, ongoing conversations with the early childhood sector, in-centre engagement of staff and post-training support.
Design of study without drugs--a Surinamese school-based drug-prevention program for adolescents.
Ishaak, Fariel; de Vries, Nanne Karel; van der Wolf, Kees
2015-10-12
The aim of this study was to design the content and accompanying materials for a school-based program--Study without Drugs--for adolescents in junior secondary schools in Suriname based on the starting points and tasks of the fourth step of the Intervention Mapping protocol (which consists of six steps). A program based on this protocol should include a combination of theory, empirical evidence, and qualitative and quantitative research. Two surveys were conducted when designing the program. In Survey I, teachers and students were asked to complete a questionnaire to determine which school year they thought would be most appropriate for implementing a drug-prevention program for adolescents (we completed a similar survey as part of previous research). An attempt was made to identify suitable culturally sensitive elements to include in the program. In Survey II, the same teachers were asked to complete a questionnaire to determine the programs' scope, sequence, structure, and topics as well as the general didactic principles to serve as a basis for program design. After outlining the program plan, lessons, and materials, we conducted a formative pretest evaluation among teachers, students, and parents. That evaluation included measures related to the program's attractiveness, comprehensibility, and usefulness. The resulting lessons were presented to the teachers for assessment. The drug-prevention program we developed comprises 10 activities and lasts 2-2.5 months in an actual school setting. The activities take place during Dutch, biology, physical education, art, religion, and social studies lessons. We based the structure of the lessons in the program on McGuire's Persuasion Communication Model, which takes into account important didactic principles. Evaluations of the program materials and lesson plans by students, teachers, and parents were mostly positive. We believe that using the fourth step of the Intervention Mapping protocol to develop a drug-prevention intervention for adolescents has a produced promising, feasible program.
Blunt, Wendy; Gill, Dawn P; Sibbald, Shannon L; Riggin, Brendan; Pulford, Roseanne W; Scott, Ryan; Danylchuk, Karen; Gray, Cindy M; Wyke, Sally; Bunn, Christopher; Petrella, Robert J
2017-11-28
The health outcomes of men continue to be poorer than women globally. Challenges in addressing this problem include difficulties engaging men in weight loss programs as they tend to view these programs as contrary to the masculine narrative of independence and self-reliance. Researchers have been turning towards sports fans to engage men in health promotion programs as sports fans are typically male, and tend to have poor health habits. Developed from the highly successful gender-sensitized Football Fans in Training program, Hockey Fans in Training (Hockey FIT) recruited 80 male hockey fans of the London Knights and Sarnia Sting who were overweight or obese into a weekly, 90-minute classroom education and group exercise program held over 12 weeks; a 40-week minimally-supported phase followed. A process evaluation of the Hockey FIT program was completed alongside a pragmatic randomized controlled trial and outcome evaluation in order to fully explore the acceptability of the Hockey FIT program from the perspectives of coaches delivering and participants engaged in the program. Data sources included attendance records, participant focus groups, coach interviews, assessment of fidelity (program observations and post-session coach reflections), and 12-month participant interviews. Coaches enjoyed delivering the program and found it simple to deliver. Men valued being among others of similar body shape and similar weight loss goals, and found the knowledge they gained through the program helped them to make and maintain health behaviour changes. Suggested improvements include having more hockey-related information and activities, greater flexibility with timing of program delivery, and greater promotion of technology support tools. We confirmed Hockey FIT was an acceptable "gender-sensitized" health promotion program for male hockey fans who were overweight or obese. Minor changes were required for optimization, which will be evaluated in a future definitive trial. NCT02396524 (Clinicaltrials.gov). Date of registration: Feb 26, 2015.
Nash, Denis; Elul, Batya; Rabkin, Miriam; Tun, May; Saito, Suzue; Becker, Mark; Nuwagaba-Biribonwoha, Harriet
2009-11-01
Program monitoring and evaluation (M&E) has the potential to be a cornerstone of health systems strengthening and of evidence-informed implementation and scale-up of HIV-related services in resource-limited settings. We discuss common challenges to M&E systems used in the rapid scale-up of HIV services as well as innovations that may have relevance to systems used to monitor, evaluate, and inform health systems strengthening. These include (1) Web-based applications with decentralized data entry and real-time access to summary reporting; (2) timely feedback of information to site and district staff; (3) site-level integration of traditionally siloed program area indicators; (4) longitudinal tracking of program and site characteristics; (5) geographic information systems; and (6) use of routinely collected aggregate data for epidemiologic analysis and operations research. Although conventionally used in the context of vertical programs, these approaches can form a foundation on which data relevant to other health services and systems can be layered, including prevention services, primary care, maternal-child health, and chronic disease management. Guiding principles for sustainable national M&E systems include country-led development and ownership, support for national programs and policies, interoperability, and employment of an open-source approach to software development.
NASA Astrophysics Data System (ADS)
Nichols, M.; Bartolone, L.; Baldassari, C.; Hoyer-Winfield, S.
2011-09-01
The Interstellar Boundary Explorer (IBEX) mission includes a comprehensive EPO program in astronomy and heliophysics that is overseen and implemented by the Adler Planetarium in Chicago, Illinois. Several EPO components were developed specifically for informal institutions, especially museums and planetaria. The program includes an internationally distributed planetarium show with accompanying informal educational materials. Our evaluator, the Program Evaluation and Research Group (PERG) at Lesley University, Cambridge, Massachusetts, assesses the effectiveness of the EPO program. In late 2009 through early 2010, more than 70 planetaria worldwide received the IBEX planetarium show. Of the many U.S. planetaria, the first 25 received the IBEX planetarium show and were offered the opportunity to receive, at no charge, accompanying informal education materials, including posters, lithographs, demonstration materials, lesson plans, and more. In Spring 2010, PERG staff conducted a study designed to gauge the effectiveness of the distribution process for the planetarium show, gather information on the professional development needs of the organizations, and document reactions of museum staff to the IBEX informal education materials and their usefulness as companion pieces to the planetarium show. In this paper, we will present preliminary findings of this particular study, in the hopes that future EPO work can make use of data in this report.
Pre-Employment Laboratory Education. Clothing/Fashion Design Guidebook.
ERIC Educational Resources Information Center
Texas Tech Univ., Lubbock. Home Economics Instructional Materials Center.
This guidebook is designed for use in teaching students enrolled in preemployment laboratory education (PELE) clothing/fashion design programs. The first of two major sections includes an overview for teachers on planning, conducting, and evaluating a PELE clothing/fashion design program. Specific topics discussed in section 1 include (1)…
Retrofit energy studies of a recreation center
DOE Office of Scientific and Technical Information (OSTI.GOV)
Haberl, J.S.; Claridge, D.
1985-01-01
Retrofit energy options for the Student Recreation Center at the University of Colorado have been evaluated using the DOE-2.1b simulation program. This building has two major systems that are not included in the program - an ice rink and a swimming pool. The approach used to model these systems and the use of the program for other applications not included in the program, such as duty cycling and night cycling of fans for freeze protection, are emphasized. Measures that help streamline the usage of the program on a minicomputer are also discussed.
Lessons learned from employee fitness programs at the Marshfield Clinic.
McCarty, Catherine A; Scheuer, Dave
2005-07-01
To describe and evaluate employee fitness programs at the Marshfield Clinic. A 16-week program was offered to employees from April-July 2004, and a 12-week program was offered from August-November, 2004. Weekly e-mails included suggestions to increase physical activity and eat a healthy diet. Incentives were offered for meeting program goals. A total of 1129 employees signed up for the first program (approximately 18% of all employees) and 610 for the second program. More than 95% of the participants in both programs were female. The activity program goal was met by 231 (20.5%) participants in the first program and 31% (n = 190) of participants in the second program. There was a significant increase in the percent of people with good or excellent fitness levels from baseline (46.4%, 95% CL = 40.5, 52.3) to follow-up (70.7%, 95% CL = 65.3, 76.0) in the first program. In the second program, there was a significant association between the number of program goals met and self-report of having increased energy, better weight control, and feeling better overall and about body image. Emphasis in future programs should be placed on increasing employee participation. Program evaluation could be expanded to include health care costs and employee absenteeism.
What Works, and Can We Afford It? Program Effectiveness in AISD, 1991-92. Publication Number 91.43.
ERIC Educational Resources Information Center
Wilkinson, David; And Others
This report presents information on the effectiveness, including cost effectiveness, of many programs of the Austin (Texas) Independent School District (AISD). In 1991-92, the AISD Office of Research and Evaluation (ORE) reviewed 85 programs or program components. Cost effectiveness was calculated for 18 programs using an achievement effect…
Simon-Rusinowitz, Lori; Mahoney, Kevin J; Marks, Lori N; Simone, Kristin; Zacharias, B Lee
2009-01-01
Using focus group data, this article discusses the use of social marketing principles to enhance enrollment in the Cash and Counseling Demonstration and Evaluation (CCDE). Focus groups were conducted in person and by conference call in two CCDE states, Arkansas and Florida. In Florida, Department of Elder Affairs and Developmental Services Program (DS) staff participated in seven focus groups. In Arkansas, four focus groups were conducted with professionals likely to come into contact with Medicaid consumers who are eligible for Arkansas' cash option program. Focus group transcripts were coded according to the project research questions. Several important lessons emerged including the importance of(a) conducting process evaluation activities, such as the social marketing focus groups, early during program implementation; (b) using multiple approaches and contacts to inform potential consumers and their families about a new, complex program; (c) carefully selecting and training personnel to conduct outreach and enrollment activities; and (d) developing specific messages to include in marketing the cash option. Using social marketing principles to examine CCDE enrollment has provided important information to enhance this program.
Hilsden, Robert Jay; Rostom, Alaa; Dubé, Catherine; Pontifex, Darlene; McGregor, S Elizabeth; Bridges, Ronald J
2011-10-01
Quality assurance (QA) is a process that includes the systematic evaluation of a service, institution of improvements and ongoing evaluation to ensure that effective changes were made. QA is a fundamental component of any organized colorectal cancer screening program. However, it should play an equally important role in opportunistic screening. Establishing the processes and procedures for a comprehensive QA program can be a daunting proposition for an endoscopy unit. The present article describes the steps taken to establish a QA program at the Forzani & MacPhail Colon Cancer Screening Centre (Calgary, Alberta) - a colorectal cancer screening centre and nonhospital endoscopy unit that is dedicated to providing colorectal cancer screening-related colonoscopies. Lessons drawn from the authors' experience may help others develop their own initiatives. The Global Rating Scale, a quality assessment and improvement tool developed for the gastrointestinal endoscopy services of the United Kingdom's National Health Service, was used as the framework to develop the QA program. QA activities include monitoring the patient experience through surveys, creating endoscopist report cards on colonoscopy performance, tracking and evaluating adverse events and monitoring wait times.
Apprentice Performance Evaluation.
ERIC Educational Resources Information Center
Gast, Clyde W.
The Granite City (Illinois) Steel apprentices are under a performance evaluation from entry to graduation. Federally approved, the program is guided by joint apprenticeship committees whose monthly meetings include performance evaluation from three information sources: journeymen, supervisors, and instructors. Journeymen's evaluations are made…
Evaluating an employee wellness program.
Mukhopadhyay, Sankar; Wendel, Jeanne
2013-12-01
What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.
Going global: considerations for introducing global health into family medicine training programs.
Evert, Jessica; Bazemore, Andrew; Hixon, Allen; Withy, Kelley
2007-10-01
Medical students and residents have shown increasing interest in international health experiences. Before attempting to establish a global health training program in a family medicine residency, program faculty must consider the goals of the international program, whether there are champions to support the program, the resources available, and the specific type of program that best fits with the residency. The program itself should include didactics, peer education, experiential learning in international and domestic settings, and methods for preparing learners and evaluating program outcomes. Several hurdles can be anticipated in developing global health programs, including finances, meeting curricular and supervision requirements, and issues related to employment law, liability, and sustainability.
Development of an Experiment High Performance Nozzle Research Program
NASA Technical Reports Server (NTRS)
2004-01-01
As proposed in the above OAI/NASA Glenn Research Center (GRC) Co-Operative Agreement the objective of the work was to provide consultation and assistance to the NASA GRC GTX Rocket Based Combined Cycle (RBCC) Program Team in planning and developing requirements, scale model concepts, and plans for an experimental nozzle research program. The GTX was one of the launch vehicle concepts being studied as a possible future replacement for the aging NASA Space Shuttle, and was one RBCC element in the ongoing NASA Access to Space R&D Program (Reference 1). The ultimate program objective was the development of an appropriate experimental research program to evaluate and validate proposed nozzle concepts, and thereby result in the optimization of a high performance nozzle for the GTX launch vehicle. Included in this task were the identification of appropriate existing test facilities, development of requirements for new non-existent test rigs and fixtures, develop scale nozzle model concepts, and propose corresponding test plans. Also included were the evaluation of originally proposed and alternate nozzle designs (in-house and contractor), evaluation of Computational Fluid Dynamics (CFD) study results, and make recommendations for geometric changes to result in improved nozzle thrust coefficient performance (Cfg).
Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin
2016-11-01
A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.
Jernigan, Jan; Barnes, Seraphine Pitt; Shea, Pat; Davis, Rachel; Rutledge, Stephanie
2017-01-01
We provide an overview of the comprehensive evaluation of State Public Health Actions to Prevent and Control Diabetes, Heart Disease, Obesity and Associated Risk Factors and Promote School Health (State Public Health Actions). State Public Health Actions is a program funded by the Centers for Disease Control and Prevention to support the statewide implementation of cross-cutting approaches to promote health and prevent and control chronic diseases. The evaluation addresses the relevance, quality, and impact of the program by using 4 components: a national evaluation, performance measures, state evaluations, and evaluation technical assistance to states. Challenges of the evaluation included assessing the extent to which the program contributed to changes in the outcomes of interest and the variability in the states’ capacity to conduct evaluations and track performance measures. Given the investment in implementing collaborative approaches at both the state and national level, achieving meaningful findings from the evaluation is critical. PMID:29215974
Satellite Power System (SPS) FY 79 program summary
NASA Technical Reports Server (NTRS)
1980-01-01
The Satellite Power System (SPS) program a joint effort to develop an initial understanding of the technical feasibility, the economic practicality, and the social and environmental acceptability of the SPS concept is discussed. This is being accomplished through implementation of the Concept Development and Evaluation Program Plan which is scheduled for completion by the end of FY 1980. This Program Summary not only covers FY 1979 but includes work completed in FY 1977 and FY 1978 in order to give a comprehensive picture of the DOE involvement in the SPS concept development and evaluation process.
Human Reliability Program Workshop
DOE Office of Scientific and Technical Information (OSTI.GOV)
Landers, John; Rogers, Erin; Gerke, Gretchen
A Human Reliability Program (HRP) is designed to protect national security as well as worker and public safety by continuously evaluating the reliability of those who have access to sensitive materials, facilities, and programs. Some elements of a site HRP include systematic (1) supervisory reviews, (2) medical and psychological assessments, (3) management evaluations, (4) personnel security reviews, and (4) training of HRP staff and critical positions. Over the years of implementing an HRP, the Department of Energy (DOE) has faced various challenges and overcome obstacles. During this 4-day activity, participants will examine programs that mitigate threats to nuclear security andmore » the insider threat to include HRP, Nuclear Security Culture (NSC) Enhancement, and Employee Assistance Programs. The focus will be to develop an understanding of the need for a systematic HRP and to discuss challenges and best practices associated with mitigating the insider threat.« less
The Measurable Benefits of a Workplace Wellness Program in Canada: Results After One Year.
Lowensteyn, Ilka; Berberian, Violette; Belisle, Patrick; DaCosta, Deborah; Joseph, Lawrence; Grover, Steven A
2018-03-01
The aim of this study was to evaluate the impact of an employee wellness program in Canada. A comprehensive program including web-based lifestyle challenges was evaluated with annual health screenings. Among 730 eligible employees, 688 (94%) registered for the program, 571 (78%) completed a health screening at baseline, and 314 (43%) at 1 year. Most (66%) employees tracked their activity for more than 6 weeks. At 1-year follow-up, there were significant clinical improvements in systolic blood pressure -3.4 mm Hg, and reductions in poor sleep quality (33% to 28%), high emotional stress (21% to 15%), and fatigue (11% to 6%). A positive dose-response was noted where the greatest improvements were observed among those who participated the most. The program had high employee engagement. After 1 year, the benefits included clinically important improvements in physical and mental health.
Evaluation of space shuttle main engine fluid dynamic frequency response characteristics
NASA Technical Reports Server (NTRS)
Gardner, T. G.
1980-01-01
In order to determine the POGO stability characteristics of the space shuttle main engine liquid oxygen (LOX) system, the fluid dynamic frequency response functions between elements in the SSME LOX system was evaluated, both analytically and experimentally. For the experimental data evaluation, a software package was written for the Hewlett-Packard 5451C Fourier analyzer. The POGO analysis software is documented and consists of five separate segments. Each segment is stored on the 5451C disc as an individual program and performs its own unique function. Two separate data reduction methods, a signal calibration, coherence or pulser signal based frequency response function blanking, and automatic plotting features are included in the program. The 5451C allows variable parameter transfer from program to program. This feature is used to advantage and requires only minimal user interface during the data reduction process. Experimental results are included and compared with the analytical predictions in order to adjust the general model and arrive at a realistic simulation of the POGO characteristics.
The RESTORE program of restorative justice for sex crimes: vision, process, and outcomes.
Koss, Mary P
2014-06-01
The article reports empirical evaluation of RESTORE, a restorative justice (RJ) conferencing program adapted to prosecutor-referred adult misdemeanor and felony sexual assaults. RESTORE conferences included voluntary enrollment, preparation, and a face-to-face meeting where primary and secondary victims voice impacts, and responsible persons acknowledge their acts and together develop a re-dress plan that is supervised for 1 year. Process data included referral and consent rates, participant characteristics, observational ratings of conferences compared with program design, services delivered, and safety monitoring. Outcome evaluation used 22 cases to assess (a) pre-post reasons for choosing RESTORE, (b) preparation and conference experiences, (c) overall program and justice satisfaction, and (d) completion rates. This is the first peer-reviewed quantitative evaluation of RJ conferencing for adult sexual assault. Although the data have limitations, the results support cautious optimism regarding feasibility, safety, and satisfactory outcomes. They help envision how conferencing could expand and individualize justice options for sexual assault.
ERIC Educational Resources Information Center
National Inst. for Science Education, Madison, WI.
The National Institute for Science Education's (NISE) focused mission is to improve mathematics and science education from kindergarten through college. This document reports on NISE's research programs, dissemination programs, and organizational process programs. Contents include: (1) "Systemic Reform: Policy and Evaluation" (William H. Clune and…
HYDROLOGIC EVALUATION OF LANDFILL PERFORMANCE (HELP) MODEL - USER'S GUIDE FOR VERSION 3
This report documents the solution methods and process descriptions used in the Version 3 of the HELP model. Program documentation including program options, system and operating requirements, file structures, program structure and variable descriptions are provided in a separat...
ERIC Educational Resources Information Center
Akiba, Y.; And Others
This user's manual for the simulation program Graphical Evaluation and Review Technique (GERT) GQ contains sections on nodes, branches, program input description and format, and program output, as well as examples. Also included is a programmer's manual which contains information on scheduling, subroutine descriptions, COMMON Variables, and…
ERIC Educational Resources Information Center
Tushnet, Naida C.
The Star Schools Program has funded projects to explore innovative educational applications of technology in distance education. Funded projects have applied a variety of technologies, including videodisks, compressed data transmission, fiber optic technology, and computer networks. Program evaluation is a mandated aspect of the program. This…
Intervention mapping: a process for developing theory- and evidence-based health education programs.
Bartholomew, L K; Parcel, G S; Kok, G
1998-10-01
The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.
Key Performance Indicators in the Evaluation of the Quality of Radiation Safety Programs.
Schultz, Cheryl Culver; Shaffer, Sheila; Fink-Bennett, Darlene; Winokur, Kay
2016-08-01
Beaumont is a multiple hospital health care system with a centralized radiation safety department. The health system operates under a broad scope Nuclear Regulatory Commission license but also maintains several other limited use NRC licenses in off-site facilities and clinics. The hospital-based program is expansive including diagnostic radiology and nuclear medicine (molecular imaging), interventional radiology, a comprehensive cardiovascular program, multiple forms of radiation therapy (low dose rate brachytherapy, high dose rate brachytherapy, external beam radiotherapy, and gamma knife), and the Research Institute (including basic bench top, human and animal). Each year, in the annual report, data is analyzed and then tracked and trended. While any summary report will, by nature, include items such as the number of pieces of equipment, inspections performed, staff monitored and educated and other similar parameters, not all include an objective review of the quality and effectiveness of the program. Through objective numerical data Beaumont adopted seven key performance indicators. The assertion made is that key performance indicators can be used to establish benchmarks for evaluation and comparison of the effectiveness and quality of radiation safety programs. Based on over a decade of data collection, and adoption of key performance indicators, this paper demonstrates one way to establish objective benchmarking for radiation safety programs in the health care environment.
Model for an Employee Wellness Project.
ERIC Educational Resources Information Center
Love, Marybeth; And Others
1981-01-01
The evaluation of a health promotion program indicated that it had successfully used several approaches, including: psychophysical tests, individual health consultants, group programs, mass media, and wellness-oriented social activities. (CJ)
The development and validation of The Inquiry Science Observation Coding Sheet.
Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M
2008-08-01
Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.
Risks Associated with Federal Construction Projects
2011-06-01
awarding contracts for construction projects (USACE, 2010). BIM offers a method to effectively design a facility while maximizing work performance during...includes Requirements, Programming, Funding, Solicitation, AEC Evaluation, Award , Project Validation, Design and Construction, and Project Management...includes the Solicitation, AEC Evaluation, and Award Steps. In this Phase, BIM is only used in the Solicitation and the AEC Evaluation steps
Permanent and separable aerospace tubing/ fitting evaluation program, volume 1
NASA Technical Reports Server (NTRS)
Ursell, C. R.; Franz, C. R.
1975-01-01
The tube fitting evaluation program was conducted to develop a standard overall test program including methods, procedures, and equipment as well as recommended test sequences for qualifying fitting/tubing assemblies. The program consisted of testing the MS flareless (separable) fitting and utilizing the results as baseline data from which all other fittings will be evaluated. Five separable designs and five permanent designs were tested in three sizes with two types of tubing materials. The basic design requirements were 4,000 psi operating pressure within the temperature range of minus 65 F to plus 450 F while also being compatible with 21-6-9 and titanium 3Al-2.5V tubing alloys.
DECISION-MAKING ALIGNED WITH RAPID-CYCLE EVALUATION IN HEALTH CARE.
Schneeweiss, Sebastian; Shrank, William H; Ruhl, Michael; Maclure, Malcolm
2015-01-01
Availability of real-time electronic healthcare data provides new opportunities for rapid-cycle evaluation (RCE) of health technologies, including healthcare delivery and payment programs. We aim to align decision-making processes with stages of RCE to optimize the usefulness and impact of rapid results. Rational decisions about program adoption depend on program effect size in relation to externalities, including implementation cost, sustainability, and likelihood of broad adoption. Drawing on case studies and experience from drug safety monitoring, we examine how decision makers have used scientific evidence on complex interventions in the past. We clarify how RCE alters the nature of policy decisions; develop the RAPID framework for synchronizing decision-maker activities with stages of RCE; and provide guidelines on evidence thresholds for incremental decision-making. In contrast to traditional evaluations, RCE provides early evidence on effectiveness and facilitates a stepped approach to decision making in expectation of future regularly updated evidence. RCE allows for identification of trends in adjusted effect size. It supports adapting a program in midstream in response to interim findings, or adapting the evaluation strategy to identify true improvements earlier. The 5-step RAPID approach that utilizes the cumulating evidence of program effectiveness over time could increase policy-makers' confidence in expediting decisions. RCE enables a step-wise approach to HTA decision-making, based on gradually emerging evidence, reducing delays in decision-making processes after traditional one-time evaluations.
Economic Evaluation of Computerized Structural Analysis
NASA Technical Reports Server (NTRS)
Fortin, P. E.
1985-01-01
This completed effort involved a technical and economic study of the capabilities of computer programs in the area of structural analysis. The applicability of the programs to NASA projects and to other users was studied. The applications in other industries was explored including both research and development and applied areas. The costs of several alternative analysis programs were compared. A literature search covered applicable technical literature including journals, trade publications and books. In addition to the literature search, several commercial companies that have developed computerized structural analysis programs were contacted and their technical brochures reviewed. These programs include SDRC I-DEAS, MSC/NASTRAN, SCADA, SUPERSAP, NISA/DISPLAY, STAAD-III, MICAS, GTSTRUDL, and STARS. These programs were briefly reviewed as applicable to NASA projects.
China’s R&D for Energy Efficient Buildings: Insights for U.S. Cooperation with China
DOE Office of Scientific and Technical Information (OSTI.GOV)
Yu, Sha; Evans, Meredydd
2010-04-01
This report includes an evaluation of China’s current activities and future direction in building energy efficiency R&D and its relevance to DOE’s R&D activities under the Building Technologies Program in the Office of Energy Efficiency and Renewable Energy. The researchers reviewed the major R&D programs in China including the so-called 973 Program, the 863 Program, and the Key Technology R&D Program1 as well as the research activities of major research institutes. The report also reviewed several relevant documents of the Chinese government, websites (including the International Energy Agency and national and local governments in China), newsletters, and financial information listedmore » in the program documents and websites.« less
Saginaw Drug and Alcohol Abuse Education and Training Program: Product Evaluation, 1990-1991.
ERIC Educational Resources Information Center
Saginaw Public Schools, MI. Dept. of Evaluation Services.
This report evaluates the Saginaw Drug and Alcohol Abuse Education Training Program conducted in 1990-1991, which provided in-depth training for 94 professionals including 63 teachers and 7 counselors through a workshop lasting 5 days and containing 6 hours of instruction per day. The workshops addressed the identification of both drug abuse…
ERIC Educational Resources Information Center
Bamezai, Anil
1995-01-01
Some of the threats to internal validity that arise when evaluating the impact of water conservation programs during a drought are illustrated. These include differential response to the drought, self-selection bias, and measurement error. How to deal with these problems when high-quality disaggregate data are available is discussed. (SLD)
Joven Noble: Evaluation of a Culturally Focused Youth Development Program
ERIC Educational Resources Information Center
Tello, Jerry; Cervantes, Richard C.; Cordova, David; Santos, Susana M.
2010-01-01
The purpose of this study was to describe and evaluate a promising program model, the Joven Nobel curriculum, for Latino male adolescents that promotes positive youth development and addresses prevention of a number of risk-related sexual behaviors within a cultural context. A quasi-experimental design was used that included a pre- and posttest…
Joan Carlson; Pam Edwards; Todd Ellsworth; Michael Eberle
2015-01-01
The National BMP Program provides National Core BMPs, standardized monitoring protocols to evaluate implementation and effectiveness of the National Core BMPs, and a data management system to store and analyze the resulting monitoring data. BMP evaluations are completed by interdisciplinary teams of resource specialists and include assessments of whether BMP...
ERIC Educational Resources Information Center
Stevens, Karen A.; Folchman, Ruth
1998-01-01
This article discusses challenges in using participatory action research (PAR) in the evaluation of programs that provide services and supports to people with severe disabilities. Challenges include the need for modification of the model, time constraints, issues around power and position, and inclusion of individuals with severe disabilities.…
Virtual Reality for Life Skills Education: Program Evaluation
ERIC Educational Resources Information Center
Vogel, Jennifer; Bowers, Clint; Meehan, Cricket; Hoeft, Raegan; Bradley, Kristy
2004-01-01
A program evaluation was completed for a Virtual Reality (VR) pilot project intended to aid deaf children in learning various life skills which they may be at risk of not adequately learning. Such skills include crossing the street safely, exiting a building during a fire drill, and avoiding situations in which strangers may harm them. The VR was…
ERIC Educational Resources Information Center
Seay, Darolyn
2017-01-01
The research focused on clarifying the responsibility of the institution preparing these individuals including but not limited to: identifying dispositions of successful teachers, evaluating those dispositions in teacher education candidates going into education, developing dispositions standards, and evaluating candidate dispositions as they…
Federal Register 2010, 2011, 2012, 2013, 2014
2011-08-17
... assigned to the control group can re-apply to the YouthBuild program. The Department is soliciting comments... ``utilize appropriate methodology and research designs, including the use of control groups chosen by.... Accordingly, ETA is conducting a multisite control group evaluation to provide rigorous estimates [[Page 51058...
Pearls and Pitfalls in Evaluating a Student Assistance Program: A Five-Year Case Study
ERIC Educational Resources Information Center
Wilburn, Sharon T.; Wilburn, Kenneth T.; Weaver, Dax M.; Bowles, Kathy
2007-01-01
This article presents data from a five-year evaluation-research case study of a large urban schools district's internal Student Assistance Program (SAP). The district employed specially trained and licensed school-based counselors to implement an internal SAP expanded to include tertiary prevention, and modeled after an employee assistance program…
Pilot Evaluation of Parent and Child Enhancement Program for Disadvantaged Families
ERIC Educational Resources Information Center
Leung, Cynthia; Tsang, Sandra; Leung, Iona
2014-01-01
Objective: The present study was a pilot evaluation of the effectiveness of the Parent and Child Enhancement (PACE) program in enhancing child development for disadvantaged families with children aged 2 to 3. Method: Participants included 23 parent-child dyads who attended 2-hr sessions twice weekly for 20 weeks. Parents and children were assessed…
Evaluation of a Health Careers Program for Asian American and Pacific Islander High School Students
ERIC Educational Resources Information Center
Yeh, Christine J.; Borrero, Noah E.
2012-01-01
The authors evaluated a health careers program in a U.S. urban public high school. After small subgroups of the original sample were removed, participants included 162 Asian American and Pacific Islander students. Analyses of covariance indicated that, compared with the comparison group, the treatment group reported significantly higher levels of…
ERIC Educational Resources Information Center
Oxford, Rebecca L.; And Others
The Washington state Title I Migrant Program Evaluation project is a feasibility study designed to assess the suitability of existing normed criterion referenced tests to measuring mathematics achievement at grades four, five, and six. Objectives include judging the technical qualities and content of several normed criterion referenced tests;…
Development and evaluation of addiction treatment programs in Latin America.
Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E
2018-07-01
The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.
Redesigning a clinical mentoring program for improved outcomes in the clinical training of clerks
Lin, Chia-Der; Lin, Blossom Yen-Ju; Lin, Cheng-Chieh; Lee, Cheng-Chun
2015-01-01
Introduction Mentorship has been noted as critical to medical students adapting to clinical training in the medical workplace. A lack of infrastructure in a mentoring program might deter relationship building between mentors and mentees. This study assessed the effect of a redesigned clinical mentoring program from the perspective of clerks. The objective was to assess the benefits of the redesigned program and identify potential improvements. Methods A redesigned clinical mentoring program was launched in a medical center according to previous theoretical and practical studies on clinical training workplaces, including the elements of mentor qualifications, positive and active enhancers for mentor–mentee relationship building, the timing of mentoring performance evaluation, and financial and professional incentives. A four-wave web survey was conducted, comprising one evaluation of the former mentoring program and three evaluations of the redesigned clinical mentoring program. Sixty-four fifth-year medical students in clerkships who responded to the first wave and to at least two of the three following waves were included in the study. A structured and validated questionnaire encompassing 15 items on mentor performance and the personal characteristics of the clerks was used. Mixed linear models were developed for repeated measurements and to adjust for personal characteristics. Results The results revealed that the redesigned mentoring program improved the mentors’ performance over time for most evaluated items regarding professional development and personal support provided to the mentees. Conclusions Our findings serve as an improved framework for the role of the institution and demonstrate how institutional policies, programs, and structures can shape a clinical mentoring program. We recommend the adoption of mentorship schemes for other cohorts of medical students and for different learning and training stages involved in becoming a physician. PMID:26384479
48 CFR 819.7115 - Solicitation provisions.
Code of Federal Regulations, 2010 CFR
2010-10-01
... SOCIOECONOMIC PROGRAMS SMALL BUSINESS PROGRAMS VA Mentor-Protégé Program 819.7115 Solicitation provisions. (a) Insert 852.219-71, VA Mentor-Protégé Program, in solicitations that include FAR clause 52.219-9, Small Business Subcontracting Plan. (b) Insert 852.219-72, Evaluation Factor for Participation in the VA Mentor...
Program-Wide Positive Behavioral Interventions and Supports in Rural Preschools
ERIC Educational Resources Information Center
Steed, Elizabeth A.; Pomerleau, Tina; Muscott, Howard; Rohde, Leigh
2013-01-01
This article describes the quantitative findings from an evaluation of program-wide positive behavioral interventions and supports (PBIS) in three rural preschool programs. Each rural preschool program included children 3 through 5 years of age with and without disabilities. Following 3 years of on-site training, technical assistance, and coaching…
The Break the Cycle Evaluation Project
ERIC Educational Resources Information Center
Jaycox, Lisa H.; Aronoff, Jessica; Shelley, Gene A.
2007-01-01
Break the Cycle is a private, nonprofit organization that seeks to end domestic violence by working proactively with youth. Founded in 1996, it includes a preventive education and outreach program, a legal services program, and a peer leadership program. All three programs focus exclusively on youth aged 12-22 years. In 2000, Centers for Disease…
Developing the Preparation in STEM Leadership Programs for Undergraduate Academic Peer Leaders
ERIC Educational Resources Information Center
Blackwell, Stacey; Katzen, Sari; Patel, Nipa; Sun, Yan; Emenike, Mary
2017-01-01
The authors introduce the Preparation in STEM Leadership Program at Rutgers, The State University of New Jersey. This NSF-Funded program and research study creates a centralized training program for peer leaders that includes a battery of assessments to evaluate peer leaders' content knowledge, pedagogical knowledge, communication skills, and…
ERIC Educational Resources Information Center
Nelson, J. Ron; Martella, Ronald M.; Marchand-Martella, Nancy
2002-01-01
A study evaluated a comprehensive school-wide program based on an effective behavioral support approach for preventing disruptive behaviors implemented in seven elementary schools. The program included a school-wide discipline program, tutoring, conflict resolution, and functional behavioral intervention plans. Schools showed positive effects on…
Partnering with the Local Livestock Market in Educational Programs.
ERIC Educational Resources Information Center
Jenkins, Jamie H.; Newman, Michael E.; Castellaw, Jimmy C.; Lane, Clyde D., Jr.
2000-01-01
Survey responses from 62 of 96 cattle producers evaluated educational methods of the extension service and the livestock market. Methods included tips distributed with the sale check, monthly and sale day programs, and Second Saturday cattle working program. The combination of programs offered influenced them to make changes in their production…
Report on a Needs Assessment and Evaluation of a Drug Education Program.
ERIC Educational Resources Information Center
West, Phyllis; And Others
The Los Angeles Valley College Drug Education Program was established in 1970 as a central community resource agency specializing in narcotic and drug abuse prevention and education. The program included two components: a training component (short courses, seminars, speakers bureau) and a resource center (library, publications program). Because of…
Homer, Natalie; Yoon, Michael K
The qualities that applicants value in the American Society of Ophthalmic Plastic and Reconstructive Surgery (ASOPRS) fellowship programs have been studied, but the availability of this information on program websites has not yet been reviewed. The authors evaluated the availability of resident-valued ASOPRS fellowship program information on the Internet. The authors performed an Internet search of the 53 ASOPRS fellowship program websites and evaluated websites for 20 characteristics of interest to ASOPRS fellowship applicants such as teaching faculty, program description, rotation schedule, operative cases, and interview information. Of the 53 ASOPRS fellowship programs, 43 (81.1%) had a fellowship program-dedicated website. The fellowship websites contained a mean 7.6 characteristics (38.1%, range 0-15). Faculty listing, program description, and case diversity were the most commonly included data (74.4%, 72.1%, and 69.8%, respectively). Fellow selection process, interview information, and graduate job placement were least commonly included (7.0%, 2.3%, and 0.0%, respectively). There was no significant difference in website inclusiveness based on fellowship region or faculty number. Programs affiliated with an ophthalmology residency were more complete than those that were not (40.3% vs. 20.0%, p = 0.0098). This review found that most programs had websites and contained a reasonable number of characteristics. However, applicant-valued information regarding surgical volume, procedure variety, application information, and postgraduate employment history were often missing. American Society of Ophthalmic Plastic and Reconstructive Surgery fellowship programs may improve match outcomes by providing and enhancing program websites with details that their applicants seek.
NASA Technical Reports Server (NTRS)
1981-01-01
The liquid rocket propulsion technology needs to support anticipated future space vehicles were examined including any special action needs to be taken to assure that an industrial base in substained. Propulsion system requirements of Earth-to-orbit vehicles, orbital transfer vehicles, and planetary missions were evaluated. Areas of the fundamental technology program undertaking these needs discussed include: pumps and pump drives; combustion heat transfer; nozzle aerodynamics; low gravity cryogenic fluid management; and component and system life reliability, and maintenance. The primary conclusion is that continued development of the shuttle main engine system to achieve design performance and life should be the highest priority in the rocket engine program.
Schubert, Erin C.; Duininck, Megan; Shlafer, Rebecca J.
2016-01-01
We describe an evaluation of a prison visiting program, Extended Visiting (EV), for incarcerated mothers and their children. Mothers (N = 24) and caregivers (N = 19) were interviewed regarding experiences with the program. Mothers identified benefits including maintaining a relationship with children, physical contact, motivation, privacy, peer support, and personal growth. Caregivers echoed mothers’ appreciation for the opportunity to maintain mother-child relationships and physical contact. Mothers identified barriers including desire for overnight visits and more age-appropriate activities. Caregivers perceived travel time and costs and children’s adverse reactions as barriers. When comparing EV to typical visiting, participants unanimously preferred EV. PMID:27867281
Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane
2015-02-01
Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.
Pojednic, Rachele; Peabody, Stephanie; Carson, Shelley; Kennedy, Mary; Bevans, Katherine; Phillips, Edward M
2016-07-01
Most childhood physical activity interventions focus on reducing childhood obesity with varying success, indicating that body mass index (BMI) may be a limited marker of health in children. To better understand overall childhood health and wellbeing, this study is investigating BOKS (Build Our Kids Success), an established ongoing before-school physical activity program, to evaluate students' physical health, mental health, cognitive capacity, and academic performance. The study is a non-randomized controlled trial with 26 elementary and middle schools in 3 Massachusetts communities, including first through eighth grade (aged 5-14) students, their parents, and teachers. Data collection is occurring during the 2015-2016 school year. Physical fitness is being assessed via 400m run and anthropometrics via height and weight measures (BMI). Psychosocial outcomes are being assessed via student, parent, and teacher survey and include nutrition, daily activities, emotional and relationship scales, bullying and victimization, vitality and energy, student engagement, stress, positive affect, self-efficacy and life satisfaction. Academic performance is reported by grades. Statistical methods include a psychometric evaluation of study measures, Pearson correlations, Student's t-tests, ANOVA/ANCOVA and multivariate linear regression including multilevel modeling analyses to account for the hierarchical organization of the data. This study is investigating a before school physical activity program on parameters of physical health, mental health, cognitive capacity, and academic performance by employing a novel triad approach, correlating the input of the child, parent, and teacher. Outcomes will evaluate the effectiveness of a before school physical activity program in elementary and middle schools and potentially provide valuable information for schools looking to institute innovative physical activity programs. Copyright © 2016 Elsevier Inc. All rights reserved.
Utilization-focused evaluation of a STEM enrichment program
NASA Astrophysics Data System (ADS)
Carter, Sally
The purpose of this study was to determine the impact and utilization of a STEM enrichment program (hereafter referred to as The Program). The Program consisted of two parts. First an educator resource center provided free educational materials throughout The Program’s home state. The second part of The Program was a network of education specialists who provided professional development for teachers, modeled lessons with students, and provided presentations for the general public. The problem addressed by this study was a lack of knowledge regarding the impact of The Program. The Program’s director requested a utilization-focused program evaluation to answer thirteen questions. Questions covered Program impact for five areas: overall impact on teachers, overall impact on students, overall impact of materials, overall impact of Program personnel, and overall impact on STEM education. A mixed-methods case study was designed to gather data. Quantitative data included Program archival data regarding the number of contacts and a survey distributed to teachers who had used The Program’s services on at least one occasion. Qualitative data included written comments gathered from the teacher surveys, seven teacher focus groups, and four Program personnel interviews. Data found an overall positive Program impact in all five areas. Both quantitative and qualitative data showed favorable perceptions by teachers and Program personnel. It is not known if data from this case study can be generalized to other STEM enrichment programs. Future research might include a study to determine if The Program’s model could be used to generate new STEM enrichment programs.
Dy, Sydney M; Al Hamayel, Nebras Abu; Hannum, Susan M; Sharma, Ritu; Isenberg, Sarina R; Kuchinad, Kamini; Zhu, Junya; Smith, Katherine; Lorenz, Karl A; Kamal, Arif H; Walling, Anne M; Weaver, Sallie J
2017-12-01
Although critical for improving patient outcomes, palliative care quality indicators are not yet widely used. Better understanding of facilitators and barriers to palliative care quality measurement and improvement might improve their use and program quality. Development of a survey tool to assess palliative care team perspectives on facilitators and barriers to quality measurement and improvement in palliative care programs. We used the adapted Consolidated Framework for Implementation Research to define domains and constructs to select instruments. We assembled a draft survey and assessed content validity through pilot testing and cognitive interviews with experts and frontline practitioners for key items. We analyzed responses using a constant comparative process to assess survey item issues and potential solutions. We developed a final survey using these results. The survey includes five published instruments and two additional item sets. Domains include organizational characteristics, individual and team characteristics, intervention characteristics, and process of implementation. Survey modules include Quality Improvement in Palliative Care, Implementing Quality Improvement in the Palliative Care Program, Teamwork and Communication, Measuring the Quality of Palliative Care, and Palliative Care Quality in Your Program. Key refinements from cognitive interviews included item wording on palliative care team members, programs, and quality issues. This novel, adaptable instrument assesses palliative care team perspectives on barriers and facilitators for quality measurement and improvement in palliative care programs. Next steps include evaluation of the survey's construct validity and how survey results correlate with findings from program quality initiatives. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.
Hanford radiological protection support services annual report for 1994
DOE Office of Scientific and Technical Information (OSTI.GOV)
Lyon, M.; Bihl, D.E.; Fix, J.J.
1995-06-01
Various Hanford Site radiation protection services provided by the Pacific Northwest Laboratory for the US Department of Energy Richland Operations Office and Hanford contractors are described in this annual report for the calendar year 1994. These activities include external dosimetry measurements and evaluations, internal dosimetry measurements and evaluations, in vivo measurements, radiological record keeping, radiation source calibration, and instrument calibration and evaluation. For each of these activities, the routine program and any program changes or enhancements are described, as well as associated tasks, investigations, and studies. Program- related publications, presentations, and other staff professional activities are also described.
Hanford radiological protection support services. Annual report for 1995
DOE Office of Scientific and Technical Information (OSTI.GOV)
Lyon, M.; Bihl, D.E.; Carbaugh, E.H.
1996-05-01
Various Hanford Site radiation protection services provided by the Pacific Northwest National Laboratory for the U.S. Department of Energy Richland Operations Office and Hanford contractors are described in this annual report for calendar year 1995. These activities include external dosimetry measurements and evaluations, internal dosimetry measurements and evaluations, in vivo measurements, radiological record keeping, radiation source calibration, and instrument calibration and evaluation. For each of these activities, the routine program and any program changes or enhancements are described, as well as associated tasks, investigations, and studies. Program-related publications, presentations, and other staff professional activities are also described.
Writing objectives and evaluating learning in the affective domain.
Maier-Lorentz, M M
1999-01-01
Staff educators recognize the importance of affective competency for effective nursing practice. Inservice programs must include affective learning with objectives stated in measurable terms. Staff educators often express frustration in developing affective objectives and evaluating the learning outcome because attitudes and feelings are usually inferred from observations. This article presents affective learning objectives for a gerontological nursing inservice program and a rating scale that measures attitudes to evaluate the learning outcome.
NASA Technical Reports Server (NTRS)
1974-01-01
The feasibility is evaluated of an evolutionary development for use of a single-axis gimbal star tracker from prior two-axis gimbal star tracker based system applications. Detailed evaluation of the star tracker gimbal encoder is considered. A brief system description is given including the aspects of tracker evolution and encoder evaluation. System analysis includes evaluation of star availability and mounting constraints for the geosynchronous orbit application, and a covariance simulation analysis to evaluate performance potential. Star availability and covariance analysis digital computer programs are included.
Economic value evaluation in disease management programs.
Magnezi, Racheli; Reicher, Sima; Shani, Mordechai
2008-05-01
Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Tonn, Bruce Edward; Carroll, David; Pigg, Scott
This report presents a summary of the studies and analyses that compose the retrospective evaluation of the U.S. Department of Energy s low-income Weatherization Assistance Program (WAP). WAP provides grants to Grantees (i.e., states) that then provide grants to Subgrantees (i.e., local weatherization agencies) to weatherize low-income homes. This evaluation focused on the WAP Program Year 2008. The retrospective evaluation produced twenty separate reports, including this summary. Four separate reports address the energy savings, energy cost savings, and cost effectiveness of WAP across four housing types: single family, mobile home, small multifamily, and large multifamily. Other reports address the environmentalmore » emissions, macroeconomic, and health and household-related benefits attributable to WAP, and characterize the program, its recipients, and those eligible for the program. Major field studies are also summarized, including a major indoor air quality study and a follow-up ventilation study, an in-depth in-field assessment of weatherization work and quality, and a study that assesses reasons for variations in energy savings across homes. Results of surveys of weatherization staff, occupants, occupants satisfaction with weatherization services provided, and weatherization trainees are summarized. Lastly, this report summarizes a set of fifteen case studies of high-performing and unique local weatherization agencies.« less
Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori
2016-10-06
Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.
Evaluation of an employer-sponsored pedometer-based physical activity program.
Behrens, Timothy K; Domina, Lorie; Fletcher, Gena M
2007-12-01
This study evaluated a competition-based employer-sponsored physical activity program using pedometers. City employees (N approximately 2,600) formed teams in groups of 10 persons (N = 640). The groups competed against each other over a 12-wk. period with the goal of attaining 10,000 steps per day, per person. Only teams with complete data were included in the formal evaluation. A repeated-measures analysis of variance indicated significant differences in team steps by week of the program, with post hoc comparisons indicating significant differences from baseline step counts evident during Weeks 6-8 but not at the end of the program. These data confirm that competition-based physical activity programs using pedometers may not be an effective means of increasing the long-term physical activity of employees.
Visual Basic programs for spreadsheet analysis.
Hunt, Bruce
2005-01-01
A collection of Visual Basic programs, entitled Function.xls, has been written for ground water spreadsheet calculations. This collection includes programs for calculating mathematical functions and for evaluating analytical solutions in ground water hydraulics and contaminant transport. Several spreadsheet examples are given to illustrate their use.
Marketing the Masters of Executive Management Program
2007-12-01
25 A. BUSINESS SCHOOLS COMPARATIVE EVALUATION ......................25 B. PRACTICES IN MARKETING... Business Schools .....................................................................28 Table 2. Curriculum Emphasis (Business Week, 2005... business schools to recruit students and market their MBA programs. An analysis of the MEM program which includes the performance of the MEM to
ERIC Educational Resources Information Center
Krutzch, Christine B.; And Others
1987-01-01
A technology transfer project for getting initial community adoption of childhood asthma management programs is described. The evolution of the project, including development of programs, packaging considerations, establishment of partnerships, implementation, and evaluation are discussed. (Author/CH)
User's manual for CNVUFAC, the general dynamics heat-transfer radiation view factor program
DOE Office of Scientific and Technical Information (OSTI.GOV)
Wong, R. L.
CNVUFAC, the General Dynamics heat-transfer radiation veiw factor program, has been adapted for use on the LLL CDC 7600 computer system. The input and output have been modified, and a node incrementing logic was included to make the code compatible with the TRUMP thermal analyzer and related codes. The program performs the multiple integration necessary to evaluate the geometric black-body radiaton node to node view factors. Card image output that contains node number and view factor information is generated for input into the related program GRAY. Program GRAY is then used to include the effects of gray-body emissivities and multiplemore » reflections, generating the effective gray-body view factors usable in TRUMP. CNVUFAC uses an elemental area summation scheme to evaluate the multiple integrals. The program permits shadowing and self-shadowing. The basic configuration shapes that can be considered are cylinders, cones, spheres, ellipsoids, flat plates, disks, toroids, and polynomials of revolution. Portions of these shapes can also be considered.« less
Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M
2018-08-01
To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.
The bottom-up approach to integrative validity: a new perspective for program evaluation.
Chen, Huey T
2010-08-01
The Campbellian validity model and the traditional top-down approach to validity have had a profound influence on research and evaluation. That model includes the concepts of internal and external validity and within that model, the preeminence of internal validity as demonstrated in the top-down approach. Evaluators and researchers have, however, increasingly recognized that in an evaluation, the over-emphasis on internal validity reduces that evaluation's usefulness and contributes to the gulf between academic and practical communities regarding interventions. This article examines the limitations of the Campbellian validity model and the top-down approach and provides a comprehensive, alternative model, known as the integrative validity model for program evaluation. The integrative validity model includes the concept of viable validity, which is predicated on a bottom-up approach to validity. This approach better reflects stakeholders' evaluation views and concerns, makes external validity workable, and becomes therefore a preferable alternative for evaluation of health promotion/social betterment programs. The integrative validity model and the bottom-up approach enable evaluators to meet scientific and practical requirements, facilitate in advancing external validity, and gain a new perspective on methods. The new perspective also furnishes a balanced view of credible evidence, and offers an alternative perspective for funding. Copyright (c) 2009 Elsevier Ltd. All rights reserved.
Motivation for Evaluation: A roadmap for Improving Program Efficacy
NASA Astrophysics Data System (ADS)
Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.
2016-12-01
Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.
A National Evaluation of Community-Based Youth Cessation Programs: Design and Implementation
ERIC Educational Resources Information Center
Curry, Susan J.; Mermelstein, Robin J.; Sporer, Amy K.; Emery, Sherry L.; Berbaum, Michael L.; Campbell, Richard T.; Carusi, Charles; Flay, Brian; Taylor, Kristie; Warnecke, Richard B.
2010-01-01
Although widely available, little is known about the effectiveness of youth cessation treatments delivered in real-world settings. The authors recruited a nonprobability sample of 41 community-based group-format programs that treated at least 15 youth per year and included evidence-based treatment components. Data collection included longitudinal…
ERIC Educational Resources Information Center
Schreier, Hans; And Others
1990-01-01
The University of Florida's efforts to include aspects of genetically engineered drugs into undergraduate teaching and develop a graduate program focusing on the pharmaceutical aspects of technology are outlined, including constituent contributions, attendance, and evaluation. The program's current status and plans for a lab course are discussed.…
A Program for Neurological Organization.
ERIC Educational Resources Information Center
Bowers, Louis
A program for neurological organization is explained and its purposes are stated. Hints are given for working with both child and parents; and form for evaluating measures of neuromotor fitness is included. Also provided is a checklist for rating motor exploration, including movements performed lying on the back, on the knees, or standing or on…
Information Management Strategies for Program Tracking and Formative Evaluation
NASA Astrophysics Data System (ADS)
Siegfried, D.; Detrick, L.; Valaitis, S.; Johnson, A.; Thomas, S. H.; Fauver, A.
2013-05-01
The Institute for Broadening Participation (IBP) has developed information management systems to facilitate programmatic formative evaluation, tracking and outreach activities. Nearly a decade of design solutions and technical implementations in support of IBP's professional development and mentoring programs for students (including the "Pathways to Ocean Science," "Minorities Striving and Pursuing Higher Degrees of Success" in Earth System Science, and "Pathways to Engineering") has provided IBP with a toolbox of proven strategies for addressing program engagement and participant tracking, outreach, and a variety of other information management needs. In this session, IBP will use case-specific examples to share general design strategies for program participant and activities data collection in REUs and other program types. The cases will illustrate an approach that begins with a review of program logic, objectives, expected outcomes, constraints and requirements, which then informs a comprehensive system design. When implemented, such information systems improve administrative efficiency through streamlined data collection processes and easy-to-use data capture forms, and a corresponding set of reporting tools provides access to data that is crucial for ongoing program improvement. IBP presents this information in response to collaborations with administrators of Research Experience for Undergraduates (REU) programs as well as longer duration programs, who have expressed the need for more comprehensive and easy to use information systems. Recently IBP has also worked with the directors of NSF and NASA funded programs seeking assistance in addressing their formative evaluation needs including system design, information collection, and reporting efforts.
Impact of a Pharmacy-Cardiology Collaborative Practice on Dofetilide Safety Monitoring.
Quffa, Lieth H; Panna, Mark; Kaufmann, Michael R; McKillop, Matthew; Dietrich, Nicole Maltese; Franck, Andrew J
2017-01-01
Limited studies have been published examining dofetilide's postmarketing use and its recommended monitoring. To evaluate the impact of a collaborative pharmacy-cardiology antiarrhythmic drug (AAD) monitoring program on dofetilide monitoring. This retrospective cohort study was performed to assess if a novel monitoring program improved compliance with dofetilide-specific monitoring parameters based on the Food and Drug Administration's Risk Evaluation and Mitigation Strategy. A total of 30 patients were included in the analysis. The monitoring parameters evaluated included electrocardiogram, serum potassium, serum magnesium, and kidney function. The primary outcome evaluated was the composite of these dofetilide monitoring parameters obtained in each cohort. In the standard cohort, 245 of 352 (69.6%) monitoring parameters were completed versus 134 of 136 (98.5%) in the intervention group ( P < 0.05). A collaborative pharmacy-cardiology AAD monitoring program was associated with a significant improvement in dofetilide monitoring. This improvement could potentially translate into enhanced patient safety outcomes, such as prevention of adverse drug reactions and decreased hospitalizations.
UWALK: the development of a multi-strategy, community-wide physical activity program.
Jennings, Cally A; Berry, Tanya R; Carson, Valerie; Culos-Reed, S Nicole; Duncan, Mitch J; Loitz, Christina C; McCormack, Gavin R; McHugh, Tara-Leigh F; Spence, John C; Vallance, Jeff K; Mummery, W Kerry
2017-03-01
UWALK is a multi-strategy, multi-sector, theory-informed, community-wide approach using e and mHealth to promote physical activity in Alberta, Canada. The aim of UWALK is to promote physical activity, primarily via the accumulation of steps and flights of stairs, through a single over-arching brand. This paper describes the development of the UWALK program. A social ecological model and the social cognitive theory guided the development of key strategies, including the marketing and communication activities, establishing partnerships with key stakeholders, and e and mHealth programs. The program promotes the use of physical activity monitoring devices to self-monitor physical activity. This includes pedometers, electronic devices, and smartphone applications. In addition to entering physical activity data manually, the e and mHealth program provides the function for objective data to be automatically uploaded from select electronic devices (Fitbit®, Garmin and the smartphone application Moves) The RE-AIM framework is used to guide the evaluation of UWALK. Funding for the program commenced in February 2013. The UWALK brand was introduced on April 12, 2013 with the official launch, including the UWALK website on September 20, 2013. This paper describes the development and evaluation framework of a physical activity promotion program. This program has the potential for population level dissemination and uptake of an ecologically valid physical activity promotion program that is evidence-based and theoretically framed.
Evaluate Yourself. Evaluation: Research-Based Decision Making Series, Number 9304.
ERIC Educational Resources Information Center
Fetterman, David M.
This document considers both self-examination and external evaluation of gifted and talented education programs. Principles of the self-examination process are offered, noting similarities to external evaluation models. Principles of self-evaluation efforts include the importance of maintaining a nonjudgmental orientation, soliciting views from…
Improving delivery of a health-promoting-environments program: experiences from Queensland Health.
Dwyer, S
1997-01-01
The purpose of this paper is to outline the key components of a statewide multisite health-promoting-environments program. Contemporary health-promotion programs in settings such as schools, workplaces and hospitals use organisational development theory to address the health issues of the setting, including the physical environment, the organisational environment, and the specific health needs of the employees and consumers of the service. Program principles include management of each project by the participant organisation or site (for example, a school or workplace), using resources available within the organisation and the local community, voluntary participation, social justice and participant-based priority setting, and evaluation and monitoring. Adoption of these principles implies a shift in the role of the health worker from implementer to facilitator. Based on the experience of Queensland Health, it is proposed that the essential building blocks of the health-promoting-environments program are an intersectoral policy base, a model for action, training and resources, local facilitators, support from local organisations, a supportive network of sites, marketing of the program, and a state-based evaluation and monitoring system. The program in Queensland was able to develop a significant number of these components over the 1990-1996 period. In regard to evaluation, process measures can be built around the program components; however, further research is required for development of impact indicators and benchmarks on quality.
Martinez-Mier, Esperanza A; Soto-Rojas, Armando E; Stelzner, Sarah M; Lorant, Diane E; Riner, Mary E; Yoder, Karen M
2011-04-01
Many health professions students who treat Spanish-speaking patients in the United States have little concept of their culture and health related traditions. The lack of understanding of these concepts may constitute major barriers to healthcare for these patients. International service-learning experiences allow students to work directly in communities from which patients immigrate and, as a result, students gain a better understanding of these barriers. This article describes the implementation of an international, multidisciplinary, service-learning program in a dental school in the United States. The Indiana University International Service-Learning program in Hidalgo, Mexico began in 1999 as an alternative spring break travel and clinical experience for medical students, focusing on the treatment of acute health problems. Travel-related preparatory sessions were offered, and no learning or service objectives had been developed. The program has evolved to include a multidisciplinary team of dental, medical, nursing, public health and social work students and faculty. The experience is now integrated into a curriculum based on the service-learning model that allows students to use their clinical skills in real-life situations and provides structured time for reflection. The program aims to enhance teaching and foster civic responsibility in explicit partnership with the community. Preparatory sessions have evolved into a multidisciplinary graduate level course with defined learning and service objectives. PROGRAM EVALUATION METHODS: In order to assess the program's operation as perceived by students and faculty and to evaluate student's perceptions of learning outcomes, evaluation tools were developed. These tools included student and faculty evaluation questionnaires, experiential learning journals, and a strengths, weaknesses, opportunities and threats analysis. Evaluation data show that after program participation, students perceived an increase in their cultural awareness, cross-cultural communication skills and understanding of barriers and disparities faced by Latinos in the United States. Faculty evaluations offer insights into the lessons learned through the implementation process. The development of a service-learning based curriculum has posed challenges but has enriched international service experiences.
DOE handbook: Guide to good practices for training and qualification of maintenance personnel
DOE Office of Scientific and Technical Information (OSTI.GOV)
NONE
1996-03-01
The purpose of this Handbook is to provide contractor training organizations with information that can be used to verify the adequacy of and/or modify existing maintenance training programs, or to develop new training programs. This guide, used in conjunction with facility-specific job analyses, provides a framework for training and qualification programs for maintenance personnel at DOE reactor and nonreactor nuclear facilities. Recommendations for qualification are made in four areas: education, experience, physical attributes, and training. The functional positions of maintenance mechanic, electrician, and instrumentation and control technician are covered by this guide. Sufficient common knowledge and skills were found tomore » include the three disciplines in one guide to good practices. Contents include: qualifications; on-the-job training; trainee evaluation; continuing training; training effectiveness evaluation; and program records. Appendices are included which relate to: administrative training; industrial safety training; fundamentals training; tools and equipment training; facility systems and component knowledge training; facility systems and component skills training; and specialized skills training.« less
D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry
2016-05-26
Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.
NASA Technical Reports Server (NTRS)
Dupnick, E.; Wiggins, D.
1980-01-01
The functional specifications, functional design and flow, and the program logic of the GREEDY computer program are described. The GREEDY program is a submodule of the Scheduling Algorithm for Mission Planning and Logistics Evaluation (SAMPLE) program and has been designed as a continuation of the shuttle Mission Payloads (MPLS) program. The MPLS uses input payload data to form a set of feasible payload combinations; from these, GREEDY selects a subset of combinations (a traffic model) so all payloads can be included without redundancy. The program also provides the user a tutorial option so that he can choose an alternate traffic model in case a particular traffic model is unacceptable.
Evaluation Methods Sourcebook.
ERIC Educational Resources Information Center
Love, Arnold J., Ed.
The chapters commissioned for this book describe key aspects of evaluation methodology as they are practiced in a Canadian context, providing representative illustrations of recent developments in evaluation methodology as it is currently applied. The following chapters are included: (1) "Program Evaluation with Limited Fiscal and Human…
Buckley, Mitchell S; Kane-Gill, Sandra L; Patel, Shardool A
2013-03-01
Anemia is common in several patient populations, including those with chronic kidney disease, cancer, and HIV/AIDS, and may require treatment with erythropoietin-stimulating agents (ESAs). Given the potential risks of the ESA, epoetin, and the significant costs associated with this agent, a large teaching medical institution developed a the drug-utilization management program using evidence-based guidelines on appropriate use. This study was designed to determine the clinical and financial impact of the drug-utilization management program. This retrospective cohort study was conducted at the medical institution that implemented the program using clinical pharmacists. Patients were included if epoetin was administered during their hospital stay (evaluation period, December 1, 2010, to December 31, 2011). The rate of inappropriate epoetin prescribing and the economic impact of guideline implementation were evaluated using comparisons of data from cohorts prescribed epoetin before and after guideline implementation. Data from 796 patients were included in the analyses (pre-implementation, 496; post-implementation, 300). The proportion of patients prescribed epoetin was significantly smaller after guideline implementation (2.4% vs 1.6%; P < 0.001). The reduction in the total number of epoetin units administered was 45%. The significant reduction (25%) in inappropriate prescribing after guideline implementation was primarily attributed to a 17% decrease in epoetin use in nonspecific anemia. The reduction in inappropriate epoetin prescribing translated into a 23.8% reduction in costs (P < 0.001) associated with inappropriate epoetin use. The estimated annual cost-savings of this program was $198,352 ($16,529/mo). The implementation of a drug-utilization management program using clinical pharmacists who evaluated epoetin was associated with a decrease in inappropriate epoetin prescribing and with significant cost-savings. Copyright © 2013 Elsevier HS Journals, Inc. All rights reserved.
Boyden, Jackelyn Y.; Kalish, Virginia B.; Muir, J. Cameron; Richardson, Suzanne; Connor, Stephen R.
2016-01-01
Abstract Background: An estimated 6,000 to 18,000 additional hospice and palliative medicine (HPM) physicians are needed in the United States. A source could be the military graduate medical education system where 15% of U.S. medical residents are trained. A community-based hospice and palliative care organization created a one-week rotation for military residents including participation in interdisciplinary group visits at patients' homes, facilities, and an inpatient hospice unit. Objective: Our goal was to evaluate the effectiveness of a one-week community HPM rotation for military medical residents. Methods: A mixed-methods, multi-stakeholder perspective program evaluation model was used for program years 2011 to 2013. Data were managed and analyzed using Microsoft Excel and Atlas.ti. Participants in the rotation were residents training at two local military hospitals. Program evaluation data were collected from residents, military program liaisons, and hospice clinical preceptors. Quantitative data included pre- and post-tests based on Accreditation Council for Graduate Medical Education competencies completed by residents. Qualitative data included resident essays and semi-structured interviews with hospice preceptors and military program liaisons. Results: Quantitative and qualitative data suggested that the rotation increased military residents' knowledge, attitudes, and comfort level with HPM. Quantitative analysis of test scores indicated improvements from pre- to post-tests in each of five areas of learning. Qualitative data indicated the rotation created a greater appreciation for the overall importance of HPM and increased understanding of eligibility and methods for pain and symptom management. Conclusions: A one-week community hospice rotation for medical military residents impacts participant's knowledge of and attitudes toward HPM. PMID:27139524
Conclusions and Further Readings.
ERIC Educational Resources Information Center
Lucas, John A.
1979-01-01
The components of a complete and effective marketing plan for higher education institutions are summarized. It is suggested that a marketing plan embrace all elements of the total marketing concept, and include curriculum evaluation, a retention program, and a scheme for evaluating the strategy's effectiveness. A bibliography is included.…
Outcomes and lessons learned from evaluating TRICARE's disease management programs.
Dall, Timothy M; Askarinam Wagner, Rachel C; Zhang, Yiduo; Yang, Wenya; Arday, David R; Gantt, Cynthia J
2010-06-01
To share outcomes and lessons learned from an evaluation of disease management (DM) programs for asthma, congestive heart failure (CHF), and diabetes for TRICARE patients. Multiyear evaluation of participants in voluntary, opt-out DM programs. Patient-centered programs, administered by 3 regional contractors, provide phone-based consultations with a care manager, educational materials, and newsletters. The study sample consisted of 23,793 asthma, 4092 CHF, and 29,604 diabetes patients with at least 6 months' tenure in the program. Medical claims were analyzed to quantify program effect on healthcare utilization, medical costs, and clinical outcomes. Multivariate regression analysis with an historical control group was used to predict patient outcomes in the absence of DM. The difference between actual and predicted DM patient outcomes was attributed to the program. A patient survey collected data on program satisfaction and perceived usefulness of program information and services. Modest improvements in patient outcomes included reduced inpatient days and medical costs, and (with few exceptions) increased percentages of patients receiving appropriate medications and tests. Annual per patient reductions in medical costs were $453, $371, and $783 for asthma, CHF, and diabetes program participants, respectively. The estimated return on investment was $1.26 per $1.00 spent on DM services. Findings suggest that the DM programs more than pay for themselves, in addition to improving patient health and quality of life. Lessons learned in program design, implementation, effectiveness, and evaluation may benefit employers contemplating DM, DM providers, and evaluators of DM programs.
Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)
NASA Astrophysics Data System (ADS)
Shebby, S.; Shipp, S. S.
2013-12-01
Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.
2003 Children's Health Protection Advisory Committee Meeting Agendas
Objectives for the two meetings in 2003 include discussing the Voluntary Children's Chemical Evaluation Program, highlights of recent activities, priorities for future programs, the Indicators Report, human milk contamination, and farm children.
Apollo experience report: Real-time auxiliary computing facility development
NASA Technical Reports Server (NTRS)
Allday, C. E.
1972-01-01
The Apollo real time auxiliary computing function and facility were an extension of the facility used during the Gemini Program. The facility was expanded to include support of all areas of flight control, and computer programs were developed for mission and mission-simulation support. The scope of the function was expanded to include prime mission support functions in addition to engineering evaluations, and the facility became a mandatory mission support facility. The facility functioned as a full scale mission support activity until after the first manned lunar landing mission. After the Apollo 11 mission, the function and facility gradually reverted to a nonmandatory, offline, on-call operation because the real time program flexibility was increased and verified sufficiently to eliminate the need for redundant computations. The evaluation of the facility and function and recommendations for future programs are discussed in this report.
Measuring the Impact of Programs that Challenge the Public Stigma of Mental Illness
Corrigan, Patrick W.; Shapiro, Jenessa R.
2010-01-01
Public stigma robs people with mental illnesses from rightful opportunities related to work and other important life goals. Advocates have developed anti-stigma programs meant to address the prejudice and discrimination associated with these conditions. Evidence is now needed to make sense of program impact; this paper looks at measurement issues related to stigma change. Community based participatory research is central to this research and includes the involvement of a diverse collection of stakeholders in all phases of evaluation. Investigators should be cautious about measures vis-à-vis social desirability effects and should directed by social validity of targeted audiences. Conceptual domains with some research support that correspond with assessments include behavior, penetration, psychological perspective, knowledge, and physiological/information processes. These issues are summarized as ten recommendations for evaluation of anti-stigma programs. PMID:20674114
The IHS diagnostic X-ray equipment radiation protection program
DOE Office of Scientific and Technical Information (OSTI.GOV)
Knapp, A.; Byrns, G.; Suleiman, O.
The Indian Health Service (IHS) operates or contracts with Tribal groups to operate 50 hospitals and approximately 165 primary ambulatory care centers. These facilities contain approximately 275 medical and 800 dental diagnostic x-ray machines. IHS environmental health personnel in collaboration with the Food and Drug Administration's (FDA) Center for Devices and Radiological Health (CDRH) developed a diagnostic x-ray protection program including standard survey procedures and menu-driven calculations software. Important features of the program include the evaluation of equipment performance collection of average patient entrance skin exposure (ESE) measurements for selected procedures, and quality assurance. The ESE data, collected using themore » National Evaluation of X-ray Trends (NEXT) protocol, will be presented. The IHS Diagnostic X-ray Radiation Protection Program is dynamic and is adapting to changes in technology and workload.« less
18 CFR 708.4 - Required programs and reports.
Code of Federal Regulations, 2010 CFR
2010-04-01
... 18 Conservation of Power and Water Resources 2 2010-04-01 2010-04-01 false Required programs and reports. 708.4 Section 708.4 Conservation of Power and Water Resources WATER RESOURCES COUNCIL UPPER... shall include survey research, program evaluation, and information/education activities as described in...
Assessing Conformity to Standards for Treatment Foster Care.
ERIC Educational Resources Information Center
Farmer, Elizabeth M. Z.; Burns, Barbara J.; Dubs, Melanie S.; Thompson, Shealy
2002-01-01
This study examined conformity to the Program Standards for Treatment Foster Care among 42 statewide programs. Findings suggest fair to good overall conformity, with considerable variation among programs. A discussion of methodological and substantive considerations for future research and evaluation using this approach is included. (Contains…
29 CFR 29.6 - Program performance standards.
Code of Federal Regulations, 2012 CFR
2012-07-01
... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...
29 CFR 29.6 - Program performance standards.
Code of Federal Regulations, 2011 CFR
2011-07-01
... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...
29 CFR 29.6 - Program performance standards.
Code of Federal Regulations, 2013 CFR
2013-07-01
... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...
29 CFR 29.6 - Program performance standards.
Code of Federal Regulations, 2014 CFR
2014-07-01
... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...
"Come to Chimera!" 1978: A Librarian's Planning Handbook.
ERIC Educational Resources Information Center
Lukenbill, Shirley; Lesser, Anita
This handbook, prepared to assist librarians in planning summer reading programs for children, includes suggestions on the following: (1) establishing program goals, objectives, and activities; (2) supplies, resources, and materials needed for the program; (3) sample registration, evaluation, and volunteer recruitment forms; (4) types of publicity…
Using Corporate-Based Methods To Assess Technical Communication Programs.
ERIC Educational Resources Information Center
Faber, Brenton; Bekins, Linn; Karis, Bill
2002-01-01
Investigates methods of program assessment used by corporate learning sites and profiles value added methods as a way to both construct and evaluate academic programs in technical communication. Examines and critiques assessment methods from corporate training environments including methods employed by corporate universities and value added…
DOT National Transportation Integrated Search
2012-11-01
This reports summarizes the project findings including the following: : An evaluation of the current pavement preservation program used in Alaska and a roadmap to grow the program : A summary of the best practices in terms of pavement preserv...
The NASA NASTRAN structural analysis computer program - New content
NASA Technical Reports Server (NTRS)
Weidman, D. J.
1978-01-01
Capabilities of a NASA-developed structural analysis computer program, NASTRAN, are evaluated with reference to finite-element modelling. Applications include the automotive industry as well as aerospace. It is noted that the range of sub-programs within NASTRAN has expanded, while keeping user cost low.
Usability evaluation of user interface of thesis title review system
NASA Astrophysics Data System (ADS)
Tri, Y.; Erna, A.; Gellysa, U.
2018-03-01
Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.
Pasos Adelante: the effectiveness of a community-based chronic disease prevention program.
Staten, Lisa K; Scheu, Linda L; Bronson, Dan; Peña, Veronica; Elenes, JoJean
2005-01-01
Implementing programs that target primary prevention of chronic diseases is critical for at-risk populations. Pasos Adelante, or "Steps Forward," is a curriculum aimed at preventing diabetes, cardiovascular disease, and other chronic diseases in Hispanic populations. Pasos Adelante is adapted from the National Heart, Lung, and Blood Institute's cardiovascular disease prevention curriculum, Su Corazon, Su Vida, and includes sessions on diabetes and community advocacy and incorporates walking clubs. The Pasos Adelante curriculum was implemented in two Arizona, United States-Sonora, Mexico border counties. Key issues in these communities are safety, access to recreational facilities, climate, and cultural beliefs. Pasos Adelante is a 12-week program facilitated by community health workers. The program includes interactive sessions on chronic disease prevention, nutrition, and physical activity. Evaluation of the program included precurriculum and postcurriculum questionnaires with self-reported measures of physical activity and dietary patterns. Approximately 250 people participated in the program in Yuma and Santa Cruz counties. Postprogram evaluation results demonstrate a significant increase in moderate to vigorous walking among participants and shifts in nutritional patterns. The Pasos Adelante program demonstrates that an educational curriculum in conjunction with the support of community health workers can motivate people in Arizona/Sonora border communities to adopt healthy lifestyle behaviors.
The Practice of Health Program Evaluation.
Lewis, Sarah R
2017-11-01
The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.
lsjk—a C++ library for arbitrary-precision numeric evaluation of the generalized log-sine functions
NASA Astrophysics Data System (ADS)
Kalmykov, M. Yu.; Sheplyakov, A.
2005-10-01
Generalized log-sine functions Lsj(k)(θ) appear in higher order ɛ-expansion of different Feynman diagrams. We present an algorithm for the numerical evaluation of these functions for real arguments. This algorithm is implemented as a C++ library with arbitrary-precision arithmetics for integer 0⩽k⩽9 and j⩾2. Some new relations and representations of the generalized log-sine functions are given. Program summaryTitle of program:lsjk Catalogue number:ADVS Program summary URL:http://cpc.cs.qub.ac.uk/summaries/ADVS Program obtained from: CPC Program Library, Queen's University of Belfast, N. Ireland Licensing terms: GNU General Public License Computers:all Operating systems:POSIX Programming language:C++ Memory required to execute:Depending on the complexity of the problem, at least 32 MB RAM recommended No. of lines in distributed program, including testing data, etc.:41 975 No. of bytes in distributed program, including testing data, etc.:309 156 Distribution format:tar.gz Other programs called:The CLN library for arbitrary-precision arithmetics is required at version 1.1.5 or greater External files needed:none Nature of the physical problem:Numerical evaluation of the generalized log-sine functions for real argument in the region 0<θ<π. These functions appear in Feynman integrals Method of solution:Series representation for the real argument in the region 0<θ<π Restriction on the complexity of the problem:Limited up to Lsj(9)(θ), and j is an arbitrary integer number. Thus, all function up to the weight 12 in the region 0<θ<π can be evaluated. The algorithm can be extended up to higher values of k(k>9) without modification Typical running time:Depending on the complexity of problem. See text below.
NASA Technical Reports Server (NTRS)
Medan, R. T.; Ray, K. S.
1974-01-01
A description of and users manual are presented for a U.S.A. FORTRAN 4 computer program which evaluates spanwise and chordwise loading distributions, lift coefficient, pitching moment coefficient, and other stability derivatives for thin wings in linearized, steady, subsonic flow. The program is based on a kernel function method lifting surface theory and is applicable to a large class of planforms including asymmetrical ones and ones with mixed straight and curved edges.
2013-01-01
Background The demand for health professionals continues to increase, partially due to the aging population and the high proportion of practitioners nearing retirement. The University of British Columbia (UBC) has developed a program to address this demand, by providing support for internationally trained Physiotherapists in their preparation for taking the National Physiotherapy competency examinations. The aim was to create a program comprised of the educational tools and infrastructure to support internationally educated physiotherapists (IEPs) in their preparation for entry to practice in Canada and, to improve their pass rate on the national competency examination. Methods The program was developed using a logic model and evaluated using program evaluation methodology. Program tools and resources included educational modules and curricular packages which were developed and refined based on feedback from clinical experts, IEPs and clinical physical therapy mentors. An examination bank was created and used to include test-enhanced education. Clinical mentors were recruited and trained to provide clinical and cultural support for participants. Results The IEP program has recruited 124 IEPs, with 69 now integrated into the Canadian physiotherapy workforce, and more IEPs continuing to apply to the program. International graduates who participated in the program had an improved pass rate on the national Physiotherapy Competency Examination (PCE); participation in the program resulted in them having a 28% (95% CI, 2% to 59%) greater possibility of passing the written section than their counterparts who did not take the program. In 2010, 81% of all IEP candidates who completed the UBC program passed the written component, and 82% passed the clinical component. Conclusion The program has proven to be successful and sustainable. This program model could be replicated to support the successful integration of other international health professionals into the workforce. PMID:24119470
Evaluating the Progress of the School Reading Program. Learning Package No. 17.
ERIC Educational Resources Information Center
Nelson, Carol; Smith, Carl, Comp.
Originally developed for the Department of Defense Schools (DoDDS) system, this learning package on evaluating the progress of the school reading program is designed for teachers who wish to upgrade or expand their teaching skills on their own. The package includes a comprehensive search of the ERIC database; a lecture giving an overview on the…
ERIC Educational Resources Information Center
Spiel, Craig F.; Evans, Steven W.; Langberg, Joshua M.
2014-01-01
The purpose of this study was to evaluate the degree with which Individualized Education Programs (IEPs) and 504 Plans prepared for middle school students with attention deficit/hyperactivity disorder (ADHD) conformed to best practices and included evidence-based services. Specifically, we examined the problem areas identified in the statement of…
ERIC Educational Resources Information Center
Peterson, Ken; And Others
The Park City School District (Utah) career ladder design provides a system in which teachers are positioned and paid according to successful performance and differentiation of responsibilities. It includes an evaluation system to differentiate among teachers. The career ladder design presents a number of innovations; for example, excellent…
NASA Human Research Program (HRP). International Space Station Medical Project (ISSMP)
NASA Technical Reports Server (NTRS)
Sams, Clarence F.
2009-01-01
This viewgraph presentation describes the various flight investigations performed on the International Space Station as part of the NASA Human Research Program (HRP). The evaluations include: 1) Stability; 2) Periodic Fitness Evaluation with Oxygen Uptake Measurement; 3) Nutrition; 4) CCISS; 5) Sleep; 6) Braslet; 7) Integrated Immune; 8) Epstein Barr; 9) Biophosphonates; 10) Integrated cardiovascular; and 11) VO2 max.
ERIC Educational Resources Information Center
Achmadi, Donna; Kagohara, Debora M.; van der Meer, Larah; O'Reilly, Mark F.; Lancioni, Giulio E.; Sutherland, Dean; Lang, Russell; Marschik, Peter B.; Green, Vanessa A.; Sigafoos, Jeff
2012-01-01
We evaluated a program for teaching two adolescents with autism spectrum disorders (ASD) to perform more advanced operations on an iPod-based speech-generating device (SGD). The effects of the teaching program were evaluated in a multiprobe multiple baseline across participants design that included two intervention phases. The first intervention…
ERIC Educational Resources Information Center
Pinheiro, Sandro O.; Rohrer, Jonathan D.; Heimann, C. F. Larry
This paper describes a mixed method evaluation study that was developed to assess faculty teaching behavior change in a faculty development fellowship program for community-based hospital faculty. Principles of adult learning were taught to faculty participants over the fellowship period. These included instruction in teaching methods, group…
ERIC Educational Resources Information Center
Chance, William
This paper provides recommendations for the development, implementation, and evaluation of a demonstration program designed to assess direct lending as a replacement for the current federal student loan program. It offers a list of principles which the demonstration project should address. Recommendations include: (1) maintenance of student…
ERIC Educational Resources Information Center
Friend, Jennifer; Militello, Matthew
2015-01-01
This article analyzes specific uses of digital video production in the field of educational leadership preparation, advancing a three-part framework that includes the use of video in (a) teaching and learning, (b) research methods, and (c) program evaluation and service to the profession. The first category within the framework examines videos…
Logic Models for Program Design, Implementation, and Evaluation: Workshop Toolkit. REL 2015-057
ERIC Educational Resources Information Center
Shakman, Karen; Rodriguez, Sheila M.
2015-01-01
The Logic Model Workshop Toolkit is designed to help practitioners learn the purpose of logic models, the different elements of a logic model, and the appropriate steps for developing and using a logic model for program evaluation. Topics covered in the sessions include an overview of logic models, the elements of a logic model, an introduction to…
ERIC Educational Resources Information Center
Irizarry, Ruddie A.; And Others
The Wingate High School Bilingual program served 280 limited English speaking Haitian students with Title VII funds. The program, which included students in grades 9 through 12, was designed to offer bilingual instruction and supportive services with the aim of mainstreaming program participants. Students received English as a Second Language…
A Meta-Analytic Review of Components Associated with Parent Training Program Effectiveness
ERIC Educational Resources Information Center
Kaminski, Jennifer Wyatt; Valle, Linda Anne; Filene, Jill H.; Boyle, Cynthia L.
2008-01-01
This component analysis used meta-analytic techniques to synthesize the results of 77 published evaluations of parent training programs (i.e., programs that included the active acquisition of parenting skills) to enhance behavior and adjustment in children aged 0-7. Characteristics of program content and delivery method were used to predict effect…
ERIC Educational Resources Information Center
Steinke, Theodore R.
This paper traces the historical development of cartography graduate programs, establishes an evolutionary model, and evaluates the model to determine if it has some utility today for the development of programs capable of producing highly skilled cartographers. Cartography is defined to include traditional cartography, computer cartography,…
Digital electronic engine control F-15 overview
NASA Technical Reports Server (NTRS)
Kock, B.
1984-01-01
A flight test evaluation of the digital elctronic engine control (DEEC) system was conducted. An overview of the flight program is presented. The roles of the participating parties, the system, and the flight program objectives are described. The test program approach is discussed, and the engine performance benefits are summarized. A description of the follow-on programs is included.
Reading Roundup: Rope a Good Book. Louisiana Summer Reading Program, 1995 Manual.
ERIC Educational Resources Information Center
White, Dorothy, J., Ed.
A manual for the Louisiana Summer Reading Program is presented in 14 sections with a western theme and illustrations. An evaluation form, a 1995 calendar, and a list of audiovisual materials with addresses and prices are also provided. Section 1 discusses promotion, publicity, and programs; and includes sample news releases; program ideas, and…
Chie, Qiu Ting; Tam, Cai Lian; Bonn, Gregory; Dang, Hoang Minh; Khairuddin, Rozainee
2016-01-01
This study examined reasons for substance abuse and evaluated the effectiveness of substance treatment programs in Malaysia through interviews with rehab patients and staff. Substance rehab patients (aged 18–69 years; n = 30) and staff (ages 30–72 years; n = 10) participated in semi-structured interviews covering a range of topics, including family and peer relationships, substance use and treatment history, factors for substance use and relapse, motivation for entering treatment, work experience, job satisfaction, treatment evaluation, and patient satisfaction. Most patients did not demonstrate the substance progression trend and had normal family relationships. Most patients reported having peers from normal family backgrounds as well. Various environmental and personal factors was cited as contributing to substance abuse and relapse. There was no significant difference between patient and staff program evaluation scores although the mean score for patients was lower. A holistic treatment approach with a combination of cognitive–behavioral, medical, social, and spiritual components was favored by patients. Suggestions for improving existing programs include better tailoring treatment to individual needs, and providing more post-treatment group support. PMID:27303313
McQueston, Kate; Silverman, Rachel; Glassman, Amanda
2013-12-01
This study reviews the scope and quality of existing literature regarding the interventions to reduce adolescent childbearing in low- and middle-income countries and compiles findings concerning their effectiveness. A total of 737 studies published between 2000 and 2011 were reviewed; 19 were identified as meeting eligibility criteria. Studies were included that: evaluated program effects on adolescents and young people, either as the primary target population or as a subset of a broader target group; evaluated an intervention intended to reduce adolescent fertility or generate improvements on a related outcome; and reported childbearing-related outcomes. Evidence indicates that a variety of interventions may be successful at reducing fertility, including school-based programs, health counseling, and cash transfers. An overview of evaluation efforts to date is provided, and potential best practices are highlighted. Conclusions are that funding for adolescent fertility initiatives should be directed toward programs for which a sound evidence base exists, such as cash transfers or other interventions that encourage school enrollment, and that programs of unknown effectiveness should be conducted in tandem with rigorous evaluation. © 2013 The Population Council, Inc.
ERIC Educational Resources Information Center
United Nations Educational, Scientific, and Cultural Organization, Santiago (Chile). Regional Office for Education in Latin America and the Caribbean.
The objectives of this seminar were to identify problems in evaluating literacy programs and to design a working strategy to confront them. Four presentations included national case studies from Brazil, Honduras, Nicaragua, and Venezuela. Central questions asked concerned who and what were evaluated and how were the results to be used. In Brazil,…