Buffering Negative Impacts of Divorce on Children: Evaluating Impact of Divorce Education

ERIC Educational Resources Information Center

Crawford, Jennifer K.; Riffe, Jane; Trevisan, Dominic A.; Adesope, Olusola O.

2014-01-01

Following the call for more stringent evaluation methodology and recently documented national Extension presence in the field of divorce education for parents and children, the study reported here describes a local multi-level evaluation to capture program impact of a stakeholder-accepted divorce education program. Using a post-then-pre…

Factors Influencing Participant Perceptions of Program Impact: Lessons from a Virtual Fieldtrip for Middle-School Students

ERIC Educational Resources Information Center

Adedokun, Omolola A.; Parker, Loran C.; Loizzo, Jamie; Burgess, Wilella D.; Robinson, J. Paul

2011-01-01

Participant perceptions of program effectiveness and impact are undoubtedly a popular focus of Extension program evaluations. However, the effects of participants' characteristics and contextual variables on program perceptions and how the resulting data can be used for program improvement are less explored in evaluation studies. Using data from…

77 FR 28623 - Comment Request for Information Collection for the Impact Evaluation of the YouthBuild Program...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-15

..., earnings, and job characteristics? What are YouthBuild's impacts on crime and delinquency? What are the... Collection for the Impact Evaluation of the YouthBuild Program; New Collection AGENCY: Employment and... instruments are clearly understood, and the impact of collection requirements on respondents can be properly...

Making Evaluation Work for You: Ideas for Deriving Multiple Benefits from Evaluation

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2016-01-01

Increased demand for accountability has forced Extension educators to evaluate their programs and document program impacts. Due to this situation, some Extension educators may view evaluation simply as the task, imposed on them by administrators, of collecting outcome and impact data for accountability. They do not perceive evaluation as a useful…

Implementing Impact Evaluations of Malaria Control Interventions: Process, Lessons Learned, and Recommendations

PubMed Central

Hershey, Christine L.; Bhattarai, Achuyt; Florey, Lia S.; McElroy, Peter D.; Nielsen, Carrie F.; Yé, Yazoume; Eckert, Erin; Franca-Koh, Ana Cláudia; Shargie, Estifanos; Komatsu, Ryuichi; Smithson, Paul; Thwing, Julie; Mihigo, Jules; Herrera, Samantha; Taylor, Cameron; Shah, Jui; Mouzin, Eric; Yoon, Steven S.; Salgado, S. René

2017-01-01

Abstract. As funding for malaria control increased considerably over the past 10 years resulting in the expanded coverage of malaria control interventions, so did the need to measure the impact of these investments on malaria morbidity and mortality. Members of the Roll Back Malaria (RBM) Partnership undertook impact evaluations of malaria control programs at a time when there was little guidance in terms of the process for conducting an impact evaluation of a national-level malaria control program. The President’s Malaria Initiative (PMI), as a member of the RBM Partnership, has provided financial and technical support for impact evaluations in 13 countries to date. On the basis of these experiences, PMI and its partners have developed a streamlined process for conducting the evaluations with a set of lessons learned and recommendations. Chief among these are: to ensure country ownership and involvement in the evaluations; to engage stakeholders throughout the process; to coordinate evaluations among interested partners to avoid duplication of efforts; to tailor the evaluation to the particular country context; to develop a standard methodology for the evaluations and a streamlined process for completion within a reasonable time; and to develop tailored dissemination products on the evaluation for a broad range of stakeholders. These key lessons learned and resulting recommendations will guide future impact evaluations of malaria control programs and other health programs. PMID:28990921

Broadening measures of success: results of a behavioral health translational research training program.

PubMed

Baldwin, Julie A; Williamson, Heather J; Eaves, Emery R; Levin, Bruce L; Burton, Donna L; Massey, Oliver T

2017-07-24

While some research training programs have considered the importance of mentoring in inspiring professionals to engage in translational research, most evaluations emphasize outcomes specific to academic productivity as primary measures of training program success. The impact of such training or mentoring programs on stakeholders and local community organizations engaged in translational research efforts has received little attention. The purpose of this evaluation is to explore outcomes other than traditional academic productivity in a translational research graduate certificate program designed to pair graduate students and behavioral health professionals in collaborative service-learning projects. Semi-structured qualitative interviews with scholars, community mentors, and academic mentors were conducted regarding a translational research program to identify programmatic impacts. Interviews were transcribed and coded by the research team to identify salient themes related to programmatic outcomes. Results are framed using the Translational Research Impact Scale which is organized into three overarching domains of potential impact: (1) research-related impacts, (2) translational impacts, and (3) societal impacts. This evaluation demonstrates the program's impact in all three domains of the TRIS evaluation framework. Graduate certificate participants (scholars) reported that gaining experience in applied behavioral health settings added useful skills and expertise to their present careers and increased their interest in pursuing translational research. Scholars also described benefits resulting from networks gained through participation in the program, including valuable ties between the university and community behavioral health organizations. This evaluation of the outcomes of a graduate certificate program providing training in translational research highlights the need for more community-oriented and practice-based measures of success. Encouraging practitioner involvement in translational research is vital to translate knowledge into practice and to enable practice-based needs to inform research and policy. A more flexible approach to measuring programmatic success in research training programs can help bridge the knowledge translation gap.

Maximizing the Impact of Program Evaluation: A Discrepancy-Based Process for Educational Program Evaluation.

ERIC Educational Resources Information Center

Cantor, Jeffrey A.

This paper describes a formative/summative process for educational program evaluation, which is appropriate for higher education programs and is based on M. Provus' Discrepancy Evaluation Model and the principles of instructional design. The Discrepancy Based Methodology for Educational Program Evaluation facilitates systematic and detailed…

Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates. NCEE 2012-4019

ERIC Educational Resources Information Center

Fortson, Kenneth; Verbitsky-Savitz, Natalya; Kopa, Emma; Gleason, Philip

2012-01-01

Randomized controlled trials (RCTs) are widely considered to be the gold standard in evaluating the impacts of a social program. When an RCT is infeasible, researchers often estimate program impacts by comparing outcomes of program participants with those of a nonexperimental comparison group, adjusting for observable differences between the two…

Meta-analytic Evaluation of a Virtual Field Trip to Connect Middle School Students with University Scientists

NASA Astrophysics Data System (ADS)

Adedokun, Omolola A.; Liu, Jia; Parker, Loran Carleton; Burgess, Wilella

2015-02-01

Although virtual field trips are becoming popular, there are few empirical studies of their impacts on student outcomes. This study reports on a meta-analytic evaluation of the impact of a virtual field trip on student perceptions of scientists. Specifically, the study examined the summary effect of zipTrips broadcasts on evaluation participants' perceptions of scientists, as well as the moderating effect of program type on program impact. The results showed statistically significant effect of each broadcast, as well as statistically significant summary (combined) effect of zipTrips on evaluation participants' perceptions of scientists. Results of the moderation analysis showed that the effect was greater for the students that participated in the evaluation of the 8th grade broadcasts, providing additional insight into the role of program variation in predicting differential program impact. This study illustrates how meta-analysis, a methodology that should be of interest to STEM education researchers and evaluation practitioners, can be used to summarize the effects of multiple offerings of the same program. Other implications for STEM educators are discussed.

Increasing the use of evaluation data collection in an EPO program

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.

Wilderness educators' evaluation of the Impact Monster Program

Treesearch

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

The Impact of Evaluation: Lessons Drawn from the Evaluations of Five Early Childhood Education Programs.

ERIC Educational Resources Information Center

Granville, Arthur C.; And Others

Five different program evaluations were described to indicate those qualities which make an evaluation effective or not effective. Evaluation effectiveness was defined as impact on decision making or long-term policy formation, and influence upon a variety of audiences. Robert D. Matz described the First Chance Project, and concluded that the…

Multiple Year Extension Program Outcomes & Impacts through Evaluation

ERIC Educational Resources Information Center

Hachfeld, Gary A.; Bau, David B.; Holcomb, C. Robert; Craig, J. William

2013-01-01

Dwindling public funding as well as greater competition for grant dollars create a challenge for Extension. For Extension to remain a financially viable organization, educators have to be able to produce substantive, measurable program outcomes and impacts. Evaluative data can inform program development and delivery, and helps administrators…

Charting the Impact of Federal Spending for Education Research: A Bibliometric Approach

ERIC Educational Resources Information Center

Milesi, Carolina; Brown, Kevin L.; Hawkley, Louise; Dropkin, Eric; Schneider, Barbara L.

2014-01-01

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

Footprints: Strategies for Non-Traditional Program Evaluation.

ERIC Educational Resources Information Center

Frechtling, Joy A., Ed.

Papers in this collection explore alternative and nontraditional approaches to evaluation. They provide options, speculations, and propositions that affect each thinker's ideas on how to trace the impact of National Science Foundation-supported programs. Organized around a central theme of footprints as evidence of a program's impact, the papers…

Socioeconomic impact assessment in ex ante evaluations: a case study on the rural development programs of the European Union.

PubMed

Vidueira, Pablo; Díaz-Puente, José M; Rivera, María

2014-08-01

Ex ante impact assessment has become a fundamental tool for effective program management, and thus, a compulsory task when establishing a new program in the European Union (EU). This article aims to analyze benefits from ex ante impact assessment, methodologies followed, and difficulties encountered. This is done through the case study on the rural development programs (RDPs) in the EU. Results regarding methodologies are then contrasted with the international context in order to provide solid insights to evaluators and program managing authorities facing ex ante impact assessment. All European RDPs from the period 2007 through 2013 (a total of 88) and their corresponding available ex ante evaluations (a total of 70) were analyzed focusing on the socioeconomic impact assessment. Only 46.6% of the regions provide quantified impact estimations on socioeconomic impacts in spite of it being a compulsory task demanded by the European Commission (EC). Recommended methods by the EC are mostly used, but there is a lack of mixed method approaches since qualitative methods are used in substitution of quantitative ones. Two main difficulties argued were the complexity of program impacts and the lack of needed program information. Qualitative approaches on their own have been found as not suitable for ex ante impact assessment, while quantitative approaches-such as microsimulation models-provide a good approximation to actual impacts. However, time and budgetary constraints make that quantitative and mixed methods should be mainly applied on the most relevant impacts for the program success. © The Author(s) 2014.

Food fortification: issues on quality assurance and impact evaluation in developing countries.

PubMed

Florentino, R

2003-01-01

Quality assurance and impact evaluation are essential components of a food fortification program and should be integrated in the fortification process. Quality assurance will ensure that the micronutrient meant to be delivered is indeed reaching the target population at the correct level. Impact evaluation will determine the effectiveness of food fortification as a strategy in controlling micronutrient deficiency and enable program planners to make decisions on the future of the program. In developing countries, both quality assurance and impact evaluation are often constrained not only by inadequacy of facilities as well as financial and manpower resources, but by unclear definition of objectives and inappropriate design. It is therefore necessary to consider the target audience for the quality assurance monitoring and impact evaluation in order to clearly define their objectives and in turn suit the design to these objectives, at the same time as the limitations in financial and manpower resources are considered.

Assessment of Program Impact Through First Grade, Volume II: Impact on Institutions. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Rosario, Jose; And Others

As part of a longitudinal study evaluating program effects, this report, the second in a series of six, describes the impact of Project Developmental Continuity (PDC) on the institutional policies and procedures of participating Head Start centers and elementary schools up to the time the evaluation study's cohort of children had completed grade…

Evaluation of the Initial Impacts of the National Science Foundation's Integrative Graduate Education and Research Traineeship Program: Final Report

ERIC Educational Resources Information Center

Carney, Jennifer; Chawla, Deepika; Wiley, Autumn; Young, Denise

2006-01-01

This report summarizes findings from an evaluation of the impacts of the National Science Foundation's (NSF) Integrative Graduate Education and Research Traineeships (IGERT) program. Through support of interdisciplinary graduate education programs in Science, Technology, Engineering, and Mathematics, the IGERT program aims to educate U.S.…

Factor Analysis of the HEW National Strategy for Youth Development Model's Community Program Impact Scales.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW (Health, Education, and Welfare) National Strategy for Youth Development Model proposed a community-based program to promote positive youth development and to prevent delinquency through a sequence of youth needs assessments, needs-targeted programs, and program impact evaluation. HEW Community Program Impact Scales data obtained…

Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-12-31

The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

The Role of Extension Nutrition Education in Student Achievement of Nutrition Standards in Grades K-3: A Descriptive Evaluation of a School-Based Program

ERIC Educational Resources Information Center

Arnold, Mary E.; Schreiber, Debera

2012-01-01

This article reports the results of a descriptive evaluation of the impact of an in-school Extension nutrition education program in a small, very rural county. The evaluation focused on understanding the nature of the role the Extension educator plays in delivering nutrition education, the impact of the program on student learning and achievement…

Driving social impact with common global indicators for healthy lifestyle programs: lessons learned.

PubMed

Robinson, Nicole R; Gin, Julia; Kamath-Jha, Shilpa; Infantes, Michel; Hernandez, Ricardo; Alberg-Seberich, Michael; Suri, Devika; Pérez-Escamilla, Rafael

2014-09-01

Partnerships between corporate entities and non-governmental organizations (NGOs) involved in delivering community focused health and well-being programs are becoming increasingly valuable especially in the context of promoting healthy lifestyles around the globe. The Mondelēz International Foundation (MIF) has funded healthy lifestyles community based programs targeting children and youth through partnership with seven global NGOs. To assess collective impact of these programs, it is crucial to identify best practices and common impact indicators that can be measured across programs. MIF therefore organized the Healthy Lifestyles Evaluation Workshop to explore these pertinent questions. Share best practices and identify common impact indicators to measure the success of current and future MIF funded healthy lifestyles programs. Analysis of the Program Impact Pathways (PIPs) and measured output of each of the seven programs. Individual and combined analysis of PIPs of the seven NGO programs led to identification of three critical impact indicators: nutrition knowledge, physical activity, and healthier eating, and also enabled NGOs to identify pathways to improve program delivery among the target population. This workshop enabled MIF and partner NGOs to came together to align on metrics and future engagement approaches for promoting and evaluating community based healthy lifestyles programs.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

ERIC Educational Resources Information Center

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Program of policy studies in science and technology

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1973-01-01

The application of an interdisciplinary, problem-oriented capability to the performance of total social impact evaluations is discussed. The consequences of introducing new configurations, technological or otherwise into future social environments are presented. The primary characteristics of the program are summarized: (1) emphasis on interdisciplinary, problem-oriented analysis; (2) development of intra- and inter-institutional arrangements for the purpose of analyzing social problems, evaluating existing programs, and assessing the social impacts of prospective policies, programs, and other public actions; (3) focus on methodological approaches to the projection of alternative future social environments, the identification of the effects of the introduction of new policies, programs, or other actions into the social system, and the evaluation of the social impacts of such effects; (4) availability of analytical resources for advisory and research tasks, and provision for use of program facilities as a neutral forum for the discussion of public issues involving involving the impact of advancing technology on social value-institutional processes.

Evaluating the Impact of Cooperative Extension Outreach via Twitter

ERIC Educational Resources Information Center

O'Neill, Barbara

2014-01-01

Twitter is increasingly being used by Extension educators as a teaching and program-marketing tool. It is not enough, however, to simply use Twitter to disseminate information. Steps must be taken to evaluate program impact with quantitative and qualitative data. This article described the following Twitter evaluation metrics: unique hashtags,…

Developing a Stakeholder-Driven Anticipated Timeline of Impact for Evaluation of Social Programs

ERIC Educational Resources Information Center

Sridharan, Sanjeev; Campbell, Bernadette; Zinzow, Heidi

2006-01-01

The authors present a stakeholder-driven method, the earliest anticipated timeline of impact, which is designed to assess stakeholder expectations for the earliest time frame in which social programs are likely to affect outcomes. The utility of the anticipated timeline of impact is illustrated using an example from an evaluation of a…

Using Maps in Web Analytics to Evaluate the Impact of Web-Based Extension Programs

ERIC Educational Resources Information Center

Veregin, Howard

2015-01-01

Maps can be a valuable addition to the Web analytics toolbox for Extension programs that use the Web to disseminate information. Extension professionals use Web analytics tools to evaluate program impacts. Maps add a unique perspective through visualization and analysis of geographic patterns and their relationships to other variables. Maps can…

A Multi-Phased Evaluation of the Impact of a Non-School Science Exhibition.

ERIC Educational Resources Information Center

Fortner, Rosanne W.

The impact of "The Great Lake Erie," an outreach program that aimed to improve visitor knowledge and attitudes about Lake Erie, is discussed in this evaluative study. "The Great Lake Erie" was presented as a two-part program consisting of a lecture and demonstration stage presentation and a series of exhibits. The program was…

Housing First and Photovoice: Transforming Lives, Communities, and Systems

PubMed Central

Barile, John P.; Ogawa, Terry Yasuko; Peralta, Nelson; Bugg, Reumell; Lau, John; Lamberton, Thomas; Hall, Corazon; Mori, Victor

2018-01-01

This article presents findings from a community-based participatory evaluation of a Housing First program on the Island of O’ahu. In this study, clients in a Housing First program used Photovoice to evaluate the program and to advocate for progressive housing policies. Written together by members of the Housing First Photovoice group, this collaborative article describes the outcomes from both the Housing First program and the Photovoice project and demonstrates the ways in which participatory program evaluations can interact with client-driven programs like Housing First to produce a cumulative, transformative impact. Findings suggest that community psychologists hoping to re-engage with community mental health systems through enacting transformative change should consider taking a community-based participatory approach to program evaluation because increased client voice in community mental health programs and their evaluations can have far-reaching, transformative impacts for research, practice, and policy. PMID:29323410

Utilization-focused evaluation of a STEM enrichment program

NASA Astrophysics Data System (ADS)

Carter, Sally

The purpose of this study was to determine the impact and utilization of a STEM enrichment program (hereafter referred to as The Program). The Program consisted of two parts. First an educator resource center provided free educational materials throughout The Program’s home state. The second part of The Program was a network of education specialists who provided professional development for teachers, modeled lessons with students, and provided presentations for the general public. The problem addressed by this study was a lack of knowledge regarding the impact of The Program. The Program’s director requested a utilization-focused program evaluation to answer thirteen questions. Questions covered Program impact for five areas: overall impact on teachers, overall impact on students, overall impact of materials, overall impact of Program personnel, and overall impact on STEM education. A mixed-methods case study was designed to gather data. Quantitative data included Program archival data regarding the number of contacts and a survey distributed to teachers who had used The Program’s services on at least one occasion. Qualitative data included written comments gathered from the teacher surveys, seven teacher focus groups, and four Program personnel interviews. Data found an overall positive Program impact in all five areas. Both quantitative and qualitative data showed favorable perceptions by teachers and Program personnel. It is not known if data from this case study can be generalized to other STEM enrichment programs. Future research might include a study to determine if The Program’s model could be used to generate new STEM enrichment programs.

Evaluation of the impact of the drug evaluation and classification program on enforcement and adjudication

DOT National Transportation Integrated Search

1992-12-01

This study examined the effect of the Drug Evaluation and Classification (DEC) Program on impaired driving (DWI) enforcement and adjudication. Drug Recognition Experts (DREs) in DEC programs evaluate suspects when drugs other than alcohol are suspect...

Evaluation of Federal Social Programs: An Uncertain Impact. Occasional Paper 1992-2.

ERIC Educational Resources Information Center

Levitan, Sar A.

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

Can We Have It All? A Review of the Impacts of School Choice on Racial Integration

ERIC Educational Resources Information Center

Swanson, Elise

2017-01-01

This article reviews the literature evaluating the impact of school choice programs on racial integration. Evidence on the impacts of magnet schools, voluntary busing programs, open enrollment practices, charter schools, and voucher programs is reviewed. The literature is mixed on this question, finding that the impacts of choice on racial…

Evaluating the Impact of the "Teaching as a Chemistry Laboratory Graduate Teaching Assistant" Program on Cognitive and Psychomotor Verbal Interactions in the Laboratory

ERIC Educational Resources Information Center

Flaherty, A.; O'Dwyer, A.; Mannix-McNamara, P.; Leahy, J. J.

2017-01-01

Designing and evaluating teacher development programs for graduate teaching assistants (GTAs) who teach in the laboratory is a prominent feature of chemistry education research. However, few studies have investigated the impact of a GTA teacher development program on the verbal interactions between participating GTAs and students in the…

Evaluation of the DC Opportunity Scholarship Program: Impacts after One Year. NCEE 2017-4022

ERIC Educational Resources Information Center

Dynarski, Mark; Rui, Ning; Webber, Ann; Gutmann, Babette

2017-01-01

The District of Columbia Opportunity Scholarship Program (OSP) was created by Congress to provide tuition vouchers to low-income parents who want their child to attend a private school. The Scholarships for Opportunity and Results (SOAR) Act of 2011 also mandated an evaluation of the OSP program. This report examines impacts one year after…

Economic Evaluation of Community-Based HIV Prevention Programs in Ontario: Evidence of Effectiveness in Reducing HIV Infections and Health Care Costs.

PubMed

Choi, Stephanie K Y; Holtgrave, David R; Bacon, Jean; Kennedy, Rick; Lush, Joanne; McGee, Frank; Tomlinson, George A; Rourke, Sean B

2016-06-01

Investments in community-based HIV prevention programs in Ontario over the past two and a half decades are assumed to have had an impact on the HIV epidemic, but they have never been systematically evaluated. To help close this knowledge gap, we conducted a macro-level evaluation of investment in Ontario HIV prevention programs from the payer perspective. Our results showed that, from 1987 to 2011, province-wide community-based programs helped to avert a total of 16,672 HIV infections, saving Ontario's health care system approximately $6.5 billion Canadian dollars (range 4.8-7.5B). We also showed that these community-based HIV programs were cost-saving: from 2005 to 2011, every dollar invested in these programs saved about $5. This study is an important first step in understanding the impact of investing in community-based HIV prevention programs in Ontario and recognizing the impact that these programs have had in reducing HIV infections and health care costs.

Moving the Needle on Program Quality: An Examination of the Organizational Characteristics That Drive Improvement in Expanded Learning Programs

ERIC Educational Resources Information Center

McCormick, Silvana

2017-01-01

Program evaluation can play a critical role in supporting high quality implementation of social programs to help them achieve their goal of social impact. Evaluation scholars have developed a wide range of strategies to help build programs' internal evaluation capacity in an effort to support meaningful use of evaluation. However, the evaluation…

Better Crunching: Recommendations for Multivariate Data Analysis Approaches for Program Impact Evaluations

ERIC Educational Resources Information Center

Braverman, Marc T.

2016-01-01

Extension program evaluations often present opportunities to analyze data in multiple ways. This article suggests that program evaluations can involve more sophisticated data analysis approaches than are often used. On the basis of a hypothetical program scenario and corresponding data set, two approaches to testing for evidence of program impact…

Testing of a Program Evaluation Model: Final Report.

ERIC Educational Resources Information Center

Nagler, Phyllis J.; Marson, Arthur A.

A program evaluation model developed by Moraine Park Technical Institute (MPTI) is described in this report. Following background material, the four main evaluation criteria employed in the model are identified as program quality, program relevance to community needs, program impact on MPTI, and the transition and growth of MPTI graduates in the…

Statewide commuter assistance program evaluation report database survey : final report : results of survey and conclusions

DOT National Transportation Integrated Search

2001-12-01

The purpose of this research project was to provide a systematic evaluation of the performance of Florida's commuter assistance programs from two perspectives: Impact on the commuting patterns and awareness of the general public; and Impact on the co...

12 CFR 1808.619 - Reporting requirements.

Code of Federal Regulations, 2014 CFR

2014-01-01

... requirements of this part and the Bond Documents; (3) Evaluate the impact of the CDFI Bond Guarantee Program... (5) Accomplish such other purposes that the CDFI Fund may deem appropriate. (b) Customer profiles...) are adequately served and to evaluate the impact of the CDFI Bond Guarantee Program. (c) Audits...

Evaluation of innovative state and community alcohol projects : breath alcohol testing program effectiveness, impact and transferability

DOT National Transportation Integrated Search

1987-03-01

Breath Alcohol Testing (BAT) programs in Albuquerque and Santa Fe, New Mexico are evaluated in regard to effectiveness, impact, and transferability of the special DWI enforcement squads and their use of BAT Mobiles. Squad activity effectiveness is me...

Evaluating WIC.

ERIC Educational Resources Information Center

Germanis, Peter; Besharov, Douglas J.

2000-01-01

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

An evaluation of the impact of the Virginia driver improvement program on negligent driving : 24-month report [final report].

DOT National Transportation Integrated Search

1982-01-01

This study evaluated the impact of the four basic treatment combinations of the rehabilitation component of the Virginia driver improvement program. This was accomplished through a comparison of the driving records of experimental group subjects who ...

Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

ERIC Educational Resources Information Center

Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

2012-01-01

This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…

Assessment of Program Impact Through First Grade, Volume III: Impact on Parents. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Morris, Mary; And Others

Third in a series of six, this volume reports findings concerning the impact of Project Developmental Continuity (PDC) on the parents of the evaluation study's cohort of children as well as preliminary findings on the relationship between family characteristics and program outcome variables up to the time the children had completed grade 1. Begun…

Predicting Vandalism in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age, and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development model was a community-based planning and procedural tool to enhance and to prevent delinquency through a process of youth needs assessments, needs targeted programs, and program impact evaluation. The program's 12 Impact Scales have been found to have acceptable reliabilities, substantial…

Evaluation of a Workplace Basic Skills Program: An Impact Study of AVC Edmonton's 1990 Job Effectiveness Training Program at Stelco Steel. Report Summary.

ERIC Educational Resources Information Center

Barker, Kathryn Chang

The pilot Job Effectiveness Training (JET) workplace basic skills program, developed by Canada's Alberta Vocational College (AVC), Edmonton, for Stelco Steel during 1989-90, was evaluated in terms of impacts or changes from the perspective of the four major stakeholder groups: the students (12 Stelco employees); the employers (Stelco management);…

What Do We Know about School-Based Management?

ERIC Educational Resources Information Center

Patrinos, Harry Anthony; Fasih, Tazeen; Barrera, Felipe; Garcia-Moreno, Vicente A.; Bentaouet-Kattan, Raja; Baksh, Shaista; Wickramasekera, Inosha

2007-01-01

Impact evaluations of school-based management (SBM) programs, or any other kind of program, are important because they can demonstrate whether or not the program has accomplished its objectives. Furthermore, these evaluations can identify ways to improve the design of the program. These evaluations can also make successful interventions…

Assessment of Learning and Program Evaluation in Health Professions Education Programs

ERIC Educational Resources Information Center

Moore, Donald E., Jr.

2018-01-01

This chapter proposes approaches for assessing learners and evaluating courses and curriculum that could be used by directors of health professions education (HPE) programs to determine the effectiveness and impact of their programs.

Mondelēz Hope Kitchen Program, China: a Program Impact Pathways (PIP) analysis.

PubMed

Li, Yanran; Yao, Xiaoxun; Gu, Lan

2014-09-01

Mondelēz Hope Kitchen is a community program initiated jointly in 2009 by Mondelēz International and the China Youth Development Foundation (CYDF). In response to the urgent needs of students, parents, and teachers at primary and middle schools in poverty-stricken rural areas of China, the program addresses the complex and intertwined issues of undernutrition and obesity. By funding both kitchen equipment and teacher training in health and nutrition, the Mondelēz Hope Kitchen Program improves the capacity of schools to supply healthy meals, helping students to access safe and nutritious foods and, ultimately, to improve their nutritional status and health. In 2011, the Mondelēz International Foundation awarded CYDF a grant to formally assess the impact of the original program design. The Mondelēz International Foundation encouraged CYDF and six other healthy lifestyles-focused community partners around the world to participate in this program evaluation workshop. The goals of this study were to describe the logic model of the Mondelēz Hope Kitchen Program, summarize a recent evaluation of the Mondelēz Hope Kitchen Program, and conduct a Program Impact Pathways (PIP) analysis to identify Critical Quality Control Points (CCPs) and a suite of impact indicators. The findings were presented at the Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. The authors developed the program's PIP diagram based on deliberations involving the program managers and Director and consulting the "Hope Kitchen Management Rules "and "Hope Kitchen Inspection and Acceptance Report". The PIP analyses identified three CCPs: buy-in from schools, kitchen infrastructure, and changes in teachers' knowledge of nutrition after training. In addition, changes in children's knowledge of nutrition will be added to the core suite of impact evaluation indicators that also includes children's dietary behaviors. Participation in this program evaluation workshop provided the Mondelēz Hope Kitchen team with the tools to improve the program using a sound monitoring system.

The Impact of a Campus-Based 4-H Summer Conference Program on Youth Thriving

ERIC Educational Resources Information Center

Arnold, Mary E.; Davis, Jamie M.; Lundeberg, Roberta

2017-01-01

In 2014 the Oregon 4-H program adopted a new program model to describe and evaluate the impact of 4-H on youths. The model is based on promoting thriving in young people, with an emphasis on high program quality. This article discusses the impact on thriving in 378 youth participants of the 4-H Summer Conference (4-HSC) program. The results of the…

The Economic, Energy, and Environmental Impacts of the Energy-Related Inventions Program

DOE R&D Accomplishments Database

Brown, M.A.; Wilson, C.R.; Franchuk, C.A.; Cohn, S.M.; Jones, D.

1994-07-01

This report provides information on the economic, energy, and environmental impacts of inventions supported by the Energy-Related Inventions Program (ERIP) -- a program jointly operated by the US Department of Energy and the National Institute of Standards and Technology (NIST). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. The period of interest is 1980 through 1992. The evaluation is based on data collected in 1993 through mail and telephone surveys of 253 program participants, and historical data collected during previous evaluations for an additional 189 participants.

National Weatherization Assistance Program Impact Evaluation: Energy Impacts for Large Multifamily Buildings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Blasnik, Michael; Dalhoff, Greg; Carroll, David

This report estimates energy savings, energy cost savings, and cost effectiveness attributable to weatherizing large multifamily buildings under the auspices of the Department of Energy's Weatherization Assistance Program during Program Year 2008.

National Weatherization Assistance Program Impact Evaluation: Energy Impacts for Small Multifamily Buildings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Blasnik, Michael; Dalhoff, Greg; Carroll, David

2014-09-01

This report estimates energy savings, energy cost savings, and cost effectiveness attributable to weatherizing small multifamily buildings under the auspices of the Department of Energy's Weatherization Assistance Program during Program Year 2008.

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

The Total Impact of Manpower Programs: A Four-City Case Study. Volume II--Final Report.

ERIC Educational Resources Information Center

Olympus Research Corp., Washington, DC.

Based on followup interviews with 1700 participants, this study is an evaluation of Federal manpower programs in Boston, Denver, and San Francisco-Oakland. Included are Manpower Development and Training Act Programs, Work Incentive Programs, and Concentrated Employment Program from late 1969 to early 1970. Program impact on enrollees, employers,…

Experiments in evaluation capacity building: Enhancing brain disorders research impact in Ontario.

PubMed

Nylen, Kirk; Sridharan, Sanjeev

2017-05-08

This paper is the introductory paper on a forum on evaluation capacity building for enhancing impacts of research on brain disorders. It describes challenges and opportunities of building evaluation capacity among community-based organizations in Ontario involved in enhancing brain health and supporting people living with a brain disorder. Using an example of a capacity building program called the "Evaluation Support Program", which is run by the Ontario Brain Institute, this forum discusses multiple themes including evaluation capacity building, evaluation culture and evaluation methodologies appropriate for evaluating complex community interventions. The goal of the Evaluation Support Program is to help community-based organizations build the capacity to demonstrate the value that they offer in order to improve, sustain, and spread their programs and activities. One of the features of this forum is that perspectives on the Evaluation Support Program are provided by multiple stakeholders, including the community-based organizations, evaluation team members involved in capacity building, thought leaders in the fields of evaluation capacity building and evaluation culture, and the funders. Copyright © 2017. Published by Elsevier Ltd.

A Change Impact Analysis to Characterize Evolving Program Behaviors

NASA Technical Reports Server (NTRS)

Rungta, Neha Shyam; Person, Suzette; Branchaud, Joshua

2012-01-01

Change impact analysis techniques estimate the potential effects of changes made to software. Directed Incremental Symbolic Execution (DiSE) is an intraprocedural technique for characterizing the impact of software changes on program behaviors. DiSE first estimates the impact of the changes on the source code using program slicing techniques, and then uses the impact sets to guide symbolic execution to generate path conditions that characterize impacted program behaviors. DiSE, however, cannot reason about the flow of impact between methods and will fail to generate path conditions for certain impacted program behaviors. In this work, we present iDiSE, an extension to DiSE that performs an interprocedural analysis. iDiSE combines static and dynamic calling context information to efficiently generate impacted program behaviors across calling contexts. Information about impacted program behaviors is useful for testing, verification, and debugging of evolving programs. We present a case-study of our implementation of the iDiSE algorithm to demonstrate its efficiency at computing impacted program behaviors. Traditional notions of coverage are insufficient for characterizing the testing efforts used to validate evolving program behaviors because they do not take into account the impact of changes to the code. In this work we present novel definitions of impacted coverage metrics that are useful for evaluating the testing effort required to test evolving programs. We then describe how the notions of impacted coverage can be used to configure techniques such as DiSE and iDiSE in order to support regression testing related tasks. We also discuss how DiSE and iDiSE can be configured for debugging finding the root cause of errors introduced by changes made to the code. In our empirical evaluation we demonstrate that the configurations of DiSE and iDiSE can be used to support various software maintenance tasks

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

NASA Technical Reports Server (NTRS)

Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

Formative Evaluation of the Canada Student Loans Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2004

2004-01-01

The "Formative Evaluation of the Canada Student Loans Program" was undertaken to assess issues of program relevance, design and delivery and for the purposes of examining the early impacts of changes made to the program since 1998. The evaluation also reviewed the Performance Measurement Strategy contained in the July 2002 Results-Based…

Comparing Propensity Score Methods in Balancing Covariates and Recovering Impact in Small Sample Educational Program Evaluations

ERIC Educational Resources Information Center

Stone, Clement A.; Tang, Yun

2013-01-01

Propensity score applications are often used to evaluate educational program impact. However, various options are available to estimate both propensity scores and construct comparison groups. This study used a student achievement dataset with commonly available covariates to compare different propensity scoring estimation methods (logistic…

Transitional Services for Youth with Developmental Disabilities: Living in College Dorms

ERIC Educational Resources Information Center

Kirkendall, Abbie; Doueck, Howard J.; Saladino, Albert

2009-01-01

This study evaluates the impact of a college-based dormitory program on transitioning youth with intellectual disabilities. A qualitative study, with interviews at pre and post, was conducted to evaluate the program's impact. Data were collected with semistructured interviews from young adults with intellectual disabilities who participated in a…

An evaluation of the impact of the Virginia driver improvement program on negligent driving : 12-month report [interim report].

DOT National Transportation Integrated Search

1982-01-01

This study sought to evaluate the impact of the four basic treatment combinations of the rehabilitation component of the Virginia driver improvement program. It was found that receipt of a warning letter from the Division of Motor Vehicles had no eff...

Uncertain Times 2012: Afterschool Programs Still Struggling in Today's Economy

ERIC Educational Resources Information Center

Afterschool Alliance, 2012

2012-01-01

"Uncertain Times 2012," conducted by the Afterschool Alliance between April 25 and June 8, 2012, assesses the impact of economic conditions on afterschool programs. While many studies have evaluated the impact of programs, "Uncertain Times" is the only research to examine the fiscal health of afterschool programs and their…

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Treatment effects model for assessing disease management: measuring outcomes and strengthening program management.

PubMed

Wendel, Jeanne; Dumitras, Diana

2005-06-01

This paper describes an analytical methodology for obtaining statistically unbiased outcomes estimates for programs in which participation decisions may be correlated with variables that impact outcomes. This methodology is particularly useful for intraorganizational program evaluations conducted for business purposes. In this situation, data is likely to be available for a population of managed care members who are eligible to participate in a disease management (DM) program, with some electing to participate while others eschew the opportunity. The most pragmatic analytical strategy for in-house evaluation of such programs is likely to be the pre-intervention/post-intervention design in which the control group consists of people who were invited to participate in the DM program, but declined the invitation. Regression estimates of program impacts may be statistically biased if factors that impact participation decisions are correlated with outcomes measures. This paper describes an econometric procedure, the Treatment Effects model, developed to produce statistically unbiased estimates of program impacts in this type of situation. Two equations are estimated to (a) estimate the impacts of patient characteristics on decisions to participate in the program, and then (b) use this information to produce a statistically unbiased estimate of the impact of program participation on outcomes. This methodology is well-established in economics and econometrics, but has not been widely applied in the DM outcomes measurement literature; hence, this paper focuses on one illustrative application.

Evaluation Project of a Postvention Program.

ERIC Educational Resources Information Center

Simon, Robert; And Others

A student suicide or parasuicide increases the risk that potentially suicidal teenagers see suicide as an enviable option. The "copycat effect" can be reduced by a postvention program. This proposed evaluative research project will provide an implementation and impact evaluation of a school's postvention program following a suicide or…

Strategies for Evaluating Complex Environmental Education Programs

NASA Astrophysics Data System (ADS)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Project Access V: An Investigation of the Impact of P.L. 89-313 Funds on Early Intervention Programs: Summative Evaluation Reports 1984 and 1985.

ERIC Educational Resources Information Center

Kochanek, Thomas T.

The reports document achievements of early intervention programs (EIPs) for handicapped infants and young children in Massachusetts. The first report focuses on Project Access V and on evaluation of four major evaluation outcomes: (1) statutory compliance and generic impact of P.L. 89-313 expenditures; (2) overall P.L. 89-313 grant management and…

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

ERIC Educational Resources Information Center

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Using a Crystal Ball Instead of a Rear-View Mirror: Helping State Legislators Assess the Future Impacts of Major Federal Legislation

ERIC Educational Resources Information Center

Alter, Joel; Patterson, John

2006-01-01

Typically, program evaluation agencies in the legislative branch of state government examine programs that have already been implemented. These evaluations often consider whether a program achieved the legislature's original goals or complied with statutory requirements. Program evaluations frequently determine whether executive branch agencies…

National Weatherization Assistance Program Impact Evaluation: Impact of Exhaust-Only Ventilation on Radon and Indoor Humidity - A Field Investigation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pigg, Scott

2014-09-01

The study described here sought to assess the impact of exhaust-only ventilation on indoor radon and humidity in single-family homes that had been treated by the Weatherization Assistance Program (WAP).

A quantitative approach to assessing the efficacy of occupant protection programs: A case study from Montana.

PubMed

Manlove, Kezia; Stanley, Laura; Peck, Alyssa

2015-10-01

Quantitative evaluation of vehicle occupant protection programs is critical for ensuring efficient government resource allocation, but few methods exist for conducting evaluation across multiple programs simultaneously. Here we present an analysis of occupant protection efficacy in the state of Montana. This approach relies on seat belt compliance rates as measured by the National Occupant Protection Usage Survey (NOPUS). A hierarchical logistic regression model is used to estimate the impacts of four Montana Department of Transportation (MDT)-funded occupant protection programs used in the state of Montana, following adjustment for a suite of potential confounders. Activity from two programs, Buckle Up coalitions and media campaigns, are associated with increased seat belt use in Montana, whereas the impact of another program, Selective Traffic Enforcement, is potentially masked by other program activity. A final program, Driver's Education, is not associated with any shift in seat belt use. This method allows for a preliminary quantitative estimation of program impacts without requiring states to obtain any new seat belt use data. This approach provides states a preliminary look at program impacts, and a means for carefully planning future program allocation and investigation. Copyright © 2015 Elsevier Ltd. All rights reserved.

Barriers to Evaluation

ERIC Educational Resources Information Center

Charley, Lois

2007-01-01

According to the Department of Health and Human Services, "good program evaluations assess programs performance, measure impacts on families and communities, and document program successes." With this information, programs are able to direct limited resources to where they are most needed and most effective in their communities. This article is…

78 FR 41924 - Privacy Act of 1974; System of Records-Impact Evaluation of Math Professional Development

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-12

... DEPARTMENT OF EDUCATION Privacy Act of 1974; System of Records--Impact Evaluation of Math... ``Impact Evaluation of Math Professional Development'' (18-13-35). The National Center for Education...-focused math professional development (PD) program on teacher knowledge, teacher practices, and student...

Impact Evaluations of Corporate E-Learning.

ERIC Educational Resources Information Center

Ring, Geoff; Reeves, Thomas C.

This paper describes key issues in conducting impact evaluations of corporate eLearning and reports the results of a study that evaluated the impact (including return on investment) of an eLearning implementation by a large telecommunications company. The program was designed to "multi-skill" over 1,000 Customer Service Officers (CSOs)…

Evaluating the Impact of a Connecticut Program to Reduce Availability of Unhealthy Competitive Food in Schools

ERIC Educational Resources Information Center

Long, Michael W.; Henderson, Kathryn E.; Schwartz, Marlene B.

2010-01-01

Background: This article seeks to inform state and local school food policies by evaluating the impact of Connecticut's Healthy Food Certification (HFC), a program which provides monetary incentives to school districts that choose to implement state nutrition standards for all foods sold to students outside reimbursable school meals. Methods: Food…

Impact of the Federal School-Based Student Mentoring Program. NCEE Evaluation Brief. NCEE 2009-4074

ERIC Educational Resources Information Center

National Center for Education Evaluation and Regional Assistance, 2009

2009-01-01

The Office of Management and Budget requested that the Institute of Education Sciences (IES) oversee an independent impact evaluation of the federal Student Mentoring Program, and in 2005 IES contracted with Abt Associates and its team of subcontractors (Branch Associates, Moore and Associates, and the Center for Resource Management) to conduct…

Measuring the Impacts of a Volunteer-Based Community Development Program in Developing Volunteers' Leadership Skills

ERIC Educational Resources Information Center

Meier, Amy; Singletary, Loretta; Hill, George

2012-01-01

This article summarizes the results of an evaluation of the impacts of a community development program to develop leadership skills in its adult volunteers. The evaluation featured 20 questions about leadership skills learned as a result of volunteer experiences. Data analysis strategies beyond a simple means ranking resulted in evidence…

Evaluation of programs to improve complementary feeding in infants and young children.

PubMed

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Evaluating the Impact of HRD.

ERIC Educational Resources Information Center

1998

This document contains four papers from a symposium on evaluating the impact of human resource development (HRD). "The Politics of Program Evaluation and the Misuse of Evaluation Findings" (Hallie Preskill, Robin Lackey) discusses the status of evaluation theory, evaluation as a political activity, and the findings from a survey on the…

Development and evaluation of addiction treatment programs in Latin America.

PubMed

Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E

2018-07-01

The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.

Thinking Inside the Box: The Health Cube Paradigm for Health and Wellness Program Evaluation and Design

PubMed Central

Harris, Sharon

2013-01-01

Abstract Appropriately constructed health promotions can improve population health. The authors developed a practical model for designing, evaluating, and improving initiatives to provide optimal value. Three independent model dimensions (impact, engagement, and sustainability) and the resultant three-dimensional paradigm were described using hypothetical case studies, including a walking challenge, a health risk assessment survey, and an individual condition management program. The 3-dimensional model is illustrated and the dimensions are defined. Calculation of a 3-dimensional score for program comparisons, refinements, and measurement is explained. Program 1, the walking challenge, had high engagement and impact, but limited sustainability. Program 2, the health risk assessment survey, had high engagement and sustainability but limited impact. Program 3, the on-site condition management program, had measurable impact and sustainability but limited engagement, because of a lack of program capacity. Each initiative, though successful in 2 dimensions, lacked sufficient evolution along the third axis for optimal value. Calculation of a 3-dimensional score is useful for health promotion program development comparison and refinements, and overall measurement of program success. (Population Health Management 2013;16:291–295) PMID:23869538

Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

PubMed Central

2013-01-01

Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

A Case Study of the Impact of a Sytematic Evaluation Process in a Graduate Medical Education Residency Program

ERIC Educational Resources Information Center

Kromrei, Heidi T.

2014-01-01

The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if…

New Teacher Induction: A Program Evaluation

ERIC Educational Resources Information Center

Hunter, J. Warren

2016-01-01

The purpose of this qualitative program evaluation was to examine the impact a two-year new teacher induction program had on teachers' feelings of support, satisfaction, and self-efficacy. The program purports that higher feelings of support, satisfaction, and self-efficacy in teachers will lead to lower teacher attrition. In turn, research shows…

Alternative Education: Evaluation and Implementation of EBCE.

ERIC Educational Resources Information Center

Shively, Joe E.; Sanders, Jack

Increasing student disenchantment with traditional schooling prompted the development of an alternative educational program: Experience-Based Career Education (EBCE). During three years of development, evaluation provided student, parent, and employer data on program impact and effectiveness. Stakeholders' involvement in program development and…

76 FR 74076 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Final Notice

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-30

... Evaluate the YouthBuild Program; Final Notice AGENCY: Employment and Training Administration (ETA), Labor... rigorous, nationally-representative estimates of the net impacts of the YouthBuild program. The Department... study. In the sites randomly selected to participate in this evaluation, all applicants for YouthBuild...

Leveraging Volunteers: An Experimental Evaluation of a Tutoring Program for Struggling Readers

ERIC Educational Resources Information Center

Jacob, Robin; Armstrong, Catherine; Bowden, A. Brooks; Pan, Yilin

2016-01-01

This study evaluates the impacts and costs of the Reading Partners program, which uses community volunteers to provide one-on-one tutoring to struggling readers in under-resourced elementary schools. The evaluation uses an experimental design. Students were randomly assigned within 19 different Reading Partners sites to a program or control…

GLOBE in the Czech Republic: A Program Evaluation

ERIC Educational Resources Information Center

Cincera, Jan; Maskova, Veronika

2011-01-01

The article presents results of the evaluation of the GLOBE program (Global Learning and Observations to Benefit the Environment) in the Czech Republic. The evaluation explores the implementation of the program in schools and its impact on research skills. Four hundred and sixty six pupils, aged 13, from 28 different schools participated in the…

An Evaluation of Newgate and Other Prisoner Education Programs.

ERIC Educational Resources Information Center

Kaplan (Marshall), Gans and Kahn, San Francisco, CA.

In a study to determine what impact prison college programs have had and to provide information useful to policy decisions, an evaluation, findings, and conclusions are presented for the Newgate and four other programs. An evaluation is made of post prison careers utilizing recidivism, "making it", and "doing good" as a…

Summative Evaluation of the Foreign Credential Recognition Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2010

2010-01-01

A summative evaluation of the Foreign Credential Recognition Program (FCRP) funded by Human Resources and Skills Development Canada (HRSDC) was conducted during the spring, summer and fall of 2008. The main objective of the evaluation was to measure the relevance, impacts, and cost-effectiveness of the program. Given the timing of the evaluation…

The Impact of a Sport-Based Life Skill Program on Adolescent Prosocial Values

ERIC Educational Resources Information Center

Brunelle, John; Danish, Steven J.; Forneris, Tanya

2007-01-01

This article describes the implementation and evaluation of a sport-based life skills and community service program. The purpose of this investigation was to determine the impact of a combined life skills and community service program on adolescents' prosocial values. The program was part of a national golf and life skills enrichment academy for…

The CAEP Standards and Research on Educator Preparation Programs: Linking Clinical Partnerships with Program Impact

ERIC Educational Resources Information Center

Heafner, Tina; McIntyre, Ellen; Spooner, Melba

2014-01-01

Responding to the challenge of more rigorous and outcome-oriented program evaluation criteria of the Council for the Accreditation of Educator Preparation (CAEP), authors take a critical look at the intersection of two standards: Clinical Partnerships and Practice (Standard 2) and Program Impact (Standard 4). Illustrating one aspect of a secondary…

The Impact of Federal Early Childhood Programs on Children.

ERIC Educational Resources Information Center

Hertz, Thomas W.

This paper reviews research findings concerning the effects on young children of major Federal programs in education and child care. It offers a summary rather than a detailed view of research on the impact of programs, and is based primarily on major program evaluation reports and research reviews. In addition, it draws upon a small number of…

Teacher Social Capital and Student Achievement: Impact of a Cyber-Enabled Teacher Professional Development Program

ERIC Educational Resources Information Center

Liu, Wei

2012-01-01

This is an evaluative research study of a NSF-funded, DRK-12 cyber-enabled teacher professional development program in elementary engineering education. The finding shows the significant impact of the program on students' science and engineering knowledge in the second year of the program's implementation. However, student learning gain…

Predicting Wanton Assault in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development Model was a community-based planning and procedural tool designed to enhance positive youth development and prevent delinquency through a process of youth needs assessment, development of targeted programs, and program impact evaluation. A series of 12 Impact Scales most directly reflect the…

Symposium: Perspectives on Formative Evaluation of Children's Television Programs.

ERIC Educational Resources Information Center

1977

Evaluators of television programing and representatives of funding agencies discussed the impact of the perceptions of funding agencies on the evaluation of children's television. Participants also examined the interplay between the objectives of the television series and the evaluation, the relationship between production and evaluation, and the…

Unlocking Public Value: An Evaluation of the Impact of Missouri's Great Northwest Day at the Capitol Program

ERIC Educational Resources Information Center

Majee, Wilson; Maltsberger, Beverly A.

2013-01-01

The study reported here is an evaluation of the public value of a regional public policy engagement program. Data were obtained through surveys and document analysis. The study observed peer-learning and networking opportunities as some of the most impactful elements of GNWD at the Capitol in creating public value. Building coalitions of interest…

SBIR and STTR Program for Assistive Technology Device Development: Evaluation of Impact Using an ICF-Based Classification

ERIC Educational Resources Information Center

Bauer, Stephen M.; Arthanat, Sajay

2010-01-01

The purpose of this paper was to evaluate the impact of Small Business Innovation Research (SBIR) and Small Business Technology Transfer Research (STTR) grant programs of 5 federal agencies National Institutes of Health (NIH), National Science Foundation (NSF), U.S. Department of Education (USDE), U.S. Department of Agriculture (USDA), and…

Evaluating the Impact of a School-Based Helmet Promotion Program on Eligible Adolescent Drivers: Different Audiences, Different Needs?

ERIC Educational Resources Information Center

Germeni, Evi; Lionis, Christos; Kalampoki, Vassiliki; Davou, Bettina; Belechri, Maria; Petridou, Eleni

2010-01-01

The school environment has been often identified as a prosperous venue for public health improvement. This study is a cluster randomized controlled trial evaluating the impact of a school-based helmet promotion program on knowledge, attitudes and practices of eligible adolescent drivers. Four public, four private and four vocational high schools…

Evaluation Methodologies: A Study to Evaluate the Functioning and Impact of the President's Council on Physical Fitness and Sports. Report No. 3.

ERIC Educational Resources Information Center

Bruce, Robert; And Others

This report presents an overview of research objectives, sampling approaches, data collection procedures, and instruments and plans for analysis used in assessing the impact of the President's Council on Physical Fitness and Sports on different types of fitness programs. Surveys were conducted of: (1) community fitness programs; (2) employee…

Aid effectiveness and programmatic effectiveness: a proposed framework for comparative evaluation of different aid interventions in a particular health system.

PubMed

Haque, Hasibul; Hill, Philip C; Gauld, Robin

2017-01-01

Against a backdrop of changing concepts of aid effectiveness, development effectiveness, health systems strengthening, and increasing emphasis on impact evaluation, this article proposes a theory-driven impact evaluation framework to gauge the effect of aid effectiveness principles on programmatic outcomes of different aid funded programs in the health sector of a particular country. The foundation and step-by-step process of implementing the framework are described. With empirical evidence from the field, the steps involve analysis of context, program designs, implementation mechanisms, outcomes, synthesis, and interpretation of findings through the programs' underlying program theories and interactions with the state context and health system. The framework can be useful for comparatively evaluating different aid interventions both in fragile and non-fragile state contexts.

Camp's "Disneyland" Effect.

ERIC Educational Resources Information Center

Renville, Gary

1999-01-01

Describes the positive mental, physical, and social growth impacts that the camping experience had on the author, and urges camp program evaluation to plan and implement such changes. Sidebar lists steps of effective evaluation: program goals and objectives, goals of evaluation, implementation of evaluation, data analysis, and findings and…

National impacts of the Weatherization Assistance Program in single-family and small multifamily dwellings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brown, M.A.; Berry, L.G.; Balzer, R.A.

1993-05-01

Since 1976, the US Department of Energy (DOE) has operated one of the largest energy conservation programs in the nation -- the low-income Weatherization Assistance Program. The program strives to increase the energy efficiency of dwellings occupied by low-income persons in order to reduce their energy consumption, lower their fuel bills, increase the comfort of their homes, and safeguard their health. It targets vulnerable groups including the elderly, people with disabilities, and families with children. The most recent national evaluation of the impacts of the Program was completed in 1984 based on energy consumption data for households weatherized in 1981.more » DOE Program regulations and operations have changed substantially since then: new funding sources, management principles, diagnostic procedures, and weatherization technologies have been incorporated. Many of these new features have been studied in isolation or at a local level; however, no recent evaluation has assessed their combined, nationwide impacts to date or their potential for the future. In 1990, DOE initiated such an evaluation. This evaluation is comprised of three ``impact`` studies (the Single-Family Study, High-Density Multifamily Study, and Fuel-Oil Study) and two ``policy`` studies. Altogether, these five studies will provide a comprehensive national assessment of the Weatherization Assistance Program as it existed in the 1989 Program Year (PY 1989). This report presents the results of the first phase of the Single-Family Study. It evaluates the energy savings and cost effectiveness of the Program as it has been applied to the largest portion of its client base -- low-income households that occupy single-family dwellings, mobile homes, and small (2- to 4-unit) multifamily dwellings. It is based upon a representative national sample that covers the full range of conditions under which the program was implemented in PY 1989.« less

Design and Operation of the Transformed National Healthy Start Evaluation.

PubMed

Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K

2017-12-01

Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.

Stage I Final Report for the Study of Program Management Procedures in the Campus-Based and Basic Grant Programs. (Volume I).

ERIC Educational Resources Information Center

Puma, Michael J.; And Others

The third phase of SISFAP (Study on the Impact of Student Financial Aid Programs), the primary purpose of this study is to evaluate federal and institutional management policies and practices for Basic Educational Opportunity Grant (BEOG) and campus-based programs as they impact on the extent to which the programs are meeting their legislative…

A Structural Evaluation of a Large-Scale Quasi-Experimental Microfinance Initiative

PubMed Central

Kaboski, Joseph P.; Townsend, Robert M.

2010-01-01

This paper uses a structural model to understand, predict, and evaluate the impact of an exogenous microcredit intervention program, the Thai Million Baht Village Fund program. We model household decisions in the face of borrowing constraints, income uncertainty, and high-yield indivisible investment opportunities. After estimation of parameters using pre-program data, we evaluate the model’s ability to predict and interpret the impact of the village fund intervention. Simulations from the model mirror the data in yielding a greater increase in consumption than credit, which is interpreted as evidence of credit constraints. A cost-benefit analysis using the model indicates that some households value the program much more than its per household cost, but overall the program costs 20 percent more than the sum of these benefits. PMID:22162594

A Structural Evaluation of a Large-Scale Quasi-Experimental Microfinance Initiative.

PubMed

Kaboski, Joseph P; Townsend, Robert M

2011-09-01

This paper uses a structural model to understand, predict, and evaluate the impact of an exogenous microcredit intervention program, the Thai Million Baht Village Fund program. We model household decisions in the face of borrowing constraints, income uncertainty, and high-yield indivisible investment opportunities. After estimation of parameters using pre-program data, we evaluate the model's ability to predict and interpret the impact of the village fund intervention. Simulations from the model mirror the data in yielding a greater increase in consumption than credit, which is interpreted as evidence of credit constraints. A cost-benefit analysis using the model indicates that some households value the program much more than its per household cost, but overall the program costs 20 percent more than the sum of these benefits.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

PubMed

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. ©Patrick Ware, Heather J Ross, Joseph A Cafazzo, Audrey Laporte, Emily Seto. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 03.05.2018.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol

PubMed Central

Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-01-01

Background Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. Objective The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. Methods The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. Results The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. Conclusions The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. PMID:29724704

Evaluating the impact of implementation factors on family-based prevention programming: methods for strengthening causal inference.

PubMed

Crowley, D Max; Coffman, Donna L; Feinberg, Mark E; Greenberg, Mark T; Spoth, Richard L

2014-04-01

Despite growing recognition of the important role implementation plays in successful prevention efforts, relatively little work has sought to demonstrate a causal relationship between implementation factors and participant outcomes. In turn, failure to explore the implementation-to-outcome link limits our understanding of the mechanisms essential to successful programming. This gap is partially due to the inability of current methodological procedures within prevention science to account for the multitude of confounders responsible for variation in implementation factors (i.e., selection bias). The current paper illustrates how propensity and marginal structural models can be used to improve causal inferences involving implementation factors not easily randomized (e.g., participant attendance). We first present analytic steps for simultaneously evaluating the impact of multiple implementation factors on prevention program outcome. Then, we demonstrate this approach for evaluating the impact of enrollment and attendance in a family program, over and above the impact of a school-based program, within PROSPER, a large-scale real-world prevention trial. Findings illustrate the capacity of this approach to successfully account for confounders that influence enrollment and attendance, thereby more accurately representing true causal relations. For instance, after accounting for selection bias, we observed a 5% reduction in the prevalence of 11th grade underage drinking for those who chose to receive a family program and school program compared to those who received only the school program. Further, we detected a 7% reduction in underage drinking for those with high attendance in the family program.

Evaluation Capacity in K-12 School Counseling Programs.

ERIC Educational Resources Information Center

Trevisan, Michael S.

2002-01-01

Presents results of a literature review, organized the Milstein and Cotton evaluation capacity (B. Milstein and D. Cotton, 2000) framework, detailing and analyzing the contextual factors and system features that impact the evaluation capacity of school counseling programs. Discusses implications for evaluation in other settings. (SLD)

Evaluating Mentoring Programs. P/PV Brief

ERIC Educational Resources Information Center

Grossman, Jean Baldwin

2009-01-01

This methodological brief is designed to provide both program operators and researchers with practical advice about how to assess a program's implementation and impact. Adapted from an article that first appeared in "The Handbook of Youth Mentoring" (DuBois and Karcher, ed. 2005), the brief focuses on the evaluation of mentoring programs, but the…

District #30 U.S.E.A. Title I Programs--PL 89-10 and Impact Aid Low Rent Housing Programs--PL 81-874. Final Evaluation Report, 1977-1978.

ERIC Educational Resources Information Center

Lesser, Saal D.; Reece, Gene K.

In 1977-78, four remediation programs were funded under Title I and three under Impact Aid in New York City's School District 30. Title I programs included: (1) a teacher-paraprofessional reading team program in 12 elementary, intermediate and junior high schools; (2) a teacher-paraprofessional mathematics team program in 10 elementary,…

Growing Community: The Impact of the Stephanie Alexander Kitchen Garden Program on the Social and Learning Environment in Primary Schools

ERIC Educational Resources Information Center

Block, Karen; Gibbs, Lisa; Staiger, Petra K.; Gold, Lisa; Johnson, Britt; Macfarlane, Susie; Long, Caroline; Townsend, Mardie

2012-01-01

This article presents results from a mixed-method evaluation of a structured cooking and gardening program in Australian primary schools, focusing on program impacts on the social and learning environment of the school. In particular, we address the Stephanie Alexander Kitchen Garden Program objective of providing a pleasurable experience that has…

Determining the Quality and Impact of an E-Mentoring Program on At-Risk Youth

ERIC Educational Resources Information Center

Culpepper, Diane W.; Hernandez-Gantes, Victor M.; Blank, William E.

2015-01-01

The purpose of this study was to determine the quality of an e-mentoring program and the impact of participation on at-risk high school students enrolled in dropout prevention programs. The quality of the program was evaluated based on the ease of implementation, use of technology, and overall satisfaction. Indicators of student's self-esteem,…

YA4-H! Youth Advocates for Health: Impact of a 4-H Teens-as-Teachers Program

ERIC Educational Resources Information Center

Arnold, Mary E.; Flesch, Jeffrey M.; Ashton, Carolyn; Black, Lynette; Brody, Barbara; Hosty, Maureen; Northway, Shanna

2016-01-01

This article reports the results of an evaluation of the YA4-H! Youth Advocates for Health--Teens as Teachers program. Consistent with previous research on the impact of teen teaching, the teens participating in the program gained confidence and skill with regard to teaching younger youths. The program also affected the teens' understanding that…

Implementing and Evaluating School-Based Primary Prevention Programs and the Importance of Differential Effects on Outcomes

ERIC Educational Resources Information Center

Hussey, David L.; Flannery, Daniel J.

2007-01-01

In 2004, Second Step (Committee for Children, 2002), a violence prevention program, was implemented in the Cleveland Heights-University Heights school district for 1,416 K through second grade students. Both process and outcome measures were used to evaluate program impact and examine issues related to the implementation and evaluation of…

"I Am Not a Big Man": Evaluation of the Issue Investigation Program

ERIC Educational Resources Information Center

Cincera, Jan; Simonova, Petra

2017-01-01

The article evaluates a Czech environmental education program focused on developing competence in issue investigation. In the evaluation, a simple quasi-experimental design with experimental (N = 200) and control groups was used. The results suggest that the program had a greater impact on girls than on boys, and that it increased their internal…

Evaluation of the Leadership Institute: A Program to Build Individual and Organizational Capacity through Emotional Intelligence

ERIC Educational Resources Information Center

Chen, Claire Yueh-Ti; King, Jeff; Cochran, Graham R.; Argabright, Karen J.

2014-01-01

The purpose of the study reported here was to evaluate the impact of Leadership Institute, a program designed to strengthen leadership capacity through developing individuals' emotional intelligence (EQ). A pre-and posttest approach was used to collect data from two workshops with identical EQ content, program structure, and evaluation.…

A Process Evaluation of Project Developmental Continuity, Interim Report VII, Volume 3: Assessment of Program Impact Through the Head Start Year.

ERIC Educational Resources Information Center

Granville, Arthur C.; And Others

This interim report, part of a series of documents examining the feasibility of the longitudinal evaluation of Project Developmental Continuity (PDC), presents the results of an analysis of PDC impact at the Head Start level, using Spring 1977 data. PDC is a Head Start Demonstration Program aimed at providing educational and developmental…

Health for Life in Primary Schools Program, United Kingdom: a Program Impact Pathways (PIP) analysis.

PubMed

Passmore, Sandra; Donovan, Martin

2014-09-01

The Health for Life in Primary Schools Program helps schools promote healthy, active lifestyles through curriculum support related to healthy eating and cooking, growing food, physical activity, and family involvement. These interrelated strands are shown to have the greatest impact on healthy lifestyles, and the Health for Life in Primary Schools Program seeks to make these not one-off lessons, but a sustainable part of a school's culture. Each school involved with the program develops its own Action Plan in order to achieve program goals. Each school is assessed by an audit of facilities, skills, and curriculum at baseline and follow-up, and the pupils complete an on-line questionnaire at baseline and follow-up. Other impact measures are individual to the school and relate to its own Action Plan. Health for Life in Primary Schools sought to assess the cohesiveness and strength of the program using the Program Impact Pathways (PIP) model. The program was deconstructed to its individual parts, with each part assessed in terms of its contribution to the overall program and constraints upon its effectiveness. The PIP analysis helped clarify the logic and structure of the program, whether its objectives can be achieved, the Critical Quality Control Points (CCPs), and the impact measures required to demonstrate success. The core indicators identified for impact evaluation were knowledge, attitudes, and behaviors of pupils around healthy eating cooking, growing food, and physical activity. The PIP model confirmed that the Health for Life in Primary Schools Program is well structured and is well suited to achieve its goals. The findings were presented at the Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation.

Evaluation Options for Family Resource Centers.

ERIC Educational Resources Information Center

Horsch, Karen, Ed.; Weiss, Heather B., Ed.

Family resource centers (FRC) are emerging as a promising program approach to solving urgent social problems. Evaluation plays an important role in learning how these programs work, what their impact is, and whether they should be expanded. However, FRCs pose unique challenges to evaluation. This report considers the challenges to evaluating FRCs,…

Evaluation: An Imperative for Public Education and Training Programs. Professorial Inaugural Lecture Series.

ERIC Educational Resources Information Center

McCaslin, N. L.

Evaluation is important to public education and training programs if the United States is to be competitive in a global economy. Six major factors have had an impact on evaluation efforts: decreased financial resources, increased public dissatisfaction, changed management approaches, enhanced evaluation methods and procedures, redesigned…

The plan for the economic evaluation of the Public Service Communication Satellite system

NASA Technical Reports Server (NTRS)

1977-01-01

A total plan for the economic evaluation of the PSCS public service communication satellite program within domestic markets is presented. It extends from the present through the planning, performance and evaluation of economic experiments following the launch of the PSCS, and includes the consideration of how the results of these experiments impact the transfer from demonstration to operations. The implementation of this plan will provide NASA with information needed to understand and manage the economic and social impacts of the PSCS program.

Impact of Pharmacists’ Participation in a Pharmacotherapy Follow-Up Program

PubMed Central

Dualde, Elena; Santonja, Francisco J.; Faus, Maria J.

2012-01-01

Objective. To evaluate the impact of a continuing pharmacy education (CPE) course on Spanish community pharmacists’ participation in a pharmacotherapy follow-up program. Design. Participation in a CPE course offered 4 times over a 4-year period via satellite teleconferencing was monitored and the data analyzed to determine the course’s impact on community pharmacists’ participation in a pharmacotherapy follow-up program. Assessment. Community pharmacists’ participation in the pharmaceutical care CPE course had a slightly positive impact on their participation in the pharmacotherapy follow-up program. In the best profiles, there was a probability of 7.3% that participants would participate in the pharmacotherapy follow-up program. Conclusions. Completion of pharmaceutical care CPE courses did not have a significant impact on pharmacists’ participation in a pharmacotherapy follow-up program. PMID:22438606

The Impact of the Louisiana Scholarship Program on Racial Segregation in Louisiana Schools. Louisiana Scholarship Program Evaluation Report #3. Technical Report

ERIC Educational Resources Information Center

Egalite, Anna J.; Mills, Jonathan N.; Wolf, Patrick J.

2016-01-01

The question of how school choice programs affect the racial stratification of schools is highly salient in the field of education policy. We use a student-level panel data set to analyze the impacts of the Louisiana Scholarship Program (LSP) on racial segregation in public and private schools. This targeted school voucher program provides funding…

Why Are Economists Evaluating the Impact of Gifted Education?

ERIC Educational Resources Information Center

Kettler, Todd

2016-01-01

Bui, Craig, and Imberman assessed the impact of gifted and talented programs on student achievement using regression discontinuity and random assignment to gifted magnet schools. In both analyses, they found minimal impact of the gifted and talented programs on student achievement. This commentary addresses two concerns associated with the study.…

Arts Impact: Lessons from ArtsBridge

ERIC Educational Resources Information Center

Shimshon-Santo, Amy R.

2010-01-01

Arts Impact summarizes lessons learned at the ArtsBridge Program. It is informed by in-depth participant observation, logic modeling, and quantitative evaluation of program impact on K-12 students in inner city schools and arts students at the University of California Los Angeles over a two year period. The case study frames its analysis through a…

Workplace Literacy Programs: Variations of Approach and Limits of Impact.

ERIC Educational Resources Information Center

Mikulecky, Larry

Six workplace literacy programs were evaluated for impact upon learners, learners' families, and learners' productivity. Site 1 was an automotive plant where learners were involved in technical preparation, the General Educational Development program, and English as a Second Language (ESL). Site 2 was a wood-processing plant with a communication…

An Abstinence Program's Impact on Cognitive Mediators and Sexual Initiation

ERIC Educational Resources Information Center

Weed, Stan E.; Ericksen, Irene H.; Lewis, Allen; Grant, Gale E.; Wibberly, Kathy H.

2008-01-01

Objectives: To evaluate the impact of an abstinence education program on sexual intercourse initiation and on possible cognitive mediators of sexual initiation for virgin seventh graders in suburban Virginia. Methods: Measures of sexual behavior and 6 mediating variables were compared at 3 time periods for program participants and a matched…

Impacts of the Retired Mentors for New Teachers Program. REL 2017-225

ERIC Educational Resources Information Center

DeCesare, Dale; McClelland, Abby; Randel, Bruce

2017-01-01

This study evaluates the impact of the Retired Mentors for New Teachers program, a two-year mentoring program at the elementary school level developed by Aurora Public Schools in Colorado. Many of the district's schools serve a large percentage of economically disadvantaged children, experience high teacher turnover, and hire newer, less…

The Impacts of the Great Recession on State Natural Resource Extension Programs

ERIC Educational Resources Information Center

Serenari, Christopher; Peterson, M. Nils; Bardon, Robert E.; Brown, Robert D.

2013-01-01

The Great Recession contributed to major budget cuts for natural resource Extension programs in the United States. Despite the potentially large cuts, their impacts and how Extension has adapted their programs have not been evaluated. We begin addressing these needs with surveys of Association of Natural Resource Extension Professionals members…

Evaluation of the Impact of a Policy Change on a Diversion Program

ERIC Educational Resources Information Center

Dembo, Richard; Wareham, Jennifer; Schmeidler, James

2005-01-01

As part of a larger study examining the impact of the "get tough" policy on juvenile crime, we studied the effects of efforts to "get tough" on juvenile participation in diversion programs in Hillsborough County, Florida. Florida legislature budget cuts in 2000 eliminated a primary community service program (JASP), replacing it…

Impacts of the Conservation Education Program in Serra Malagueta Natural Park, Cape Verde

ERIC Educational Resources Information Center

Burnett, Edmund; Sills, Erin; Peterson, M. Nils; DePerno, Christopher

2016-01-01

Environmental and conservation education programs are commonly offered in the rapidly expanding network of protected areas in developing countries. There have been few evaluations of these programs and their impacts on participants. At Serra Malagueta Natural Park in Cape Verde, we assessed changes in environmental knowledge, opinions, and…

Teacher Philosophy and Program Implementation and the Impact on Sex Education Outcomes.

ERIC Educational Resources Information Center

De Gaston, Jacqueline F.; And Others

1994-01-01

Reports a study that evaluated teacher influence and impact in a middle school abstinence sex education program, noting pre-post change, teacher differences, and student differences. Surveys indicated abstinence sex education programs can produce positive outcomes that are significantly influenced by the teacher's own philosophy and commitment to…

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

UNAVCO's Education and Community Engagement Program: Evaluating Five years of Geoscience Education and Community Outreach

NASA Astrophysics Data System (ADS)

Charlevoix, D. J.; Dutilly, E.

2017-12-01

In 2013, UNAVCO, a facility co-sponsored by the NSF and NASA, received a five-year award from the NSF: Geodesy Advancing Geosciences and EarthScope (GAGE). Under GAGE, UNAVCO's Education and Community Engagement (ECE) program conducts outreach and education activities, in essence broader impacts for the scientific community and public. One major challenge of this evaluation was the breadth and depth of the dozens of projects conducted by the ECE program under the GAGE award. To efficiently solve this problem of a large-scale program evaluation, we adopted a deliberative democratic (DD) approach that afforded UNAVCO ECE staff a prominent voice in the process. The evaluator directed staff members to chose the projects they wished to highlight as case studies of their finest broader impacts work. The DD approach prizes inclusion, dialogue, and deliberation. The evaluator invited ECE staff to articulate qualities of great programs and develop a case study of their most valuable broader impacts work. To anchor the staff's opinion in more objectivity than opinion, the evaluator asked each staff member to articulate exemplary qualities of their chosen project, discuss how these qualities fit their case study, and helped staff to develop data collection systems that lead to an evidence-based argument in support of their project's unique value. The results of this evaluation show that the individual ECE work areas specialized in certain kinds of projects. However, when viewed at the aggregate level, ECE projects spanned almost the entire gamut of NSF broader impacts categories. Longitudinal analyses show that since the beginning of the GAGE award, many projects grew in impact from year 1 to year 5. While roughly half of the ECE projects were prior work projects, by year five at least 33% of projects were newly developed under GAGE. All selected case studies exemplified how education and outreach work can be productively tied to UNAVCO's core mission of promoting geodesy.

Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

PubMed

Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

2014-12-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.

Reducing Gridlock on the Grid: Utility Trends in Managing Peak Electric Load through Residential Demand Response

NASA Astrophysics Data System (ADS)

McDonald, Betsy

Utilities across the United States are piloting residential demand response programs to help manage peak electric demand. Using publicly available program evaluations, this thesis analyzes nine such programs to uncover and synthesize the range of program offerings, goals, enrollment strategies, and customer experiences. This review reveals that program participation, components, and results differ based on a variety of factors, including geographic characteristics, program goals, and implementation strategies. The diversity of program designs and evaluation findings suggests an underlying tension between the need to generate cost-effective program impacts and the desire to increase accessibility so that program benefits are not exclusive to certain segments of the population. For more significant and impactful engagement, program goals may need to shift. State level policy support could help shift program goals toward increasing program accessibility. Future research should explore creative strategies that target existing barriers and allow for more inclusive deployment.

78 FR 36750 - Information Collection; Submission for OMB Review, Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-19

... (ICR) entitled Senior Corps Independent Living Impact Evaluation Study for review and approval in... Independent Living Impact Evaluation Study. This project will assess the impact of the Senior Companion Program on clients' self-efficacy, life satisfaction, and perceived social ties and social supports...

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

An evaluation paradigm for cumulative impact analysis

NASA Astrophysics Data System (ADS)

Stakhiv, Eugene Z.

1988-09-01

Cumulative impact analysis is examined from a conceptual decision-making perspective, focusing on its implicit and explicit purposes as suggested within the policy and procedures for environmental impact analysis of the National Environmental Policy Act of 1969 (NEPA) and its implementing regulations. In this article it is also linked to different evaluation and decision-making conventions, contrasting a regulatory context with a comprehensive planning framework. The specific problems that make the application of cumulative impact analysis a virtually intractable evaluation requirement are discussed in connection with the federal regulation of wetlands uses. The relatively familiar US Army Corps of Engineers' (the Corps) permit program, in conjunction with the Environmental Protection Agency's (EPA) responsibilities in managing its share of the Section 404 regulatory program requirements, is used throughout as the realistic context for highlighting certain pragmatic evaluation aspects of cumulative impact assessment. To understand the purposes of cumulative impact analysis (CIA), a key distinction must be made between the implied comprehensive and multiobjective evaluation purposes of CIA, promoted through the principles and policies contained in NEPA, and the more commonly conducted and limited assessment of cumulative effects (ACE), which focuses largely on the ecological effects of human actions. Based on current evaluation practices within the Corps' and EPA's permit programs, it is shown that the commonly used screening approach to regulating wetlands uses is not compatible with the purposes of CIA, nor is the environmental impact statement (EIS) an appropriate vehicle for evaluating the variety of objectives and trade-offs needed as part of CIA. A heuristic model that incorporates the basic elements of CIA is developed, including the idea of trade-offs among social, economic, and environmental protection goals carried out within the context of environmental carrying capacity.

Evaluating an employee wellness program.

PubMed

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Unlocking the Potential of the "What Works" Approach to Policymaking and Practice: Improving Impact Evaluations

ERIC Educational Resources Information Center

Granger, Robert C.; Maynard, Rebecca

2015-01-01

Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

[Impact of interventions in the pressure ulcer rate].

PubMed

Araya Farías, I; Febré, N

To evaluate the impact of a risk management program for prevention of pressure ulcers (PUs) in an adult Intensive Care Unit (ICU). A quantitative, prospective study performed with a «before and after» evaluation, and designed in three stages: 1) PU incidence study; 2) Intervention by implementing a risk management program, and 3) Assessment of the impact. Adherence to the preventive measures showed a significant increase (11.7%) between the first month of the program and the final month (58.5%) of the assessment. Initial PU rate was 20.9, with a decrease in the rate to 14.0 per 1000 bed occupancy days (P<.05) after the risk management program. The data show that the risk management program, using prevention measures, was effective in reducing the rate of PU in the period under study by more than 33%. Copyright © 2017 SECA. Publicado por Elsevier España, S.L.U. All rights reserved.

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

The Impact of a Cash Transfer Program on Cognitive Achievement: The "Bono de Desarrollo Humano" of Ecuador

ERIC Educational Resources Information Center

Ponce, Juan; Bedi, Arjun S.

2010-01-01

Throughout Latin America, conditional cash transfer (CCT) programs play an important role in social policy. These programs aim to influence the accumulation of human capital, as well as reduce poverty. In terms of educational outcomes, a number of impact evaluation studies have shown that such programs have led to an increase in school enrollment,…

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

ERIC Educational Resources Information Center

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques

PubMed Central

Jones, Kelly W.; Lewis, David J.

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented—from protected areas to payments for ecosystem services (PES)—to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing ‘matching’ to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods—an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators—due to the presence of unobservable bias—that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs. PMID:26501964

Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques.

PubMed

Jones, Kelly W; Lewis, David J

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented--from protected areas to payments for ecosystem services (PES)--to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing 'matching' to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods--an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators--due to the presence of unobservable bias--that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs.

Evaluation of seismic spatial interaction effects through an impact testing program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thomas, B.D.; Driesen, G.E.

The consequences of non-seismically qualified objects falling and striking essential, seismically qualified objects is an analytically difficult problem to assess. Analytical solutions to impact problems are conservative and only available for simple situations. In a nuclear facility, the numerous ``sources`` and ``targets`` requiring evaluation often have complex geometric configurations, which makes calculations and computer modeling difficult. Few industry or regulatory rules are available for this specialized assessment. A drop test program was recently conducted to ``calibrate`` the judgment of seismic qualification engineers who perform interaction evaluations and to further develop seismic interaction criteria. Impact tests on varying combinations of sourcesmore » and targets were performed by dropping the sources from various heights onto targets that were connected to instruments. This paper summarizes the scope, test configurations, and some results of the drop test program. Force and acceleration time history data and general observations are presented on the ruggedness of various targets when subjected to impacts from different types of sources.« less

Evaluation of seismic spatial interaction effects through an impact testing program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thomas, B.D.; Driesen, G.E.

The consequences of non-seismically qualified objects falling and striking essential, seismically qualified objects is an analytically difficult problem to assess. Analytical solutions to impact problems are conservative and only available for simple situations. In a nuclear facility, the numerous sources'' and targets'' requiring evaluation often have complex geometric configurations, which makes calculations and computer modeling difficult. Few industry or regulatory rules are available for this specialized assessment. A drop test program was recently conducted to calibrate'' the judgment of seismic qualification engineers who perform interaction evaluations and to further develop seismic interaction criteria. Impact tests on varying combinations of sourcesmore » and targets were performed by dropping the sources from various heights onto targets that were connected to instruments. This paper summarizes the scope, test configurations, and some results of the drop test program. Force and acceleration time history data and general observations are presented on the ruggedness of various targets when subjected to impacts from different types of sources.« less

Local Government Leadership Education: Measuring the Impact of Leadership Skill Development on Public Officials

ERIC Educational Resources Information Center

Davis, Gregory A.; Lucente, Joe

2012-01-01

Many Extension leadership development programs have been evaluated for effectiveness. Little literature exists focusing on the evaluation of leadership development programs involving elected and appointed local officials. This article describes an annual program involving elected and appointed local officials and shares quantitative and…

Evaluating the Impact of Implementation Factors on Family-Based Prevention Programming: Methods for Strengthening Causal Inference

PubMed Central

Crowley, D. Max; Coffman, Donna L.; Feinberg, Mark; Greenberg, Mark; Spoth, Richard

2013-01-01

Despite growing recognition of the important role implementation plays in successful prevention efforts, relatively little work has sought to demonstrate a causal relationship between implementation factors and participant outcomes. In turn, failure to explore the implementation-to-outcome link limits our understanding of the mechanisms essential to successful programming. This gap is partially due to the inability of current methodological procedures within prevention science to account for the multitude of confounders responsible for variation in implementation factors (i.e., selection bias). The current paper illustrates how propensity and marginal structural models can be used to improve causal inferences involving implementation factors not easily randomized (e.g., participant attendance). We first present analytic steps for simultaneously evaluating the impact of multiple implementation factors on prevention program outcome. Then we demonstrate this approach for evaluating the impact of enrollment and attendance in a family program, over and above the impact of a school-based program, within PROSPER, a large scale real-world prevention trial. Findings illustrate the capacity of this approach to successfully account for confounders that influence enrollment and attendance, thereby more accurately representing true causal relations. For instance, after accounting for selection bias, we observed a 5% reduction in the prevalence of 11th grade underage drinking for those who chose to receive a family program and school program compared to those who received only the school program. Further, we detected a 7% reduction in underage drinking for those with high attendance in the family program. PMID:23430578

Program Impact Evaluations: An Introduction for Managers of Title VII Projects. A Draft Guidebook.

ERIC Educational Resources Information Center

Bissell, Joan S.

Intended to assist administrators in the planning, management, and utilization of evaluation, this guidebook is designed as an introduction and supplement to other evaluation materials for bilingual education programs being developed under federal sponsorship, including evaluation models for Title VII projects. General information is provided on…

The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia. Impact Evaluation Series No. 29. Policy Research Working Paper 4836

ERIC Educational Resources Information Center

Barrera-Osorio, Felipe; Linden, Leigh L.

2009-01-01

This paper presents the evaluation of the program Computers for Education. The program aims to integrate computers, donated by the private sector, into the teaching of language in public schools. The authors conduct a two-year randomized evaluation of the program using a sample of 97 schools and 5,201 children. Overall, the program seems to have…

Interactive multi-mode blade impact analysis

NASA Technical Reports Server (NTRS)

Alexander, A.; Cornell, R. W.

1978-01-01

The theoretical methodology used in developing an analysis for the response of turbine engine fan blades subjected to soft-body (bird) impacts is reported, and the computer program developed using this methodology as its basis is described. This computer program is an outgrowth of two programs that were previously developed for the purpose of studying problems of a similar nature (a 3-mode beam impact analysis and a multi-mode beam impact analysis). The present program utilizes an improved missile model that is interactively coupled with blade motion which is more consistent with actual observations. It takes into account local deformation at the impact area, blade camber effects, and the spreading of the impacted missile mass on the blade surface. In addition, it accommodates plate-type mode shapes. The analysis capability in this computer program represents a significant improvement in the development of the methodology for evaluating potential fan blade materials and designs with regard to foreign object impact resistance.

Long-Term Impacts of a Faculty Development Program for the Internationalization of Curriculum in Higher Education

ERIC Educational Resources Information Center

Urban, Emily; Navarro, Maria; Borron, Abigail

2017-01-01

Faculty development programs for internationalization of the curriculum in higher education are often evaluated for short- and medium-term outcomes, but more long-term assessments are needed to determine impact. This study examined the long-term (6 years) impacts on faculty from colleges of agriculture after participating in a one-year…

Abriendo Puertas/Opening Doors Parenting Program: Summary Report of Program Implementation and Impacts. Publication #2014-24

ERIC Educational Resources Information Center

Moore, Kristin A.; Caal, Selma; Lawner, Elizabeth K.; Rojas, Angela; Walker, Karen

2014-01-01

Child Trends conducted a random assignment evaluation of the Abriendo Puertas/Opening Doors program, one of the largest programs in the United States working with low-income Latino parents of children ages zero to five. Since it began in 2007, the program has served over 30,000 parents/families in 34 states. The evaluation study examined the…

The Impact of a Two-Year School Breakfast Program for Preschool-Aged Children on Their Nutrient Intake and Pre-Academic Performance.

ERIC Educational Resources Information Center

Worobey, John; Worobey, Harriet S.

1999-01-01

Two studies examined nutritional differences between home breakfasts and breakfasts served at preschool following School Breakfast Program guidelines and evaluated nutritional impact of program participation on 4-year olds' preacademic performance. Results indicated that breakfast intake was altered under school breakfast conditions. Performance…

The Family Transition Program: Implementation and Three-Year Impacts of Florida's Initial Time-Limited Welfare Program.

ERIC Educational Resources Information Center

Bloom, Dan; Farrell, Mary; Kemple, James J.; Verma, Nandita

This report focuses on implementation, impacts, and time limit in Florida's Family Transition Program (FTP), a welfare reform initiative. Chapter 1 describes FTP and evaluation, target population, and data. Chapter 2 describes implementation of FTP in Escambia County: staffing and organizational structure of FTP and traditional Aid to Families…

Efficiency in Vocational Rehabilitation Program Service Delivery: The Impact of Socioeconomic Context

ERIC Educational Resources Information Center

Gere, Bryan O.; Burnett, Royce D.; Flowers, Carl R.; Akaaboune, Ouadie

2017-01-01

Background: State-federal (VR) program efficiency is the focus of empirical research because of increases in the magnitude and types of program requests, possibly funding cuts and class for models to more appropriately measure and evaluate performance. Objective: The purpose of this study was to examine the impact socioeconomic diversity has on…

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

NASA Astrophysics Data System (ADS)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

An economic analysis methodology for project evaluation and programming.

DOT National Transportation Integrated Search

2013-08-01

Economic analysis is a critical component of a comprehensive project or program evaluation methodology that considers all key : quantitative and qualitative impacts of highway investments. It allows highway agencies to identify, quantify, and value t...

How Bigelow Laboratory Measured Broader Impacts: The Case Study of the Evaluation of the Keller BLOOM Program (Invited)

NASA Astrophysics Data System (ADS)

Fowler, R. A.; Repa, J.

2010-12-01

In this presentation we discuss the impetus for, the results of the short and long term effects, and the impacts of the Keller BLOOM Program, hosted by Bigelow Laboratory for Ocean Sciences of West Boothbay Harbor, Maine. Each May, for the last 21 years, 16 bright high school juniors, one from each county in Maine, have been invited to spend five days with the research scientists at the lab conducting and reporting research on the bottom layers of the ocean’s food chain: phytoplankton and zooplankton. Bigelow has chosen to evaluate BLOOM through a series of questionnaires delivered during the program, and long term tracking of participants after the program, in order to better understand the impact of the program on participants. The short term effect of the experience, measured at the end of the week, found that participants are able to: 1) develop testable research questions, 2) collect multiple water samples from a local estuary, 3) measure various characteristics of those samples with the sophisticated instruments in Bigelow’s labs assisted by their research scientists, 4) analyze and integrate the results from the various labs, and 5) present their findings to a non-scientific audience. To measure long term participation effects, a random sample of 40 of the 332 participants were interviewed resulting in the following findings: 100% attend college; 62% have STEM majors; 88% graduate from college; 57% pursue STEM careers; and 60% live and work in Maine. Bigelow scientists include a description of the BLOOM Program and the evaluation results in their NSF Broader Impacts statements to demonstrate that their research activities are being integrated into a successful STEM education program. Evaluation results are also used by Bigelow scientists and program administrators to refine program content and delivery, to promote the program to potential applicants, and to strengthen proposals to funding agencies when seeking financial support for BLOOM.

Evaluation of a family-centered prevention intervention for military children and families facing wartime deployments.

PubMed

Lester, Patricia; Saltzman, William R; Woodward, Kirsten; Glover, Dorie; Leskin, Gregory A; Bursch, Brenda; Pynoos, Robert; Beardslee, William

2012-03-01

We evaluated the Families OverComing Under Stress program, which provides resiliency training designed to enhance family psychological health in US military families affected by combat- and deployment-related stress. We performed a secondary analysis of Families OverComing Under Stress program evaluation data that was collected between July 2008 and February 2010 at 11 military installations in the United States and Japan. We present data at baseline for 488 unique families (742 parents and 873 children) and pre-post outcomes for 331 families. Family members reported high levels of satisfaction with the program and positive impact on parent-child indicators. Psychological distress levels were elevated for service members, civilian parents, and children at program entry compared with community norms. Change scores showed significant improvements across all measures for service member and civilian parents and their children (P < .001). Evaluation data provided preliminary support for a strength-based, trauma-informed military family prevention program to promote resiliency and mitigate the impact of wartime deployment stress.

[Effects of social programs on indigent population health: Evidence from results-based budgeting's impact evaluations to social programs in Peru].

PubMed

Cavero-Arguedas, Denice; Cruzado de la Vega, Viviana; Cuadra-Carrasco, Gabriela

2017-01-01

This article describes the experience of the MEF's impact evaluation management as one of the RBB instruments and documents the design and results obtained from three impact evaluations of the most emblematic government social programs. The Service of Visiting Families (SAF) of the National Program "Cuna Mas", conditional cash transfer Program "JUNTOS" and National Program "Pension 65" focusing on objective population's health the outcomes. Among the main results, it was found the SAF generated improvements in cognitive and communication development in children, but had no impact on mothers' child care practices or children's nutritional status. In the case of JUNTOS, there were increases in per capita spending, food expenditure, decreases in severity and poverty gap, increases in school attendance and reductions of school dropout. However, no significant results were found in most indicators of prenatal health, child health, or chronic malnutrition. In the case of Pension 65, there were increases in household consumption and improvements in elderly's emotional health (depression, self valoration); but there was no evidence of increases in the use of health services by the elderly or improvements in their physical health. Therefore, it is recommended that such programs boost their designs and inter-sectoral coordination with MINSA and subnational institutions, in order to improve contents of healthy practices and child care, and optimize the provision of health and education services, in order to meet the demands of their users.

Assessment of Program Impact Through First Grade, Volume IV: Impact on Teachers. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Wacker, Sally; And Others

The fourth in a series reporting evaluation findings on the impact of Project Developmental Continuity (PDC), this volume reports treatment-related and other findings concerning teachers and classrooms up to the time the evaluation study's cohort of children had completed grade 1. Begun at 15 sites in 1974 with the purpose of ensuring that…

Pay-for-performance in nursing homes.

PubMed

Briesacher, Becky A; Field, Terry S; Baril, Joann; Gurwitz, Jerry H

2009-01-01

Information on the impact of pay-for-performance programs is lacking in the nursing home setting. This literature review (1980-2007) identified 13 prior examples of pay-for-performance programs in the nursing home setting: 7 programs were active as of 2007, while 6 had been terminated. The programs were mostly short-lived, varied considerably in the choice of performance measures and pay incentives, and evaluations of the impact were rare.

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program

ERIC Educational Resources Information Center

Davis, LaShara A.; Morgan, Susan E.; Mobley, Amy R.

2016-01-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported…

The Impact of Not on Tobacco on Teen Smoking Cessation: End-of-Program Evaluation Results, 1998 to 2003

ERIC Educational Resources Information Center

Horn, Kimberly; Dino, Geri; Kalsekar, Iftekhar; Mody, Reema

2005-01-01

This review summarizes end-of-program quit rates from 6 controlled and 10 field-based Not on Tobacco (NOT) evaluations. Approximately 6,130 youth from 5 states and 489 schools participated. Intent-to-treat and compliant quit rates were calculated at 3 months postbaseline (end-of-program). Results from controlled evaluations revealed an aggregate…

Evaluation of a Standardized Patient Education Program for Inpatient Cardiac Rehabilitation: Impact on Illness Knowledge and Self-Management Behaviors up to 1 Year

ERIC Educational Resources Information Center

Meng, Karin; Seekatz, Bettina; Haug, Günter; Mosler, Gabriele; Schwaab, Bernhard; Worringen, Ulrike; Faller, Hermann

2014-01-01

Patient education is an essential part of the treatment of coronary heart disease in cardiac rehabilitation. In Germany, no standardized and evaluated patient education programs for coronary heart disease have been available so far. In this article, we report the evaluation of a patient-oriented program. A multicenter quasi-experimental,…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

Evaluation of the Veterans' Education and Training Service (VETS) Program of the National League of Cities and U.S. Conference of Mayors.

ERIC Educational Resources Information Center

Scheflen, Kenneth C.; Brandewie, Robert J.

The document evaluates the impact of the Veterans' Education and Training Service (VETS) program on G.I. Bill utilization rates. The VETS program is designed to increase enrollments of educationally and economically disadvantaged veterans in Veterans' Administration education and training programs. Statistical data on veterans and descriptive data…

Getting Teachers in on the Act: Evaluation of a Theater- and Classroom-Based Youth Violence Prevention Program

ERIC Educational Resources Information Center

Zucker, Marla; Spinazzola, Joseph; Pollack, Amie Alley; Pepe, Lauren; Barry, Stephanie; Zhang, Lynda; van der Kolk, Bessel

2010-01-01

This study replicated and extended our previous evaluation of Urban Improv (UI), a theater-based youth violence prevention (YVP) program developed for urban youth. It assessed the replicability of positive program impacts when implemented by nonprogram originators, as well as the utility of a comprehensive version of the UI program that included a…

eMINTS Program Evaluation Report: An Investigation of Program Fidelity and Its Impact on Teacher Mastery and Student Achievement

ERIC Educational Resources Information Center

Martin, Wendy; Strother, Scott; Weatherholt, Tara; Dechaume, Merav

2008-01-01

The eMINTS professional development programs are designed to help teachers learn how to integrate technology into their teaching, using instructional strategies that promote inquiry-based learning and encourage collaboration and community building among students and teachers. The eMINTS programs considered in this evaluation include: (1) eMINTS…

Evaluation of a High-Engagement Teaching Program for STEM Graduate Students: Outcomes of the Future Academic Scholars in Teaching (FAST) Fellowship Program

ERIC Educational Resources Information Center

Prevost, Luanna B.; Vergara, Claudia E.; Urban-Lurain, Mark; Campa, Henry, III.

2018-01-01

Higher education institutions prepare future faculty members for multiple roles, including teaching. However, teaching professional development programs for graduate students vary widely. We present evaluation data from a high engagement program for STEM doctoral students. We analyzed the impact on three cohorts of participants over three academic…

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

The report is an overview of electric energy efficiency programs. It takes a concise look at what states are doing to encourage energy efficiency and how it impacts electric utilities. Energy efficiency programs began to be offered by utilities as a response to the energy crises of the 1970s. These regulatory-driven programs peaked in the early-1990s and then tapered off as deregulation took hold. Today, rising electricity prices, environmental concerns, and national security issues have renewed interest in increasing energy efficiency as an alternative to additional supply. In response, new methods for administering, managing, and delivering energy efficiency programs aremore » being implemented. Topics covered in the report include: Analysis of the benefits of energy efficiency and key methods for achieving energy efficiency; evaluation of the business drivers spurring increased energy efficiency; Discussion of the major barriers to expanding energy efficiency programs; evaluation of the economic impacts of energy efficiency; discussion of the history of electric utility energy efficiency efforts; analysis of the impact of energy efficiency on utility profits and methods for protecting profitability; Discussion of non-utility management of energy efficiency programs; evaluation of major methods to spur energy efficiency - systems benefit charges, resource planning, and resource standards; and, analysis of the alternatives for encouraging customer participation in energy efficiency programs.« less

Impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or chronic obstructive pulmonary disease: a systematic review of the literature.

PubMed

de Bruin, Simone R; Heijink, Richard; Lemmens, Lidwien C; Struijs, Jeroen N; Baan, Caroline A

2011-07-01

Evaluating the impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or COPD. Systematic Pubmed search for studies reporting the impact of disease management programs on healthcare expenditures. Included were studies that contained two or more components of Wagner's chronic care model and were published between January 2007 and December 2009. Thirty-one papers were selected, describing disease management programs for patients with diabetes (n=14), depression (n=4), heart failure (n=8), and COPD (n=5). Twenty-one studies reported incremental healthcare costs per patient per year, of which 13 showed cost-savings. Incremental costs ranged between -$16,996 and $3305 per patient per year. Substantial variation was found between studies in terms of study design, number and combination of components of disease management programs, interventions within components, and characteristics of economic evaluations. Although it is widely believed that disease management programs reduce healthcare expenditures, the present study shows that evidence for this claim is still inconclusive. Nevertheless disease management programs are increasingly implemented in healthcare systems worldwide. To support well-considered decision-making in this field, well-designed economic evaluations should be stimulated. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Indigenous Child Health in Brazil: The Evaluation of Impacts as a Human Rights Issue.

PubMed

Coates, Anna R; Del Pino Marchito, Sandra; Vitoy, Bernardino

2016-06-01

Improving the health status of indigenous children is a long-standing challenge. Several United Nations committees have identified the health of indigenous peoples as a human rights concern. Addressing the health of indigenous children cannot be separated from their social, cultural, and historic contexts, and any related health program must offer culturally appropriate services and a community perspective broad enough to address the needs of children and the local worlds in which they live. Evaluations of programs must, therefore, address process as well as impacts. This paper assesses interventions addressing indigenous children's health in Brazil, ranging from those explicitly targeting indigenous children's health, such as the targeted immunization program for indigenous peoples, as well as more generalized programs, including a focus upon indigenous children, such as the Integrated Management of Childhood Illness. The paper discusses the tensions and complexities of ethnically targeted health interventions as well as the conceptual and methodological challenge of measuring the processes employed and their impact. The lessons learned, especially the need for countries to more systematically collect data and evaluate impacts using ethnicity as an analytical category, are drawn out with respect to ensuring human rights for all within health sector responses.

Impact of a provider training program on the treatment of children with autism spectrum disorder at psychosocial care units in Brazil.

PubMed

Silva, Luciana C; Teixeira, Maria C T V; Ribeiro, Edith L; Paula, Cristiane S

2017-12-18

To develop, implement, and verify the impact of a training program for health care providers working with children with autism spectrum disorder (ASD) in psychosocial care centers for children and adolescents (Centro de Atenção Psicossocial à Infância e à Adolescência - CAPSi) in São Paulo, Brazil. This quasi-experimental study was conducted with 14 professionals from four CAPSi units. The training program consisted of six phases: 1) pre-intervention observation; 2) meeting with staff to assess the main needs of the training program; 3) developing materials for training and evaluation; 4) meetings to discuss program implementation; 5) a final meeting for case discussion and evaluation; and 6) distance supervision. Three measures were used to evaluate the training program: i) the Knowledge, Attitudes, and Practices (KAP) questionnaire; ii) videos containing questions designed to assess program comprehension; and iii) a satisfaction survey. Thirteen videos were produced to as visual aids for use during the training program, and a further 26 videos were developed to evaluate it. The program was well evaluated by the participants. The video responses and KAP questionnaire scores suggest that staff knowledge and attitudes improved after training. The positive findings of this study suggest that the tested training program is feasible for use with multidisciplinary teams working in the CAPSi environment.

Evaluation of the Impact of Fatty Acid Methyl Ester (FAME) Contamination on the Thermal Stability of Jet A

DTIC Science & Technology

2013-11-01

contamination in Jet A from 5 ppm to 100 ppm. Testing was performed by the U.S. Air Force at the Air Force Research Laboratory, Fuels and Energy...50 5.9.4 Post -Program EDTST Mode Additional Testing .............................................................. 50 6.0...124 Appendix H – Additional Post -Program Testing to Evaluate Impact of FAME on Typical Jet A of Reasonable Thermal Stability

Widening Our Evaluative Lenses of Formal, Facilitated, and Spontaneous Academic Development

ERIC Educational Resources Information Center

Hoessler, Carolyn; Godden, Lorraine; Hoessler, Brian

2015-01-01

As conceptions of academic development expand to encompass a more diverse and flexible set of supports, traditional approaches to evaluation, including impact studies of formal programming, become insufficient. A program may appear ineffective when evaluation ignores additional supports that interact to counteract implementation or alternatively…

Effectiveness of Medifast supplements combined with obesity pharmacotherapy: A clinical program evaluation

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the long-term impact of Medifast meal-replacement supplements (MMRS) combined with appetite suppressant medication (ASM) among participants who received 52 weeks of treatment. We conducted a systematic program evaluation of weight loss data from a medically supervised w...

Evaluating Alternative High Schools: Program Evaluation in Action

ERIC Educational Resources Information Center

Hinds, Drew Samuel Wayne

2013-01-01

Alternative high schools serve some of the most vulnerable students and their programs present a significant challenge to evaluate. Determining the impact of an alternative high school that serves mostly at-risk students presented a significant research problem. Few studies exist that dig deeper into the characteristics and strategies of…

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Using the RE-AIM framework to evaluate physical activity public health programs in Mexico

USDA-ARS?s Scientific Manuscript database

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizationa...

Impact Properties of Metal Fan Containment Materials Being Evaluated for the High-Speed Civil Transport (HSCT)

NASA Technical Reports Server (NTRS)

1996-01-01

Under the Enabling Propulsion Materials (EPM) program - a partnership between NASA, Pratt & Whitney, and GE Aircraft Engines - the Materials and Structures Divisions of the NASA Lewis Research Center are involved in developing a fan-containment system for the High-Speed Civil Transport (HSCT). The program calls for a baseline system to be designed by the end of 1995, with subsequent testing of innovative concepts. Five metal candidate materials are currently being evaluated for the baseline system in the Structures Division's Ballistic Impact Facility. This facility was developed to provide the EPM program with cost-efficient and timely impact test data. At the facility, material specimens are impacted at speeds up to 350 m/sec by projectiles of various sizes and shapes to assess the specimens' ability to absorb energy and withstand impact. The tests can be conducted at either room or elevated temperatures. Posttest metallographic analysis is conducted to improve understanding of the failure modes. A dynamic finite element program is used to simulate the events and both guide the testing as well as aid in designing the fan-containment system.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

PubMed

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.

Testing the DMAA's recommendations for disease management program evaluation.

PubMed

Serxner, Seth; Mattke, Soeren; Zakowski, Sarah; Gold, Daniel

2008-10-01

The objective of this study was to compare and contrast findings regarding the financial savings projections of the disease management (DM) programs of 2 large employers based on different evaluation methods. In particular, this research tests the impact of differences in assumptions on the underlying growth rate of group health costs, exclusions of high-cost conditions and claims, and the length of the baseline period for determined health care costs. A pre-post study design was used. The data for this research came from 2 large employers in the consumer goods industry with comprehensive Health and Productivity Management programs. It contained medical and prescription drug claims and health plan enrollment data as well as program activity data from 2001 to 2005, covering an average yearly sample size of 201,037 members with 12 consecutive months of enrollment. Analyses were done on group-level averages using nominal cost data and were run to reflect the impact of a DM-only intervention. While the trend estimate and length of baseline had the largest effects on estimated program impact, the use of exclusions had an important effect as well. These findings demonstrate the importance of developing and instituting a standardized evaluation methodology. Without increasing consistency in the way evaluators develop their methodologies, it will remain difficult to be able to compare one evaluation to another, or to have faith in the results at hand.

Using GIS to evaluate a fire safety program in North Carolina.

PubMed

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

A Realist Evaluation Approach to Unpacking the Impacts of the Sentencing Guidelines

ERIC Educational Resources Information Center

Hunt, Kim Steven; Sridharan, Sanjeev

2010-01-01

Evaluations of complex interventions such as sentencing guidelines provide an opportunity to understand the mechanisms by which policies and programs can impact intermediate and long-term outcomes. There is limited previous discussion of the underlying frameworks by which sentencing guidelines can impact outcomes such as crime rates. Guided by a…

Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

PubMed

Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

2015-01-01

Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

Methodologies for Evaluating the Impact of Contraceptive Social Marketing Programs.

ERIC Educational Resources Information Center

Bertrand, Jane T.; And Others

1989-01-01

An overview of the evaluation issues associated with contraceptive social marketing programs is provided. Methodologies covered include survey techniques, cost-effectiveness analyses, retail audits of sales data, time series analysis, nested logit analysis, and discriminant analysis. (TJH)

EVALUATION OF DIVERSION AND COSTS FOR SELECTED DROP-OFF RECYCLING PROGRAMS - A MITE PROGRAM EVALUATION

EPA Science Inventory

This analysis was undertaken in 1993-94 to examine a sample of drop-off recycling programs in the United States and Canada to determine the quantities of recyclable materials diverted, the cost of diverting those materials, and the impact of a wide range of independent variables ...

Innovations in Doctoral Education: Distance Education Methodology Applied

ERIC Educational Resources Information Center

Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan

2009-01-01

This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…

Findings from the Evaluation of OJJDP's Gang Reduction Program. Juvenile Justice Bulletin

ERIC Educational Resources Information Center

Cahill, Meagan; Hayeslip, David

2010-01-01

This bulletin draws on findings from an independent evaluation, conducted by the Urban Institute, of the Gang Reduction Program's (GRP) Impact in Los Angeles, California; Milwaukee, Wisconsin; North Miami Beach, Florida; and Richmond, Virginia, to examine how effectively these sites implemented the program. Following are some of the authors' key…

Evaluation of Access, a Primary Care Program for Indigent Patients: Inpatient and Emergency Room Utilization.

ERIC Educational Resources Information Center

Davidson, Richard A.; Giancola, Angela; Gast, Andrea; Ho, Janice; Waddell, Rhondda

2003-01-01

Evaluated the impact of Accessing Community Care through Eastside Social Services (ACCESS), a program that provided indigent patients with free primary care, on inpatient admissions, emergency room (ER) visits, and subsequent charges. Data on 19 people before and after program enrollment showed significant decreases in ER visits following…

Evaluation of a Local Designated Driver and Responsible Server Program to Prevent Drinking and Driving.

ERIC Educational Resources Information Center

Simons-Morton, Bruce G.; Cummings, Sharon Snider

1997-01-01

Evaluates the impact of beverage servers' interventions at five establishments participating in the Houston Techniques for Effective Alcohol Management (TEAM) program. The intervention included server training, a designated-driver program, and "Safe Ride Home" taxi vouchers. Findings are discussed within the context of scant public and…

The evolution of Rare Pride: using evaluation to drive adaptive management in a biodiversity conservation organization.

PubMed

Jenks, Brett; Vaughan, Peter W; Butler, Paul J

2010-05-01

Rare Pride is a social marketing program that stimulates human behavior change in order to promote biodiversity conservation in critically threatened regions in developing countries. A series of formal evaluation studies, networking strategies, and evaluative inquiries have driven a 20-year process of adaptive management that has resulted in extensive programmatic changes within Pride. This paper describes the types of evaluation that Rare used to drive adaptive management and the changes it caused in Pride's theory-of-change and programmatic structure. We argue that (a) qualitative data gathered from partners and staff through structured interviews is most effective at identifying problems with current programs and procedures, (b) networking with other organizations is the most effective strategy for learning of new management strategies, and (c) quantitative data gathered through surveys is effective at measuring program impact and quality. Adaptive management has allowed Rare to increase its Pride program from implementing about two campaigns per year in 2001 to more than 40 per year in 2009 while improving program quality and maintaining program impact. Copyright 2009 Elsevier Ltd. All rights reserved.

Methods for evaluating and ranking transportation energy conservation programs

NASA Astrophysics Data System (ADS)

Santone, L. C.

1981-04-01

The energy conservation programs are assessed in terms of petroleum savings, incremental costs to consumers probability of technical and market success, and external impacts due to environmental, economic, and social factors. Three ranking functions and a policy matrix are used to evaluate the programs. The net present value measure which computes the present worth of petroleum savings less the present worth of costs is modified by dividing by the present value of DOE funding to obtain a net present value per program dollar. The comprehensive ranking function takes external impacts into account. Procedures are described for making computations of the ranking functions and the attributes that require computation. Computations are made for the electric vehicle, Stirling engine, gas turbine, and MPG mileage guide program.

New Utrecht High School Project Impact, 1981-1982. O.E.E. Evaluation Report.

ERIC Educational Resources Information Center

Di Martino, Vincent; And Others

Project IMPACT, a magnet bilingual program for Italian-speaking students in New York City, offered in 1981-82 full academic and career programs for 210 students in grades 9-12. The philosophy of bilingual education employed in IMPACT is transitional, and a major goal is to mainstream students within an average of two years. Students receive…

Pharmacist Web-Based Training Program on Medication Use in Chronic Kidney Disease Patients: Impact on Knowledge, Skills, and Satisfaction

ERIC Educational Resources Information Center

Legris, Marie-eve; Seguin, Noemie Charbonneau; Desforges, Katherine; Sauve, Patricia; Lord, Anne; Bell, Robert; Berbiche, Djamal; Desrochers, Jean-Francois; Lemieux, Jean-Philippe; Morin-Belanger, Claudia; Paradis, Francois Ste-Marie; Lalonde, Lyne

2011-01-01

Introduction: Chronic kidney disease (CKD) patients are multimorbid elderly at high risk of drug-related problems. A Web-based training program was developed based on a list of significant drug-related problems in CKD patients requiring a pharmaceutical intervention. The objectives were to evaluate the impact of the program on community…

4-S Positive Youth Development in Latin America: Professional Schools in Costa Rica

ERIC Educational Resources Information Center

Lopes, Sandro; Geldhof, G. John; Bowers, Edmond P.; Thogmartin, Asia

2018-01-01

As youth development programs established in the United States expand globally, researchers must evaluate their impacts in diverse contexts. The work described in this article established a baseline for assessing the impact of a 4-S youth program at professional technical high schools in Costa Rica. The 4-S program is equivalent to 4-H in…

Impact of a Kentucky Maternal, Infant, and Early Childhood Home-Visitation Program on Parental Risk Factors

ERIC Educational Resources Information Center

Ferguson, Jonnisa M.; Vanderpool, Robin C.

2013-01-01

As public health organizations continue to implement maternal and child health home-visitation programs, more evaluation of these efforts is needed, particularly as it relates to improving parental behaviors. The purpose of our study was to assess the impact of families' participation in a home-visitation program offered by a central Kentucky…

Impact of "Grassroots on Work" (GROW) Extension Program to the Bachelor of Arts in Political Science Students' Sense of Civic Responsibility

ERIC Educational Resources Information Center

Paga, Mark Leo Huit

2015-01-01

Purpose: The purpose of this study was to determine the medium term effect of service-learning program or "Grassroots on Work" extension program to civic responsibility of AB Political Science students. Methodology: This study employed an impact evaluation research design and both qualitative and quantitative. The data on goals and…

Exploring the Level of Evidence of Impact Collected through Program Evaluation by Cooperative Extension as Published in the "Journal of Extension"

ERIC Educational Resources Information Center

Workman, Jeffrey Dale

2010-01-01

Documenting evidence of impact demonstrates that organizations and programs are making a difference and/or accomplishing something positive. The results of a program must ultimately change people's attitudes or behavior, or benefit society in other ways (Diem, 1997). As competition increases and the availability of financial resources decreases,…

The Impact of a Community-Based Comprehensive Sex Education Program on Chinese Adolescents' Sex-Related Knowledge and Attitudes

ERIC Educational Resources Information Center

Wang, Bo; Meier, Ann; Shah, Iqbal; Li, Xiaoming

2006-01-01

The purpose of this study was to evaluate a community-based comprehensive sex education program among unmarried youth in China. The impact of the intervention on sexual knowledge, attitudes, and sexual initiation were assessed, using a pre-test post-test quasi-experimental research design. The program used six methods for providing sex-related…

The development of a parenting program for incarcerated mothers in Australia: a review of prison-based parenting programs.

PubMed

Newman, Claire; Fowler, Cathrine; Cashin, Andrew

2011-08-01

The increasing population of children with an incarcerated parent is a significant public health issue. A literature search highlighted that children of incarcerated parents experience psychological stressors that may potentially impact on health and behavioural outcomes. Parenting programs for prisoners may be of benefit as early parenting experiences during childhood have a significant impact on a child's future experiences as an adolescent and adult. A review of identified evaluation-based studies of parenting programs for prisoners (N = 11), although varied in program delivery approaches and evaluation methods, suggest that such programs have the potential to improve the parenting skills, knowledge and confidence of incarcerated parents. Finally, this paper provides an outline of the development of an Australian based parenting program for incarcerated mothers and their young children.

Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches.

PubMed

Champagne, François; Lemieux-Charles, Louise; Duranceau, Marie-France; MacKean, Gail; Reay, Trish

2014-05-02

The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change. We conducted a theory-driven evaluation of the organizational impact of healthcare leaders' participation in two training programs using a logic model based on Nonaka's theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed. We found that the impact of training could primarily be felt in trainees' immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members. Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence--both positive and negative--of specific organizational factors on extending the impact of training programs.

GWERD CAFO Research Program – CAFO Impacts on Ground Water Quality

EPA Science Inventory

An overview of several projects will be presented on a research program currently underway at ORD’s Ground Water and Ecosystems Restoration Division (GWERD) to evaluate CAFO impacts on ground water quality. The overall research objectives are to characterize the potential for gro...

The COMPASS study: a longitudinal hierarchical research platform for evaluating natural experiments related to changes in school-level programs, policies and built environment resources.

PubMed

Leatherdale, Scott T; Brown, K Stephen; Carson, Valerie; Childs, Ruth A; Dubin, Joel A; Elliott, Susan J; Faulkner, Guy; Hammond, David; Manske, Steve; Sabiston, Catherine M; Laxer, Rachel E; Bredin, Chad; Thompson-Haile, Audra

2014-04-08

Few researchers have the data required to adequately understand how the school environment impacts youth health behaviour development over time. COMPASS is a prospective cohort study designed to annually collect hierarchical longitudinal data from a sample of 90 secondary schools and the 50,000+ grade 9 to 12 students attending those schools. COMPASS uses a rigorous quasi-experimental design to evaluate how changes in school programs, policies, and/or built environment (BE) characteristics are related to changes in multiple youth health behaviours and outcomes over time. These data will allow for the quasi-experimental evaluation of natural experiments that will occur within schools over the course of COMPASS, providing a means for generating "practice based evidence" in school-based prevention programming. COMPASS is the first study with the infrastructure to robustly evaluate the impact that changes in multiple school-level programs, policies, and BE characteristics within or surrounding a school might have on multiple youth health behaviours or outcomes over time. COMPASS will provide valuable new insight for planning, tailoring and targeting of school-based prevention initiatives where they are most likely to have impact.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

NASA Technical Reports Server (NTRS)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

NASA Astrophysics Data System (ADS)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-09-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM: TECHNOLOGY WITH AN IMPACT

EPA Science Inventory

SITE promotes the development and implementation of innovative technologies for remediating hazardous waste sites and for evaluating the nature and extent of hazardous waste site contamination through four component segments. The SITE Program is a key element in EPA's efforts...

Evaluation of the German-American Partnership Program between Madison Public Schools and Neutorschule of Mainz, Federal Republic of Germany.

ERIC Educational Resources Information Center

Grittner, Frank M.

The program evaluated here involved a two-way exchange of students and teachers from a school in Mainz and two high schools in Madison, Wisconsin. Homestay and cultural touring were outstanding aspects of the program. To measure the impact of the program on American participants, tests and questionnaires were administered before and after the…

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

Does the Kids Cafe Program's nutrition education improve children's dietary intake? A pilot evaluation study

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the Kids Café Program (KCP) nutrition education intervention and assess its impact on children's diet quality and body mass index (BMI) percentile. An experimental design consisting of pretest-posttest comparison groups using mixed methods was used to evaluate the 6-ses...

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation summary for DMA program.

DOT National Transportation Integrated Search

2017-07-04

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Application (DMA) connected vehicle applications and Active Transportation and Demand management (ATDM)...

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation report for ATDM program.

DOT National Transportation Integrated Search

2017-07-16

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Applications (DMA) and the Active Transportation and Demand Management (ATDM) strategies. Specifically,...

Using Youth Participatory Evaluation to Improve a Bullying Prevention Program

ERIC Educational Resources Information Center

Duke, Adrienne M.; Sollie, Donna L.; Silva, Kelcie

2016-01-01

We conducted a youth participatory evaluation of a bullying prevention curriculum before the curriculum was implemented in communities. We partnered with youths from a young women leaders' program to reduce the number of lessons in an existing curriculum and determine which activities were likely to have the greatest impact. To evaluate the…

Reaching Residents of Green Communities: Evaluation of a Unique Environmental Education Program

ERIC Educational Resources Information Center

Hostetler, Mark; Swiman, Elizabeth; Prizzia, Anna; Noiseux, Krystal

2008-01-01

Often in green communities, homeowner understanding is left out of the project. We evaluated the impact of a new environmental education program installed in a green community, Town of Harmony, Florida. Consisting of educational kiosks, website, and brochure, we evaluated whether Harmony residents' environmental knowledge, attitudes, and behaviors…

Evaluation of the Albuquerque Indian School Motivational Environment Program.

ERIC Educational Resources Information Center

Hiat, Albert B.; And Others

In order to evaluate the impact of a token economy behavior modification program implemented from 1970-71 in the Albuquerque Indian School (AIS), a secondary institution, a five-member evaluation team assessed standardized test results, behavioral data, and student and staff attitudes. A battery of tests (Tennessee Self-Concept Scale, SRA…

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation summary for ATDM program.

DOT National Transportation Integrated Search

2017-07-04

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Application (DMA) connected vehicle applications and Active Transportation and Dynamic management (ATDM...

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation report for DMA program.

DOT National Transportation Integrated Search

2017-02-02

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of DMA connected vehicle applications and the active and dynamic transportation management (ATDM) strategies. The outputs (...

Evaluation of the 1985-86 Beginning Teacher Program.

ERIC Educational Resources Information Center

Feldman, H. S.

The Florida Beginning Teacher Program was evaluated in 1985-86 to determine its impact on teacher performance and to study problem areas identified in the 1984-85 evaluation. A sample of 43 beginning teachers and their support team members (a peer teacher, a building-level administrator, and one or more professional educators) completed surveys.…

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

PubMed

Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-06-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

PubMed Central

Cole, Donald C.; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-01-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners’ meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. PMID:27003730

Instructional Improvement in Maryland: Impact on Educators and Students.

ERIC Educational Resources Information Center

Roberts, Jane M. E.; Kenney, Jane L.

The impact of the School Improvement Through Instructional Process (SITIP) program in Maryland schools was evaluated. The program encourages application of research on planned change to implement one or more of four instructional models: (1) Active Teaching--emphasis on direct instruction, review and discussion of homework, individually supervised…

78 FR 47307 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-05

... obtain data on the pedagogical methods of National Guard Youth ChalleNGe program teachers. The data will be used by DoD to evaluate how differences in classroom teaching methods impact program outcomes. The... September 4, 2013. Title; Associated Form; and OMB Number: How Differences in Pedagogical Methods Impact...

An Evaluation of an Adolescent Pregnancy Prevention Program: Is "Just Say No" Enough?

ERIC Educational Resources Information Center

Christopher, F. Scott; Roosa, Mark W.

1990-01-01

Evaluated impact of abstinence promotion program targeting sixth and seventh graders. After being exposed to 6 program sessions focusing on self-esteem, communication skills, peer pressure, and teaching value that sex should be confined to marriage, only change shown by 191 participants but not by 129 controls was increase in precoital sexual…

Continuing Education for the Health Professions. Developing, Managing, and Evaluating Programs for Maximum Impact on Patient Care.

ERIC Educational Resources Information Center

Green, Joseph S., Ed.; And Others

Advice on making continuing education (CE) responsive to the practice needs of professionals in medicine, dentistry, nursing, pharmacy, allied health, and public health is provided in 16 chapters. Attention is directed to: establishing realistic goals, tailoring programs to specific needs, recruiting subject matter experts, evaluating programs and…

Demonstrating Impact through Replicable Analysis: Implications of an Evaluation of Arkansas's Expanded Food and Nutrition Education Program

ERIC Educational Resources Information Center

Phelps, Josh; Brite-Lane, Allison; Crook, Tina; Hakkak, Reza; Fuller, Serena

2017-01-01

The evaluation described in this article focused on the effectiveness of Arkansas's Extension-based Expanded Food and Nutrition Education Program (EFNEP) but demonstrates an analytic approach that may be useful across Extension programs. We analyzed data from 1,810 Arkansas EFNEP participants' entry and exit Behavior Checklists to assess…

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

ERIC Educational Resources Information Center

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

7 CFR 799.4 - Definitions.

Code of Federal Regulations, 2010 CFR

2010-01-01

... ENVIRONMENTAL POLICY ACT § 799.4 Definitions. (a) The term environmental evaluation means agency appraisal of the potential or likely environmental impacts of proposed legislation, a new program, a major change... concerns as an environmental impact statement. The environmental evaluation shall particularly focus on the...

Reengaging New York City's Disconnected Youth through Work: Implementation and Early Impacts of the Young Adult Internship Program. OPRE Report 2017-22

ERIC Educational Resources Information Center

Skemer, Melanie; Sherman, Arielle; Williams, Sonya; Cummings, Danielle

2017-01-01

This report presents implementation and early impact results from a random assignment evaluation of the Young Adult Internship Program (YAIP), a subsidized employment program for young people in New York City who have become disconnected from school and work. Operated by various provider agencies, YAIP offers disconnected youth between the ages of…

The Impact of the Social, Academic, and Moral Development Programs of an Achievable Dream on Students during Their College and University Experience

ERIC Educational Resources Information Center

Runge, Amy L.

2016-01-01

This evaluation case study explores the impact of the An Achievable Dream social, academic, and moral program on college student's performance in college. Through this study, the researcher was able to provide insight on college student and college student advocates perceptions of An Achievable Dream's social, academic, and moral program's impact…

The Impact of a Dual-Project Action Learning Program: A Case of a Large IT Manufacturing Company in South Korea

ERIC Educational Resources Information Center

Yoon, Hyung Joon; Cho, Yonjoo; Bong, Hyeon-Cheol

2012-01-01

The primary purpose of this article is to evaluate the impact of a dual-project action learning program (DPALP) conducted in South Korea. A dual-project program requires each participant to carry out both team and individual projects. Cho and Egan's [2009. Action learning research: A systematic review and conceptual framework. "Human Resource…

Model Energy Efficiency Program Impact Evaluation Guide

EPA Pesticide Factsheets

Find guidance on model approaches for calculating energy, demand, and emissions savings resulting from energy efficiency programs. It describes several standard approaches that can be used in order to make these programs more efficient.

Evaluation of the AIDS prevention street nurse program: one step at a time.

PubMed

Hilton, B Ann; Thompson, Ray; Moore-Dempsey, Laura

2009-03-01

The AIDS Prevention Street Nurse Program uses specially prepared community health nurses to focus on HIV and STD prevention with marginalized, hard-to-reach and high-risk clients within a broader context of harm reduction and health promotion. Street nurses (n=17), service providers (n=30), representatives of other HIV/STD programs in the province of British Columbia, Canada (n=5), and clients (n=32) were interviewed during an evaluation for the purpose of describing the nurses' work, the challenges the nurses' face, the fit of the program with other services, and the impact of the nurses' work.This article describes the impact of the nurses' work on clients. Impact/outcome changes reflected a progression from knowledge to behavioural levels and to major indicators of health/illness. Impact on clients included: knowing more about HIV/AIDS, their own situation, and options; receiving essential supplies to reduce harm and promote health; changing behaviour to reduce disease transmission, improve resistance, and promote health; connecting with help; feeling better about themselves and others; feeling supported; influencing others; receiving earlier attention for problems; being healthier with or without HIV; making major changes in drug use; and likely decreasing morbidity and mortality. The program was found to be clearly effective in making a positive impact on clients.

Buckle up safely (shoalhaven): a process and impact evaluation of a pragmatic, multifaceted preschool-based pilot program to increase correct use of age-appropriate child restraints.

PubMed

Hunter, Kate; Keay, Lisa; Clapham, Kathleen; Lyford, Marilyn; Brown, Julie; Bilston, Lynne; Simpson, Judy M; Stevenson, Mark; Ivers, Rebecca Q

2014-01-01

To conduct a process and impact evaluation of a multifaceted education-based pilot program targeting correct use of age-appropriate restraints in a regional setting with a high proportion of Aboriginal and Torres Strait Islander families. The program was delivered in 2010 in 3 early learning centers where 31 percent of the children were of Aboriginal and Torres Strait Islander descent. Each component of the program was assessed for message consistency and uptake. To measure program effectiveness, participating children were matched 1:1 by age, language spoken at home, and annual household income with 71 children from the control arm of a contemporaneous trial. The outcome measure in the control and program centers (a 4-category ordinal scale of restraint use) was compared using ordinal logistic regression accounting for age of the parent. Process evaluation found that though program components were delivered with a consistency of message, uptake was affected by turnover of all staff at one center and by parents experiencing difficulty in paying for subsidized restraints at each of the centers. Impact evaluation found that children from the centers receiving the program had nearly twice the odds of being in a better restraint category than children matched from the control group (adjusted odds ratio [ORadj] = 2.06, 95% confidence interval [CI], 1.09-3.90). This was a pragmatic study reflecting the real-life issues of implementing a program in preschools where 57 percent of families had a low income and turnover of staff was high. Despite these issues, impact evaluation showed that the integrated educational program showed promise in increasing correct use of age-appropriate restraints. The findings from this pilot study support the use of an integrated educational program that includes access to subsidized restraints to promote best practice child restraint use among communities that include a high proportion of Aboriginal and Torres Strait Islander families in New South Wales. Future trials in similar settings should consider offering more support in centers with high turnover of staff and offering alternative methods of payment when families experience financial difficulties in purchasing the subsidized restraints. If proven in larger trials, this approach could reduce death and injuries in child passengers in this vulnerable group.

Study protocol: incentives for increased access to comprehensive family planning for urban youth using a benefits card in Uganda. A quasi-experimental study.

PubMed

Nuwasiima, Afra; Nuwamanya, Elly; Navvuga, Patricia; Babigumira, Janet U; Asiimwe, Francis T; Lubinga, Solomon J; Babigumira, Joseph B

2017-10-27

The use of contraception is one of the most cost-effective public health interventions and has the potential to prevent about 30% of maternal and 10% of child deaths in developing countries. Voucher-based initiatives for family planning are an effective and viable means of increasing contraceptive use. In this paper, we present a protocol for a pilot study of a novel incentive, a family planning benefits card (FPBC) program to increase uptake of family planning services among urban poor youth in Uganda while leveraging private sector funding. The study employs both impact and health economic evaluation methods to assess the effect of the FPBC program. We propose a quasi-experimental study design with two separate pre- and post-samples to measure program effectiveness. The main outcome of the impact evaluation is the percentage change in the prevalence of modern contraceptive use and unmet need for contraception. We will also conduct model-based incremental cost-effectiveness and budget impact analyses. The main outcomes of the economic evaluation are the cost per enrolled youth and cost per pregnancy averted, and cost per disability-adjusted life-year (DALY) averted. We will also pilot a corporate social responsibility model of sponsorship for the FPBC program in partnership with local corporations. Budget impact analysis will examine the potential affordability of scaling up the FPBC program and the fiscal implications of this scale up to the corporate social responsibility (CSR) budgets of partner corporations, the government, and the individual taxpayer. In this study, we propose an impact and economic evaluation to establish the proof concept of using a FPBC program to increase uptake of family planning services among urban poor youth in Uganda. The results of this study will present stakeholders in Uganda and internationally with a potentially viable option for corporate-sponsored access to family planning in urban poor communities. MUREC1/7 No. 10/05-17. Registered 19th July 2017.

Evaluating Different Dimensions of Programme Effectiveness for Private Medicine Retailer Malaria Control Interventions in Kenya

PubMed Central

Abuya, Timothy O.; Fegan, Greg; Amin, Abdinasir A.; Akhwale, Willis S.; Noor, Abdisalan M.; Snow, Robert W.; Marsh, Vicki

2010-01-01

Background Private medicine retailers (PMRs) are key partners in the home management of fevers in many settings. Current evidence on effectiveness for PMR interventions at scale is limited. This study presents evaluation findings of two different programs implemented at moderate scale targeting PMRs for malaria control in the Kisii and Kwale districts of Kenya. Key components of this evaluation were measurement of program performance, including coverage, PMR knowledge, practices, and utilization based on spatial analysis. Methodology/Principal Findings The study utilized mixed quantitative methods including retail audits and surrogate client surveys based on post-intervention cross-sectional surveys in intervention and control areas and mapping of intervention outlets. There was a large and significant impact on PMR knowledge and practices of the program in Kisii, with 60.5% of trained PMRs selling amodiaquine medicines in adequate doses compared to 2.8% of untrained ones (OR; 53.5: 95% CI 6.7, 428.3), a program coverage of 69.7% targeted outlets, and a potential utilization of about 30,000 children under five. The evaluation in Kwale also indicates a significant impact with 18.8% and 2.3% intervention and control PMRs selling amodiaquine with correct advice, respectively (OR; 9.4: 95% CI 1.1, 83.7), a program coverage of 25.3% targeted outlets, and a potential utilization of about 48,000 children under five. A provisional benchmark of 7.5 km was a reasonable threshold distance for households to access PMR services. Conclusions/Significance This evaluation show that PMR interventions operationalized in the district level settings are likely to impact PMR knowledge and practices and lead to increased coverage of appropriate treatment to target populations. There is value of evaluating different dimensions of public health programs, including quality, spatial access, and implementation practice. This approach strengthens the potential contribution of pragmatic study designs to evaluating public health programs in the real world. PMID:20126620

Using Rainfall and Temperature Data in the Evaluation of National Malaria Control Programs in Africa.

PubMed

Thomson, Madeleine C; Ukawuba, Israel; Hershey, Christine L; Bennett, Adam; Ceccato, Pietro; Lyon, Bradfield; Dinku, Tufa

2017-09-01

Since 2010, the Roll Back Malaria (RBM) Partnership, including National Malaria Control Programs, donor agencies (e.g., President's Malaria Initiative and Global Fund), and other stakeholders have been evaluating the impact of scaling up malaria control interventions on all-cause under-five mortality in several countries in sub-Saharan Africa. The evaluation framework assesses whether the deployed interventions have had an impact on malaria morbidity and mortality and requires consideration of potential nonintervention influencers of transmission, such as drought/floods or higher temperatures. Herein, we assess the likely effect of climate on the assessment of the impact malaria interventions in 10 priority countries/regions in eastern, western, and southern Africa for the President's Malaria Initiative. We used newly available quality controlled Enhanced National Climate Services rainfall and temperature products as well as global climate products to investigate likely impacts of climate on malaria evaluations and test the assumption that changing the baseline period can significantly impact on the influence of climate in the assessment of interventions. Based on current baseline periods used in national malaria impact assessments, we identify three countries/regions where current evaluations may overestimate the impact of interventions (Tanzania, Zanzibar, Uganda) and three countries where current malaria evaluations may underestimate the impact of interventions (Mali, Senegal and Ethiopia). In four countries (Rwanda, Malawi, Mozambique, and Angola) there was no strong difference in climate suitability for malaria in the pre- and post-intervention period. In part, this may be due to data quality and analysis issues.

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

Impact of Standardized New Medication Education Program on Postdischarge Patients' Knowledge and Satisfaction.

PubMed

Jones, Tammie R; Coke, Lola

2016-10-01

This study, implemented on 2 medical-surgical units, evaluated the impact of a standardized, evidence-based new medication education program. Outcomes evaluated included patient postdischarge knowledge of new medication purpose and side effects, patient satisfaction with new medication, and Medicare reimbursement earn-back potential. As a result, knowledge scores for new medication purpose and side effects were high post intervention. Patient satisfaction with new medication education increased. Value-based purchasing reimbursement earn-back potential improved.

Spitting in the Ocean: Realistic Expectations of the Impact of Driver Alcohol Education and Rehabilitation Programs on the Problem of Drunk Driving.

ERIC Educational Resources Information Center

Waller, Patricia F.

Alcohol education and rehabilitation programs are widely accepted as an integral part of the enforcement of drunk driving laws; however, careful evaluations of these programs generally fail to show subsequent beneficial effects on traffic crashes. This fact is due in part to the many barriers to conducting sound program evaluations and in part to…

Program Evaluation: A Study to Evaluate the Effectiveness of Academic and Behavioral Interventions in an Alternative to out of School Suspension Program

ERIC Educational Resources Information Center

Rizzi, Lorenzo

2011-01-01

The purpose of this study was to provide insight regarding the impact that the alternative to suspension program Achievement Character Excellence (ACE) has on the students who are placed there. The study utilized four achievement indicators to track the level of improvement of students after they were placed in the ACE program and after they were…

Move Over, Richard Simmons.

ERIC Educational Resources Information Center

Liebler, Scott

1999-01-01

Evaluated a daily exercise program to determine the impact on Head Start children's physical fitness. Found that children in treatment programs improved in strength, balance, endurance, and enthusiasm. Children in comparison programs showed little physical improvement. Parent components of the program included workshops, newsletters, activity…

EPA Research Evaluating CAFO Impacts on Ground Water Quality

EPA Science Inventory

An overview of several projects will be presented on a research program currently underway at ORD’s Ground Water and Ecosystems Restoration Division (GWERD) to evaluate CAFO impacts on ground water quality. The overall research objectives are to characterize the potential for gro...

Evaluation of a Family-Centered Prevention Intervention for Military Children and Families Facing Wartime Deployments

PubMed Central

Saltzman, William R.; Woodward, Kirsten; Glover, Dorie; Leskin, Gregory A.; Bursch, Brenda; Pynoos, Robert; Beardslee, William

2012-01-01

Objectives. We evaluated the Families OverComing Under Stress program, which provides resiliency training designed to enhance family psychological health in US military families affected by combat- and deployment-related stress. Methods. We performed a secondary analysis of Families OverComing Under Stress program evaluation data that was collected between July 2008 and February 2010 at 11 military installations in the United States and Japan. We present data at baseline for 488 unique families (742 parents and 873 children) and pre–post outcomes for 331 families. Results. Family members reported high levels of satisfaction with the program and positive impact on parent–child indicators. Psychological distress levels were elevated for service members, civilian parents, and children at program entry compared with community norms. Change scores showed significant improvements across all measures for service member and civilian parents and their children (P < .001). Conclusions. Evaluation data provided preliminary support for a strength-based, trauma-informed military family prevention program to promote resiliency and mitigate the impact of wartime deployment stress. PMID:22033756

A participatory evaluation model for Healthier Communities: developing indicators for New Mexico.

PubMed Central

Wallerstein, N

2000-01-01

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline findings. The evaluation model shows the links between process, community-level system impacts, and population health changes. PMID:10968754

Crossroads Cafe Implementation Florida Evaluation.

ERIC Educational Resources Information Center

McLean, Teri

The evaluation reviews the implementation of the "Crossroads Cafe" English language instruction program in Florida, focusing on the program's management, training, and overall effectiveness as measured by its impact on adult English-as-a-Second-Language (ESL) teachers and learners. "Crossroads Cafe" is a series of videotape…

Evaluation of the COMETT Programme.

ERIC Educational Resources Information Center

Thompson, Quentin; Ambler, Mark

1990-01-01

The evaluation report of the European Community Action Programme for Education and Training for Technology (COMETT) examines COMETT program content, COMETT projects, and initial program impact. It was concluded that COMETT has alerted the educational sector and industry to benefits of cooperative training but that transnational cooperative…

Welfare Reform: DOT Has Made Progress in Implementing the Job Access Program but Has Not Evaluated the Impact. Testimony before the Committee on Transportation and Infrastructure, Subcommittee on Highways and Transit, U.S. House of Representatives.

ERIC Educational Resources Information Center

Hecker, JayEtta Z.

A series of reviews of the Department of Transportation's (DOT's) Job Access and Reverse Commute (Job Access) Program explored DOT's and grantees' challenges in implementing the Job Access program and the status of DOT's program evaluation efforts. DOT and grantees faced significant challenges in implementing the Job Access program. DOT's process…

An Empirical Comparison of Formulas Evaluating Early Intervention Program Impact on Development.

ERIC Educational Resources Information Center

Rosenberg, Steven A.; And Others

1987-01-01

The study evaluated developmental progress in three groups of infants (9-30 months) presenting Down syndrome (n=28), mild disability (n=16), or moderate/severe disabilities (n=16). To evaluate intervention impact, formulas that measure rate of development and change in rate of development were computed. Findings indicated rate change formulas were…

Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches

PubMed Central

2014-01-01

Background The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change. Methods We conducted a theory-driven evaluation of the organizational impact of healthcare leaders’ participation in two training programs using a logic model based on Nonaka’s theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed. Results We found that the impact of training could primarily be felt in trainees’ immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members. Conclusions Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence—both positive and negative—of specific organizational factors on extending the impact of training programs. PMID:24885800

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2012 CFR

2012-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2014 CFR

2014-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2013 CFR

2013-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2011 CFR

2011-01-01

... AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS GRADUATE AND POSTGRADUATE FELLOWSHIP GRANTS PROGRAM... analyze both the institutional context and the impact of any supported project. ...

Promoting Positive Family Interactions: Evaluating a Free Early Childhood Book Distribution Program

ERIC Educational Resources Information Center

Funge, Simon P.; Sullivan, Dana J.; Tarter, Kirsten

2017-01-01

The Dolly Parton Imagination Library (DPIL) program encourages reading among families of preschool children by mailing age-appropriate books, once per month, until the child reaches the age of five. An evaluation of a DPIL program in a southern state in the U.S. was conducted to assess the impact on enrolled children. Focus groups were conducted…

The Job Opportunities in the Business Sector Program: An Evaluation of Impact in Ten Standard Metropolitan Statistical Areas.

ERIC Educational Resources Information Center

Greenleigh Associates, Inc., New York, NY.

An evaluation of the Job Opportunities in the Business Sectors (JOBS) program revealed that JOBS should be continued as a Federally assisted manpower program since it has demonstrated a viable role for business in manpower training. As a result of JOBS disadvantaged, unemployed, and underemployed persons have been elevated above poverty income…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

Evaluations Backgrounder: A Summary of Formal Evaluations of Afterschool Programs' Impact on Academics, Behavior, Safety and Family Life

ERIC Educational Resources Information Center

Afterschool Alliance, 2011

2011-01-01

Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before school, afterschool and summer learning programs, is needed to keep up with the growing…

Evaluations Backgrounder: A Summary of Formal Evaluations of Afterschool Programs' Impact on Academics, Behavior, Safety and Family Life

ERIC Educational Resources Information Center

Afterschool Alliance, 2014

2014-01-01

Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before-school, afterschool and summer learning programs, is needed to keep up with the growing…

Evaluations Backgrounder: A Summary of Formal Evaluations of Afterschool Programs' Impact on Academics, Behavior, Safety and Family Life

ERIC Educational Resources Information Center

Afterschool Alliance, 2015

2015-01-01

Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before school, afterschool and summer learning programs, is needed to keep up with the growing…

Evaluations Backgrounder: "A Summary of Formal Evaluations of Afterschool Programs' Impact on Academics, Behavior, Safety and Family Life"

ERIC Educational Resources Information Center

Afterschool Alliance, 2013

2013-01-01

Afterschool programs have been operating for decades in communities across the country, and federal investment in afterschool has increased dramatically since the mid-1990s. However, even more investment in the field of afterschool, which includes before-school, afterschool and summer learning programs, is needed to keep up with the growing…

Impact of North Carolina's Early Childhood Programs and Policies on Educational Outcomes in Elementary School

ERIC Educational Resources Information Center

Dodge, Kenneth A.; Bai, Yu; Ladd, Helen F.; Muschkin, Clara G.

2017-01-01

North Carolina's Smart Start and More at Four (MAF) early childhood programs were evaluated through the end of elementary school (age 11) by estimating the impact of state funding allocations to programs in each of 100 counties across 13 consecutive years on outcomes for all children in each county-year group (n = 1,004,571; 49% female; 61%…

Effectiveness of Secondary Pregnancy Prevention Programs: A Meta-Analysis

ERIC Educational Resources Information Center

Corcoran, Jacqueline; Pillai, Vijayan K.

2007-01-01

Because subsequent pregnancy in teen parents often worsens the impact of adolescent parenting; therefore, a common goal of teenage parent programs has been to reduce repeat pregnancy. To examine the impact of this goal, a meta-analysis was conducted on 16 control-comparison group studies that evaluated the effect of teenage pregnancy and parenting…

The Impact of Selected Undergraduate Experiences on Women's Career Choice.

ERIC Educational Resources Information Center

Brown, Sylvia J.

A comparative study was conducted of women college graduates of cooperative and noncooperative programs to explore and evaluate the impact of cooperative education on the career development of college women. A total of 629 women from twenty-three institutions (twelve with cooperative education programs and eleven without) responded to the mailed…

The Impact of Chile's School Feeding Program on Education Outcomes

ERIC Educational Resources Information Center

McEwan, Patrick J.

2013-01-01

Chile operates one of the oldest and largest school feeding programs in Latin America, targeting higher-calorie meals to relatively poorer schools. This paper evaluates the impact of higher-calorie meals on the education outcomes of public, rural schools and their students. It applies a regression-discontinuity design to administrative data,…

Impact of Nursing Educational Program on Reducing or Preventing Postoperative Complications for Patients after Intracranial Surgery

ERIC Educational Resources Information Center

Elmowla, Rasha Ali Ahmed Abd; El-Lateef, Zienab Abd; El-khayat, Roshdy

2015-01-01

Intracranial surgery means any surgery performed inside the skull to treat problems in the brain and surrounding structures. Aim: Evaluate the impact of nursing educational program on reducing or preventing postoperative complications for patients after intracranial surgery. Subjects and methods: Sixty adult patients had intracranial surgery (burr…

Using Distance Learning to Impact Access of Diverse Learners to Advanced Placement Programs

ERIC Educational Resources Information Center

Fenty, Nicole S.; Allio, Andrea

2017-01-01

Distance learning has been used as one method to increase access for students who have otherwise been underrepresented in college preparatory courses like Advanced Placement (AP). This study evaluated the impact of a statewide Virtual Advanced Placement (VAP) program on access to AP courses for students from underrepresented populations. Survey…

Regression Verification Using Impact Summaries

NASA Technical Reports Server (NTRS)

Backes, John; Person, Suzette J.; Rungta, Neha; Thachuk, Oksana

2013-01-01

Regression verification techniques are used to prove equivalence of syntactically similar programs. Checking equivalence of large programs, however, can be computationally expensive. Existing regression verification techniques rely on abstraction and decomposition techniques to reduce the computational effort of checking equivalence of the entire program. These techniques are sound but not complete. In this work, we propose a novel approach to improve scalability of regression verification by classifying the program behaviors generated during symbolic execution as either impacted or unimpacted. Our technique uses a combination of static analysis and symbolic execution to generate summaries of impacted program behaviors. The impact summaries are then checked for equivalence using an o-the-shelf decision procedure. We prove that our approach is both sound and complete for sequential programs, with respect to the depth bound of symbolic execution. Our evaluation on a set of sequential C artifacts shows that reducing the size of the summaries can help reduce the cost of software equivalence checking. Various reduction, abstraction, and compositional techniques have been developed to help scale software verification techniques to industrial-sized systems. Although such techniques have greatly increased the size and complexity of systems that can be checked, analysis of large software systems remains costly. Regression analysis techniques, e.g., regression testing [16], regression model checking [22], and regression verification [19], restrict the scope of the analysis by leveraging the differences between program versions. These techniques are based on the idea that if code is checked early in development, then subsequent versions can be checked against a prior (checked) version, leveraging the results of the previous analysis to reduce analysis cost of the current version. Regression verification addresses the problem of proving equivalence of closely related program versions [19]. These techniques compare two programs with a large degree of syntactic similarity to prove that portions of one program version are equivalent to the other. Regression verification can be used for guaranteeing backward compatibility, and for showing behavioral equivalence in programs with syntactic differences, e.g., when a program is refactored to improve its performance, maintainability, or readability. Existing regression verification techniques leverage similarities between program versions by using abstraction and decomposition techniques to improve scalability of the analysis [10, 12, 19]. The abstractions and decomposition in the these techniques, e.g., summaries of unchanged code [12] or semantically equivalent methods [19], compute an over-approximation of the program behaviors. The equivalence checking results of these techniques are sound but not complete-they may characterize programs as not functionally equivalent when, in fact, they are equivalent. In this work we describe a novel approach that leverages the impact of the differences between two programs for scaling regression verification. We partition program behaviors of each version into (a) behaviors impacted by the changes and (b) behaviors not impacted (unimpacted) by the changes. Only the impacted program behaviors are used during equivalence checking. We then prove that checking equivalence of the impacted program behaviors is equivalent to checking equivalence of all program behaviors for a given depth bound. In this work we use symbolic execution to generate the program behaviors and leverage control- and data-dependence information to facilitate the partitioning of program behaviors. The impacted program behaviors are termed as impact summaries. The dependence analyses that facilitate the generation of the impact summaries, we believe, could be used in conjunction with other abstraction and decomposition based approaches, [10, 12], as a complementary reduction technique. An evaluation of our regression verification technique shows that our approach is capable of leveraging similarities between program versions to reduce the size of the queries and the time required to check for logical equivalence. The main contributions of this work are: - A regression verification technique to generate impact summaries that can be checked for functional equivalence using an off-the-shelf decision procedure. - A proof that our approach is sound and complete with respect to the depth bound of symbolic execution. - An implementation of our technique using the LLVMcompiler infrastructure, the klee Symbolic Virtual Machine [4], and a variety of Satisfiability Modulo Theory (SMT) solvers, e.g., STP [7] and Z3 [6]. - An empirical evaluation on a set of C artifacts which shows that the use of impact summaries can reduce the cost of regression verification.

Evaluation Study of "Language, Literacy, & Vocabulary!" Spring 2006 Pilot

ERIC Educational Resources Information Center

McNabb, Mary

2006-01-01

Purpose: A pilot study of the "Language, Literacy, & Vocabulary!" program was conducted by Learning Gauger, Inc., for National Geographic School Publishing, in spring 2006. The program evaluation examined the classroom adoption approaches used by participating teachers and the subsequent impact of the "Language, Literacy, &…

The Evaluation of School-Based Violence Prevention Programs: A Meta-Analysis

ERIC Educational Resources Information Center

Park-Higgerson, Hyoun-Kyoung; Perumean-Chaney, Suzanne E.; Bartolucci, Alfred A.; Grimley, Diane M.; Singh, Karan P.

2008-01-01

Background: Youth violence and related aggressive behaviors have become serious public health issues with physical, economic, social, and psychological impacts and consequences. This study identified and evaluated the characteristics of successful school-based violence prevention programs. Methods: Twenty-six randomized controlled trial (RCT),…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Regional Issue Identification and Assessment (RIIA). Volume III. Institutional barriers to developing power generation facilities in the Pacific Northwest

DOE Office of Scientific and Technical Information (OSTI.GOV)

Morris, F. A.; Sawyer, C. H.; Maxwell, J. H.

1979-10-01

The Regional Assessments Division in the US Department of Energy (DOE) has undertaken a program to assess the probable consequences of various national energy policies in regions of the United States and to evaluate the constraints on national energy policy imposed by conditions in these regions. The program is referred to as the Regional Issues Identification and Assessment (RIIA) Program. Currently the RIIA Program is evaluating the Trendlong Mid-Mid scenario, a pattern of energy development for 1985 and 1990 derived from the Project Independence Evaluation System (PIES) model. This scenario assumes a medium annual growth rate in both the nationalmore » demand for and national supply of energy. It has been disaggregated to specify the generating capacity to be supplied by each energy source in each state. Pacific Northwest Laboratory (PNL) has the responsibility for evaluating the scenario for the Federal Region 10, consisting of Alaska, Idaho, Oregon, and Washington. PNL is identifying impacts and constraints associated with realizing the scenario in a variety of categories, including air and water quality impacts, health and safety effects, and socioeconomic impacts. This report summarizes the analysis of one such category: institutional constraints - defined to include legal, organizational, and political barriers to the achievement of the scenario in the Northwest.« less

Weatherization Works II - Summary of Findings from the ARRA Period Evaluation of the U.S. Department of Energy's Weatherization Assistance Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tonn, Bruce Edward; Carroll, David; Rose, Erin M.

2015-10-01

This report presents a summary of the American Recovery and Reinvestment Act of 2009 (ARRA) evaluation of the U.S. Department of Energy s low-income Weatherization Program. This evaluation focused on the WAP Program Year 2010. The ARRA evaluation produced fourteen separate reports, including this summary. Three separate reports address the energy savings, energy cost savings, and cost effectiveness of WAP across four housing types: single family, mobile home, and large multifamily. Other reports address the environmental emissions benefits attributable to WAP, and characterize the program. Special studies were conducted to: estimate the impacts of weatherization and healthy homes interventions onmore » asthma-related Medicaid claims in a small cohort in Washington State; assess how weatherization recipients communicate their weatherization experiences to those in their social network, and assess processes implemented to defer homes for weatherization. Small studies addressed energy use in refrigerators, WAP as implemented in the U.S. territories for the first time, and weatherization s impacts on air conditioning energy savings. The national occupant survey was mined for additional insights on the impacts of weatherization on household budgets and energy behaviors post-weatherization. Lastly, the results of a survey of weatherization training centers are summarized.« less

Curriculum in the Fast Lane.

ERIC Educational Resources Information Center

Hendrix, Laura

2003-01-01

Describes the Electric Vehicle Education Program (EVEP) validated by the Georgia Department of Education and evaluated by the University of Georgia. Discusses the potential for the curriculum and training program and the program's impact on students and communities. (KHR)

Evidence of progress. Measurement of impacts of Australia's S and L program from 1990-2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lowenthal-Savy; McNeil, Michael; Harrington, Lloyd

2013-10-15

Australia first put categorical energy efficiency labels on residential appliances in the mid-1980s, and the first Minimum Energy Performance Standards (MEPS) for refrigerators was implemented in 1999. Updated in 2005, these MEPS were aligned with US 2001 levels. Considered together, these actions set Australia apart as having one of the most aggressive appliance efficiency programs in the world. For these reasons, together with good data on product sales over time, Australia represents a potentially fruitful case study for understanding the dynamics energy efficiency standards and labeling (EES and L) programs impacts on appliance markets. This analysis attempts to distinguish betweenmore » the impacts of labeling alone as opposed to MEPS, and to probe the time-dependency of such impacts. Fortunately, in the Australian case, detailed market sales data and a comprehensive registration system provides a solid basis for the empirical evaluation of these questions. This paper analyzes Australian refrigerator efficiency data covering the years 1993-2009. Sales data was purchased from a commercial market research organization (in this case, the GfK Group) and includes sales and average price in each year for each appliance model – this can be used to understand broader trends by product class and star rating category, even where data is aggregated. Statistical regression analysis is used to model market introduction and adoption of high efficiency refrigerators according to logistic adoption model formalism, and parameterizes the way in which the Australian programs accelerated adoption of high-efficiency products and phased out others. Through this analysis, the paper presents a detailed, robust and quantitative picture of the impacts of EES and L in the Australian case, but also demonstrates a methodology of the evaluation of program impacts that could form the basis of an international evaluation framework for similar programs in other countries.« less

Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children. Report from the Social and Character Development Research Program. NCER 2011-2001

ERIC Educational Resources Information Center

Ruby, Allen; Doolittle, Emily

2010-01-01

The Institute of Education Sciences (IES) and the Division of Violence Prevention in the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention (CDC) collaborated to conduct a rigorous impact evaluation of programs aimed at improving students' behavior. For this evaluation, such programs were termed Social…

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

NASA Astrophysics Data System (ADS)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

Energy use in the marine transportation industry. Task III. Efficiency improvements. Draft report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1977-06-02

Research and development areas that hold promise for maritime energy conservation are identified and evaluated. The methodology used is discussed in Chapter II. The technology base of the commercial marine transportation industry relating to energy usage is made up of: main propulsion plants, propulsors, hydrodynamics, vessel operations, and fuels. Fifteen specific program areas in the first four generic technologies are identified and are evaluated. An economic and energy impact analysis and technological risk assessment was performed on the specific program areas and the results are summarized in Chapter III. The first five appendices address the generic technologies. The sixth appendixmore » contains the baseline operating and cost parameters against which the 15 program areas were evaluated, and the last appendix contains sample printouts of the MTEM model used to evaluate the energy consumption and economic impacts associated with the candidate technology areas. (MCW)« less

Estimates of External Validity Bias When Impact Evaluations Select Sites Nonrandomly

ERIC Educational Resources Information Center

Bell, Stephen H.; Olsen, Robert B.; Orr, Larry L.; Stuart, Elizabeth A.

2016-01-01

Evaluations of educational programs or interventions are typically conducted in nonrandomly selected samples of schools or districts. Recent research has shown that nonrandom site selection can yield biased impact estimates. To estimate the external validity bias from nonrandom site selection, we combine lists of school districts that were…

"Cooking and Active Leisure" TAS Program, Spain: a Program Impact Pathways (PIP) analysis.

PubMed

Roura, Elena; Pareja, Sara Lucía; Milá, Raimon; Cinca, Núria

2014-09-01

The "Cooking and Active Leisure" Tu y Alícia por la Salud (CAL-TAS) Program is a school-based pilot that addresses healthy lifestyle needs of Spanish secondary school students with initiatives that research has proven to improve dietary and physical activity behaviors. The objectives were to perform a Program Impact Pathways (PIP) analysis to describe key activities and processes of the CAL-TAS Program, identify Critical Quality Control Points (CCPs), and identify a suite of common indicators of healthy lifestyles to be applied across participant schools. The CAL-TAS Program designers and implementation team developed this PIP analysis through an iterative process and presented the results for feedback at the seven-country Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. The team identified three PIP CCPs: teachers' motivation and training, changes in students' knowledge of healthy lifestyles, and changes in students' healthy lifestyle behavior. The selected indicators of the program's impact on healthy lifestyles are adequacy of food intake, level of knowledge of healthy lifestyles gained, and adequacy of physical activity level according to World Health Organization recommendations. A clear definition of impact indicators, as well as collection of accurate data on healthy lifestyle behaviors and knowledge, is essential to understanding the effectiveness of this program before it can be scaled up. CAL-TAS is an effective secondary school-based program encouraging healthy lifestyles. The PIP analysis was instrumental in identifying CCPs to sustain and improve the quality of the program. The team hopes to sustain and improve the program through these program evaluation recommendations.

A Process Evaluation of Project Developmental Continuity. Interim Report IV, Volume I: Pilot Year Impact Study--Instrument Characteristics and Attrition Trends.

ERIC Educational Resources Information Center

Granville, Arthur C.; And Others

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

Assessment of Program Impact Through First Grade, Volume V: Impact on Children. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Berrueta-Clement, John; And Others

Fifth in a series of six volumes reporting outcomes of the preliminary evaluation of an educational intervention, this report presents the findings of the effects of Project Developmental Continuity (PDC) up to the time the evaluation study's cohort of children completed grade 1. Preliminary findings concerning the relationship between variables…

Evaluation of the safety benefits of the risk awareness and perception training program for novice teen drivers.

DOT National Transportation Integrated Search

2016-01-01

This project evaluated the impact of the PC-based Risk Awareness and Perception Training (RAPT) program on young driver crashes and traffic violations. Young drivers 16 to 18 years of age were recruited immediately after they passed the on-road drivi...

A National Survey of Undergraduate Teaching in Obstetrics and Gynecology.

ERIC Educational Resources Information Center

And Others; Stenchever, Morton A.

1979-01-01

A survey of academic departments of obstetrics and gynecology was designed to assess undergraduate educational programs and the impact of efforts made to improve teaching in the specialty. It focuses on instructional patterns, the clinical clerkship, student evaluation, and program administration and evaluation. Prior surveys are noted.…

76 FR 14396 - Agency Information Collection Request; 60-Day Public Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-16

... within 60-days. Proposed Project: Evaluation of Adolescent Pregnancy Prevention Approaches (PPA) and the Impact Evaluation of the Teen Pregnancy Prevention Program Grantees: First Follow-up Data Collection--OMB No. OS-0990--NEW--Office of Adolescent Pregnancy Programs. Abstract: The Office of Adolescent Health...

Evaluation of the Navy Master Planning Program

DTIC Science & Technology

1976-05-01

34The most clear-cut evidence of the primitive state of federal self -evaluation lies in the widespread failure of agencies even to spell out program...the appropriate boxes and weight the respose , ŕ" to ř", depending on relative impact of the item selected). 1) change in installation mission

Pilot Evaluation of a Walking School Bus Program in a Low-Income Urban Community

USDA-ARS?s Scientific Manuscript database

To evaluate the impact of a walking school bus (WSB) program on the proportion of students walking to school in a low-income, urban neighborhood, we conducted a controlled, quasi-experimental trial in urban, socioeconomically disadvantaged, public elementary schools (one intervention and two control...

Pilot evaluation of a walking school bus program in a low-income, urban community

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the impact of a walking school bus (WSB) program on student transport in a low-income, urban neighborhood. The design was a controlled, quasi-experimental trial with consecutive cross-sectional assessments. The setting was three urban, socioeconomically disadvantaged, p...

A Final Report for the Evaluation of the Achieve3000 Programs

ERIC Educational Resources Information Center

Shannon, Lisa; Grant, Billie-Jo

2015-01-01

Achieve3000 publishes a number of online literacy programs that differentiate lessons and activities based on student performance. Magnolia Consulting--an independent, third party evaluation firm--assessed Achieve3000 Solutions' impact on student learning during the 2014-15 school year. The researchers used a randomized control trial, where…

Alternative Transportation Program, P.L. 94-142. 1985-86 Evaluation Report.

ERIC Educational Resources Information Center

Case, Elizabeth J.; Bouchard, Donald

Overall effectiveness and impact were evaluated for the Alternative Transportation Program (ATP) of the Albuquerque (New Mexico) Public Schools, funded under Public Law 94-142, the Education for All Handicapped Children Act. Two specialists implemented the ATP, which developed and presented curricula and assemblies tailored to handicapped students…

Participatory Monitoring and Evaluation--A Prototype Internal Learning System for Livelihood and Micro-Credit Programs.

ERIC Educational Resources Information Center

Noponen, Helzi

1997-01-01

An internal learning system (ILS), created for a development organization operating savings/credit programs with poor women, is used for data collection, monitoring, and evaluation. The ILS is participatory, pictorial, decentralized, and flexible; it documents socioeconomic impact and supports action planning. (SK)

Aggregating Case Study Data in Customer Service Training.

ERIC Educational Resources Information Center

Barrington, Gail V.

An evaluation was conducted to determine the outcomes and impacts of participation in the ALBERTA BEST training program in terms of participant attitudes toward service excellence and business profitability. ALBERTA BEST is a customer service program offered by the Alberta (Canada) government. The evaluation involved a series of case studies…

What Peer Mentoring Adds to Already Good Patient Care: Implementing the Carpeta Roja Peer Mentoring Program in a Well-Resourced Health Care System.

PubMed

Knox, Lyndee; Huff, Jessica; Graham, Deborah; Henry, Michelle; Bracho, America; Henderson, Cynthia; Emsermann, Caroline

2015-08-01

The purpose of this study was to evaluate the impact of a peer support program on the health outcomes of patients already receiving well-organized, comprehensive diabetes care. We used a mixed-methods, nonrandomized, control-group design to evaluate the impact of a peer-mentoring program on the health outcomes and self-management behaviors of adults with type 2 diabetes in 15 primary care practices in San Antonio. Propensity score analysis, t-tests, and multivariable repeated analyses were used to evaluate impact. Qualitative interviews were conducted with 15 participants in the intervention group and analyzed using a grounded theory approach. Both intervention and control groups showed significant improvement on all health indicators from baseline to 6-month follow-up (P<.001). Hemoglobin A1c (HbA1c) decreased slightly faster for patients in the intervention group (P=.04). Self-management behaviors improved significantly from baseline to 6-month follow-up for the intervention group. Interviewed participants also reported reductions in social isolation and extension of impact of health behavior changes to multiple generations of family members. The addition of peer mentoring to already well-organized comprehensive diabetes care does not improve outcomes. However, findings suggest that the impact of the program extends to members of the participants' families, which is an intriguing finding that deserves further study. © 2015 Annals of Family Medicine, Inc.

Health Mentor-Reported Outcomes and Perceptions of Student Team Performance in a Longitudinal Interprofessional Education Program.

PubMed

Umland, Elena; Collins, Lauren; Baronner, Ashley; Lim, Edwin; Giordano, Carolyn

2016-01-01

The need to evaluate the impact of interprofessional education (IPE) on learner outcomes is clear, but assessment of IPE's impact on patient health and well-being is lacking. This mixed-methods study evaluated perspectives of community volunteers, health mentors (HMs) who have at least one chronic condition, who participated in an IPE curriculum. In May 2014, 93 HMs concluding the Health Mentors Program completed a survey evaluating their student teams according to the Interprofessional Education Collaborative core competencies' four domains and program impact on health/wellbeing using a 4-point Likert scale (1=strongly disagree; 4=strongly agree). The average response to statements regarding the four domains of values/ethics, roles/responsibilities, communication, and teamwork statements were all >3.0. HMs rated program satisfaction on a 10-point scale (1=least satisfied, 10=most satisfied) and answered open-ended outcome questions. The average program satisfaction score was 9.13±1.43; increased motivation to make and maintain healthy behaviors was reported. In a follow-up focus group with 10 mentors, high satisfaction levels from working with interprofessional student teams were reported, and substantial improvements in managing health conditions and improving overall health status were relayed. Further studies will determine if the patient-reported outcomes of the mentors correlate with objective health measures.

A Critical Meta-Analysis of All Evaluations of State-Funded Preschool from 1977 to 1998: Implications for Policy, Service Delivery and Program Evaluation.

ERIC Educational Resources Information Center

Gilliam, Walter S.; Zigler, Edward F.

2000-01-01

Presents a meta-analytic review of evaluations of state-funded preschool programs over 20 years. Identifies several methodological flaws but also suggests that pattern of findings offers modest support for positive impact in improving children's developmental competence, improving later school attendance and performance, and reducing subsequent…

Evaluating the Impact of a Summer Dropout Prevention Program for Incoming Freshmen Attending an Under-Resourced High School

ERIC Educational Resources Information Center

Vera, Elizabeth; Shriberg, David; Alves, Alison; de Oca, Jessie Montes; Reker, Kassandra; Roche, Meghan; Salgado, Manuel; Stegmaier, Jessica; Viellieu, Lindsay; Karahalios, Vicky; Knoll, Michael; Adams, Kristen; Diaz, Yahaira; Rau, Ellen

2016-01-01

Low high school completion rates are an ongoing challenge for educators. This study provides the results of an evaluation of a ninth-grade summer transition program offered at a large public school with a high freshman dropout rate. The evaluation consisted of preprogram and postprogram surveys and interviews with 64 incoming freshman…

Use of program logic models in the Southern Rural Access Program evaluation.

PubMed

Pathman, Donald; Thaker, Samruddhi; Ricketts, Thomas C; Albright, Jennifer B

2003-01-01

The Southern Rural Access Program (SRAP) evaluation team used program logic models to clarify grantees' activities, objectives, and timelines. This information was used to benchmark data from grantees' progress reports to assess the program's successes. This article presents a brief background on the use of program logic models--essentially charts or diagrams specifying a program's planned activities, objectives, and goals--for evaluating and managing a program. It discusses the structure of the logic models chosen for the SRAP and how the model concept was introduced to the grantees to promote acceptance and use of the models. The article describes how the models helped clarify the program's objectives and helped lead agencies plan and manage the many program initiatives and subcontractors in their states. Models also provided a framework for grantees to report their progress to the National Program Office and evaluators and promoted the evaluators' visibility and acceptance by the grantees. Program logics, however, increased grantees' reporting requirements and demanded substantial time of the evaluators. Program logic models, on balance, proved their merit in the SRAP through their contributions to its management and evaluation and by providing a better understanding of the program's initiatives, successes, and potential impact.

Evaluation of Demonstrations of National School Lunch Program and School Breakfast Program Direct Certification of Children Receiving Medicaid Benefits: Access Evaluation Report

ERIC Educational Resources Information Center

Hulsey, Lara; Gordon, Anne; Leftin, Joshua; Beyler, Nicholas; Schirm, Allen; Smither-Wulsin, Claire; Crumbley, Will

2015-01-01

This report presents findings from the Access Evaluation, a study component that is designed to assess the potential impacts of direct certification-Medicaid (DC-M) on students' access to free school meals by conducting retrospective simulations of DC-M in school year 2011-2012, the year before the demonstration began. For the Access Evaluation,…

A program wide framework for evaluating data driven teaching and learning - earth analytics approaches, results and lessons learned

NASA Astrophysics Data System (ADS)

Wasser, L. A.; Gold, A. U.

2017-12-01

There is a deluge of earth systems data available to address cutting edge science problems yet specific skills are required to work with these data. The Earth analytics education program, a core component of Earth Lab at the University of Colorado - Boulder - is building a data intensive program that provides training in realms including 1) interdisciplinary communication and collaboration 2) earth science domain knowledge including geospatial science and remote sensing and 3) reproducible, open science workflows ("earth analytics"). The earth analytics program includes an undergraduate internship, undergraduate and graduate level courses and a professional certificate / degree program. All programs share the goals of preparing a STEM workforce for successful earth analytics driven careers. We are developing an program-wide evaluation framework that assesses the effectiveness of data intensive instruction combined with domain science learning to better understand and improve data-intensive teaching approaches using blends of online, in situ, asynchronous and synchronous learning. We are using targeted online search engine optimization (SEO) to increase visibility and in turn program reach. Finally our design targets longitudinal program impacts on participant career tracts over time.. Here we present results from evaluation of both an interdisciplinary undergrad / graduate level earth analytics course and and undergraduate internship. Early results suggest that a blended approach to learning and teaching that includes both synchronous in-person teaching and active classroom hands-on learning combined with asynchronous learning in the form of online materials lead to student success. Further we will present our model for longitudinal tracking of participant's career focus overtime to better understand long-term program impacts. We also demonstrate the impact of SEO optimization on online content reach and program visibility.

Fall-to-Fall Testing versus Spring-to-Spring Testing: What Is the Impact on a Local Community's Chapter 1 Evaluation?

ERIC Educational Resources Information Center

Bushner, Diane E.

The impact of a decision by a local program under Chapter 1, the federally funded program of financial assistance to special educational needs of children, to test students fall-to-fall or spring-to-spring was studied. Students enrolled in a Chapter 1 reading program in 1988-89 were tested on a fall-to-spring basis, a spring-to-spring basis, and a…

Using Rainfall and Temperature Data in the Evaluation of National Malaria Control Programs in Africa

PubMed Central

Thomson, Madeleine C.; Ukawuba, Israel; Hershey, Christine L.; Bennett, Adam; Ceccato, Pietro; Lyon, Bradfield; Dinku, Tufa

2017-01-01

Abstract. Since 2010, the Roll Back Malaria (RBM) Partnership, including National Malaria Control Programs, donor agencies (e.g., President's Malaria Initiative and Global Fund), and other stakeholders have been evaluating the impact of scaling up malaria control interventions on all-cause under-five mortality in several countries in sub-Saharan Africa. The evaluation framework assesses whether the deployed interventions have had an impact on malaria morbidity and mortality and requires consideration of potential nonintervention influencers of transmission, such as drought/floods or higher temperatures. Herein, we assess the likely effect of climate on the assessment of the impact malaria interventions in 10 priority countries/regions in eastern, western, and southern Africa for the President's Malaria Initiative. We used newly available quality controlled Enhanced National Climate Services rainfall and temperature products as well as global climate products to investigate likely impacts of climate on malaria evaluations and test the assumption that changing the baseline period can significantly impact on the influence of climate in the assessment of interventions. Based on current baseline periods used in national malaria impact assessments, we identify three countries/regions where current evaluations may overestimate the impact of interventions (Tanzania, Zanzibar, Uganda) and three countries where current malaria evaluations may underestimate the impact of interventions (Mali, Senegal and Ethiopia). In four countries (Rwanda, Malawi, Mozambique, and Angola) there was no strong difference in climate suitability for malaria in the pre- and post-intervention period. In part, this may be due to data quality and analysis issues. PMID:28990912

Emotionally Troubled Teens' Help-Seeking Behaviors: An Evaluation of Surviving the Teens® Suicide Prevention and Depression Awareness Program

ERIC Educational Resources Information Center

Strunk, Catherine M.; Sorter, Michael T.; Ossege, Julianne; King, Keith A.

2014-01-01

Many school-based suicide prevention programs do not show a positive impact on help-seeking behaviors among emotionally troubled teens despite their being at high risk for suicide. This study is a secondary analysis of the Surviving the Teens® program evaluation to determine its effect on help-seeking behaviors among troubled youth. Results showed…

The Careers in Health and Medical Professions Program (CHAMPS): An Impact Study of a University-Based STEM+H Outreach Program

NASA Astrophysics Data System (ADS)

Wallace, Eric W.; Perry, Justin C.; Ferguson, Robert L.; Jackson, Debbie K.

2015-08-01

The present study investigated the impact of a Science, Technology, Engineering, Mathematics and Health (STEM+H) university-based pipeline program, the Careers in Health and Medical Professions Program, over the course of two summers among predominantly African-American high school students recruited from urban school districts ( N = 155). Based on a mixed methods approach, results indicated that youth made significant gains in both academic and career knowledge. Furthermore, youth generally rated the program's sessions favorably, but also rated sessions with varying levels of satisfaction. The limitations and implications for program delivery and evaluation methods among pipeline programs are discussed.

Staff Attitudes Regarding the Impact of a Therapy Dog Program on Military Behavioral Health Patients.

PubMed

Brisson, Sara; Dekker, Anthony H

Human-animal interactions in the form of animal-assisted therapy (AAT) have become common in both civilian and military health care facilities. Evidence supports AAT as a beneficial therapeutic alternative for patients with physical disabilities and psychological disorders. Few studies have been conducted in the civilian health care setting to evaluate staff attitudes regarding the impact of an AAT program on behavioral health (BH) patients. To our knowledge, no research has examined staff attitudes on the impact and effectiveness of AAT on active-duty Servicemembers in a BH program at a military facility. At the completion of a year-long AAT dog program and after institutional review board exemption, an anonymous, six-question survey was used to examine staff attitudes (n = 29) regarding the impact and continuation of the program with military BH patients. Most staff members (86%) believed the AAT dog program had a positive impact on the BH patients, including improved patient mood, greater patient relaxation, improved patient attitude toward therapy, and increased social interactions among patients. All the staff reported a desire to continue the program at the military facility. Most BH staff thought the year-long AAT dog program had a positive impact on patients. All staff supported continuation of the program. 2017.

Making quality improvement programs more effective.

PubMed

Shaw-Taylor, Yoku

2014-01-01

In the past 25 years, and as recent as 2011, all external evaluations of the Quality Improvement Organization (QIO) Program have found its impact to be small or difficult to discern. The QIO program costs about $200 million on average to administer each year to improve quality of healthcare for people of 65 years or older. The program was created to address questionable quality of care. QIOs review how care is provided based on performance measures. The paper aims to discuss these issues. In 2012, the author supported the production of quarterly reports and reviewed internal monitoring and evaluation protocols of the program. The task also required reviewing all previous program evaluations. The task involved many conversations about the complexities of the program, why impact is difficult to discern and possible ways for eventual improvement. Process flow charts were created to simulate the data life cycle and discrete event models were created based on the sequence of data collection and reporting to identify gaps in data flow. The internal evaluation uncovered data gaps within the program. The need for a system of specification rules for data conceptualization, collection, distribution, discovery, analysis and repurposing is clear. There were data inconsistencies and difficulty of integrating data from one instance of measurement to the next. The lack of good and reliable data makes it difficult to discern true impact. The prescription is for a formal data policy or data governance structure to integrate and document all aspects of the data life cycle. The specification rules for governance are exemplified by the Data Documentation Initiative and the requirements published by the Data Governance Institute. The elements are all in place for a solid foundation of the data governance structure. These recommendations will increase the value of program data. The model specifies which agency units must be included in the governance authority and the data team. The model prescribes in detail a data governance model to address gaps in the life cycle. These prescriptive measures will allow the program to integrate all of its data. Without this formal data governance structure, the QIO program will be undetermined by the persistent lack of good data for monitoring and evaluation.

THE IMPACT OF STATE LEVEL BROWNFIELDS PROGRAM PUBLIC PARTICIPATION MECHANISMS ON DISADVANTAGED COMMUNITY INVOLVEMENT IN DECISION-MAKING: A CASE COMPARISON

EPA Science Inventory

A recent EPA survey of state-level brownfields programs shows great variability among states in use of public participation tools such as public record and notice, public comment, hearing, meeting and citizen group grants. This study seeks to evaluate the impact of these tools o...

New Utrecht High School Project IMPACT. O.E.E. Evaluation Report, 1982-1983.

ERIC Educational Resources Information Center

Bulkin, Elly; Sica, Michael

Project IMPACT, a magnet program in its third and final year of funding, provided instruction in ESL and Italian language skills, as well as bilingual instruction in mathematics, social studies and typing to approximately 200 students of limited English proficiency in a Brooklyn, New York, high school. Nearly all program students were born in…

Educational Impact of a School Breakfast Programme in Rural Peru

ERIC Educational Resources Information Center

Cueto, Santiago; Chinen, Marjorie

2008-01-01

In this paper, we present data from an evaluation of the educational impact of a school breakfast program implemented in rural schools in Peru. The results showed positive effects on school attendance and dropout rates, and a differential effect of the breakfast program on multiple-grade and full-grade schools. Particularly in multiple-grade…

Sending Farmers Back to School: The Impact of Farmer Field Schools in Indonesia. World Bank Policy Research Working Paper.

ERIC Educational Resources Information Center

Feder, Gershon; Murgai, Rinku; Quizon, Jaime B.

A study evaluated the impact of Farmer Field Schools in Indonesia, an intensive participatory training program emphasizing integrated pest management. Focus was on whether program participation improved yields and reduced pesticide use among graduates and neighbors who gained knowledge through informal communications. It used a modified…

Student and Teacher Success: The Impact of Computers in Primary Grades.

ERIC Educational Resources Information Center

Drexler, Nancy Gadzuk; And Others

This paper discusses the impact of computers on student learning as reported by teachers participating in a study of a computer-based language arts instructional program for the early elementary grades--the Apple Learning Series: Early Language (ALS-EL). Although they found the program difficult to evaluate, some teachers stated that the ALS-EL…

Do Conditional Cash Transfers for Schooling Generate Lasting Benefits? A Five-Year Followup of PROGRESA/Oportunidades

ERIC Educational Resources Information Center

Behrman, Jere R.; Parker, Susan W.; Todd, Petra E.

2011-01-01

Conditional cash transfer (CCT) programs link public transfers to human capital investment in hopes of alleviating current poverty and reducing its intergenerational transmission. However, little is known about their long-term impacts. This paper evaluates longer-run impacts on schooling and work of the best-known CCT program, Mexico's…

Impact of Curriculum Training on State-Funded Prekindergarten Teachers' Knowledge, Beliefs, and Practices

ERIC Educational Resources Information Center

Breffni, Lorraine

2011-01-01

The number of state-funded prekindergarten programs continues to grow in the United States. The quality of these early childhood programs, however, often depends on the type of professional development provided. In this investigative study, an experimental pre-post causal-comparative research design was employed to evaluate the impact of an 8-week…

Resource Programs : Draft Environmental Impact Statement, Volume 2, Appendices.

DOE Office of Scientific and Technical Information (OSTI.GOV)

United States. Bonneville Power Administration.

1992-03-01

Every two years, Bonneville Power Administration (BPA) prepares a Resource Program which identifies the resource actions BPA will take to meet its obligation to serve the forecasted power requirements of its customers. The Resource Program`s Environmental Impact Statement (RPEIS) is a programmatic environmental document which will support decisions made in several future Resource Programs. Environmental documents tiered to the EIS may be prepared on a site-specific basis. The RPEIS includes a description of the environmental effects and mitigation for the various resource types available in order to evaluate the trade-offs among them. It also assesses the environmental impacts of addingmore » thirteen alternative combinations of resources to the existing power system. This report contains the appendices to the RPEIS.« less

Reaching out to high school youth: the effectiveness of a video-based antistigma program.

PubMed

Stuart, Heather

2006-09-01

To evaluate the impact on high school students of a video-based antistigma program portraying real life experiences of individuals with schizophrenia and lesson plans to guide classroom discussions and active learning. We used a pre- and posttest design to measure the short-term impact of the program on student's knowledge of schizophrenia and its treatment as well as students' self-reported socially distancing behaviours. Participants (571 students) were from 8 high schools across Canada. Following the Reaching Out antistigma program, high school students were significantly more knowledgeable and less socially distancing. Impact also varied by age group and sex. Video-based antistigma programs are comparable to programs that deliver educational messages through direct contact with individuals with mental illnesses. Video-based programs are more easily disseminated on a broad scale.

Pilot evaluation of a health promotion program for African immigrant and refugee women: the UJAMBO Program.

PubMed

Piwowarczyk, Linda; Bishop, Hillary; Saia, Kelley; Crosby, Sondra; Mudymba, Francine Tshiwala; Hashi, Nimo Ibrahim; Raj, Anita

2013-02-01

The UJAMBO Program was a series of one session group workshops with Congolese and Somali women in the United States built around a DVD using African immigrant women's stories which provided basic information about mammography, pap smears and mental health services for trauma. The current study is an evaluation of the UJAMBO program addressing the impact on participants'knowledge of these health services and their intentions to use these services.

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Evaluation of the 2012 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference: Six Month Impact on Science, Program, and Policy

PubMed Central

Goodman, David A.; Howlette, Travis; Kroelinger, Charlan D.; Law, Mark; Phillips, Donna; Jones, Jessica; Brantley, Mary D.; Fitzgerald, Maureen

2015-01-01

The 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference took place in December 2012, covering MCH science, program, and policy issues. Assessing the impact of the Conference on attendees’ work 6 months post-Conference provides information critical to understanding the impact and the use of new partnerships, knowledge, and skills gained during the Conference. Evaluation assessments, which included collection of quantitative and qualitative data, were administered at two time points: at Conference registration and 6 months post-Conference. The evaluation files were merged using computer IP address, linking responses from each assessment. Percentages of attendees reporting Conference impacts were calculated from quantitative data, and common themes and supporting examples were identified from qualitative data. Online registration was completed by 650 individuals. Of registrants, 30 % responded to the 6 month post-Conference assessment. Between registration and 6 month post-Conference evaluation, the distribution of respondents did not significantly differ by organizational affiliation. In the 6 months following the Conference, 65 % of respondents reported pursuing a networking interaction; 96 % shared knowledge from the Conference with coworkers and others in their agency; and 74 % utilized knowledge from the Conference to translate data into public health action. The Conference produced far-reaching impacts among Conference attendees. The Conference served as a platform for networking, knowledge sharing, and attaining skills that advance the work of attendees, with the potential of impacting organizational and workforce capacity. Increasing capacity could improve MCH programs, policies, and services, ultimately impacting the health of women, infants, and children. PMID:25107597

Evaluation of the 2012 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference: six month impact on science, program, and policy.

PubMed

Arellano, Danielle E; Goodman, David A; Howlette, Travis; Kroelinger, Charlan D; Law, Mark; Phillips, Donna; Jones, Jessica; Brantley, Mary D; Fitzgerald, Maureen

2014-09-01

The 18th Maternal and Child Health (MCH) Epidemiology and 22nd CityMatCH MCH Urban Leadership Conference took place in December 2012, covering MCH science, program, and policy issues. Assessing the impact of the Conference on attendees' work 6 months post-Conference provides information critical to understanding the impact and the use of new partnerships, knowledge, and skills gained during the Conference. Evaluation assessments, which included collection of quantitative and qualitative data, were administered at two time points: at Conference registration and 6 months post-Conference. The evaluation files were merged using computer IP address, linking responses from each assessment. Percentages of attendees reporting Conference impacts were calculated from quantitative data, and common themes and supporting examples were identified from qualitative data. Online registration was completed by 650 individuals. Of registrants, 30 % responded to the 6 month post-Conference assessment. Between registration and 6 month post-Conference evaluation, the distribution of respondents did not significantly differ by organizational affiliation. In the 6 months following the Conference, 65 % of respondents reported pursuing a networking interaction; 96 % shared knowledge from the Conference with co-workers and others in their agency; and 74 % utilized knowledge from the Conference to translate data into public health action. The Conference produced far-reaching impacts among Conference attendees. The Conference served as a platform for networking, knowledge sharing, and attaining skills that advance the work of attendees, with the potential of impacting organizational and workforce capacity. Increasing capacity could improve MCH programs, policies, and services, ultimately impacting the health of women, infants, and children.

Evaluation of a Passive Nature Viewing Program Set to Music.

PubMed

Cadman, Sally J

2014-09-01

Research has revealed that passive nature viewing (viewing nature scenes without actually being in nature) has many health benefits but little is known about the best method of offering this complementary modality. The purpose of this pilot program was to evaluate the impact of a passive nature viewing program set to music on stress reduction in adults living in the community. A pre- and postsurvey design along with weekly recordings of stress and relaxation levels were used to evaluate the effect of this passive nature viewing program on stress reduction. Participants watched one of three preselected nature scenes for 5 minutes a day over 1 month and rated their stress and relaxation levels weekly on a 100-mm Visual Analogue Scale before and after viewing the nature DVD. Quantitative analysis were not performed because of the less number of subjects (n = 10) completing the study. Qualitative analysis found five key categories that have an impact on program use: (a) technology, (b) personal preferences, (c) time, (d) immersion, and (e) use of the program. Holistic nurses may consider integrating patient preferences and immersion strategies in the design of future passive nature viewing programs to reduce attrition and improve success. © The Author(s) 2013.

7 CFR 799.4 - Definitions.

Code of Federal Regulations, 2014 CFR

2014-01-01

... the potential or likely environmental impacts of proposed legislation, a new program, a major change... an environmental impact statement is needed. Such appraisal shall relate to the same environmental concerns as an environmental impact statement. The environmental evaluation shall particularly focus on the...

7 CFR 799.4 - Definitions.

Code of Federal Regulations, 2013 CFR

2013-01-01

... the potential or likely environmental impacts of proposed legislation, a new program, a major change... an environmental impact statement is needed. Such appraisal shall relate to the same environmental concerns as an environmental impact statement. The environmental evaluation shall particularly focus on the...

7 CFR 799.4 - Definitions.

Code of Federal Regulations, 2011 CFR

2011-01-01

... the potential or likely environmental impacts of proposed legislation, a new program, a major change... an environmental impact statement is needed. Such appraisal shall relate to the same environmental concerns as an environmental impact statement. The environmental evaluation shall particularly focus on the...

Techno-Economic Analysis of Indian Draft Standard Levels for RoomAir Conditioners

DOE Office of Scientific and Technical Information (OSTI.GOV)

McNeil, Michael A.; Iyer, Maithili

The Indian Bureau of Energy Efficiency (BEE) finalized its first set of efficiency standards and labels for room air conditioners in July of 2006. These regulations followed soon after the publication of levels for frost-free refrigerators in the same year. As in the case of refrigerators, the air conditioner program introduces Minimum Efficiency Performance Standards (MEPS) and comparative labels simultaneously, with levels for one to five stars. Also like the refrigerator program, BEE defined several successive program phases of increasing stringency. In support of BEE's refrigerator program, Lawrence Berkeley National Laboratory (LBNL) produced an analysis of national impacts of standardsmore » in collaboration with the Collaborative Labeling and Standards Program (CLASP). That analysis drew on LBNL's experience with standards programs in the United States, as well as many other countries. Subsequently, as part of the process for setting optimal levels for air conditioner regulations, CLASP commissioned LBNL to provide support to BEE in the form of a techno-economic evaluation of air conditioner efficiency technologies. This report describes the methodology and results of this techno-economic evaluation. The analysis consists of three components: (1) Cost effectiveness to consumers of efficiency technologies relative to current baseline. (2) Impacts on the current market from efficiency regulations. (3) National energy and financial impacts. The analysis relied on detailed and up-to-date technical data made available by BEE and industry representatives. Technical parameters were used in conjunction with knowledge about air conditioner use patterns in the residential and commercial sectors, and prevailing marginal electricity prices, in order to give an estimate of per-unit financial impacts. In addition, the overall impact of the program was evaluated by combining unit savings with market forecasts in order to yield national impacts. LBNL presented preliminary results of these analyses in May 2006, at a meeting of BEEs Technical Committee for Air Conditioners. This meeting was attended by a wide array of stakeholder, including industry representatives, engineers and consumer advocates. Comments made by stakeholders at this meeting are incorporated into the final analysis presented in this report. The current analysis begins with the Rating Plan drafted by BEE in 2006, along with an evaluation of the market baseline according to test data submitted by manufacturers. MEPS, label rating levels, and baseline efficiencies are presented in Section 2. First, we compare Indian MEPS with current standards in other countries, and assess their relative stringency. Baseline efficiencies are then used to estimate the fraction of models likely to remain on the market at each phase of the program, and the impact on market-weighted efficiency levels. Section 3 deals with cost-effectiveness of higher efficiency design options. The cost-benefit analysis is grounded in technical parameters provided by industry representatives in India. This data allows for an assessment of financial costs and benefits to consumers as a result of the standards and labeling program. A Life-Cycle Cost (LCC) calculation is used to evaluate the impacts of the program at the unit level, thus providing some insight into the appropriateness of the levels chosen, and additional opportunities for further ratcheting. In addition to LCC, we also calculate payback periods, cost of conserved energy (CCE), and return on investment (ROI). Finally, Section 4 covers national impacts. This is an extension of unit level estimates in the two previous sections. Extrapolation to the national level depends on a forecast of air conditioner purchases (shipments), which we describe here. Following the cost-benefit analysis, we construct several efficiency scenarios including the BEE plan, but also considering further potential for efficiency improvement. These are combined with shipments through a stock accounting model in order to forecast air conditioner energy consumption in each scenario, and associated electricity savings and carbon emission mitigation. Finally, financial costs and savings are scaled to the national level to evaluate net fiscal benefits.« less

Evaluating the impacts of the clean cities program.

PubMed

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

Wait watchers: the application of a waiting list active management program in ambulatory care.

PubMed

de Belvis, Antonio Giulio; Marino, Marta; Avolio, Maria; Pelone, Ferruccio; Basso, Danila; Dei Tos, Gian Antonio; Cinquetti, Sandro; Ricciardi, Walter

2013-04-01

This study describes and evaluates the application of a waiting list management program in ambulatory care. Waiting list active management survey (telephone call and further contact); before and after controlled trial. Local Health Trust in Veneto Region (North-East of Italy) in 2008-09. Five hundred and one people on a 554 waiting list for C Class ambulatory care diagnostic and/or clinical investigations (electrocardiography plus cardiology ambulatory consultation, eye ambulatory consultation, carotid vessels Eco-color-Doppler, legs Eco-color-Doppler or colonoscopy, respectively). Active list management program consisting of a telephonic interview on 21 items to evaluate socioeconomic features, self-perceived health status, social support, referral physician, accessibility and patients' satisfaction. A controlled before-and-after study was performed to evaluate anonymously the overall impact on patients' self-perceived quality of care. The rate of patients with deteriorating healthcare conditions; rate of dropout; interviewed degree of satisfaction about the initiative; overall impact on citizens' perceived quality of care. 95.4% patients evaluated the initiative as useful. After the intervention, patients more likely to have been targeted with the program showed a statistically significant increase in self-reported quality of care. Positive impact of the program on some dimensions of ambulatory care quality (health status, satisfaction, willingness to remain in the queue), thus confirming the outstanding value of 'not to leave people alone' and 'not to leave them feeling themselves alone' in healthcare delivery.

The Impact of Community Violence on School-Based Research.

PubMed

Velsor-Friedrich, Barbara; Richards, Maryse; Militello, Lisa K; Dean, Kyle C; Scott, Darrick; Gross, Israel M; Romeo, Edna

2015-12-01

Research conducted on youth exposure to violence has generally focused on documenting the prevalence of community violence and its emotional and behavioral implications. However, there is a dearth of information related to the impact of violence on the implementation and evaluation of community and school-based programs. This commentary examines the impact of community violence on a school-based research program. It is also a brief summary of the detrimental effects of exposure to community violence on psychological and academic functioning and health outcomes. An example of the impact of community violence on the implementation of a school-based asthma program will be addressed. Implications for school nurses will be discussed. © The Author(s) 2015.

Assessment of Program Impact Through First Grade, Volume VI: Summary of Impact on Institutions, Teachers and Classrooms, Parents and Children. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Powell, Marjorie; And Others

The final volume in a series of six evaluation reports, this document provides a summary of the results of the evaluation of Project Developmental Continuity (PDC), conducted when the evaluation study's cohort of children had completed grade 1. Begun at 15 sites in 1974 with the purpose of ensuring that disadvantaged children receive continuous…

Which Interventions Have the Greatest Effect on Student Learning in Sub-Saharan Africa? "A Meta-Analysis of Rigorous Impact Evaluations"

ERIC Educational Resources Information Center

Conn, Katharine

2014-01-01

In the last three decades, there has been a large increase in the number of rigorous experimental and quasi-experimental evaluations of education programs in developing countries. These impact evaluations have taken place all over the globe, including a large number in Sub-Saharan Africa (SSA). The fact that the developing world is socially and…

Evaluation of the economic and environmental impact of converting cropland to forest: a case study in Dunhua county, China.

PubMed

Wang, C; Ouyang, H; Maclaren, V; Yin, Y; Shao, B; Boland, A; Tian, Y

2007-11-01

The Sloping Land Conversion Program (also known as "Grain for Green" or the Upland Conversion Program) for converting cropland to forest is one of China's most ambitious environmental initiatives, and is one of the world's largest land-conservation programs with a budget of RMB 337 billion (over US$ 40 billion). Although environmental impacts have played a vital role in the general reasoning and argumentation for forest plantations, environmental impact analyses have often received less attention than economic analyses in the planning of plantation forestry projects. The overall goal of this paper is to evaluate the program's environmental impact considering the farmer's interests and the potential social benefits due to carbon sequestration in different scenarios based on household and field survey data in Dunhua County. Our findings are that: (1) in many cases, the program did not give adequate consideration to land productivity and environmental heterogeneity when selecting plots; (2) more than half of the reforestation plots were on flat cropland (slopes of less than 5 degrees ); (3) in five of the eight townships, net incomes on reforested land were substantially above or below previous crop incomes, raising questions about the efficiency of the allocation of compensation to farmers participating in the program; (4) the potential carbon co-benefit increased the NPV of the program by 5954-7009 RMB/ha. In conclusion, we recommend that more attention should be paid to the quality of reforestation programs rather than just their scale and note that consideration of potential carbon sequestration co-benefits enhances the benefits of cropland conversion programs.

CETA: Manpower Programs under Local Control.

ERIC Educational Resources Information Center

Mirengoff, William; Rindler, Lester

This document presents the final report of a study conducted by the Committee on Evaluation and Training Programs to assess the impact of CETA (Comprehensive Employment and Training Act) on manpower programs. The report examines the differences between CETA Title I programs and their predecessors and compares legislative goals with results. It…

Assessing the Impact of Planned Social Change. Occasional Paper Series, #8.

ERIC Educational Resources Information Center

Campbell, Donald T.

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

13 CFR 120.1893 - Data collections and reporting.

Code of Federal Regulations, 2010 CFR

2010-01-01

... amount of any defaults or delinquencies that occurred on the loan; (3) Demonstrate compliance with the requirements of this part; and (4) Evaluate the impact of the SISMBD Loan Program on its SBA Secondary Market... ensure compliance with the requirements of this Subpart and to evaluate the impact of the SISMBD Loan...

Measuring the Impact of a New Faculty Program Using Institutional Data

ERIC Educational Resources Information Center

Meizlish, Deborah S.; Wright, Mary C.; Howard, Joseph; Kaplan, Matthew L.

2018-01-01

This paper presents a quasi-experimental evaluation of a required, teaching-focused, new faculty program at a large research university. The study makes use of institutional data, including student evaluations of teaching and faculty participation in educational development activities, which are available on many campuses yet rarely used in…

Instructional Leadership: Using a Research Approach to Evaluate the Impact of a Reading Intervention Program

ERIC Educational Resources Information Center

O'Hare, John M.

2012-01-01

Though campus principals must take on many leadership roles, their primary responsibility is to facilitate effective teaching and learning with the overall mission of enhancing student achievement. One way to provide instructional leadership is to evaluate and select effective instructional programs that align with campus goals of improving…

Using the Wisconsin-Ohio Reference Evaluation Program (WOREP) to Improve Training and Reference Services

ERIC Educational Resources Information Center

Novotny, Eric; Rimland, Emily

2007-01-01

This article discusses a service quality study conducted in the Pennsylvania State University Libraries. The Wisconsin-Ohio Reference Evaluation Program survey was selected as a valid, standardized instrument. We present our results, highlighting the impact on reference training. A second survey a year later demonstrated that focusing on…

Becoming Adults: One-Year Impact Findings from the Youth Villages Transitional Living Evaluation

ERIC Educational Resources Information Center

Valentine, Erin Jacobs; Skemer, Melanie; Courtney, Mark E.

2015-01-01

The "Youth Villages Transitional Living Evaluation" is testing whether the "Transitional Living" program, operated by the social service organization Youth Villages, makes a difference in the lives of young people with histories of foster care or juvenile justice custody. The program, which was renamed "YVLifeSet" in…

Evaluating the Impact of Six Supplemental Nutrition Assistance Program Education Interventions on Children's At-Home Diets

ERIC Educational Resources Information Center

Williams, Pamela A.; Cates, Sheryl C.; Blitstein, Jonathan L.; Hersey, James C.; Kosa, Katherine M.; Long, Valerie A.; Singh, Anita; Berman, Danielle

2015-01-01

Background: Nutrition education in the Supplemental Nutrition Assistance Program Education (SNAP-Ed) is designed to promote healthy eating behaviors in a low-income target population. Purpose: To evaluate the effectiveness of six SNAP-Ed interventions delivered in child care centers or elementary school settings in increasing participating…

Evaluation of Child Care Subsidy Strategies: Massachusetts Family Child Care Study

ERIC Educational Resources Information Center

Collins, Ann; Goodson, Barbara; Luallen, Jeremy; Fountain, Alyssa Rulf; Checkoway, Amy

2010-01-01

This report presents findings from the Massachusetts Family Child Care study, a two-year evaluation of the impacts of an early childhood education program on providers and children in family child care. The program--"LearningGames"--is designed to train caregivers to stimulate children's cognitive, language, and social-emotional…

National Evaluation of Diversion Projects. Executive Summary.

ERIC Educational Resources Information Center

Dunford, Franklyn W.; And Others

In 1976 the Special Emphasis branch of the Office of Juvenile Justice and Delinquency Prevention made $10 million available for the development of 11 diversion programs. A national evaluation of these programs was promoted in the hope of better understanding the viability of diversion as an alternative to traditional practices. The impact of…

A Meta-Analysis of Class Sizes and Ratios in Early Childhood Education Programs: Are Thresholds of Quality Associated with Greater Impacts on Cognitive, Achievement, and Socioemotional Outcomes?

ERIC Educational Resources Information Center

Bowne, Jocelyn Bonnes; Magnuson, Katherine A.; Schindler, Holly S.; Duncan, Greg J.; Yoshikawa, Hirokazu

2017-01-01

This study uses data from a comprehensive database of U.S. early childhood education program evaluations published between 1960 and 2007 to evaluate the relationship between class size, child-teacher ratio, and program effect sizes for cognitive, achievement, and socioemotional outcomes. Both class size and child-teacher ratio showed nonlinear…

Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

ERIC Educational Resources Information Center

Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

2014-01-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…

A counterfactual impact evaluation of a bilingual program on students' grade point average at a spanish university.

PubMed

Arco-Tirado, J L; Fernández-Martín, F; Ramos-García, A M; Littvay, L; Villoria, J; Naranjo, J A

2018-06-01

This observational study intends to estimate the causal effects of an English as a Medium of Instruction (EMI) program (as predictor) on students Grade Point Average (GPA) (as outcome) at a particular University in Spain by using a Counterfactual Impact Evaluation (CIE). The need to address the crucial question of causal inferences in EMI programs to produce credible evidences of successful interventions contrasts, however, with the absence of experimental or quasi-experimental research and evaluation designs in the field. CIE approach is emerging as a methodologically viable solution to bridge that gap. The program evaluated here consisted in delivering an EMI program in a Primary Education Teacher Training Degree group. After achieving balance on the observed covariates and recreating a situation that would have been expected in a randomized experiment, three matching approaches such as genetic matching, nearest neighbor matching and Coarsened Exact Matching were used to analyze observational data from a total of 1288 undergraduate students, including both treatment and control group. Results show unfavorable effects of the bilingual group treatment condition. Potential interpretations and recommendations are provided in order to strengthen future causal evidences of bilingual education programs' effectiveness in Higher Education. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Using the RE-AIM framework to evaluate physical activity public health programs in México.

PubMed

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

Process and impact evaluation of a legal assistance and health care community partnership.

PubMed

Teufel, James A; Brown, Stephen L; Thorne, Woody; Goffinet, Diane M; Clemons, Latesha

2009-07-01

Community health partnerships have increased in popularity, but their effectiveness is often not evaluated. Through secondary data analysis, this study evaluates a program that offered access to legal services to address health-related issues, such as Medicaid reimbursement, Social Security benefits, medication coverage, and divorce. Based on the analysis reimbursements to expenditures, the health and law program appears to be cost-effective and thereby economically sustainable. The cost-effectiveness of this program increases the likelihood that it will be institutionalized and/or expanded. This program evaluation is used to exemplify how community stakeholders could partner to leverage resources to establish a sustainable community health and law program to address the needs of people living in medically underserved areas.

Evaluation of an Online Educational Program for Parents and Caregivers of Children With Food Allergies.

PubMed

Ruiz-Baqués, A; Contreras-Porta, J; Marques-Mejías, M; Cárdenas Rebollo, J M; Capel Torres, F; Ariño Pla, M N; Zorrozua Santisteban, A; Chivato, T

2018-01-01

The increasing prevalence of food allergy affects both patients and their families. Objective: The aim of this study was to evaluate the impact of an online educational program designed for parents and caregivers of children with food allergies. The program was developed by a multidisciplinary group comprising health care professionals, researchers, and expert patients under the participatory medicine model. Participants took a 2-week online educational program covering major topics in food allergy management. General knowledge about the disease, symptoms, treatment, and topics relevant to families' daily lives were evaluated. The contents included educational videos, online forums, and live video chats. A pretest/posttest questionnaire survey was used to evaluate the impact of the program. A total of 207 participants enrolled in the educational program, which was completed by 130 (62.8%). Knowledge acquisition improved significantly following participation in the program in 15 out of 30 items (50%), reaching P<.001 for 8 items (26.7%). Of the 207 participants who started the program, 139 (67.1%) visited online forums, and 27.5% attended video chats. Average overall satisfaction with the educational program was 8.78 (on a scale of 0 to 10). The results obtained show that parents improved their knowledge in all areas of food allergy. The high level of satisfaction among participants suggests that digital learning tools are effective and motivational, enabling patients to acquire appropriate knowledge and thus increasing their quality of life.

The Fiscal Impact of the Milwaukee Parental Choice Program: 2009 Update. SCDP Milwaukee Evaluation Report #7

ERIC Educational Resources Information Center

Costrell, Robert M.

2009-01-01

In February 2008, the School Choice Demonstration Project (SCDP) issued its first report on the fiscal impact of the Milwaukee Parental Choice Program (MPCP) on taxpayers in Milwaukee and the state of Wisconsin. There are two reasons to update the 2008 report. First, the figures will naturally change with the continuing growth of the voucher…

Impact of the Thinking Reader[R] Software Program on Grade 6 Reading Vocabulary, Comprehension, Strategies, and Motivation: Final Report. NCEE 2010-4035

ERIC Educational Resources Information Center

Drummond, Kathryn; Chinen, Marjorie; Duncan, Teresa Garcia; Miller, H. Ray; Fryer, Lindsay; Zmach, Courtney; Culp, Katherine

2011-01-01

"Thinking Reader" is a software program for students in Grades 5-8 that incorporates elements commonly identified in policy reports as being key components of effective adolescent literacy instruction. This evaluation of the impact of "Thinking Reader" use by Grade 6 students focused on two confirmatory research questions about…

Everyday Arts for Special Education Impact Evaluation. District 75, New York City Department of Education

ERIC Educational Resources Information Center

Horowitz, Rob

2016-01-01

The purpose of this study was to examine the impact of the Everyday Arts for Special Education (EASE) program on elementary special education students' academic achievement (reading and math) and social-emotional learning. EASE was a 5-year program providing professional development and instruction in the arts in 10 New York City special education…

Empowering Parents to Improve Education: Evidence from Rural Mexico. Impact Evaluation Series Number 4. World Bank Policy Research Working Paper 3935

ERIC Educational Resources Information Center

Gertler, Paul; Patrinos, Harry; Rubio-Codina, Marta

2006-01-01

Mexico's compensatory education program provides extra resources to primary schools that enroll disadvantaged students in highly disadvantaged rural communities. One of the most important components of the program is the school-based management intervention known as Apoyo a la Gestion Escolar, (AGEs). The impact of the AGEs is assessed on…

Assessing the Impact of the Three-Year Ohio Teen B.R.I.D.G.E.S. AmeriCorps Program.

ERIC Educational Resources Information Center

Safrit, R. Dale; Schmiesing, Ryan; King, Jeffrey E.; Villard, Judy; Wells, Betty

2003-01-01

Ohio Teen B.R.I.D.G.E.S (Building Responsibility In teen Drivers through Growth in self-Esteem and Safety) was evaluated using 12 focus groups. Program impacts included heightened awareness of vehicular safety issues among teens and communities, enhanced public speaking for youth volunteers, and meaningful leadership and volunteer opportunities…

Development of Psychosocial Scales for Evaluating the Impact of a Culinary Nutrition Education Program on Cooking and Healthful Eating

ERIC Educational Resources Information Center

Condrasky, Margaret D.; Williams, Joel E.; Catalano, Patricia Michaud; Griffin, Sara F.

2011-01-01

Objective: Develop scales to assess the impact of the "Cooking with a Chef" program on several psychosocial constructs. Methods: Cross-sectional design in which parents and caregivers were recruited from child care settings (Head Start, faith-based, public elementary schools), and cooks were recruited from church and school kitchens. Analysis…

Focus on Results: An Academic Impact Analysis of the Knowledge Is Power Program (KIPP)

ERIC Educational Resources Information Center

Online Submission, 2005

2005-01-01

The Education Policy Institute (EPI) conducted an analysis of recent academic data collected from 24 KIPP (Knowledge is Power Program) schools on behalf of the KIPP Foundation. The purpose of this study was to evaluate these data to determine whether KIPP schools have had a positive impact on the student learning of 5th-grade students as…

The Faculty Learning Outcome Assessment Framework

ERIC Educational Resources Information Center

Hurney, Carol A.; Brantmeier, Edward J.; Good, Megan R.; Harrison, Douglas; Meixner, Cara

2016-01-01

Assessment is a cyclical process within which educators construct outcomes, implement programs, assess constructs such as learning, evaluate results, and utilize results to craft stronger programs and services. Within educational and faculty development, assessment measures program impact on faculty, students, and/or institutional culture.…

Assessing the impact of microfinance programming on children: an evaluation from post-tsunami Aceh.

PubMed

Stark, Lindsay; Kassim, Nafessa; Sparling, Thalia; Buscher, Dale; Yu, Gary; Boothby, Neil

2015-04-01

This paper presents an evaluation of the long-term impact of microfinance programmes on Acehnese children during the post-tsunami recovery. The study, conducted from June to August 2010, examined the impact of microfinance programming six years after the tsunami. The sample consisted of 185 microfinance participants, with a comparison group of 192 individuals who did not participate in microfinance programmes. All respondents were parents, interviewed through a structured survey. The study used four child protection indicators-diet, health, childcare and education-in contrast to traditional repayment rate indicators. The primary results were insignificant with respect to all four child protection indicators, suggesting that, with respect to these indicators, there was no long-term difference between the impact of microfinance on beneficiaries' children and non-beneficiaries' children. These findings signify a need for microfinance actors to move beyond traditional indicators of economic success to evaluate the social changes microfinance programmes are presumed to effect. © 2015 The Author(s). Disasters © Overseas Development Institute, 2015.

Strong and healthy in Primary School Klasse2000 Program, Germany: a Program Impact Pathways (PIP) analysis.

PubMed

Dokter, Andrea; Horst, Brigitte

2014-09-01

Developing a Program Impact Pathways (PIP) diagram helps identify and clarify the key objectives, processes, activities, and evaluation indicators of school-based nutrition programs. The Mondelēz International Foundation has recently supported the development of PIP analyses for programs in seven countries around the world. The results were shared with other project organizers at a Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. The objectives were to develop the PIP assessment of the Strong and Healthy in Primary School Klasse2000 Program in order to refine the primary, secondary, and tertiary objectives of the program; identify Critical Quality Control Points (CCPs); and identify core indicators of the program's impact on healthy lifestyles. The PIP report was developed based on detailed instructions provided prior to the workshop, taking into account the Klasse2000 Program evaluation reports. The following CCPs were identified: monitoring the qualifications and motivation of teaching staff (external health promoters and schoolteachers); assessing involvement of the students' environmental influences, including families, schools, and sponsors; and assessing the children's healthy lifestyle knowledge, attitudes, and behaviors before and after program exposure. The healthy lifestyle indicators identified were children's knowledge of healthy diets and health-enhancing physical activities; the availability of healthy breakfast and snacks; the frequency of consumption of fruits, vegetables, sweetened and unsweetened drinks,fast food, and sweets, as well as attitudes toward physical activity; and the frequency and extent of physical activity in school and during free time. Body mass index (BMI) was identified as the final outcome indicator. Developing a PIP report helped to focus the objectives of the program. Identifying CCPs helped draw attention to the processes linking critical program activities. As a result, plans for the upcoming school year include conducting a PIP-informed survey of participating parents and children to gauge their satisfaction with the program.

Online Health Behavior and Disease Management Programs: Are We Ready for Them? Are They Ready for Us?

PubMed Central

Cummins, Carol O; Prochaska, James O; Prochaska, Janice M

2005-01-01

Advancing the science and practice of health promotion and disease management on the Internet requires a systematic program of research examining the population impact of such programs. With impact described as the combination of effectiveness and participation, such research needs to include the examination of the quality and effectiveness of programs that are available to the general public, as well as descriptive and predictive knowledge about population readiness to participate in such programs. There have been few studies examining the quality of interactive health behavior change (HBC) programs on the Internet, and even fewer investigations of the effectiveness of such programs. Based on the review of over 300 HBC programs on the Internet using the “5 A's” of Health Behavior Change on the Internet (HBC-I Screener), which represent standard minimum guidelines for evaluation, it appears HBC on the Internet is in the early stages of development. As health behavior change on the Internet matures from the provision of health information to meeting the requirements necessary to produce health behavior change, and as program developers take advantage of the interactive nature of the Internet, the basic screening and expanded evaluation criteria developed in this project will provide templates for both consumers and developers of programs. The second component necessary for evaluating the impact of HBC on the Internet is the extent to which the population is ready to participate in such programs. We need to move beyond a narrow focus on early adopters and produce a population perspective that includes those not ready, those getting ready, and those ready to use such programs, as well as those already participating. By understanding participation levels of such programs, and what drives this participation, the development and dissemination of practical tailored and targeted interventions can help maximize population participation in Internet programs for health behavior change. PMID:15998618

The impact of an online disease management program on medical costs among health plan members.

PubMed

Schwartz, Steven M; Day, Brian; Wildenhaus, Kevin; Silberman, Anna; Wang, Chun; Silberman, Jordan

2010-01-01

This study evaluated the economic impact of an online disease management program within a broader population health management strategy. A retrospective, quasi-experimental, cohort design evaluated program participants and a matched cohort of nonparticipants on 2003-2007 claims data in a mixed model. The study was conducted through Highmark Inc, Blue Cross Blue Shield, covering 4.8 million members in five regions of Pennsylvania. Overall, 413 online self-management program participants were compared with a matched cohort of 360 nonparticipants. The costs and claims data were measured per person per calendar year. Total payments were aggregated from inpatient, outpatient, professional services, and pharmacy payments. The costs of the online program were estimated on a per-participant basis. All dollars were adjusted to 2008 values. The online intervention, implemented in 2006, was a commercially available, tailored program for chronic condition self management, nested within the Blues on Call(SM) condition management strategy. General linear modeling (with covariate adjustment) was used. Data trends were also explored using second-order polynomial regressions. Health care costs per person per year were $757 less than predicted for participants relative to matched nonparticipants, yielding a return on investment of $9.89 for every dollar spent on the program. This online intervention showed a favorable and cost-effective impact on health care cost.

Using program impact pathways to understand and improve program delivery, utilization, and potential for impact of Helen Keller International's homestead food production program in Cambodia.

PubMed

Olney, Deanna K; Vicheka, Sao; Kro, Meng; Chakriya, Chhom; Kroeun, Hou; Hoing, Ly Sok; Talukder, Aminzzaman; Quinn, Victoria; Iannotti, Lora; Becker, Elisabeth; Roopnaraine, Terry

2013-06-01

Evidence of the impact of homestead food production programs on nutrition outcomes such as anemia and growth is scant. In the absence of information on program impact pathways, it is difficult to understand why these programs, which have been successful in increasing intake of micronutrient-rich foods, have had such limited documented impact on nutrition outcomes. To conduct a process evaluation of Helen Keller International's (HKI's) homestead food production program in Cambodia to assess whether the program was operating as planned (in terms of design, delivery, and utilization) and to identify ways in which the program might need to be strengthened in order to increase its potential for impact. A program theory framework, which laid out the primary components along the hypothesized program impact pathways, was developed in collaboration with HKI and used to design the research. Semistructured interviews and focus group discussions with program beneficiaries (n = 36 and 12, respectively), nonbeneficiaries (n = 12), and program implementers (n = 17 and 2, respectively) and observations of key program delivery points, including health and nutrition training sessions (n = 6), village model farms (n = 6), and household gardens of beneficiaries (n = 36) and nonbeneficiaries (n = 12), were conducted to assess the delivery and utilization of the primary program components along the impact pathways. The majority of program components were being delivered and utilized as planned. However, challenges with some of the key components posited to improve outcomes such as anemia and growth were noted. Among these were a gap in the expected pathway from poultry production to increased intake of eggs and poultry meat, and some weaknesses in the delivery of the health and nutrition training sessions and related improvements in knowledge among the village health volunteers and beneficiaries. Although the program has been successful in delivering the majority of the program components as planned and has documented achievements in improving household production and intake of micronutrient-rich foods, it is likely that strengthening delivery and increasing utilization of some program components would increase its potential for nutritional impacts. This research has highlighted the importance of designing a program theory framework and assessing the components that lie along the primary program impact pathways to optimize program service delivery and utilization and, in turn, potential for impact.

Evidence of Progress - Measurement of Impacts of Australia's S&L Program from 1990-2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lowenthal-Savy, Danielle; McNeil, Michael; Harrington, Lloyd

2013-09-11

Australia first put categorical energy efficiency labels on residential appliances in the mid-1980s, and the first Minimum Energy Performance Standards (MEPS) for refrigerators was implemented in 1999. Updated in 2005, these MEPS were aligned with US 2001 levels. Considered together, these actions set Australia apart as having one of the most aggressive appliance efficiency programs in the world. For these reasons, together with good data on product sales over time, Australia represents a potentially fruitful case study for understanding the dynamics energy efficiency standards and labeling (EES&L) programs impacts on appliance markets. This analysis attempts to distinguish between the impactsmore » of labeling alone as opposed to MEPS, and to probe the time-dependency of such impacts. Fortunately, in the Australian case, detailed market sales data and a comprehensive registration system provides a solid basis for the empirical evaluation of these questions. This paper analyzes Australian refrigerator efficiency data covering the years 1993-2009. Sales data was purchased from a commercial market research organization (in this case, the GfK Group) and includes sales and average price in each year for each appliance model; this can be used to understand broader trends by product class and star rating category, even where data is aggregated. Statistical regression analysis is used to model market introduction and adoption of high efficiency refrigerators according to logistic adoption model formalism, and parameterizes the way in which the Australian programs accelerated adoption of high-efficiency products and phased out others. Through this analysis, the paper presents a detailed, robust and quantitative picture of the impacts of EES&L in the Australian case, but also demonstrates a methodology of the evaluation of program impacts that could form the basis of an international evaluation framework for similar programs in other countries.« less

Green Power Partnership Program Success Metrics

EPA Pesticide Factsheets

The U.S. EPA's Green Power Partnership is a voluntary program designed to reduce the environmental impact of electricity generation by promoting renewable energy. EPA evaluates partnership metrics annually to determine progress toward programmatic goals.

A novel framework for analyzing conservation impacts: evaluation, theory, and marine protected areas.

PubMed

Mascia, Michael B; Fox, Helen E; Glew, Louise; Ahmadia, Gabby N; Agrawal, Arun; Barnes, Megan; Basurto, Xavier; Craigie, Ian; Darling, Emily; Geldmann, Jonas; Gill, David; Holst Rice, Susie; Jensen, Olaf P; Lester, Sarah E; McConney, Patrick; Mumby, Peter J; Nenadovic, Mateja; Parks, John E; Pomeroy, Robert S; White, Alan T

2017-07-01

Environmental conservation initiatives, including marine protected areas (MPAs), have proliferated in recent decades. Designed to conserve marine biodiversity, many MPAs also seek to foster sustainable development. As is the case for many other environmental policies and programs, the impacts of MPAs are poorly understood. Social-ecological systems, impact evaluation, and common-pool resource governance are three complementary scientific frameworks for documenting and explaining the ecological and social impacts of conservation interventions. We review key components of these three frameworks and their implications for the study of conservation policy, program, and project outcomes. Using MPAs as an illustrative example, we then draw upon these three frameworks to describe an integrated approach for rigorous empirical documentation and causal explanation of conservation impacts. This integrated three-framework approach for impact evaluation of governance in social-ecological systems (3FIGS) accounts for alternative explanations, builds upon and advances social theory, and provides novel policy insights in ways that no single approach affords. Despite the inherent complexity of social-ecological systems and the difficulty of causal inference, the 3FIGS approach can dramatically advance our understanding of, and the evidentiary basis for, effective MPAs and other conservation initiatives. © 2017 New York Academy of Sciences.

Measuring the Impact of Programs that Challenge the Public Stigma of Mental Illness

PubMed Central

Corrigan, Patrick W.; Shapiro, Jenessa R.

2010-01-01

Public stigma robs people with mental illnesses from rightful opportunities related to work and other important life goals. Advocates have developed anti-stigma programs meant to address the prejudice and discrimination associated with these conditions. Evidence is now needed to make sense of program impact; this paper looks at measurement issues related to stigma change. Community based participatory research is central to this research and includes the involvement of a diverse collection of stakeholders in all phases of evaluation. Investigators should be cautious about measures vis-à-vis social desirability effects and should directed by social validity of targeted audiences. Conceptual domains with some research support that correspond with assessments include behavior, penetration, psychological perspective, knowledge, and physiological/information processes. These issues are summarized as ten recommendations for evaluation of anti-stigma programs. PMID:20674114

WATERSHED BOUNDARY CONDITIONS FOR GLOBAL CHANGE IMPACT ANALYSIS

EPA Science Inventory

The US Global Change Research Program (USGCRP) studies (among other issues) the impact of global change on water quality. This field study evaluates the impact of global changes (land-use change and climate change) on source water quality. Changes in source water quality change...

Using measures of wellbeing for impact evaluation: Proof of concept developed with an Indigenous community undertaking land management programs in northern Australia.

PubMed

Larson, Silva; Stoeckl, Natalie; Jarvis, Diane; Addison, Jane; Prior, Sharon; Esparon, Michelle

2018-05-05

Combining insights from literature on the Theory of Change, Impact Evaluation, and Wellbeing, we develop a novel approach to assessing impacts. Intended beneficiaries identify and rate factors that are important to their wellbeing, their satisfaction with those factors now, and before an intervention. Qualitative responses to questions about perceived changes and causes of change are linked to quantitative data to draw inferences about the existence and/or importance of impact(s). We use data from 67 Ewamian people, in a case study relating to Indigenous land management, to provide proof of concept. 'Knowing that country is being looked after' and 'Having legal right/access to the country' were identified as important to wellbeing, with perceptions that Native Title determination, declared Indigenous Protected Area and associated land management programs have had a significant and positive impact on them. Further method testing might determine the utility of this approach in a wide range of settings.

Understanding the Mechanisms Through Which an Influential Early Childhood Program Boosted Adult Outcomes

PubMed Central

Heckman, James; Pinto, Rodrigo

2013-01-01

A growing literature establishes that high quality early childhood interventions targeted toward disadvantaged children have substantial impacts on later life outcomes. Little is known about the mechanisms producing these impacts. This paper uses longitudinal data on cognitive and personality traits from an experimental evaluation of the influential Perry Preschool program to analyze the channels through which the program boosted both male and female participant outcomes. Experimentally induced changes in personality traits explain a sizable portion of adult treatment effects. PMID:24634518

Corps of Engineers Scoping Meetings for Nationwide Permit Program Programmatic Environmental Impact Statement

EPA Pesticide Factsheets

The overall purpose of the PEIS is to review and evaluate the NWP program as a whole, to ensure that the NWP program authorizes only those activities with minimal individual and cumulative adverse environmental effects on the aquatic environment.

Federal Highway Administration Research and Technology National Household Travel Survey Program

DOT National Transportation Integrated Search

2017-08-01

This evaluation of the National Household Travel Survey (NHTS) Program addresses three key questions: 1) What is the breadth and depth of NHTS usage? 2) What impact does the NHTS Program have on policy, project, or regulatory decision making? 3) How ...

Final Report on the Study of the Impact of the Statewide Systemic Initiatives. Lessons Learned about Designing, Implementing, and Evaluating Statewide Systemic Reform. WCER Working Paper No. 2003-12

ERIC Educational Resources Information Center

Heck, Daniel J.; Weiss, Iris R.; Boyd, Sally E.; Howard, Michael N.; Supovitz, Jonathan A.

2003-01-01

This document represents the first of two volumes presented in "Study of the Impact of the Statewide Systemic Initiatives Program" (Norman L. Webb and Iris R. Weiss). In an effort to evaluate the impact of the Statewide Systemic Initiatives (SSIs) on student achievement and the lessons that could be learned from the National Science…

Overview of the Robert Wood Johnson Foundation Nurse Faculty Scholars program.

PubMed

Campbell, Jacquelyn; Ladden, Maryjoan D; McBride, Angela Barron; Cimino, Andrea; Kostas-Polston, Elizabeth; Deming, Katie

The Robert Wood Johnson Foundation Nurse Faculty Scholars program was created to address the nursing faculty shortage and thereby decrease the nursing shortage. The purpose of the study was to describe the program development, implementation, and ongoing outcome evaluation. Data on scholarly productivity, impact of research, research funding, and leadership positions were compiled, including an h-index (impact of publications) comparison with a comparison group of other interdisciplinary faculty at the same institutions of the 90 current and alumni scholars. There is evidence of the achievements of the individual scholars; however, the effect of the synergy of the multiple components of the program is difficult to capture in traditional evaluation strategies. The sense of possibility and responsibility (to the profession, to improving the health of all Americans, and to one's school of nursing and university) was a significant outcome of the program. Lessons learned from the program are important for the leadership development and retention of nursing faculty. Copyright © 2017 Elsevier Inc. All rights reserved.

Proceedings of the Annual Conference of the Association for International Agricultural and Extension Education (15th, Port of Spain, Trinidad and Tobago March 21-26, 1999).

ERIC Educational Resources Information Center

Richardson, John G., Ed.

This proceedings contains session topics: extension systems, extension programs, extension evaluation, program impacts, extension management, extension reform, experiential learning, program delivery, farming systems research, professional training and development, program strategies, teaching effectiveness, organizational leadership, extension…

The Social Context of Alcohol and Drug Education: Implications for Program Effectiveness.

ERIC Educational Resources Information Center

Weisheit, Ralph A.

1983-01-01

Argues that the design of current alcohol and drug education programs precludes their having a substantial impact on adolescent alcohol or drug use. Suggests that evaluators consider only limited aspects of these programs which leads to narrow definition of success and restricts input into program development and modification. (LLL)

Personalized Computer-Assisted Mathematics Problem-Solving Program and Its Impact on Taiwanese Students

ERIC Educational Resources Information Center

Chen, Chiu-Jung; Liu, Pei-Lin

2007-01-01

This study evaluated the effects of a personalized computer-assisted mathematics problem-solving program on the performance and attitude of Taiwanese fourth grade students. The purpose of this study was to determine whether the personalized computer-assisted program improved student performance and attitude over the nonpersonalized program.…

School Libraries and Language Skills in Indian Primary Schools: A Randomized Evaluation of the Akshara Library Program. NBER Working Paper No. 18183

ERIC Educational Resources Information Center

Borkum, Evan; He, Fang; Linden, Leigh L.

2012-01-01

We conduct a randomized evaluation of a school library program on children's language skills. We find that the program had little impact on students' scores on a language test administered 16 months after implementation. The estimates are sufficiently precise to rule out effects larger than 0.13 and 0.11 standard deviations based on the 95 and 90…

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase frommore » $3.1 billion in 2008 to $$7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources often with multiple program administrators and intended to meet multiple purposes.« less

Evaluating the Impact of an Academic Teacher Development Program: Practical Realities of an Evidence-Based Study

ERIC Educational Resources Information Center

Rathbun, Gail A.; Leatherman, Jane; Jensen, Rebecca

2017-01-01

This study aimed to assess the impact of an entire academic teacher development programme at a Midwestern masters comprehensive university in the United States over a period of five years by examining changes in teaching and student outcomes of nine randomly selected programme participants. Researchers analysed syllabi, course evaluations, grade…

A Process Evaluation of Project Developmental Continuity, Interim Report VI: Recommendations for Continuing the Impact Study.

ERIC Educational Resources Information Center

Granville, Arthur; And Others

This interim report re-examines data on instrument suitability, comparability of groups, and adequacy of sample size in Year III of the process evaluation of Project Developmental Continuity (PDC) and offers preliminary recommendations concerning the feasibility of continuing the impact study. PDC is a Head Start demonstration program aimed at…

An Impact Evaluation of the Resource Access Projects 1980-1981.

ERIC Educational Resources Information Center

Empson, Judith V.; And Others

This report presents findings of the fifth impact evaluation of Head Start's 15 Resource Access Projects (RAPs), offering data for the 1980-81 program year. RAPs are the designated liaison between Head Start grantees and state and local education systems, and they also train Head Start staff to work with handicapped children and their families.…

A Quantitative Assessment of an Outsourced Agricultural Extension Service in the Umzimkhulu District of KwaZulu-Natal, South Africa

ERIC Educational Resources Information Center

Lyne, Michael C.; Jonas, Nomonde; Ortmann, Gerald F.

2018-01-01

Purpose: This study evaluates the impact of an outsourced extension service delivered by Lima Rural Development Foundation (Lima) in the Umzimkhulu district of South Africa. The evaluation is conducted at both the household and program levels. Design/methodology/approach: Household impacts were estimated using two-stage regression with…

A National Evaluation of the Impact of State Policies on Competitive Foods in Schools

ERIC Educational Resources Information Center

Fernandes, Meenakshi M.

2013-01-01

Background: Since 2003, many states have introduced policies to improve the nutritional content and restrict the availability of competitive foods, which are foods offered outside of the National School Lunch and Breakfast Programs. This article evaluates the impact of 2 types of state-level policies on the availability of competitive foods in a…

Impact of a Pharmacy-Cardiology Collaborative Practice on Dofetilide Safety Monitoring.

PubMed

Quffa, Lieth H; Panna, Mark; Kaufmann, Michael R; McKillop, Matthew; Dietrich, Nicole Maltese; Franck, Andrew J

2017-01-01

Limited studies have been published examining dofetilide's postmarketing use and its recommended monitoring. To evaluate the impact of a collaborative pharmacy-cardiology antiarrhythmic drug (AAD) monitoring program on dofetilide monitoring. This retrospective cohort study was performed to assess if a novel monitoring program improved compliance with dofetilide-specific monitoring parameters based on the Food and Drug Administration's Risk Evaluation and Mitigation Strategy. A total of 30 patients were included in the analysis. The monitoring parameters evaluated included electrocardiogram, serum potassium, serum magnesium, and kidney function. The primary outcome evaluated was the composite of these dofetilide monitoring parameters obtained in each cohort. In the standard cohort, 245 of 352 (69.6%) monitoring parameters were completed versus 134 of 136 (98.5%) in the intervention group ( P < 0.05). A collaborative pharmacy-cardiology AAD monitoring program was associated with a significant improvement in dofetilide monitoring. This improvement could potentially translate into enhanced patient safety outcomes, such as prevention of adverse drug reactions and decreased hospitalizations.

Application of Difference-in-Difference Techniques to the Evaluation of Drought-Tainted Water Conservation Programs.

ERIC Educational Resources Information Center

Bamezai, Anil

1995-01-01

Some of the threats to internal validity that arise when evaluating the impact of water conservation programs during a drought are illustrated. These include differential response to the drought, self-selection bias, and measurement error. How to deal with these problems when high-quality disaggregate data are available is discussed. (SLD)

Evaluation of a Cardiovascular Health Program for Participants with Mental Retardation and Normal Learners

ERIC Educational Resources Information Center

Ewing, Gary; McDermott, Suzanne; Thomas-Koger, Marlo; Whitner, Wendy; Pierce, Kristen

2004-01-01

An evaluation was conducted to compare the impact of an 8-week cardiovascular disease risk reduction group teaching program for 92 individuals with mental retardation (MR; IQ less than 70) and 97 normal learners. The curriculum emphasized exercise, nutritional choices, and stress reduction. Body Mass Index (BMI; weight in kilograms, divided by…

Evaluation of CHANGE, an Involuntary Cognitive Program for High-Risk Inmates

ERIC Educational Resources Information Center

Hogan, Nancy L.; Lambert, Eric G.; Barton-Bellessa, Shannon M.

2012-01-01

Prison violence is a major concern in most correctional institutions. One intervention frequently used to reduce violent behavior is cognitive therapy. An involuntary cognitive program at a Midwestern state prison was evaluated for its impact on official misconduct. A total of 213 inmates were randomly assigned to the treatment (CHANGE) group (n =…

Guiding Math Students to Campus Services: An Impact Evaluation of the Beacon Program at South Texas College

ERIC Educational Resources Information Center

Visher, Mary; Butcher, Kristin F.; Cerna, Oscar S.

2011-01-01

This research rigorously evaluates whether a low-cost intervention can improve students' performance in developmental math. The "Beacon Mentoring Program" was developed at South Texas College by professors, administrators, and staff at the college. Surveys of students revealed that many did not have someone on campus whom they felt they…

Toward a Capacity Framework for Useful Student Learning Outcomes Assessment in College Foreign Language Programs

ERIC Educational Resources Information Center

Davis, John McEwan

2016-01-01

The educational impacts of mandated assessment in U.S. colleges is part of a growing research agenda focused on how methodologies of program evaluation best enable educators to improve teaching and learning. Accordingly, research has tried to identify the key aspects of evaluation/assessment "capacity" in college language departments…

Evaluation of Multidisciplinary Tobacco Cessation Training Program in a Large Health Care System

ERIC Educational Resources Information Center

Chen, Timothy C.; Hamlett-Berry, Kim W.; Watanabe, Jonathan H.; Bounthavong, Mark; Zillich, Alan J.; Christofferson, Dana E.; Myers, Mark G.; Himstreet, Julianne E.; Belperio, Pamela S.; Hudmon, Karen Suchanek

2015-01-01

Background: Health care professionals can have a dramatic impact by assisting patients with tobacco cessation but most have limited training. Purpose: To evaluate the effectiveness of a 4-hour tobacco cessation training program. Methods: A team of multidisciplinary health care professionals created a veteran-specific tailored version of the Rx for…

Evaluations Backgrounder: A Summary of Formal Evaluations of the Academic Impact of Afterschool Programs

ERIC Educational Resources Information Center

Afterschool Alliance, 2008

2008-01-01

Although afterschool programs for children have been operating for decades in some communities, the afterschool movement--the great national awakening to the opportunity afterschool offers--is just a few years old. As public demand for afterschool has grown, so has the demand for accountability. That is particularly true in afterschool programs…

Teaching Basic Cooking Skills: Evaluation of the North Carolina Extension "Cook Smart, Eat Smart" Program

ERIC Educational Resources Information Center

Dunn, Carolyn; Jayaratne, K. S. U.; Baughman, Kristen; Levine, Katrina

2014-01-01

Cook Smart, Eat Smart (CSES) is a 12-hour cooking school that teaches participants to prepare nutritious, delicious food using simple, healthy preparation techniques, basic ingredients, and minimal equipment. The purpose of this evaluation was to examine the impact of CSES on food preparation and meal consumption behavior. Program outcomes include…

Use of Interactive Electronic Audience Response Tools (Clickers) to Evaluate Knowledge Gained in Extension Programming

ERIC Educational Resources Information Center

Gunn, Patrick; Loy, Dan

2015-01-01

Effectively measuring short-term impact, particularly a change in knowledge resulting from Extension programming, can prove to be challenging. Clicker-based technology, when used properly, is one alternative that may allow educators to better evaluate this aspect of the logic model. While the potential interface between clicker technology and…

Evaluating the Effects of Child Savings Accounts Program Participation on Parental Well-Being

ERIC Educational Resources Information Center

Okech, David

2012-01-01

Objectives: Using baseline and second wave data, the study evaluated the impact of child savings accounts participation on parenting stress, personal mastery, and economic strain with N = 381 lower income parents who decided to join and those who did not join in a child development savings account program. Methods: Structural equation modeling for…

Practitioner Review: Engaging fathers – recommendations for a game change in parenting interventions based on a systematic review of the global evidence

PubMed Central

Panter-Brick, Catherine; Burgess, Adrienne; Eggerman, Mark; McAllister, Fiona; Pruett, Kyle; Leckman, James F

2014-01-01

Background Despite robust evidence of fathers’ impact on children and mothers, engaging with fathers is one of the least well-explored and articulated aspects of parenting interventions. It is therefore critical to evaluate implicit and explicit biases manifested in current approaches to research, intervention, and policy. Methods We conducted a systematic database and a thematic hand search of the global literature on parenting interventions. Studies were selected from Medline, Psychinfo, SSCI, and Cochrane databases, and from gray literature on parenting programs, using multiple search terms for parent, father, intervention, and evaluation. We tabulated single programs and undertook systematic quality coding to review the evidence base in terms of the scope and nature of data reporting. Results After screening 786 nonduplicate records, we identified 199 publications that presented evidence on father participation and impact in parenting interventions. With some notable exceptions, few interventions disaggregate ‘father’ or ‘couple’ effects in their evaluation, being mostly driven by a focus on the mother–child dyad. We identified seven key barriers to engaging fathers in parenting programs, pertaining to cultural, institutional, professional, operational, content, resource, and policy considerations in their design and delivery. Conclusions Barriers to engaging men as parents work against father inclusion as well as father retention, and undervalue coparenting as contrasted with mothering. Robust evaluations of father participation and father impact on child or family outcomes are stymied by the ways in which parenting interventions are currently designed, delivered, and evaluated. Three key priorities are to engage fathers and coparenting couples successfully, to disaggregate process and impact data by fathers, mothers, and coparents, and to pay greater attention to issues of reach, sustainability, cost, equity, and scale-up. Clarity of purpose with respect to gender-differentiated and coparenting issues in the design, delivery, and evaluation of parenting programs will constitute a game change in this field. PMID:24980187

Protocol for the evaluation of a quality-based pay for performance scheme in Liberia.

PubMed

Bawo, Luke; Leonard, Kenneth L; Mohammed, Rianna

2015-01-13

Improving the quality of care at hospitals is a key next step in rebuilding Liberia's health system. In order to improve the efficiency, effectiveness, and quality of care at the secondary hospital level, the country is developing a system to upgrade health worker skills and competencies, and shifting towards improved provider accountability for results, including a Graduate Medical Residency Program (GMRP) and provider accountability for improvements in quality through performance-based financing (PBF) at the hospital level. This document outlines the protocol for the impact evaluation of the hospital improvement program. The evaluation will provide an estimate of the impact of the project and investigate the mechanism for success in a way that can provide general lessons about the quality of health care in low-income countries. The evaluation aims 1) to provide the best possible estimate of program impact and 2) to quantitatively describe the changes that took place within facilities as a result of the program. In particular, the impact evaluation focuses on the changes in human resources within the hospitals. As such, we use a three-period intensive evaluation of treated and matched comparison hospitals to see how services change in treated hospitals as well as a continuous data collection effort to track the activities of individual health workers within treated hospitals. We are particularly interested in understanding how facilities met quality targets. Did they bring in new health workers with higher qualifications? Did they improve the knowledge or competence of their existing staff? Did they improve the availability of medicines and equipment so that the capacities of existing health workers were improved? Did they address the motivation of health workers so that individuals with the same competence and capacity were able to provide higher quality? And, if they did improve quality, did patients notice?

The Impact of a Holistic Conditional Cash Transfer Program in New York City on Parental Financial Investment, Student Time Use, and Educational Processes and Outcomes

ERIC Educational Resources Information Center

Aber, J. Lawrence; Morris, Pamela; Wolf, Sharon; Berg, Juliette

2016-01-01

This article examines the impacts of Opportunity New York City-Family Rewards, the first holistic conditional cash transfer (CCT) program evaluated in the United States, on parental financial investments in children, and high school students' academic time use, motivations and self-beliefs, and achievement outcomes. Family Rewards, launched by the…

Moneyball for Head Start: Using Data, Evidence, and Evaluation to Improve Outcomes for Children and Families

ERIC Educational Resources Information Center

Mead, Sara; Mitchel, Ashley LiBetti

2016-01-01

Head Start is a valuable federal program that improves the lives of our nation's most vulnerable children and their families. Research shows that Head Start programs improve children's learning at school entry and have a positive impact on long-term life outcomes. Research also suggests that Head Start could have a stronger impact on children's…

Side impact test and analysis of a DOT-112 tank car.

DOT National Transportation Integrated Search

2016-12-01

As part of a program to improve transportation safety for tank cars, Transportation Technology Center, Inc. (TTCI) has conducted a side impact test on a DOT-112 tank car to evaluate the performance of the DOT-112 under dynamic impact conditions and t...

Hood River and Pelton Ladder Evaluation Studies : Annual Report 1994.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Olsen, Erik A.; French, Rod A.; Ritchey, Alan D.

1995-09-01

In 1992, the Northwest Power Planning Council approved the Hood River and Pelton ladder master plans within the framework of the Columbia River Basin Fish and Wildlife Program. The master plans define an approach for implementing a hatchery supplementation program in the Hood River subbasin. The hatchery program as defined in the master plans is called the Hood River Hatchery Production Program (HRPP). The HRPP will be phased in over several years and will be jointly implemented by the Oregon Department of Fish and Wildlife (ODFW) and the Confederated Tribes of the Warm Springs (CTWS) Reservation. In December 1991, amore » monitoring and evaluation program was implemented in the Hood River subbasin to collect life history and production information on stocks of anadromous salmonids returning to the Hood River subbasin. The program was implemented to provide the baseline information needed to: (1) evaluate various management options for implementing the HRPP and (2) determine any post-project impacts the HRPP has on indigenous populations of resident fish. Information collected during the 1992-94 fiscal years will also be used to prepare an environmental impact statement (EIS) evaluating the program`s impact on the human environment. To begin construction on project facilities, it was proposed that the HRPP be implemented in two phases. Phase I would include work that would fall under a {open_quotes}categorical exclusion{close_quotes} from NEPA, and Phase II would include work requiring an EIS prior to implementation. This report summarizes the life history and escapement data collected in the Hood River subbasin and the status work of implemented under Phase I of the HR Life history and escapement data will be used to: (1) test the assumptions on which harvest and escapement goals for the Hood River and Pelton ladder master plans are based and (2) develop biologically based management recommendations for implementing the HRPP.« less

Growing community: the impact of the Stephanie Alexander Kitchen Garden Program on the social and learning environment in primary schools.

PubMed

Block, Karen; Gibbs, Lisa; Staiger, Petra K; Gold, Lisa; Johnson, Britt; Macfarlane, Susie; Long, Caroline; Townsend, Mardie

2012-08-01

This article presents results from a mixed-method evaluation of a structured cooking and gardening program in Australian primary schools, focusing on program impacts on the social and learning environment of the school. In particular, we address the Stephanie Alexander Kitchen Garden Program objective of providing a pleasurable experience that has a positive impact on student engagement, social connections, and confidence within and beyond the school gates. Primary evidence for the research question came from qualitative data collected from students, parents, teachers, volunteers, school principals, and specialist staff through interviews, focus groups, and participant observations. This was supported by analyses of quantitative data on child quality of life, cooperative behaviors, teacher perceptions of the school environment, and school-level educational outcome and absenteeism data. Results showed that some of the program attributes valued most highly by study participants included increased student engagement and confidence, opportunities for experiential and integrated learning, teamwork, building social skills, and connections and links between schools and their communities. In this analysis, quantitative findings failed to support findings from the primary analysis. Limitations as well as benefits of a mixed-methods approach to evaluation of complex community interventions are discussed.

Evaluation of STD/AIDS prevention programs: a review of approaches and methodologies.

PubMed

da Cruz, Marly Marques; dos Santos, Elizabeth Moreira; Monteiro, Simone

2007-05-01

The article presents a review of approaches and methodologies in the evaluation of STD/AIDS prevention programs, searching for theoretical and methodological support for the institutionalization of evaluation and decision-making. The review included the MEDLINE, SciELO, and ISI Web of Science databases and other sources like textbooks and congress abstracts from 1990 to 2005, with the key words: "evaluation", "programs", "prevention", "STD/AIDS", and similar terms. The papers showed a predominance of quantitative outcome or impact evaluative studies with an experimental or quasi-experimental design. The main use of evaluation is accountability, although knowledge output and program improvement were also identified in the studies. Only a few evaluative studies contemplate process evaluation and its relationship to the contexts. The review aimed to contribute to the debate on STD/AIDS, which requires more effective, consistent, and sustainable decisions in the field of prevention.

United States of America Ocean Dumping Report for Calendar Year 1981. Dredged Material.

DTIC Science & Technology

1982-06-01

to monitoring studies under the Disposal Area Monitoring System ( DAHOS ) program. The program is designed to identify and evaluate impacts resulting...sites. The DAHOS program continually contributes to the development of new monitoring methodologies that reflect on the efficiency of field observations

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2012 CFR

2012-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2011 CFR

2011-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2013 CFR

2013-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

29 CFR 29.6 - Program performance standards.

Code of Federal Regulations, 2014 CFR

2014-07-01

... apprenticeship programs. (1) The tools and factors to be used must include, but are not limited to: (i) Quality... rates. (2) Any additional tools and factors used by the Registration Agency in evaluating program... probationary period will not have an adverse impact on a sponsor's completion rate. ...

78 FR 26372 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-06

... Profession Opportunity Grants (HPOG) program. ACF has developed a multi-pronged research and evaluation... Opportunity Grants (HPOG-Impact). Two data collection efforts related to HPOG research were approved by OMB... collect data about the HPOG program designs and implementation, HPOG partner and program networks and...

Premium increases in state health insurance programs: lessons from a case study of the Massachusetts Medicaid buy-in program.

PubMed

Livermore, Gina A; Goodman, Nanette; Hooven, Fred; Hashemi, Lobat

In March 2003, Massachusetts increased the premiums it charges to most enrollees in its CommonHealth-Working (CH-W) program. This study evaluates the impact of the premium change on disenrollment using a comparison group methodology. The findings indicate that the premium change had only a small, but statistically significant impact on program exits. The CH-W experience differs from other state programs that saw substantial enrollment declines in response to new or increased premiums. This is likely due to factors that make CH-W different from other programs, key of which are administrative procedures intended to minimize disenrollment due to premium nonpayment.

Improving clinical and translational research training: a qualitative evaluation of the Atlanta Clinical and Translational Science Institute KL2-mentored research scholars program

PubMed Central

Comeau, Dawn L; Escoffery, Cam; Freedman, Ariela; Ziegler, Thomas R; Blumberg, Henry M

2017-01-01

A major impediment to improving the health of communities is the lack of qualified clinical and translational research (CTR) investigators. To address this workforce shortage, the National Institutes of Health (NIH) developed mechanisms to enhance the career development of CTR physician, PhD, and other doctoral junior faculty scientists including the CTR-focused K12 program and, subsequently, the KL2-mentored CTR career development program supported through the Clinical and Translational Science Awards (CTSAs). Our evaluation explores the impact of the K12/KL2 program embedded within the Atlanta Clinical and Translational Science Institute (ACTSI), a consortium linking Emory University, Morehouse School of Medicine and the Georgia Institute of Technology. We conducted qualitative interviews with program participants to evaluate the impact of the program on career development and collected data on traditional metrics (number of grants, publications). 46 combined K12/KL2 scholars were supported between 2002 and 2016. 30 (65%) of the 46 K12/KL2 scholars are women; 24 (52%) of the trainees are minorities, including 10 (22%) scholars who are members of an underrepresented minority group. Scholars reported increased research skills, strong mentorship experiences, and positive impact on their career trajectory. Among the 43 scholars who have completed the program, 39 (91%) remain engaged in CTR and received over $89 000 000 as principal investigators on federally funded awards. The K12/KL2 funding provided the training and protected time for successful career development of CTR scientists. These data highlight the need for continued support for CTR training programs for junior faculty. PMID:27591319

A program evaluation of Protovation Camp at an elementary school in North Carolina

NASA Astrophysics Data System (ADS)

Cavoly, Denise Y.

The purpose of this program evaluation was to investigate the impact over time teachers' self-efficacies and the outcome expectancies of those who participated in an inquiry-based, hands-on, constructivist professional development program to learn science content. The hope was that after active participation in this inquiry-based professional development program that provides science inquiry experiences, the teachers, graduate students and elementary students would gain content knowledge, increase self-efficacies, and provide the outcome expectancies of the learning development program that provides science inquiry experiences. The mixed-methods approach used quantitative and qualitative data for campers, which consisted of pre-test and post-test scores on the Test of Science-Related Attitudes (TOSRA), the Draw-A-Scientist Test, Science Process Skills Inventory (SPSI) and content tests based on the camp activities. Additionally, TOSRA scores, Teacher Sense of Efficacy Scale (TSES), and Thinking about Science Survey (TSSI) results for the graduate students and elementary teachers were used along with qualitative data collected from plusdelta charts and interviews to determine the impact of participation in Protovation Camp on teachers and students. Results of the program evaluation indicated that when students were taught inquiry-based lessons that ignite wonder, both their attitudes toward science and their knowledge about science improved. An implication for teacher preparation programs was that practicing inquiry-based lessons on actual elementary students was an important component for teachers and graduate students as they prepare to positively impact student learning in their own classrooms. The findings of this study suggest that it is not just the length of the professional development program that is crucial, but the need for an implementation period while teachers work to transfer the learning to the classroom to their own students is critical to the success of process.

Impact of the Kenya Cash Transfer for Orphans and Vulnerable Children on early pregnancy and marriage of adolescent girls.

PubMed

Handa, Sudhanshu; Peterman, Amber; Huang, Carolyn; Halpern, Carolyn; Pettifor, Audrey; Thirumurthy, Harsha

2015-09-01

There is promising evidence that poverty-targeted cash transfer programs can have positive impacts on adolescent transitions to adulthood in resource poor settings, however existing research is typically from small scale programs in diverse geographic and cultural settings. We provide estimates of the impact of a national unconditional cash transfer program, the Kenya Cash Transfer for Orphans and Vulnerable Children, on pregnancy and early marriage among females aged 12 to 24, four years after program initiation. The evaluation was designed as a clustered randomized controlled trial and ran from 2007 to 2011, capitalizing on the existence of a control group, which was delayed entry to the program due to budget constraints. Findings indicate that, among 1549 females included in the study, while the program reduced the likelihood of pregnancy by five percentage points, there was no significant impact on likelihood of early marriage. Program impacts on pregnancy appear to work through increasing the enrollment of young women in school, financial stability of the household and delayed age at first sex. The Kenyan program is similar in design to most other major national cash transfer programs in Eastern and Southern Africa, suggesting a degree of generalizability of the results reported here. Although the objective of the program is primarily poverty alleviation, it appears to have an important impact on facilitating the successful transition of adolescent girls into adulthood. Copyright © 2015 Elsevier Ltd. All rights reserved.

Impact of the Kenya Cash Transfer for Orphans and Vulnerable Children on early pregnancy and marriage of adolescent girls

PubMed Central

Handa, Sudhanshu; Huang, Carolyn; Halpern, Carolyn; Pettifor, Audrey; Thirumurthy, Harsha

2015-01-01

There is promising evidence that poverty-targeted cash transfer programs can have positive impacts on adolescent transitions to adulthood in resource poor settings, however existing research is typically from small scale programs in diverse geographic and cultural settings. We provide estimates of the impact of a national unconditional cash transfer program, the Kenya Cash Transfer for Orphans and Vulnerable Children, on pregnancy and early marriage among females aged 12 to 24, four years after program initiation. The evaluation was designed as a clustered randomized controlled trial and ran from 2007 to 2011, capitalizing on the existence of a control group, which was delayed entry to the program due to budget constraints. Findings indicate that, among 1,549 females included in the study, while the program reduced the likelihood of pregnancy by five percentage points, there was no significant impact on likelihood of early marriage. Program impacts on pregnancy appear to work through increasing the enrollment of young women in school, financial stability of the household and delayed age at first sex. The Kenyan program is similar in design to most other major national cash transfer programs in Eastern and Southern Africa, suggesting a degree of generalizability of the results reported here. Although the objective of the program is primarily poverty alleviation, it appears to have an important impact on facilitating the successful transition of adolescent girls into adulthood. PMID:26246032

Impact Evaluation of the U.S. Department of Energy's Solar Decathlon Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barnes, Harley

2012-12-01

This report includes the methodology and findings in evaluating DOE’s Solar Decathlon event. The primary purpose of this evaluation is to learn how effectively the Solar Decathlon event is in meeting its objectives.

Training School Personnel to Implement a Universal School-Based Prevention of Depression Program under Real-World Conditions

ERIC Educational Resources Information Center

Harnett, P.H.; Dadds, M.R.

2004-01-01

The present study evaluated the impact of a universal prevention of depression program [the Resourceful Adolescent Program (RAP)] when implemented under real-world conditions in a school setting. Prior research has found the RAP program to be beneficial for high-school students when the program was implemented by university staff selected,…

Development and Implementation of Science and Technology Ethics Education Program for Prospective Science Teachers

ERIC Educational Resources Information Center

Rhee, Hyang-yon; Choi, Kyunghee

2014-01-01

The purposes of this study were (1) to develop a science and technology (ST) ethics education program for prospective science teachers, (2) to examine the effect of the program on the perceptions of the participants, in terms of their ethics and education concerns, and (3) to evaluate the impact of the program design. The program utilized…

The Effects of the Home Instruction Program for Preschool Youngsters (HIPPY) on Children's School Performance at the End of the Program and One Year Later.

ERIC Educational Resources Information Center

Baker, Amy J. L.; Piotrkowski, Chaya S.; Brooks-Gunn, Jeanne

1998-01-01

Evaluated whether participation in HIPPY (Home Instruction Program for Preschool Youngsters) has a positive impact on young children's performance in school. Assessed 182 children at baseline, the program's end, and one year later. Interpreted findings as mixed support for the effectiveness of the HIPPY program. (JS)

Evaluation of a Five-Year Demonstration Farm Program in Two Pennsylvania Counties.

ERIC Educational Resources Information Center

Hartman, Joel A.; Brown, Emory J.

This analysis of the impact of a result demonstration educational program was made in an effort to achieve the following goals: (1) identification of the objectives of the educational program; (2) description of the program; (3) assessment of awareness of the program by target clientele; (4) measurement of the amount of change that takes place;…

Toward More Successful Biomedical Informatics Education Programs and Ecosystems in the Arab World.

PubMed

Wageih, Mohamed A; Marcano-Cedeño, Alexis; Gómez, Enrique J; Mantas, John

2015-01-01

Biomedical & Health Informatics (BMHI) is relatively new in Arab States. However, several programs/ tracks are running, with high promises of expansion. Programs are evaluated by national authorities, not by a specialized body/association. This does not always mean that the program is of an international standard. One of the possible ways of ensuring the quality of these programs is to be evaluated by international agencies. The International Medical Informatics Association (IMIA) has the expertise in the evaluation BMHI education programs. Accredited programs staffs will have the opportunities for Internationalization and to be engaged with other top-notch organizations, which will have great impacts on the overall implementations of the BMHI in the Arab World. The goal of this document is to show to Arab Universities (pilot: Egypt) how to apply for IMIA Accreditation for their programs.

Cost-Benefit Analysis of a Support Program for Nursing Staff.

PubMed

Moran, Dane; Wu, Albert W; Connors, Cheryl; Chappidi, Meera R; Sreedhara, Sushama K; Selter, Jessica H; Padula, William V

2017-04-27

A peer-support program called Resilience In Stressful Events (RISE) was designed to help hospital staff cope with stressful patient-related events. The aim of this study was to evaluate the impact of the RISE program by conducting an economic evaluation of its cost benefit. A Markov model with a 1-year time horizon was developed to compare the cost benefit with and without the RISE program from a provider (hospital) perspective. Nursing staff who used the RISE program between 2015 and 2016 at a 1000-bed, private hospital in the United States were included in the analysis. The cost of running the RISE program, nurse turnover, and nurse time off were modeled. Data on costs were obtained from literature review and hospital data. Probabilities of quitting or taking time off with or without the RISE program were estimated using survey data. Net monetary benefit (NMB) and budget impact of having the RISE program were computed to determine cost benefit to the hospital. Expected model results of the RISE program found a net monetary benefit savings of US $22,576.05 per nurse who initiated a RISE call. These savings were determined to be 99.9% consistent on the basis of a probabilistic sensitivity analysis. The budget impact analysis revealed that a hospital could save US $1.81 million each year because of the RISE program. The RISE program resulted in substantial cost savings to the hospital. Hospitals should be encouraged by these findings to implement institution-wide support programs for medical staff, based on a high demand for this type of service and the potential for cost savings.

BeHealthy Charities Aid Foundation Program, Russia: a Program Impact Pathways (PIP) analysis.

PubMed

Mukhina, Marina; Novikova, Irina

2014-09-01

In 2007, the Charities Aid Foundation Branch in Russia, under the initiative of and with financial support from the Mondelēz International Foundation and Mondelēz International, launched the charitable BeHealthy Program. The program's main focus is the implementation of four interrelated activities: conducting lessons for schoolchildren on healthy nutrition, with an emphasis on breakfast; healthy cooking lessons with children; cultivating nutritional plants; and providing conditions to encourage children to engage in more physical activity. The program serves more than 13,000 children attending public schools in the Leningrad (Lomonosovskii District), Vladimir, and Novgorod regions. BeHealthy provides funding for schools and comprehensive educational materials to help schoolchildren develop habits of healthy nutrition and physical activity, as well as consulting and expert support for school staff and other key stakeholders. The program brings in experts on program implementation and training for teachers. Curriculum support also includes printed and Web-based healthy lifestyle educational materials on best practices and positive experience, as well as meetings and conferences with school representatives and local authorities. One of the biggest challenges for program managers is to fully understand the complexities of the program, and why and how it is expected to induce changes in healthy lifestyle behaviors of the schoolchildren. For more comprehensive understanding, we performed a Program Impact Pathways (PIP) analysis to identify Critical Quality Control Points (CCPs) and a suite of core indicators of the program's impact on healthy lifestyles. The findings were presented at the Healthy Life-styles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. First, we developed an updated logic model based on how the program was executed. We then translated the logic model into a PIP diagram, where pathways that lead from one activity to the next were defined as the program processes. The PIP diagram is a road map to help ensure that the program inputs and activities lead to expected outcomes. Based on this road map, the program identifies and tracks its CCPs. Ensuring implementation of program activities and evaluating pre-post knowledge and behavior of participants were identified as CCPs. The PIP analysis was very useful for understanding realistic expectations for the potential of BeHealthy and its inputs. As a result, we now plan to evaluate the impact of the program and, on this basis, further improve the program's implementation and dissemination to other locations.

Evaluation of funding gastroenterology research in Canada illustrates the beneficial role of partnerships

PubMed Central

Sherman, Philip M; Hart, Kimberly Banks; Rose, Keeley; Bosompra, Kwadwo; Manuel, Christopher; Belanger, Paul; Daniels, Sandra; Sinclair, Paul; Vanner, Stephen; Buret, André G

2013-01-01

BACKGROUND: Funders of health research in Canada seek to determine how their funding programs impact research capacity and knowledge creation. OBJECTIVE: To evaluate the impact of a focused grants and award program that was cofunded by the Canadian Institutes of Health Research Institute of Nutrition, Metabolism and Diabetes, and the Canadian Association of Gastroenterology; and to measure the impact of the Program on the career paths of funded researchers and assess the outcomes of research supported through the Program. METHODS: A survey of the recipients of grants and awards from 2000 to 2008 was conducted in 2012. The CIHR Funding Decisions database was searched to determine subsequent funding; a bibliometric citation analysis of publications arising from the Program was performed. RESULTS: Of 160 grant and award recipients, 147 (92%) completed the survey. With >$17.4 million in research funding, support was provided for 131 fellowship awards, seven career transition awards, and 22 operating grants. More than three-quarters of grant and award recipients continue to work or train in a research-related position. Combined research outputs included 545 research articles, 130 review articles, 33 book chapters and 11 patents. Comparative analyses indicate that publications supported by the funding program had a greater impact than other Canadian and international comparators. CONCLUSIONS: Continuity in support of a long-term health research funding partnership strengthened the career development of gastroenterology researchers in Canada, and enhanced the creation and dissemination of new knowledge in the discipline. PMID:24340317

Assessment of Program Impact Through First Grade, Volume I: The Context, Conceptual Approach and Methods of the Evaluation. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Rosario, Jose; And Others

This volume is the first of a series reporting evaluation findings on the impact of Project Developmental Continuity (PDC) on institutions, classroom staff, parents and children from the time the children entered Head Start through the first grade. PDC was begun in 1974 with the purpose of ensuring that disadvantaged children receive continuous…

Effectiveness of the IMPACT:Ability Program to Improve Safety and Self-Advocacy Skills in High School Students with Disabilities

ERIC Educational Resources Information Center

Dryden, Eileen M.; Desmarais, Jeffery; Arsenault, Lisa

2014-01-01

Background: Individuals with disabilities experience higher rates of abuse than the nondisabled. Few evidence-based prevention interventions have been published despite a need for such work. This study evaluated IMPACT:Ability, a safety and self-advocacy training for individuals with cognitive and/or physical disabilities. Methods: A…

Evaluation of the National School Lunch Program Application/Verification Pilot Projects, Volume V: Analysis of Applications. Nutrition Assistance Program Report Series. Report No. CN-04-AV4

ERIC Educational Resources Information Center

Hulsey, Lara; Gleason, Philip; Ohls, James

2004-01-01

This report, the fifth in a serious of reports about the evaluation of the National School Lunch Program focuses on issues relating to applications for free or reduced-price meals. In particular, it presents (1) an impact analysis of the effects of the pilot policies on the number of applications submitted, and (2) a descriptive analysis of the…

Evaluating the Impact of the U.S. National Toxicology Program: A Case Study on Hexavalent Chromium.

PubMed

Xie, Yun; Holmgren, Stephanie; Andrews, Danica M K; Wolfe, Mary S

2017-02-01

Evaluating the impact of federally funded research with a broad, methodical, and objective approach is important to ensure that public funds advance the mission of federal agencies. We aimed to develop a methodical approach that would yield a broad assessment of National Toxicology Program's (NTP's) effectiveness across multiple sectors and demonstrate the utility of the approach through a case study. A conceptual model was developed with defined activities, outputs (products), and outcomes (proximal, intermediate, distal) and applied retrospectively to NTP's research on hexavalent chromium (CrVI). Proximal outcomes were measured by counting views of and requests for NTP's products by external stakeholders. Intermediate outcomes were measured by bibliometric analysis. Distal outcomes were assessed through Web and LexisNexis searches for documents related to legislation or regulation changes. The approach identified awareness of NTP's work on CrVI by external stakeholders (proximal outcome) and citations of NTP's research in scientific publications, reports, congressional testimonies, and legal and policy documents (intermediate outcome). NTP's research was key to the nation's first-ever drinking water standard for CrVI adopted by California in 2014 (distal outcome). By applying this approach to a case study, the utility and limitations of the approach were identified, including challenges to evaluating the outcomes of a research program. This study identified a broad and objective approach for assessing NTP's effectiveness, including methodological needs for more thorough and efficient impact assessments in the future. Citation: Xie Y, Holmgren S, Andrews DMK, Wolfe MS. 2017. Evaluating the impact of the U.S. National Toxicology Program: a case study on hexavalent chromium. Environ Health Perspect 125:181-188; http://dx.doi.org/10.1289/EHP21.

Welfare Reform in California: Early Results from the Impact Analysis.

ERIC Educational Resources Information Center

Klerman, Jacob Alex; Hotz, V. Joseph; Reardon, Elaine; Cox, Amy G.; Farley, Donna O.; Haider, Steven J.; Imbens, Guido; Schoeni, Robert

The impact of California Work Opportunity and Responsibility to Kids (CalWORKS), which was passed to increase California welfare recipients' participation in welfare-to-work (WTW) activities, was examined. The impact study consisted of a nonexperimental program evaluation that used statistical models to estimate causal effects and a simulation…

Estimating Cross-Site Impact Variation in the Presence of Heteroscedasticity

ERIC Educational Resources Information Center

Bloom, Howard S.; Porter, Kristin E.; Weiss, Michael J.; Raudenbush, Stephen

2013-01-01

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

Energy Education Incentives: Evaluating the Impact of Consumer Energy Kits

ERIC Educational Resources Information Center

Kirby, Sarah D.; Guin, Autumn; Langham, Laura

2015-01-01

Measuring the energy and environmental impact of residential energy education efforts is difficult. The E-Conservation residential energy management program uses consumer energy kits to document the impact of energy-efficient improvements. The consumer energy kit provides an incentive for individuals attending energy education workshop, helps…

77 FR 13095 - Intent To Prepare an Environmental Impact Statement for NOAA Restoration Center Programmatic...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-05

... Coastal Wetland Planning, Protection and Restoration Act (CWPPRA) Program, and the Great Lakes Habitat... Prepare an Environmental Impact Statement for NOAA Restoration Center Programmatic Coastal Habitat... (PEIS) to evaluate the potential environmental impacts of different ranges of coastal and marine habitat...

Ready, Steady, Go! Program, Italy: a Program Impact Pathways (PIP) analysis.

PubMed

Veracini, Giordana; Leonardi, Elisabetta; Girotti, Rita; Thrasher, Erika Willumsen

2014-09-01

Ready, Steady, Go! promotes proper nutrition and physical activity among people of all ages in targeted neighborhoods and encourages social integration and children's participation in decisions that affect their lives. It also seeks to involve parents in activities so that they can influence their children's attitudes toward lifestyles and personal development. This partnership has reached 70,000 Italian children and adults with new opportunities for physical activities and social experiences that help them improve nutritional behaviors while having fun with their peers. To assess the Ready, Steady, Go! Program logic and to identify Critical Quality Control Points (CCPs) and a core suite of impact indicators based on a Program Impact Pathways (PIP) analysis. The PIP analysis team reviewed the key activities and processes that form Ready, Steady, Go! and then identified key CCPs for the project. The findings were presented at the Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. The PIP analysis confirmed that Ready, Steady, Go! has a structure that is likely to support the primary aims of the program. The CCPs identified are training of teachers in healthy lifestyles, teachers' active participation in the program, access to remodeled and well-equipped sports and recreational centers, participation of parents and grandparents, and involvement of local institutions and networks. A suite of impact indicators for changes in healthy lifestyle knowledge, attitudes, and behavior was identified. Project staff are now more aware of the importance of carefully monitoring the CCPs and have decided to conduct quarterly PIP-informed quality control evaluations.

A Study of Informal Out-of-School Programs with Migrant Children.

ERIC Educational Resources Information Center

Dik, David

The purposes of this study were to determine the educational impact of an out-of-school informal migrant program, and to discover materials, techniques, methods, and guidelines for similar programs with migrant children. The Orange County, New York 4-H program was evaluated weekly and a record of successful projects, staff training procedures, and…

An Analysis of the 2013 Program Evaluation Proposals for the School Leadership Preparation Program

ERIC Educational Resources Information Center

Sanzo, Karen

2016-01-01

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

Audience Duplication in the Video Age: Changes in Prime Time Inheritance Effects between 1976 and 1985.

ERIC Educational Resources Information Center

Walker, James R.

Evaluating the impact of the changing media environment on television programming, a study examined inheritance effects--the percentage of one television program's audience that also watches the program immediately following--in network prime time programming between 1976 and 1985. Inheritance effect was calculated as the correlation between a…

When Worlds Collide: Evaluating the Impact of Short-Term Study Abroad Programs

ERIC Educational Resources Information Center

Sato, Deirdre Colby

2009-01-01

The purpose of this study was to determine whether and how short-term study abroad programs transform college students' perspectives. The study examined attitudes about host country and international outlook, as well as intellectual, social and personal understandings. Short-term programs were defined as programs of less than a semester or a…

Evaluating the Impact of the Administrator and Administrative Structure of Online Programs at Nonprofit Private Colleges

ERIC Educational Resources Information Center

Hoey, Rebecca; McCracken, Fawn; Gehrett, Matt; Snoeyink, Rick

2014-01-01

Nonprofit private colleges lag behind their public and for-profit counterparts in offering online programs. Many nonprofit private colleges affiliated with the Council for Christian Colleges & Universities (CCCU) launched their first online programs within the past five years. As a result, administrative structures to manage online programs at…

The Development of a Transportable Leadership and Management Program in Higher Education.

ERIC Educational Resources Information Center

Shapiro, Joan P.; And Others

The impact of an evaluation design on the effective implementation of a training program for women in higher education leadership and management was assessed. The program was designed by the University of Pennsylvania's Higher Education Resource Services. The training program, entitled "The Next Move," was introduced at three pilot sites: a large,…

Program Evaluation: A Study of the Impact of a Workforce Preparation Program

ERIC Educational Resources Information Center

Blevins, Stephanie Strevels

2010-01-01

The Kentucky 4-H Reality Store, a workforce preparation program was established to educate youth about the importance of budgeting, setting goals, planning for careers, considering the future, preventing teen pregnancy, and abstaining from drug misuse. The program which has been administered to over 45,000 adolescents each year has never been…

Expanding Children's Food Experiences: The Impact of a School-Based Kitchen Garden Program

ERIC Educational Resources Information Center

Gibbs, Lisa; Staiger, Petra K.; Johnson, Britt; Block, Karen; Macfarlane, Susie; Gold, Lisa; Kulas, Jenny; Townsend, Mardie; Long, Caroline; Ukoumunne, Obioha

2013-01-01

Objective: Evaluate achievement of the "Stephanie Alexander Kitchen Garden Program" in increasing child appreciation of diverse, healthy foods. Design: Comparative 2-year study. Setting: Six program and 6 comparison primary schools in rural and metropolitan Victoria, Australia, matched for socioeconomic status and size. Participants: A…

An Evaluation of CHAMPS: A Classroom Management Program

ERIC Educational Resources Information Center

Minnear, Holly J.

2015-01-01

This dissertation was designed to examine the impact of Conversation, Help, Activity, Movement, Participation, Success (CHAMPS), a classroom management program in elementary schools in a district in North Carolina. The participants included principals and teachers who attended a 2-day training course and implemented the CHAMPS program at their…

Essays on Education Programs in Developing Countries

ERIC Educational Resources Information Center

He, Fang

2010-01-01

This dissertation evaluates programs seeking to address educational access and quality in developing countries. Chapter 1 examines the impact of two school feeding programs on enrollment in Sri Lanka. Chapter 2 assesses the relative productivity of several modes of implementing an Indian English education curriculum in India. Finally, chapter 3…

Assessing the Impact of a Summer Internship Program for Teachers and Counselors.

ERIC Educational Resources Information Center

Russell, Jill F.; Reiser, Mary Lynn

1999-01-01

Discusses an evaluation of a summer internship program for Omaha, Nebraska, educators that stressed scientific/technical work experience. Results suggest that internship programs can provide a growth experience for teachers and can positively influence students' knowledge, skills, and readiness for the world of work. (MLH)

Outcome Measures of Health Programs: What and How?

ERIC Educational Resources Information Center

Chen, Martin K.

With the proliferation of new health programs, such as Health Maintenance Organizations (HMO's) and Professional Service Review Organizations (PSRO's), the task of evaluating the impact of such programs on the health delivery systems and on the health of the American people becomes more urgent. Thus far no experimental or quasi-experimental…

Evaluating the Effectiveness of a Sustainable Living Education Program

ERIC Educational Resources Information Center

Mazze, Sarah; Stockard, Jean

2013-01-01

The Climate Masters at Home program was modeled after Extension "master" classes with the aim of increasing individuals' energy and resource saving behaviors. This article explores the impact of the program on participants' behavior, attitudes, and knowledge over several years of implementation. Data sources include survey…

STEM Learning in Afterschool: An Analysis of Impact and Outcomes

ERIC Educational Resources Information Center

Afterschool Alliance, 2011

2011-01-01

This document summarizes evaluation reports from afterschool science, technology, engineering and math (STEM) programs across the United States and identifies common trends and strengths that afterschool learning brings to STEM education. Like many programs nationwide, several of the programs highlighted in this paper were designed specifically to…

The Impact of the Measures of Academic Progress (MAP) Program on Student Reading Achievement

ERIC Educational Resources Information Center

Cordray, David S.; Pion, Georgine M.; Brandt, Chris; Molefe, Ayrin

2013-01-01

One of the most widely used commercially available systems incorporating benchmark assessment and training in differentiated instruction is the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) program. The MAP program involves two components: (1) computer-adaptive assessments administered to students three to four…

Effective Dropout Prevention and College Attendance Programs for Latino Students.

ERIC Educational Resources Information Center

Fashola, Olatokunbo S.; Slavin, Robert E.

This paper reviews research related to effective secondary school programs aimed at dropout prevention and increasing college enrollment rates for at-risk Latino youth. The review identifies programs that have demonstrated a significant impact on dropout rates, college attendance, school performance, or related outcomes in rigorous evaluations;…

The Impact and Evaluation of Two School-Based Interventions on Intention to Register an Organ Donation Preference

ERIC Educational Resources Information Center

Reubsaet, A.; Brug, J.; Kitslaar, J.; Van Hooff, J. P.; van den Borne, H. W.

2004-01-01

The present paper describes the impact and evaluation of two intervention components--a video with group discussion and an interactive computer-tailored program--in order to encourage adolescents to register their organ donation preference. Studies were conducted in school during regular school hours. The video with group discussion in class had a…

77 FR 75648 - Notice of Intent To Prepare an Environmental Impact Statement To Evaluate the Use of Three New...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-21

... Prepare an Environmental Impact Statement To Evaluate the Use of Three New Herbicides on Public Lands in..., and rimsulfuron herbicides as part of the its vegetation treatment programs on public lands in 17... rimsulfuron to the BLM's approved list of herbicides for (1) Controlling noxious weeds and other invasive...

Results from a First-Year Evaluation of Academic Impacts of an After-School Program for At-Risk Students

ERIC Educational Resources Information Center

Jenner, Eric; Jenner, Lynne W.

2007-01-01

This article presents the research findings of an evaluation of the academic impacts of 21st Century Learning Centers (CCLC) in Louisiana. Using quasi-experimental design, the article operationalizes academic achievement as core and subject test performance on nationally standardized pre- and posttests (Iowa Test of Basic Skills; ITBS). Based on…

From professional development for science teachers to student learning in science

NASA Astrophysics Data System (ADS)

Tinoca, Luis Fonseca

This study investigates the effects of professional development for science teachers on student learning. It is usually expected that professional development programs positively impact student learning, however this dimension is not commonly incorporated in the programs evaluation. It is simply assumed that students will be indirectly impacted through their participating teachers in the work with their students. Two main research questions are addressed: (1) Are professional development programs effective in enhancing student learning in science? (2) What are the characteristics of the most and least effective programs? To answer these questions a meta-analysis of 37 professional development programs reporting their impact on student learning was performed. Program characteristics have been defined according to the categories defined by Loucks-Horsley et al (1998), the National Science Education Standards (NRC, 1996), as well as new categories developed by us analyzing other variables such as the programs length. A significant impact of professional development for science teachers on student learning has been found in the form of an overall correlation effect size of r = 0.22 (p < 0.001). Moreover, a Fixed Effects Model was used to differentiate between the impacts of the different characteristics of professional development programs for science teachers. In particular, programs emphasizing work on curriculum development, replacement, or implementation, scientific inquiry, pedagogical content knowledge, lasting over 6 month and with a total duration of at least 100 hours have been identified as having a larger impact on student learning. To enhance the findings vignettes have been developed based on the attained effect sizes describing possible professional development programs. Recommendations for present and future professional development programs are made based on what works best in order to maximize their impact on student learning.

Using Elections as Teachable Moments: A Randomized Evaluation of the Student Voices Civic Education Program

ERIC Educational Resources Information Center

Syvertsen, Amy K.; Stout, Michael D.; Flanagan, Constance A.

2009-01-01

The recommitment of public education to its civic roots has revived discussion on how to engage younger generations of citizens in electoral politics and civic life. This randomized trial of 1,670 high school students in 80 social studies classrooms evaluates the impact of an election-based civics program on students' civic knowledge, skills, and…

Fellowship Effects in Graduate Education: Evaluating the Impact of the National Science Foundation's Graduate Research Fellowship Program. ASHE Annual Meeting Paper.

ERIC Educational Resources Information Center

Goldsmith, Sharon S.; Presley, Jennifer B.

This report results from an evaluation of the National Research Foundation's Graduate Research Fellowship program. The study sought to determine: (1) whether NSF fellows show evidence of more timely degree completion and early career success; (2) whether graduate fellows and minority graduate fellows experience similar education and career…

Findings from an Evaluation of a Comprehensive Parent Education Program for School-Age Parents.

ERIC Educational Resources Information Center

Braun, Maureen H.; Fuscaldo, Diane P.

This study evaluates the impact of the Parent Linking Project III (PLP III) on its participants. The PLP III is a comprehensive program for teenage mothers which offers workshops in parenting, mother-child interaction, and vocational awareness, and provides day care services that allow teen mothers to take the opportunity to complete their high…

Evaluation of the Florida Master Teacher Initiative: Final Evaluation Findings

ERIC Educational Resources Information Center

Wang, Haiwen; Warner, Miya; Golan, Shari; Wechsler, Marjorie; Park, C. J.

2015-01-01

The purpose of this study was to examine the impact of the Florida Master Teacher Initiative (FMTI)--an i3-funded early learning program aimed at improving the quality of teaching and student outcomes in grades PreK through third grade in high need schools. The FMTI schools participated in four program components: (1) a job-embedded graduate…

A Comprehensive Evaluation of OEO Community Action Programs on Six Selected American Indian Reservations. Report 4 - Final Report.

ERIC Educational Resources Information Center

Smith, James G. E.; And Others

The impact of the Office of Economic Opportunity (OEO) Community Action Programs (CAP) on 6 selected American Indian reservations (Gila River and Papago, Arizona; Santa Clara Pueblo, New Mexico; Pine Ridge, South Dakota; Turtle Mountain, North Dakota, and White Earth Chippewa, Minnesota) are evaluated. After considering the development of Indian…

Evaluation of a Health Professionals' Training Program to Conduct Research in New York City's Asian American Community

ERIC Educational Resources Information Center

Zhang, Pao San Lucy; Sim, Shao-Chee; Pong, Perry; Islam, Nadia; Trinh-Shevrin, Chau; Li, Shijian; Tsang, Thomas; Rey, Mariano

2014-01-01

Background: Because health disparities among Asian Americans are understudied, a partnership program between the Charles B. Wang Community Health Center and the Center for the Study of Asian American Health was created to increase awareness and interest in Asian American research. Purpose: To evaluate the process, outcome, and impact of a health…

Evaluations Backgrounder: A Summary of Formal Evaluations of Afterschool Programs' Impact on Behavior, Safety and Family Life

ERIC Educational Resources Information Center

Afterschool Alliance, 2007

2007-01-01

Although afterschool programs for children have been operating for many years in some communities, the afterschool movement--the great national awakening to the opportunity afterschool offers--is just a few years old. As public demand for afterschool has grown, so has the demand for accountability. That is particularly true in afterschool…

Evaluation of the Emotional Education Program "Happy 8-12" for the Assertive Resolution of Conflicts among Peers

ERIC Educational Resources Information Center

Filella, G.; Cabello, E.; Pérez-Escoda, N.; Ros-Morente, A.

2016-01-01

Introduction: Coexistence in schools inevitably implies conflicts among peers, which can have a negative impact in both the students' well-being and their academic achievement. In this sense, the main objective of the present article is to introduce and describe the evaluation of the Training Program in Emotional Management Happy 8-12. This…

Evaluation of the Williamsburg County Direct Instruction Program: Factors Leading to Success in Rural Elementary Programs.

ERIC Educational Resources Information Center

Darch, Craig; And Others

Several evaluation formats were used to examine the impact that the Direct Instruction Model had on 600 selected students in Williamsburg County, South Carolina, over a 7-year period. The performance of students in the Direct Instruction Model was contrasted with the performance of similar students (on the basis of family income, ethnicity,…

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

PubMed

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

NASA Astrophysics Data System (ADS)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in its vision, mission, goals and activities. In addition to the documentation of evaluative process, the case study also provides insight on the establishment of mutually supportive principal investigator and evaluator partnerships as necessary foundations for building effective teams. The study addresses frequently asked questions (FAQ's) on the formation and sustenance of partnerships among visionaries and evaluators and the impact of this partnership on the achievement of program outcomes.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

PubMed

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Multiple educational programs improves glycemic control, quality of life with diminishing the impact of diabetes in poorly controlled type 1 diabetics.

PubMed

Vyas, Chintan; Dalal, Lopa; Talaviya, Praful; Saboo, Banshi

2017-12-01

The aim of present study was to assess the outcomes of multiple educational programs on glycemic control, quality of life and impact of diabetes in poorly controlled Type 1 Diabetic patients. A 12 months diabetes education programs were conducted every week for first one month then followed by every 3 months with follow up on improvement of HbA1c and QOL in T1D patients (n=54). Clinical characteristics were recorded at baseline visit. The QOL was evaluated by 15 set DQOL questionnaires in 40 consecutive patients at baseline, 3, 6 and 12 months after education programs. The HbA1c level (%) was evaluated at same time point. Decrease in DQOL score was reported as improvement in QOL. The rate of patients response to educational programs was noted 74.07% (n=40) at end of the study (12 months). The prevalence of T1D was reported higher in men than in women. The overall DQOL score and HbA1c% level was significantly (P<0.05) decreased at 3, 6 and 12 months after educational programs. Patients exhibited greater satisfaction and diminished impact of diabetes after educational programs was observed after 3 months and it was continue up to end of study. The frequencies of self-monitoring of blood glucose were increased. Numbers of hypoglycemic and DKA events were decreased after educational programs when compared to baseline. Results of study revealed that the appropriate education and counseling diminish impact of diabetes, improve QOL and help to achieve desired glycemic (HbA1c) level in poorly control T1D patients. Copyright © 2017. Published by Elsevier Ltd.

Application of logic models in a large scientific research program.

PubMed

O'Keefe, Christine M; Head, Richard J

2011-08-01

It is the purpose of this article to discuss the development and application of a logic model in the context of a large scientific research program within the Commonwealth Scientific and Industrial Research Organisation (CSIRO). CSIRO is Australia's national science agency and is a publicly funded part of Australia's innovation system. It conducts mission-driven scientific research focussed on delivering results with relevance and impact for Australia, where impact is defined and measured in economic, environmental and social terms at the national level. The Australian Government has recently signalled an increasing emphasis on performance assessment and evaluation, which in the CSIRO context implies an increasing emphasis on ensuring and demonstrating the impact of its research programs. CSIRO continues to develop and improve its approaches to impact planning and evaluation, including conducting a trial of a program logic approach in the CSIRO Preventative Health National Research Flagship. During the trial, improvements were observed in clarity of the research goals and path to impact, as well as in alignment of science and support function activities with national challenge goals. Further benefits were observed in terms of communication of the goals and expected impact of CSIRO's research programs both within CSIRO and externally. The key lesson learned was that significant value was achieved through the process itself, as well as the outcome. Recommendations based on the CSIRO trial may be of interest to managers of scientific research considering developing similar logic models for their research projects. The CSIRO experience has shown that there are significant benefits to be gained, especially if the project participants have a major role in the process of developing the logic model. Copyright © 2011 Elsevier Ltd. All rights reserved.

A pilot study to investigate the impact of interactional television on student evaluation of faculty effectiveness.

PubMed

Fetzer, S J

2000-02-01

While the dominant theme of distance education research has been the learner, learner achievement is not necessarily the only important consideration in assessing the effectiveness of ITV programs. With nearly half of the nursing programs recently surveyed by Reinert and Fryback (1997) offering or planning to offer distance learning in the near future, researchers and developers must seek to understand the impact of ITV on the teacher. These programs require faculty who are committed and prepared to teach outside of the traditional classroom. Selection of faculty requires attention to appropriate qualifications and knowledge of strategies to bridge teacher-learner separation created by distance education. Faculty, peers, and administrators should consider the teaching environment when interpreting data designed to evaluate teacher effectiveness of ITV teaching.

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.

The Impact of Prematriculation Admission Characteristics on Graduation Rates in an Accelerated Doctor of Pharmacy Program.

PubMed

Steinberg, Michael; Morin, Anna K

2015-10-25

Objective. To evaluate the impact of admission characteristics on graduation in an accelerated doctor of pharmacy (PharmD) program. Methods. Selected prematriculation characteristics of students entering the graduation class years of 2009-2012 on the Worcester and Manchester campuses of MCPHS University were analyzed and compared for on-time graduation. Results. Eighty-two percent of evaluated students (699 of 852) graduated on time. Students who were most likely to graduate on-time attended a 4-year school, previously earned a bachelor's degree, had an overall prematriculation grade point average (GPA) greater than or equal to 3.6, and graduated in the spring just prior to matriculating to the university. Factors that reduced the likelihood of graduating on time were also identified. Work experience had a marginal impact on graduating on time. Conclusion. Although there is no certainty in college admission decisions, prematriculation characteristics can help predict the likelihood for academic success of students in an accelerated PharmD program.

The Impact of Prematriculation Admission Characteristics on Graduation Rates in an Accelerated Doctor of Pharmacy Program

PubMed Central

Morin, Anna K.

2015-01-01

Objective. To evaluate the impact of admission characteristics on graduation in an accelerated doctor of pharmacy (PharmD) program. Methods. Selected prematriculation characteristics of students entering the graduation class years of 2009-2012 on the Worcester and Manchester campuses of MCPHS University were analyzed and compared for on-time graduation. Results. Eighty-two percent of evaluated students (699 of 852) graduated on time. Students who were most likely to graduate on-time attended a 4-year school, previously earned a bachelor’s degree, had an overall prematriculation grade point average (GPA) greater than or equal to 3.6, and graduated in the spring just prior to matriculating to the university. Factors that reduced the likelihood of graduating on time were also identified. Work experience had a marginal impact on graduating on time. Conclusion. Although there is no certainty in college admission decisions, prematriculation characteristics can help predict the likelihood for academic success of students in an accelerated PharmD program. PMID:26689686

Evaluation of the impact of collaborative work by teams from the National Medical Residency Committee and the Brazilian Society of Neurosurgery. Retrospective and prospective study.

PubMed

Santos, Renato Antunes Dos; Snell, Linda; Nunes, Maria do Patrocínio Tenório

2016-04-01

Training for specialist physicians in Brazil can take place in different ways. Closer liaison between institutions providing this training and assessment and health care services may improve qualifications. This article analyzes the impact of closer links and joint work by teams from the National Medical Residency Committee (Comissão Nacional de Residência Médica, CNRM) and the Brazilian Society of Neurosurgery (Sociedade Brasileira de Neurocirurgia, SBN) towards evaluating these programs. Retrospective and prospective study, conducted in a public university on a pilot project developed between CNRM and SBN for joint assessment of training programs across Brazil. The literature in the most relevant databases was reviewed. Documents and legislation produced by official government bodies were evaluated. Training locations were visited. Reports produced about residency programs were analyzed. Only 26% of the programs were immediately approved. The joint assessments found problems relating to teaching and to functioning of clinical service in 35% of the programs. The distribution of programs in this country has a strong relationship with the Human Development Index (HDI) of the regions and is very similar to the distribution of specialists. Closer collaboration between the SBN and CNRM had a positive impact on assessment of neurosurgery medical residency across the country. The low rates of direct approval have produced modifications and improvements to the quality of teaching and care (services). Closer links between the CNRM and other medical specialties have the capability to positively change the structure and function of specialty training in Brazil.

SCIX IMPACT ON DWPF CPC

DOE Office of Scientific and Technical Information (OSTI.GOV)

Koopman, D.

2011-07-14

A program was conducted to systematically evaluate potential impacts of the proposed Small Column Ion Exchange (SCIX) process on the Defense Waste Processing Facility (DWPF) Chemical Processing Cell (CPC). The program involved a series of interrelated tasks. Past studies of the impact of crystalline silicotitanate (CST) and monosodium titanate (MST) on DWPF were reviewed. Paper studies and material balance calculations were used to establish reasonable bounding levels of CST and MST in sludge. Following the paper studies, Sludge Batch 10 (SB10) simulant was modified to have both bounding and intermediate levels of MST and ground CST. The SCIX flow sheetmore » includes grinding of the CST which is larger than DWPF frit when not ground. Nominal ground CST was not yet available, therefore a similar CST ground previously in Savannah River National Laboratory (SRNL) was used. It was believed that this CST was over ground and that it would bound the impact of nominal CST on sludge slurry properties. Lab-scale simulations of the DWPF CPC were conducted using SB10 simulants with no, intermediate, and bounding levels of CST and MST. Tests included both the Sludge Receipt and Adjustment Tank (SRAT) and Slurry Mix Evaporator (SME) cycles. Simulations were performed at high and low acid stoichiometry. A demonstration of the extended CPC flowsheet was made that included streams from the site interim salt processing operations. A simulation using irradiated CST and MST was also completed. An extensive set of rheological measurements was made to search for potential adverse consequences of CST and MST and slurry rheology in the CPC. The SCIX CPC impact program was conducted in parallel with a program to evaluate the impact of SCIX on the final DWPF glass waste form and on the DWPF melter throughput. The studies must be considered together when evaluating the full impact of SCIX on DWPF. Due to the fact that the alternant flowsheet for DWPF has not been selected, this study did not consider the impact of proposed future alternative DWPF CPC flowsheets. The impact of the SCIX streams on DWPF processing using the selected flowsheet need to be considered as part of the technical baseline studies for coupled processing with the selected flowsheet. In addition, the downstream impact of aluminum dissolution on waste containing CST and MST has not yet been evaluated. The current baseline would not subject CST to the aluminum dissolution process and technical concerns with performing the dissolution with CST have been expressed. Should this option become feasible, the downstream impact should be considered. The main area of concern for DWPF from aluminum dissolution is an impact on rheology. The SCIX project is planning for SRNL to complete MST, CST, and sludge rheology testing to evaluate any expected changes. The impact of ground CST transport and flush water on the DWPF CPC feed tank (and potential need for decanting) has not been defined or studied.« less