Using a Theory of Change to Guide Grant Monitoring and Grantmaking.

PubMed

Glasgow, LaShawn; Adams, Elizabeth; Joshi, Sandhya; Curry, Laurel; Schmitt, Carol L; Rogers, Todd; Willett, Jeffrey; Van Hersh, Deanna

Charitable foundations play a significant role in advancing public health, funding billions of dollars in health grants each year. Evaluation is an important accountability tool for foundations and helps ensure that philanthropic investments contribute to the broader public health evidence base. While commitment to evaluation has increased among foundations over the past few decades, effective use of evaluation findings remains challenging. To facilitate use of evaluation findings among philanthropic organizations, evaluators can incorporate the foundation's theory of change-an illustration of the presumed causal pathways between a program's activities and its intended outcomes-into user-friendly products that summarize evaluation findings and recommendations. Using examples from the evaluation of the Kansas Health Foundation's Healthy Living Focus Area, we present a mapping technique that can be applied to assess and graphically depict alignment between program theory and program reality, refine the theory of change, and inform grantmaking.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

1980-1981 Evaluation Findings.

ERIC Educational Resources Information Center

Austin Independent School District, TX. Office of Research and Evaluation.

This volume summarizes the results of evaluation and testing activities carried out in the Austin, Texas, Independent School District (AISD) during the 1980-81 school year. The text consists of five parts: Section one highlights important findings in the areas of Title I Schoolwide Projects, compensatory programs, early childhood programs,…

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Bonus Awards for Teachers in Texas' Performance Pay Program: Findings from the First Round of TEEG Schools. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2009

2009-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the second-year of a multi-year evaluation of the Texas Educator Excellence Grant (TEEG) program, a statewide educator incentive program that operated in Texas. As part of this evaluation report, researchers examined how first-year TEEG schools…

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

PubMed

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Primary prevention research: a preliminary review of program outcome studies.

PubMed

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Helping Teachers Use Research Findings: The Consumer-Validation Process.

ERIC Educational Resources Information Center

Eaker, Robert E.; Huffman, James O.

A program stressing teacher involvement and classroom implementation of educational research findings is described. The program was designed to familiarize teachers with current findings, have them apply the findings in their classrooms, analyze their own teaching behavior, and critically evaluate the findings in terms of their applicability to…

Evaluating Federal Social Programs: Finding out What Works and What Does Not

ERIC Educational Resources Information Center

Muhlhausen, David B.

2012-01-01

Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

Is abstinence education theory based? The underlying logic of abstinence education programs in Texas.

PubMed

Goodson, Patricia; Pruitt, B E; Suther, Sandy; Wilson, Kelly; Buhi, Eric

2006-04-01

Authors examined the logic (or the implicit theory) underlying 16 abstinence-only-until-marriage programs in Texas (50% of all programs funded under the federal welfare reform legislation during 2001 and 2002). Defined as a set of propositions regarding the relationship between program activities and their intended outcomes, program staff's implicit theories were summarized and compared to (a) data from studies on adolescent sexual behavior, (b) a theory-based model of youth abstinent behavior, and (c) preliminary findings from the national evaluation of Title V programs. Authors interviewed 62 program directors and instructors and employed selected principles of grounded theory to analyze interview data. Findings indicated that abstinence education staff could clearly articulate the logic guiding program activity choices. Comparisons between interview data and a theory-based model of adolescent sexual behavior revealed striking similarities. Implications of these findings for conceptualizing and evaluating abstinence-only-until-marriage (or similar) programs are examined.

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

ERIC Educational Resources Information Center

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Exploring the Suitability of an English for Health Sciences Program: Model and Report of a Self-Evaluation Process

ERIC Educational Resources Information Center

Ferrer, Erica; Pérez, Yuddy

2017-01-01

Program evaluation is a process of carefully collecting information in order to make informed decisions to strengthen specific components of a given program. The type of evaluation an institution decides to undertake depends on the purpose as well as on the information the institution wants to find out about its program. Self-evaluation represents…

Evaluation of Selected New York City Umbrella Programs, 1974-1975 School Year.

ERIC Educational Resources Information Center

Fordham Univ., Bronx, NY. Inst. for Research and Evaluation.

An evaluation of twelve different New York City Umbrella Programs coordinated in New York City public schools during the 1974-1975 school year is contained in this document. This report presents a description and evaluation of these programs, together with the major findings. The programs were implemented in the following areas: (1) tutoring in…

Do State Pre-K Programs Improve Children's Pre-Literacy and Math Learning? Evaluation Science Brief

ERIC Educational Resources Information Center

National Forum on Early Childhood Program Evaluation, 2008

2008-01-01

"Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "An Effectiveness-Based Evaluation of Five State Pre-Kindergarten Programs" (V. C. Wong, T. D. Cook, W. S. Barnett, and K. Jung.) States have high aspirations for…

Qualitative Evaluation of Project P.A.T.H.S.: An Integration of Findings Based on Program Participants

PubMed Central

Shek, Daniel T. L.; Sun, Rachel C. F.

2012-01-01

An integration of the qualitative evaluation findings collected in different cohorts of students who participated in Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) (n = 252 students in 29 focus groups) was carried out. With specific focus on how the informants described the program, results showed that the descriptions were mainly positive in nature, suggesting that the program was well received by the program participants. When the informants were invited to name three metaphors that could stand for the program, positive metaphors were commonly used. Beneficial effects of the program in different psychosocial domains were also voiced by the program participants. The qualitative findings integrated in this paper provide further support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in promoting holistic development in Chinese adolescents in Hong Kong. PMID:22666134

Afterschool Alliance Backgrounder: Formal Evaluations of Afterschool Programs.

ERIC Educational Resources Information Center

Afterschool Alliance, Washington, DC.

Noting that various types of evaluations of after-school programming conducted over the last several years have provided useful information to providers and to policymakers, this report summarizes the lessons learned from independent evaluations of after-school programs. The following overall findings are supported with a delineation of findings…

7 CFR 1485.20 - Financial management, reports, evaluations and appeals.

Code of Federal Regulations, 2011 CFR

2011-01-01

.... (ii) A brand promotion evaluation is a review of the U.S. and foreign commercial entities' export... of the program to determine the effectiveness of the participant's strategy in meeting specified... program evaluation's findings and recommendations and proposed changes in program strategy or design as a...

Do Early Childhood Programs Have Lasting Effects on Children? Evaluation Science Brief

ERIC Educational Resources Information Center

National Forum on Early Childhood Program Evaluation, 2008

2008-01-01

"Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "Early Intervention in Low Birthweight Premature Infants: Results at 18 Years of Age for the Infant Health and Development Program (IHDP)" (M.C. McCormick, J.…

Traffic control device evaluation program : FY 2016.

DOT National Transportation Integrated Search

2017-03-01

This report presents findings on three different activities conducted in the Traffic Control Device Evaluation Program during the 2016 fiscal year. The first two activities are evaluations of full-matrix color light-emitting diode changeable message ...

A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

PubMed Central

Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

2018-01-01

Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report. NCEE 2009-4047

ERIC Educational Resources Information Center

Bernstein, Lawrence; Rappaport, Catherine Dun; Olsho, Lauren; Hunt, Dana; Levin, Marjorie

2009-01-01

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and…

Governor's Educator Excellence Grant (GEEG) Program: Year One Evaluation Report. Policy Evaluation Report

ERIC Educational Resources Information Center

Springer, Matthew G.; Podgursky, Michael J.; Lewis, Jessica L.; Ehlert, Mark W.; Gardner, Catherine G.; Ghoshdastidar, Bonnie; Lopez, Omar S.; Patterson, Christine H.; Taylor, Lori L.

2007-01-01

This report presents findings stemming from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide performance incentive programs in Texas. In the fall of 2006, the GEEG program made available non-competitive, three-year grants to 99 schools ranging from $60,000 to $220,000 per year. Grants…

Program Evaluation of Services for the Homeless: Challenges and Strategies.

ERIC Educational Resources Information Center

Mercier, Celine; And Others

1992-01-01

Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)

A responsive evaluation of an Aboriginal nursing education access program.

PubMed

Curran, Vernon; Solberg, Shirley; LeFort, Sandra; Fleet, Lisa; Hollett, Ann

2008-01-01

Nursing education access programs have been introduced in a number of countries to address the shortage of healthcare providers of Aboriginal descent. An evaluation study of a nursing education access program in Labrador, Canada, was undertaken using a Responsive Evaluation approach. Interviews and focus groups with program stakeholders were conducted. Program effectiveness was influenced by culturally relevant curriculum, experiential and authentic learning opportunities, academic and social support, and the need for partnership building between stakeholders. The authors report key findings resulting from the Responsive Evaluation.

Design and Operation of the Transformed National Healthy Start Evaluation.

PubMed

Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K

2017-12-01

Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.

The Design and Pilot Evaluation of an Interactive Learning Environment for Introductory Programming Influenced by Cognitive Load Theory and Constructivism

ERIC Educational Resources Information Center

Moons, Jan; De Backer, Carlos

2013-01-01

This article presents the architecture and evaluation of a novel environment for programming education. The design of this programming environment, and the way it is used in class, is based on the findings of constructivist and cognitivist learning paradigms. The environment is evaluated based on qualitative student and teacher evaluations and…

Helping Leaders Take Effective Action: A Program Evaluation.

ERIC Educational Resources Information Center

Young, Dianne P.; Dixon, Nancy M.

In 1991 the Center for Creative Leadership (CCL) launched its LeaderLab program, with the goal of helping executives take more effective action in their leadership situations. This publication presents findings of a program evaluation that explored whether program participants took more effective action in their leadership situations. Data were…

Student Perspectives: Evaluating a Higher Education Administration Program

ERIC Educational Resources Information Center

Roberts, Jalynn; Gentry, Debra; Townsend, Amy

2011-01-01

The purpose of this mixed-method study was to evaluate a Higher Education Administration doctoral program, to understand student perceptions of program quality, to improve both student satisfaction and retention to degree completion, and to plan for the future. Findings from survey data and focus group interviews indicated program strengths to…

Federally Mandated Evaluation of Vocational Programs: One College's Response.

ERIC Educational Resources Information Center

Stevenson, Mike; Walleri, R. Dan

The process and findings of the evaluation of seven of the 52 vocational preparatory programs at Mount Hood Community College are described with a focus on demonstrating the feasibility, utility, and problems associated with making program evaluations meet both internal needs and federal requirements. Summaries of data collected are provided in…

An Evaluation of the Nutrition Education and Training Program: Project Summary.

ERIC Educational Resources Information Center

St. Pierre, Robert G.

This project summary reviews and extends the findings of prior reports made by Abt Associates, Inc. (Cambridge, Massachusetts) on the Nutrition Education and Training (NET) program, synthesizes evaluation efforts in nutrition education, and presents a set of conclusions based on the evaluations of nutrition programs. Chapter 1 presents background…

An Evaluation of Newgate and Other Prisoner Education Programs.

ERIC Educational Resources Information Center

Kaplan (Marshall), Gans and Kahn, San Francisco, CA.

In a study to determine what impact prison college programs have had and to provide information useful to policy decisions, an evaluation, findings, and conclusions are presented for the Newgate and four other programs. An evaluation is made of post prison careers utilizing recidivism, "making it", and "doing good" as a…

Evaluating the Impact of HRD.

ERIC Educational Resources Information Center

1998

This document contains four papers from a symposium on evaluating the impact of human resource development (HRD). "The Politics of Program Evaluation and the Misuse of Evaluation Findings" (Hallie Preskill, Robin Lackey) discusses the status of evaluation theory, evaluation as a political activity, and the findings from a survey on the…

The use of one- versus two-tailed tests to evaluate prevention programs.

PubMed

Ringwalt, Chris; Paschall, M J; Gorman, Dennis; Derzon, James; Kinlaw, Alan

2011-06-01

Investigators have used both one- and two-tailed tests to determine the significance of findings yielded by program evaluations. While the literature that addresses the appropriate use of each type of significance test should be used is historically inconsistent, almost all authorities now agree that one-tailed tests are rarely (if ever) appropriate. A review of 85 published evaluations of school-based drug prevention curricula specified on the National Registry of Effective Programs and Practices revealed that 20% employed one-tailed tests and, within this subgroup, an additional 4% also employed two-tailed tests. The majority of publications either did not specify the type of statistical test employed or used some other criterion such as effect sizes or confidence intervals. Evaluators reported that they used one-tailed tests either because they stipulated the direction of expected findings in advance, or because prior evaluations of similar programs had yielded no negative results. The authors conclude that one-tailed tests should never be used because they introduce greater potential for Type I errors and create an uneven playing field when outcomes are compared across programs. The authors also conclude that the traditional threshold of significance that places α at .05 is arbitrary and obsolete, and that evaluators should consistently report the exact p values they find.

Camp's "Disneyland" Effect.

ERIC Educational Resources Information Center

Renville, Gary

1999-01-01

Describes the positive mental, physical, and social growth impacts that the camping experience had on the author, and urges camp program evaluation to plan and implement such changes. Sidebar lists steps of effective evaluation: program goals and objectives, goals of evaluation, implementation of evaluation, data analysis, and findings and…

Remote Infrared Audible Signage (RIAS) Pilot Program : evaluation report

DOT National Transportation Integrated Search

2009-09-01

This report presents evaluation findings on the Remote Infrared Audible Signage (RIAS) Pilot Program in the Puget Sound Region of Washington. The installation, demonstration and evaluation of RIAS were required by a provision in the Safe, Accountable...

A Process Evaluation of Project Developmental Continuity, Interim Report VII, Volume 1: Findings from the PDC Implementation Study.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This third year interim report, one of a series of documents on the evaluation of Project Developmental Continuity (PDC), presents findings from three major analyses of program implementation; measurement of the extent each program has implemented the basic PDC Guidelines; a description of patterns of that implementation; and analysis of some…

Pitfalls in Evaluating the Effectiveness of Case Management Programs for Homeless Persons: Lessons from the NIAAA Community Demonstration Program.

ERIC Educational Resources Information Center

Orwin, Robert G.; And Others

1994-01-01

Evaluation findings of the National Institute on Alcohol Abuse and Alcoholism (NIAAA) Community Demonstration Program show few clear indications of the effectiveness of case management approaches. This article identifies phenomena that explain the lack of positive effects and suggests that evaluation problems may explain apparent negative…

Cancer Education Program Evaluation: A Responsive Approach to Planning an Evaluation and Initial Results.

ERIC Educational Resources Information Center

Pearsol, James A.

This paper describes evaluation planning for the Cancer Education Program (CEP) at Ohio State University (OSU). The three-year OSU CEP project was designed as a multidisciplinary cancer education program. A responsive method, which trades off some measurement precision in order to increase the usefulness of the findings, was employed in the…

Pennsylvania's Family Literacy Programs: Results of a Statewide Evaluation, 1999-2000.

ERIC Educational Resources Information Center

Van Horn, Barbara; Kassab, Cathy; Grinder, Elisabeth

Pennsylvania's family literacy programs were subjected to a statewide evaluation in 1999-2000. Data were collected through focus groups with parents, a survey of staff in community agencies and organizations, and analyses of program data and the findings of selected assessments administered to adults and children involved in the program.…

California's Past Programs to Support School and District Improvement: A Synthesis of Evaluation Studies

ERIC Educational Resources Information Center

California Collaborative on District Reform, 2017

2017-01-01

This document synthesizes the findings from the evaluations of four statewide programs designed to provide support for underperforming schools and districts in California as part of the state accountability system: (1) Immediate Intervention/Underperforming Schools Program (II/USP); (2) High Priority Schools Grant (HPSG) Program; (3) School…

An Experimental Health Education Program: Effects on Urban Primary Students.

ERIC Educational Resources Information Center

Andrews, Richard L.; Hearne, Jill T.

1986-01-01

Presents findings of an evaluation of a health education program for primary school students of low SES. Related findings to two dependent measures--attitudes toward smoking and knowledge about smoking and health. Reports that program participants displayed more positive attitudes toward good health practices than did non-participating control…

Toward Useful Program Evaluation in College Foreign Language Education

ERIC Educational Resources Information Center

Norris, John M., Ed.; Davis, John McE., Ed.; Sinicrope, Castle, Ed.; Watanabe, Yukiko, Ed.

2009-01-01

This volume reports on innovative, useful evaluation work conducted within U.S. college foreign language programs. An introductory chapter scopes out the territory, reporting key findings from research into the concerns, impetuses, and uses for evaluation that FL educators identify. Seven chapters then highlight examples of evaluations conducted…

Evaluation of the Meaning of Life Program in Israel

ERIC Educational Resources Information Center

Kasler, Jonathan; White, Gwyne W.; Elias, Maurice J.

2013-01-01

During the 2009-2010 academic year, 10 schools participated in the Meaning of Life educational program, an adaption of the popular U.S. Laws of Life program. The program sought to encourage each participant to develop a personal approach to finding meaning in life. To evaluate the success of the program, we conducted a study to compare measures of…

Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

PubMed

Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

2014-12-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.

Empowerment evaluation with programs designed to prevent first-time male perpetration of sexual violence.

PubMed

Noonan, Rita K; Gibbs, Deborah

2009-01-01

This special issue captures several threads in the ongoing evolution of sexual violence prevention. The articles that follow examine an empowerment evaluation process with four promising programs dedicated to preventing first-time male perpetration of sexual violence, as well as evaluation findings. Both the evaluation approach and the programs examined shed light on how sexual violence prevention can continue to be improved in the future.

Assessment of Program Impact Through First Grade, Volume III: Impact on Parents. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Morris, Mary; And Others

Third in a series of six, this volume reports findings concerning the impact of Project Developmental Continuity (PDC) on the parents of the evaluation study's cohort of children as well as preliminary findings on the relationship between family characteristics and program outcome variables up to the time the children had completed grade 1. Begun…

Improving Processual Quality in Early Education and Care: Process Findings from the Evaluation of the Benevolent Society's Partnerships in Early Education Program

ERIC Educational Resources Information Center

Valentine, Kylie; Thomson, Cathy

2009-01-01

This paper describes the facilitators and barriers to implementing an attachment-based intervention in early education and care settings, the Partnerships in Early Childhood program (PIEC), based on findings from the process evaluation of its first year of implementation. The paper focuses on four areas: the nature of the partnership and program…

Texas Educator Excellence Grant (TEEG) Program: Year Three Evaluation Report. Policy Evaluation Report

ERIC Educational Resources Information Center

Springer, Matthew G.; Lewis, Jessica L.; Podgursky, Michael J.; Ehlert, Mark W.; Gronberg, Timothy J.; Hamilton, Laura S.; Jansen, Dennis W.; Stecher, Brian M.; Taylor, Lori L.; Lopez, Omar S.; Peng, Art

2009-01-01

The Texas Educator Excellence Grant (TEEG) program was state-funded and provided annual grants to schools to design and implement performance pay plans during the 2006-07 to 2009-10 school year. This report builds on the previous TEEG evaluation reports, presenting findings from three years of the TEEG program. Overall, the report discusses the…

Applied Pluralism in the Evaluation of Employee Counselling.

ERIC Educational Resources Information Center

Goss, Stephen; Mearns, Dave

1997-01-01

Outlines the method, findings, and philosophical approach taken in a 22-month evaluation of an Employee Assistance Program. The program offered free counseling sessions, telephone support, in-service training, and conciliation work. Using an integrated pluralist evaluation, found that clients reported high satisfaction. Reduced absenteeism…

Dissemination: Handmaiden to Evaluation Use

ERIC Educational Resources Information Center

Lawrenz, Frances; Gullickson, Arlen; Toal, Stacie

2007-01-01

Use of evaluation findings is a valued outcome for most evaluators. However, to optimize use, the findings need to be disseminated to potential users in formats that facilitate use of the information. This reflective case narrative uses a national evaluation of a multisite National Science Foundation (NSF) program as the setting for describing the…

Visualizing ultrasound through computational modeling

NASA Technical Reports Server (NTRS)

Guo, Theresa W.

2004-01-01

The Doppler Ultrasound Hematocrit Project (DHP) hopes to find non-invasive methods of determining a person s blood characteristics. Because of the limits of microgravity and the space travel environment, it is important to find non-invasive methods of evaluating the health of persons in space. Presently, there is no well developed method of determining blood composition non-invasively. This projects hopes to use ultrasound and Doppler signals to evaluate the characteristic of hematocrit, the percentage by volume of red blood cells within whole blood. These non-invasive techniques may also be developed to be used on earth for trauma patients where invasive measure might be detrimental. Computational modeling is a useful tool for collecting preliminary information and predictions for the laboratory research. We hope to find and develop a computer program that will be able to simulate the ultrasound signals the project will work with. Simulated models of test conditions will more easily show what might be expected from laboratory results thus help the research group make informed decisions before and during experimentation. There are several existing Matlab based computer programs available, designed to interpret and simulate ultrasound signals. These programs will be evaluated to find which is best suited for the project needs. The criteria of evaluation that will be used are 1) the program must be able to specify transducer properties and specify transmitting and receiving signals, 2) the program must be able to simulate ultrasound signals through different attenuating mediums, 3) the program must be able to process moving targets in order to simulate the Doppler effects that are associated with blood flow, 4) the program should be user friendly and adaptable to various models. After a computer program is chosen, two simulation models will be constructed. These models will simulate and interpret an RF data signal and a Doppler signal.

Evaluating bacterial gene-finding HMM structures as probabilistic logic programs.

PubMed

Mørk, Søren; Holmes, Ian

2012-03-01

Probabilistic logic programming offers a powerful way to describe and evaluate structured statistical models. To investigate the practicality of probabilistic logic programming for structure learning in bioinformatics, we undertook a simplified bacterial gene-finding benchmark in PRISM, a probabilistic dialect of Prolog. We evaluate Hidden Markov Model structures for bacterial protein-coding gene potential, including a simple null model structure, three structures based on existing bacterial gene finders and two novel model structures. We test standard versions as well as ADPH length modeling and three-state versions of the five model structures. The models are all represented as probabilistic logic programs and evaluated using the PRISM machine learning system in terms of statistical information criteria and gene-finding prediction accuracy, in two bacterial genomes. Neither of our implementations of the two currently most used model structures are best performing in terms of statistical information criteria or prediction performances, suggesting that better-fitting models might be achievable. The source code of all PRISM models, data and additional scripts are freely available for download at: http://github.com/somork/codonhmm. Supplementary data are available at Bioinformatics online.

Literacy and Workplace Change: Evaluation Findings from Eighteen Workplace Literacy Programs

ERIC Educational Resources Information Center

Benseman, John

2012-01-01

Many Western governments are looking to workplace literacy, language, and numeracy programs to address general skill improvement with a longterm aim of improving labor productivity. Rigorous research on these programs' effectiveness for both of these agendas, however, remains sparse and limited in scope. This article reports the findings of an…

Partners in School Asthma Management: Evaluation of a Self-Management Program for Children with Asthma

ERIC Educational Resources Information Center

Bartholomew, L. Kay; Sockrider, Marianna M.; Abramson, Stuart L.; Swank, Paul R.; Czyzewski, Danita I.; Tortolero, Susan R.; Markham, Christine M.; Fernandez, Maria E.; Shegog, Ross; Tyrrell, Shellie

2006-01-01

The "Partners in School Asthma Management" program for inner-city elementary school children comprises (1) case finding; (2) linkage of school nurses, parents, and clinicians; (3) a computer-based tailored educational program; and (4) school environmental assessment and intervention. Case finding identified 1730 children in 60 elementary schools…

A Review of Findings from Two-Way Bilingual Education Evaluation Reports.

ERIC Educational Resources Information Center

Mahrer, Cindy; Christian, Donna

A review of 35 reports evaluating 27 two-way bilingual education programs is reported. All programs represented meet basic criteria for language of instruction, student characteristics, and emphasis on developing bilingualism. The review examined program characteristics and student outcomes, when available. Results are summarized in the following…

10 CFR 709.17 - Final disposition of CI evaluation findings and recommendations.

Code of Federal Regulations, 2010 CFR

2010-01-01

... recommendations. 709.17 Section 709.17 Energy DEPARTMENT OF ENERGY COUNTERINTELLIGENCE EVALUATION PROGRAM CI... Intelligence and Counterintelligence must recommend, in writing, to the appropriate Program Manager that the covered person's access be approved or retained, or denied or revoked. (b) If the Program Manager agrees...

Arts Integration and Students' Reading Achievement: A Formative Evaluation Study

ERIC Educational Resources Information Center

Hosfelt, Patricia D.

2017-01-01

The purpose of this dissertation was to evaluate essential components of an arts-integration program that may contribute to improved student achievement in elementary reading at the school of study through a formative evaluation. Stufflebeam's CIPP model of program evaluation served as the conceptual framework for the study's findings. Creative…

Students Training for Academic Readiness (STAR): Year Three Evaluation Report

ERIC Educational Resources Information Center

Rainey, Katharine; Sheehan, Daniel; Maloney, Catherine

2010-01-01

This report presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation considers…

The art of appropriate evaluation : a guide for highway safety program managers

DOT National Transportation Integrated Search

1999-05-01

This Guide provides an overview of the steps that are involved in program evaluations and gets you thinking about how these steps fit into your implementation plans. It also provides some handy suggestions on how to find and work with an evaluation c...

Evaluation of the School Breakfast Program Pilot Project: Findings from the First Year of Implementation. Nutrition Assistance Program Report Series.

ERIC Educational Resources Information Center

McLaughlin, Joan E.; Bernstein, Lawrence S.; Crepinsek, May Kay; Daft, Lynn M.; Murphy, J. Michael

In 1998, Congress authorized implementation of a 3-year pilot breakfast program involving 4,300 students in elementary schools in 6 school districts representing a range of economic and demographic characteristics. The program began in the 2000-01 school year. This lengthy report presents the findings from the pilot's first year. The study had two…

Putting program evaluation to work: a framework for creating actionable knowledge for suicide prevention practice.

PubMed

Wilkins, Natalie; Thigpen, Sally; Lockman, Jennifer; Mackin, Juliette; Madden, Mary; Perkins, Tamara; Schut, James; Van Regenmorter, Christina; Williams, Lygia; Donovan, John

2013-06-01

The economic and human cost of suicidal behavior to individuals, families, communities, and society makes suicide a serious public health concern, both in the US and around the world. As research and evaluation continue to identify strategies that have the potential to reduce or ultimately prevent suicidal behavior, the need for translating these findings into practice grows. The development of actionable knowledge is an emerging process for translating important research and evaluation findings into action to benefit practice settings. In an effort to apply evaluation findings to strengthen suicide prevention practice, the Centers for Disease Control and Prevention (CDC) and the Substance Abuse and Mental Health Services Administration (SAMHSA) supported the development of three actionable knowledge products that make key findings and lessons learned from youth suicide prevention program evaluations accessible and useable for action. This paper describes the actionable knowledge framework (adapted from the knowledge transfer literature), the three products that resulted, and recommendations for further research into this emerging method for translating research and evaluation findings and bridging the knowledge-action gap.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Traffic Control Device Evaluation Program : FY 2017

DOT National Transportation Integrated Search

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

A Snapshot of OST Programs in Philadelphia: An Evaluation of Eleven 21st Century Community Learning Center Grantees

ERIC Educational Resources Information Center

Gao, Jian; Hallar, Brittan; Hartmann, Tracey A.

2014-01-01

This report examines the 21st Century Community Learning Center (CCLC) programs evaluated by Research for Action (RFA) and presents an aggregate analysis of key findings to inform broader discussions about OST programs. The report addresses the following questions: (1) Who participated in the 21st CCLC programs and how frequently did they…

Crossroads Cafe: An ESOL Program for Adult Learners. Formative Evaluation Study, Summer 1996 Pilot Implementation.

ERIC Educational Resources Information Center

Spiegel, Seymour; Rayman, Irene C.

The reports presents findings of a formative evaluation of "Crossroads Cafe," an adult-level distance learning program designed to teach English to speakers of other languages (ESOL). The study focused on how 22 programs were implemented in 6 different regions of New York State. The program is a collaborative efforts of the Department of…

Pre-Placement Program for Severely Multi-Handicapped Deaf-Blind Children, 1980-1981. Final Evaluation Report.

ERIC Educational Resources Information Center

Tobias, Robert; And Others

Evaluation of the sixth and final year of operation for a preplacement program for 13 severely multiply handicapped deaf blind children, located in the Industrial Home for the Blind, is reported. The program is explained to prepare students for entrance into their existing special education programs. Qualitative findings on the physical setting,…

Evaluation of the Initial Impacts of the National Science Foundation's Integrative Graduate Education and Research Traineeship Program: Final Report

ERIC Educational Resources Information Center

Carney, Jennifer; Chawla, Deepika; Wiley, Autumn; Young, Denise

2006-01-01

This report summarizes findings from an evaluation of the impacts of the National Science Foundation's (NSF) Integrative Graduate Education and Research Traineeships (IGERT) program. Through support of interdisciplinary graduate education programs in Science, Technology, Engineering, and Mathematics, the IGERT program aims to educate U.S.…

Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

PubMed

MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

2006-01-01

The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

The National Cross-Site Evaluation of High-Risk Youth Programs. Preventing Substance Abuse: Major Findings from the National Cross-Site Evaluation of High-Risk Youth Programs. Monograph Series.

ERIC Educational Resources Information Center

Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Herman, Jack

This multiple-site study assessed 48 prevention programs for high-risk youth funded by the Center for Substance Abuse Prevention, identifying program characteristics associated with strong substance abuse prevention outcomes. Data analysis indicated that substance abuse programs reduced rates of substance use, and the positive effects of program…

Evaluation of Project P.A.T.H.S. (Secondary 1 Program) by the Program Participants: Findings Based on the Full Implementation Phase

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Sun, Rachel C. F.

2008-01-01

A total of 207 schools (N = 33,693 students) participated in the Secondary 1 Program of Project P.A.T.H.S. in the Full Implementation Phase (2006-07). Participants responded to a Subjective Outcome Evaluation Form (Form A) to assess their views of the program, instructors, and perceived effectiveness after program completion. Utilizing the…

Evaluation of an occupational rehabilitation program.

PubMed

Goodman, Glenn; Browning, Margaret; Campbell, Sims; Hudak, Huison

2005-01-01

The purpose of this study was to report the findings of a program evaluation for an occupational rehabilitation program in the Midwest. An ex-post facto chart review was performed on 50 charts using demographic data, results from tests of performance and pain measures, and data from patient satisfaction questionnaires to find evidence of excellence in the program, and to identify areas for improvement. Over 97% of the participants actually completed the program and 76% returned to work within 3 months after program completion. Ninety-two percent indicated overall satisfaction with the program, and all aspects of the program were rated with a mean score of 4.25 or above on a 1 to 5 Likert scale. Evaluation of perceived pain scales of the participants indicate no discernable relationship between intensity of pain and successful return to work. The program showed a high completion rate, a high return to work rate, and high levels of patient satisfaction. Suggestions for improvement include an increase in use of real and simulated work activities, better documentation of pain measures, better programs to address psychosocial issues, lengthening the program, and increased communication with case managers and professionals outside of the work program.

Teacher Attitudes about Performance Incentives in Texas: Early Reactions to the GEEG Program. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide educator incentive programs in Texas. Findings are based on surveys administered to GEEG teachers during the 2006-07 school year, the…

The Design of Schools' Performance Incentive Programs in Texas: Findings from Year One of GEEG. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide educator incentive programs in Texas. In this report, the authors provide an overview of 99 schools' locally designed educator…

What Works to Reduce Victimization? Synthesizing What We Know and Where to Go From Here.

PubMed

Fox, Kathleen A; Shjarback, John A

2016-01-01

While some attention has been paid to "what works" to reduce crime, little is known about the effectiveness of programs designed to reduce victimization. This study systematically reviews 83 program evaluations to identify what works to (a) reduce victimization, (b) enhance beliefs/attitudes about victims, and (c) improve knowledge/awareness of victimization issues. Evidence-based findings are organized around 4 major forms of victimization, including bullying, intimate partner violence, sexual abuse, and other general forms of victimization. Determining whether certain types of programs can reduce the risk of victimization has important implications for improving people's quality of life. Based on our findings, we offer several promising directions for the next generation of research on evaluating victimization programs. The goal of this study is to improve the strength of future program evaluations, replications, and other systematic reviews as researchers and practitioners continue to learn what works to reduce victimization.

Evaluation of the Refugee Targeted Assistance Grants Program: Phase I, Final Report.

ERIC Educational Resources Information Center

Cichon, Donald; And Others

This report presents findings of the first phase of an evaluation of the Targeted Assistance Program (TAP), A Federal program which funds services and projects that assist refugees in attaining economic self-sufficiency and reduced dependency upon public assistance. Following an executive summary and other materials, the report is divided into…

An Evaluation of a Community College Workforce-Training Program

ERIC Educational Resources Information Center

Duru-Nnebue, Thomisha M.

2012-01-01

This project study is an evaluation of a job-training program designed to serve unemployed adult learners at a community college. The program lacked empirical data about participants finding employment. The rationale for selecting the problem is the need to provide skill development and vocational training in response to high unemployment rates.…

Integrated Science in the Seychelles: An Evaluation.

ERIC Educational Resources Information Center

Brophy, Michael; Pillay, Patrick

1986-01-01

Provides an overview of the educational program of the Seychelles and focuses on an evaluation of the final phase (P7-P9) of the nine-year school program. Reports how findings from content analyses of materials, teacher and student interviews, and student test results were used to develop the new Seychelles Integrated Science program. (ML)

Evaluation of a Local Designated Driver and Responsible Server Program to Prevent Drinking and Driving.

ERIC Educational Resources Information Center

Simons-Morton, Bruce G.; Cummings, Sharon Snider

1997-01-01

Evaluates the impact of beverage servers' interventions at five establishments participating in the Houston Techniques for Effective Alcohol Management (TEAM) program. The intervention included server training, a designated-driver program, and "Safe Ride Home" taxi vouchers. Findings are discussed within the context of scant public and…

English-French Bilingual Education in the Early Grades: The Elgin Study

ERIC Educational Resources Information Center

Barik, Henri C.; Swain, Merrill

1974-01-01

Presents findings of an evaluation of an English-French bilingual education program using partial instruction in the second language in St. Thomas, Ontario. The evaluation covers grades 1-3. The program operates in unilingual English environment. (RM)

Evaluation of freeway motorist assist : staff summary, February 2010.

DOT National Transportation Integrated Search

2010-02-01

This research document builds on the previous Return on Investment (ROI) Study of Motorist Assist (1994) that evaluated the St. Louis Motor Assist program to establish and update current benefits of this program. The following is a summary of finding...

Oklahoma City FILM Even Start Family Literacy Program Evaluation, 2000-2001.

ERIC Educational Resources Information Center

Richardson, Donna Castle; Shove, Joanie; Brickman, Sharon; Terrell, Sherry; Shields, Jane

This report presents findings from the evaluation of the Oklahoma City Public Schools Even Start Program, also called the Family Intergenerational Literacy Model (FILM), now in its twelfth full year of operation. The evaluation focuses on the total population of adult students, preschoolers, adult graduates, and preschool graduates. The…

An Examination of Final Evaluation Methods Used in Master's Level Counseling Programs.

ERIC Educational Resources Information Center

Carney, Jamie S.; Cobia, Debra C.; Shannon, David M.

1998-01-01

Reports the findings of a national study examining methods used for final evaluation in master's level counseling programs. Suggests that as faculty review their policies and procedures with regard to student evaluation, these data may provide valuable information concerning methods selection, content, and delivery of feedback to students.…

Students Training for Academic Readiness (STAR): Year Three Evaluation Report. Executive Summary

ERIC Educational Resources Information Center

Texas Center for Educational Research, 2010

2010-01-01

This executive summary presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation…

Evaluation of Training Programs in Russian Manufacturing Companies

ERIC Educational Resources Information Center

Kucherov, Dmitry; Manokhina, Daria

2017-01-01

Purpose: This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels…

The Design of Schools' Performance Incentive Programs in Texas: Findings from Year One of TEEG. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Texas Educator Excellence Grant (TEEG) program, one of several statewide educator incentive programs in Texas. This report provides an overview of over 1,000 schools' locally designed TEEG performance incentive…

Teacher Attitudes about Performance Incentives in Texas: Early Reactions to the TEEG Program. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Texas Educator Excellence Grant (TEEG) program, one of several statewide educator incentive programs in Texas. Findings are based on the responses of full-time instructional personnel at over 1,000 TEEG schools…

New Findings on the Retention of Novice Teachers from Teaching Residency Programs. NCEE Evaluation Brief. NCEE 2015-4015

ERIC Educational Resources Information Center

Silva, Tim; McKie, Allison; Gleason, Philip

2015-01-01

This brief updates earlier study findings (Silva et al., 2014) regarding the extent to which teachers trained through teaching residency programs (TRPs) funded through the U.S. Department of Education's Teacher Quality Partnership grants program are retained in their districts and schools. TRPs prepare new teachers primarily through a year-long…

Formative Evaluation of ACES Program: Findings from Surveys and Interviews Year One, Grades 11 and 12

ERIC Educational Resources Information Center

Wolanin, Natalie; Modarresi, Shahpar

2015-01-01

The Office of Shared Accountability (OSA) in Montgomery County (Maryland) Public Schools (MCPS) is conducting a multiyear evaluation of the Achieving Collegiate Excellence and Success (ACES) program. The ACES program is a collaboration between MCPS, Montgomery College (MC), and the Universities at Shady Grove (USG) to create a seamless pathway…

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

ERIC Educational Resources Information Center

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

The Role of Training in the Evaluation of Public Programs

ERIC Educational Resources Information Center

Treiber, Jeanette; Kipke, Robin; Satterlund, Travis; Cassady, Diana

2013-01-01

Nearly all private, government and non-governmental organizations that receive government funding to run social or health promotion programs in the United States are required to conduct program evaluations and to report findings to the funding agency. Reports are usually due at the end of a funding cycle and they may or may not have an influence…

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

A statewide nurse training program for a hospital based infant abusive head trauma prevention program.

PubMed

Nocera, Maryalice; Shanahan, Meghan; Murphy, Robert A; Sullivan, Kelly M; Barr, Marilyn; Price, Julie; Zolotor, Adam

2016-01-01

Successful implementation of universal patient education programs requires training large numbers of nursing staff in new content and procedures and maintaining fidelity to program standards. In preparation for statewide adoption of a hospital based universal education program, nursing staff at 85 hospitals and 1 birthing center in North Carolina received standardized training. This article describes the training program and reports findings from the process, outcome and impact evaluations of this training. Evaluation strategies were designed to query nurse satisfaction with training and course content; determine if training conveyed new information, and assess if nurses applied lessons from the training sessions to deliver the program as designed. Trainings were conducted during April 2008-February 2010. Evaluations were received from 4358 attendees. Information was obtained about training type, participants' perceptions of newness and usefulness of information and how the program compared to other education materials. Program fidelity data were collected using telephone surveys about compliance to delivery of teaching points and teaching behaviors. Results demonstrate high levels of satisfaction and perceptions of program utility as well as adherence to program model. These findings support the feasibility of implementing a universal patient education programs with strong uptake utilizing large scale systematic training programs. Copyright © 2015 Elsevier Ltd. All rights reserved.

Model Energy Efficiency Program Impact Evaluation Guide

EPA Pesticide Factsheets

Find guidance on model approaches for calculating energy, demand, and emissions savings resulting from energy efficiency programs. It describes several standard approaches that can be used in order to make these programs more efficient.

A participatory evaluation model for Healthier Communities: developing indicators for New Mexico.

PubMed Central

Wallerstein, N

2000-01-01

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline findings. The evaluation model shows the links between process, community-level system impacts, and population health changes. PMID:10968754

Emergency Immigration Education Act Programs: Summer E.S.L. Welcome Plus Program for Students of Limited English Proficiency (LEP), Summer Bilingual Program, and Project Omega. OREA Report.

ERIC Educational Resources Information Center

Duque, Diana L.

This report presents findings of the evaluation by the New York City public school system's Office of Research, Evaluation, and Assessment of three programs (Summer E.S.L. Welcome Plus, Summer Bilingual, and Project Omega) for immigrant students. The Summer E.S.L. (English as a Second Language) Welcome Plus program operated at 19 sites in New York…

After-School Math PLUS (ASM+) Final Evaluation Report

ERIC Educational Resources Information Center

Academy for Educational Development, 2007

2007-01-01

This report summarizes findings from the Academy for Educational Development's (AED's) evaluation of After-School Math PLUS (ASM+). This program was designed to help students find the math in everyday experiences and create awareness about the importance of math skills for future career options. The evaluation was conducted by AED's Center for…

Community outreach: from measuring the difference to making a difference with health information*

PubMed Central

Ottoson, Judith M.; Green, Lawrence W.

2005-01-01

Background: Community-based outreach seeks to move libraries beyond their traditional institutional boundaries to improve both access to and effectiveness of health information. The evaluation of such outreach needs to involve the community in assessing the program's process and outcomes. Purpose: Evaluation of community-based library outreach programs benefits from a participatory approach. To explain this premise of the paper, three components of evaluation theory are paired with relevant participatory strategies. Concepts: The first component of evaluation theory is also a standard of program evaluation: use. Evaluation is intended to be useful for stakeholders to make decisions. A useful evaluation is credible, timely, and of adequate scope. Participatory approaches to increase use of evaluation findings include engaging end users early in planning the program itself and in deciding on the outcomes of the evaluation. A second component of evaluation theory seeks to understand what is being evaluated, such as specific aspects of outreach programs. A transparent understanding of the ways outreach achieves intended goals, its activities and linkages, and the context in which it operates precedes any attempt to measure it. Participatory approaches to evaluating outreach include having end users, such as health practitioners in other community-based organizations, identify what components of the outreach program are most important to their work. A third component of evaluation theory is concerned with the process by which value is placed on outreach. What will count as outreach success or failure? Who decides? Participatory approaches to valuing include assuring end-user representation in the formulation of evaluation questions and in the interpretation of evaluation results. Conclusions: The evaluation of community-based outreach is a complex process that is not made easier by a participatory approach. Nevertheless, a participatory approach is more likely to make the evaluation findings useful, ensure that program knowledge is shared, and make outreach valuing transparent. PMID:16239958

Non-formal educator use of evaluation results.

PubMed

Baughman, Sarah; Boyd, Heather H; Franz, Nancy K

2012-08-01

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.

Parents as Partners Program.

ERIC Educational Resources Information Center

Ryan, Thomas E.

1992-01-01

In September 1990, three programs (Family Study Institute, Saturday School Programs, and Evening Programs) to strengthen and improve parent-school partnerships and enhance communication were instituted in a racially integrated school district in Cook County, Illinois. Evaluation findings showed that parental involvement significantly enhanced…

The Brave New World of GEC Evaluation: The Experience of the Rhode Island Geriatric Education Center

ERIC Educational Resources Information Center

Filinson, Rachel; Clark, Phillip G.; Evans, Joann; Padula, Cynthia; Willey, Cynthia

2012-01-01

In 2007, the Health Resources Services Administration introduced new mandates that raised the standards on program evaluation for Geriatric Education Centers. Described in this article are the primary and secondary evaluation efforts undertaken for one program within the Rhode Island Geriatric Education Center (RIGEC), the findings from these…

Systematic review of qualitative evaluations of reentry programs addressing problematic drug use and mental health disorders amongst people transitioning from prison to communities.

PubMed

Kendall, Sacha; Redshaw, Sarah; Ward, Stephen; Wayland, Sarah; Sullivan, Elizabeth

2018-03-02

The paper presents a systematic review and metasynthesis of findings from qualitative evaluations of community reentry programs. The programs sought to engage recently released adult prison inmates with either problematic drug use or a mental health disorder. Seven biomedical and social science databases, Cinahl, Pubmed, Scopus, Proquest, Medline, Sociological abstracts and Web of Science and publisher database Taylor and Francis were searched in 2016 resulting in 2373 potential papers. Abstract reviews left 140 papers of which 8 were included after detailed review. Major themes and subthemes were identified through grounded theory inductive analysis of results from the eight papers. Of the final eight papers the majority (6) were from the United States. In total, the papers covered 405 interviews and included 121 (30%) females and 284 (70%) males. Findings suggest that the interpersonal skills of case workers; access to social support and housing; and continuity of case worker relationships throughout the pre-release and post-release period are key social and structural factors in program success. Evaluation of community reentry programs requires qualitative data to contextualize statistical findings and identify social and structural factors that impact on reducing incarceration and improving participant health. These aspects of program efficacy have implications for reentry program development and staff training and broader social and health policy and services.

Evaluation Study of Short-Term Programs at a Residential School for Students Who Are Blind and Visually Impaired

ERIC Educational Resources Information Center

Pogrund, Rona L.; Darst, Shannon; Boland, Teryl

2013-01-01

Introduction: The results of a 2009-2010 program evaluation study that examined parents, teachers of students with visual impairments, administrators, and students regarding overall satisfaction with and effectiveness of the short-term programs at a residential school for students who are blind and visually impaired are described. The findings are…

National Home Start Evaluation Interim Report VII. Twenty-Month Program Analysis and Findings.

ERIC Educational Resources Information Center

Love, John M.; And Others

This interim evaluation report focuses on process (formative) and outcome (summative) data collected in spring 1975 on the National Home Start Program. Home Start, a federally-funded 3-year (1972-1975) home-based demonstration program for low-income families with 3- to 5-year-old children was designed to enhance a mother's skills in dealing with…

Evaluation Report of a Detention-Based Student Disciplinary Program in a Honduran/International Primary School.

ERIC Educational Resources Information Center

Evans, Thomas J.

The Escuela Internacional Sampedrana (EIS) in Honduras implemented a new discipline program in its Primary School during the 1996-97 school year. This paper contains findings from three evaluations of the program--an initial analysis, a midyear report, and a year-end report. The first report analyzed the number of suspensions and detentions, as…

Adding to the Pool of Methods for Program Evaluation: A Comparison of Latent Class Analysis and Propensity Score Analysis

ERIC Educational Resources Information Center

Taylor, Lauren Christine

2013-01-01

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

Three Independent Evaluations of Healthy Kids Programs Find Substantial Gains in Children's Dental Health Care. In Brief, September 2008, Number 2

ERIC Educational Resources Information Center

Hughes, Dana; Howell, Embry; Trenholm, Christopher; Hill, Ian; Dubay, Lisa

2008-01-01

This brief presents highlights from rigorous, independent evaluations of the Healthy Kids programs in three California counties: Los Angeles, San Mateo, and Santa Clara. Launched by Children's Health Initiatives (CHIs) in these counties between 2001 and 2003, the three Healthy Kids programs provide children with comprehensive health insurance…

The Ergonomic Program Implementation Continuum (EPIC): integration of health and safety--a process evaluation in the healthcare sector.

PubMed

Baumann, Andrea; Holness, D Linn; Norman, Patrica; Idriss-Wheeler, Dina; Boucher, Patricia

2012-07-01

This article presents a health and safety intervention model and the use of process evaluation to assess a participatory ergonomic intervention. The effectiveness of the Ergonomic Program Implementation Continuum (EPIC) was assessed at six healthcare pilot sites in Ontario, Canada. The model provided a framework to demonstrate evaluation findings. Participants reported that EPIC was thorough and identified improvements related to its use. Participants believed the program contributed to advancing an organizational culture of safety (COS). Main barriers to program uptake included resistance to change and need for adequate funding and resources. The dedication of organizational leaders and consultant coaches was identified as essential to the program's success. In terms of impact on industry, findings contribute to the evidence-based knowledge of health and safety interventions and support use of the framework for creating a robust infrastructure to advance organizational COS and link staff safety and wellness with patient safety in healthcare. Copyright © 2012 National Safety Council and Elsevier Ltd. All rights reserved.

POLLUTION PREVENTION POSSIBILITIES FOR SMALL AND MEDIUM-SIZED INDUSTRIES: RESULTS OF THE WRITE PROJECTS

EPA Science Inventory

The Waste Reduction Innovative Technology Evaluation Program (WRITE) was a pilot program with six (6) states and one (1) local government, to identify priority needs at the respective governmental level, find promising waste minimization technologies and perform an evaluation to ...

Findings of the District English Program Evaluation Committee.

ERIC Educational Resources Information Center

Price, A. Rae; And Others

In summer 1990, the English Department of the Metropolitan Community College District (MCCD) in Missouri conducted a self-study to determine whether the English program's subject matter, academic standards, and methods of instruction were consistent with objectives. An Evaluation Committee, consisting of three English instructors representing each…

Enhancing Sustainability Curricula through Faculty Learning Communities

ERIC Educational Resources Information Center

Natkin, L. W.; Kolbe, Tammy

2016-01-01

Purpose: Although the number of higher education institutions adopting sustainability-focused faculty learning communities (FLCs) has grown, very few of these programs have published evaluation research. This paper aims to report findings from an evaluation of the University of Vermont's (UVM's) sustainability faculty fellows (SFF) program. It…

Evaluative Thinking in Practice: The National Asthma Control Program.

PubMed

Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

Evaluation of Demonstrations of National School Lunch Program and School Breakfast Program Direct Certification of Children Receiving Medicaid Benefits: Access Evaluation Report

ERIC Educational Resources Information Center

Hulsey, Lara; Gordon, Anne; Leftin, Joshua; Beyler, Nicholas; Schirm, Allen; Smither-Wulsin, Claire; Crumbley, Will

2015-01-01

This report presents findings from the Access Evaluation, a study component that is designed to assess the potential impacts of direct certification-Medicaid (DC-M) on students' access to free school meals by conducting retrospective simulations of DC-M in school year 2011-2012, the year before the demonstration began. For the Access Evaluation,…

Summer 1976 Program for Deaf Children: Evaluation Report, Evaluation Period, July 2-August 13, 1976.

ERIC Educational Resources Information Center

Minton, Judith

The evaluation of a summer project for 110 deaf children (5-14 years old) describes findings in terms of project objectives. Analysis of objectives is said to indicate that intellectual growth took place for most of the Ss during the program and that the success ratio for achieving mastery was high. Eight recommendations are listed, including…

Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

ERIC Educational Resources Information Center

Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

2012-01-01

This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…

A Critical Meta-Analysis of All Evaluations of State-Funded Preschool from 1977 to 1998: Implications for Policy, Service Delivery and Program Evaluation.

ERIC Educational Resources Information Center

Gilliam, Walter S.; Zigler, Edward F.

2000-01-01

Presents a meta-analytic review of evaluations of state-funded preschool programs over 20 years. Identifies several methodological flaws but also suggests that pattern of findings offers modest support for positive impact in improving children's developmental competence, improving later school attendance and performance, and reducing subsequent…

The promise and challenge of practice-research collaborations: Guiding principles and strategies for initiating, designing, and implementing program evaluation research.

PubMed

Secret, Mary; Abell, Melissa L; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations, and building on their experiences in successfully completing a community-based research evaluation, the authors identify specific relationship-focused principles and strategies and illustrate how these approaches can guide practice-research teams through the various sequential activities of the evaluation research process. In particular, it is suggested that practice-research collaborations can be formed, strengthened, and sustained by emphasis on a spirit of discovery and shared leadership at the start of the relationship, use of a comprehensive evaluation model to clarify and frame the evaluation and program goals, beginning where the client is when selecting research methodology and measurement tools, commitment to keeping the program first and recording everything during the implementation and data-collection stages, discussion of emerging findings and presentation of findings in graphic format at the data-analysis stage, and a total team approach at the dissemination stage.

Program theory-driven evaluation science in a youth development context.

PubMed

Deane, Kelsey L; Harré, Niki

2014-08-01

Program theory-driven evaluation science (PTDES) provides a useful framework for uncovering the mechanisms responsible for positive change resulting from participation in youth development (YD) programs. Yet it is difficult to find examples of PTDES that capture the complexity of such experiences. This article offers a much-needed example of PTDES applied to Project K, a youth development program with adventure, service-learning and mentoring components. Findings from eight program staff focus groups, 351 youth participants' comments, four key program documents, and results from six previous Project K research projects were integrated to produce a theory of change for the program. A direct logic analysis was then conducted to assess the plausibility of the proposed theory against relevant research literature. This demonstrated that Project K incorporates many of the best practice principles discussed in the literature that covers the three components of the program. The contributions of this theory-building process to organizational learning and development are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Can Local Voluntary Environmental Programs "Work"? An Examination of Fort Collins' (Colorado) Climate Wise Program

NASA Astrophysics Data System (ADS)

Samantha, Mosier; Jonathan, Fisk

2013-05-01

Previous research on voluntary environmental programs (VEPs) frequently assesses the effectiveness of federal, state, and third party programs and why organizations seek to join such programs. Yet, research has yet to evaluate the effectiveness or firm motivation relative to local VEPs. Recognizing this gap, our paper examines the structure and organization of Fort Collins' Climate Wise program, a local VEP. Using a variety of sources, we find that the program has successfully met both short- and long-term goals by persistently self-evaluating and seeking outside financial support. Findings from this analysis can aid in understanding and developing local VEPs elsewhere. Specifically, this initial research suggests that local VEPs need to consider local context and available resources when implementing such programs. Furthermore, it is possible for local VEPs to attract a diverse variety of participating firms by avoiding one-size-fits-all participation levels and by establishing a sense of ownership among partners.

Can local voluntary environmental programs "work"? An examination of Fort Collins' (Colorado) climate wise program.

PubMed

Mosier, Samantha; Samantha, Mosier; Fisk, Jonathan; Jonathan, Fisk

2013-05-01

Previous research on voluntary environmental programs (VEPs) frequently assesses the effectiveness of federal, state, and third party programs and why organizations seek to join such programs. Yet, research has yet to evaluate the effectiveness or firm motivation relative to local VEPs. Recognizing this gap, our paper examines the structure and organization of Fort Collins' Climate Wise program, a local VEP. Using a variety of sources, we find that the program has successfully met both short- and long-term goals by persistently self-evaluating and seeking outside financial support. Findings from this analysis can aid in understanding and developing local VEPs elsewhere. Specifically, this initial research suggests that local VEPs need to consider local context and available resources when implementing such programs. Furthermore, it is possible for local VEPs to attract a diverse variety of participating firms by avoiding one-size-fits-all participation levels and by establishing a sense of ownership among partners.

10 CFR 709.17 - Final disposition of CI evaluation findings and recommendations.

Code of Federal Regulations, 2014 CFR

2014-01-01

... and recommendations. (a) Following completion of a CI evaluation, the Director of the Office of Intelligence and Counterintelligence must recommend, in writing, to the appropriate Program Manager that the covered person's access be approved or retained, or denied or revoked. (b) If the Program Manager agrees...

Evaluating the Effectiveness of Student Assistance Programs in Pennsylvania.

ERIC Educational Resources Information Center

Fertman, Carl I.; Fichter, Cele; Schlesinger, Jo; Tarasevich, Susan; Wald, Holly; Zhang, Xiaoyan

2001-01-01

This evaluation of the Pennsylvania Student Assistance Program (SAP) was conducted to determine overall efficacy of SAPs and, more specifically, how SAP is currently implemented. Findings indicate that SAP is being implemented as designed. Recommended is the development of benchmarks and indicators focusing on best SAP practices and effectiveness.…

Science: It's Elementary. Year Four Evaluation Report

ERIC Educational Resources Information Center

Banilower, Eric R.; Fulp, Sherri L.; Warren, Camille L.

2010-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program during the period from July 2009 through June 2010. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education (PDE). SIE is an initiative aimed at improving elementary…

Science: It's Elementary. Year Two Evaluation Report

ERIC Educational Resources Information Center

Banilower, Eric R.; Fulp, Sherri L.; Warren, Camille L.

2008-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program in the period June 2007 through May 2008. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education. SIE is an initiative aimed at improving elementary science instruction…

Science: It's Elementary. Year Three Evaluation Report

ERIC Educational Resources Information Center

Fulp, Sherri L.; Warren, Camille L.; Banilower, Eric R.

2009-01-01

This report summarizes the activities and findings of the external evaluation of the "Science: It's Elementary" (SIE) program during the period from July 2008 through June 2009. The SIE program is managed by ASSET Inc. and overseen by the Pennsylvania Department of Education. SIE is an initiative aimed at improving elementary science…

Advancing Achievement: Findings from an Independent Evaluation of a Major After-School Initiative

ERIC Educational Resources Information Center

Arbreton, Amy; Sheldon, Jessica; Bradshaw, Molly; Goldsmith, Julie

2008-01-01

This report presents outcomes from Public/Private Ventures research on CORAL, an eight-year, $58 million after-school initiative of The James Irvine Foundation. Findings described in the report demonstrate the relationship between high-quality literacy programming and academic gains and underscore the potential role that quality programs may play…

Program Evaluation Report for Sulphur Springs Independent School District Project STYLE (Students and Teachers Yearning to Learn Effectively) 2004-2005

ERIC Educational Resources Information Center

Combs, Julie P.; Jackson, Sherion H.

2005-01-01

The purpose of this paper is to present findings from a program evaluation conducted to examine the effectiveness of the Schools Attuned program in a north Texas school district. Schools Attuned was developed by a professor of pediatrics, Dr. Mel Levine (2002), as a professional development model to train teachers to identify cognitive and…

What works in family planning interventions: A systematic review of the evidence

PubMed Central

Mwaikambo, Lisa; Speizer, Ilene S.; Schurmann, Anna; Morgan, Gwen; Fikree, Fariyal

2013-01-01

This study presents findings from a systematic review of evaluations of family planning interventions published between 1995 and 2008. Studies that used an experimental or quasi-experimental design or had another way to attribute program exposure to observed changes in fertility or family planning outcomes at the individual or population levels were included and ranked by strength of evidence. A total of 63 studies were found that met the inclusion criteria. The findings from this review are summarized in tabular format by the type of intervention (classified as supply-side or demand-side). About two-thirds of the studies found were on demand generation type-programs. Findings from all programs revealed significant improvements in knowledge, attitudes, discussion, and intentions. Program impacts on contraceptive use and use of family planning services were less consistently found and less than half of the studies that measured fertility or pregnancy-related outcomes found an impact. Based on the review findings, we identify promising programmatic approaches and propose directions for future evaluation research of family planning interventions. PMID:21834409

Employer evaluations of nurse graduates: a critical program assessment element.

PubMed

Ryan, M E; Hodson, K E

1992-05-01

Accountability in higher education dictates implementation of a comprehensive evaluation plan. Employer evaluation of graduates is an important component of program evaluation and contributes a different view that is rarely reported in the literature. The purpose of this study was to establish a database by surveying employers of baccalaureate-prepared nurses, postgraduation, over a five-year period. Employer surveys measured perceptions of graduates' functioning. Findings indicated that graduates function above expected levels for leadership skills, nursing skills, communication skills, and professionalism. Systematic program evaluation by employers is recommended at one and five years after graduation. A tool for employer evaluation of baccalaureate graduates is discussed.

Finding and Evaluating Online Resources on Complementary Health Approaches

MedlinePlus

... it selling something? Finding Health Information on the Internet: How To Start To find accurate health information, ... thousands of mobile apps (a software program you access using your phone or other mobile device) that ...

Collaborative evaluation of a high school prevention curriculum: How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement.

PubMed

Orsini, Muhsin Michael; Wyrick, David L; Milroy, Jeffrey J

2012-11-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome variables that can be used for program improvement. Throughout this project there were many examples of client learning from evaluator and evaluator learning from client. This article presents convincing evidence that collaborative evaluation can improve the design, implementation, and findings of the randomized control trial. Throughout this paper, we discuss many examples of good science, good evaluation, and other practical benefits of practicing collaborative evaluation. Ultimately, the authors created the term pre-formative evaluation to describe the period prior to data collection and before program implementation, when collaborative evaluation can inform program improvement. Copyright © 2012 Elsevier Ltd. All rights reserved.

Applying to the DC Opportunity Scholarship Program: How Do Parents Rate Their Children's Current Schools at Time of Application and What Do They Want in New Schools? NCEE Evaluation Brief. NCEE 2016-4003

ERIC Educational Resources Information Center

Dynarski, Mark; Betts, Julian; Feldman, Jill

2016-01-01

The DC Opportunity Scholarship Program (OSP), established in 2004, is the only federally-funded private school voucher program for low-income parents in the United States. This evaluation brief describes findings using data from more than 2,000 applicants' parents, who applied to the program from spring 2011 to spring 2013 following…

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Designing faculty development to support the evaluation of resident competency in the intrinsic CanMEDS roles: practical outcomes of an assessment of program director needs.

PubMed

Puddester, Derek; MacDonald, Colla J; Clements, Debbie; Gaffney, Jane; Wiesenfeld, Lorne

2015-06-05

The Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada mandate that faculty members demonstrate they are evaluating residents on all CanMEDS (Canadian Medical Education Directions for Specialists) roles as part of the accreditation process. Postgraduate Medical Education at the University of Ottawa initiated a 5-year project to develop and implement a comprehensive system to assess the full spectrum of CanMEDS roles. This paper presents the findings from a needs assessment with Program Directors, in order to determine how postgraduate medical faculty can be motivated and supported to evaluate residents on the intrinsic CanMEDS roles. Semi-structured individual interviews were conducted with 60 Postgraduate Program Directors in the Faculty of Medicine. Transcribed interviews were analyzed using qualitative analysis. Once the researchers were satisfied the identified themes reflected the views of the participants, the data was assigned to categories to provide rich, detailed, and comprehensive information that would indicate what faculty need in order to effectively evaluate their residents on the intrinsic roles. Findings indicated faculty members need faculty development and shared point of care resources to support them with how to not only evaluate, but also teach, the intrinsic roles. Program Directors expressed the need to collaborate and share resources across departments and national specialty programs. Based on our findings, we designed and delivered workshops with companion eBooks to teach and evaluate residents at the point of care (Developing the Professional, Health Advocate and Scholar). Identifying stakeholder needs is essential for designing effective faculty development. By sharing resources, faculties can prevent 'reinventing the wheel' and collaborate to meet the Colleges' accreditation requirements more efficiently.

7 CFR 295.4 - Program evaluation status reports.

Code of Federal Regulations, 2011 CFR

2011-01-01

... completed studies may be obtained by writing the Director, Office of Analysis and Evaluation, Food and... evaluation status reports. FNS also publishes summaries of objectives and findings of completed studies and...

Development of a Teen-Friendly Health Education Program on Facebook: Lessons Learned.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E

2016-01-01

Facebook is the most popular online platform among adolescents and can be an effective medium to deliver health education. Although Korean American (KA) adolescents are at risk of obesity, a culturally tailored health education program is not available for them. Thus, our research team developed a health education program for KA adolescents on Facebook called "Healthy Teens." The aim of this study was to discuss important lessons learned through the program development process. This program includes culturally tailored learning modules about healthy eating and physical activity. The program was developed on the basis of the social cognitive theory, and the online program was developed by applying Web usability principles for adolescents. Upon completion, the usability of the program was assessed using heuristic evaluation. The findings from the heuristic evaluation showed that the Healthy Teens program was usable for KA adolescents. The findings from this study will assist researchers who are planning to build similar Facebook-based health education programs. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Assessment of Program Impact Through First Grade, Volume V: Impact on Children. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Berrueta-Clement, John; And Others

Fifth in a series of six volumes reporting outcomes of the preliminary evaluation of an educational intervention, this report presents the findings of the effects of Project Developmental Continuity (PDC) up to the time the evaluation study's cohort of children completed grade 1. Preliminary findings concerning the relationship between variables…

Treating Substance-Using Women and Their Children in Public Housing: Preliminary Evaluation Findings.

ERIC Educational Resources Information Center

Metsch, Lisa R.; Wolfe, Harlan P.; Fewell, Rebecca; McCoy, Clyde B.; Elwood, William N.; Wohler-Torres, Brad; Petersen-Baston, Pamela; Haskins, Henry V.

2001-01-01

SafePort is a residential substance abuse treatment program within public housing to provide drug treatment to parenting women in Key West, Florida. All family members--women, children, and significant others--receive comprehensive assessments to determine appropriate therapeutic interventions. Preliminary evaluation findings suggest that women…

44 CFR 19.110 - Remedial and affirmative action and self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... affirmative action and self-evaluation. (a) Remedial action. If the designated agency official finds that a... effects of such discrimination. (b) Affirmative action. In the absence of a finding of discrimination on the basis of sex in an education program or activity, a recipient may take affirmative action...

36 CFR 1211.110 - Remedial and affirmative action and self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... affirmative action and self-evaluation. (a) Remedial action. If the designated agency official finds that a... effects of such discrimination. (b) Affirmative action. In the absence of a finding of discrimination on the basis of sex in an education program or activity, a recipient may take affirmative action...

36 CFR 1211.110 - Remedial and affirmative action and self-evaluation.

Code of Federal Regulations, 2011 CFR

2011-07-01

... affirmative action and self-evaluation. (a) Remedial action. If the designated agency official finds that a... effects of such discrimination. (b) Affirmative action. In the absence of a finding of discrimination on the basis of sex in an education program or activity, a recipient may take affirmative action...

44 CFR 19.110 - Remedial and affirmative action and self-evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... affirmative action and self-evaluation. (a) Remedial action. If the designated agency official finds that a... effects of such discrimination. (b) Affirmative action. In the absence of a finding of discrimination on the basis of sex in an education program or activity, a recipient may take affirmative action...

More, but Not Yet Better: An Evaluation of USAID's Programs and Policies To Improve Girls' Education. USAID Program and Operations Assessment Report No. 25.

ERIC Educational Resources Information Center

O'Gara, Chloe; Benoliel, Sharon; Sutton, Margaret; Tietjen, Karen

This report evaluates U.S. Agency for International Development (USAID) efforts to improve basic education for girls. The evaluation drew on field studies in: Guatemala, Guinea, Malawi, Nepal, and Pakistan; a country desk study of Egypt; issue-oriented research on Bolivia and Thailand; and a literature review. Findings indicate that effective…

Culturally Competent Research with American Indians and Alaska Natives: Findings and Recommendations of the First Symposium of the Work Group on American Indian Research and Program Evaluation Methodology

ERIC Educational Resources Information Center

Caldwell, Joyce Y.; Davis, Jamie D.; Du Bois, Barbara; Echo-Hawk, Holly; Erickson, Jill Shepard; Goins, R. Turner; Hill, Calvin; Hillabrant, Walter; Johnson, Sharon R.; Kendall, Elizabeth; Keemer, Kelly; Manson, Spero M.; Marshall, Catherine A.; Running Wolf, Paulette; Santiago, Rolando L.; Schacht, Robert; Stone, Joseph B.

2005-01-01

This article describes the collective experience of a multidisciplinary network of researchers, practitioners, and program evaluators who support appropriate research and evaluation methods in working with Native peoples. Our experience underlines the critical importance of culture in understanding and conducting research with the diverse…

Positioning Continuing Education Computer Programs for the Corporate Market.

ERIC Educational Resources Information Center

Tilney, Ceil

1993-01-01

Summarizes the findings of the market assessment phase of Bellevue Community College's evaluation of its continuing education computer training program. Indicates that marketing efforts must stress program quality and software training to help overcome strong antiacademic client sentiment. (MGB)

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

Findings of a Formative Evaluation of a Transitional Housing Program for Forensic Patients Discharged into the Community

ERIC Educational Resources Information Center

Cherner, Rebecca; Nandlal, Joan; Ecker, John; Aubry, Tim; Pettey, Donna

2013-01-01

Using results from a formative evaluation, this article describes the transitional rehabilitation housing pilot (TRHP) program located in two metropolitan Canadian cities. TRHP is an innovative community mental health service, created to support hospitalized forensic patients in their transition to living independently in the community. The…

Community Jobs Outcomes Assessment & Program Evaluation.

ERIC Educational Resources Information Center

Case, Annette; Burchfield, Erin; Sommers, Paul

Unemployment wage data were evaluated to assess employment, job retention, and wage progression for graduates of Community Jobs (CJ), a short-term public job creation program for the hard to employ in the state of Washington. The following were among the findings: (1) 66% of all participants were employed after graduating from CJ; (2) 53% were…

Becoming Adults: One-Year Impact Findings from the Youth Villages Transitional Living Evaluation

ERIC Educational Resources Information Center

Valentine, Erin Jacobs; Skemer, Melanie; Courtney, Mark E.

2015-01-01

The "Youth Villages Transitional Living Evaluation" is testing whether the "Transitional Living" program, operated by the social service organization Youth Villages, makes a difference in the lives of young people with histories of foster care or juvenile justice custody. The program, which was renamed "YVLifeSet" in…

Preparing Youth for College and Career: A Process Evaluation of Urban Alliance

ERIC Educational Resources Information Center

Theodos, Brett; Pergamit, Michael R.; Edelstein, Sara; George, Taz; Freiman, Lesley

2014-01-01

This report presents baseline and process study findings of an evaluation of the Urban Alliance high school internship program, which provides training, mentoring, and work experience to high school seniors from distressed communities in Washington, DC, Baltimore, Northern Virginia, and Chicago. The report, which focuses on the program's…

Desirable Qualifications for Personnel Conducting Educational Program Evaluations and Audits.

ERIC Educational Resources Information Center

Newman, Warren B.

A study was made of professional qualifications for personnel employed as program evaluators and auditors. These qualifications, according to operational or theoretical models, are necessary to assure local school districts of obtaining the services of competent and ethical personnel. Findings of (1) a review of literature, (2) a national survey…

Evaluation of Child Care Subsidy Strategies: Massachusetts Family Child Care Study

ERIC Educational Resources Information Center

Collins, Ann; Goodson, Barbara; Luallen, Jeremy; Fountain, Alyssa Rulf; Checkoway, Amy

2010-01-01

This report presents findings from the Massachusetts Family Child Care study, a two-year evaluation of the impacts of an early childhood education program on providers and children in family child care. The program--"LearningGames"--is designed to train caregivers to stimulate children's cognitive, language, and social-emotional…

More than a Conversation: Using Cogenerative Dialogues in the Professional Development of High School Chemistry Teachers

ERIC Educational Resources Information Center

Martin, Sonya N.; Scantlebury, Kathryn

2009-01-01

This paper focuses on content-based and pedagogical instructors' use of cogenerative dialogues to improve instructional practice and to evaluate program effectiveness in a professional development program for high school chemistry teachers. We share our research findings from using cogenerative dialogues as an evaluative tool for general…

A Randomized Evaluation of the Success for All Middle School Reading Program

ERIC Educational Resources Information Center

Chamberlain, Anne; Daniels, Cecelia; Madden, Nancy A.; Slavin, Robert E.

2007-01-01

This article describes a randomized evaluation of The Reading Edge, a reading program for middle school students. The Reading Edge was designed to integrate findings of research on cooperative learning and metacognitive reading strategies into a replicable reading instructional package that could be implemented effectively in Title I middle…

Online Extensive Reading for Advanced Foreign Language Learners: An Evaluation Study

ERIC Educational Resources Information Center

Arnold, Nike

2009-01-01

The following article reports the findings of a qualitative evaluation of an online extensive reading program in German as a foreign language. Designed for advanced learners, it differs from traditional extensive reading programs in two important aspects: students read online instead of printed materials, and there was no teacher preselection to…

Findings From a Prospective Randomized Controlled Trial of an Individualized Music Listening Program for Persons With Dementia.

PubMed

Kwak, Jung; Anderson, Keith; O'Connell Valuch, Katharine

2018-06-01

Music & Memory (M&M) is a passive music intervention that uses personalized music playlists delivered on digital music players. This program has been increasingly adopted in nursing homes across the United States to facilitate communication, engagement, and socialization among persons with dementia (PWDs); however, few studies have evaluated the program's effect on PWDs' outcomes. In the present study, a randomized controlled crossover design was used to examine the impact of the M&M program on 59 PWDs in 10 nursing homes over a 14-week period. Residents' evaluated outcomes included agitation, behavioral symptoms, and use of psychotropic medications. Although trends supported the positive effects of M&M, no statistically significant differences were found in any of the outcomes measured over time. Methodological limitations withstanding, these findings call into question the effectiveness of the M&M program and the ability of facility staff to implement this intervention with fidelity.

Strengthening community leadership: evaluation findings from the california healthy cities and communities program.

PubMed

Kegler, Michelle C; Norton, Barbara L; Aronson, Robert E

2008-04-01

Collaborative approaches to community health improvement such as healthy cities and communities have the potential to strengthen community capacity through leadership development. The healthy cities and communities process orients existing local leadership to new community problem-solving strategies and draws out leadership abilities among residents not previously engaged in civic life. In an evaluation of the California Healthy Cities and Communities (CHCC) Program, leadership development was one of several outcomes assessed at the civic-participation level of the social ecology. Data collection methods included focus groups and surveys, semistructured interviews with coordinators and community leaders, and review of program documents. Findings suggest that the CHCC program enhanced capacity by expanding new leadership opportunities through coalition participation, program implementation, and civic leadership roles related to spin-off organizations and broader collaborative structures. Communities in rural regions were particularly successful in achieving significant leadership outcomes.

Using Qualitative Methods to Evaluate a Family Behavioral Intervention for Type 1 Diabetes

PubMed Central

Herbert, Linda Jones; Sweenie, Rachel; Kelly, Katherine Patterson; Holmes, Clarissa; Streisand, Randi

2013-01-01

Introduction The objectives of this study were to qualitatively evaluate a dyadic adolescent-parent type 1 diabetes (T1D) program developed to prevent deterioration in diabetes care among adolescents with T1D and provide recommendations for program refinement. Method Thirteen adolescent-parent dyads who participated in the larger RCT, the TeamWork Project, were interviewed regarding their perceptions of their participation in the program and current T1D challenges. Interviews were transcribed and coded to establish broad themes. Results Adolescents and parents thought the TeamWork Project sessions were helpful and taught them new information. Five themes catalog findings from the qualitative interviews: TeamWork content, TeamWork structure, transition of responsibility, current and future challenges, and future intervention considerations. Discussion Addressing T1D challenges as a parent-adolescent dyad via a behavioral clinic program is helpful to families during adolescence. Findings highlight the utility of qualitative evaluation to tailor interventions for the unique challenges related to pediatric chronic illness. PMID:24269281

Investigating the criteria and processes used in the selection, implementation, and evaluation of STEM within K-12 education

NASA Astrophysics Data System (ADS)

Delp, Matthew J.

This study utilized survey research to investigate how school districts within K-12 education select, implement, and evaluate Science, Technology, Engineering, and Mathematics (STEM) programs. Thirty school districts within the Math and Science Collaborative located in Western Pennsylvania participated in this research. In addition to characterizing the STEM programs of the participating school districts, this study also analyzed the alignment of these programs to the components of comprehensive STEM programs and critical approaches to substantiate STEM program implementation as stated in the literature (Augustine, 2005; Bybee, 2010a, 2010b; Carnevale et al., 2011; DeJarnette, 2010; Epstein & Miller, 2011b; Gardner et al., 1983; Hossain & Robinson, 2011, 2012; Kuenzi, 2008). Findings suggest that the primary goal for school districts, as it relates to STEM program implementation, is to influence students' interest and pursuit of STEM-related careers and degrees. In order to achieve this goal, results of this study indicate the focus of STEM program implementation occurs with the greatest frequency at the middle school (grades seven and eight) level, are developed as an adaptation to the curriculum, and are very diverse from one school district to the next. In addition, findings suggest that although school districts maintain they aim to promote careers and degrees in STEM, districts rely on traditional methods of evaluating STEM program implementation (i.e. standardized test scores) and do not track the longitudinal impact their STEM programs as they related to degrees and careers in STEM. Furthermore, results indicate district STEM programs are not aligned to the characteristics of comprehensive STEM programs as defined by the literature. In order to address the misalignment of school district goals and evaluation processes involved in STEM program implementation and the absence of the characteristics commensurate with comprehensive STEM programs, this study has created a framework to guide school districts in STEM program selection, implementation, and evaluation.

Assessment of Program Impact Through First Grade, Volume IV: Impact on Teachers. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Wacker, Sally; And Others

The fourth in a series reporting evaluation findings on the impact of Project Developmental Continuity (PDC), this volume reports treatment-related and other findings concerning teachers and classrooms up to the time the evaluation study's cohort of children had completed grade 1. Begun at 15 sites in 1974 with the purpose of ensuring that…

34 CFR 303.302 - Comprehensive child find system.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 34 Education 2 2012-07-01 2012-07-01 false Comprehensive child find system. 303.302 Section 303... TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and Individualized Family Service Plans Pre-Referral Procedures-Public Awareness Program and Child Find System § 303.302 Comprehensive child...

34 CFR 303.302 - Comprehensive child find system.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 34 Education 2 2013-07-01 2013-07-01 false Comprehensive child find system. 303.302 Section 303... TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and Individualized Family Service Plans Pre-Referral Procedures-Public Awareness Program and Child Find System § 303.302 Comprehensive child...

34 CFR 303.302 - Comprehensive child find system.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 34 Education 2 2014-07-01 2013-07-01 true Comprehensive child find system. 303.302 Section 303.302... TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and Individualized Family Service Plans Pre-Referral Procedures-Public Awareness Program and Child Find System § 303.302 Comprehensive child...

Evaluation Program on the Implementation of Industrial Apprenticeship (Prakerin) in Electrical Engineering

NASA Astrophysics Data System (ADS)

Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.

2018-02-01

This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.

Correlates of quality educational programs.

PubMed

Chester, Deborah R; Tracy, Jessamyn A; Earp, Emily; Chauhan, Reetu

2002-06-01

Preliminary evaluation findings are presented that explore relationships between educational program quality and program characteristics such as program type, security level, aftercare, teacher certification, facility size, and private versus public provider. Several program characteristics are found to be related to measurements of educational program quality. Among the major quality characteristics are proportion of program teachers that are professionally certified, smaller sized facilities versus larger facilities, level of aftercare services, and provider sources, with private for-profit providers being the lowest performing and public providers being the highest performing. The article closes with description of the Juvenile Justice Educational Enhancement Program's continuing evaluation of correlates to educational program quality through the continued development of a comprehensive database.

Evaluative Thinking in Practice: The National Asthma Control Program

PubMed Central

Fierro, Leslie A.; Codd, Heather; Gill, Sarah; Pham, Phung K.; Grandjean Targos, Piper T.; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings—specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention’s National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs’ evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts. PMID:29950803

School Libraries and Language Skills in Indian Primary Schools: A Randomized Evaluation of the Akshara Library Program. NBER Working Paper No. 18183

ERIC Educational Resources Information Center

Borkum, Evan; He, Fang; Linden, Leigh L.

2012-01-01

We conduct a randomized evaluation of a school library program on children's language skills. We find that the program had little impact on students' scores on a language test administered 16 months after implementation. The estimates are sufficiently precise to rule out effects larger than 0.13 and 0.11 standard deviations based on the 95 and 90…

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Characteristics of successful asthma programs.

PubMed

Clark, Noreen; Lachance, Laurie; Milanovich, Amy Friedman; Stoll, Shelley; Awad, Daniel F

2009-01-01

We identified characteristics of interventions associated with positive asthma outcomes to understand how programs can be improved. We identified asthma interventions from the peer-reviewed literature or through a nomination process for unpublished programs. Initially, we identified 532 interventions. Of those, 223 met our eligibility criteria (e.g., focus on asthma, completed an evaluation, and demonstrated at least one asthma-related health outcome) and provided information on program components and processes, administration, evaluation, and findings through telephone interviews, program documents, and published reports. We analyzed bivariate relationships between programmatic factors and outcomes using Chi-square statistics, Fisher's exact tests, and unconditional logistic regression. We confirmed findings for all programs by analyzing the subset with published results in peer-reviewed journals. Our findings indicated that programs were more likely to report a positive impact on health outcomes if they (1) were community based, (2) engaged the participation of community-based organizations, (3) provided program components in a clinical setting, (4) provided asthma training to health-care providers, (5) collaborated with other organizations and institutions and with government agencies, (6) designed a program for a specific racial/ethnic group, (7) tailored content or delivery based on individual health or educational needs, and (8) conducted environmental assessments and tailored interventions based on these assessments. Positive asthma outcomes were associated with specific program characteristics: being community centered, clinically connected, and continuously collaborative. Program developers and implementers who build these characteristics into their interventions will be more likely to realize desired asthma outcomes.

The Minnesota Family, Friend and Neighbor Grant Program

ERIC Educational Resources Information Center

Susman-Stillman, Amy; Stout, Karen; Cleveland, Jennifer; Hawley, Vicki

2011-01-01

In 1997, Minnesota became the first state in the nation to pass legislation establishing an education and support program for family, friend, and neighbor (FFN) care providers. This article describes the Minnesota Family, Friend and Neighbor Grant Program and findings from an evaluation of the programs and a curriculum scan of materials used in…

Program-Wide Positive Behavioral Interventions and Supports in Rural Preschools

ERIC Educational Resources Information Center

Steed, Elizabeth A.; Pomerleau, Tina; Muscott, Howard; Rohde, Leigh

2013-01-01

This article describes the quantitative findings from an evaluation of program-wide positive behavioral interventions and supports (PBIS) in three rural preschool programs. Each rural preschool program included children 3 through 5 years of age with and without disabilities. Following 3 years of on-site training, technical assistance, and coaching…

Network Analysis of a Demonstration Program for the Developmentally Disabled

ERIC Educational Resources Information Center

Fredericks, Kimberly A.

2005-01-01

This chapter presents the findings from a network analysis of a demonstration program for the developmentally disabled to show the application of graphical network analysis in program evaluation. The developmentally disabled demonstration (DDD) program was a five-year pilot project to provide person-centered service environments to people with …

Grassroots Engagement and the University of Washington: Evaluating Science Communication Training Created by Graduate Students for Graduate Students

NASA Astrophysics Data System (ADS)

Rohde, J. A.; Clarkson, M.; Houghton, J.; Chen, W.

2016-12-01

Science graduate students increasingly seek science communication training, yet many do not have easy access to training programs. Students often rely on a "do it yourself" approach to gaining communication skills, and student created science communication programs are increasingly found at universities and institutions across the U.S. In 2010, graduate students at the University of Washington led a grassroots effort to improve their own communication and outreach by creating "The Engage Program." With a focus on storytelling and public speaking, this graduate level course not only trains students in science communication but also gives them real world experience practicing that training at a public speaker series at Town Hall Seattle. The Engage Program was fortunate in that it was able to find institutional champions at University of Washington and secure funding to sustain the program over the long-term. However, many grassroots communication programs find it difficult to gain institutional support if there is a perceived lack of alignment with university priorities or lack of return on investment. In order to justify and incentivize institutional support for instruction in science communication, student leaders within the program initiated, designed and carried out an evaluation of their own program focused on assessing the impact of student communication, evaluating the effectiveness of the program in teaching communication skills, and quantifying the benefits of communication training to both the students and their institution. Project leaders created the opportunity for this evaluation by initiating a crowdfunding campaign, which has helped to further engage public support of science communication and incentivized student participation in the program, and may also inspire future program leaders to pursue similar program optimizations.

PREFACE: SPECIAL ISSUE OF ATMOSPHERIC ENVIRONMENT ON FINDINGS FROM EPA'S PARTICULATE MATTER SUPERSITES PROGRAM

EPA Science Inventory

The Supersites Program is a methods development and evaluation, measurements, modeling, and data analysis program designed to provide key stakeholders in the science, regulatory, and policy communities with information to support primarily implementation of National Ambient Air Q...

38 CFR 1.15 - Standards for program evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... decisions. (4) Reliability. Use of the same research design by others should yield the same findings. (g...

Empowerment evaluation: building communities of practice and a culture of learning.

PubMed

Fetterman, David M

2002-02-01

Empowerment evaluation is the use of evaluation concepts, techniques, and findings to foster improvement and self-determination. Program participants--including clients--conduct their own evaluations: an outside evaluator often serves as a coach or additional facilitator depending on internal program capabilities. Empowerment evaluation has three steps: 1) establishing a mission; 2) taking stock; and 3) planning for the future. These three steps build capacity. They also build a sense of community, often referred to as communities of practice. Empowerment evaluation also helps to create a culture of learning and evaluation within an organization or community.

Evaluator Training: Content and Topic Valuation in University Evaluation Courses

ERIC Educational Resources Information Center

Davies, Randall; MacKay, Kathryn

2014-01-01

Quality training opportunities for evaluators will always be important to the evaluation profession. While studies have documented the number of university programs providing evaluation training, additional information is needed concerning what content is being taught in current evaluation courses. This article summarizes the findings of a survey…

An Evaluative Study of an ICT Module for a School Leadership and Management Preparation Program

ERIC Educational Resources Information Center

Musgrave, Sarietjie; De Wet, Corene

2017-01-01

This study reports on findings of an evaluative study on the effectiveness of an information and communication technology (ICT) module that forms part of the Advanced Certificate in Education: School Leadership and Management program. The study was carried out among distance education (DE) students from the University of the Free State enrolled…

Experimental Evaluation of the Value Added by Raising a Reader and Supplemental Parent Training in Shared Reading

ERIC Educational Resources Information Center

Anthony, Jason L.; Williams, Jeffrey M.; Zhang, Zhoe; Landry, Susan H.; Dunkelberger, Martha J.

2014-01-01

Research Findings: In an effort toward developing a comprehensive, effective, scalable, and sustainable early childhood education program for at-risk populations, we conducted an experimental evaluation of the value added by 2 family involvement programs to the Texas Early Education Model (TEEM). A total of 91 preschool classrooms that served…

Evaluation of the Enhanced Assessment Grants (EAGs) SimScientists Program: Site Visit Findings. CRESST Report 791

ERIC Educational Resources Information Center

Herman, Joan; Dai, Yunyun; Htut, Aye Mon; Martinez, Marcela; Rivera, Nichole

2011-01-01

This evaluation report addresses the implementation, utility, and feasibility of SimScientists' simulation-based assessments for middle school science classrooms, with particular attention to the use of accommodations available in the program. Data were collected from a convenience sample of five schools and eight teachers across three states…

Evaluating the forest stewardship program through a national survey of participants

Treesearch

J.D. Esseks; R.J. Moulton

2000-01-01

This paper reports findings from a national survey of 1,231 participants in the Forest Stewardship Program (FSP) of USDA's Forest Service. Launched in 1991, the FSP provides technical assistance through state forestry agencies to help landowners develop management plans for their non-industrial forestland. The survey allowed us to address five main evaluative...

The Evaluation of Abstinence Education Programs Funded Under Title V Section 510: Interim Report.

ERIC Educational Resources Information Center

Devaney, Barbara; Johnson, Amy; Maynard, Rebecca; Trenholm, Chris

This report presents interim findings from an independent, federally funded evaluation of the abstinence education programs authorized under the Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) and defined under Title V, Section 510 (b)(2)(A-H) of the Social Security Act. The report draws heavily on 4 years of…

Development, Implementation, and Evaluation of Leadership/Management Training Within Army Battalions: Volume I: Summary of Findings.

ERIC Educational Resources Information Center

Fry, John P.; Cliborn, Robert E.

The report describes the development and evaluation of an in-unit, leadership/management training program (based on experimental training methodology for providing Army leaders with behavioral skills and techniques) implemented within three battalion-sized combat units at Fort Bliss, Texas, in 1974. The program was organized around workshops…

Evaluating JTPA Programs for Economically Disadvantaged Adults: A Case Study of Utah and General Findings. Research Report No. 92-02.

ERIC Educational Resources Information Center

Bowman, William R.

A study examined the feasibility of using a "nonexperimental" technique to evaluate Job Training Partnership Act (JTPA) programs for economically disadvantaged adults. New statistical techniques were applied to data about a sample of Utah JTPA participants and data about Employment Security registrants linked with their individual…

Evaluation of Academic Library Residency Programs in the United States for Librarians of Color

ERIC Educational Resources Information Center

Boyd, Angela; Blue, Yolanda; Im, Suzanne

2017-01-01

The purpose of this research was to evaluate academic library residency programs that successfully recruit and retain academic librarians of color. This study examines library residencies in the United States and discusses findings of two nationwide surveys. One survey posed questions to residents about the structure of their residencies, aspects…

Personal Benefits of a Health Evaluation and Enhancement Program

NASA Technical Reports Server (NTRS)

Heinzelmann, F.; Durbeck, D. C.

1970-01-01

A study was made of the benefits reported by participants in a health evaluation and enhancement program dealing with physical activity. Program benefits were identified and defined in regard to three major areas: program effects on work; program effects on health; and program effects on habits and behavior. A strong positive and consistent relationship was found between reported benefits in each of these areas and measures of improvement in cardiovascular functioning based on treadmill performance. Significant differences in these measures of improvement were also found between participants who reported program benefits and those persons who did not. These findings provide a meaningful profile of the pattern of benefits generated by this kind of health program.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

PubMed

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

PubMed

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

PubMed

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

The Effects of the Home Instruction Program for Preschool Youngsters (HIPPY) on Children's School Performance at the End of the Program and One Year Later.

ERIC Educational Resources Information Center

Baker, Amy J. L.; Piotrkowski, Chaya S.; Brooks-Gunn, Jeanne

1998-01-01

Evaluated whether participation in HIPPY (Home Instruction Program for Preschool Youngsters) has a positive impact on young children's performance in school. Assessed 182 children at baseline, the program's end, and one year later. Interpreted findings as mixed support for the effectiveness of the HIPPY program. (JS)

Testing the DMAA's recommendations for disease management program evaluation.

PubMed

Serxner, Seth; Mattke, Soeren; Zakowski, Sarah; Gold, Daniel

2008-10-01

The objective of this study was to compare and contrast findings regarding the financial savings projections of the disease management (DM) programs of 2 large employers based on different evaluation methods. In particular, this research tests the impact of differences in assumptions on the underlying growth rate of group health costs, exclusions of high-cost conditions and claims, and the length of the baseline period for determined health care costs. A pre-post study design was used. The data for this research came from 2 large employers in the consumer goods industry with comprehensive Health and Productivity Management programs. It contained medical and prescription drug claims and health plan enrollment data as well as program activity data from 2001 to 2005, covering an average yearly sample size of 201,037 members with 12 consecutive months of enrollment. Analyses were done on group-level averages using nominal cost data and were run to reflect the impact of a DM-only intervention. While the trend estimate and length of baseline had the largest effects on estimated program impact, the use of exclusions had an important effect as well. These findings demonstrate the importance of developing and instituting a standardized evaluation methodology. Without increasing consistency in the way evaluators develop their methodologies, it will remain difficult to be able to compare one evaluation to another, or to have faith in the results at hand.

Assessing Conformity to Standards for Treatment Foster Care.

ERIC Educational Resources Information Center

Farmer, Elizabeth M. Z.; Burns, Barbara J.; Dubs, Melanie S.; Thompson, Shealy

2002-01-01

This study examined conformity to the Program Standards for Treatment Foster Care among 42 statewide programs. Findings suggest fair to good overall conformity, with considerable variation among programs. A discussion of methodological and substantive considerations for future research and evaluation using this approach is included. (Contains…

Develop guidelines for pavement preservation treatments and for building a pavement preservation program platform for Alaska.

DOT National Transportation Integrated Search

2012-11-01

This reports summarizes the project findings including the following: : An evaluation of the current pavement preservation program used in Alaska and a roadmap to grow the program : A summary of the best practices in terms of pavement preserv...

Get on Board the Cost Effective Way: A Tech Prep Replication Process.

ERIC Educational Resources Information Center

Moore, Wayne A.; Szul, Linda F.; Rivosecchi, Karen

1997-01-01

The Northwestern Pennsylvania Tech Prep Consortium model for replicating tech prep programs includes these steps: fact finding, local industry analysis, curriculum development, detailed description, marketing strategies, implementation, and program evaluation. (SK)

Evaluation of Virginia's first heated bridge.

DOT National Transportation Integrated Search

2000-12-01

This study is a contribution to the Heated Bridge Technology Program established in 1991 under the Intermodal Surface Transportation Efficiency Act. The goal of the program was to find durable and environmentally friendly heated bridge technologies f...

Process evaluation of the project P.A.T.H.S. (secondary 2 program): findings based on the co-walker scheme.

PubMed

Shek, Daniel T L; Tam, Suet-yan

2009-01-01

To understand the implementation quality of the Tier 1 Program (Secondary 2 Curriculum) of the P.A.T.H.S. Project, process evaluation was carried out by co-walkers through classroom observation of 195 units in 131 schools. Results showed that the overall level of program adherence was generally high with an average of 84.55%, and different factors of the implementation process were evaluated as positive. Quality of program implementation and achievement of program objectives were predicted by students' participation and involvement, strategies to enhance students' motivation, opportunity for reflection, time management, and class preparation. Success in program implementation was predicted by students' participation and involvement, classroom control, interactive delivery method, strategies to enhance students' motivation, opportunity for reflection, and lesson preparation.

GEOSAFE CORPORATION IN SITU VITRIFICATION: INNOVATIVE TECHNOLOGY EVALUATION REPORT

EPA Science Inventory

This report summarizes the findings associated with a Demonstration of the Geosafe Corporation (Geosafe) In Situ Vitrification (ISV) Process. The Geosafe ISV Technology was evaluated under the EPA Superfund Innovative Technology Evaluation (SITE) Program in conjuction with remedi...

Impact Evaluation of the U.S. Department of Energy's Solar Decathlon Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barnes, Harley

2012-12-01

This report includes the methodology and findings in evaluating DOE’s Solar Decathlon event. The primary purpose of this evaluation is to learn how effectively the Solar Decathlon event is in meeting its objectives.

42 CFR 483.128 - PASARR evaluation criteria.

Code of Federal Regulations, 2010 CFR

2010-10-01

... PASARR program must use at least the evaluative criteria of § 483.130 (if one or both determinations can... of all data concerning the individual. (g) Preexisting data. Evaluators may use relevant evaluative... determinations, findings must be issued in the form of a written evaluative report which— (1) Identifies the name...

42 CFR 483.128 - PASARR evaluation criteria.

Code of Federal Regulations, 2014 CFR

2014-10-01

... PASARR program must use at least the evaluative criteria of § 483.130 (if one or both determinations can... of all data concerning the individual. (g) Preexisting data. Evaluators may use relevant evaluative... determinations, findings must be issued in the form of a written evaluative report which— (1) Identifies the name...

42 CFR 483.128 - PASARR evaluation criteria.

Code of Federal Regulations, 2013 CFR

2013-10-01

... PASARR program must use at least the evaluative criteria of § 483.130 (if one or both determinations can... of all data concerning the individual. (g) Preexisting data. Evaluators may use relevant evaluative... determinations, findings must be issued in the form of a written evaluative report which— (1) Identifies the name...

42 CFR 483.128 - PASARR evaluation criteria.

Code of Federal Regulations, 2011 CFR

2011-10-01

... PASARR program must use at least the evaluative criteria of § 483.130 (if one or both determinations can... of all data concerning the individual. (g) Preexisting data. Evaluators may use relevant evaluative... determinations, findings must be issued in the form of a written evaluative report which— (1) Identifies the name...

42 CFR 483.128 - PASARR evaluation criteria.

Code of Federal Regulations, 2012 CFR

2012-10-01

... PASARR program must use at least the evaluative criteria of § 483.130 (if one or both determinations can... of all data concerning the individual. (g) Preexisting data. Evaluators may use relevant evaluative... determinations, findings must be issued in the form of a written evaluative report which— (1) Identifies the name...

Model-based optimal design of experiments - semidefinite and nonlinear programming formulations

PubMed Central

Duarte, Belmiro P.M.; Wong, Weng Kee; Oliveira, Nuno M.C.

2015-01-01

We use mathematical programming tools, such as Semidefinite Programming (SDP) and Nonlinear Programming (NLP)-based formulations to find optimal designs for models used in chemistry and chemical engineering. In particular, we employ local design-based setups in linear models and a Bayesian setup in nonlinear models to find optimal designs. In the latter case, Gaussian Quadrature Formulas (GQFs) are used to evaluate the optimality criterion averaged over the prior distribution for the model parameters. Mathematical programming techniques are then applied to solve the optimization problems. Because such methods require the design space be discretized, we also evaluate the impact of the discretization scheme on the generated design. We demonstrate the techniques for finding D–, A– and E–optimal designs using design problems in biochemical engineering and show the method can also be directly applied to tackle additional issues, such as heteroscedasticity in the model. Our results show that the NLP formulation produces highly efficient D–optimal designs but is computationally less efficient than that required for the SDP formulation. The efficiencies of the generated designs from the two methods are generally very close and so we recommend the SDP formulation in practice. PMID:26949279

Model-based optimal design of experiments - semidefinite and nonlinear programming formulations.

PubMed

Duarte, Belmiro P M; Wong, Weng Kee; Oliveira, Nuno M C

2016-02-15

We use mathematical programming tools, such as Semidefinite Programming (SDP) and Nonlinear Programming (NLP)-based formulations to find optimal designs for models used in chemistry and chemical engineering. In particular, we employ local design-based setups in linear models and a Bayesian setup in nonlinear models to find optimal designs. In the latter case, Gaussian Quadrature Formulas (GQFs) are used to evaluate the optimality criterion averaged over the prior distribution for the model parameters. Mathematical programming techniques are then applied to solve the optimization problems. Because such methods require the design space be discretized, we also evaluate the impact of the discretization scheme on the generated design. We demonstrate the techniques for finding D -, A - and E -optimal designs using design problems in biochemical engineering and show the method can also be directly applied to tackle additional issues, such as heteroscedasticity in the model. Our results show that the NLP formulation produces highly efficient D -optimal designs but is computationally less efficient than that required for the SDP formulation. The efficiencies of the generated designs from the two methods are generally very close and so we recommend the SDP formulation in practice.

Boys and Girls Clubs in Public Housing. Final Research Report.

ERIC Educational Resources Information Center

Pope, Carl E.; And Others

This report presents findings and recommendations resulting from the evaluation of programs implemented in 15 cities by the Boys and Girls Clubs of America. These programs were implemented to distribute variations on the "Weed and Seed" program and its provision of crime and drug prevention programs. The overall goal of Weed and Seed was…

The Impact of Federal Early Childhood Programs on Children.

ERIC Educational Resources Information Center

Hertz, Thomas W.

This paper reviews research findings concerning the effects on young children of major Federal programs in education and child care. It offers a summary rather than a detailed view of research on the impact of programs, and is based primarily on major program evaluation reports and research reviews. In addition, it draws upon a small number of…

Look-Listen Opinion Poll, 1983-1984. Project of the National Telemedia Council, Inc.

ERIC Educational Resources Information Center

National Telemedia Council, Inc., Madison, WI.

Designed to indicate the reasons behind viewer program preferences, this report presents results of a survey which asked 1,576 television viewers (monitors) to evaluate programs they liked, did not like, and/or new programs. Tables summarize the findings for why programs were chosen, their technical quality, content realism, overall quality, and…

Teacher Social Capital and Student Achievement: Impact of a Cyber-Enabled Teacher Professional Development Program

ERIC Educational Resources Information Center

Liu, Wei

2012-01-01

This is an evaluative research study of a NSF-funded, DRK-12 cyber-enabled teacher professional development program in elementary engineering education. The finding shows the significant impact of the program on students' science and engineering knowledge in the second year of the program's implementation. However, student learning gain…

Evaluation of the US Department of Energy's occupational safety and health program for its government-owned contractor-operated facilities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

The purpose of this report is to present to Secretary of Energy James Watkins the findings and recommendations of the Occupational Safety and Health Administration's (OSHA) evaluation of the Department of Energy's (DOE) programs for worker safety and health at DOE's government-owned contractor-operated (GOCO) nuclear facilities. The OSHA evaluation is based on an intensive and comprehensive review and analysis of DOE's worker safety and health programs including: written programs; safety and health inspection programs; and the adequacy of resource, training, and management controls. The evaluation began on April 10, 1990 and involved over three staff years before its conclusion. Themore » evaluation was initiated by former Secretary of Labor Elizabeth Dole in response to Secretary of Energy James Watkins' request that OSHA assist him in determining the actions needed to assure that DOE has an exemplary safety and health program in place at its GOCOs. 6 figs.« less

Phoenix Rising: use of a participatory approach to evaluate a federally funded HIV, hepatitis and substance abuse prevention program.

PubMed

Dryden, Eileen; Hyde, Justeen; Livny, Ayala; Tula, Monique

2010-11-01

This paper highlights the value of utilizing a participatory evaluation approach when working with community agencies receiving federal funding for prevention and intervention services. Drawing from our experience as evaluators of a SAMHSA-funded substance abuse, HIV and Hepatitis prevention program targeting homeless young adults, we describe the importance of and strategies for creating a participatory evaluation partnership with program implementers. By participatory evaluation we mean the active involvement of program implementers in defining the evaluation, developing instruments, collecting data, discussing findings, and disseminating results. There are a number of challenges faced when using this approach with federally funded programs that require the use of standardized measurement tools and data collection procedures. Strategies we used to strike a balance between federal requirements and local needs are presented. By increasing the understanding of and participation in the evaluation process, program implementers have greater support for data collection requirements and are appreciably more interested in learning from the evaluation data. This approach has helped to build the capacity of a program and stimulated new possibilities for learning, growing, and ultimately improving the services offered to those the program strives to reach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

A Little Help from My Friends: Testing the Utility of Facebook Groups as Online Communities in an Undergraduate Research Internship

ERIC Educational Resources Information Center

Brobst, Joseph Arthur

2013-01-01

This Executive Position Paper describes the findings of a study investigating the utility of Facebook Groups in fostering community among participants in the Delaware INBRE and EPSCoR undergraduate research internship programs. In the first phase of the study, findings from the existing evaluation of the programs and themes from the literature…

Transitioning a Large Scale HIV/AIDS Prevention Program to Local Stakeholders: Findings from the Avahan Transition Evaluation

PubMed Central

Bennett, Sara; Singh, Suneeta; Rodriguez, Daniela; Ozawa, Sachiko; Singh, Kriti; Chhabra, Vibha; Dhingra, Neeraj

2015-01-01

Background Between 2009–2013 the Bill and Melinda Gates Foundation transitioned its HIV/AIDS prevention initiative in India from being a stand-alone program outside of government, to being fully government funded and implemented. We present an independent prospective evaluation of the transition. Methods The evaluation drew upon (1) a structured survey of transition readiness in a sample of 80 targeted HIV prevention programs prior to transition; (2) a structured survey assessing institutionalization of program features in a sample of 70 targeted intervention (TI) programs, one year post-transition; and (3) case studies of 15 TI programs. Findings Transition was conducted in 3 rounds. While the 2009 transition round was problematic, subsequent rounds were implemented more smoothly. In the 2011 and 2012 transition rounds, Avahan programs were well prepared for transition with the large majority of TI program staff trained for transition, high alignment with government clinical, financial and managerial norms, and strong government commitment to the program. One year post transition there were significant program changes, but these were largely perceived positively. Notable negative changes were: limited flexibility in program management, delays in funding, commodity stock outs, and community member perceptions of a narrowing in program focus. Service coverage outcomes were sustained at least six months post-transition. Interpretation The study suggests that significant investments in transition preparation contributed to a smooth transition and sustained service coverage. Notwithstanding, there were substantive program changes post-transition. Five key lessons for transition design and implementation are identified. PMID:26327591

The Effectiveness of Parenting Programs: A Review of Campbell Reviews

ERIC Educational Resources Information Center

Barlow, Jane; Coren, Esther

2018-01-01

Parenting practices predict important outcomes for children, and parenting programs are potentially effective means of supporting parents to promote optimal outcomes for children. This review summarizes findings of systematic reviews of parenting programs published in the Campbell Library. Six reviews evaluated the effectiveness of a range of…

Outcomes Assessment in Accredited Health Information Management Programs

ERIC Educational Resources Information Center

Bennett, Dorine

2010-01-01

The purpose of this study was to determine the use and perceived usefulness of outcomes assessment methods in health information management programs. Additional characteristics of the outcomes assessment practices were recognized. The findings were evaluated for significant differences in results based on age of the program, type of institution,…

An Outcome Evaluation of the Effectiveness of Pre-Registration Midwifery Programmes of Education.

ERIC Educational Resources Information Center

Fraser, Diane; Murphy, Roger; Worth-Butler, Michelle

A project evaluated 23 preregistration midwifery education programs in Britain. Phase 1 reviewed the programs and identified a cohort of students for indepth study. Phase 2 followed this cohort into their first year in practice. A survey selected six case study sites. Findings showed a common cause of attrition was students being unable to balance…

Findings from an Evaluation of a Comprehensive Parent Education Program for School-Age Parents.

ERIC Educational Resources Information Center

Braun, Maureen H.; Fuscaldo, Diane P.

This study evaluates the impact of the Parent Linking Project III (PLP III) on its participants. The PLP III is a comprehensive program for teenage mothers which offers workshops in parenting, mother-child interaction, and vocational awareness, and provides day care services that allow teen mothers to take the opportunity to complete their high…

Evaluation of the Florida Master Teacher Initiative: Final Evaluation Findings

ERIC Educational Resources Information Center

Wang, Haiwen; Warner, Miya; Golan, Shari; Wechsler, Marjorie; Park, C. J.

2015-01-01

The purpose of this study was to examine the impact of the Florida Master Teacher Initiative (FMTI)--an i3-funded early learning program aimed at improving the quality of teaching and student outcomes in grades PreK through third grade in high need schools. The FMTI schools participated in four program components: (1) a job-embedded graduate…

Evaluation of a School-Based Sex Education Program for Low Income Male High School Students in Chile.

ERIC Educational Resources Information Center

Silva, Monica; Ross, Ines

2003-01-01

Evaluated a 1-year sex education program for low income male high school students in Chile. Findings for 92 students in the baseline year, 1993, and 196 students in the 1998 cohort show a reduction in the percentage of students reporting having had sexual intercourse, changes attitudes toward abstinence, and differences in communication about…

The Fairy Godmother--and Her Warts: Making the Dream of Evidence-Based Policy Come True

ERIC Educational Resources Information Center

Weiss, Carol H.; Murphy-Graham, Erin; Petrosino, Anthony; Gandhi, Allison G.

2008-01-01

Evaluators sometimes wish for a Fairy Godmother who would make decision makers pay attention to evaluation findings when choosing programs to implement. The U.S. Department of Education came close to creating such a Fairy Godmother when it required school districts to choose drug abuse prevention programs only if their effectiveness was supported…

A Summary of Six Major Evaluation Reports on Follow Through in Philadelphia, 1973-l1974.

ERIC Educational Resources Information Center

Goodwin, Judith

This report is a non-technical summary of six major evaluation reports on the Follow Through Program in Philadelphia, 1973-74. Positive findings are presented in the areas of pupil achievement, teacher and pupil continuance and pupil absence, and supportive services and parent involvement. The Follow Through Program in Philadelphia is comprised of…

Lifelong Learning Programs of Education Faculty in Sinop: Evaluation of Participants' Problems and Worries

ERIC Educational Resources Information Center

Usakli, Hakan

2009-01-01

In this paper Lifelong Learning Program of Education Faculty in Sinop was evaluated in terms of interrelations between LLP and cultural shock. The barriers of LLP in Education Faculty in Sinop can be examined in two main parts: difficulties of finding suitable partner and students' difficulty in deciding whether to apply or not. These two main…

Far from Home: An Experimental Evaluation of the Mother-Child Home Program in Bermuda.

ERIC Educational Resources Information Center

Scarr, Sandra; McCartney, Kathleen

1988-01-01

Effects of the Mother-Child Home Program (MCHP) were evaluated with a broad range of measures on cognition, social behavior, and emotion. Findings indicated that children in Bermuda scored above U.S. norms on cognitive tests and were functioning well in the preschool period. The MCHP had few demonstrable effects on any segment of the sample. (RH)

Life Outcomes and Higher Education: The Need for Longitudinal Research Using a Broad Range of Quality of Life Indicators.

PubMed

Sheppard-Jones, Kathleen; Kleinert, Harold; Butler, Laura; Whaley, Barry

2018-02-01

Higher education is increasingly becoming an option for young adults with intellectual disability (ID). Although initial evaluations of postsecondary education for this population have been promising, a broader "quality of life" framework needs to be adopted in order to truly understand the impact of these programs. Moreover, researchers and program evaluators must collect longitudinal data that follows former students for multiple years and uses multiple measures. We conducted a pilot evaluation of the life outcomes of students who had attended at least two semesters in Kentucky's supported higher education program for students with ID, collecting data on life status and experiences using measures from the National Core Indicators-Adult Consumer Survey. The findings from this pilot study show better outcomes for young adults who participated in a postsecondary education program compared to young adults who did not, but these findings need to be considered in light of several limitations. In many respects, our data provided more new questions than answers. Recommendations for collecting and evaluating broad-based, longitudinal data to gain insight into the potential benefits of postsecondary education for people with intellectual disability are discussed.

The Evaluator as an Agent of Change.

ERIC Educational Resources Information Center

New Directions for Program Evaluation, 1980

1980-01-01

Bertram S. Brown, former director of the National Institute of Mental Health, discusses conflicts between scientific and value dimensions of evaluation. He relates this conflict to: usefulness of mental health program evaluations; conduct of internal evaluations; release of findings; training; rating of reports; and planned change consultation.…

Translation of etiology into evidence-based prevention: the life skills program IPSY.

PubMed

Weichold, Karina

2014-01-01

IPSY (Information + Psychosocial Competence = Protection) is a universal life skills program aiming at the promotion of generic intra- and interpersonal life skills, substance specific skills (for example, resistance skills), school bonding, knowledge, and the prevention of substance misuse with a focus on alcohol and tobacco in youth. This program is based on the WHO's life skills approach as well as on theories and empirical findings concerning the development of substance misuse during early adolescence. IPSY is implemented by teachers over three years of schooling (grades 5-7 in Germany). Guided by models of translational research dealing with conditions of a successful translation of etiological findings into evidence-based prevention programs, the chapter highlights the results of a more than ten-year research program focusing on the development and evaluation of the IPSY program. Findings on long-term general effects, mediators and moderators of program effectiveness, and cross-cultural transferability of the program to other European countries are summarized and discussed in light of dissemination issues. © WILEY PERIODICALS, INC.

Clinical orientation program for new medical registrars--a qualitative evaluation.

PubMed

Rosemergy, Ian; Bell, Damon A; Jayathissa, Sisira K

2009-02-01

We present a qualitative evaluation of a clinical orientation program for medical registrars within the Wellington region in New Zealand, designed and implemented by current advanced registrars. This program was intended to improve the transition from house officer to medical registrar. The program was qualitatively evaluated using focus groups comprising participants, presenters and senior nursing staff. Purposive samples were drawn from each of these groups. The most significant finding was the perception of enhanced professional collegiality among medical staff. There were benefits to participants and presenters with improved communication between medical registrars. We believe there are individual, institutional and patient care benefits with a region-specific, clinical orientation for new medical registrars.

An update of engine system research at the Army Propulsion Directorate

NASA Technical Reports Server (NTRS)

Bobula, George A.

1990-01-01

The Small Turboshaft Engine Research (STER) program provides a vehicle for evaluating the application of emerging technologies to Army turboshaft engine systems and to investigate related phenomena. Capitalizing on the resources at hand, in the form of both the NASA facilities and the Army personnel, the program goal of developing a physical understanding of engine system dynamics and/or system interactions is being realized. STER entries investigate concepts and components developed both in-house and out-of-house. Emphasis is placed upon evaluations which evolved from on-going basic research and advanced development programs. Army aviation program managers are also encouraged to make use of STER resources, both people and facilities. The STER personnel have established their reputations as experts in the fields of engine system experimental evaluations and engine system related phenomena. The STER facility has STER program provides the Army aviation community the opportunity to perform system level investigations, and then to offer the findings to the entire engine community for their consideration in next generation propulsion systems. In this way results of the fundamental research being conducted to meet small turboshaft engine technology challenges expeditiously find their way into that next generation of propulsion systems.

Evaluation through research of a three-track career ladder program for registered nurses.

PubMed

Korman, Carol; Eliades, Aris Beoglos

2010-01-01

A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.

Aid effectiveness and programmatic effectiveness: a proposed framework for comparative evaluation of different aid interventions in a particular health system.

PubMed

Haque, Hasibul; Hill, Philip C; Gauld, Robin

2017-01-01

Against a backdrop of changing concepts of aid effectiveness, development effectiveness, health systems strengthening, and increasing emphasis on impact evaluation, this article proposes a theory-driven impact evaluation framework to gauge the effect of aid effectiveness principles on programmatic outcomes of different aid funded programs in the health sector of a particular country. The foundation and step-by-step process of implementing the framework are described. With empirical evidence from the field, the steps involve analysis of context, program designs, implementation mechanisms, outcomes, synthesis, and interpretation of findings through the programs' underlying program theories and interactions with the state context and health system. The framework can be useful for comparatively evaluating different aid interventions both in fragile and non-fragile state contexts.

An update of engine system research at the Army Propulsion Directorate

NASA Technical Reports Server (NTRS)

Bobula, George A.

1990-01-01

The Small Turboshaft Engine Research (STER) program provides a vehicle for evaluating the application of emerging technologies to Army turboshaft engine systems and to investigate related phenomena. Capitalizing on the resources at hand, in the form of both the NASA facilities and the Army personnel, the program goal of developing a physical understanding of engine system dynamics and/or system interactions is being realized. STER entries investigate concepts and components developed both in-house and out-of-house. Emphasis is placed upon evaluations which have evolved from on-going basic research and advanced development programs. Army aviation program managers are also encouraged to make use of STER resources, both people and facilities. The STER personnel have established their reputations as experts in the fields of engine system experimental evaluations and engine system related phenomena. The STER facility has demonstrated its utility in both research and development programs. The STER program provides the Army aviation community the opportunity to perform system level investigations, and then to offer the findings to the entire engine community for their consideration in next generation propulsion systems. In this way results of the fundamental research being conducted to meet small turboshaft engine technology challenges expeditiously find their way into that next generation of propulsion systems.

Evaluating Cross-Cutting Approaches to Chronic Disease Prevention and Management: Developing a Comprehensive Evaluation

PubMed Central

Jernigan, Jan; Barnes, Seraphine Pitt; Shea, Pat; Davis, Rachel; Rutledge, Stephanie

2017-01-01

We provide an overview of the comprehensive evaluation of State Public Health Actions to Prevent and Control Diabetes, Heart Disease, Obesity and Associated Risk Factors and Promote School Health (State Public Health Actions). State Public Health Actions is a program funded by the Centers for Disease Control and Prevention to support the statewide implementation of cross-cutting approaches to promote health and prevent and control chronic diseases. The evaluation addresses the relevance, quality, and impact of the program by using 4 components: a national evaluation, performance measures, state evaluations, and evaluation technical assistance to states. Challenges of the evaluation included assessing the extent to which the program contributed to changes in the outcomes of interest and the variability in the states’ capacity to conduct evaluations and track performance measures. Given the investment in implementing collaborative approaches at both the state and national level, achieving meaningful findings from the evaluation is critical. PMID:29215974

REMEDIATION TECHNOLOGY EVALUATION AT THE GILT EDGE MINE, SOUTH DAKOTA

EPA Science Inventory

This document reports the findings of the Mine Waste Technology Program's Activity III, Project 29,The Remediation Technology Evaluation Project at the Gilt Edge Mine, S.D. This project consisted of evaluating three emerging acidic waste rock stabilization technologies and compar...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2014-07-01 2013-07-01 true Procedures for IFSP development, review, and evaluation...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2013-07-01 2013-07-01 false Procedures for IFSP development, review, and evaluation...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2012 CFR

2012-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2012-07-01 2012-07-01 false Procedures for IFSP development, review, and evaluation...

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Developmental Screening in Community Health Care Centers and Pediatric Practices: An Evaluation of the Baby Steps Program

ERIC Educational Resources Information Center

Shannon, Patrick; Anderson, Patti Rawding

2008-01-01

The Baby Steps Program (Easter Seals of New Hampshire, 2003) is a child-find program that introduces developmental specialists into health care settings to conduct developmental screenings with children during well-child visits. This article presents the Baby Steps Program model, summaries of screening and referral data, and the results of 3 focus…

Incarcerated women develop a nutrition and fitness program: participatory research.

PubMed

Elwood Martin, Ruth; Adamson, Sue; Korchinski, Mo; Granger-Brown, Alison; R Ramsden, Vivian; A Buxton, Jane; Espinoza-Magana, Nancy; L Pollock, Sue; J F Smith, Megan; C Macaulay, Ann; Lisa Condello, Lara; Gregory Hislop, T

2013-01-01

Women in prison throughout the world experience higher rates of mental and physical illness compared with the general population and compared with men in prison. The paper finds no published studies that report on men or women in prison engaging in participatory health research to address their concerns about nutrition and fitness. The purpose of this paper is to describe a pilot nutrition and fitness program, which resulted from a unique prison participatory health research project. Women in prison designed, led, and evaluated a six-week pilot fitness program in a minimum/medium security women's prison. Pre- and post-program assessments included a self-administered questionnaire and body measures. Open-ended questionnaire responses illuminated the quantitative findings. Sixteen women in prison completed the program evaluation. Weight, body mass index, waist-to-hip ratio, and chest measurements decreased, and energy, sleep, and stress levels improved by the end of the program. As a component of a participatory research project, incarcerated women designed and led a nutrition and fitness program, which resulted in improved body measures and self-reported health benefits. ORIGINALITY VALUE: Incarceration provides opportunities to engage women in designing their own health programs with consequent potential long-term "healing" benefits.

A Descriptive Analysis of Programs and Trends in Engineering Education for Ethnic Minority Students: A Report to the Field.

ERIC Educational Resources Information Center

Gordon, Edmund W.; And Others

This report presents the findings of an evaluative study of the current status of engineering education for minority students at the collegiate and pre-collegiate levels in the United States. It is based on a survey of 50 existing programs and a review of the professional and research literature in this field. The major findings of the analysis…

Data Availability in Appliance Standards and Labeling Program Development and Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Romankiewicz, John; Khanna, Nina; Vine, Edward

2013-05-01

In this report, we describe the necessary data inputs for both standards development and program evaluation and perform an initial assessment of the availability and uncertainty of those data inputs in China. For standards development, we find that China and its standards and labeling program administrators currently has access to the basic market and technical data needed for conducting market and technology assessment and technological and economic analyses. Some data, such as shipments data, is readily available from the China Energy Label product registration database while the availability of other data, including average unit energy consumption, prices and design options,more » needs improvement. Unlike some other countries such as the United States, most of the necessary data for conducting standards development analyses are not publicly available or compiled in a consolidated data source. In addition, improved data on design and efficiency options as well as cost data (e.g., manufacturing costs, mark-ups, production and product use-phase costs) – key inputs to several technoeconomic analyses – are particularly in need given China’s unconsolidated manufacturing industry. For program evaluation, we find that while China can conduct simple savings evaluations on its incentive programs with the data it currently has available from the Ministry of Finance – the program administrator, the savings estimates produced by such an evaluation will carry high uncertainty. As such, China could benefit from an increase in surveying and metering in the next one to three years to decrease the uncertainty surrounding key data points such as unit energy savings and free ridership.« less

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

Evaluating Different Dimensions of Programme Effectiveness for Private Medicine Retailer Malaria Control Interventions in Kenya

PubMed Central

Abuya, Timothy O.; Fegan, Greg; Amin, Abdinasir A.; Akhwale, Willis S.; Noor, Abdisalan M.; Snow, Robert W.; Marsh, Vicki

2010-01-01

Background Private medicine retailers (PMRs) are key partners in the home management of fevers in many settings. Current evidence on effectiveness for PMR interventions at scale is limited. This study presents evaluation findings of two different programs implemented at moderate scale targeting PMRs for malaria control in the Kisii and Kwale districts of Kenya. Key components of this evaluation were measurement of program performance, including coverage, PMR knowledge, practices, and utilization based on spatial analysis. Methodology/Principal Findings The study utilized mixed quantitative methods including retail audits and surrogate client surveys based on post-intervention cross-sectional surveys in intervention and control areas and mapping of intervention outlets. There was a large and significant impact on PMR knowledge and practices of the program in Kisii, with 60.5% of trained PMRs selling amodiaquine medicines in adequate doses compared to 2.8% of untrained ones (OR; 53.5: 95% CI 6.7, 428.3), a program coverage of 69.7% targeted outlets, and a potential utilization of about 30,000 children under five. The evaluation in Kwale also indicates a significant impact with 18.8% and 2.3% intervention and control PMRs selling amodiaquine with correct advice, respectively (OR; 9.4: 95% CI 1.1, 83.7), a program coverage of 25.3% targeted outlets, and a potential utilization of about 48,000 children under five. A provisional benchmark of 7.5 km was a reasonable threshold distance for households to access PMR services. Conclusions/Significance This evaluation show that PMR interventions operationalized in the district level settings are likely to impact PMR knowledge and practices and lead to increased coverage of appropriate treatment to target populations. There is value of evaluating different dimensions of public health programs, including quality, spatial access, and implementation practice. This approach strengthens the potential contribution of pragmatic study designs to evaluating public health programs in the real world. PMID:20126620

Evaluation of the New York City State Program to Implement Career Education. January, 1972-June, 1973. Research Report No. 73-4.

ERIC Educational Resources Information Center

Abramson, Theodore; And Others

Activities of and outcomes resulting from the State Project to Implement Career Education (SPICE) in New York City schools for the first year and a half are reported in this summative evaluation. Findings (much of which are statistical data) discussed deal almost exclusively with the elementary-junior high program, one of two autonomous programs…

A Randomized Controlled Trial Evaluation of "Time to Read", a Volunteer Tutoring Program for 8- to 9-Year-Olds

ERIC Educational Resources Information Center

Miller, Sarah; Connolly, Paul

2013-01-01

Tutoring is commonly employed to prevent early reading failure, and evidence suggests that it can have a positive effect. This article presents findings from a large-scale ("n" = 734) randomized controlled trial evaluation of the effect of "Time to Read"--a volunteer tutoring program aimed at children aged 8 to 9 years--on…

A Comprehensive Evaluation of the Community Action Program in Austin and Travis County, Texas. Final Report.

ERIC Educational Resources Information Center

Tracor, Inc., Austin, TX.

Produced in four parts, this report covers a study of poor people in Austin, Texas, begun in 1967. Initial research efforts defined the problem and identified the population to be studied. An interim report was then made on the first year's findings. This involved evaluating some of the community action programs (CAP) and identifying and analyzing…

What Makes a Difference: Early Head Start Evaluation Findings in a Developmental Context

ERIC Educational Resources Information Center

Love, John M.; Chazan-Cohen, Rachel; Raikes, Helen; Brooks-Gunn, Jeanne

2013-01-01

The federal Early Head Start (EHS) program began in 1995, and a randomized trial was conducted to evaluate the efficacy of 17 EHS programs. In all, 3,001 low-income families (35% African American, 24% Hispanic, and 37% White) with a pregnant women or an infant under the age of 12 months were randomly assigned to a treatment or control group (with…

Findings from the Evaluation of the National Library Power Program. Executive Summary. An Initiative of the DeWitt Wallace-Reader's Digest Fund.

ERIC Educational Resources Information Center

Zweizig, Douglas; Hopkins, Dianne McAfee

This document presents the executive summary of an evaluation of Library Power, a program of the DeWitt Wallace-Reader's Digest Fund to enhance and elevate the role of libraries in public schools. The report begins with an examination of Library Power's core components (collection development, facilities refurbishing, flexible scheduling,…

Integrating research, policy, and practice in juvenile justice education.

PubMed

Blomberg, Thomas G; Waldo, Gordon P

2002-06-01

This article provides an overview of the history and context leading to Florida's efforts to implement an evaluation-driven research and associated quality assurance system for its juvenile justice education policies and practices. The Juvenile Justice Educational Enhancement Program began implementing Florida's evaluation research and quality assurance system to juvenile justice education in 1998. The article includes a brief summary of articles comprising this special issue of Evaluation Review that address the Juvenile Justice Educational Enhancement Program's various functions, methodological components, data, preliminary findings, continuing evaluation research efforts, and impediments.

Evaluation of an online continuing education program from the perspective of new graduate nurses.

PubMed

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Development and Implementation of a Peer Mentoring Program for Early Career Gerontological Faculty

PubMed Central

Bryant, Ashley Leak; Brody, Ab; Perez, Adriana; Shillam, Casey; Edelman, Linda S.; Bond, Stewart M.; Foster, Victoria; Siegel, Elena

2016-01-01

Purpose In conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), the Hartford Gerontological Nursing Leaders (HGNL) developed and executed a program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of the HGNL. The purpose of this article is to describe key strategies used to develop and execute the mentoring program and to present the formative and summative program evaluation. Design The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. Findings An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Conclusions Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Clinical Relevance Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. PMID:25808927

Evaluation of Healthy Living Wellness Program With Minority Underserved Economically Disadvantaged Older Adults.

PubMed

Tallier, Peggy C; Reineke, Patricia R; Frederickson, Keville

2017-04-01

The purpose of this Roy adaptation model-guided study was to test the effectiveness of a student registered nurse intern-led nursing intervention entitled the Healthy Living Wellness Program. A one-group pretest/posttest preexperimental design was used. The intervention was imparted to minority, underserved, economically disadvantaged older adults ( N = 30). Significant findings pre- and postintervention were reported for body mass index, waist circumference, self-reported blood glucose, and weight. The findings supported the effectiveness of the nursing intervention, the Healthy Living Wellness Program, guided by the Roy adaptation model.

A Management Review of the Institutions of Higher Learning: Commissioner's Office, University Foundations and Athletic Programs.

ERIC Educational Resources Information Center

Mississippi State Legislature, Jackson. Performance Evaluation and Expenditure Review Committee.

A state mandated evaluation study was done of certain programs and activities of the Mississippi Commissioner's Office of the Institutions of Higher Learning (IHL) including the Commissioner's Fund and operations of university foundations and athletic programs. This report presents findings, recommendations, and documentation, as well as responses…

Evaluating the Effectiveness of Programs to Improve Educational Attainment of Unwed African American Teen Mothers: A Meta Analysis

ERIC Educational Resources Information Center

Baytop, Chanza M.

2006-01-01

A study implements meta-analytic methods to synthesize the findings and analyze the effects of interventions, including secondary teen pregnancy prevention programs, on educational achievement among unwed African American teen mothers. Results indicate that secondary teen pregnancy prevention programs and other interventions for adolescent mothers…

Goals and Characteristics of Long-Term Care Programs: An Analytic Model.

ERIC Educational Resources Information Center

Braun, Kathryn L.; Rose, Charles L.

1989-01-01

Used medico-social analytic model to compare five long-term care programs: Skilled Nursing Facility-Intermediate Care Facility (SNF-ICF) homes, ICF homes, foster homes, day hospitals, and home care. Identified similarities and differences among programs. Preliminary findings suggest that model is useful in the evaluation and design of long-term…

Mathematics Teachers' Professional Development Program--Needs and Expectations

ERIC Educational Resources Information Center

Levi-Keren, Michal; Patkin, Dorit

2016-01-01

This paper presents the major findings and recommendations from a formative evaluation of the first of a 2-year in-service training program. This program was designed for the professional development of math teachers. It was developed following an educational reform, which was meant to enhance the teachers' ability to generate changes in their…

Pilot Test of Standup, an Online School-Based Bullying Prevention Program

ERIC Educational Resources Information Center

Timmons-Mitchell, Jane; Levesque, Deborah A.; Harris, Leon A., III.; Flannery, Daniel J.; Falcone, Tatiana

2016-01-01

Bullying is a significant public health problem for students in schools. Prevention programs have addressed targets with some success; however, meta-analyses find small effects among older youths. A pilot study was conducted with high school students to evaluate the potential efficacy of StandUp, a three-session online program that delivers…

4-H Night at the Movies: A Program for Adolescents and Their Families.

ERIC Educational Resources Information Center

Jurich, Anthony P.; Collins, Olivia P.

1996-01-01

Evaluates a program designed to improve self-esteem in adolescents. Used commercial movies about teenagers to enhance adolescents' interest and understanding of their world. Findings indicated significant increases in measures of self concept, self satisfaction, family self, and social self over the course of the program. (RJM)

System-Level Influences on the Sustainability of a Cognitive Therapy Program in a Community Behavioral Health Network.

PubMed

Stirman, Shannon Wiltsey; Matza, Alexis; Gamarra, Jennifer; Toder, Katherine; Xhezo, Regina; Evans, Arthur C; Hurford, Matthew; Beck, Aaron T; Crits-Christoph, Paul; Creed, Torrey

2015-07-01

The purpose of this study was to examine influences on the sustainability of a program to implement an evidence-based psychotherapy in a mental health system. Interviews with program administrators, training consultants, agency administrators, and supervisors (N=24), along with summaries of program evaluation data and program documentation, were analyzed with a directed content-analytic approach. Findings suggested a number of interconnected and interacting influences on sustainability, including alignment with emerging sociopolitical influences and system and organizational priorities; program-level adaptation and evolution; intervention flexibility; strong communication, collaboration, planning, and support; and perceived benefit. These individual factors appeared to mutually influence one another and contribute to the degree of program sustainability achieved at the system level. Although most influences were positive, financial planning and support emerged as potentially both facilitator and barrier, and evaluation of benefits at the patient level remained a challenge. Several factors appeared to contribute to the sustainability of a psychosocial intervention in a large urban mental health system and warrant further investigation. Understanding interconnections between multiple individual facilitators and barriers appears critical to advancing understanding of sustainability in dynamic systems and adds to emerging recommendations for other implementation efforts. In particular, implications of the findings include the importance of implementation strategies, such as long-term planning, coalition building, clarifying roles and expectations, planned adaptation, evaluation, diversification of financing strategies, and incentivizing implementation.

Trenholm State (AL) Technical College High School Science Enrichment Program 1996-1997 Evaluation Report

NASA Technical Reports Server (NTRS)

Ross, Elizabeth G.

1997-01-01

This document presents findings based on a third-year evaluation of Trenholm State (AL) Technical College's National Aeronautics and Space Administration (NASA) - supported High School Science Enrichment Program (HSSEP). HSSEP is an external (to school) program for area students from groups that are underrepresented in the mathematics, science, engineering and technology (MSET) professions. In addition to gaining insight into scientific careers, HSSEP participants learn about and deliver presentations that focus on mathematics applications, scientific problem-solving and computer programming during a seven-week summer or 10-week Academic-Year Saturday session.

School-based obesity prevention: a blueprint for taming the epidemic.

PubMed

Baranowski, Tom; Cullen, Karen W; Nicklas, Theresa; Thompson, Deborah; Baranowski, Janice

2002-01-01

To review the literature on school-based obesity prevention programs to identify what can be done to minimize the increasing levels of obesity. Twenty articles reporting school-based dietary or physical activity change programs were identified that used BMI or skinfolds as part of the evaluation. Seven studies obtained change in BMI and differed from those not finding change in 3 ways: program implementers were not classroom teachers; intervention targeted middle or high schools; and inactivity reduction was promoted. An 8-step research strategy was delineated to develop and evaluate programs with a maximum chance of taming the obesity epidemic.

A Comparison of Participant and Practitioner Beliefs About Evaluation

PubMed Central

Whitehall, Anna K.; Hill, Laura G.; Koehler, Christian R.

2014-01-01

The move to build capacity for internal evaluation is a common organizational theme in social service delivery, and in many settings, the evaluator is also the practitioner who delivers the service. The goal of the present study was to extend our limited knowledge of practitioner evaluation. Specifically, the authors examined practitioner concerns about administering pretest and posttest evaluations within the context of a multisite 7-week family strengthening program and compared those concerns with self-reported attitudes of the parents who completed evaluations. The authors found that program participants (n = 105) were significantly less likely to find the evaluation process intrusive, and more likely to hold positive beliefs about the evaluation process, than practitioners (n = 140) expected. Results of the study may address a potential barrier to effective practitioner evaluation—the belief that having to administer evaluations interferes with establishing a good relationship with program participants. PMID:25328379

Using a set-aside to encourage the evaluation of public health service programs.

PubMed

Riggin, L J; Shipman, S L; York, R L

1995-03-01

For over 20 years, the secretary of the Department of Health and Human Services (HHS) has had the authority to use up to 1% of the annual Public Health Service (PHS) appropriations for the evaluation of federal health programs. However, recent changes to the Public Health Service Act put not only a ceiling (1%) but also a floor (0.2%) on the funds that the secretary can set aside for evaluation. The changes to the legislation are intended to encourage HHS to dedicate more funds to evaluation, focus the funds set aside for evaluation on studies of PHS program implementation and effectiveness, and regularly report the findings of the evaluations to Congress. These changes respond to concerns raised by the U.S. General Accounting Office in a study of the PHS evaluation set-aside conducted for Congress.

Implementation and Outcomes of Forensic Housing First Programs.

PubMed

Kriegel, Liat S; Henwood, Benjamin F; Gilmer, Todd P

2016-01-01

This mixed-method study used administrative data from 68 supportive housing programs and evaluative and qualitative site visit data from a subset of four forensic programs to (a) compare fidelity to the Housing First model and residential client outcomes between forensic and nonforensic programs and (b) investigate whether and how providers working in forensic programs can navigate competing Housing First principles and criminal justice mandates. Quantitative findings suggested that forensic programs were less likely to follow a harm reduction approach to substance use and clients in those programs were more likely to live in congregate settings. Qualitative findings suggested that an interplay of court involvement, limited resources, and risk environments influenced staff decisions regarding housing and treatment. Existing mental health and criminal justice collaborations necessitate adaptation to the Housing First model to accommodate client needs.

Evaluation of a Bilingual Education Program in Canada: The Elgin Study Through Grade Six. Acts of the Colloquium of the Swiss Interuniversity Commission for Applied Linguistics. CILA Bulletin, No. 27.

ERIC Educational Resources Information Center

Barik, Henri C.; Swain, Merrill

This paper presents the findings of the last completed evaluation of a partial immersion program in St. Thomas, Ontario, which involves the use of French as the medium of instruction for half the school day and English for the other half, beginning in Grade One. Unlike the previous evaluation, in the current one a Canadian-normed instrument was…

Evaluation of the New York City Dropout Prevention Initiative. Final Report on the High Schools for Year Three, 1987-88. Part Two: Special Studies of the High School Program in Year Three.

ERIC Educational Resources Information Center

Grannis, Joseph; And Others

This document comprises part 2 of a two-part evaluation of the third-year implementation of the New York City Board of Education's 3-year high school Dropout Prevention Initiative (DPI). It consists of reports on 8 special substudies of the program in year 3 (part 1 describes the DPI and presents the evaluation findings and recommendations.) The…

The who, what, and how of evaluation within online nursing education: state of the science.

PubMed

Russell, Bedelia H

2015-01-01

The resource capacity in nursing programs has a direct impact on student admissions and number of graduates who enter the nursing workforce. Online delivery of nursing education is identified as a solution to expand nursing program capacity. As nursing programs continue to address capacity with online course delivery, it is essential that nurse educators maintain consistent evaluation practices to ensure successful and positive outcomes, compared with traditional models. Evaluation is a central component to determine program quality and mastery of learning outcomes. This article examines the state of the science around the current evaluation of educational practices, instructional strategies, and outcomes within the context of online nursing education. Thirty-six articles met the inclusion criteria. Despite substantive contributions to the state of the science, the findings reflect evaluation practices that are diffuse and superficial and serve as the basis for future recommendations and research opportunities. Copyright 2015, SLACK Incorporated.

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Using intervention mapping to develop a breast and cervical cancer screening program for Hispanic farmworkers: Cultivando La Salud.

PubMed

Fernández, Maria E; Gonzales, Alicia; Tortolero-Luna, Guillermo; Partida, Sylvia; Bartholomew, L Kay

2005-10-01

This article describes the development of the Cultivando La Salud program, an intervention to increase breast and cervical cancer screening for Hispanic farmworker women. Processes and findings of intervention mapping (IM), a planning process for development of theory and evidence-informed program are discussed. The six IM steps are presented: needs assessment, preparation of planning matrices, election of theoretic methods and practical strategies, program design, implementation planning, and evaluation. The article also describes how qualitative and quantitative findings informed intervention development. IM helped ensure that theory and evidence guided (a) the identification of behavioral and environmental factors related to a target health problem and (b) the selection of the most appropriate methods and strategies to address the identified determinants. IM also guided the development of program materials and implementation by lay health workers. Also reported are findings of the pilot study and effectiveness trial.

Time Discounting and Credit Market Access in a Large-Scale Cash Transfer Programme.

PubMed

Handa, Sudhanshu; Martorano, Bruno; Halpern, Carolyn; Pettifor, Audrey; Thirumurthy, Harsha

2016-06-01

Time discounting is thought to influence decision-making in almost every sphere of life, including personal finances, diet, exercise and sexual behavior. In this article we provide evidence on whether a national poverty alleviation program in Kenya can affect inter-temporal decisions. We administered a preferences module as part of a large-scale impact evaluation of the Kenyan Government's Cash Transfer for Orphans and Vulnerable Children. Four years into the program we find that individuals in the treatment group are only marginally more likely to wait for future money, due in part to the erosion of the value of the transfer by inflation. However among the poorest households for whom the value of transfer is still relatively large we find significant program effects on the propensity to wait. We also find strong program effects among those who have access to credit markets though the program itself does not improve access to credit.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

PubMed

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

PubMed

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Finding Fortune in Thirteen Out-of-School Time Programs: A Compendium of Education Programs and Practices.

ERIC Educational Resources Information Center

Trammel, Ming

This research compendium summarizes and reviews the evaluations of 13 out-of-school time programs with positive outcomes for young people. The programs are (1) 4-H; (2) 21st Century Community Learning Centers; (3) The After-School Corporation; (4) Beacons; (5) BELL After School Instructional Curriculum; (6) Big Brothers Big Sisters of America; (7)…

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Riverdale Elementary "Learning Without Limits" 2003-2004 Evaluation Report.

ERIC Educational Resources Information Center

Grant, Michael M.; Ross, Steven M.; Wang, Weiping; Potter, Allison; Wilson, Yola

2004-01-01

This report discusses the findings from an evaluation study of the Learning Without Limits program in the fifth grade at Riverdale Elementary in the Shelby County Schools district, Memphis, Tennessee. The overall purpose of the evaluation was twofold: (a) to provide formative evaluation data to Riverdale School to use as a basis for improvement…

"Follow Through" Evaluation.

ERIC Educational Resources Information Center

Glass, Gene V.; Camilli, Gregory A.

Two questions are addressed in this document: What is worth knowing about Project Follow Through? and, How should the National Institute of Education (NIE) evaluate the Follow Through program? Discussion of the first question focuses on findings of past Follow Through evaluations, problems associated with the use of experimental design and…

U.S. Coast Guard SARSAT Final Evaluation Report. Volume III. Programs and Data Listings.

DOT National Transportation Integrated Search

1987-04-01

Volume I of this report, Technical Evaluation, presents the findings of the U.S. Coast Guard's two year demonstration and evaluation (D&E) of the COSPAS/SARSAT satellite-aided search and rescue system for locating distressed vessels and aircraft, a c...

Breast cancer survivorship program: testing for cross-cultural relevance.

PubMed

Chung, Lynna K; Cimprich, Bernadine; Janz, Nancy K; Mills-Wisneski, Sharon M

2009-01-01

Taking CHARGE, a theory-based self-management program, was developed to assist women with survivorship concerns that arise after breast cancer treatment. Few such programs have been evaluated for cultural relevance with diverse groups. This study determined the utility and cultural relevance of the program for African American (AA) breast cancer survivors. Two focus groups were held with AA women (n = 13), aged 41 to 72 years, who had completed primary treatment. Focus group participants assessed the program content, format, materials, and the self-regulation process. Content analysis of audiotapes was conducted using an open, focused coding process to identify emergent themes regarding program relevance and topics requiring enhancement and/or further emphasis. Although findings indicated that the program's content was relevant to participants' experiences, AA women identified need for cultural enhancements in spirituality, self-preservation, and positive valuations of body image. Content areas requiring more emphasis included persistent fatigue, competing demands, disclosure, anticipatory guidance, and age-specific concerns about body image/sexuality. Suggested improvements to program materials included portable observation logs, additional resources, more photographs of younger AA women, vivid colors, and images depicting strength. These findings provide the basis for program enhancements to increase the utility and cultural relevance of Taking CHARGE for AA survivors and underscore the importance of evaluating interventions for racially/ethnically diverse groups.

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

Reducing Gridlock on the Grid: Utility Trends in Managing Peak Electric Load through Residential Demand Response

NASA Astrophysics Data System (ADS)

McDonald, Betsy

Utilities across the United States are piloting residential demand response programs to help manage peak electric demand. Using publicly available program evaluations, this thesis analyzes nine such programs to uncover and synthesize the range of program offerings, goals, enrollment strategies, and customer experiences. This review reveals that program participation, components, and results differ based on a variety of factors, including geographic characteristics, program goals, and implementation strategies. The diversity of program designs and evaluation findings suggests an underlying tension between the need to generate cost-effective program impacts and the desire to increase accessibility so that program benefits are not exclusive to certain segments of the population. For more significant and impactful engagement, program goals may need to shift. State level policy support could help shift program goals toward increasing program accessibility. Future research should explore creative strategies that target existing barriers and allow for more inclusive deployment.

Mixed method evaluation of a community-based physical activity program using the RE-AIM framework: practical application in a real-world setting.

PubMed

Koorts, Harriet; Gillison, Fiona

2015-11-06

Communities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. A single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. Inconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. This research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.

Review of literature and practices for incident management programs : technical report.

DOT National Transportation Integrated Search

2016-06-01

The project team examined project evaluations, best practice summaries, and synthesis documents, and derived a summary of key elements of programs to speed the time to find and clear stalled vehicles and crashes from freeway shoulders and main lanes....

Did JCLP Really Work?

ERIC Educational Resources Information Center

Hencey, Robert

1981-01-01

Considers the methodology, findings, and conclusions of three studies conducted by Stephen Epler, Louis Bender, and James Perkins, which evaluated the Junior College Leadership Program. The project was funded from 1959 through 1974 to establish university programs for the preparation of two-year college administrators. (DML)

Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation.

PubMed

Boyce, Ayesha S

2017-10-01

Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator-stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluating Mission Drift in Microfinance: Lessons for Programs with Social Mission

ERIC Educational Resources Information Center

Hishigsuren, Gaamaa

2007-01-01

The article contributes to a better understanding of implications of scaling up on the social mission of microfinance programs. It proposes a methodology to measure the extent, if any, to which a microfinance program with a poverty alleviation mission drifts away from its mission during rapid scaling up and presents findings from a field research…

New York City's First Conditional Cash Transfer Program: What Worked, What Didn't

ERIC Educational Resources Information Center

Riccio, James; Miller, Cynthia

2016-01-01

This report summarizes the findings of a long-term evaluation of Opportunity NYC--Family Rewards, an experimental, privately funded, conditional cash transfer (CCT) program to help families break the cycle of poverty. Family Rewards was the first comprehensive CCT program in a developed country. Launched in 2007 by New York City's Center for…

College Admissions and Academic Ethic: How Context-Specific Evaluation within a Science-Based Compensatory Program Benefits African American Students

ERIC Educational Resources Information Center

Wooten, Melissa E.

2016-01-01

This study investigates how the college readiness of participants in a compensatory program designed to facilitate interest in science and engineering was determined. Archival data were used to qualitatively analyze the performance reports of 205 student participants during the compensatory program's first 5 years. Findings indicate participants…

A Randomized Trial of a Multimodal Community-Based Prisoner Reentry Program Emphasizing Substance Abuse Treatment

ERIC Educational Resources Information Center

Grommon, Eric; Davidson, William S., II; Bynum, Timothy S.

2013-01-01

Prisoner reentry programs continue to be developed and implemented to ease the process of transition into the community and to curtail fiscal pressures. This study describes and provides relapse and recidivism outcome findings related to a randomized trial evaluating a multimodal, community-based reentry program that prioritized substance abuse…

Measuring the Impact of a Pilot Geospatial Technology Apprenticeship Program for the Department of Labor

ERIC Educational Resources Information Center

Gaudet, Cyndi; Annulis, Heather; Kmiec, John

2010-01-01

The Geospatial Technology Apprenticeship Program (GTAP) pilot was designed as a replicable and sustainable program to enhance workforce skills in geospatial technologies to best leverage a $30 billion market potential. The purpose of evaluating GTAP was to ensure that investment in this high-growth industry was adding value. Findings from this…

The Positive Impact of Attending a Community-Based Youth Program on Child Depressive Symptoms

ERIC Educational Resources Information Center

Fite, Paula J.; Vitulano, Michael L.; Preddy, Teresa M.

2011-01-01

The current study evaluated associations between attending a community-based youth program, neighborhood problems, and child depressive symptoms in a sample of 147 children (mean [M] age=8.22 years, 54.4% male). Findings suggested that both program attendance and neighborhood problems were uniquely associated with child depressive symptoms while…

Can We Have It All? A Review of the Impacts of School Choice on Racial Integration

ERIC Educational Resources Information Center

Swanson, Elise

2017-01-01

This article reviews the literature evaluating the impact of school choice programs on racial integration. Evidence on the impacts of magnet schools, voluntary busing programs, open enrollment practices, charter schools, and voucher programs is reviewed. The literature is mixed on this question, finding that the impacts of choice on racial…

Public Relations for Brazilian Libraries: Process, Principles, Program Planning, Planning Techniques and Suggestions.

ERIC Educational Resources Information Center

Kies, Cosette N.

A brief overview of the functions of public relations in libraries introduces this manual, which provides an explanation of the public relations (PR) process, including fact-finding, planning, communicating, evaluating, and marketing; some PR principles; a 10-step program that could serve as a model for planning a PR program; a discussion of PR…

Eco-School in Kindergartens: The Effects, Interpretation, and Implementation of a Pilot Program

ERIC Educational Resources Information Center

Cincera, Jan; Kroufek, Roman; Simonova, Petra; Broukalova, Lenka; Broukal, Vaclav; Skalík, Jan

2017-01-01

This study presents an analysis of a Czech pilot project in implementing the Eco-School program in kindergartens. The evaluation applied a mixed design that included pre/post testing of children using picture-based questionnaires, and interviews with the teachers responsible for conducting the program. The findings revealed a significant increase…

Teacher Behaviors and Performance Incentives in Texas: Early Reactions to the GEEG Program. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide performance incentive programs in Texas. The report provides an overview of changes to teacher behavior and instructional practices…

Evaluating an employee wellness program.

PubMed

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Residential family treatment for parents with substance use disorders who are involved with child welfare: two perspectives on program design, collaboration, and sustainability.

PubMed

Hammond, Gretchen Clark; McGlone, Amanda

2013-01-01

This article discusses the service design, implementation, and evaluation findings of two residential family treatment programs: Wayside House (MN) and OnTrack (OR). Both programs specialize in family-centered services for adults with substance use disorders (SUD) who are involved with child welfare. Information on program design, services offered, and key collaborations are detailed. Implications for program sustainability are provided.

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Sustainability in Health care by Allocating Resources Effectively (SHARE) 5: developing a model for evidence-driven resource allocation in a local healthcare setting.

PubMed

Harris, Claire; Allen, Kelly; Waller, Cara; Green, Sally; King, Richard; Ramsey, Wayne; Kelly, Cate; Thiagarajan, Malar

2017-05-10

This is the fifth in a series of papers reporting Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. This paper synthesises the findings from Phase One of the SHARE Program and presents a model to be implemented and evaluated in Phase Two. Monash Health, a large healthcare network in Melbourne Australia, sought to establish an organisation-wide systematic evidence-based program for disinvestment. In the absence of guidance from the literature, the Centre for Clinical Effectiveness, an in-house 'Evidence Based Practice Support Unit', was asked to explore concepts and practices related to disinvestment, consider the implications for a local health service and identify potential settings and methods for decision-making. Mixed methods were used to capture the relevant information. These included literature reviews; online questionnaire, interviews and structured workshops with a range of stakeholders; and consultation with experts in disinvestment, health economics and health program evaluation. Using the principles of evidence-based change, the project team worked with health service staff, consumers and external experts to synthesise the findings from published literature and local research and develop proposals, frameworks and plans. Multiple influencing factors were extracted from these findings. The implications were both positive and negative and addressed aspects of the internal and external environments, human factors, empirical decision-making, and practical applications. These factors were considered in establishment of the new program; decisions reached through consultation with stakeholders were used to define four program components, their aims and objectives, relationships between components, principles that underpin the program, implementation and evaluation plans, and preconditions for success and sustainability. The components were Systems and processes, Disinvestment projects, Support services, and Program evaluation and research. A model for a systematic approach to evidence-based resource allocation in a local health service was developed. A robust evidence-based investigation of the research literature and local knowledge with a range of stakeholders resulted in rich information with strong consistent messages. At the completion of Phase One, synthesis of the findings enabled development of frameworks and plans and all preconditions for exploration of the four main aims in Phase Two were met.

Current trends in systematic program evaluation of online graduate nursing education: an integrative literature review.

PubMed

Horne, Eva M; Sandmann, Lorilee R

2012-10-01

Over the past decade, the Internet's e3 ect has transformed nursing education, particularly at the graduate level. Schools of nursing have embraced Internet-based course delivery technology to broaden students' access to academic degrees. However, the rush to stay competitive in online education raises questions. What is the quality of these online programs? To what extent are schools of nursing systematically evaluating the programs beyond the course level? What evaluation tools are used? What are the findings? How are the evaluation data used? By answering these questions, nurse educators can develop strategies for evaluating the quality and worth of online learning, thus improving instruction and learning outcomes. This integrative review of nursing and adult education literature identified as the current trends in program evaluation of online nursing education at the graduate level. Research articles were analyzed and perspectives were synthesized from a research agenda viewpoint. Recommendations and needs for future research are discussed. Copyright 2012, SLACK Incorporated.

Designing Effective EPO Products for Museums: Preliminary Evaluation Findings from the Interstellar Boundary Explorer (IBEX) EPO Program

NASA Astrophysics Data System (ADS)

Nichols, M.; Bartolone, L.; Baldassari, C.; Hoyer-Winfield, S.

2011-09-01

The Interstellar Boundary Explorer (IBEX) mission includes a comprehensive EPO program in astronomy and heliophysics that is overseen and implemented by the Adler Planetarium in Chicago, Illinois. Several EPO components were developed specifically for informal institutions, especially museums and planetaria. The program includes an internationally distributed planetarium show with accompanying informal educational materials. Our evaluator, the Program Evaluation and Research Group (PERG) at Lesley University, Cambridge, Massachusetts, assesses the effectiveness of the EPO program. In late 2009 through early 2010, more than 70 planetaria worldwide received the IBEX planetarium show. Of the many U.S. planetaria, the first 25 received the IBEX planetarium show and were offered the opportunity to receive, at no charge, accompanying informal education materials, including posters, lithographs, demonstration materials, lesson plans, and more. In Spring 2010, PERG staff conducted a study designed to gauge the effectiveness of the distribution process for the planetarium show, gather information on the professional development needs of the organizations, and document reactions of museum staff to the IBEX informal education materials and their usefulness as companion pieces to the planetarium show. In this paper, we will present preliminary findings of this particular study, in the hopes that future EPO work can make use of data in this report.

Meditation programs for veterans with posttraumatic stress disorder: Aggregate findings from a multi-site evaluation.

PubMed

Heffner, Kathi L; Crean, Hugh F; Kemp, Jan E

2016-05-01

Interest in meditation to manage posttraumatic stress disorder (PTSD) symptoms is increasing. Few studies have examined the effectiveness of meditation programs offered to Veterans within Department of Veterans Affairs (VA) mental health services. The current study addresses this gap using data from a multisite VA demonstration project. Evaluation data collected at 6 VA sites (N = 391 Veterans) before and after a meditation program, and a treatment-as-usual (TAU) program, were examined here using random effects meta-analyses. Site-specific and aggregate between group effect sizes comparing meditation programs to TAU were determined for PTSD severity measured by clinical interview and self-report. Additional outcomes included experiential avoidance and mindfulness. In aggregate, analyses showed medium effect sizes for meditation programs compared to TAU for PTSD severity (clinical interview: effect size (ES) = -0.32; self-report: ES = -0.39). Similarly sized effects of meditation programs were found for overall mindfulness (ES = 0.41) and 1 specific aspect of mindfulness, nonreactivity to inner experience (ES = .37). Additional findings suggested meditation type and program completion differences each moderated program effects. VA-sponsored meditation programs show promise for reducing PTSD severity in Veterans receiving mental health services. Where meditation training fits within mental health services, and for whom programs will be of interest and effective, require further clarification. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Do Program Implementation Factors or Fidelity Affect Chronic Disease Self-Management Education Programs' Outcomes?

PubMed

Brady, Teresa J; Murphy, Louise B; O'Colmain, Benita J; Hobson, Reeti Desai

2017-09-01

To evaluate whether implementation factors or fidelity moderate chronic disease self-management education program outcomes. Meta-analysis of 34 Arthritis Self-Management Program and Chronic Disease Self-Management Program studies. Community. N = 10 792. Twelve implementation factors: program delivery fidelity and setting and leader and participant characteristics. Eighteen program outcomes: self-reported health behaviors, physical health status, psychological health status, and health-care utilization. Meta-analysis using pooled effect sizes. Modest to moderate statistically significant differences for 4 of 6 implementation factors; these findings were counterintuitive with better outcomes when leaders and participants were unpaid, leaders had less than minimum training, and implementation did not meet fidelity requirements. Exploratory study findings suggest that these interventions tolerate some variability in implementation factors. Further work is needed to identify key elements where fidelity is essential for intervention effectiveness.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

Rules and Regulations for Education Programs for the Handicapped.

ERIC Educational Resources Information Center

Pace, R. Elwood; And Others

The manual presents Utah's rules and regulations for education programs serving handicapped students. Regulations touch upon the following topics (sample subtopics in parentheses): responsibilities of the State Office of Education (authority to make policy); child identification (child find and screening, referral, evaluation/classification…

Social learning within a community of practice: Investigating interactions about evaluation among zoo education professionals.

PubMed

Khalil, Kathayoon; Ardoin, Nicole M; Wojcik, Deborah

2017-04-01

The accessibility and ubiquity of zoos and aquariums-which reach over 700 million people worldwide annually-make them critical sites for science and environmental learning. Through educational offerings, these sites can generate excitement and curiosity about nature and motivate stewardship behavior, but only if their programs are high quality and meet the needs of their audiences. Evaluation is, therefore, critical: knowing what works, for whom, and under what conditions must be central to these organizations. Yet, many zoo and aquarium educators find evaluation to be daunting, and they are challenged to implement evaluations and/or use the findings iteratively in program development and improvement. This article examines how zoo education professionals engage with one another in a learning community related to evaluation. We use a communities of practice lens and social network analysis to understand the structure of this networked learning community, considering changes over time. Our findings suggest that individuals' roles in a networked learning community are influenced by factors such as communicative convenience and one's perceptions of others' evaluation expertise, which also contribute to forming and sustaining professional relationships. This study illuminates how project-based professional networks can become communities of practice. Copyright © 2016 Elsevier Ltd. All rights reserved.

What Do We Know About Teaching and Learning in Urban Schools? Volume 9: New Perspectives on School District Research and Evaluation.

ERIC Educational Resources Information Center

Lyon, Catherine

The Center for the Study of Evaluation's project, Evaluation and School Districts, used questionnaires to survey the heads of evaluation offices in metropolitan public school systems. This paper presents the preliminary findings of the survey. Most school systems have established a centralized program evaluation unit organized around three…

Children's Growth and Classroom Experiences in Georgia's Pre-K Program: Findings from the 2011-2012 Evaluation Study

ERIC Educational Resources Information Center

Peisner-Feinberg, Ellen; Schaaf, Jennifer; LaForett, Dore

2013-01-01

Georgia has one of the few state-funded universal pre-kindergarten programs in the United States, with the aim of providing pre-k services to all 4-year-olds whose families want their children to participate in the program, regardless of family income level. In the 2011-2012 school year, Georgia's Pre-K Program served a total of over 94,000…

The Effects of "Girl-Friendly" Schools: Evidence from the BRIGHT School Construction Program in Burkina Faso. NBER Working Paper No. 18115

ERIC Educational Resources Information Center

Kazianga, Harounan; Levy, Dan; Linden, Leigh L.; Sloan, Matt

2012-01-01

We evaluate the causal effects of a program that constructed high quality "girl-friendly" primary schools in Burkina Faso, using a regression discontinuity design 2.5 years after the program started. We find that the program increased enrollment of all children between the ages of 5 and 12 by 20 percentage points and increased their test…

The Early Development Instrument as an Evaluation and Improvement Tool for School-Based, Integrated Services for Young Children and Parents: The Toronto First Duty Project

ERIC Educational Resources Information Center

Corter, Carl; Patel, Sejal; Pelletier, Janette; Bertrand, Jane

2008-01-01

Research Findings: Integrated services for young children and families are part of the new policy landscape in early childhood, but there is limited evidence of the effectiveness of these programs and how they develop on the ground. This study examined the use of the Early Development Instrument (EDI) as both a summative program evaluation tool…

GSA's Green Proving Ground: Identifying, Testing and Evaluating Innovative Technologies (Presentation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kandt, A.; Lowell, M.

2012-05-01

GSA's Green Proving Ground (GPG) program utilizes GSA's real estate portfolio to test and evaluate innovative and underutilized sustainable building technologies and practices. Findings are used to support the development of GSA performance specifications and inform decision making within GSA, other federal agencies, and the real estate industry. The program aims to drive innovation in environmental performance in federal buildings and help lead market transformation through deployment of new technologies.

How Bigelow Laboratory Measured Broader Impacts: The Case Study of the Evaluation of the Keller BLOOM Program (Invited)

NASA Astrophysics Data System (ADS)

Fowler, R. A.; Repa, J.

2010-12-01

In this presentation we discuss the impetus for, the results of the short and long term effects, and the impacts of the Keller BLOOM Program, hosted by Bigelow Laboratory for Ocean Sciences of West Boothbay Harbor, Maine. Each May, for the last 21 years, 16 bright high school juniors, one from each county in Maine, have been invited to spend five days with the research scientists at the lab conducting and reporting research on the bottom layers of the ocean’s food chain: phytoplankton and zooplankton. Bigelow has chosen to evaluate BLOOM through a series of questionnaires delivered during the program, and long term tracking of participants after the program, in order to better understand the impact of the program on participants. The short term effect of the experience, measured at the end of the week, found that participants are able to: 1) develop testable research questions, 2) collect multiple water samples from a local estuary, 3) measure various characteristics of those samples with the sophisticated instruments in Bigelow’s labs assisted by their research scientists, 4) analyze and integrate the results from the various labs, and 5) present their findings to a non-scientific audience. To measure long term participation effects, a random sample of 40 of the 332 participants were interviewed resulting in the following findings: 100% attend college; 62% have STEM majors; 88% graduate from college; 57% pursue STEM careers; and 60% live and work in Maine. Bigelow scientists include a description of the BLOOM Program and the evaluation results in their NSF Broader Impacts statements to demonstrate that their research activities are being integrated into a successful STEM education program. Evaluation results are also used by Bigelow scientists and program administrators to refine program content and delivery, to promote the program to potential applicants, and to strengthen proposals to funding agencies when seeking financial support for BLOOM.

The Impact of Credit on Village Economies

PubMed Central

Kaboski, Joseph P.; Townsend, Robert M.

2011-01-01

This paper evaluates the short-term impact of Thailand’s ‘Million Baht Village Fund’program, among the largest scale government microfinance iniative in the world, using pre- and post-program panel data and quasi-experimental cross-village variation in credit-per-household. We find that the village funds have increased total short-term credit, consumption, agricultural investment, income growth (from business and labor), but decreased overall asset growth. We also find a positive impact on wages, an important general equilibrium effect. The findings are broadly consistent qualitatively with models of credit-constrained household behavior and models of intermediation and growth. PMID:22844546

Evaluation program for secondary spacecraft cells: Initial evaluation tests of Eagel-Picher Industries, Incorporated, 20.0 amphere-hour nickel-cadmium spacecraft cells

NASA Technical Reports Server (NTRS)

Harkness, J. D.

1974-01-01

An evaluation test of the 20.0 ampere-hour cells was conducted to insure that all cells put into the life cycle program are of high quality. This is accomplished by the screening of cells found to have electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open circuit voltage above 1.150 volts during the internal short test. The results obtained in the test are given, as well as the recommendations based on these findings.

Continuous Evaluation Of In-Service Highway Safety Feature Performance

DOT National Transportation Integrated Search

2002-09-01

This report documents the research effort, findings, conclusions, and recommendations of a study to develop a program for the continuous in-service evaluation of highway safety features. The study consisted of two phases and eight tasks. An in-servic...

Outcomes and lessons learned from evaluating TRICARE's disease management programs.

PubMed

Dall, Timothy M; Askarinam Wagner, Rachel C; Zhang, Yiduo; Yang, Wenya; Arday, David R; Gantt, Cynthia J

2010-06-01

To share outcomes and lessons learned from an evaluation of disease management (DM) programs for asthma, congestive heart failure (CHF), and diabetes for TRICARE patients. Multiyear evaluation of participants in voluntary, opt-out DM programs. Patient-centered programs, administered by 3 regional contractors, provide phone-based consultations with a care manager, educational materials, and newsletters. The study sample consisted of 23,793 asthma, 4092 CHF, and 29,604 diabetes patients with at least 6 months' tenure in the program. Medical claims were analyzed to quantify program effect on healthcare utilization, medical costs, and clinical outcomes. Multivariate regression analysis with an historical control group was used to predict patient outcomes in the absence of DM. The difference between actual and predicted DM patient outcomes was attributed to the program. A patient survey collected data on program satisfaction and perceived usefulness of program information and services. Modest improvements in patient outcomes included reduced inpatient days and medical costs, and (with few exceptions) increased percentages of patients receiving appropriate medications and tests. Annual per patient reductions in medical costs were $453, $371, and $783 for asthma, CHF, and diabetes program participants, respectively. The estimated return on investment was $1.26 per $1.00 spent on DM services. Findings suggest that the DM programs more than pay for themselves, in addition to improving patient health and quality of life. Lessons learned in program design, implementation, effectiveness, and evaluation may benefit employers contemplating DM, DM providers, and evaluators of DM programs.

The Efficacy of Coerced Treatment for Offenders: An Evaluation of Two Residential Forensic Drug and Alcohol Treatment Programs.

ERIC Educational Resources Information Center

Baird, Francis X.; Frankel, Arthur J.

2001-01-01

Reviews the history of community-based treatment for offenders with drug and alcohol addiction. Describes the treatment regimen in two residential programs for offenders with drug and alcohol problems, including a description of the components of the residential treatment model utilized in these two programs. Findings support the efficacy of…

Study of Former Students of the Word Processing Program. Volume XXIII, No. 5.

ERIC Educational Resources Information Center

Lucas, John A.; Zilkowski, Robert R.

As part of the program evaluation and review process at William Rainey Harper College (WRHC) in Illinois, a follow-up study was conducted of students who had enrolled in the college's Word Processing Program between summer 1989 and spring 1994. A survey was mailed to 500 former students, receiving a response rate of 37.6%. Study findings included…

The CLEP Program: An Evaluation and Assessment at a Small Private University

ERIC Educational Resources Information Center

Beaver, William; Paul, Stephen T.

2007-01-01

The Educational Testing Service (ETS) created the College Level Examination Program (CLEP) in 1965 and over the years it has become a staple of American higher education. In order to better understand the ramifications of the CLEP program, this article provides a brief history of CLEP and reexamines some of the findings of earlier research. The…

Evaluating the Impact of School Nutrition Programs. Final Report. E-FAN-04-008

ERIC Educational Resources Information Center

Bhattacharya, Jayanta; Currie, Janet; Haider, Steven J.

2004-01-01

This study develops estimates of the efficacy of school nutrition programs in improving a broad range of dietary outcomes by comparing the nutritional status of students and their families during the school year with the status when school is out. The study finds evidence that children who have a School Breakfast Program (SBP) available consume a…

Is the Court-Appointed Special Advocate Program Effective? A Longitudinal Analysis of Time Involvement and Case Outcomes.

ERIC Educational Resources Information Center

Leung, Patrick

1996-01-01

Describes the Court Appointed Special Advocate (CASA) Program for child welfare proceedings. Examines the current literature regarding the impact of CASA across the nation and discusses the findings and implications of an empirical study that evaluated a CASA program in terms of placement outcomes in a major U.S. city. (MOK)

Enhancing Family Literacy through Collaboration: Program Considerations.

ERIC Educational Resources Information Center

Tice, Carolyn J.

2000-01-01

Presents findings from a two-year evaluation of a family literacy program in rural Appalachian Ohio. Demonstrates positive results for both impact/outcome and process objectives. Highlights an extensive network of interpersonal and interagency relationships that maximized resources and supported families as they changed. Suggests the importance of…

Teaching Evidence-Based Medicine: A Regional Dissemination Model.

ERIC Educational Resources Information Center

Leipzig, Rosanne M.; Wallace, Eleanor Z.; Smith, Lawrence G.; Sullivant, Jean; Dunn, Kathel; McGinn, Thomas

2003-01-01

Described and evaluated an interactive course designed to create a cadre of medical school faculty in New York who could integrate evidence-based medicine into their training programs. Findings for representatives of 30 internal medicine residency programs show the usefulness of the regional dissemination model used. (SLD)

Technology Programs...For All or for Some?

ERIC Educational Resources Information Center

Giancola, Susan P.

2001-01-01

Introduces the Delaware Technology Innovation Challenge (DTIC) project which aims to increase parent involvement, generate more time for learning, and improve student achievement. Investigates whether evaluation findings of the project are reflective of the program's implementation or rather reveal a limitation of the technology. (Contains 20…

Evaluation of the Project P.A.T.H.S. Based on Students' Weekly Diaries: Findings from Eight Datasets

PubMed Central

Shek, Daniel T. L.; Sun, Rachel C. F.

2012-01-01

This paper aims to investigate the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. (positive adolescent training through holistic social programmes) based on eight datasets collected between 2005 and 2009. A total of 1,138 students who participated in the program were randomly invited (from the whole grade or in some classes) to write a piece of journal in the form of a weekly diary in order to reveal their perceptions and feelings regarding the program and the perceived benefits of the program. Based on an integration of findings from different databases, results showed that the respondents generally (1) had positive views on the program, (2) had positive views on the instructors, and (3) perceived that they had acquired competencies at the societal, school, familial, interpersonal, and personal levels after joining the program. Acknowledging the limitations of diaries, the present qualitative findings provide support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. in Hong Kong. PMID:22593676

Impact of a provider training program on the treatment of children with autism spectrum disorder at psychosocial care units in Brazil.

PubMed

Silva, Luciana C; Teixeira, Maria C T V; Ribeiro, Edith L; Paula, Cristiane S

2017-12-18

To develop, implement, and verify the impact of a training program for health care providers working with children with autism spectrum disorder (ASD) in psychosocial care centers for children and adolescents (Centro de Atenção Psicossocial à Infância e à Adolescência - CAPSi) in São Paulo, Brazil. This quasi-experimental study was conducted with 14 professionals from four CAPSi units. The training program consisted of six phases: 1) pre-intervention observation; 2) meeting with staff to assess the main needs of the training program; 3) developing materials for training and evaluation; 4) meetings to discuss program implementation; 5) a final meeting for case discussion and evaluation; and 6) distance supervision. Three measures were used to evaluate the training program: i) the Knowledge, Attitudes, and Practices (KAP) questionnaire; ii) videos containing questions designed to assess program comprehension; and iii) a satisfaction survey. Thirteen videos were produced to as visual aids for use during the training program, and a further 26 videos were developed to evaluate it. The program was well evaluated by the participants. The video responses and KAP questionnaire scores suggest that staff knowledge and attitudes improved after training. The positive findings of this study suggest that the tested training program is feasible for use with multidisciplinary teams working in the CAPSi environment.

Evaluating Enhancements to a Perioperative Nurse Liaison Program

PubMed Central

Hanson-Heath, Cathy Ann; Muller, Linda M.; Cunningham, Maureen F.

2016-01-01

The impetus for the Perioperative Nurse Liaison (PNL) program at our cancer center was to reduce anxiety for family members of patients undergoing surgery by improving communication between the family and the perioperative team. The purpose of our quality improvement project was to increase contact with family members during the patient’s surgery and to support families and surgeons during the postoperative family consult when findings were unexpected. After implementing process changes, the PNLs evaluated the program using a short survey given to families after the postoperative consult. Families reported a reduction in stress and anxiety when receiving intraoperative updates either in person or by telephone. In addition, when the PNL accompanied family members to the consult, the family felt supported when receiving unexpected findings. Further, family contact increased from 82% to 98% and consults with surgeons that included the PNL rose from an average of 254 to 500 per year. PMID:27004504

Alzheimer's Caregiver Support Online: lessons learned, initial findings and future directions.

PubMed

Glueckauf, Robert L; Loomis, Jeffrey S

2003-01-01

Family caregivers of older adults with progressive dementia (e.g., Alzheimer's disease) are faced with a variety of emotional and behavioral difficulties, such as dealing with persistent, repetitive questions, managing agitation and depression, and monitoring hygiene and self-care activities. Although professional and governmental organizations have called for the creation of community-based education and support programs, most dementia caregivers continue to receive little or no formal instruction in responding effectively to these challenges. The current paper describes the development and implementation of Alzheimer's Caregiver Support Online, a Web- and telephone-based education and support network for caregivers of individuals with progressive dementia. Lessons learned from the first two years of this state-supported initiative are discussed, followed by the findings of a Robert Wood Johnson Foundation-funded strategic marketing initiative and an initial program evaluation of AlzOnline's Positive Caregiving classes. Finally, clinical implications and future directions for program development and evaluation research are proposed.

A Synthetic Comparator Approach to Local Evaluation of School-Based Substance Use Prevention Programming.

PubMed

Hansen, William B; Derzon, James H; Reese, Eric L

2014-06-01

We propose a method for creating groups against which outcomes of local pretest-posttest evaluations of evidence-based programs can be judged. This involves assessing pretest markers for new and previously conducted evaluations to identify groups that have high pretest similarity. A database of 802 prior local evaluations provided six summary measures for analysis. The proximity of all groups using these variables is calculated as standardized proximities having values between 0 and 1. Five methods for creating standardized proximities are demonstrated. The approach allows proximity limits to be adjusted to find sufficient numbers of synthetic comparators. Several index cases are examined to assess the numbers of groups available to serve as comparators. Results show that most local evaluations would have sufficient numbers of comparators available for estimating program effects. This method holds promise as a tool for local evaluations to estimate relative effectiveness. © The Author(s) 2012.

Asthma 101 for Schools: Successes and Challenges in Transitioning to Online Delivery

PubMed Central

Nowakowski, Alexandra Catherine Hayes; Carretta, Henry Joseph; Dudley, Julie Kurlfink; Forrest, Jamie R.

2016-01-01

Florida Asthma Program staff worked with evaluators from the Florida State University College of Medicine to assess participation and quality of the American Lung Association’s Asthma 101 asthma management education program for school faculty and staff between 2011 and 2014. This included transitioning the program to an online training format for the 2013–2014 school year. Asthma 101 helps school personnel master the basics of asthma physiology and management, with content tailored specifically for elementary and secondary educational settings. The program is assessed with questionnaires at multiple timepoints, yielding a quasi-experimental evaluation design. Evaluators reviewed quantitative data from pretests and qualitative and quantitative data from post-program satisfaction questionnaires. Program spreadsheets listing the dates for delivery and number of attendees were also reviewed. Overall, evaluation findings were positive. In the 2011–2012 program year, 16 different course sessions were offered, and more than half of enrolled participants came from Title I schools. A total of 228 people were trained. In the 2012–2013 program year, 19 different course sessions were offered. Enrollment totals (638) and matching pre- and posttest totals (562) soundly exceeded the target metric of 425. At least 170 (27%) of a total of 638 participants could be verified as coming from the target demographic of Title I school faculty and staff. In the 2013–2014 program year, the course was offered online on a rolling basis via the Florida TRAIN course management system. Enrollment remained high and learner outcomes remained consistently strong across all content areas for knowledge and satisfaction. A total of 406 people participated in the training; complete pre- and posttest data were available for 341 of these individuals; and satisfaction data were available for 325. Of the 406 trainees, 199 (49%) reported working for Title I schools. Evaluation yielded very positive results. An overwhelming majority of participants reported finding the course consistently strong across the board and highly impactful for their own ability to help students manage their asthma effectively. Most participants also reported that they would change/improve their asthma management behaviors in the workplace. Recommendations were developed to help expand future program reach. PMID:26870724

The CEMHaVi program: control, evaluation, and modification of lifestyles in obese youth.

PubMed

Vanhelst, Jérémy; Marchand, Frédéric; Fardy, Paul; Zunquin, Gautier; Loeuille, Guy-André; Renaut, Hervé; Mikulovic, Jacques; Hurdiel, Rémy; Béghin, Laurent; Theunynck, Denis

2010-01-01

Obesity in children has increased in recent years. Many studies with differing methodologies have been undertaken to treat obesity. The Control, Evaluation, and Modification of Lifestyles in Obese Youth (CEMHaVi) program is a unique 2-year health-wellness program of physical activity and health education for obese youth. Findings of this study represent results at 1-year follow-up. The purpose of this study was to evaluate the effects of the CEMHaVi program. Physician-referred subjects (N = 26) participated in the study, 14 girls (13.4 +/- 2.9 years) and 12 boys (12.3 +/- 2.8 years). Measurements included height, weight, body mass index (BMI), academic performance, sleep habits, and health knowledge. The intervention consisted of a unique program of physical activity, including a variety of games specifically selected to be enjoyable, maintain interest, and motivate subjects to adhere. Activity sessions were offered once per week, 2 hours each session, for 12 months. A health education program was offered once every 3 months for 2 hours per session. Health knowledge, academic performance, self-esteem, and sleep were assessed before and after the intervention. Means were calculated at baseline and following intervention and were compared by paired t tests. Findings suggest significant improvements in academic performance (P < .001), quality and quantity of sleep (P < .05), and obesity (P < .05). The program reduced BMI and improved health knowledge, sleep, and academic performance in obese children. The feasibility of a beneficial lifestyle intervention program is encouraging in addressing obesity and related issues in young boys and girls.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

The effectiveness of state-level tobacco control interventions: a review of program implementation and behavioral outcomes.

PubMed

Siegel, Michael

2002-01-01

In 2001, nearly one billion dollars will be spent on statewide tobacco control programs, including those in California, Massachusetts, Arizona, and Oregon, funded by cigarette tax revenues, and the program in Florida, funded by the state's settlement with the tobacco industry. With such large expenditures, it is imperative to find out whether these programs are working. This paper reviews the effectiveness of the statewide tobacco control programs in California, Massachusetts, Arizona, Oregon, and Florida. It focuses on two aspects of process evaluation--the funding and implementation of the programs and the tobacco industry's response, and four elements of outcome evaluation--the programs' effects on cigarette consumption, adult and youth smoking prevalence, and protection of the public from secondhand smoke. The paper formulates general lessons learned from these existing programs and generates recommendations to improve and inform the development and implementation of these and future programs.

Interim evaluation of the Tier 1 Program of Project P.A.T.H.S.: continuation of evidence.

PubMed

Shek, Daniel T L; Yu, Lu; Chan, Alex C W

2012-01-17

An interim evaluation study was conducted to understand the implementation of the Tier 1 Program of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) in the 2008/09 school year. One hundred and twenty-eight schools were randomly selected to provide information on the implementation details of the program via interviews, telephone interviews and self-completed questionnaires. Results showed that a majority of the workers perceived that the students had positive responses to the program and the program was helpful to the students. Program workers' views toward the implementation of the Tier 1 Program were positive across different grades and program implementation modes. In conjunction with previous studies, the present findings suggest that the Tier 1 Program of Project P.A.T.H.S. is well received by different stakeholders.

Stirring up the Mud: Using a Community-Based Participatory Approach to Address Health Disparities through a Faith-Based Initiative

PubMed Central

Kaplan, Sue A.; Ruddock, Charmaine; Golub, Maxine; Davis, Joyce; Foley, Robert; Devia, Carlos; Rosen, Rosa; Berry, Carolyn; Barretto, Brenda; Carter, Toni; Irish-Spencer, Evalina; Marchena, Maria; Purcaro, Ellenrita; Calman, Neil

2011-01-01

This case study provides a mid-course assessment of the Bronx Health REACH faith-based initiative four years into its implementation. The study uses qualitative methods to identify lessons learned and to reflect on the benefits and challenges of using a community-based participatory approach for the development and evaluation of a faith-based program designed to address health disparities. Key findings concern the role of pastoral leadership, the importance of providing a religious context for health promotion and health equality messages, the challenges of creating a bilingual/bi-cultural program, and the need to provide management support to the lay program coordinators. The study also identifies lessons learned about community-based evaluation and the importance of addressing community concern about the balance between evaluation and program. Finally, the study identifies the challenges that lie ahead, including issues of program institution-alization and sustainability. PMID:20168022

Hey girlfriend: an evaluation of AIDS prevention among women in the sex industry.

PubMed

Dorfman, L E; Derish, P A; Cohen, J B

1992-01-01

Increasingly, acquired immunodeficiency syndrome (AIDS) prevention programs have been developed to reach and influence street-based populations. Standard methods of evaluation do not fit the conditions of such programs. This article describes a process and outcome evaluation of an AIDS prevention program for sex workers in which qualitative and quantitative methods were combined in order to mediate research problems endemic to street-based populations. Methods included epidemiological questionnaires, open-ended interviews with participants, and ethnographic field notes. Process evaluation findings show that field staff who were indigenous to the neighborhood and population readily gained access to the community of sex workers and simultaneously became role models for positive behavior change. Outcome findings show that sex workers do feel at risk for AIDS, but usually from clients rather than from husbands or boyfriends. Accordingly, they use condoms more frequently with clients than with steady partners. Increasing condom use among sex workers with their steady partners remains an important challenge for AIDS prevention. Combining qualitative and quantitative research data provided a more comprehensive assessment of how to reach sex workers with effective AIDS risk reduction messages than either method could have provided alone.

Evolution of a multilevel framework for health program evaluation.

PubMed

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.

Establish a Baseline for Planning and Growth. Focus on Program Evaluation. Technology Report 92-114.

ERIC Educational Resources Information Center

Des Moines Public Schools, IA. Dept. of Information Management.

This evaluation focuses on the use of computers, telephones, broadcast video, and related devices to support instructional activities and administrative functions in the Des Moines (Iowa) Independent Community School District. The findings are presented in five parts: (1) Context Evaluation--History and Recent Improvements (video and instructional…

Evaluation development for a physical activity positive youth development program for girls.

PubMed

Ullrich-French, Sarah; Cole, Amy N; Montgomery, Anna K

2016-04-01

Girls on the Run (GOTR) is an after school program for girls in third through fifth grade which utilizes a physical activity based positive youth development curriculum that culminates with completing a 5K run. Unfortunately, there is little empirical data documenting GOTR participant changes that align with the curriculum and describe the evaluation process. Therefore, this study presents an evaluation of GOTR consisting of three main processes: curriculum content analysis and stakeholder focus groups (N=11) to identify key outcomes of the program; community-based participatory research to collaborate with program personnel to further identify important outcomes; and the design and pilot testing of an instrument (N=104) for assessing changes in the theoretically grounded outcomes over time. Findings demonstrated a positive collaborative process that led to important information to be used for an impact evaluation of Girls on the Run and for future evaluation development efforts for physical activity based positive youth development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Children's Growth and Classroom Experiences in Georgia's Pre-K Program: Findings from the 2011-2012 Evaluation Study. Executive Summary

ERIC Educational Resources Information Center

Peisner-Feinberg, Ellen; Schaaf, Jennifer; LaForett, Dore

2013-01-01

Georgia has one of the few state-funded universal pre-kindergarten programs in the United States, with the aim of providing pre-k services to all 4-year-olds whose families want their children to participate in the program, regardless of family income level. In the 2011-2012 school year, Georgia's Pre-K Program served a total of over 94,000…

2014 Wind Program Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

The Wind Program Peer Review Meeting was held March 24-28, 2014 in Arlington, VA. Principle investigators from the Energy Department, National Laboratories, academic, and industry representatives presented the progress of their DOE-funded research. This report documents the formal, rigorous evaluation process and findings of nine independent reviewers who examined the technical, scientific, and business results of Wind Program funded projects, as well as the productivity and management effectiveness of the Wind Program itself.

Environmental Assessment and Finding of No Significant Impact (FONSI) of the Underground Technology Program, Rodgers Hollows, Fort Knox, Kentucky

DTIC Science & Technology

1994-10-01

Technical Report SL-94-21 October 1994 •(rn US Army Corps 00• of Engineers CM Waterways Experiment , Station Environmental Assessment and Finding of...Underground Technology Program, Rodgers Hollow, Fort Knox, KY by D.W. Murrell. J. S. Shore U.S. Army Corps of Engineers Waterways Experiment Station 3909...Evaluation. I. Shore, J. S. II. Unitedl States. Army. Corl:, of Engineers . Ull. U.S. Army En- gineer Waterways Experiment Station. IV. Structures

What happened after the evaluation?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bennett, C L

1999-03-12

An ergonomics program including a ergonomic computer workstation evaluations at a research and development facility was assessed three years after formal implementation. As part of the assessment, 53 employees who had been subjects of computer workstation evaluations were interviewed. The documented reports (ergonomic evaluation forms) of the ergonomic evaluations were used in the process of selecting the interview subjects. The evaluation forms also provided information about the aspects of the computer workstation that were discussed and recommended as part of the evaluation, although the amount of detail and completeness of the forms varied. Although the results were mixed and reflectivemore » of the multivariate psychosocial factors affecting employees working in a large organization, the findings led to recommendations for improvements of the program.« less

Finding Your Way™: a collaborative approach to increase awareness of missing person events among persons with dementia.

PubMed

Hillier, Loretta M; Harvey, David; Conway, Cathy; Hunt, Jocelyn; Hoffman, Ron

2016-04-01

To describe an innovative community-wide program aimed at increasing awareness of risks of missing person events among persons with dementia targeting various cultural groups and to present preliminary evaluation findings. Review of program records to describe program implementation and a community partner survey. Over 23 months, 386 partnerships were established to implement the program; 941 awareness-raising sessions were conducted reaching 23,495 individuals. There is an upward trend in number of sessions conducted in various languages and attendance. Community partners' (>85%) responded positively to the program and consultation process. This partnership experience demonstrates the effectiveness of a collaborative approach to the development and widespread dissemination of information and resource materials aimed at ensuring the safety of a vulnerable population.

Effective Teacher Retention Bonuses: Evidence From Tennessee

ERIC Educational Resources Information Center

Springer, Matthew G.; Swain, Walker A.; Rodriguez, Luis A.

2016-01-01

We report findings from a quasi-experimental evaluation of the recently implemented US$5,000 retention bonus program for effective teachers in Tennessee's Priority Schools. We estimate the impact of the program on teacher retention using a fuzzy regression discontinuity design by exploiting a discontinuity in the probability of treatment…

State Assessment (Accountability): Potential for Becoming a Friend or Foe?

ERIC Educational Resources Information Center

Buchmiller, Archie A.

A summary of legislation concerning educational accountability reveals that 13 States hope to find greater accountability in testing or assessment programs, 7 in planning, programming, budgeting systems, 4 in uniform accounting system, 8 in the evaluation of professional employees, 2 in management information systems, and 1 in performance…

Evaluation of Adult Education Programs. California Adult Education.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento.

To assist adult educators in finding meaningful ways to measure the effectiveness of instruction, this monograph provides selected illustrations of specific methods used by adult education instructors to verify student learning. Obtained from teachers in the field, the examples are from programs in (1) dental assisting, (2) instrument pilot ground…

34 CFR 477.3 - What activities may the Secretary fund?

Code of Federal Regulations, 2013 CFR

2013-07-01

... VOCATIONAL AND ADULT EDUCATION, DEPARTMENT OF EDUCATION STATE PROGRAM ANALYSIS ASSISTANCE AND POLICY STUDIES... directly or through awards: (a) An analysis of State plans and of the findings of evaluations conducted in... planning or program operation. (b) The provision of an information network (in conjunction with the...

34 CFR 477.3 - What activities may the Secretary fund?

Code of Federal Regulations, 2014 CFR

2014-07-01

... VOCATIONAL AND ADULT EDUCATION, DEPARTMENT OF EDUCATION STATE PROGRAM ANALYSIS ASSISTANCE AND POLICY STUDIES... directly or through awards: (a) An analysis of State plans and of the findings of evaluations conducted in... planning or program operation. (b) The provision of an information network (in conjunction with the...

34 CFR 477.3 - What activities may the Secretary fund?

Code of Federal Regulations, 2011 CFR

2011-07-01

... VOCATIONAL AND ADULT EDUCATION, DEPARTMENT OF EDUCATION STATE PROGRAM ANALYSIS ASSISTANCE AND POLICY STUDIES... directly or through awards: (a) An analysis of State plans and of the findings of evaluations conducted in... planning or program operation. (b) The provision of an information network (in conjunction with the...

34 CFR 477.3 - What activities may the Secretary fund?

Code of Federal Regulations, 2010 CFR

2010-07-01

... VOCATIONAL AND ADULT EDUCATION, DEPARTMENT OF EDUCATION STATE PROGRAM ANALYSIS ASSISTANCE AND POLICY STUDIES... directly or through awards: (a) An analysis of State plans and of the findings of evaluations conducted in... planning or program operation. (b) The provision of an information network (in conjunction with the...

34 CFR 477.3 - What activities may the Secretary fund?

Code of Federal Regulations, 2012 CFR

2012-07-01

... VOCATIONAL AND ADULT EDUCATION, DEPARTMENT OF EDUCATION STATE PROGRAM ANALYSIS ASSISTANCE AND POLICY STUDIES... directly or through awards: (a) An analysis of State plans and of the findings of evaluations conducted in... planning or program operation. (b) The provision of an information network (in conjunction with the...

Tea Time: Raising Awareness and Support for Extension

ERIC Educational Resources Information Center

Franz, Nancy K.; Fahey, Chris

2012-01-01

In a time of reliance on electronic media for information, chaotic programming environments, and declining public resources, Extension workers need to find unique ways to connect with stakeholders to maintain and increase support for programming. To address this need, we developed, conducted, and evaluated a series of stakeholder teas. We found…

Evaluation of the NSF Industry/University Cooperative Research Centers: Descriptive and Correlative Findings.

ERIC Educational Resources Information Center

National Science Foundation, Washington, DC. Directorate for Engineering.

This report presents results of a survey of participants in the National Science Foundation (NSF) Industry-University Cooperative Research Centers program. The program promotes more rapid technological innovation by creating linkages between industry and university scientists. The Centers function as university research groups, with partial…

MHEC Survey Establishes Midwest Property Insurance Benchmarks.

ERIC Educational Resources Information Center

Midwestern Higher Education Commission Risk Management Institute Research Bulletin, 1994

1994-01-01

This publication presents the results of a survey of over 200 midwestern colleges and universities on their property insurance programs and establishes benchmarks to help these institutions evaluate their insurance programs. Findings included the following: (1) 51 percent of respondents currently purchase their property insurance as part of a…

Colorado Even Start Progress Report, 2001-2002.

ERIC Educational Resources Information Center

Anderson, Beckie

Even Start programs integrate early childhood education, adult literacy or basic education, parenting education and support, and parent and child time together to help break the cycle of poverty and illiteracy. This progress report describes the Even Start program in Colorado and presents evaluation findings from the 2001-2002 implementation year,…

Helping Children Cope with Violence: A School-Based Program That Works. Research Highlights

ERIC Educational Resources Information Center

Stein, Bradley D.; Jaycox, Lisa H.; Tu, Wenli

2005-01-01

A team of clinician-researchers from several institutions collaborated to develop, implement, and evaluate an intervention designed to help children traumatized by violence. Reported findings include: (1) Students who participated in the program had significantly less post-traumatic stress symptoms, less depression, and less psychosocial…

The Impact of Diagnosing Skill Deficiencies and Assessment-Based Communication Training on Managerial Performance.

ERIC Educational Resources Information Center

Papa, Michael J.; Graham, Elizabeth E.

1991-01-01

Evaluates an organizational diagnosis program that assesses managerial communication skills and provides the frame for follow-up training programs. Finds that managers participating in follow-up communication skills training performed significantly higher on interpersonal skills, problem-solving ability, and productivity over three long-term…

Enhancing Cultural Adaptation through Friendship Training: A Single-Case Study.

ERIC Educational Resources Information Center

Liu, Yi-Ching; Baker, Stanley B.

1993-01-01

Four-year-old girl from mainland China experienced culture shock when attending American university day-care center. Counseling intern from Taiwan designed friendship training program based on assumptions concerning adaptation, acculturation, and peer relationships. Evaluated as intensive single-case study, findings indicated the program may be…

Application of Virtual Reality Technology in Biology Education.

ERIC Educational Resources Information Center

Shim, Kew-Cheol; Park, Jong-Seok; Kim, Hyun-Sup; Kim, Jae-Hyun; Park, Young-Chul; Ryu, Hai-Il

2003-01-01

Reports on the findings of a study designed to develop three-dimensional virtual reality technology (VRT) learning programs for middle school students and evaluate the program's educational value. Focuses on the topic of structure and function of the eye. Concludes that VRT simulations allow comfortable interaction with computers and increase the…

Final Accumulative Results & Transfer of Knowledge of the Arizona Career Ladder Research & Evaluation Project: Impact on Student Achievement, Formulated Models, Network Anecdotes, & Recommendations to the Legislature for Policy Development, Program Continuation & State-Wide Expansion. Summative Report VIII.

ERIC Educational Resources Information Center

Packard, Richard D.; Dereshiwsky, Mary I.

This paper presents research findings concerning the Career Ladder pilot test program in Arizona. The program is designed to reward and motivate teachers based on performance. One of the program's key features is the flexibility and innovation allowed to participating districts in their individual development of program designs and structures. An…

Time Discounting and Credit Market Access in a Large-Scale Cash Transfer Programme

PubMed Central

Handa, Sudhanshu; Martorano, Bruno; Halpern, Carolyn; Pettifor, Audrey; Thirumurthy, Harsha

2017-01-01

Summary Time discounting is thought to influence decision-making in almost every sphere of life, including personal finances, diet, exercise and sexual behavior. In this article we provide evidence on whether a national poverty alleviation program in Kenya can affect inter-temporal decisions. We administered a preferences module as part of a large-scale impact evaluation of the Kenyan Government’s Cash Transfer for Orphans and Vulnerable Children. Four years into the program we find that individuals in the treatment group are only marginally more likely to wait for future money, due in part to the erosion of the value of the transfer by inflation. However among the poorest households for whom the value of transfer is still relatively large we find significant program effects on the propensity to wait. We also find strong program effects among those who have access to credit markets though the program itself does not improve access to credit. PMID:28260842

An Ex-Post Facto Examination of Relationships among the Developmental Designs Professional Development Model/Classroom Management Approach, School Leadership, Climate, Student Achievement, Attendance, and Behavior in High Poverty, Middle Grades Schools

ERIC Educational Resources Information Center

Hough, David L.; Schmitt, Vicki L.

2011-01-01

This study reports finding from an ex post facto causal-comparison study utilizing data from a multifaceted program evaluation of a professional development approach to classroom management known as Development Designs 1 and Developmental Designs 2 (DD1 & D2). Data from this program evaluation indicate that teachers implement a number of classroom…

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Mentoring Undergraduate Students in Estuarine Research Experiences: Different Strokes for Different Folks

NASA Astrophysics Data System (ADS)

Moser, F. C.; Allen, M. R.; Montoya-Ospina, R. A.; Maldonado, P.; Barberena-Arias, M.; Olivo-Delgado, C.; Harris, L.; Pierson, J. J.; Alvarez, J. P.

2015-12-01

Here we consider how mentoring, both traditional and peer based, contributes to successful student outcomes in undergraduate research programs and we present several approaches to encourage positive mentor-mentee relationships. From several different research mentoring programs with undergraduates in Maryland and in Puerto Rico, we find that some mentoring techniques are universally useful, while others need to be tailored to a specific program and mentee population. Our programs differ in length, student composition, and student expectations, we find that success occurs across-the-board when mentors quickly establish rapport with their students and reach an early joint understanding of the program's requirements and the students' capabilities and needs through immersive orientations early in the program. Alternatively, mentors have to customize their approaches (e.g. simplify presentations of concepts, increase time for questions) when they encounter differences in student knowledge levels and cultural disconnects (e.g. language barriers, unfamiliarity with research labs and academia). Our current approach to improving and evaluating mentoring includes using a system of multiple mentor tiers (peer, near-peer, faculty, and program leaders), multiple qualitative and quantitative evaluations during the program, and post-research experience student outreach, all of which we believe improve student outcomes. Although we have measures of mentee success (e.g., presenting at national meetings, pursuing additional research experiences, applying to graduate school in marine science-related fields, etc.), we continue to look for additional short and long-term evaluation techniques that may help us to distinguish between the influence of mentoring and that of other program attributes (e.g. lab and field experiences, professional development seminars, ethics training, etc.) on student achievement.

How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

PubMed

Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

2017-07-01

In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P < .01). Larger programs were more likely to teach (P = .04) and evaluate (P = .02) community-based research. Experiential learning and classroom-based didactics were the most frequent teaching methodologies. Many programs used multiple teaching methodologies for all competencies. Observation was the most frequent evaluation technique used; portfolio review and written reflection were also commonly reported. Our findings show a strong emphasis on community pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Impacts of a Violence Prevention Program for Middle Schools: Findings from the First Year of Implementation. NCEE 2010-4007

ERIC Educational Resources Information Center

Silvia, Suyapa; Blitstein, Jonathan; Williams, Jason; Ringwalt, Chris; Dusenbury, Linda; Hansen, William

2010-01-01

This is the first of two reports that summarize the findings from an impact evaluation of a violence prevention intervention for middle schools. This report discusses findings after 1 year of implementation. A forthcoming report will discuss the findings after 2 years and 3 years of implementation. In 2004, the U.S. Department of Education (ED)…

Outcome evaluation of a 3-year senior health and wellness initiative.

PubMed

Kuczmarksi, Marie Fanelli; Cotugna, Nancy

2009-02-01

The Wilmington Senior Center developed a 3-year multidisciplinary health and wellness initiative entitled The Time of Your Life to promote healthy aging for participants attending countywide senior centers. The purpose of this paper is to describe the development and implementation of the evaluation methodology and outcomes of this senior health and wellness project that consisted of 11 programs in total. Long-term programming can present several challenges in both implementation and evaluation, but assessing outcomes is critical to documenting program value and accountability. Participant-completed surveys and post-series focus groups were utilized as the evaluation tools. Our findings indicate that the program's objectives of increasing knowledge and motivating adoption or maintenance of a healthy lifestyle were met to varying degrees, while a third objective of assessing the usefulness of resources to inform health-related decisions was unable to be evaluated due to the cross-sectional nature of the data collection. Post-series focus groups indicated that topics of most interest to seniors were money management, medications and staying mentally and physically fit. The evaluations showed that long-term programming, while challenging, can be a successful and sustainable format for senior health education.

Space station thermal control surfaces. [space radiators

NASA Technical Reports Server (NTRS)

Maag, C. R.; Millard, J. M.; Jeffery, J. A.; Scott, R. R.

1979-01-01

Mission planning documents were used to analyze the radiator design and thermal control surface requirements for both space station and 25-kW power module, to analyze the missions, and to determine the thermal control technology needed to satisfy both sets of requirements. Parameters such as thermal control coating degradation, vehicle attitude, self eclipsing, variation in solar constant, albedo, and Earth emission are considered. Four computer programs were developed which provide a preliminary design and evaluation tool for active radiator systems in LEO and GEO. Two programs were developed as general programs for space station analysis. Both types of programs find the radiator-flow solution and evaluate external heat loads in the same way. Fortran listings are included.

The Relation of Source Credibility and Message Frequency to Program Evaluation and Self-Confidence of Students in a Job Shadowing Program

ERIC Educational Resources Information Center

Linnehan, Frank

2004-01-01

Using a pre- and post-test design, this study examined the relation of an adult's credibility and message frequency to the beliefs of female high school students participating in a job-shadowing program. Hypotheses were based on the Elaboration Likelihood Model of attitude formation and change. Findings indicate that credibility of the adult…

Healthy Start Programa Madrina: A Promotora Home Visiting Outreach and Education Program to Improve Perinatal Health among Latina Pregnant Women

ERIC Educational Resources Information Center

Bill, Debra E.; Hock-Long, Linda; Mesure, Maryann; Bryer, Pamela; Zambrano, Neydary

2009-01-01

The purpose of this article is to describe the development, implementation, and evaluation of Healthy Start Programa Madrina (HSPM), a home visiting promotora outreach and education program for Latina pregnant women and to present the 10-year findings of the program (1996-2005). Perinatal health disparities continue to persist among low-income…

The Platinum Bullet: An Experimental Evaluation of CUNY's Accelerated Study in Associate Program (ASAP)--New Three-Year Impacts, Cost Analyses, and Implementation Findings

ERIC Educational Resources Information Center

Weiss, Michael; Scrivener, Susan; Fresques, Hannah; Ratledge, Alyssa; Rudd, Tim; Sommo, Colleen

2014-01-01

The City University of New York's (CUNY's) Accelerated Study in Associate Programs (ASAP) combines many of the ideas from a range of programs into a comprehensive model that requires students to attend school full-time, and provides supports and incentives for three years. ASAP's financial aid reforms, enhanced student services, and scheduling…

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

The brave new world of GEC evaluation: the experience of the Rhode Island Geriatric Education Center.

PubMed

Filinson, Rachel; Clark, Phillip G; Evans, Joann; Padula, Cynthia; Willey, Cynthia

2012-01-01

In 2007, the Health Resources Services Administration introduced new mandates that raised the standards on program evaluation for Geriatric Education Centers. Described in this article are the primary and secondary evaluation efforts undertaken for one program within the Rhode Island Geriatric Education Center (RIGEC), the findings from these efforts, and the modifications to assessment that ensued in response to the increased accountability requirements. The evaluation focused on RIGEC's series of continuing education, day-long workshops for health and social service professionals, the completion of all seven of which leads to a Certificate in Interdisciplinary Practice in Geriatrics.

Impacts of a Violence Prevention Program for Middle Schools: Findings after 3 Years of Implementation. NCEE 2011-4017

ERIC Educational Resources Information Center

Silvia, Suyapa; Blitstein, Jonathan; Williams, Jason; Ringwalt, Chris; Dusenbury, Linda; Hansen, William

2011-01-01

This is the second and final report summarizing findings from an impact evaluation of a violence prevention intervention for middle schools. This report provides findings from the second and third years of the 3-year intervention. The U.S. Department of Education (ED) contracted with RTI International and its subcontractors, Pacific Institute for…

African American perspectives: A qualitative study of an informal science enrichment program

NASA Astrophysics Data System (ADS)

Simpson, Jamila Rashida

The purposes of this study were to determine what program characteristics African American parents consider when they enroll their children into an informal science education enrichment program, the parents' evaluation of a program called Jordan Academy in which they enrolled their children, and the alignment of the parents' perspectives with Black Cultural Ethos (BCE). BCE refers to nine dimensions posited by Wade Boykin, a psychologist, as comprising African American culture. Participants were parents of students that attended Jordan Academy, an informal science enrichment program designed for third through sixth grade students from underserved populations. Qualitative methodologies were utilized to perform a thorough assessment of parents' perspectives. Data sources included classroom observations, student surveys, academy curriculum, photos and video-taped class sessions. Data included teachers and parents' responses to semi-structured, audio recorded interviews and students' written responses to open-ended items on the program's evaluation instrument. The data were analyzed for themes and the findings compared to Black Cultural Ethos. Findings revealed that the participants believed that informal science education offered their children opportunities not realized in the formal school setting - a means of impacting their children holistically. The parents expressed the academic, cultural, and personal development of their children in their characterizations of the ideal informal science education experience and in their evaluations of Jordan Academy. Overall, the parents' views emphasized the BCE values of harmony, affect, verve, movement, orality and communalism. The study has important implications for practices within and research on informal science education.

34 CFR 303.521 - Fees.

Code of Federal Regulations, 2010 CFR

2010-07-01

... SERVICES, DEPARTMENT OF EDUCATION EARLY INTERVENTION PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES... charged to parents: (1) Implementing the child find requirements in § 303.321. (2) Evaluation and... coordinative activities related to— (i) The development, review, and evaluation of IFSPs in §§ 303.340 through...

34 CFR 303.521 - Fees.

Code of Federal Regulations, 2011 CFR

2011-07-01

... SERVICES, DEPARTMENT OF EDUCATION EARLY INTERVENTION PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES... charged to parents: (1) Implementing the child find requirements in § 303.321. (2) Evaluation and... coordinative activities related to— (i) The development, review, and evaluation of IFSPs in §§ 303.340 through...

Client-Centered Supervision and Evaluation of Teachers.

ERIC Educational Resources Information Center

Schwartz, Libby Zinman

1978-01-01

Client-centered supervision is a personal participatory, and developmental approach, which finds its roots in the "third force" psychology of Carl Rogers. It requires a supervisor of sensitivity and humanistic orientation. Teacher evaluation criteria under this system focus on three areas: learning climate, program content, and…

Evaluation of the new Virginia Dept. of Highways and Transportation skid testing trailer.

DOT National Transportation Integrated Search

1975-01-01

The purpose of this study was to evaluate the new skid trailer obtained by the Virginia Department of Highways & Transportation and to determine how the survey skid testing program should be conducted in light of the findings. Specifically, those thi...

Stakeholders' Perspectives About and Priorities for Economic Evaluation of Health and Safety Programs in Healthcare.

PubMed

Tompa, Emile; de Boer, Henriette; Macdonald, Sara; Alamgir, Hasanat; Koehoorn, Mieke; Guzman, Jaime

2016-04-01

This study identified and prioritized resources and outcomes that should be considered in more comprehensive and scientifically rigorous health and safety economic evaluations according to healthcare sector stakeholders. A literature review and stakeholder interviews identified candidate resources and outcomes and then a Delphi panel ranked them. According to the panel, the top five resources were (a) health and safety staff time; (b) training workers; (c) program planning, promotion, and evaluation costs; (d) equipment purchases and upgrades; and (e) administration costs. The top five outcomes were (a) number of injuries, illnesses, and general sickness absences; (b) safety climate; (c) days lost due to injuries, illnesses, and general sickness absences; (d) job satisfaction and engagement; and (e) quality of care and patient safety. These findings emphasize stakeholders' stated priorities and are useful as a benchmark for assessing the quality of health and safety economic evaluations and the comprehensiveness of these findings. © 2016 The Author(s).

Wineries Evaluation of Costs and Benefits of Sustainability Certification Program: The Case of Terra Vitis in France.

PubMed

Jourjon, Frederique; Chou, Hsia-Chi; Gezart, Anna; Kadison, Amy E; Martinat, Lea; Pomarici, Eugenio; Vecchio, Riccardo

2016-01-01

The current paper analyses the evaluation of the costs and benefits of French wineries (N=69) participating in the sustainability program Terra Vitis, a widespread environmental certification scheme within the French wine industry. An online questionnaire was sent to all Terra Vitis participants, in order to analyse the evaluation of economic costs and benefits (together with environmental benefits) as perceived by wineries. Our findings reveal that older participants in the scheme (over 5 years), firms with higher export share (>40% of annual turnover) and cooperative wineries tend to be keener to assign a positive evaluation to the benefits/costs ratio in both the vineyard and the winery. In the context of increasing concerns regarding the economic and environmental performance of the French agricultural sector, such findings and also the patent research could be useful for policy makers and entrepreneurs in defining mainstream normative and corporate strategies. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Attitudes about AIDS education and condom availability among parents of high school students in New York City: a focus group approach.

PubMed

Rafferty, Y; Radosh, A

1997-02-01

This paper describes parents' views of the New York City Public High School's AIDS Education and Condom Availability Program. It presents findings from 12 focus groups with 81 parents of students at six representative high schools. Focus groups were conducted as part of an independent, comprehensive 3-year evaluation of the program, consisting of both qualitative and quantitative components. Participants were mostly supportive of the program, citing intense concern about AIDS among adolescents, fear that teenagers do not adequately perceive themselves as being vulnerable, and personal experiences with infected relatives and friends. Implications of these findings for program development are discussed and recommendations for social policy changes are presented.

Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

PubMed

Wand, Timothy; White, Kathryn; Patching, Joanna

2011-06-01

Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

An Empirical Comparison of Formulas Evaluating Early Intervention Program Impact on Development.

ERIC Educational Resources Information Center

Rosenberg, Steven A.; And Others

1987-01-01

The study evaluated developmental progress in three groups of infants (9-30 months) presenting Down syndrome (n=28), mild disability (n=16), or moderate/severe disabilities (n=16). To evaluate intervention impact, formulas that measure rate of development and change in rate of development were computed. Findings indicated rate change formulas were…

Flipping one-shot library instruction: using Canvas and Pecha Kucha for peer teaching.

PubMed

Carroll, Alexander J; Tchangalova, Nedelina; Harrington, Eileen G

2016-04-01

This study sought to determine whether a flipped classroom that facilitated peer learning would improve undergraduate health sciences students' abilities to find, evaluate, and use appropriate evidence for research assignments. Students completed online modules in a learning management system, with librarians facilitating subsequent student-directed, in-person sessions. Mixed methods assessment was used to evaluate program outcomes. Students learned information literacy concepts but did not consistently apply them in research assignments. Faculty interviews revealed strengthened partnerships between librarians and teaching faculty. This pedagogy shows promise for implementing and evaluating a successful flipped information literacy program.

Global Spent Fuel Logistics Systems Study (GSFLS). Volume 2. GSFLS visit findings and evaluations. Interim report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

1978-01-31

This report is a part of the interim report documentation for the Global Spent Fuel Logistics System (GSFLS) study. This report describes a global framework that evaluates spent fuel disposition requirements, influencing factors and strategies. A broad sampling of foreign governmental officials, electric utility spokesmen and nuclear power industry officials responsible for GSFLS policies, plans and programs were surveyed as to their views with respect to national and international GSFLS related considerations. The results of these GSFLS visit findings are presented herein. These findings were then evaluated in terms of technical, institutional and legal/regulatory implications. The GSFLS evaluations, in conjunctionmore » with perceived US spent fuel objectives, formed the basis for selecting a set of GSFLS strategies which are reported herein.« less

Growing community: the impact of the Stephanie Alexander Kitchen Garden Program on the social and learning environment in primary schools.

PubMed

Block, Karen; Gibbs, Lisa; Staiger, Petra K; Gold, Lisa; Johnson, Britt; Macfarlane, Susie; Long, Caroline; Townsend, Mardie

2012-08-01

This article presents results from a mixed-method evaluation of a structured cooking and gardening program in Australian primary schools, focusing on program impacts on the social and learning environment of the school. In particular, we address the Stephanie Alexander Kitchen Garden Program objective of providing a pleasurable experience that has a positive impact on student engagement, social connections, and confidence within and beyond the school gates. Primary evidence for the research question came from qualitative data collected from students, parents, teachers, volunteers, school principals, and specialist staff through interviews, focus groups, and participant observations. This was supported by analyses of quantitative data on child quality of life, cooperative behaviors, teacher perceptions of the school environment, and school-level educational outcome and absenteeism data. Results showed that some of the program attributes valued most highly by study participants included increased student engagement and confidence, opportunities for experiential and integrated learning, teamwork, building social skills, and connections and links between schools and their communities. In this analysis, quantitative findings failed to support findings from the primary analysis. Limitations as well as benefits of a mixed-methods approach to evaluation of complex community interventions are discussed.

36 CFR 1237.28 - What special concerns apply to digital photographs?

Code of Federal Regulations, 2012 CFR

2012-07-01

... defects, evaluate the accuracy of finding aids, and verify file header information and file name integrity... sampling methods or more comprehensive verification systems (e.g., checksum programs), to evaluate image.... For permanent or unscheduled images descriptive elements must include: (1) An identification number...

36 CFR § 1237.28 - What special concerns apply to digital photographs?

Code of Federal Regulations, 2013 CFR

2013-07-01

... defects, evaluate the accuracy of finding aids, and verify file header information and file name integrity... sampling methods or more comprehensive verification systems (e.g., checksum programs), to evaluate image.... For permanent or unscheduled images descriptive elements must include: (1) An identification number...

36 CFR 1237.28 - What special concerns apply to digital photographs?

Code of Federal Regulations, 2014 CFR

2014-07-01

... defects, evaluate the accuracy of finding aids, and verify file header information and file name integrity... sampling methods or more comprehensive verification systems (e.g., checksum programs), to evaluate image.... For permanent or unscheduled images descriptive elements must include: (1) An identification number...

36 CFR 1237.28 - What special concerns apply to digital photographs?

Code of Federal Regulations, 2010 CFR

2010-07-01

... defects, evaluate the accuracy of finding aids, and verify file header information and file name integrity... sampling methods or more comprehensive verification systems (e.g., checksum programs), to evaluate image.... For permanent or unscheduled images descriptive elements must include: (1) An identification number...

36 CFR 1237.28 - What special concerns apply to digital photographs?

Code of Federal Regulations, 2011 CFR

2011-07-01

... defects, evaluate the accuracy of finding aids, and verify file header information and file name integrity... sampling methods or more comprehensive verification systems (e.g., checksum programs), to evaluate image.... For permanent or unscheduled images descriptive elements must include: (1) An identification number...

An Evaluation of In-School Suspension Programs.

ERIC Educational Resources Information Center

Siskind, Theresa G.; And Others

Findings of a study that determined the effectiveness of the Berkeley County (South Carolina) in-school suspension (ISS) program are presented in this paper. Methodology involved personal interviews conducted with the ISS director and ISS teacher in 8 middle and 8 high schools in the county, a total of 16 principals and 16 teachers. Findings…

Federal Programs Supporting Educational Change, Vol. VIII: Implementing and Sustaining Innovations.

ERIC Educational Resources Information Center

Berman, Paul; McLaughlin, Milbrey Wallin

This report reviews and synthesizes the findings of a four year, two-phase study conducted by the Rand Corporation to examine and evaluate a national sample of educational innovations funded by Federal programs. Section I of this document provides background information and descriptions of the study. Section II discusses Rand's research approach…

Talents Unlimited Program: Summary of Research Finding for 1979-80.

ERIC Educational Resources Information Center

McLean, James E.; Chissom, Brad S.

During the 1979-80 school year, the Talents Unlimited (TU) program (validated by the Joint Dissemination Review Panel) for talented students in grades 1 through 6 was evaluated by nine adopting school systems. Five talent areas were addressed: communication, forecasting, decision making, productive thinking, and planning. Data were analyzed for…

Transition to Teaching in Nebraska: Findings from the First Decade

ERIC Educational Resources Information Center

McCarty, Wendy L.

2013-01-01

Nebraska's alternative teacher certification program, Transition to Teaching, is housed at the University of Nebraska at Kearney. After 10 years in operation, program evaluation was deemed necessary to assess responsiveness to the needs of teacher candidates and the school districts within the state and effectiveness in meeting those needs.…

Using Mobile Peer Mentors for Student Engagement: Student Rovers in the Learning Commons

ERIC Educational Resources Information Center

Tout, Dan; Pancini, Geri; McCormack, Rob

2014-01-01

This paper presents findings from a 2010 evaluation of Victoria University's Student Rover program, an on-campus work-based learning program in which mobile student mentors are employed and deployed within the university's Learning Commons to provide "just-in-time" and "just-in-place" learning support to other students. Student…

Evaluation of DILearn: An Interactive Computer-Assisted Learning Program for Drug Information.

ERIC Educational Resources Information Center

Tunget, Cynthia L.; And Others

1993-01-01

Use of an interactive computer-assisted learning program to teach basic skills in obtaining drug information was investigated with 26 doctoral pharmacy students and a control group of 25 students receiving lecture instruction. Findings indicated no significant differences in short-term retention of drug information between groups and that students…

What Matters, What Works: Advancing Achievement after School

ERIC Educational Resources Information Center

Public/Private Ventures, 2008

2008-01-01

This brief provides highlights from "Advancing Achievement: Findings from an Independent Evaluation of a Major After-School Initiative." The brief underscores the potential of after-school programs in the ongoing drive to advance children's academic achievement. It shines a light on some of the issues that matter most for programs striving to…

Downtown Study Centre: An Open-Ended ABE Program in an Urban Shopping Mall

ERIC Educational Resources Information Center

Harrison, David

1976-01-01

Describes an adult basic education facility after one year of operation in an urban shopping mall in Nanaimo, British Columbia, Canada. The center is an informal open-ended classroom and advising center where part-time adult learners study an individualized curriculum. Summarizes the major findings of a program evaluation. (EM)

Evaluating Performance Measurement Systems in Nonprofit Agencies: The Program Accountability Quality Scale (PAQS).

ERIC Educational Resources Information Center

Poole, Dennis L.; Nelson, Joan; Carnahan, Sharon; Chepenik, Nancy G.; Tubiak, Christine

2000-01-01

Developed and field tested the Performance Accountability Quality Scale (PAQS) on 191 program performance measurement systems developed by nonprofit agencies in central Florida. Preliminary findings indicate that the PAQS provides a structure for obtaining expert opinions based on a theory-driven model about the quality of proposed measurement…

Connecting Neuroscience, Cognitive, and Educational Theories and Research to Practice: A Review of Mathematics Intervention Programs

ERIC Educational Resources Information Center

Kroeger, Lori A.; Brown, Rhonda Douglas; O'Brien, Beth A.

2012-01-01

Research Findings: This article describes major theories and research on math cognition across the fields of neuroscience, cognitive psychology, and education and connects these literatures to intervention practices. Commercially available math intervention programs were identified and evaluated using the following questions: (a) Did neuroscience…

Honors Selection Study 1966-67.

ERIC Educational Resources Information Center

Neidich, Alan

Because many of the students selected for participation in the University of South Carolina's College of Arts and Science Honors Program failed to attain the minimal grade point level required to remain in the program, the Counseling Bureau undertook an evaluative study to improve selection methods. The project aimed to find answers to 3…

A Randomized Controlled Trial of a Multi-Dose Bystander Intervention Program Using Peer Education Theater

ERIC Educational Resources Information Center

McMahon, Sarah; Winter, Samantha C.; Palmer, Jane E.; Postmus, Judy L.; Peterson, N. Andrew; Zucker, Sharon; Koenick, RuthAnne

2015-01-01

This article reports findings from a longitudinal, experimental evaluation of a peer education theater program, Students Challenging Realities and Educating Against Myths (SCREAM) Theater. This study examines the impact of SCREAM Theater on a range of bystander-related outcomes (i.e. bystander intentions, bystander efficacy, perception of friend…

Process evaluation of the Hunter Illawarra Kids Challenge Using Parent Support study: a multisite randomized controlled trial for the management of child obesity.

PubMed

Jones, Rachel A; Warren, Janet M; Okely, Anthony D; Collins, Clare E; Morgan, Philip J; Cliff, Dylan P; Burrows, Tracy; Cleary, Jane; Baur, Louise A

2010-11-01

The purposes of this article are to (a) outline findings from secondary or process outcome data of the Hunter Illawarra Kids Challenge Using Parent Support (HIKCUPS) study and (b) inform the design and development of future research interventions and practice in the management of child obesity. Data were collected by means of facilitator evaluations, independent session observation, attendance records, and parent questionnaires. Internal validity and reliability of the program delivery were high. All parents reported positive changes in their children as a result of the physical activity program, the dietary modification program, or both. Most participants completed the home activities, but more than half reported that finding time to do them was problematic. Facilitator review indicated that future programs should specifically cater to children of similar age or same sex, allow adequate time for explanation of complex nutritional concepts, and use intrinsic motivators for participants. Recommendations for future interventions, specifically the implementation of subsequent HIKCUPS or other multisite effectiveness studies, are detailed.

Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program.

PubMed

Tein, Jenn-Yun; Mazza, Gina L; Gunn, Heather J; Kim, Hanjoe; Stuart, Elizabeth A; Sandler, Irwin N; Wolchik, Sharlene A

2018-06-01

We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.

Case studies of energy efficiency financing in the original five pilot states, 1993-1996

DOE Office of Scientific and Technical Information (OSTI.GOV)

Farhar, B C; Collins, N E; Walsh, R W

1997-05-01

The purpose of this report is to document progress in state-level programs in energy efficiency financing programs that are linked with home energy rating systems. Case studies are presented of programs in five states using a federal pilot program to amortize the costs of home energy improvements. The case studies present background information, describe the states` program, list preliminary evaluation data and findings, and discuss problems and solution encountered in the programs. A comparison of experiences in pilot states will be used to provide guidelines for program implementers, federal agencies, and Congress. 5 refs.

A menu with prices: Annual per person costs of programs addressing community integration.

PubMed

Leff, H Stephen; Cichocki, Ben; Chow, Clifton; Salzer, Mark; Wieman, Dow

2016-02-01

Information on costs of programs addressing community integration for persons with serious mental illness in the United States, essential for program planning and evaluation, is largely lacking. To address this knowledge gap, community integration programs identified through directories and snowball sampling were sent an online survey addressing program costs and organizational attributes. 64 Responses were received for which annual per person costs (APPC) could be computed. Programs were categorized by type of services provided. Program types differed in median APPCs, though median APPCs identified were consistent with the ranges identified in the limited literature available. Multiple regression was used to identify organizational variables underlying APPCs such as psychosocial rehabilitation program type, provision of EBPs, number of volunteers, and percentage of budget spent on direct care staff, though effects sizes were moderate at best. This study adds tentative prices to the menu of community integration programs, and the implications of these findings for choosing, designing and evaluating programs addressing community integration are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

A pilot-study of a worksite based participatory intervention program: Its acceptability and short-term effects on work climate and attitudes in human service employees.

PubMed

Nylén, Eva Charlotta; Lindfors, Petra; Ishäll, Lars; Göransson, Sara; Aronsson, Gunnar; Kylin, Camilla; Sverke, Magnus

2017-01-01

Psychosocial factors, including job demands and poor resources, have been linked to stress, health problems, and negative job attitudes. However, worksite based interventions and programs targeting psychosocial factors may change employees' perceptions of their work climate and work attitudes. This pilot study describes a newly developed worksite based participatory organizational intervention program that was tested in the social service sector. It is evaluated using participants' perceptions of the intervention to investigate its acceptability as a feature of feasibility and its short-term effects on work climate factors (job demands and resources) and work-related attitudes. Forty employees of a Swedish social service unit provided self-reports before, during, and after the intervention. As for effects, quantitative role overload and social support decreased while turnover intention increased. Responses to an open-ended question showed that participants considered the intervention program valuable for addressing issues relating to the psychosocial work climate. Although the findings are preliminary, it was possible to carry out this worksite based participatory organizational program in this particular setting. Also, the preliminary findings underscore the challenges associated with designing and implementing this type of intervention program, thus adding to the methodological discussion on implementation and evaluation.

Student Evaluation of UTOPIA

ERIC Educational Resources Information Center

Pearson, M.; Carswell, D. J.

1978-01-01

Reports some reactions and opinions of the students to a course in nuclear and radiation chemistry using programmed instructional aids. Concludes that the findings were very favorable to the course. (GA)

Health in the urban environment: a qualitative review of the Brighton and Hove WHO Healthy City Program.

PubMed

Hall, Caroline; Davies, John Kenneth; Sherriff, Nigel

2010-01-01

Phase IV of the WHO European Region's Healthy Cities Program ended in December 2008. This article presents the findings from a recently completed review of Brighton and Hove's Healthy City Program which aimed to scope whether added value had accrued from the city's role as a WHO Healthy City during phase IV. In contrast to most other evaluations of healthy cities, this review adopted a qualitative approach representing an appraisal of the Brighton and Hove Healthy City Program from the internal viewpoint of its local stakeholders. In addition to documentary analysis and a facilitated workshop, a series of in-depth interviews (N = 27) were conducted with stakeholders from the Brighton and Hove Healthy City Partnership representing each of the sectors reflected in the Local Strategic Partnership (public, statutory, elected, community and voluntary, neighborhood and communities, business). The key findings of the review are presented in a way which reflects the three key areas of the review including (1) the healthy cities approach, (2) participation in phase IV of the WHO Healthy Cities Program, and (3) the Brighton and Hove Healthy City Partnership. These findings are discussed, and recommendations for action at local, national, and European levels are proposed. In particular, we argue that there is an urgent need to develop a suitable monitoring and evaluation system for the WHO Healthy Cities Program with appropriate indicators that are meaningful and relevant to local stakeholders. Moreover, it would be important for any such system to capitalize on the benefits that qualitative methodologies can offer alongside more traditional quantitative indicators.

Design and demonstration of an advanced data collection/position location system

NASA Technical Reports Server (NTRS)

1977-01-01

The final report on a breadboard evaluation and demonstration program is reported concerning the applicability of MSK modulation and chirp-z transformer technology in Advanced Data Collection/Position Location (ADC/PL) systems. The program effort consisted of three phases - design, testing, and evaluation. Section 2 describes the breadboard hardware built during the design phase of the program, Section 3 describes the tests conducted on the breadboard and the results of the tests, and Section 4 presents a brief analysis and summary of the findings of the breadboard tests and develops a sample ADC/PL system which incorporates both MSK modulation and a chirp-z transformer.

Using evaluation to improve program quality based on the BELL model.

PubMed

Phalen, Earl Martin; Cooper, Tiffany M

2007-01-01

Building Educated Leaders for Life (BELL) is a national not-for-profit organization whose mission is to increase the educational achievements, self-esteem, and life opportunities of elementary school children living in low-income urban communities. BELL has been engaged in formal evaluation, internally and externally, for more than five years and has built internal evaluation capacity by investing in a specialized full-time evaluation team. As part of a continuous program improvement model of evaluation, BELL uses the data to refine program implementation and replicate successful elements of the services and operations. In this chapter, the authors highlight best practices from the field by outlining BELL's approach to using evaluation data for continuous program improvement. Key strategies include (1) carefully identifying intended users of the evaluation throughout the organization and among its external stakeholders, then working closely with intended users throughout the evaluation process, ensuring full engagement at every step of the process; (2) reporting findings in a readable, user-friendly format and timing the reporting so that it is aligned with programmatic decision making and planning cycles; and (3) making and supporting explicit recommendations for the next program cycle, where intended users have agreed to recommendations and ownership is assigned. BELL's successful use of data for improvement is evidenced by the consistently strong outcomes for the students it serves as well as increased efficiency and satisfaction related to service delivery that has supported the replication of BELL's programs nationally.

Department of Education Information on Consolidation Opportunities and Student Aid. Testimony before the Subcommittee on Human Resources and the Intergovernmental Relations Committee on Government Reform and Oversight, House of Representatives. Statement of Cornelia M. Blanchette, Associate Director, Education and Employment Issues, Health, Education, and Human Services Division.

ERIC Educational Resources Information Center

Blanchette, Cornelia M.

This report evaluates Department of Education opportunities to consolidate overlapping education programs, to find cost savings, and to strengthen its "gatekeeping" over schools' participation in student financial aid programs. It notes that, besides already proposed program consolidation, other programs that could be streamlined include…

Evaluation of an Educational Program to Improve School Nursing Staff Perceptions of Bullying In Pinellas County, Florida.

PubMed

Salmeron, Patricia A; Christian, Becky J

2016-01-01

The purpose of this project was to determine if a bullying educational program for school nurses and certified nursing assistants/health technicians (CNAs/HTs) would increase knowledge of bullying, probability of reporting a bully, and probability of assisting a bullied victim. This educational program and evaluation employed a retrospective, post-then-pre-test design. Instruments used included a 17-item demographic questionnaire and the 12-item Reduced Aggression/ Victimization Scale Bullying Assessment Tool (BAT), a 5-point Likert Scale de - signed to assess school nurses’ and CNAs’/HTs’ understanding of bullying, the probability of reporting bullies, and the probability of assisting bullied victims before and after the educational presentation. Findings of this educational evaluation program indicated that the majority of school nurses and CNAs/HTs had an increased understanding of bullying, higher probability of reporting a bully, and assisting a bullied victim after the presentation.

Nurse education regarding agitated patients and its effects on clinical practice.

PubMed

Ozdemir, Leyla; Karabulut, Erdem

This study identified the impact of an education program on nurses' practices for agitated patients and documented the changes in practice after completion of the training. Eighteen cardiac intensive care nurses were included to the study. Prior to nurses' participation in an education program, a pre-test indicating nurses' current practices for 40 agitated patients was evaluated with the 'Nurse Practice Form'. After the pre-test data collection period was completed, the 2-day training program on caring for agitated patients was conducted. The last step of the study was evaluation of post-test nurses' practices for 40 agitated patients using the 'Nurse Practice Form'. The findings indicated that instead of pre-test nurses' use of physical restraints for controlling agitated patients without a physician order, none of post-test nurses applied them. The training program provided nurses the knowledge and skills needed to evaluate and to manage the causes of agitation.

Findings From the National Machine Guarding Program-A Small Business Intervention: Machine Safety.

PubMed

Parker, David L; Yamin, Samuel C; Xi, Min; Brosseau, Lisa M; Gordon, Robert; Most, Ivan G; Stanley, Rodney

2016-09-01

The purpose of this nationwide intervention was to improve machine safety in small metal fabrication businesses (3 to 150 employees). The failure to implement machine safety programs related to guarding and lockout/tagout (LOTO) are frequent causes of Occupational Safety and Health Administration (OSHA) citations and may result in serious traumatic injury. Insurance safety consultants conducted a standardized evaluation of machine guarding, safety programs, and LOTO. Businesses received a baseline evaluation, two intervention visits, and a 12-month follow-up evaluation. The intervention was completed by 160 businesses. Adding a safety committee was associated with a 10% point increase in business-level machine scores (P < 0.0001) and a 33% point increase in LOTO program scores (P < 0.0001). Insurance safety consultants proved effective at disseminating a machine safety and LOTO intervention via management-employee safety committees.

How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations.

PubMed Central

Ennett, S T; Tobler, N S; Ringwalt, C L; Flewelling, R L

1994-01-01

OBJECTIVES. Project DARE (Drug Abuse Resistance Education) is the most widely used school-based drug use prevention program in the United States, but the findings of rigorous evaluations of its effectiveness have not been considered collectively. METHODS. We used meta-analytic techniques to review eight methodologically rigorous DARE evaluations. Weighted effect size means for several short-term outcomes also were compared with means reported for other drug use prevention programs. RESULTS. The DARE effect size for drug use behavior ranged from .00 to .11 across the eight studies; the weighted mean for drug use across studies was .06. For all outcomes considered, the DARE effect size means were substantially smaller than those of programs emphasizing social and general competencies and using interactive teaching strategies. CONCLUSIONS. DARE's short-term effectiveness for reducing or preventing drug use behavior is small and is less than for interactive prevention programs. PMID:8092361

Methodological Review of Intimate Partner Violence Prevention Research

ERIC Educational Resources Information Center

Murray, Christine E.; Graybeal, Jennifer

2007-01-01

The authors present a methodological review of empirical program evaluation research in the area of intimate partner violence prevention. The authors adapted and utilized criterion-based rating forms to standardize the evaluation of the methodological strengths and weaknesses of each study. The findings indicate that the limited amount of…

The Impact of In-Prison Therapeutic Community Programs on Prison Management.

ERIC Educational Resources Information Center

Prendergast, Michael; Farabee, David; Cartier, Jerome

2001-01-01

Presents findings of a process evaluation of the California Substance Abuse Treatment Facility. Measures from the evaluation suggest that the presence of a therapeutic community within a prison is associated with significant advantages for management of the institution-including lower rates of infractions, reduced absenteeism among correctional…

22 CFR 142.6 - Remedial action, voluntary action, and self-evaluation.

Code of Federal Regulations, 2013 CFR

2013-04-01

...-evaluation. 142.6 Section 142.6 Foreign Relations DEPARTMENT OF STATE CIVIL RIGHTS NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE General Provisions... Secretary finds that a recipient has discriminated against persons on the basis of handicap in violation of...

22 CFR 142.6 - Remedial action, voluntary action, and self-evaluation.

Code of Federal Regulations, 2011 CFR

2011-04-01

...-evaluation. 142.6 Section 142.6 Foreign Relations DEPARTMENT OF STATE CIVIL RIGHTS NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE General Provisions... Secretary finds that a recipient has discriminated against persons on the basis of handicap in violation of...

22 CFR 142.6 - Remedial action, voluntary action, and self-evaluation.

Code of Federal Regulations, 2014 CFR

2014-04-01

...-evaluation. 142.6 Section 142.6 Foreign Relations DEPARTMENT OF STATE CIVIL RIGHTS NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE General Provisions... Secretary finds that a recipient has discriminated against persons on the basis of handicap in violation of...

22 CFR 142.6 - Remedial action, voluntary action, and self-evaluation.

Code of Federal Regulations, 2010 CFR

2010-04-01

...-evaluation. 142.6 Section 142.6 Foreign Relations DEPARTMENT OF STATE CIVIL RIGHTS NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE General Provisions... Secretary finds that a recipient has discriminated against persons on the basis of handicap in violation of...

22 CFR 142.6 - Remedial action, voluntary action, and self-evaluation.

Code of Federal Regulations, 2012 CFR

2012-04-01

...-evaluation. 142.6 Section 142.6 Foreign Relations DEPARTMENT OF STATE CIVIL RIGHTS NONDISCRIMINATION ON THE BASIS OF HANDICAP IN PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE General Provisions... Secretary finds that a recipient has discriminated against persons on the basis of handicap in violation of...

The National Evaluation of NASA's Science, Engineering, Mathematics and Aerospace Academy (SEMAA) Program

ERIC Educational Resources Information Center

Martinez, Alina; Cosentino de Cohen, Clemencia

2010-01-01

This report presents findings from a NASA requested evaluation in 2008, which contains both implementation and impact modules. The implementation study investigated how sites implement Science, Engineering, Mathematics, and Aerospace Academy (SEMAA) and the contextual factors important in this implementation. The implementation study used data…

National STEM Consortium Evaluation. Final Report

ERIC Educational Resources Information Center

Stewart, Sarah

2015-01-01

Acting as the lead agency for the "National STEM Consortium" (NSC), Anne Arundel Community College (AACC) engaged Hezel Associates to provide an independent program and impact evaluation of the U.S. Department of Labor (USDOL)-funded STEM certificate initiative. This report is comprehensive and covers the findings from all 4 years of the…

Integrating Multimedia into the Curriculum: A Case Study Evaluation.

ERIC Educational Resources Information Center

Felix, Uschi

1997-01-01

Evaluates software developed for advanced learners of a second language. The software uses the target language (German) exclusively, brings together language and literature teaching, and includes a large variety of written exercises with scored feedback. Findings reveal that students are enthusiastic about using this multimedia program and…

Cycle life test. Evaluation program for secondary spacecraft cells. [performance tests on silver zinc batteries, silver cadmium batteries, and nickel cadmium batteries

NASA Technical Reports Server (NTRS)

Harkness, J. D.

1976-01-01

Considerable research is being done to find more efficient and reliable means of starting electrical energy for orbiting satellites. Rechargeable cells offer one such means. A test program is described which has been established in order to further the evaluation of certain types of cells and to obtain performance and failure data as an aid to their continued improvement. The purpose of the program is to determine the cycling performance capabilities of packs of cells under different load and temperature conditions. The various kinds of cells tested were nickel-cadmium, silver-cadmium, and silver-zinc sealed cells. A summary of the results of the life cycling program is given in this report.

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

An Evaluation Framework and Comparative Analysis of the Widely Used First Programming Languages

PubMed Central

Farooq, Muhammad Shoaib; Khan, Sher Afzal; Ahmad, Farooq; Islam, Saeed; Abid, Adnan

2014-01-01

Computer programming is the core of computer science curriculum. Several programming languages have been used to teach the first course in computer programming, and such languages are referred to as first programming language (FPL). The pool of programming languages has been evolving with the development of new languages, and from this pool different languages have been used as FPL at different times. Though the selection of an appropriate FPL is very important, yet it has been a controversial issue in the presence of many choices. Many efforts have been made for designing a good FPL, however, there is no ample way to evaluate and compare the existing languages so as to find the most suitable FPL. In this article, we have proposed a framework to evaluate the existing imperative, and object oriented languages for their suitability as an appropriate FPL. Furthermore, based on the proposed framework we have devised a customizable scoring function to compute a quantitative suitability score for a language, which reflects its conformance to the proposed framework. Lastly, we have also evaluated the conformance of the widely used FPLs to the proposed framework, and have also computed their suitability scores. PMID:24586449

An evaluation framework and comparative analysis of the widely used first programming languages.

PubMed

Farooq, Muhammad Shoaib; Khan, Sher Afzal; Ahmad, Farooq; Islam, Saeed; Abid, Adnan

2014-01-01

Computer programming is the core of computer science curriculum. Several programming languages have been used to teach the first course in computer programming, and such languages are referred to as first programming language (FPL). The pool of programming languages has been evolving with the development of new languages, and from this pool different languages have been used as FPL at different times. Though the selection of an appropriate FPL is very important, yet it has been a controversial issue in the presence of many choices. Many efforts have been made for designing a good FPL, however, there is no ample way to evaluate and compare the existing languages so as to find the most suitable FPL. In this article, we have proposed a framework to evaluate the existing imperative, and object oriented languages for their suitability as an appropriate FPL. Furthermore, based on the proposed framework we have devised a customizable scoring function to compute a quantitative suitability score for a language, which reflects its conformance to the proposed framework. Lastly, we have also evaluated the conformance of the widely used FPLs to the proposed framework, and have also computed their suitability scores.

Evaluation and implementation of highly challenging balance training in clinical practice for people with Parkinson's disease: protocol for the HiBalance effectiveness-implementation trial.

PubMed

Leavy, Breiffni; Kwak, Lydia; Hagströmer, Maria; Franzén, Erika

2017-02-07

If people with progressive neurological diseases are to avail of evidence-based rehabilitation, programs found effective in randomized controlled trials (RCT's) must firstly be adapted and tested in clinical effectiveness studies as a means of strengthening their evidence base. This paper describes the protocol for an effectiveness-implementation trial that will assess the clinical effectiveness of a highly challenging balance training program (the HiBalance program) for people with mild-moderate Parkinson's disease (PD) while simultaneously collecting data concerning the way in which the program is implemented. The HiBalance program is systemically designed to target balance impairments in PD and has been shown effective at improving balance control and gait in a previous RCT. Study aims are to i) determine the effectiveness of the adapted HiBalance program on performance and self-rated outcomes such as balance control, gait and physical activity level ii) conduct a process evaluation of program implementation at the various clinics iii) determine barriers and facilitators to program implementation in these settings. This effectiveness-implementation type 1 hybrid study will use a non-randomized controlled design with consecutive inclusion of people with PD at multiple clinical sites. A mixed method approach will be used to collect clinical effectiveness data and process evaluation data which is both quantitative and qualitative in nature. The consolidated framework for implementation research (CFIR) will be used to guide the planning and collection of data concerning implementation barriers and facilitators. The HiBalance program will be provided by physical therapists as a part of standard rehabilitation care at the clinical sites, while the evaluation of the implementation process will be performed by the research group and funded by research grants. An effectiveness-implementation study design benefits patients by speeding up the process of translating findings from research settings to routine health care. Findings from this study will also be highly relevant for those working with neurological rehabilitation when faced with decisions concerning the translation of training programs from efficacy studies to everyday clinical practice. ClinicalTrials.gov march 2016, NCT02727478 .

Handbook of evaluation of utility DSM programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hirst, E.; Reed, J.; Bronfman, B.

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough tomore » highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.« less

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hirst, E.; Reed, J.; Bronfman, B.

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough tomore » highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.« less

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

WHATIF: an open-source desktop application for extraction and management of the incidental findings from next-generation sequencing variant data

PubMed Central

Ye, Zhan; Kadolph, Christopher; Strenn, Robert; Wall, Daniel; McPherson, Elizabeth; Lin, Simon

2015-01-01

Background Identification and evaluation of incidental findings in patients following whole exome (WGS) or whole genome sequencing (WGS) is challenging for both practicing physicians and researchers. The American College of Medical Genetics and Genomics (ACMG) recently recommended a list of reportable incidental genetic findings. However, no informatics tools are currently available to support evaluation of incidental findings in next-generation sequencing data. Methods The Wisconsin Hierarchical Analysis Tool for Incidental Findings (WHATIF), was developed as a stand-alone Windows-based desktop executable, to support the interactive analysis of incidental findings in the context of the ACMG recommendations. WHATIF integrates the European Bioinformatics Institute Variant Effect Predictor (VEP) tool for biological interpretation and the National Center for Biotechnology Information ClinVar tool for clinical interpretation. Results An open-source desktop program was created to annotate incidental findings and present the results with a user-friendly interface. Further, a meaningful index (WHATIF Index) was devised for each gene to facilitate ranking of the relative importance of the variants and estimate the potential workload associated with further evaluation of the variants. Our WHATIF application is available at: http://tinyurl.com/WHATIF-SOFTWARE Conclusions The WHATIF application offers a user-friendly interface and allows users to investigate the extracted variant information efficiently and intuitively while always accessing the up to date information on variants via application programming interfaces (API) connections. WHATIF’s highly flexible design and straightforward implementation aids users in customizing the source code to meet their own special needs. PMID:25890833

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety

PubMed Central

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative–reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research. PMID:26297629

Facing the fear of failure: An explorative qualitative study of client experiences in a mindfulness-based stress reduction program for university students with academic evaluation anxiety.

PubMed

Hjeltnes, Aslak; Binder, Per-Einar; Moltu, Christian; Dundas, Ingrid

2015-01-01

The aim of this qualitative study was to investigate the subjective experiences of 29 university students who participated in an 8-week mindfulness-based stress reduction (MBSR) program for academic evaluation anxiety. Participants who self-referred to the Student Counseling Service underwent individual semi-structured interviews about how they experienced the personal relevance and practical usefulness of taking the MBSR program. Interviews were transcribed and analyzed through a team-based explorative-reflective thematic approach based on a hermeneutic-phenomenological epistemology. Five salient patterns of meaning (themes) were found: (1) finding an inner source of calm, (2) sharing a human struggle, (3) staying focused in learning situations, (4) moving from fear to curiosity in academic learning, and (5) feeling more self-acceptance when facing difficult situations. We contextualize these findings in relation to existing research, discuss our own process of reflexivity, highlight important limitations of this study, and suggest possible implications for future research.

The FAA's postmortem forensic toxicology self-evaluated proficiency test program: the second seven years.

PubMed

Chaturvedi, Arvind K; Craft, Kristi J; Cardona, Patrick S; Rogers, Paul B; Canfield, Dennis V

2009-05-01

During toxicological evaluations of samples from fatally injured pilots involved in civil aviation accidents, a high degree of quality control/quality assurance (QC/QA) is maintained. Under this philosophy, the Federal Aviation Administration (FAA) started a forensic toxicology proficiency-testing (PT) program in July 1991. In continuation of the first seven years of the PT findings reported earlier, PT findings of the next seven years are summarized herein. Twenty-eight survey samples (12 urine, 9 blood, and 7 tissue homogenate) with/without alcohols/volatiles, drugs, and/or putrefactive amine(s) were submitted to an average of 31 laboratories, of which an average of 25 participants returned their results. Analytes in survey samples were correctly identified and quantitated by a large number of participants, but some false positives of concern were reported. It is anticipated that the FAA's PT program will continue to serve the forensic toxicology community through this important part of the QC/QA for laboratory accreditations.

A phenomenological approach to assessing a DUI/DWI program.

PubMed

Narag, Raymund E; Maxwell, Sheila Royo; Lee, Byung

2013-02-01

In an effort to find a more proactive solution to the problem of drunk driving, a midwestern city has implemented a Driving Under the Influence or Driving While Impaired (DUI/DWI) Court program, a derivative of the popular drug courts. Eligible participants are those who have had two or more drunk-driving offenses but who have not been convicted of a violent offense. Participants volunteer for a 36-week program in exchange for a suspension of their prison sentence. Program elements include drug/alcohol monitoring, support groups, counseling, and extensive supervision. Using a phenomenological approach, this article describes the challenges faced by 20 participants, how they navigated the program requirements, their key realizations about their conditions, and their views on the viability and effectiveness of the program. The article uses qualitative interviews of participants and stakeholders collected for a process evaluation of the DUI program, and official records collected for programming purposes. Findings from this research can be used broadly for programming purposes and can be used by other court jurisdictions that are developing similar programs.

"Compassion, pleasantry, and hope": a process evaluation of a volunteer-based nonprofit.

PubMed

Mye, Sarah C; Moracco, Kathryn E

2015-06-01

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Implementation of the Hammersmith Infant Neurological Exam in a High-Risk Infant Follow-Up Program

PubMed Central

Maitre, Nathalie L; Chorna, Olena; Romeo, Domenico M; Guzzetta, Andrea

2017-01-01

Background High-Risk Infant Follow-Up (HRIF) programs provide early identification and referral for treatment of neurodevelopmental delays and impairments. In these programs, a standardized neurological exam is a critical component of evaluation for clinical and research purposes. Implementation To address primary challenges of provider educational diversity and standardized documentation, we designed an approach to training and implementation of the Hammersmith Infant Neurological Exam (HINE) with pre-course materials, a workshop model and adaptation of the electronic medical record. Conclusions Provider completion and documentation of a neurologic exam were evaluated before and after HINE training. Standardized training and implementation of the HINE in a large HRIF is feasible and effective and allows for quantitative evaluation of neurological findings and developmental trajectories. PMID:27765470

Building on a YMCA's health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_.

PubMed

Bush, Paula Louise; García Bengoechea, Enrique

2016-08-01

School-based physical activity programs are only effective for increasing adolescents' school-based physical activity. To increase out-of-school-time physical activity, complementary community programs are warranted. Partnerships between universities and community organizations may help build the capacity of these organizations to provide sustainable programs. To understand capacity building processes and outcomes, we partnered with a YMCA to build on their adolescent physical activity promotion capacity. Together, we designed and implemented means to evaluate the YMCA teen program to inform program planning. For this qualitative case study, emails and interviews and meetings transcripts were collected over 2.5 years and analyzed using inductive and deductive thematic analysis. Findings illustrate that the YMCA's workforce and organizational development capacities (e.g., evaluation and health promotion capacity and competence) were increased through our partnership, resource allocation, and leadership. We responded to YMCA partners' perceived needs, yet guided them beyond those needs, successfully combining our complementary objectives, knowledge, and skills to generate an integrated program vision, rationale, and evaluation results. This provided YMCA partners with validation, reminders, and awareness. In turn, this contributed to programming and evaluation practice changes. In light of extant capacity building literature, we discuss how our partnership increased the YMCA's capacity to promote healthy adolescent programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development of the Aqueous Processes for Removing NOx from Flue Gases.

ERIC Educational Resources Information Center

Chappell, Gilford A.

A screening study was conducted to evaluate the capability of aqueous solutions to scrub NOx from the flue gases emitted by stationary power plants fired with fossil fuels. The report summarizes the findings of this laboratory program. The experimental program studied the following media for absorption of NOx from flue gases containing no NOx:…

Using Continuous Quality Improvement (CQI) to Sustain Success in Faculty Development for Online Teaching

ERIC Educational Resources Information Center

Kerrick, Sharon A.; Miller, Karen Hughes; Ziegler, Craig

2015-01-01

This article shares the curriculum and evaluation findings over four years for a faculty development program aimed at increasing skills in designing and teaching online courses. The University of Louisville's "Delphi U" is a four-day retreat style program covering 17 modules, each of which includes an exercise or activity. Over the four…

The Use and Validation of Qualitative Methods Used in Program Evaluation.

ERIC Educational Resources Information Center

Plucker, Frank E.

When conducting a two-year college program review, there are several advantages to supplementing the standard quantitative research approach with qualitative measures. Qualitative research does not depend on a large number of random samples, it uses a flexible design which can be refined as the research is executed, and it generates findings in a…

Diversity, Knowledge Clusters, and Job Placement: Graduate Economics Teaching of Core Microeconomics

ERIC Educational Resources Information Center

Campbell, Arthur; Feinstein, Jonathan S.; Hong, Soonwook; Qian, Sharon; Williams, Trevor C.

2017-01-01

The authors present an empirical analysis of what is taught in core micro-economics at a set of top U.S. doctoral economics programs. Their aim is to evaluate the diversity across programs and assess whether there are distinct "schools of thought" in graduate economics education. Their empirical findings reveal substantial, in fact,…

A Short Term Evaluation of the Direct Operating Grants. Final Report.

ERIC Educational Resources Information Center

Levy-Coughlin Partnership.

Findings of a survey of a sample of center-based child care (CBCC) programs and private home day care (PHDC) agencies listed in Ontario's Direct Operating Grant Calculation Data Base are reported. During 1988, licensed child care programs in Ontario received approximately 46.5 million dollars in Direct Operating Grants (DOGs). Grants were…

A Checklist for Designing and Evaluating Physical Education Program Web Sites

ERIC Educational Resources Information Center

Tucker, Michael; Hill, Grant

2009-01-01

Creating a physical education department web site is an excellent way to promote a positive image of the program, because students and parents are able to find important information and improve the lines of communication. A well-designed physical education web site can even encourage students to increase their physical activity levels. Improved…

Public Value Posters: Conveying Societal Benefits of Extension Programs through Evaluation Evidence

ERIC Educational Resources Information Center

Chazdon, Scott; Meyer, Nathan; Mohr, Caryn; Troschinetz, Alexis

2017-01-01

The public value poster session is a new tool for effectively demonstrating and reporting the public value of Extension programming. Akin to the research posters that have long played a critical role in the sharing of findings from academic studies, the public value poster provides a consistent format for conveying the benefits to society of…

Tuning in to Kids: An Emotion-Focused Parenting Program--Initial Findings from a Community Trial

ERIC Educational Resources Information Center

Havighurst, Sophie S.; Wilson, Katherine R.; Harley, Ann E.; Prior, Margot R.

2009-01-01

This study evaluated a new group parenting program, Tuning in to Kids, which taught emotion coaching skills to parents of preschool children. In a randomized control trial, 218 primary caregiver parents of children aged 4.0-5.11 years completed questionnaires assessing parent emotion socialization (emotion coaching vs. emotion dismissing), parent…

"Tuning in to Kids": Improving Emotion Socialization Practices in Parents of Preschool Children--Findings from a Community Trial

ERIC Educational Resources Information Center

Havighurst, Sophie S.; Wilson, Katherine R.; Harley, Ann E.; Prior, Margot R.; Kehoe, Christiane

2010-01-01

Background: This study evaluated a new prevention and early intervention parenting program: "Tuning in to Kids." The program aims to improve emotion socialization practices in parents of preschool children and is based on research evidence that parents' responses to, and coaching of, their children's emotions influence emotional and behavioral…

Going Public: Who Leaves a Large, Longstanding, and Widely Available Urban Voucher Program?

ERIC Educational Resources Information Center

Cowen, Joshua M.; Fleming, David J.; Witte, John F.; Wolf, Patrick J.

2012-01-01

This article contributes to research concerning the determinants of student mobility between public and private schools. The authors analyze a unique set of data collected as part of a new evaluation of Milwaukee's citywide voucher program. The authors find several important patterns. Students who switch from the private to the public sector were…

Educational Opportunity Program (EOP) at a Selective Public University: Initial Findings from a Longitudinal Evaluation Study

ERIC Educational Resources Information Center

Winograd, Greta; Verkuilen, Jay; Weingarten, Alison; Walker, Lucy

2018-01-01

In this study, we examined academic outcomes among students from low-income and academically disadvantaged backgrounds who participated in the Educational Opportunity Program (EOP) at a selective four-year public comprehensive college in the Northeast. We found that provisionally admitted EOP students earned comparable first-semester grades and…

Reemployment Assistance for Engineers, Scientists, and Technicians Unemployed Because of Aerospace and Defense Cutbacks. Report to Congress.

ERIC Educational Resources Information Center

Comptroller General of the U.S., Washington, DC.

As a report on the Department of Labor's Technology Mobilization and Reemployment (TMR) program, findings and conclusions from an evaluative review are presented in this volume. Information is obtained from state eployment security offices in Los Angeles and Van Nuys, California; Seattle; Denver; and New Orleans. The program accomplishments are…

Lessons Learned from a State-Funded Workplace Literacy Program. Upjohn Institute Staff Working Paper No. 09-146

ERIC Educational Resources Information Center

Hollenbeck, Kevin; Timmeney, Bridget

2009-01-01

Findings from an evaluation of a workplace literacy program funded by the State of Indiana are presented. Working with employers, providers were given considerable latitude to design their own training regimens. The state awarded certificates to workers who achieved certain levels of proficiency in reading, math, critical thinking, problem solving…

Computer-Assisted, Counselor-Delivered Smoking Cessation Counseling for Community College Students: Intervention Approach and Sample Characteristics

ERIC Educational Resources Information Center

Prokhorov, Alexander V.; Fouladi, Rachel T.; de Moor, Carl; Warneke, Carla L.; Luca, Mario; Jones, Mary Mullin; Rosenblum, Carol; Emmons, Karen M.; Hudmon, Karen Suchanek; Yost, Tracey E.; Gritz, Ellen R.

2007-01-01

This report presents the experimental approach and baseline findings from "Look at Your Health," an ongoing study to develop and evaluate a computer-assisted, counselor-delivered smoking cessation program for community college students. It describes the expert system software program used for data collection and for provision of tailored feedback,…

Evaluation of Safe Medication Administration through the Use of Simulation in an Academic Setting

ERIC Educational Resources Information Center

Dover, Cheryl D.

2013-01-01

Nursing educational programs are struggling with how to educate students to safely and efficiently administer medications. There is no doubt education programs need to find a way to assist students to acquire the skill of medication administration and to also transfer the skill into practice. Knowledge, skills, and abilities are requirements for…

Evaluation of Hospital-Based Palliative Care Programs.

PubMed

Hall, Karen Lynn; Rafalson, Lisa; Mariano, Kathleen; Michalek, Arthur

2016-02-01

This study evaluated current hospital-based palliative care programs using recommendations from the Center to Advance Palliative Care (CAPC) as a framework. Seven hospitals located in Buffalo, New York were included based on the existence of a hospital-based palliative care program. Data was collected from August through October of 2013 by means of key informant interviews with nine staff members from these hospitals using a guide comprised of questions based on CAPC's recommendations. A gap analysis was conducted to analyze the current state of each hospital's program based upon CAPC's definition of a quality palliative care program. The findings identify challenges facing both existing/evolving palliative care programs, and establish a foundation for strategies to attain best practices not yet implemented. This study affirms the growing availability of palliative care services among these selected hospitals along with opportunities to improve the scope of services in line with national recommendations. © The Author(s) 2014.

Opportunities for Success: Cost Effective Programs for Children Update, 1988. A Report of the Select Committee on Children, Youth and Families, U.S. House of Representatives, One Hundredth Congress, Second Session.

ERIC Educational Resources Information Center

Congress of the U.S., Washington, DC. House Select Committee on Children, Youth, and Families.

Based on findings of the most current and highly regarded evaluations and research reviews available, this committee print provides an update of a prior committee report (August, 1985) on eight cost-effective federal programs for children. Described in terms of program participation, characteristics, benefits for children, cost effectiveness, and…

Evaluating Summer School Programs and the Effect on Student Achievement: The Correlation between Stanford-10 Standardized Test Scores and Two Different Summer Programs

ERIC Educational Resources Information Center

Koop, Brian J.

2010-01-01

School districts looking for ways to minimize summer learning loss have implemented a variety of programs to combat this problem. Since No Child Left Behind and the need for school districts to meet the goals of Adequate Yearly Progress, it is no longer enough to limit summer learning loss. Now school leaders find it necessary to use the summer…

Deception in Program Evaluation Design

DTIC Science & Technology

2014-10-31

CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) Scott Cheney-Peters 5d. PROJECT NUMBER 5e. TASK NUMBER 5f. WORK UNIT...stakeholders interested in assessments as a true reflection of a programâs state have a variety of methods at hand to mitigate their impacts. Even in...26. Cites attempts to manipulate the reception and understanding of findings on climate research and intelligence reports. 3 whether determining

Implementation evaluation of the Telephone Lifestyle Coaching (TLC) program: organizational factors associated with successful implementation.

PubMed

Damschroder, Laura J; Reardon, Caitlin M; Sperber, Nina; Robinson, Claire H; Fickel, Jacqueline J; Oddone, Eugene Z

2017-06-01

The Telephone Lifestyle Coaching (TLC) program provided telephone-based coaching for six lifestyle behaviors to 5321 Veterans at 24 Veterans Health Administration (VHA) medical facilities. The purpose of the study was to conduct an evaluation of the TLC program to identify factors associated with successful implementation. A mixed-methods study design was used. Quantitative measures of organizational readiness for implementation and facility complexity were used to purposively select a subset of facilities for in-depth evaluation. Context assessments were conducted using interview transcripts. The Consolidated Framework for Implementation Research (CFIR) was used to guide qualitative data collection and analysis. Factors most strongly correlated with referral rates included having a skilled implementation leader who used effective multi-component strategies to engage primary care clinicians as well as general clinic structures that supported implementation. Evaluation findings pointed to recommendations for local and national leaders to help anticipate and mitigate potential barriers to successful implementation.

Development and feasibility of an evidence-informed self-management education program in pediatric concussion rehabilitation.

PubMed

Hunt, Anne W; De Feo, Luciano; Macintyre, Jennifer; Greenspoon, Dayna; Dick, Talia; Mah, Katherine; Paniccia, Melissa; Provvidenza, Christine; Reed, Nick

2016-08-17

Concussion is a considerable public health problem in youth. However, identifying, understanding and implementing best evidence informed recovery guidelines may be challenging for families given the vast amount of information available in the public domains (e.g. Internet). The objective of this study was to develop, implement and evaluate the feasibility of an evidence-informed self-management education program for concussion recovery in youth. Synthesis of best evidence, principles of knowledge translation and exchange, and expert opinion were integrated within a self-management program framework to develop a comprehensive curriculum. The program was implemented and evaluated in a children's rehabilitation hospital within a universal health care system. A retrospective secondary analysis of anonymous data from a program evaluation survey was used to evaluate program feasibility, to identify features of importance to program participants and to assess changes in participants' knowledge. The program, "Concussion & You" includes a comprehensive, evidence informed, population specific curriculum that teaches participants practical strategies for management of return to school and play, sleep, nutrition, relaxation and energy conservation. A 'wheel of health' is used to facilitate participants' self-management action plan. Results from eighty-seven participant surveys indicate that the program is feasible and participant knowledge increased in all areas of the program with the highest changes reported in knowledge about sleep hygiene, rest and energy conservation. Findings indicate that "Concussion & You" is a feasible program that is acceptable to youth and their families, and fills a health system service gap.

Quantitative and qualitative evaluation of a web-based, interactive approach for teaching the management of angle-closure glaucoma.

PubMed

Blumberg, Dana M; Quigley, Harry A; Goldberg, Harry R

2009-02-01

To construct a validated Internet-based teaching system that improves diagnostic and therapeutic skills related to glaucoma diagnosis. Nonrandomized clinical trial. Thirty-four glaucoma specialists and 21 ophthalmologists-in-training. An interactive program was designed to improve the recognition of gonioscopic findings and to manage angle-closure glaucoma (ACG) patients, including technical information in performing gonioscopy, ability to recognize angle structures, and treatment choices. The behavior of participants permitted the assessment of degree of improvement related to the interaction. The program content was validated by 5 academic glaucoma subspecialists. Then, 34 fellowship-trained glaucoma specialists and 21 ophthalmology residents accessed the program. Results were evaluated using paired and nonpaired t tests and analysis of variance. Comparison of pretest and posttest scores of residents and glaucoma specialists on measures of gonioscopy recognition and questions related to ACG management. Residents improved their recognition of gonioscopic findings after viewing the program (P<0.0001), scoring significantly worse than glaucoma specialists before interacting with the program (P<0.0001), but scoring at equivalent levels to specialists after viewing the program (P=0.34). The time necessary to improve knowledge by interacting with the program was significantly related to year of residency training (P<0.0001, analysis of variance). The rate of correct answers to management questions related to ACG increased with increasing years of experience in ophthalmology, validating the education methodology (P<0.0001). A web-based teaching approach for diagnosis and management of ACG evaluated the knowledge of ophthalmologists in a manner consistent with their expected expertize. Statistically significant improvements in validated knowledge of ACG were demonstrated for this educational method.

Health financing for the poor produces promising short-term effects on utilization and out-of-pocket expenditure: evidence from Vietnam

PubMed Central

Axelson, Henrik; Bales, Sarah; Minh, Pham Duc; Ekman, Björn; Gerdtham, Ulf-G

2009-01-01

Background Vietnam introduced the Health Care Fund for the Poor in 2002 to increase access to health care and reduce the financial burden of health expenditure faced by the poor and ethnic minorities. It is often argued that effects of financing reforms take a long time to materialize. This study evaluates the short-term impact of the program to determine if pro-poor financing programs can achieve immediate effects on health care utilization and out-of-pocket expenditure. Method Considering that the program is a non-random policy initiative rolled out nationally, we apply propensity score matching with both single differences and double differences to data from the Vietnam Household Living Standards Surveys 2002 (pre-program data) and 2004 (first post-program data). Results We find a small, positive impact on overall health care utilization. We find evidence of two substitution effects: from private to public providers and from primary to secondary and tertiary level care. Finally, we find a strong negative impact on out-of-pocket health expenditure. Conclusion The results indicate that the Health Care Fund for the Poor is meeting its objectives of increasing utilization and reducing out-of-pocket expenditure for the program's target population, despite numerous administrative problems resulting in delayed and only partial implementation in most provinces. The main lessons for low and middle-income countries from Vietnam's early experiences with the Health Care Fund for the Poor are that it managed to achieve positive outcomes in a short time-period, the need to ensure adequate and sustained funding for targeted programs, including marginal administrative costs, develop effective targeting mechanisms and systems for informing beneficiaries and providers about the program, respond to the increased demand for health care generated by the program, address indirect costs of health care utilization, and establish and maintain routine and systematic monitoring and evaluation mechanisms. PMID:19473518

Supporting fathers' efforts to be smoke-free: program principles.

PubMed

Oliffe, John L; Bottorff, Joan L; Sarbit, Gayl

2012-09-01

There is limited empirical evidence on effective ways to develop, distribute, and evaluate men-centred, gender-sensitive health promotion programs. The purpose of this research was to transition qualitative findings on men's smoking into father-centred cessation interventions. Men's perspectives were gathered in 4 group sessions with 24 new fathers who smoked. The data led to the identification of 3 principles for men's health promotion programs: use positive messaging to promote change without amplifying stigma, guilt, shame, and blame; foster connections between masculine ideals (e.g., strength, decisiveness, resilience, autonomy) and being smoke-free; and privilege the testimonials of potential end-users (e.g., fathers who smoke and want to quit). Experiences drawn from the design and pilot-testing of a booklet and a group program based on these principles are described. The findings can be used to guide nurses in the design and/or delivery of men's health promotion programs.

Flipping one-shot library instruction: using Canvas and Pecha Kucha for peer teaching*†

PubMed Central

Carroll, Alexander J.; Tchangalova, Nedelina; Harrington, Eileen G.

2016-01-01

Objective This study sought to determine whether a flipped classroom that facilitated peer learning would improve undergraduate health sciences students' abilities to find, evaluate, and use appropriate evidence for research assignments. Methods Students completed online modules in a learning management system, with librarians facilitating subsequent student-directed, in-person sessions. Mixed methods assessment was used to evaluate program outcomes. Results Students learned information literacy concepts but did not consistently apply them in research assignments. Faculty interviews revealed strengthened partnerships between librarians and teaching faculty. Conclusion This pedagogy shows promise for implementing and evaluating a successful flipped information literacy program. PMID:27076799

Military Emergency Medical Service System Assessment: Application of the National Park Service Needs Assessment and Program Audit to Objectively Evaluate the Military EMS System of Okinawa, Japan.

PubMed

Ross, Elliot M; Harper, Stephen A; Cunningham, Cord; Walrath, Benjamin D; DeMers, Gerard; Kharod, Chetan U

2017-03-01

As part of a Military Emergency Medical Services (EMS) system process improvement initiative, the authors sought to objectively evaluate the U.S. military EMS system for the island of Okinawa. They applied a program evaluation tool currently utilized by the U.S. National Park Service (NPS). A comprehensive needs assessment was conducted to evaluate the current Military EMS system in Okinawa, Japan. The NPS EMS Program Audit Worksheet was used to get an overall "score" of our assessment. After all the data had been collected, a joint committee of Military EMS physicians reviewed the findings and made formal recommendations. From 2011 to 2014, U.S. military EMS on Okinawa averaged 1,345 ± 137 patient transports annually. An advanced life support (ALS) provider would have been dispatched on 558 EMS runs (38%) based on chief complaint in 2014 had they been available. Over 36,000 man-hours were expended during this period to provide National Registry Emergency Medical Technician (EMT)-accredited instruction to certify 141 Navy Corpsman as EMT Basics. The NPS EMS Program Audit Worksheet was used and the program scored a total of 31, suggesting the program is well planned and operating within standards. This evaluation of the Military EMS system on Okinawa using the NPS program assessment and audit worksheet demonstrates the NPS evaluation instruments may offer a useful assessment tool for the evaluation of Military EMS systems. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Evaluating the social and economic impact of community-based prenatal care.

PubMed

Cramer, Mary E; Chen, Li-Wu; Roberts, Sara; Clute, Dorothea

2007-01-01

This article describes the evaluation and findings of a community-based prenatal care program, Omaha Healthy Start (OHS), designed to reduce local racial disparities in birth outcomes. This evaluative study used a comparative descriptive design, and Targeting Outcomes of Programs was the conceptual framework for evaluation. The evaluation followed 3 groups for 2 years: OHS birth mothers (N=79; N=157); non-OHS participant birth mothers (N=746; N=774); and Douglas County birth mothers (N=7,962; N=7,987). OHS provided case management, home visits, screening, referral, transportation, and health education to participants. Program outcome measures included low birth weight, infant mortality, adequacy of care, trimester of care, and costs of care. OHS birth outcomes improved during year 2, and there was a 31% cost saving in the average hospital expenditure compared with the nonparticipant groups. Preliminary evaluative analysis indicates that prenatal case management and community outreach can improve birth outcomes for minority women, while producing cost savings. Further prospective study is needed to document trends over a longer period of time regarding the relationship between community-based case management programs for minority populations, birth outcomes, and costs of care.