An Evaluation of the Cost Effectiveness of Alternative Compensatory Reading Programs, Volume IV: Cost Analysis of Summer Programs. Final Report.

ERIC Educational Resources Information Center

Al-Salam, Nabeel; Flynn, Donald L.

This report describes the results of a study of the cost and cost effectiveness of 27 summer reading programs, carried through as part of a large-scale evaluation of compensatory reading programs. Three other reports describe cost and cost-effectiveness studies of programs during the regular school year. On an instructional-hour basis, the total…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Evaluation of a Bullying Prevention Program

ERIC Educational Resources Information Center

Hallford, Abby; Borntrager, Cameo; Davis, Joanne L.

2006-01-01

In order to address the federal "No Child Left Behind Act", the state of Oklahoma required that all public schools address the problem of bullying. Although numerous anti-bullying programs exist, few have been evaluated to determine their effectiveness. The present study evaluated the effectiveness of one such program,…

Lessons from the trenches: meeting evaluation challenges in school health education.

PubMed

Young, Michael; Denny, George; Donnelly, Joseph

2012-11-01

Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.

Meta-analytic Evaluation of a Virtual Field Trip to Connect Middle School Students with University Scientists

NASA Astrophysics Data System (ADS)

Adedokun, Omolola A.; Liu, Jia; Parker, Loran Carleton; Burgess, Wilella

2015-02-01

Although virtual field trips are becoming popular, there are few empirical studies of their impacts on student outcomes. This study reports on a meta-analytic evaluation of the impact of a virtual field trip on student perceptions of scientists. Specifically, the study examined the summary effect of zipTrips broadcasts on evaluation participants' perceptions of scientists, as well as the moderating effect of program type on program impact. The results showed statistically significant effect of each broadcast, as well as statistically significant summary (combined) effect of zipTrips on evaluation participants' perceptions of scientists. Results of the moderation analysis showed that the effect was greater for the students that participated in the evaluation of the 8th grade broadcasts, providing additional insight into the role of program variation in predicting differential program impact. This study illustrates how meta-analysis, a methodology that should be of interest to STEM education researchers and evaluation practitioners, can be used to summarize the effects of multiple offerings of the same program. Other implications for STEM educators are discussed.

The Impact of Evaluation: Lessons Drawn from the Evaluations of Five Early Childhood Education Programs.

ERIC Educational Resources Information Center

Granville, Arthur C.; And Others

Five different program evaluations were described to indicate those qualities which make an evaluation effective or not effective. Evaluation effectiveness was defined as impact on decision making or long-term policy formation, and influence upon a variety of audiences. Robert D. Matz described the First Chance Project, and concluded that the…

Evaluation of Career Guidance Programs: Models, Methods, and Microcomputers. Information Series No. 317.

ERIC Educational Resources Information Center

Crites, John O.

Evaluating the effectiveness of career guidance programs is a complex process, and few comprehensive models for evaluating such programs exist. Evaluation of career guidance programs has been hampered by the myth that program outcomes are uniform and monolithic. Findings from studies of attribute treatment interactions have revealed only a few…

Evaluating Evaluations: The Case of Parent Involvement Programs

ERIC Educational Resources Information Center

Mattingly, Doreen J.; Prislin, Radmila; McKenzie, Thomas L.; Rodriguez, James L.; Kayzar, Brenda

2002-01-01

This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

Cost Effectiveness Ratio: Evaluation Tool for Comparing the Effectiveness of Similar Extension Programs

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2015-01-01

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

Promoting organ donation through an entertainment-education TV program in Korea: Open Your Eyes.

PubMed

Byoung Kwan Lee; Hyun Soon Park; Choi, Myung-Il; Cheon Soo Kim

2010-01-01

The purpose of this study is to investigate the effects of the characteristics of the program, Open Your Eyes, an entertainment-education TV program in Korea, on parasocial interaction and behavioral intention for organ donation. The results indicated that affective evaluation positively affected parasocial interaction with the program but cognitive evaluation negatively affected involvement with beneficiaries in the program. Also, it was found that cognitive evaluation of Open Your Eyes had a significant positive effect on behavioral intention. In addition, a significant positive effect of program engagement on the behavioral intention was found. Thus, the results indicate that individuals who feel program engagement of Open Your Eyes will be more likely to proceed with organ donation. However, no direct effect of involvement with the beneficiary and program hosts was found.

Pretesting Effects in the Evaluation of Social Skills Training.

ERIC Educational Resources Information Center

Mungas, Dan M.; Walters, Herman A.

1979-01-01

Evaluated effects of pretesting in conjunction with a group social skills training program. A Solomon four-groups design was used to evaluate the effects of pretesting, the skills training program, and their interaction. Strong evidence of pretesting effects was found for measures associated with a behavioral forced interaction task. (Author)

Assessing communications effectiveness in meeting corporate goals of public health organizations.

PubMed

Brown, Gordon D; Bopp, Kenneth D; Boren, Suzanne Austin

2005-01-01

Much evaluation of health communications in public health is considered from a program perspective of smoking cessation, weight reduction, education on sexually transmitted diseases, etc. These studies have advanced the knowledge base of communications theory and evaluation and have contributed to program effectiveness. In program-based evaluation the communications process is structured as part of the program itself. This article extends program-based communications evaluation to view communications from the perspective of the consumer and how effectively public health departments respond to consumer expectations. It develops a conceptual model for evaluating elements of communications such as its importance in defining mission and goals within the community, managing strategic constituencies, and enlisting individuals and groups as customers and co-producers of health. It gives a broader perspective on how communications in public heath organizations are managed and a basis for assessing whether they are being managed effectively.

A systematic review of school-based suicide prevention programs.

PubMed

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

Aid effectiveness and programmatic effectiveness: a proposed framework for comparative evaluation of different aid interventions in a particular health system.

PubMed

Haque, Hasibul; Hill, Philip C; Gauld, Robin

2017-01-01

Against a backdrop of changing concepts of aid effectiveness, development effectiveness, health systems strengthening, and increasing emphasis on impact evaluation, this article proposes a theory-driven impact evaluation framework to gauge the effect of aid effectiveness principles on programmatic outcomes of different aid funded programs in the health sector of a particular country. The foundation and step-by-step process of implementing the framework are described. With empirical evidence from the field, the steps involve analysis of context, program designs, implementation mechanisms, outcomes, synthesis, and interpretation of findings through the programs' underlying program theories and interactions with the state context and health system. The framework can be useful for comparatively evaluating different aid interventions both in fragile and non-fragile state contexts.

Analyzing for Individual Differences in Evaluating Compensatory Education Programs. Occasional Paper No. 27.

ERIC Educational Resources Information Center

Krus, Patricia H.

Trait-Treatment Interaction (TTI), a research method for observing experimental effects of treatments on subjects of different aptitudes and learning characteristics, is suggested as an effective evaluation tool to provide evaluators and educators in compensatory education programs with information about which program is best for different kinds…

Evaluating disease management program effectiveness: an introduction to time-series analysis.

PubMed

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

Factors Influencing Participant Perceptions of Program Impact: Lessons from a Virtual Fieldtrip for Middle-School Students

ERIC Educational Resources Information Center

Adedokun, Omolola A.; Parker, Loran C.; Loizzo, Jamie; Burgess, Wilella D.; Robinson, J. Paul

2011-01-01

Participant perceptions of program effectiveness and impact are undoubtedly a popular focus of Extension program evaluations. However, the effects of participants' characteristics and contextual variables on program perceptions and how the resulting data can be used for program improvement are less explored in evaluation studies. Using data from…

Process and impact evaluation of a legal assistance and health care community partnership.

PubMed

Teufel, James A; Brown, Stephen L; Thorne, Woody; Goffinet, Diane M; Clemons, Latesha

2009-07-01

Community health partnerships have increased in popularity, but their effectiveness is often not evaluated. Through secondary data analysis, this study evaluates a program that offered access to legal services to address health-related issues, such as Medicaid reimbursement, Social Security benefits, medication coverage, and divorce. Based on the analysis reimbursements to expenditures, the health and law program appears to be cost-effective and thereby economically sustainable. The cost-effectiveness of this program increases the likelihood that it will be institutionalized and/or expanded. This program evaluation is used to exemplify how community stakeholders could partner to leverage resources to establish a sustainable community health and law program to address the needs of people living in medically underserved areas.

The Effectiveness of SRA Corrective Reading and SRA Connecting Math Programs as Reading and Math Intervention Programs for Students with Disabilities

ERIC Educational Resources Information Center

Guinn, Toby Ready

2009-01-01

The purpose of this study was to evaluate the effectiveness of the SRA Corrective Reading and SRA Connecting Math Intervention Programs when used as a scripted intervention program with identified students with disabilities and was evaluated to determine whether the effectiveness was affected by the student's gender or academic skill proficiency.…

The Effectiveness of Adapted Versions of an Evidence-Based Prevention Program in Reducing Alcohol Use among Alternative School Students

ERIC Educational Resources Information Center

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youths, there is a need to facilitate the implementation and evaluation of these programs in real-world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin' it REAL (kiR), with alternative…

Camp's "Disneyland" Effect.

ERIC Educational Resources Information Center

Renville, Gary

1999-01-01

Describes the positive mental, physical, and social growth impacts that the camping experience had on the author, and urges camp program evaluation to plan and implement such changes. Sidebar lists steps of effective evaluation: program goals and objectives, goals of evaluation, implementation of evaluation, data analysis, and findings and…

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

Do less effective teachers choose professional development does it matter?

PubMed

Barrett, Nathan; Butler, J S; Toma, Eugenia F

2012-10-01

In an ongoing effort to improve teacher quality, most states require continuing education or professional development for their in-service teachers. Studies evaluating the effectiveness of various professional development programs have assumed a normal distribution of quality of teachers participating in the programs. Because participation in many professional development programs is either targeted or voluntary, this article suggests past evaluations of the effectiveness of professional development may be subject to selection bias and policy recommendations may be premature. This article presents an empirical framework for evaluating professional development programs where treatment is potentially nonrandom, and explicitly accounts for the teacher's prior effectiveness in the classroom as a factor that may influence participation in professional development. This article controls for the influence of selection bias on professional development outcomes by generating a matched sample based on propensity scores and then estimating the program's effect. In applying this framework to the professional development program examined in this article, less effective teachers are found to be more likely to participate in the program, and correcting for this selection leads to different conclusions regarding the program's effectiveness than when ignoring teacher selection patterns.

An overview of the effectiveness and efficiency of HIV prevention programs.

PubMed Central

Holtgrave, D R; Qualls, N L; Curran, J W; Valdiserri, R O; Guinan, M E; Parra, W C

1995-01-01

Because of the enormity of the HIV-AIDS epidemic and the urgency for preventing transmission, HIV prevention programs are a high priority for careful and timely evaluations. Information on program effectiveness and efficiency is needed for decision-making about future HIV prevention priorities. General characteristics of successful HIV prevention programs, programs empirically evaluated and found to change (or not change) high-risk behaviors or in need of further empirical study, and economic evaluations of certain programs are described and summarized with attention limited to programs that have a behavioral basis. HIV prevention programs have an impact on averting or reducing risk behaviors, particularly when they are delivered with sufficient resources, intensity, and cultural competency and are based on a firm foundation of behavioral and social science theory and past research. Economic evaluations have found that some of these behaviorally based programs yield net economic benefits to society, and others are likely cost-effective (even if not cost-saving) relative to other health programs. Still, specific improvements should be made in certain HIV prevention programs. PMID:7630989

Effectiveness of the Combat Operational Stress Control Training Program: Expectations of the U.S. Marine Corps

ERIC Educational Resources Information Center

Sipko, Marek M.

2010-01-01

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions. The…

Evaluation of Six School Effectiveness Programs.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

School effectiveness programs were evaluated at six urban schools (five elementary and one junior high schools) in Louisiana for the 1986-87 school year. Focus was on providing principals with information to improve their school effectiveness programs for the 1987-88 school year. Subjects were 3,006 students, for whom scores on the California…

Program Evaluation of Community College Learning Assistance Centers: What Do LAC Directors Think?

ERIC Educational Resources Information Center

Franklin, Doug; Blankenberger, Bob

2016-01-01

Objective: This study seeks to determine the nature of current program evaluation practices for learning assistance centers (LACs), the practices being used for program evaluation, and whether LAC directors believe their practices are appropriate for evaluating program effectiveness. Method: We conducted a survey (n = 61) of community college LAC…

Program Implementers' Evaluation of the Project P.A.T.H.S.: Findings Based on Different Datasets over Time

PubMed Central

Shek, Daniel T. L.; Ma, Cecilia M. S.

2012-01-01

This paper integrates the evaluation findings based on program implementers in nine datasets collected from 2005 to 2009 (244 schools and 7,926 implementers). Using consolidated data with schools as the unit of analysis, results showed that program implementers generally had positive perceptions of the program, themselves, and benefits of the program, with more than four-fifths of the implementers regarding the program as beneficial to the program participants. The subjective outcome evaluation instrument was found to be internally consistent. Multiple regression analyses revealed that perceived qualities of the program and program implementers predicted perceived effectiveness of the program. In conjunction with evaluation findings based on other sources, the present study provides support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) in Hong Kong. PMID:22629224

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

NASA Astrophysics Data System (ADS)

Luera, Gail Rose

As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.

Evaluation Strategies in Financial Education: Evaluation with Imperfect Instruments

ERIC Educational Resources Information Center

Robinson, Lauren; Dudensing, Rebekka; Granovsky, Nancy L.

2016-01-01

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

Evaluation of a Postdischarge Call System Using the Logic Model.

PubMed

Frye, Timothy C; Poe, Terri L; Wilson, Marisa L; Milligan, Gary

2018-02-01

This mixed-method study was conducted to evaluate a postdischarge call program for congestive heart failure patients at a major teaching hospital in the southeastern United States. The program was implemented based on the premise that it would improve patient outcomes and overall quality of life, but it had never been evaluated for effectiveness. The Logic Model was used to evaluate the input of key staff members to determine whether the outputs and results of the program matched the expectations of the organization. Interviews, online surveys, reviews of existing patient outcome data, and reviews of publicly available program marketing materials were used to ascertain current program output. After analyzing both qualitative and quantitative data from the evaluation, recommendations were made to the organization to improve the effectiveness of the program.

Evaluation of the impact of the drug evaluation and classification program on enforcement and adjudication

DOT National Transportation Integrated Search

1992-12-01

This study examined the effect of the Drug Evaluation and Classification (DEC) Program on impaired driving (DWI) enforcement and adjudication. Drug Recognition Experts (DREs) in DEC programs evaluate suspects when drugs other than alcohol are suspect...

[Process evaluation in relation to effectiveness assessment: experiences with school-based programs].

PubMed

Ariza, Carles; Villalbí, Joan R; Sánchez-Martínez, Francesca; Nebot, Manel

2011-06-01

Evaluation of public health interventions usually focus on the quality of design and research methods, and less on the quality of the intervention or process evaluation. In process evaluation of school-based interventions, key issues are how completely the intervention is carried out and adherence to the protocol. In addition, exploration of intermediate variables, such as those that influence (and often predict) preventable behavior, is highly useful. This article describes the basic concepts in this topic, using examples of the effectiveness of some preventive interventions carried out in schools. The interventions discussed were mainly quasi-experimental studies, based on data from programs promoted by public health teams in the city of Barcelona. Data from process evaluation of preventive programs in secondary schools that underwent formal assessment of their effectiveness is provided. The examples are drawn from preventive programs of HIV infection or unprotected sexual intercourse (PRESSEC program) and drug consumption prevention (the PASE, PASE.bcn and x kpts programs). These examples show why the intervention process influences the impact of the programs and their results. Thorough planning of process evaluation is essential to obtain valid indicators that will identify, in the effectiveness evaluation of the intervention, the most efficacious strategies to obtain positive outcomes. Copyright © 2011 Sociedad Española de Salud Pública y Administración Sanitaria. Published by Elsevier Espana. All rights reserved.

The Evaluation of a North Carolina Truancy Intervention Program: Is It Culturally Sensitive?

ERIC Educational Resources Information Center

Carson, Deborah

2013-01-01

Truancy issues are longstanding and the desires to develop programs that are effective have been just as enduring. More striking is the lack of evidence of a truancy program evaluation process that includes collaboration with the clients that it serves. Truancy intervention programs have a wide range of effects on participants from multiple ethnic…

Adult Literacy Education: Program Evaluation and Learner Assessment. Information Series No. 338.

ERIC Educational Resources Information Center

Lytle, Susan L.; Wolfe, Marcie

Adult literacy programs need reliable information about program quality and effectiveness for accountability, improvement of practice, and expansion of knowledge. Evaluation and assessment reflect fundamental beliefs about adult learners, concepts of literacy, and educational settings. Resources for planning program evaluations include surveys,…

An Overview of the National Nutrition Education and Training Program Evaluation.

ERIC Educational Resources Information Center

St. Pierre, Robert G.; Rezmovic, Victor

1982-01-01

Presents the organizing framework used in evaluating the National Nutrition Education and Training Program (NET) and summarizes the descriptive, evaluative, and meta-evaluative findings. Concludes that positive effects on children's nutrition-related knowledge have resulted from different nutrition education programs. (DC)

34 CFR 200.84 - Responsibilities of SEAs for evaluating the effectiveness of the MEP.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 1 2010-07-01 2010-07-01 false Responsibilities of SEAs for evaluating the... ACADEMIC ACHIEVEMENT OF THE DISADVANTAGED Migrant Education Program § 200.84 Responsibilities of SEAs for evaluating the effectiveness of the MEP. Each SEA must determine the effectiveness of its program through a...

Program evaluation of FHWA pedestrian and bicycle safety activities.

DOT National Transportation Integrated Search

2011-03-01

"Introduction : FHWAs Office of Highway Safety (HSA) initiated a program evaluation by Booz Allen Hamilton to assess the overall effectiveness of the Agencys Pedestrian and Bicycle Safety Program. The evaluation covers pedestrian and bicycle sa...

When Unintended Consequences Become the Main Effect: Evaluating the Development of a Foster Parent Training Program.

ERIC Educational Resources Information Center

Loesch-Griffin, Deborah A.; Ringstaff, Cathy

A program of education, training, and support provided to foster parents in a California county through a nonprofit agency is evaluated. The evaluators' experience indicates that: (1) evaluations are gaining in popularity; (2) role shifts by evaluators are sometimes difficult to perceive; (3) program staff are unlikely to use evaluative feedback…

Space Storable Rocket Technology program (SSRT). Option 1 program

NASA Astrophysics Data System (ADS)

Chazen, Melvin L.; Mueller, Thomas; Rust, Thomas

1993-08-01

The Space Storable Rocket Technology (SSRT) Option 1 Program was initiated in October 1991 after completion of the Basic Program. The program was restructured in mid-July 1992 to incorporate a Rhenium Technology Task and reduce the scope of the LO2-N2H4 engine development. The program was also extended to late February 1993 to allow for the Rhenium Technology Task completion. The Option 1 Program was devoted to evaluation of two new injector elements, evaluation of two different methods of thermal protection of the injector, evaluation of high temperature material properties of rhenium and evaluation of methods of joining the rhenium thrust chamber to the columbium injector and nozzle extension. In addition, critical experiments were conducted (Funded by Option 2) to evaluate mechanisms to understand the effects of GO2 injection into the chamber, helium injection into the main LO2, effect of the splash plate and effect of decreasing the aspect ratio of the 120-slot (-13a) element. The performance and thermal models were used to further correlate the test results with analyses. The results of the work accomplished are summarized.

Space Storable Rocket Technology program (SSRT). Option 1 program

NASA Technical Reports Server (NTRS)

Chazen, Melvin L.; Mueller, Thomas; Rust, Thomas

1993-01-01

The Space Storable Rocket Technology (SSRT) Option 1 Program was initiated in October 1991 after completion of the Basic Program. The program was restructured in mid-July 1992 to incorporate a Rhenium Technology Task and reduce the scope of the LO2-N2H4 engine development. The program was also extended to late February 1993 to allow for the Rhenium Technology Task completion. The Option 1 Program was devoted to evaluation of two new injector elements, evaluation of two different methods of thermal protection of the injector, evaluation of high temperature material properties of rhenium and evaluation of methods of joining the rhenium thrust chamber to the columbium injector and nozzle extension. In addition, critical experiments were conducted (Funded by Option 2) to evaluate mechanisms to understand the effects of GO2 injection into the chamber, helium injection into the main LO2, effect of the splash plate and effect of decreasing the aspect ratio of the 120-slot (-13a) element. The performance and thermal models were used to further correlate the test results with analyses. The results of the work accomplished are summarized.

Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

ERIC Educational Resources Information Center

Hawkins, J. David; Nederhood, Britt

This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

Automated Writing Evaluation Program's Effect on Student Writing Achievement

ERIC Educational Resources Information Center

Holman, Lester Donnie

2011-01-01

In an ex post facto causal-comparative research design, this study investigated the effectiveness of Automated Writing Evaluation (AWE) programs on raising the student writing achievement. Tennessee Comprehensive Assessment Program (TCAP) writing achievement scores from the 2010 administration were utilized for this study. The independent variable…

Home-Start between Childhood and Maturity: A Programme Evaluation.

ERIC Educational Resources Information Center

Terpstra, Linda; van Dijke, Anke

A crucial question for evaluating nationally or internationally implemented programs is whether local adaptations detract from program quality and effectiveness. An evaluation examined the program successes and challenges encountered in the first 5 years of Home-Start in the Netherlands, a home-based family support program for families with young…

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase frommore » $3.1 billion in 2008 to $$7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources often with multiple program administrators and intended to meet multiple purposes.« less

Antimicrobial stewardship in long term care facilities: what is effective?

PubMed

Nicolle, Lindsay E

2014-02-12

Intense antimicrobial use in long term care facilities promotes the emergence and persistence of antimicrobial resistant organisms and leads to adverse effects such as C. difficile colitis. Guidelines recommend development of antimicrobial stewardship programs for these facilities to promote optimal antimicrobial use. However, the effectiveness of these programs or the contribution of any specific program component is not known. For this review, publications describing evaluation of antimicrobial stewardship programs for long term care facilities were identified through a systematic literature search. Interventions included education, guidelines development, feedback to practitioners, and infectious disease consultation. The studies reviewed varied in types of facilities, interventions used, implementation, and evaluation. Comprehensive programs addressing all infections were reported to have improved antimicrobial use for at least some outcomes. Targeted programs for treatment of pneumonia were minimally effective, and only for indicators of uncertain relevance for stewardship. Programs focusing on specific aspects of treatment of urinary infection - limiting treatment of asymptomatic bacteriuria or prophylaxis of urinary infection - were reported to be effective. There were no reports of cost-effectiveness, and the sustainability of most of the programs is unclear. There is a need for further evaluation to characterize effective antimicrobial stewardship for long term care facilities.

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

PubMed

Jacobson, Miriam R; Azzam, Tarek

2018-06-01

This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

Human Services Program Evaluation: "How to Improve Your Accountability and Program Effectiveness"

ERIC Educational Resources Information Center

Barrett, Thomas; Sorensen, James

2015-01-01

The term "outcome evaluation" has become one of the most popular terms among human service providers and those whose job it is to evaluate the impact of human service programs. In the public sector alone, there are over a hundred instruments in use to evaluate the impact of state human service programs. Most states, many providers, and…

A multidimensional evaluation of a nursing information-literacy program.

PubMed Central

Fox, L M; Richter, J M; White, N E

1996-01-01

The goal of an information-literacy program is to develop student skills in locating, evaluating, and applying information for use in critical thinking and problem solving. This paper describes a multidimensional evaluation process for determining nursing students' growth in cognitive and affective domains. Results indicate improvement in student skills as a result of a nursing information-literacy program. Multidimensional evaluation produces a well-rounded picture of student progress based on formal measurement as well as informal feedback. Developing new educational programs can be a time-consuming challenge. It is important, when expending so much effort, to ensure that the goals of the new program are achieved and benefits to students demonstrated. A multidimensional approach to evaluation can help to accomplish those ends. In 1988, The University of Northern Colorado School of Nursing began working with a librarian to integrate an information-literacy component, entitled Pathways to Information Literacy, into the curriculum. This article describes the program and discusses how a multidimensional evaluation process was used to assess program effectiveness. The evaluation process not only helped to measure the effectiveness of the program but also allowed the instructors to use several different approaches to evaluation. PMID:8826621

Evaluating Federal Social Programs: An Uncertain Act.

ERIC Educational Resources Information Center

Levitan, Sar A.; Wurzburg, Gregory K.

This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

ERIC Educational Resources Information Center

Bruhns, Arthur E.

Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

Program Effectiveness in AISD 1992-93.

ERIC Educational Resources Information Center

Wilkinson, David; Mangino, Evangelina

The Office of Research and Evaluation (ORE) of the Austin Independent School District (AISD) (Texas) reviews the effectiveness of many of the school district's special programs. In 1992-93, ORE reviewed 60 programs or program components. Cost effectiveness was calculated for 31 programs, using an achievement effect measure for 10, a dropout…

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

ERIC Educational Resources Information Center

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Assessment of Learning and Program Evaluation in Health Professions Education Programs

ERIC Educational Resources Information Center

Moore, Donald E., Jr.

2018-01-01

This chapter proposes approaches for assessing learners and evaluating courses and curriculum that could be used by directors of health professions education (HPE) programs to determine the effectiveness and impact of their programs.

Evaluation of a Community-Based Aging Intervention Program

ERIC Educational Resources Information Center

Hsu, Hui-Chuan; Wang, Chun-Hou; Chen, Yi-Chun; Chang, Ming-Chen; Wang, Jean

2010-01-01

This study evaluated the outcome and process of a community-based aging intervention program for the elderly in Taiwan. The program included education on nutrition and dietary behavior and on physical activities. Outcome and process evaluations were conducted. The program may have had some effects on decreasing some dietary behavioral problems and…

Some Measures of Evaluation and Effectiveness in Social Work Practice.

ERIC Educational Resources Information Center

Kapoor, J. M.

Measures of accountability and evaluation of social work program efforts are examined. Evaluation of program effort refers to an assessment of the amount and kinds of program activities considered necessary for the accomplishment of program goals within a particular stage of development. It refers not only to staff time, activity, and commitment,…

Lazy evaluation of FP programs: A data-flow approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wei, Y.H.; Gaudiot, J.L.

1988-12-31

This paper presents a lazy evaluation system for the list-based functional language, Backus` FP in data-driven environment. A superset language of FP, called DFP (Demand-driven FP), is introduced. FP eager programs are transformed into DFP lazy programs which contain the notions of demands. The data-driven execution of DFP programs has the same effects of lazy evaluation. DFP lazy programs have the property of always evaluating a sufficient and necessary result. The infinite sequence generator is used to demonstrate the eager-lazy program transformation and the execution of the lazy programs.

Personal Benefits of a Health Evaluation and Enhancement Program

NASA Technical Reports Server (NTRS)

Heinzelmann, F.; Durbeck, D. C.

1970-01-01

A study was made of the benefits reported by participants in a health evaluation and enhancement program dealing with physical activity. Program benefits were identified and defined in regard to three major areas: program effects on work; program effects on health; and program effects on habits and behavior. A strong positive and consistent relationship was found between reported benefits in each of these areas and measures of improvement in cardiovascular functioning based on treadmill performance. Significant differences in these measures of improvement were also found between participants who reported program benefits and those persons who did not. These findings provide a meaningful profile of the pattern of benefits generated by this kind of health program.

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Bystander programs addressing sexual violence on college campuses: A systematic review and meta-analysis of program outcomes and delivery methods.

PubMed

Jouriles, Ernest N; Krauss, Alison; Vu, Nicole L; Banyard, Victoria L; McDonald, Renee

2018-02-06

This systematic review and meta-analysis evaluates the effectiveness of bystander programs that address sexual violence on college campuses. Program effects on student attitudes/beliefs and bystander behavior were examined. Durability of program outcomes and the influence of program-delivery methods (e.g., facilitator-led programs vs. video, online or poster campaign programs) and program-parameters (e.g., program length) were also evaluated. Twenty-four studies met criteria for inclusion in the meta-analysis, and 207 separate results from these studies were coded. Students who participated in a bystander program, compared to those who had not, had more pro-social attitudes/beliefs about sexual violence and intervening to prevent it, and engaged in more bystander behavior. Program effects diminished over time, but meaningful changes persisted for at least three months following program delivery. Longer programs had greater effects than shorter programs on attitudes/beliefs. Bystander programs can be a valuable addition to colleges' violence prevention efforts.

Assessing the feasibility, acceptability and potential effectiveness of an integrated approach to smoking cessation for new and expectant fathers: The Dads in Gear study protocol.

PubMed

Bottorff, Joan L; Oliffe, John L; Sarbit, Gayl; Caperchione, Cristina; Clark, Marianne; Anand, Anima; Howay, Kym

2017-03-01

Evidence related to the effects of tobacco exposure in pregnancy and on infant and child health have focused on women's smoking cessation. Less often addressed is men's smoking, which when continued in fatherhood, reduces the chances of female partners' cessation and can negatively impact children's health as well as men's health. Dads in Gear (DIG) is an innovative program designed specifically for new fathers who want to reduce and quit smoking that includes three components: smoking cessation, fathering, and physical activity. The over-arching purpose of this study is to evaluate the feasibility of the DIG program and provide estimates of program efficacy. The purpose of this article is to describe the rationale and protocol for evaluating the DIG program's feasibility, acceptability and potential effectiveness. Using a prospective, non-comparative design, the DIG program will be implemented and evaluated in six communities. The program will be offered by trained facilitators to fathers who currently smoke and want to quit. The RE-AIM framework will guide the evaluation. Open-ended questions in participant surveys, and semi-structured interviews and weekly telephone de-briefs with facilitators will provide data for a process evaluation. Estimates of effectiveness include smoking behavior, fathering and physical activity measures at baseline, end of program, and 3-month follow up. The DIG program could support positive changes with respect to smoking cessation, physical activity and overall health for men. These effects could also promote family health. The program might also provide an effective model for engaging men in other health behavior change. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Postadoption and Guardianship: An Evaluation of the Adoption Preservation, Assessment, and Linkage Program

ERIC Educational Resources Information Center

Liao, Minli; Testa, Mark

2016-01-01

Objectives: This study evaluated the effects of the Adoption Preservation, Assessment, and Linkage (APAL) postpermanency program. Method: A quasi-experimental, posttest-only design was used to estimate the program's effects on youth discharged from foster care to adoption or legal guardianship. A random sample was surveyed (female = 44.7%; African…

Evaluation of an Occupational Therapy Mentorship Program: Effects on Therapists' Skills and Family-Centered Behavior

ERIC Educational Resources Information Center

King, Gillian; Tam, Cynthia; Fay, Linda; Pilkington, Martha; Servais, Michelle; Petrosian, Hasmik

2011-01-01

There is growing interest in understanding the usefulness of mentorship programs for children's rehabilitation service providers. This evaluation study examined the effects of an occupational therapy mentorship program on the skills and behaviors of 8 new and 17 experienced occupational therapists practicing at a regional children's rehabilitation…

Evaluation Study of the Exploratory Visit: An Innovative Outreach Activity of the ILGWU's Friendly Visiting Program

ERIC Educational Resources Information Center

Wright, Holly; And Others

1977-01-01

The exploratory visit to recent retirees, an outreach component of the International Ladies Garment Workers Union Friendly Visiting Program, was evaluated. A post-test only control group effect study revealed exploratory visits were effective in establishing a link between the program and the retiree. (Author)

Evaluation of NASA space grant consortia programs

NASA Technical Reports Server (NTRS)

Eisenberg, Martin A.

1990-01-01

The meaningful evaluation of the NASA Space Grant Consortium and Fellowship Programs must overcome unusual difficulties: (1) the program, in its infancy, is undergoing dynamic change; (2) the several state consortia and universities have widely divergent parochial goals that defy a uniform evaluative process; and (3) the pilot-sized consortium programs require that the evaluative process be economical in human costs less the process of evaluation comprise the effectiveness of the programs they are meant to assess. This paper represents an attempt to assess the context in which evaluation is to be conducted, the goals and limitations inherent to the evaluation, and to recommend appropriate guidelines for evaluation.

Evaluating the Implementation of an Olympic Education Program in Greece

NASA Astrophysics Data System (ADS)

Grammatikopoulos, Vasilios; Tsigilis, Nikolaos; Koustelios, Athanasios; Theodorakis, Yannis

2005-11-01

The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following six factors: `facilities', `administration', `educational material', `student-teacher relationships', `educational procedures', and `training'. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with advanced statistical methods.

Program Evaluation at Foothill College.

ERIC Educational Resources Information Center

Lowe, Irel D.

Evaluation systems were designed for the assessment of the instructional and non-instructional programs at Foothill College (California) to determine whether the objectives of the programs were being met and to ascertain the direct and indirect costs of the programs. For the instructional programs, criteria for determining effectiveness, revenue…

A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

PubMed Central

Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

2018-01-01

Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

An experimental evaluation of theory-based mother and mother-child programs for children of divorce.

PubMed

Wolchik, S A; West, S G; Sandler, I N; Tein, J Y; Coatsworth, D; Lengua, L; Weiss, L; Anderson, E R; Greene, S M; Griffin, W A

2000-10-01

This study evaluated the efficacy of 2 theory-based preventive interventions for divorced families: a program for mothers and a dual component mother-child program. The mother program targeted mother-child relationship quality, discipline, interparental conflict, and the father-child relationship. The child program targeted active coping, avoidant coping, appraisals of divorce stressors, and mother-child relationship quality. Families with a 9- to 12-year-old child (N = 240) were randomly assigned to the mother, dual-component, or self-study program. Postintervention comparisons showed significant positive program effects of the mother program versus self-study condition on relationship quality, discipline, attitude toward father-child contact, and adjustment problems. For several outcomes, more positive effects occurred in families with poorer initial functioning. Program effects on externalizing problems were maintained at 6-month follow-up. A few additive effects of the dual-component program occurred for the putative mediators; none occurred for adjustment problems.

Expert opinions on good practice in evaluation of health promotion and primary prevention measures related to children and adolescents in Germany.

PubMed

Korber, Katharina; Becker, Christian

2017-10-02

Determining what constitutes "good practice" in the measurement of the costs and effects of health promotion and disease prevention measures is of particular importance. The aim of this paper was to gather expert knowledge on (economic) evaluations of health promotion and prevention measures for children and adolescents, especially on the practical importance, the determinants of project success, meaningful parameters for evaluations, and supporting factors, but also on problems in their implementation. This information is targeted at people responsible for the development of primary prevention or health promotion programs. Partially structured open interviews were conducted by two interviewers and transcribed, paraphrased, and summarized for further use. Eight experts took part in the interviews. The interviewed experts saw evaluation as a useful tool to establish the effects of prevention programs, to inform program improvement and further development, and to provide arguments to decision making. The respondents' thought that determinants of a program's success were effectiveness with evidence of causality, cost benefit relation, target-group reach and sustainability. It was considered important that hard and soft factors were included in an evaluation; costs were mentioned only by one expert. According to the experts, obstacles to evaluation were lacking resources, additional labor requirements, and the evaluators' unfamiliarity with a program's contents. It was recommended to consider evaluation design before a program is launched, to co-operate with people involved in a program and to make use of existing structures. While in in this study only a partial view of expert knowledge is represented, it could show important points to consider when developing evaluations of prevention programs. By considering these points, researchers could further advance towards a more comprehensive approach of evaluation targeting measures in children and adolescents.

A Cost-Effectiveness Analysis Model for Evaluating and Planning Secondary Vocational Programs

ERIC Educational Resources Information Center

Kim, Jin Eun

1977-01-01

This paper conceptualizes a cost-effectiveness analysis and describes a cost-effectiveness analysis model for secondary vocational programs. It generates three kinds of cost-effectiveness measures: program effectiveness, cost efficiency, and cost-effectiveness and/or performance ratio. (Author)

Design and Operation of the Transformed National Healthy Start Evaluation.

PubMed

Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K

2017-12-01

Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.

Evaluation of a Worksite-Controlled Smoking Program.

ERIC Educational Resources Information Center

Glasgow, Russell E.; And Others

1984-01-01

Evaluated the relative effectiveness of three versions of a controlled smoking program conducted in the worksite: abrupt reduction, gradual reduction, or gradual reduction plus feedback on nicotine consumption. All conditions were effective. There was some indication that the gradual reduction condition was more effective than the abrupt…

Evaluation of innovative state and community alcohol projects : breath alcohol testing program effectiveness, impact and transferability

DOT National Transportation Integrated Search

1987-03-01

Breath Alcohol Testing (BAT) programs in Albuquerque and Santa Fe, New Mexico are evaluated in regard to effectiveness, impact, and transferability of the special DWI enforcement squads and their use of BAT Mobiles. Squad activity effectiveness is me...

A responsive evaluation of an Aboriginal nursing education access program.

PubMed

Curran, Vernon; Solberg, Shirley; LeFort, Sandra; Fleet, Lisa; Hollett, Ann

2008-01-01

Nursing education access programs have been introduced in a number of countries to address the shortage of healthcare providers of Aboriginal descent. An evaluation study of a nursing education access program in Labrador, Canada, was undertaken using a Responsive Evaluation approach. Interviews and focus groups with program stakeholders were conducted. Program effectiveness was influenced by culturally relevant curriculum, experiential and authentic learning opportunities, academic and social support, and the need for partnership building between stakeholders. The authors report key findings resulting from the Responsive Evaluation.

Detecting selection effects in community implementations of family-based substance abuse prevention programs.

PubMed

Hill, Laura G; Goates, Scott G; Rosenman, Robert

2010-04-01

To calculate valid estimates of the costs and benefits of substance abuse prevention programs, selection effects must be identified and corrected. A supplemental comparison sample is typically used for this purpose, but in community-based program implementations, such a sample is often not available. We present an evaluation design and analytic approach that can be used in program evaluations of real-world implementations to identify selection effects, which in turn can help inform recruitment strategies, pinpoint possible selection influences on measured program outcomes, and refine estimates of program costs and benefits. We illustrate our approach with data from a multisite implementation of a popular substance abuse prevention program. Our results indicate that the program's participants differed significantly from the population at large.

Creating a Minnesota Statewide SNAP-Ed Program Evaluation

ERIC Educational Resources Information Center

Gold, Abby; Barno, Trina Adler; Sherman, Shelley; Lovett, Kathleen; Hurtado, G. Ali

2013-01-01

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

Evaluation Project of a Postvention Program.

ERIC Educational Resources Information Center

Simon, Robert; And Others

A student suicide or parasuicide increases the risk that potentially suicidal teenagers see suicide as an enviable option. The "copycat effect" can be reduced by a postvention program. This proposed evaluative research project will provide an implementation and impact evaluation of a school's postvention program following a suicide or…

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

NASA Technical Reports Server (NTRS)

Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

Teacher Education Program Evaluation: An Annotated Bibliography and Guide to Research.

ERIC Educational Resources Information Center

Ayers, Jerry B.; Berney, Mary F.

This book includes an annotated bibliography of the essentials needed to conduct an effective evaluation of a teacher education program. Specific information on evaluation includes: (1) general evaluation techniques, (2) evaluation of candidates and students, (3) evaluation of the knowledge base, (4) quality controls, (5) evaluation of laboratory…

The Use of Multiple Evaluation Approaches in Program Evaluation

ERIC Educational Resources Information Center

Bledsoe, Katrina L.; Graham, James A.

2005-01-01

The authors discuss the use of multiple evaluation approaches in conducting program evaluations. Specifically, they illustrate four evaluation approaches (theory-driven, consumer-based, empowerment, and inclusive evaluation) and briefly discuss a fifth (use-focused evaluation) as a side effect of the use of the others. The authors also address the…

What Works, and Can We Afford It? Program Effectiveness in AISD, 1991-92. Publication Number 91.43.

ERIC Educational Resources Information Center

Wilkinson, David; And Others

This report presents information on the effectiveness, including cost effectiveness, of many programs of the Austin (Texas) Independent School District (AISD). In 1991-92, the AISD Office of Research and Evaluation (ORE) reviewed 85 programs or program components. Cost effectiveness was calculated for 18 programs using an achievement effect…

Insourcing, Not Capacity Building, a Better Model for Sustained Program Evaluation

ERIC Educational Resources Information Center

Miller, Thomas I.; Kobayashi, Michelle M.; Noble, Paula M.

2006-01-01

Community-based organizations (CBOs), typically small and underfunded with transient staff members, are told by funders to care for clients and verify program value. To assist CBOs with evaluations that speak to program effectiveness, many funders wish to expand the evaluation capacity of CBO staff members so that evaluation will occur as long as…

Evaluating Knowledge, Attitudinal, and Behavioral Change Effects from a Multinational HIV/AIDS Education Program for Youth

ERIC Educational Resources Information Center

Hardre, Patricia L.; Garcia, Fe; Apamo, Peter; Mutheu, Lucy; Ndege, Monica; Bois, Iderle

2010-01-01

This project tracked the mid-term evaluation processes, practices, and products of a multinational program to reduce at-risk behaviors for HIV/AIDS among children in Kenya, Tanzania, and Haiti. It focused on participant and community perceptions; program effectiveness in promoting abstinence and monogamy decisions; and factors supporting ongoing…

The Compubus Evaluation.

ERIC Educational Resources Information Center

Klimko, Ivan P.

The Computer Bus Program (Compubus Program) of the Modesto City Schools (California) was evaluated to determine the effectiveness of the computer literacy program for fourth, fifth, and sixth grade students at eight elementary compensatory education schools. The program provided instruction on computer vocabulary, knowledge, and applications in a…

THE SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM; ANNUAL REPORT TO CONGRESS, FY 1998

EPA Science Inventory

This document summarizes the accomplishments and activities of the Superfund Innovative Technology Evaluation (SITE) Program for 1998. General information on the SITE program is presented. In addition, cost savings effected by the SITE program were estimated and are presented. ...

Sexuality Education: An Evaluation of Programs and Their Effects.

ERIC Educational Resources Information Center

Kirby, Douglas

This document is the first volume of a six-volume report on sexuality education. This volume summarizes the structure and content of sexuality education in the United States, reviews the literature on the effects of sexuality education, describes the evaluation methods, provides a description of and the evaluation data for each program, and…

Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

NASA Astrophysics Data System (ADS)

Warburton, J.; Crowley, S.; Larson, A.

2012-12-01

PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

Economic evaluation of preventive dental programs: what can they tell us?

PubMed

Morgan, Mike; Mariño, Rodrigo; Wright, Clive; Bailey, Denise; Hopcraft, Matthew

2012-10-01

The role of public health program planners is to determine the effectiveness of public health programs, what recommendations should be made, what future initiatives should be taken, and what policies should be developed. At a basic level, to choose between competing alternatives, two characteristics of an intervention must be considered; these are its outcome and its cost. Based on cost and outcome, planners must select the option that offers the most advantages. Economic evaluation is commonly adopted by decision makers in the health sector to investigate the effectiveness of public health programs and to help plan future initiatives. Economic evaluation assists decision makers who must weigh the information it provides in the context of many and often competing options. In this way, an economic evaluation is an aid to decision making rather than the decision itself. Economic evaluation is becoming essential for informed decision making, with potential implications for public health policy and practice and for clinical practice too. While economic evaluations are commonly used in decision-making processes about health programs, few examples exist in the oral health literature. In the case of preventive oral health programs, economic analysis is often difficult, largely because it makes demands on epidemiological and demographic data that are hard to meet. This study will address the concepts and tools required to conduct economic evaluations of prevention programs. The emphasis will be on oral health and preventive dental programs, although the concepts presented could be useful for other public health programs by practitioners and managers with the aim of producing effective and efficient oral health programs. © 2012 John Wiley & Sons A/S.

How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations.

PubMed Central

Ennett, S T; Tobler, N S; Ringwalt, C L; Flewelling, R L

1994-01-01

OBJECTIVES. Project DARE (Drug Abuse Resistance Education) is the most widely used school-based drug use prevention program in the United States, but the findings of rigorous evaluations of its effectiveness have not been considered collectively. METHODS. We used meta-analytic techniques to review eight methodologically rigorous DARE evaluations. Weighted effect size means for several short-term outcomes also were compared with means reported for other drug use prevention programs. RESULTS. The DARE effect size for drug use behavior ranged from .00 to .11 across the eight studies; the weighted mean for drug use across studies was .06. For all outcomes considered, the DARE effect size means were substantially smaller than those of programs emphasizing social and general competencies and using interactive teaching strategies. CONCLUSIONS. DARE's short-term effectiveness for reducing or preventing drug use behavior is small and is less than for interactive prevention programs. PMID:8092361

Interpreting Outcomes: Using Focus Groups in Evaluation Research

ERIC Educational Resources Information Center

Ansay, Sylvia J.; Perkins, Daniel F.; Nelson, John

2004-01-01

Although focus groups continue to gain popularity in marketing and social science research, their use in program evaluation has been limited. Here we demonstrate how focus groups can benefit evaluators, program staff, policy makers and administrators by providing an in-depth understanding of program effectiveness from the perspective of…

Manipulator system man-machine interface evaluation program. [technology assessment

NASA Technical Reports Server (NTRS)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

A Modified Importance-Performance Framework for Evaluating Recreation-Based Experiential Learning Programs

ERIC Educational Resources Information Center

Pitas, Nicholas; Murray, Alison; Olsen, Max; Graefe, Alan

2017-01-01

This article describes a modified importance-performance framework for use in evaluation of recreation-based experiential learning programs. Importance-performance analysis (IPA) provides an effective and readily applicable means of evaluating many programs, but the near universal satisfaction associated with recreation inhibits the use of IPA in…

7 CFR 1485.20 - Financial management, reports, evaluations and appeals.

Code of Federal Regulations, 2011 CFR

2011-01-01

.... (ii) A brand promotion evaluation is a review of the U.S. and foreign commercial entities' export... of the program to determine the effectiveness of the participant's strategy in meeting specified... program evaluation's findings and recommendations and proposed changes in program strategy or design as a...

Barriers to Evaluation

ERIC Educational Resources Information Center

Charley, Lois

2007-01-01

According to the Department of Health and Human Services, "good program evaluations assess programs performance, measure impacts on families and communities, and document program successes." With this information, programs are able to direct limited resources to where they are most needed and most effective in their communities. This article is…

Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity.

PubMed

Kozica, S L; Lombard, C B; Harrison, C L; Teede, H J

2016-11-24

The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs. A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor. Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m 2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required. Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up. Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].

Kentucky Preschool Evaluation Project: Differential Effects, Program Characteristics and Child Outcomes, and Longitudinal and Cumulative Findings. Reports 1-4, 1998-1999.

ERIC Educational Resources Information Center

Hemmeter, Mary Louise; Townley, Kim; Wilson, Stephen; Epstein, Ann; Hines, Huyi

This document is comprised of four reports related to the evaluation of the Kentucky Preschool Program (KPP), serving 4-year-olds who qualify for the free lunch program and 3- and 4-year-olds with disabilities. Report 1 focuses on the differential effects of the preschool program related to race and to gender. Three key findings are reported: (1)…

Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

PubMed

Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

2014-12-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

PubMed

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design in evaluating the training program, the training program is expected to be efficiently and rapidly implemented into and adjusted to care practice and medical education.

An Evaluation of the Effect of D.C.'s Voucher Program on Public School Achievement and Racial Integration after One Year. Education Working Paper No. 10.

ERIC Educational Resources Information Center

Greene, Jay P.; Winters, Marcus A.

2006-01-01

This study evaluates the initial effect of Washington, D.C.'s Opportunity Scholarship Program (OSP) on the academic performance of public schools and its effects on the opportunities that District students have to attend integrated schools. The OSP is a federally sponsored school voucher program that provides vouchers worth up to $7,500 for an…

The transfer of safety training in work organizations: a systems perspective to continuous learning.

PubMed

Ford, J K; Fisher, S

1994-01-01

The effectiveness of safety and health programs can be evaluated from a "transfer" perspective, which evaluates the effectiveness of training in individual programs, and from a "systems" perspective that contends that a safety training program cannot be isolated from the organizational system of which it is a part. This chapter explores the effectiveness of training from a systems perspective and includes recommendations for improving safety and health training.

An Evaluation of a Mixed-Gender Sexual Assault Prevention Program

ERIC Educational Resources Information Center

Bradley, April R.; Yeater, Elizabeth A.; O'Donohue, William

2009-01-01

This study evaluated the short-term effectiveness of a mixed-gender sexual assault prevention program developed for college students. Program participants (n = 177) were compared to non-program participants (n = 132) prior to the program and during a 2-week follow-up period on measures of rape myths, victim empathy, perceived negative consequences…

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

PubMed Central

KOJURI, JAVAD; AMINI, MITRA; KARIMIAN, ZAHRA; DEHGHANI, MOHAMMAD REZA; SABER, MAHBOOBEH; BAZRAFCAN, LEILA; EBRAHIMI, SEDIGHEH; REZAEE, RITA

2015-01-01

Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396). Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusions: Our faculty development program  have a significant positive effect on medical university teaching staff members’ competencies. Further research is needed to investigate whether the faculty development program actually results in improved teaching performance. PMID:25587548

Evaluation readiness: improved evaluation planning using a data inventory framework.

PubMed

Cohen, A B; Hall, K C; Cohodes, D R

1985-01-01

Factors intrinsic to many programs, such as ambiguously stated objectives, inadequately defined performance measures, and incomplete or unreliable databases, often conspire to limit the evaluability of these programs. Current evaluation planning approaches are somewhat constrained in their ability to overcome these obstacles and to achieve full preparedness for evaluation. In this paper, the concept of evaluation readiness is introduced as a complement to other evaluation planning approaches, most notably that of evaluability assessment. The basic products of evaluation readiness--the formal program definition and the data inventory framework--are described, along with a guide for assuring more timely and appropriate evaluation response capability to support the decision making needs of program managers. The utility of evaluation readiness for program planning, as well as for effective management, is also discussed.

Measuring Success in Obesity Prevention: A Synthesis of Health Promotion Switzerland's Long-Term Monitoring and Evaluation Strategy

PubMed Central

Ackermann, Günter; Kirschner, Michael; Guggenbühl, Lisa; Abel, Bettina; Klohn, Axel; Mattig, Thomas

2015-01-01

Aims Since 2007, Health Promotion Switzerland has implemented a national priority program for a healthy body weight. This article provides insight into the methodological challenges and results of the program evaluation. Methods Evaluation of the long-term program required targeted monitoring and evaluation projects addressing different outcome levels. The evaluation was carried out according to the Swiss Model for Outcome Classification (SMOC), a model designed to classify the effects of health promotion and prevention efforts. Results The results presented in this article emphasize both content and methods. The national program successfully achieved outcomes on many different levels within complex societal structures. The evaluation system built around the SMOC enabled assessment of program progress and the development of key indicators. However, it is not possible to determine definitively to what extent the national program helped stabilize the prevalence of obesity in Switzerland. Conclusion The model has shown its utility in providing a basis for evaluation and monitoring of the national program. Continuous analysis of data from evaluation and monitoring has made it possible to check the plausibility of suspected causal relationships as well as to establish an overall perspective and assessment of effectiveness supported by a growing body of evidence. PMID:25765161

Addressing Social Injustices, Displacement, and Minority Rights through Cases of Culturally Responsive Evaluation

ERIC Educational Resources Information Center

Stokes, Helga; Chaplin, Shane S.; Dessouky, Shimaa; Aklilu, Liya; Hopson, Rodney K.

2011-01-01

Evaluation of programs that address the lingering effects of human rights abuses during times of conflict is necessary to improve program sustainability and create a knowledge bank about the effectiveness of strategies. Outcomes, however, are hard to measure. Evaluators have to gain understanding of the roots of a conflict, surrounding events,…

The Effects of a Statewide Evaluation Initiative in Gifted Education on Practitioner Knowledge, Concerns, and Program Documentation

ERIC Educational Resources Information Center

Robinson, Ann; Cotabish, Alicia; Wood, Betty K.; O'Tuel, Fran S.

2014-01-01

When well-considered and grounded in current knowledge, program evaluations of services to gifted learners can be a powerful tool for increasing practitioners' knowledge and self-efficacy, and for effecting positive programmatic changes. The Arkansas Evaluation Initiative (AEI) in Gifted Education, a Jacob K. Javits-funded project, was implemented…

Using Evaluation to Effect Social Change: Looking through a Community Psychology Lens

ERIC Educational Resources Information Center

Cook, James R.

2015-01-01

Program evaluation is generally viewed as a set of mechanisms for collecting and using information to learn about projects, policies and programs, to understand their effects as well as the manner in which they are implemented. AEA has espoused principles for evaluation that place emphasis on competent, honest inquiry that respects the security,…

Evaluation of Urban After-School Programs: Effective Methodologies for a Diverse and Political Environment.

ERIC Educational Resources Information Center

Frank, Martina W.; Walker-Moffat, Wendy

This study considered how 25 highly diverse after-school programs with funding of $5.6 million were evaluated during a 10-month period. The paper describes the evaluation methodologies used and determined which methodologies were most effective within a diverse and political context. The Bayview Fund for Youth Development (name assumed for…

Comparative Evaluation of Financing Programs: Insights From California’s Experience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deason, Jeff

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less

Evaluating Admission Criteria Effects for Under-Represented Groups

ERIC Educational Resources Information Center

Childs, Ruth A.; Ferguson, Amanda K.; Herbert, Monique B.; Broad, Kathryn; Zhang, Jingshun

2016-01-01

The effects that admission criteria may have for under-represented groups are an important concern for programs seeking to improve access to post-secondary education. Using data from a large preservice teacher education program in the Canadian province of Ontario, we demonstrate two approaches to evaluating the effects of admission criteria. The…

Moving evidence-based drug abuse prevention programs from basic science to practice: "bridging the efficacy-effectiveness interface".

PubMed

August, Gerald J; Winters, Ken C; Realmuto, George M; Tarter, Ralph; Perry, Cheryl; Hektner, Joel M

2004-01-01

This article examines the challenges faced by developers of youth drug abuse prevention programs in transporting scientifically proven or evidence-based programs into natural community practice systems. Models for research on the transfer of prevention technology are described with specific emphasis given to the relationship between efficacy and effectiveness studies. Barriers that impede the successful integration of efficacy methods within effectiveness studies (e.g., client factors, practitioner factors, intervention structure characteristics, and environmental and organizational factors) are discussed. We present a modified model for program development and evaluation that includes a new type of research design, the hybrid efficacy-effectiveness study that addresses program transportability. The utility of the hybrid study is illustrated in the evaluation of the Early Risers "Skills for Success" prevention program.

Implementation of the Career Education Incentive Act. First Interim Report on the Evaluability Assessment.

ERIC Educational Resources Information Center

Jung, Steven M.; And Others

Survey activities are reported which were designed to provide the foundation for a national evaluation of the effectiveness of programs assisted under the Career Education Incentive Act of 1977 (PL 95-207). The methodology described, called "program evaluability assessment," focuses on detailed analysis of program assumptions in order to…

Summative Evaluation of the Foreign Credential Recognition Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2010

2010-01-01

A summative evaluation of the Foreign Credential Recognition Program (FCRP) funded by Human Resources and Skills Development Canada (HRSDC) was conducted during the spring, summer and fall of 2008. The main objective of the evaluation was to measure the relevance, impacts, and cost-effectiveness of the program. Given the timing of the evaluation…

A Collaborative Approach to Family Literacy Evaluation Strategies.

ERIC Educational Resources Information Center

Landerholm, Elizabeth; Karr, Jo Ann; Mushi, Selina

A collaborative approach to program evaluation combined with the use of a variety of evaluation methods using currently available technology can yield valuable information about the effectiveness of family literacy programs. Such an approach was used for McCosh Even Start, a federally-funded family literacy program located at McCosh School in an…

Program Evaluation of Alternative Schools in North Carolina: A Companion Dissertation

ERIC Educational Resources Information Center

Jones, Michael O.

2013-01-01

The purpose of the evaluation was to evaluate two alternative programs in a North Carolina (NC) and South Carolina (SC) public school district to determine if they are effective in delivering constructive interventions that modify student behavior once students have left the programs and have returned to their regular learning environments. This…

Evaluating the Effects of Maintenance Resource Management (MRM) Interventions in Airline Safety

DOT National Transportation Integrated Search

1998-02-01

The present paper seeks to describe and validate the effectiveness of five change programs (generically termed Maintenance Resource Management, or "MRM"). The activities evaluated here are in the middle stages of an ongoing MRM training program, or t...

The evolution of Rare Pride: using evaluation to drive adaptive management in a biodiversity conservation organization.

PubMed

Jenks, Brett; Vaughan, Peter W; Butler, Paul J

2010-05-01

Rare Pride is a social marketing program that stimulates human behavior change in order to promote biodiversity conservation in critically threatened regions in developing countries. A series of formal evaluation studies, networking strategies, and evaluative inquiries have driven a 20-year process of adaptive management that has resulted in extensive programmatic changes within Pride. This paper describes the types of evaluation that Rare used to drive adaptive management and the changes it caused in Pride's theory-of-change and programmatic structure. We argue that (a) qualitative data gathered from partners and staff through structured interviews is most effective at identifying problems with current programs and procedures, (b) networking with other organizations is the most effective strategy for learning of new management strategies, and (c) quantitative data gathered through surveys is effective at measuring program impact and quality. Adaptive management has allowed Rare to increase its Pride program from implementing about two campaigns per year in 2001 to more than 40 per year in 2009 while improving program quality and maintaining program impact. Copyright 2009 Elsevier Ltd. All rights reserved.

Evaluating the Sharing Stories youth theatre program: an interactive theatre and drama-based strategy for sexual health promotion among multicultural youth.

PubMed

Roberts, Meagan; Lobo, Roanna; Sorenson, Anne

2017-03-01

Issue addressed Rates of sexually transmissible infections among young people are high, and there is a need for innovative, youth-focused sexual health promotion programs. This study evaluated the effectiveness of the Sharing Stories youth theatre program, which uses interactive theatre and drama-based strategies to engage and educate multicultural youth on sexual health issues. The effectiveness of using drama-based evaluation methods is also discussed. Methods The youth theatre program participants were 18 multicultural youth from South East Asian, African and Middle Eastern backgrounds aged between 14 and 21 years. Four sexual health drama scenarios and a sexual health questionnaire were used to measure changes in knowledge and attitudes. Results Participants reported being confident talking to and supporting their friends with regards to safe sex messages, improved their sexual health knowledge and demonstrated a positive shift in their attitudes towards sexual health. Drama-based evaluation methods were effective in engaging multicultural youth and worked well across the cultures and age groups. Conclusions Theatre and drama-based sexual health promotion strategies are an effective method for up-skilling young people from multicultural backgrounds to be peer educators and good communicators of sexual health information. Drama-based evaluation methods are engaging for young people and an effective way of collecting data from culturally diverse youth. So what? This study recommends incorporating interactive and arts-based strategies into sexual health promotion programs for multicultural youth. It also provides guidance for health promotion practitioners evaluating an arts-based health promotion program using arts-based data collection methods.

Improving Literacy Achievement for English Learners in Transitional Bilingual Programs.

ERIC Educational Resources Information Center

Saunders, William M.

1999-01-01

Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)

Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

ERIC Educational Resources Information Center

Greci, Dana

2016-01-01

Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

Assessing the Subsequent Effect of a Formative Evaluation on a Program.

ERIC Educational Resources Information Center

Brown, J. Lynne; Kiernan, Nancy Ellen

2001-01-01

Conducted a formative evaluation of an osteoporosis prevention health education program using several methods, including questionnaires completed by 256 women, and then compared formative evaluation results to those of a summative evaluation focusing on the same target group. Results show the usefulness of formative evaluation for strengthening…

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

Effectiveness in Delaying the Initiation of Sexual Intercourse of Girls Aged 12-14: Two Components of the Girls Incorporated Preventing Adolescent Pregnancy Program.

ERIC Educational Resources Information Center

Postrado, Leticia T.; Nicholson, Heather Johnston

1992-01-01

Evaluates effectiveness of the Girls Incorporated Preventing Adolescent Pregnancy Program, concentrating on effectiveness of the Will Power/Won't Power social skills development program and the Growing Together parent-daughter communication program. Surveys of 412 girls aged 12 to 14 years indicate the effectiveness of these programs in delaying…

Evaluating the cost-effectiveness of cancer patient navigation programs: conceptual and practical issues.

PubMed

Ramsey, Scott; Whitley, Elizabeth; Mears, Victoria Warren; McKoy, June M; Everhart, Rachel M; Caswell, Robert J; Fiscella, Kevin; Hurd, Thelma C; Battaglia, Tracy; Mandelblatt, Jeanne

2009-12-01

Patient navigators-individuals who assist patients through the healthcare system to improve access to and understanding of their health and healthcare-are increasingly used for underserved individuals at risk for or with cancer. Navigation programs can improve access, but it is unclear whether they improve the efficiency and efficacy of cancer diagnostic and therapeutic services at a reasonable cost, such that they would be considered cost-effective. In the current study, the authors outline a conceptual model for evaluating the cost-effectiveness of cancer navigation programs. They describe how this model is being applied to the Patient Navigation Research Program, a multicenter study supported by the National Cancer Institute's Center to Reduce Cancer Health Disparities. The Patient Navigation Research Program is testing navigation interventions that aim to reduce time to delivery of quality cancer care (noncancer resolution or cancer diagnosis and treatment) after identification of a screening abnormality. Examples of challenges to evaluating cost-effectiveness of navigation programs include the heterogeneity of navigation programs, the sometimes distant relation between navigation programs and outcome of interest (eg, improving access to prompt diagnostic resolution and life-years gained), and accounting for factors in underserved populations that may influence both access to services and outcomes. In this article, the authors discuss several strategies for addressing these barriers. Evaluating the costs and impact of navigation will require some novel methods, but will be critical in recommendations concerning dissemination of navigation programs. (c) 2009 American Cancer Society.

Commentary on Foubert, Godin, & Tatum (2010): the evolution of sexual violence prevention and the urgency for effectiveness.

PubMed

Tharp, Andra Teten; DeGue, Sarah; Lang, Karen; Valle, Linda Anne; Massetti, Greta; Holt, Melissa; Matjasko, Jennifer

2011-11-01

Foubert, Godin, and Tatum describe qualitative effects among college men of The Men's Program, a one-session sexual violence prevention program. This article and the program it describes are representative of many sexual violence prevention programs that are in practice and provide an opportunity for a brief discussion of the development and evaluation of sexual violence prevention approaches. In this commentary, we will focus on two considerations for an evolving field: the adherence to the principles of prevention and the use of rigorous evaluation methods to demonstrate effectiveness. We argue that the problem of sexual violence has created urgency for effective prevention programs and that scientific and prevention standards provide the best foundation to meet this need.

Evaluation of the University of South Alabama College of Education Teacher Training Program by Analyses of its Alumni, II - 1971.

ERIC Educational Resources Information Center

Johnson, Granville B.

To ascertain the effectiveness of a training program, an evaluation of its effect on trainees must be obtained. In a teacher training program, sources of feedback exist which may prove significant in the development of improved training techniques. Two of these are: How the alumni feel about their own training experience and how their principals…

Evaluation of a Workplace Basic Skills Program: An Impact Study of AVC Edmonton's 1990 Job Effectiveness Training Program at Stelco Steel. Report Summary.

ERIC Educational Resources Information Center

Barker, Kathryn Chang

The pilot Job Effectiveness Training (JET) workplace basic skills program, developed by Canada's Alberta Vocational College (AVC), Edmonton, for Stelco Steel during 1989-90, was evaluated in terms of impacts or changes from the perspective of the four major stakeholder groups: the students (12 Stelco employees); the employers (Stelco management);…

Locking-In Effects Due to Early Interventions? An Evaluation of a Multidisciplinary Screening Programs for Avoiding Long-Term Sickness

ERIC Educational Resources Information Center

Johansson, Per; Lindahl, Erica

2012-01-01

Objective: In this article, we estimate the effect of a multidisciplinary collaboration program on the length of sickness absence. The intention with the program was to avoid long-term sickness absence by providing an early and holistic evaluation of the sick-listed individuals' conditions. The target group was individuals who were at risk of…

Program Evaluation Report for Sulphur Springs Independent School District Project STYLE (Students and Teachers Yearning to Learn Effectively) 2004-2005

ERIC Educational Resources Information Center

Combs, Julie P.; Jackson, Sherion H.

2005-01-01

The purpose of this paper is to present findings from a program evaluation conducted to examine the effectiveness of the Schools Attuned program in a north Texas school district. Schools Attuned was developed by a professor of pediatrics, Dr. Mel Levine (2002), as a professional development model to train teachers to identify cognitive and…

Performance Evaluation of Community Health Workers: Case Study in the Amazon of Peru.

PubMed

Westgard, Christopher; Naraine, Renuka; Paucar Villacorta, Diego Mauricio

2018-03-26

A shortage in human resources for health is a growing crisis that has led to an inability to provide adequate health services to impoverished populations. By "task-shifting", health systems can delegate certain activities, such as health promotion and referral, to trained community members to help fill the human resource gap. An effective community health agent program can improve maternal and child health and overall effectiveness of rural health systems. Such a program is most effective when the community health agents receive supervision and evaluation of their performance. There is a shortage of literature that provides instruction and example on how to conduct a performance evaluation in the developing world to improve maternal and child health outcomes. The current study provides a case study of a performance evaluation in the Amazon region of Peru and how the findings can be used to make program adjustments. A set of instruments to measure the performance of CHWs was adapted from the literature and then implemented in the field. The instruments were used to measure the quality of home visits by the CHWs, their knowledge of the health topics, and structural activities. Three communities with an active CHW program in Loreto, Peru were chosen to receive the evaluation. All CHWs in the communities were evaluated. The scores from the evaluation were compared internally to identify strengths and weaknesses of the program and within the population of CHWs. The evaluation was completed on 52 home visits and 27 CHWs in three communities. The CHWs were found to be most effective at creating good relationships with caregivers and delivering health messages, and least effective at interacting with the child during the home visit and using material to deliver health messages. The evaluation instruments were well suited for the CHW program that utilizes home visits to teach about child health and development.

Implementing a centralized institutional peer tutoring program.

PubMed

Gaughf, Natalie White; Foster, Penni Smith

2016-01-01

Peer tutoring has been found to be beneficial to both students and peer tutors in health sciences education programs. This article describes the implementation of a centralized, institutional peer tutoring program at the University of Mississippi Medical Center, an academic health science center in the U.S. The Program: This multispecialty peer tutoring program paired students experiencing academic difficulties with peer tutors who showed prior academic success, professionalism and effective communication skills. The program allowed students and peer tutors to coordinate their own tutoring services. Evaluations by both students and peer tutors showed satisfaction with the program. Recommendations for developing and implementing an effective peer tutoring program are presented, including utilization of an online system, consistent program policy with high professionalism expectations, funding, program evaluation and data tracking.

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers.

PubMed

Viester, Laura; Verhagen, Evert A L M; Bongers, Paulien M; van der Beek, Allard J

2014-11-01

To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions. Effectiveness was assessed on motivational stage-of-change, self-efficacy, and decisional balance for physical activity and dietary behavior. The external validity of the trial was satisfactory with representative reach of workers and adoption of workplace units in the participating construction company. The extent to which the program was implemented as intended was modest. The intervention was effective on participants' progress through stages of behavior change. Based on the RE-AIM dimensions, it is concluded that for construction workers, the program is feasible and potentially effective, but adjustments are required before widespread implementation.

Preventing Sexual Violence in Adolescence: Comparison of a Scientist-Practitioner Program and a Practitioner Program Using a Cluster-Randomized Design.

PubMed

Muck, Christoph; Schiller, Eva-Maria; Zimmermann, Maria; Kärtner, Joscha

2018-02-01

Numerous school-based prevention programs have been developed by scientists and practitioners to address sexual violence in adolescence. However, such programs struggle with two major challenges. First, the effectiveness of many well-established practitioner programs has not been rigorously evaluated. Second, effective scientific programs may be hard to implement into everyday school practice. Combining the knowledge of scientists and practitioners in a scientist-practitioner program could be a helpful compromise. The aim of the present study is to evaluate the effects of a scientist-practitioner program and a practitioner program using a cluster-randomized experimental design. Twenty-seven school classes were randomly assigned to either one of two programs or a control group. Outcome variables (knowledge, attitudes, behavior, and iatrogenic effects) were assessed at pretest, posttest, and a 6-month follow-up for 453 adolescents (55% female, Mage = 14.18). Short-term effects were found in both programs regarding general knowledge, knowledge of professional help, and victim-blaming attitudes. Long-term effects were found in both programs regarding general knowledge and knowledge of professional help and, in the practitioner program, in a reduction of victimization. No other effects were found on attitudes and behavior. No iatrogenic effects in the form of increased anxiety were found. Both the scientist-practitioner and the practitioner program show promise for the prevention of sexual violence in adolescence; in particular, the practitioner program may be a more cost-effective method.

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

PubMed

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

Framework for a National Testing and Evaluation Program ...

EPA Pesticide Factsheets

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Offense History and the Effectiveness of Juvenile Diversion Programs.

ERIC Educational Resources Information Center

Osgood, D. Wayne; And Others

Some evaluations have concluded that diversion programs for juvenile offenders (programs intended as community-based alternatives to formal justice dispositions) reduce recidivism only among youths with the least serious offense histories. To investigate the relationship of offense history to program effectiveness, three diversion programs were…

Effectiveness of the online weight reduction program KiloCoach™ and comparison with other evaluated commercial direct intervention and online programs.

PubMed

Longin, Rita; Grasse, Marina; Aspalter, Rosa; Waldherr, Karin

2012-01-01

Preliminary results indicated effectiveness of the online weight reduction program KiloCoach. The current study presents a large collection of user data and compares KiloCoach with other evaluated commercial weight loss programs. Furthermore, potential factors influencing the effectiveness of internet weight loss programs should be identified. 4,310 data sets of KiloCoach users were available, 3,150 of them were suitable for further analysis. 946 program users were considered completers (at least 60 days of continuous protocol). For comparison with other programs, different subsamples were drawn that matched to the inclusion criteria of reference studies. On average, KiloCoach overweight and obese completers lost 4.5 % of initial body weight. KiloCoach was as effective as the commercial program Weight Watchers® after 1 year (6.4% vs. 5.3% weight loss; p = 0.11) and 2 years (5.1% vs. 3.2% weight loss; p = 0.15). KiloCoach proved to be more effective than other online programs (Viktklubb, eDiets.com) as well as an in-person behavioral program, but less effective than Vtrim®, an online behavioral program providing intensive support. In comparison to reference programs, KiloCoach proved to be effective for weight reduction. The effect of online weight reduction programs seems to depend on methods and features applied.

Alternative Education: Evaluation and Implementation of EBCE.

ERIC Educational Resources Information Center

Shively, Joe E.; Sanders, Jack

Increasing student disenchantment with traditional schooling prompted the development of an alternative educational program: Experience-Based Career Education (EBCE). During three years of development, evaluation provided student, parent, and employer data on program impact and effectiveness. Stakeholders' involvement in program development and…

48 CFR 552.219-76 - Mentor Requirements and Evaluation.

Code of Federal Regulations, 2014 CFR

2014-10-01

... protégé firms will submit a “Lessons Learned” evaluation to the GSA Mentor-Protégé Program Manager at the... for Program exclusion and the effective date. The exclusion from the Program does not constitute a...

48 CFR 552.219-76 - Mentor Requirements and Evaluation.

Code of Federal Regulations, 2012 CFR

2012-10-01

... protégé firms will submit a “Lessons Learned” evaluation to the GSA Mentor-Protégé Program Manager at the... for Program exclusion and the effective date. The exclusion from the Program does not constitute a...

48 CFR 552.219-76 - Mentor Requirements and Evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... protégé firms will submit a “Lessons Learned” evaluation to the GSA Mentor-Protégé Program Manager at the... for Program exclusion and the effective date. The exclusion from the Program does not constitute a...

48 CFR 552.219-76 - Mentor Requirements and Evaluation.

Code of Federal Regulations, 2013 CFR

2013-10-01

... protégé firms will submit a “Lessons Learned” evaluation to the GSA Mentor-Protégé Program Manager at the... for Program exclusion and the effective date. The exclusion from the Program does not constitute a...

Alternatives to Piloting Textbooks.

ERIC Educational Resources Information Center

Muther, Connie

1985-01-01

Using short-term pilot programs to evaluate textbooks can lead to unreliable results and interfere with effective education. Alternative methods for evaluating textbook-based programs include obtaining documented analyses of competitors' products from sales agents, visiting districts using programs being considered, and examining publishers' own…

The effectiveness of laser and radar based enforcement programs for deterrence of speeding

DOT National Transportation Integrated Search

1997-02-01

This report documents the results of a study to determine the community-wide effectiveness of laser-based speed enforcement programs relative to radar-based programs. Jurisdiction-wide speeding enforcement programs were implemented and evaluated in t...

The Effect of Persuasion on the Utilization of Program Evaluation Information: A Preliminary Study.

ERIC Educational Resources Information Center

Eason, Sandra H.; Thompson, Bruce

The utilization of program evaluation may be made more effective by means of the application of contemporary persuasion theory. The Elaboration Likelihood Model--a model of cognitive processing, ability, and motivation--was used in this study to test the persuasive effects of source credibility and involvement on message acceptance of evaluation…

Implementing and Evaluating School-Based Primary Prevention Programs and the Importance of Differential Effects on Outcomes

ERIC Educational Resources Information Center

Hussey, David L.; Flannery, Daniel J.

2007-01-01

In 2004, Second Step (Committee for Children, 2002), a violence prevention program, was implemented in the Cleveland Heights-University Heights school district for 1,416 K through second grade students. Both process and outcome measures were used to evaluate program impact and examine issues related to the implementation and evaluation of…

Pedagogical Ethical Dilemmas in a Responsive Evaluation of a Leadership Program for Youth

ERIC Educational Resources Information Center

Freeman, Melissa; Preissle, Judith

2010-01-01

How do responsive evaluators provide input to program planners when competing ethical principles point to different choices of effective feedback? A team of three evaluators used participant observation, individual and focus group interviews, and analysis of documents to provide input on the development and outcome of a summer program for high…

Annual Evaluation: Elementary and Secondary Act of 1965 - Title I, Maine, FY 1970.

ERIC Educational Resources Information Center

Maine State Dept. of Education, Augusta.

This evaluation attempts to measure the extent and effectiveness of ESEA Title I programs designed to meet the needs of disadvantaged children and apprizes the public and the legislature of program outcomes. In keeping with USOE requirements for evaluating Title I programs, this document is constructed of (1) responses to USOE probes by…

Evaluation and implementation of highly challenging balance training in clinical practice for people with Parkinson's disease: protocol for the HiBalance effectiveness-implementation trial.

PubMed

Leavy, Breiffni; Kwak, Lydia; Hagströmer, Maria; Franzén, Erika

2017-02-07

If people with progressive neurological diseases are to avail of evidence-based rehabilitation, programs found effective in randomized controlled trials (RCT's) must firstly be adapted and tested in clinical effectiveness studies as a means of strengthening their evidence base. This paper describes the protocol for an effectiveness-implementation trial that will assess the clinical effectiveness of a highly challenging balance training program (the HiBalance program) for people with mild-moderate Parkinson's disease (PD) while simultaneously collecting data concerning the way in which the program is implemented. The HiBalance program is systemically designed to target balance impairments in PD and has been shown effective at improving balance control and gait in a previous RCT. Study aims are to i) determine the effectiveness of the adapted HiBalance program on performance and self-rated outcomes such as balance control, gait and physical activity level ii) conduct a process evaluation of program implementation at the various clinics iii) determine barriers and facilitators to program implementation in these settings. This effectiveness-implementation type 1 hybrid study will use a non-randomized controlled design with consecutive inclusion of people with PD at multiple clinical sites. A mixed method approach will be used to collect clinical effectiveness data and process evaluation data which is both quantitative and qualitative in nature. The consolidated framework for implementation research (CFIR) will be used to guide the planning and collection of data concerning implementation barriers and facilitators. The HiBalance program will be provided by physical therapists as a part of standard rehabilitation care at the clinical sites, while the evaluation of the implementation process will be performed by the research group and funded by research grants. An effectiveness-implementation study design benefits patients by speeding up the process of translating findings from research settings to routine health care. Findings from this study will also be highly relevant for those working with neurological rehabilitation when faced with decisions concerning the translation of training programs from efficacy studies to everyday clinical practice. ClinicalTrials.gov march 2016, NCT02727478 .

An Evaluation of DOE-EM Public Participation Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bradbury, Judith A.; Branch, Kristi M.; Malone, Elizabeth L.

This report evaluates the scope and effectiveness of the public participation pr ograms, including Site-Specific Advisory Boards (SSABs), at seven U.S. Departmen t of Energy (DOE) sites: Fernald, Hanford, Los Alamos, Nevada, Oak Ridge, Paduc ah, and Savannah River. The primary purpose of the study is to assist both DOE Field and Headquarters managers in reviewing and understanding lessons learned o ver the past decade concerning public participation programs administered by the DOE Office of Environmental Management (EM). The evaluation provides a snapsh ot of selected EM public participation programs at a particular point of time. It is based onmore » interviews and site visits conducted between January and June 200 2- a time of change within the program. The study focuses on public participati on programs that incorporate a variety of activities and address a wide range of individual site activities and decisions. It uses the Acceptability Diamond as an evaluative framework to answer questions about stakeholders' experiences wit h, and assessment of, DOE-EM's public participation programs. The Acceptability Diamond, which was developed by researchers from the Pacific Northwest National Laboratory in previous research, identifies four program dimensions - substanti ve issues, decision-making process, relationships, and accountability - that det ermine the effectiveness of an agency's interactions with local communities. Es sentially, a public participation program may be deemed effective to the extent that it provides for open disclosure and addresses all four acceptability dimens ions in ways that are appropriate and effective for a particular community and s ituation. This framework provides a guide for agencies to 1) set objectives, 2) design public participation and oversight programs, and 3) set criteria for eva luating program effectiveness. In the current study, where the framework is use d as a means of assessing program effectiveness, the focus is on stakeholders' p erspectives of public participation: on the nature of DOE-EM's public disclosure and the four interrelated dimensions of DOE-EM's interactions with its neighbor ing communities« less

The effectiveness of state-level tobacco control interventions: a review of program implementation and behavioral outcomes.

PubMed

Siegel, Michael

2002-01-01

In 2001, nearly one billion dollars will be spent on statewide tobacco control programs, including those in California, Massachusetts, Arizona, and Oregon, funded by cigarette tax revenues, and the program in Florida, funded by the state's settlement with the tobacco industry. With such large expenditures, it is imperative to find out whether these programs are working. This paper reviews the effectiveness of the statewide tobacco control programs in California, Massachusetts, Arizona, Oregon, and Florida. It focuses on two aspects of process evaluation--the funding and implementation of the programs and the tobacco industry's response, and four elements of outcome evaluation--the programs' effects on cigarette consumption, adult and youth smoking prevalence, and protection of the public from secondhand smoke. The paper formulates general lessons learned from these existing programs and generates recommendations to improve and inform the development and implementation of these and future programs.

Evaluating Training by Four Economic Indices.

ERIC Educational Resources Information Center

Rosentreter, Gary

1979-01-01

This study was intended to demonstrate the effectiveness of four selected economic indicators as criteria for evaluation of a manufacturing firm's management training program in communication skills. Though the results indicated that the program effected change only in employee turnover, the study supports the measurement of training by economic…

Evaluation and Validation: A Look at the Program Effectiveness Panel.

ERIC Educational Resources Information Center

Cook, Nancy R.; And Others

The work of the Program Effectiveness Panel (PEP) of the United States Department of Education was examined. The PEP is the Department of Education's primary means of certifying or validating the effectiveness of educational programs. Thirty-three educational programs were validated by the PEP between January 1988 and December 1990. Over time,…

Maximizing Student Learning: The Effects of a Comprehensive School-Based Program for Preventing Problem Behaviors.

ERIC Educational Resources Information Center

Nelson, J. Ron; Martella, Ronald M.; Marchand-Martella, Nancy

2002-01-01

A study evaluated a comprehensive school-wide program based on an effective behavioral support approach for preventing disruptive behaviors implemented in seven elementary schools. The program included a school-wide discipline program, tutoring, conflict resolution, and functional behavioral intervention plans. Schools showed positive effects on…

Implementing an Evidence-Based Fall Prevention Intervention in Community Senior Centers.

PubMed

Li, Fuzhong; Harmer, Peter; Fitzgerald, Kathleen

2016-11-01

To evaluate the impact of implementing an evidence-based fall prevention intervention in community senior centers. We used a single-group design to evaluate the Tai Ji Quan: Moving for Better Balance (TJQMBB) program's adoption, population reach, implementation, effectiveness, and maintenance among 36 senior centers in 4 Oregon counties between 2012 and 2016. The primary outcome measure, as part of the effectiveness evaluation, was number of falls as ascertained by self-report. Trained TJQMBB instructors delivered the program to community-dwelling older adults for 48 weeks, with a 6-month postintervention follow-up. TJQMBB was adopted by 89% of the senior centers approached and reached 90% of the target population. The program resulted in a 49% reduction in the total number of falls and improved physical performance. Participation was well maintained after the program's completion. The average cost-effectiveness ratio for the 48-week program implementation was $917 per fall prevented and $676 per fall prevented for multiple falls. TJQMBB is an effective public health program that can be broadly implemented in community senior centers for primary prevention of falls among community-dwelling older adults.

A Review of Elementary School-Based Substance Use Prevention Programs: Identifying Program Attributes

ERIC Educational Resources Information Center

Hopfer, S.; Davis, D.; Kam, J. A.; Shin, Y.; Elek, E.; Hecht, M. L.

2010-01-01

This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary…

Evaluation of the Olweus Bullying Prevention Program in Nine Urban Schools: Effective Practices and next Steps

ERIC Educational Resources Information Center

Black, Sally; Washington, Ericka

2008-01-01

The Olweus Bullying Prevention Program (BPP) is an internationally recognized school-based bullying prevention program. This project sought to evaluate pilot implementation of the program in one urban district using fidelity of implementation, bullying incident density (BID), student surveys, and serious incident reports as process and outcome…

Evaluation of the DUI Court Program in Maricopa County, Arizona

DOT National Transportation Integrated Search

2011-07-01

This is the final report of a project that evaluated the effectiveness of a DUI court program : aimed at reducing felony DUI offenders subsequent alcohol-related traffic violations. The : evaluation involved a descriptive and quantitative analysis...

Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

PubMed

Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

2015-01-01

Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

40 CFR 610.10 - Program purpose.

Code of Federal Regulations, 2013 CFR

2013-07-01

... DEVICES Test Procedures and Evaluation Criteria General Provisions § 610.10 Program purpose. (a) The... standardized procedures, the performance of various retrofit devices applicable to automobiles for which fuel... statistical analysis of data from vehicle tests, the evaluation program will determine the effects on fuel...

40 CFR 610.10 - Program purpose.

Code of Federal Regulations, 2014 CFR

2014-07-01

... DEVICES Test Procedures and Evaluation Criteria General Provisions § 610.10 Program purpose. (a) The... standardized procedures, the performance of various retrofit devices applicable to automobiles for which fuel... statistical analysis of data from vehicle tests, the evaluation program will determine the effects on fuel...

40 CFR 610.10 - Program purpose.

Code of Federal Regulations, 2011 CFR

2011-07-01

... DEVICES Test Procedures and Evaluation Criteria General Provisions § 610.10 Program purpose. (a) The... standardized procedures, the performance of various retrofit devices applicable to automobiles for which fuel... statistical analysis of data from vehicle tests, the evaluation program will determine the effects on fuel...

40 CFR 610.10 - Program purpose.

Code of Federal Regulations, 2012 CFR

2012-07-01

... DEVICES Test Procedures and Evaluation Criteria General Provisions § 610.10 Program purpose. (a) The... standardized procedures, the performance of various retrofit devices applicable to automobiles for which fuel... statistical analysis of data from vehicle tests, the evaluation program will determine the effects on fuel...

Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-12-31

The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

Workplace Literacy: From Survival to Empowerment and Human Development.

ERIC Educational Resources Information Center

Rhoder, Carol A.; French, Joyce N.

1994-01-01

Describes an effective literacy program in two hospitals, which benefited both the employer and employee by empowering participants to solve problems, think critically and creatively, and make decisions. Discusses criteria for effective workplace literacy programs, the program's framework, and program evaluation. (RS)

The Teachers of Quality Academy: Evaluation of the Effectiveness and Impact of a Health Systems Science Training Program.

PubMed

Walsh, Danielle S; Lazorick, Suzanne; Lawson, Luan; Lake, Donna; Garrison, Herbert G; Higginson, Jason; Vos, Paul; Baxley, Elizabeth

2018-05-01

This project aimed to evaluate the effectiveness of a faculty development program in health systems science (HSS)-the Teachers of Quality Academy (TQA). Participants in TQA and a comparison group were evaluated before, during, and 1 year after the program using self-perception questionnaires, tests of HSS knowledge, and tracking of academic productivity and career advancement. Among program completers (n = 27), the mean self-assessed ratings of knowledge and skills of HSS topics immediately after the program, as compared to baseline, increased significantly compared to controls (n = 30). Participants demonstrated progressive improvement of self-perceived skills and attitudes, and retention of HSS knowledge, from baseline to completion of the program. Participants also demonstrated substantially higher HSS scholarly productivity, leadership, and career advancement compared to the comparison group. The TQA effectively created a faculty cadre able to role model, teach, and create a curriculum in HSS competencies for medical students, resident physicians, and other health professionals.

Evaluating disease management program effectiveness: an introduction to survival analysis.

PubMed

Linden, Ariel; Adams, John L; Roberts, Nancy

2004-01-01

Currently, the most widely used method in the disease management industry for evaluating program effectiveness is the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer plausible rationale explaining the change from baseline. Survival analysis allows for the inclusion of data from censored cases, those subjects who either "survived" the program without experiencing the event (e.g., achievement of target clinical levels, hospitalization) or left the program prematurely, due to disenrollement from the health plan or program, or were lost to follow-up. Additionally, independent variables may be included in the model to help explain the variability in the outcome measure. In order to maximize the potential of this statistical method, validity of the model and research design must be assured. This paper reviews survival analysis as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

The Effectiveness of Adapted Versions of an Evidence-based Prevention Program in Reducing Alcohol Use among Alternative School Students

PubMed Central

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youth, there is a need to facilitate the implementation and evaluation of these programs in real world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin’ it REAL (kiR), with alternative school students. Programs are often adapted when used in schools and other community settings for a variety of reasons. The kiR adaptations, developed during an earlier phase of this study, were created to make the curriculum more appropriate for alternative high school youth. The adaptations were evaluated using a quasi-experimental design in which questionnaires were administered at pretest, posttest, and follow-up, and focus groups were conducted at posttest. MANOVA analyses indicate significantly reduced intentions to accept alcohol and, for younger participants, reduced alcohol use. Focus group data support the need for age appropriate prevention content. The authors discuss implications for practitioners implementing prevention programs in schools. PMID:20622971

Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

ERIC Educational Resources Information Center

Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

2014-01-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Economic evaluation of drug abuse treatment and HIV prevention programs in pregnant women: a systematic review.

PubMed

Ruger, Jennifer Prah; Lazar, Christina M

2012-01-01

Drug abuse and transmission of HIV during pregnancy are public health problems that adversely affect pregnant women, their children and surrounding communities. Programs that address this vulnerable population have the ability to be cost-effective due to resulting cost savings for mother, child and society. Economic evaluations of programs that address these issues are an important tool to better understand the costs of services and create sustainable healthcare systems. This study critically examined economic evaluations of drug abuse treatment and HIV prevention programs in pregnant women. A systematic review was conducted using the criteria recommended by the Panel on Cost-Effectiveness in Health and Medicine and the British Medical Journal (BMJ) checklist for economic evaluations. The search identified 6 economic studies assessing drug abuse treatment for pregnant women, and 12 economic studies assessing programs that focus on prevention of mother-to-child transmission (PMTCT) of HIV. Results show that many programs for drug abuse treatment and PMTCT among pregnant women are cost-effective or even cost-saving. This study identified several shortcomings in methodology and lack of standardization of current economic evaluations. Efforts to address methodological challenges will help make future studies more comparable and have more influence on policy makers, clinicians and the public. Copyright © 2011 Elsevier Ltd. All rights reserved.

[Evaluation of a program to promote network building between disciplinary agencies and informal community organizations: trial in a community comprehensive support center].

PubMed

Murayama, Hiroshi; Kojima, Tomoko; Tomaru, Meiko; Narabu, Harumi; Tachibana, Reiko; Yamaguchi, Takuhiro; Murashima, Sachiyo

2010-10-01

To examine the effectiveness of a program promoting network building between disciplinary agencies and informal community organizations (IGOs) comprising community residents, by implemention with staff of a community comprehensive support center (CJCSG). The program was implemented for nine staff of a GGSG in Setagaya Ward, Tokyo for a year. For process evaluation, items were assessed concerning the contents of the program such as satisfaction and understandability, participants' goal attainment level at each period of the program, and program satisfaction as a whole. Outcome evaluation included measurement of participants' self-efficacy regarding network building with ICOs before and after the program, using interviews of the members who completed the program. Eight out of the nine participants completed the program. All positively evaluated the contents of the program and their own goal attainment at each period of the program. After its completion, they felt highly satisfied. Moreover, there was an improvement in the cognition of the participants, including self-efficacy on network building with IGOs and the atmosphere in the GGSG with regard to network building. The efficacy of this program could be confirmed as demonstrated by the staff of the CCSC, although a more detailed assessment of validity and effectiveness will be necessary in the future.

Outcomes and lessons learned from evaluating TRICARE's disease management programs.

PubMed

Dall, Timothy M; Askarinam Wagner, Rachel C; Zhang, Yiduo; Yang, Wenya; Arday, David R; Gantt, Cynthia J

2010-06-01

To share outcomes and lessons learned from an evaluation of disease management (DM) programs for asthma, congestive heart failure (CHF), and diabetes for TRICARE patients. Multiyear evaluation of participants in voluntary, opt-out DM programs. Patient-centered programs, administered by 3 regional contractors, provide phone-based consultations with a care manager, educational materials, and newsletters. The study sample consisted of 23,793 asthma, 4092 CHF, and 29,604 diabetes patients with at least 6 months' tenure in the program. Medical claims were analyzed to quantify program effect on healthcare utilization, medical costs, and clinical outcomes. Multivariate regression analysis with an historical control group was used to predict patient outcomes in the absence of DM. The difference between actual and predicted DM patient outcomes was attributed to the program. A patient survey collected data on program satisfaction and perceived usefulness of program information and services. Modest improvements in patient outcomes included reduced inpatient days and medical costs, and (with few exceptions) increased percentages of patients receiving appropriate medications and tests. Annual per patient reductions in medical costs were $453, $371, and $783 for asthma, CHF, and diabetes program participants, respectively. The estimated return on investment was $1.26 per $1.00 spent on DM services. Findings suggest that the DM programs more than pay for themselves, in addition to improving patient health and quality of life. Lessons learned in program design, implementation, effectiveness, and evaluation may benefit employers contemplating DM, DM providers, and evaluators of DM programs.

Evaluating Student Perceptions of Course Delivery Platforms

ERIC Educational Resources Information Center

Bramorski, Tom; Madan, Manu S.

2016-01-01

In this paper we evaluate effectiveness of course delivery mode on three dimensions: values, networking opportunities and learning. While students and their future employers are two important customers for the business program, we focus on the perception of students regarding the effectiveness of course delivery mode on program performance. The…

Assessment of Effectiveness in Preprimary and School Social Work Programs.

ERIC Educational Resources Information Center

Radin, Norma

A model for evaluating effectiveness in preschool and school social work programs is proposed. The paradigm has two major dimensions: criteria for evaluating success, and modalities for assessing whether the criteria have been met. Three criteria are suggested including improved views of significant others, and seven modalities including test…

Evaluating the Effectiveness of Student Assistance Programs in Pennsylvania.

ERIC Educational Resources Information Center

Fertman, Carl I.; Fichter, Cele; Schlesinger, Jo; Tarasevich, Susan; Wald, Holly; Zhang, Xiaoyan

2001-01-01

This evaluation of the Pennsylvania Student Assistance Program (SAP) was conducted to determine overall efficacy of SAPs and, more specifically, how SAP is currently implemented. Findings indicate that SAP is being implemented as designed. Recommended is the development of benchmarks and indicators focusing on best SAP practices and effectiveness.…

How Methodological Features Affect Effect Sizes in Education

ERIC Educational Resources Information Center

Cheung, Alan C. K.; Slavin, Robert E.

2016-01-01

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

A potential role of anti-poverty programs in health promotion

PubMed Central

Silverman, Kenneth; Holtyn, August F.; Jarvis, Brantley

2016-01-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. PMID:27235603

A potential role of anti-poverty programs in health promotion.

PubMed

Silverman, Kenneth; Holtyn, August F; Jarvis, Brantley P

2016-11-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. Copyright © 2016 Elsevier Inc. All rights reserved.

[Development and short-term effects of a standardized patient education program for in-patient cardiologic rehabilitation].

PubMed

Seekatz, B; Haug, G; Mosler, G; Schwaab, B; Altstidl, R; Worringen, U; Faller, H; Meng, K

2013-10-01

Patient education is an essential part in the treatment of coronary heart disease in medical rehabilitation. In the German-speaking area, no standardized and evaluated patient education program for coronary heart disease is available so far. In this paper, we demonstrate the development of a quality assured patient education program based on a health-education program of the German statutory pension insurance scheme. In a multi-level approach, an existing program was modified concerning treatment evidence, practical guidelines, theories of health and illness behavior and quality criteria for patient education as well as clinical experience and thereafter manualized. In a formative evaluation, feasibility and patient acceptance of this modified program were assessed using evaluation questionnaires of patients and trainers. Afterwards, effects of the patient education program as compared to a traditional education program were assessed on a short-term (at discharge), medium-term (6-month follow-up) and long-term (12-month follow-up) basis in a multicenter quasi-experimental control group study of patients with coronary heart disease (n=434). Results of the formative evaluation demonstrate an overall good acceptance and a good feasibility of the manualized program. Short-term results show a significant small treatment effect in the primary outcome variable patients' knowledge (p=0.001, η2 =0.028). Furthermore, small effects were also observed among some secondary outcomes, such as attitude towards medication, planning of physical activity, psychological quality of life and satisfaction with the education program. A standardized education program for patients with coronary heart disease has been developed in a systematic process based on established quality standards. Depending on the outstanding medium and long-term effects, the program may be recommended for general use in medical rehabilitation. The manual provides the prerequisites allowing for a successful transfer into clinical practice. © Georg Thieme Verlag KG Stuttgart · New York.

Historical context for the creation of the Office of Adolescent Health and the Teen Pregnancy Prevention Program.

PubMed

Kappeler, Evelyn M; Farb, Amy Feldman

2014-03-01

In Fiscal Year 2010, Federal funds were dedicated to support evidence-based approaches to effectively target teen pregnancy prevention and resulted in the establishment of the Office of Adolescent Health (OAH) and the Teen Pregnancy Prevention (TPP) Program. Through the tiered TPP Program, OAH supports replication and evaluation of programs using models whose effectiveness has been demonstrated through rigorous evaluation and the development and testing of promising or innovative pregnancy prevention strategies and approaches. This article documents the creation of OAH and the development of the TPP Program, the identification of a TPP evidence base, current program and evaluation efforts at OAH, and government coordination and partnerships related to reducing teen pregnancy. This article is of interest to those working to improve the health and wellbeing of adolescents. Published by Elsevier Inc.

The effectiveness of workshops on management evaluation of traffic safety programs.

DOT National Transportation Integrated Search

1977-01-01

Nine management evaluation workshops based on The Evaluation of Highway Traffic Safety Programs' A Manual for Managers were held in various cities throughout the United States by the Office of Manpower Development (NHTSA). The analysis reported here ...

15 CFR 2301.17 - Evaluation criteria for construction and planning applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... PUBLIC TELECOMMUNICATIONS FACILITIES PROGRAM Evaluation and Selection Process § 2301.17 Evaluation... significant diversity in the ownership of, operation of, and participation in public telecommunications... attitudes of diverse listeners by promoting the development of more effective programming strategies...

40 CFR 51.366 - Data analysis and reporting.

Code of Federal Regulations, 2010 CFR

2010-07-01

... monitoring and evaluation of the program by program management and EPA, and shall provide information... and effectiveness evaluations of the enforcement mechanism, the quality assurance system, the quality... vehicles receiving a mass emissions test. (b) Quality assurance report. The program shall submit to EPA by...

Bystander intervention and litter control: Evaluation of an appeal-to-help program.

Treesearch

Harriet H. Christensen

1981-01-01

Managers of public recreation areas are concerned about increases in vandalism and disregard for regulations and the rights of others by some users. Other than the litter incentive program, none of the approaches for reducing violations have been evaluated or proved effective. The present study evaluated a program to increase involvement of campers in the management of...

Evaluation of a Commercially Available Program and in Situ Training by Parents to Teach Abduction-Prevention Skills to Children

ERIC Educational Resources Information Center

Beck, Kimberly V.; Miltenberger, Raymond G.

2009-01-01

Child abduction is a serious problem; therefore, it is essential that researchers evaluate the efficacy of commercially available abduction-prevention programs. A multiple baseline design across participants (ages 6 to 8 years) was used to evaluate the effects of a training program, The Safe Side. Experimenters assessed safety responses in situ in…

State “Technical Assistance Programs” for nursing home quality improvement: variations and potential implications

PubMed Central

Li, Yue; Spector, Williams D.; Glance, Laurent G.; Mukamel, Dana B.

2013-01-01

Context To improve nursing home quality, many states developed “Technical Assistance Programs” that provide on-site consultation and training for nursing facility staff. Methods We conducted a national survey on these state programs to collect data on program design, operations, financing, and perceived effectiveness. Results As of 2010, 17 states have developed such programs. Compared to existing state nursing home quality regulations, these programs represent a collaborative, rather than enforcement-oriented, approach to quality. However, existing programs vary substantially in key structural features such as staffing patterns, funding levels, and relationship with state survey and certification agencies. Perceived effectiveness by program officials on quality was high, although few states have performed formal evaluations. Perceived barriers to program effectiveness included lack of appropriate staff and funding, among others. Conclusion State “Technical Assistance Programs” for nursing homes varies in program design and perceived effectiveness. Future comparative evaluations are needed to inform evidence-based quality initiatives. PMID:23216345

Review and Evaluation of Current Training Programs Found in Various Mining Environments. Final Report. Volume I, Summary.

ERIC Educational Resources Information Center

Adkins, John; And Others

A project was designed to produce a broad description of current mining training programs and to evaluate their effectiveness with respect to reducing mine injuries. The research strategy was built on the ranking of mines according to the effectiveness of their training with an effective training effort being defined as that training which is…

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

A review of the evaluation of 47 drug abuse prevention curricula available nationally.

PubMed

Dusenbury, L; Falco, M; Lake, A

1997-04-01

This review determined how many drug prevention curricula available to schools have been shown in rigorous research studies to reduce substance use behavior. Forty-seven curricula which met the following criteria were included: 1) they focused on primary prevention of alcohol and/or drug use, 2) they were classroom-based curricula designed for any grade level P-12, 3) they were nationally and currently available, and 4) program distributors were willing to provide samples of curriculum materials to determine drug abuse prevention content. Of the 47 drug abuse prevention curricula identified, 10 (21%) had been subjected to sufficiently rigorous evaluations. At least eight of the 10 programs have been shown effective at reducing tobacco or drug use, in at least some studies. The remaining two programs did not appear to have sustained effects on drug use, although they had variable success at reducing substance use early on. One of the 10 programs has been shown to have positive effects lasting into young adulthood. Six of the 10 curricula have been shown to have effects lasting for at least two years after the pretest. Two curricula have not been evaluated beyond the post-test, so it is impossible to know whether their effectiveness will last. Recommendations to increase the number of programs rigorously evaluated are offered.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

An Evaluation of the AirCare Program Based on Cost-Benefit and Cost-Effectiveness Analyses

ERIC Educational Resources Information Center

Bi, Hsiaotao T.; Wang, Dianle

2006-01-01

A cost-benefit analysis of the AirCare program in the province of British Columbia on the basis of emissions cost factors from the literature showed a benefit outweighing the cost. Furthermore, a cost-effectiveness analysis comparing the AirCare program with a hybrid-car rebate program revealed that the AirCare program is more effective in…

Meditation programs for veterans with posttraumatic stress disorder: Aggregate findings from a multi-site evaluation.

PubMed

Heffner, Kathi L; Crean, Hugh F; Kemp, Jan E

2016-05-01

Interest in meditation to manage posttraumatic stress disorder (PTSD) symptoms is increasing. Few studies have examined the effectiveness of meditation programs offered to Veterans within Department of Veterans Affairs (VA) mental health services. The current study addresses this gap using data from a multisite VA demonstration project. Evaluation data collected at 6 VA sites (N = 391 Veterans) before and after a meditation program, and a treatment-as-usual (TAU) program, were examined here using random effects meta-analyses. Site-specific and aggregate between group effect sizes comparing meditation programs to TAU were determined for PTSD severity measured by clinical interview and self-report. Additional outcomes included experiential avoidance and mindfulness. In aggregate, analyses showed medium effect sizes for meditation programs compared to TAU for PTSD severity (clinical interview: effect size (ES) = -0.32; self-report: ES = -0.39). Similarly sized effects of meditation programs were found for overall mindfulness (ES = 0.41) and 1 specific aspect of mindfulness, nonreactivity to inner experience (ES = .37). Additional findings suggested meditation type and program completion differences each moderated program effects. VA-sponsored meditation programs show promise for reducing PTSD severity in Veterans receiving mental health services. Where meditation training fits within mental health services, and for whom programs will be of interest and effective, require further clarification. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

The Backpack Food Program's Effects on U.S. Elementary Students' Hunger and On-Task Behavior

ERIC Educational Resources Information Center

Ecker, Meghan E.; Sifers, Sarah K.

2013-01-01

Purpose/Objectives: The purpose of this study was to evaluate the BackPack Food Program's effectiveness in combating students' hunger over the weekends and school breaks, as well as analyze the program's effects on students' on-task behavior in the classroom. Additionally, this study examined program satisfaction from students, parents, and…

Audience Duplication in the Video Age: Changes in Prime Time Inheritance Effects between 1976 and 1985.

ERIC Educational Resources Information Center

Walker, James R.

Evaluating the impact of the changing media environment on television programming, a study examined inheritance effects--the percentage of one television program's audience that also watches the program immediately following--in network prime time programming between 1976 and 1985. Inheritance effect was calculated as the correlation between a…

Evaluating Effectiveness of Pair Programming as a Teaching Tool in Programming Courses

ERIC Educational Resources Information Center

Faja, Silvana

2014-01-01

This study investigates the effectiveness of pair programming on student learning and satisfaction in introductory programming courses. Pair programming, used in the industry as a practice of an agile development method, can be adopted in classroom settings to encourage peer learning, increase students' social skills, and enhance student…

Evaluating the "Reasoning and Rehabilitation" Program for Young Offenders

ERIC Educational Resources Information Center

Mitchell, Jonathan; Palmer, Emma J.

2004-01-01

The effectiveness of the Reasoning and Rehabilitation (R and R) program with juvenile offenders in an English prison was evaluated using reconviction and reimprisonment at eighteen months post-release as outcomes. A group of offenders who completed the program (n = 31) were compared with a group of offenders who did not receive the program (n =…

Training the Poor. A Benefit-Cost Analysis of Manpower Programs in the U.S. Antipoverty Program.

ERIC Educational Resources Information Center

Sewell, D. O.

This report critically reviews past benefit-cost studies of manpower programs and offers an alternative methodology for program evaluation. Because of selective admission criteria and a tendency to attribute all income changes to training, previous studies have had an upward bias in measuring the effectiveness of training. This study evaluates a…

An Evaluative Case Study of Nine Virtual High School Programs

ERIC Educational Resources Information Center

Bannister, Clara M.

2009-01-01

The purpose of this study was to conduct a program evaluation of nine virtual high school programs in the states of Alabama, California, Florida, Idaho, Colorado, Illinois, Michigan, North Carolina and Massachusetts. In order to assess the quality and effectiveness of the virtual high school programs in the study in terms of overall quality and…

Improving Mathematics Teacher Education in Germany: Empirical Results from a Longitudinal Evaluation of Innovative Programs

ERIC Educational Resources Information Center

Buchholtz, Nils; Kaiser, Gabriele

2013-01-01

Innovative programs for restructuring the entry phase of mathematics teacher education programs have been implemented at various German universities within the last few years. This article reports about the design and the results of a longitudinal evaluation study of the effectiveness of two of these programs aiming to improve mathematics teacher…

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

Meta-analysis of the effectiveness of school substance abuse prevention programs in Spain.

PubMed

Espada, José P; Gonzálvez, María T; Orgilés, Mireia; Lloret, Daniel; Guillén-Riquelme, Alejandro

2015-01-01

There has been an increase in adolescent substance use that has led to the development and implementation of prevention programs. New evidence is needed in order to improve them and optimize the resources. The aim of this paper is to use a meta-analysis to analyze the effectiveness of school drug prevention programs in Spain. Twenty-one studies that evaluated drug abuse prevention programs in schools, were published between 2002 and 2013, and that met the selection criteria were identified. Preventive program effectiveness was low ( d = 0.16), although it was higher at the follow-up ( d = 0.30). The programs were most effective in changing attitudes ( d = 0.44) towards drugs. The models of health education ( d = 0.48) and social learning ( d = 0.20) were also very effective, especially in combination with oral, written, and audiovisual support material ( d = 0.21) and the implementation of joint programs by health education professionals and faculty members ( d = 0.25). Is possible to determine the need for more rigorous evaluations of interventions to establish useful programs.

Evaluation of an online continuing education program from the perspective of new graduate nurses.

PubMed

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

75 FR 2511 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-15

.... Title and OMB Number: An Outcome Evaluation of the SOS Suicide Prevention Program; OMB Control Number... information collection requirement is necessary to evaluate the effectiveness of the SOS Suicide Prevention Program which is used as suicide prevention programming in middle and high schools throughout the country...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

ERIC Educational Resources Information Center

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Administration 101: Evaluation of a Professional Development Program.

ERIC Educational Resources Information Center

Chiriboga, Cristina

2003-01-01

Evaluates a community college leadership development program provided by the Association of California Community College Administrators (ACCCA). A total of 129 participants answered questionnaires regarding the effectiveness of the program. Responses were then coded and analyzed in terms of apparent patterns or themes. Outlines some benefits of…

A Research Program on the Potential for Effects of Engineered Nanomaterials on Biological Systems

EPA Science Inventory

The US Environmental Protection Agency (EPA), Office of Research and Development, has developed a research program to evaluate the potential implications of engineered nanomaterials for human health and the environment. Among the major themes of the program are evaluating the in...

Teaching-skills training programs for family medicine residents: systematic review of formats, content, and effects of existing programs.

PubMed

Lacasse, Miriam; Ratnapalan, Savithiri

2009-09-01

To review the literature on teaching-skills training programs for family medicine residents and to identify formats and content of these programs and their effects. Ovid MEDLINE (1950 to mid-July 2008) and the Education Resources Information Center database (pre-1966 to mid-July 2008) were searched using and combining the MeSH terms teaching, internship and residency, and family practice; and teaching, graduate medical education, and family practice. The initial MEDLINE and Education Resources Information Center database searches identified 362 and 33 references, respectively. Titles and abstracts were reviewed and studies were included if they described the format or content of a teaching-skills program or if they were primary studies of the effects of a teaching-skills program for family medicine residents or family medicine and other specialty trainees. The bibliographies of those articles were reviewed for unidentified studies. A total of 8 articles were identified for systematic review. Selection was limited to articles published in English. Teaching-skills training programs for family medicine residents vary from half-day curricula to a few months of training. Their content includes leadership skills, effective clinical teaching skills, technical teaching skills, as well as feedback and evaluation skills. Evaluations mainly assessed the programs' effects on teaching behaviour, which was generally found to improve following participation in the programs. Evaluations of learner reactions and learning outcomes also suggested that the programs have positive effects. Family medicine residency training programs differ from all other residency training programs in their shorter duration, usually 2 years, and the broader scope of learning within those 2 years. Few studies on teaching-skills training, however, were designed specifically for family medicine residents. Further studies assessing the effects of teaching-skills training in family medicine residents are needed to stimulate development of adapted programs for the discipline. Future research should also assess how residents' teaching-skills training can affect their learners' clinical training and eventually patient care.

Cutter Resource Effectiveness Evaluation (CREE) Program : A Guide for Users and Analysts

DOT National Transportation Integrated Search

1978-03-01

The Cutter Resource Effectiveness Evaluation (CREE) project has developed a sophisticated, user-oriented computer model which can evaluate the effectiveness of any existing Coast Guard craft, or the effectiveness of any of a number of proposed altern...

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

Usability evaluation of user interface of thesis title review system

NASA Astrophysics Data System (ADS)

Tri, Y.; Erna, A.; Gellysa, U.

2018-03-01

Presentation of programs with user interface that can be accessed online through the website of course greatly provide user benefits. User can easily access the program they need. There are usability values that serve as a benchmark for the success of a user accessible program, ie efficiency, effectiveness, and convenience. These usability values also determine the development of the program for the better use. Therefore, on the review title thesis program that will be implemented in STT Dumai was measured usability evaluation. It aims to see which sides are not yet perfect and need to be improved to improve the performance and utilization of the program. Usability evaluation was measured by using smartPLS software. Database used was the result of respondent questionnaires that include questions about the experience when they used program. The result of a review of thesis title program implemented in STT Dumai has an efficiency value of 22.615, the effectiveness of 20.612, and satisfaction of 33.177.

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

PubMed

Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

2017-02-01

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Testing Mediators of Intervention Effects in Randomized Controlled Trials: An Evaluation of Three Depression Prevention Programs

ERIC Educational Resources Information Center

Stice, Eric; Rohde, Paul; Seeley, John R.; Gau, Jeff M.

2010-01-01

Objective: Evaluate a new 5-step method for testing mediators hypothesized to account for the effects of depression prevention programs. Method: In this indicated prevention trial, at-risk teens with elevated depressive symptoms were randomized to a group cognitive-behavioral (CB) intervention, group supportive expressive intervention, CB…

Instructional Leadership: Using a Research Approach to Evaluate the Impact of a Reading Intervention Program

ERIC Educational Resources Information Center

O'Hare, John M.

2012-01-01

Though campus principals must take on many leadership roles, their primary responsibility is to facilitate effective teaching and learning with the overall mission of enhancing student achievement. One way to provide instructional leadership is to evaluate and select effective instructional programs that align with campus goals of improving…

Effective Practices in Community Based Family Literacy: Results of a National Research and Evaluation Project.

ERIC Educational Resources Information Center

Association for Community Based Education, Washington, DC.

A field evaluation of 14 community-based family and intergenerational literacy programs identified the most effective strategies, structures, and approaches to reach and teach the "hardest to reach." Information was collected through 90-minute telephone surveys with program coordinators and/or executive directors. Although different in structural…

The Effects of the Preschool Inclusion Program on Teacher Outcomes in Turkey

ERIC Educational Resources Information Center

Sucuoglu, Nimet Bülbin; Bakkaloglu, Hatice; Akalin, Selma; Demir, Seyda; Iscen-Karasu, Fadime

2015-01-01

The aim of this study was to evaluate the effects of a teacher training program on teacher outcomes. The teachers' knowledge and attitudes regarding inclusion, classroom management strategies, and their relationships with children both with and without disabilities were evaluated using self-report instruments. In addition, their classroom…

Evaluating the Effectiveness of READ 180: A Reading Program for Struggling Middle School Students

ERIC Educational Resources Information Center

Johnson, Latonya R.

2011-01-01

This study was conducted using a qualitative approach to evaluate the effectiveness of READ 180 Program in improving students reading interests and achievement at West Bolivar Middle School (WBMS). A number of interviews and observations were conducted. Two teachers and nine students were interviewed, and nine classroom observations were…

Effects of a dolphin interaction program on children with autism spectrum disorders – an exploratory research

PubMed Central

2012-01-01

Background Interaction programs involving dolphins and patients with various pathologies or developmental disorders (e.g., cerebral palsy, intellectual impairment, autism, atopic dermatitis, post-traumatic stress disorder, depression) have stimulated interest in their beneficial effects and therapeutic potential. However, the true effects observed in different clinical and psycho-educational setups are still controversial. Results An evaluation protocol consisting of the Childhood Autism Rating Scale (CARS), Psychoeducational Profile-Revised (PEP-R), Autism Treatment Evaluation Checklist (ATEC), Theory of Mind Tasks (ToM Tasks) and a custom-made Interaction Evaluation Grid (IEG) to evaluate behavioural complexity during in-pool interactions was applied to 10 children diagnosed with Autism Spectrum Disorders. The ATEC, ToM Tasks and CARS results show no benefits of the dolphin interaction program. Interestingly, the PEP-R suggests some statistically significant effects on ‘Overall development score’, as well as on their ‘Fine motor development’, ‘Cognitive performance’ and ‘Cognitive verbal development’. Also, a significant evolution in behavioural complexity was shown by the IEG. Conclusions This study does not support significant developmental progress resulting from the dolphin interaction program. PMID:22537536

The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation

ERIC Educational Resources Information Center

Brandon, Paul R.; Fukunaga, Landry L.

2014-01-01

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

Students Training for Academic Readiness (STAR): Year Three Evaluation Report

ERIC Educational Resources Information Center

Rainey, Katharine; Sheehan, Daniel; Maloney, Catherine

2010-01-01

This report presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation considers…

A Product Evaluation of the Selective Abandonment Process for School Budgeting

ERIC Educational Resources Information Center

Loofe, Christopher M.

2016-01-01

The purpose of this study is to evaluate the degree to which the Selective Abandonment budget process objectives were achieved by analyzing stakeholder perceptions. Use of this evaluation may enable the district to become more effective, efficient, and more fiscally responsible when developing future program budgeting plans. Program evaluation was…

Evaluating Program Effectiveness or, If the Program is Competency-Based, How Come the Evaluation Is Costing So Much?

ERIC Educational Resources Information Center

Scriven, Michael

The concern with competency-based education is not whether it is any different from the more traditional approaches but whether it is worth the considerable effort it involves. There are several aspects of a competency-based program to be considered in its evaluation. The first is whether or not there is a justifiable need for the specified…

Policy Forum Report: Statewide Evaluation of Programs and Services for Students with Disabilities (Arlington, Virginia, August 30-31, 1994). Final Report. Project FORUM.

ERIC Educational Resources Information Center

National Association of State Directors of Special Education, Alexandria, VA.

This report reviews the outcomes of a forum convened to examine policy and practice issues surrounding the annual evaluation of effectiveness of programs and services for students with disabilities. At the forum, alternative approaches being used by states to implement program evaluation were discussed, along with issues in gathering…

Abstinence-based programs for prevention of adolescent pregnancies. A review.

PubMed

Thomas, M H

2000-01-01

This article assesses the abstinence-based programs developed by family life educators and the factors associated with positive results through a review of abstinence promotion programs of the federal government. In 1996, Section 510 was added to Title V of the Social Security Act allocating US$50 million annually from 1998-2000 to fund abstinence education programs, while in 1997, a National Strategy to Prevent Teen Pregnancy was launched by the Office of Adolescent Pregnancy Prevention to provide teen pregnancy programs to at least 25% of the communities. Presented in this paper is a discussion of the Abstinence Only programs, which focus on the prevention of pregnancy and sexually transmitted disease among adolescents, and the Abstinence Plus programs, which emphasize other prevention methods as well as abstinence. Evaluation of Abstinence Only programs include Success Express, Project Taking Charge, Sex Respect, Teen Aid, Values and Choices and Facts and Feelings. Moreover, programs such as Reducing the Risk, Postponing Sexual Involvement, Project Education Now, and Babies Later were evaluated under the Abstinence Plus programs. Several programs evaluated have shown to have a positive effect on attitudes among adolescents, but are not proven to have a significant effect on sexual behavior. In conclusion, this article encourages exploration of new approaches to address teen pregnancy and the increasing incidence of sexually transmitted diseases among adolescents, while the federal government must utilize the implementation of existing programs with positive effects.

Assessing the Effectiveness of a School-Based Dental Clinic on the Oral Health of Children Who Lack Access to Dental Care: A Program Evaluation

ERIC Educational Resources Information Center

Carpino, Rachel; Walker, Mary P.; Liu, Ying; Simmer-Beck, Melanie

2017-01-01

This program evaluation examines the effectiveness of a school-based dental clinic. A repeated-measures design was used to longitudinally examine secondary data from participants (N = 293). Encounter intensity was developed to normalize data. Multivariate analysis of variance and Kruskal-Wallis test were used to investigate the effect of encounter…

The Solaar HIV Prevention Program for Gay and Bisexual Latino Men: Using Social Marketing to Build Capacity for Service Provision and Evaluation

ERIC Educational Resources Information Center

Conner, Ross F.; Takahashi, Lois; Ortiz, Eloy; Archuleta, Eduardo; Muniz, Juan; Rodriguez, Julio

2005-01-01

Community-researcher partnerships can be powerful mechanisms to understand and effectively address health and social problems such as HIV/AIDS prevention. When the partnership is a positive, productive one, the combined expertise and energy of both parties result in a more effective program and a better evaluation of its effects. This article…

Unpacking the "Black Box" of Social Programs and Policies: Introduction

ERIC Educational Resources Information Center

Solmeyer, Anna R.; Constance, Nicole

2015-01-01

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

New approach in the evaluation of a fitness program at a worksite.

PubMed

Shirasaya, K; Miyakawa, M; Yoshida, K; Tanaka, C; Shimada, N; Kondo, T

1999-03-01

The most common methods for the economic evaluation of a fitness program at a worksite are cost-effectiveness, cost-benefit, and cost-utility analyses. In this study, we applied a basic microeconomic theory, "neoclassical firm's problems," as the new approach for it. The optimal number of physical-exercise classes that constitute the core of the fitness program are determined using the cubic health production function. The optimal number is defined as the number that maximizes the profit of the program. The optimal number corresponding to any willingness-to-pay amount of the participants for the effectiveness of the program is presented using a graph. For example, if the willingness-to-pay is $800, the optimal number of classes is 23. Our method can be applied to the evaluation of any health care program if the health production function can be estimated.

Using a Mixed-Methods RE-AIM Framework to Evaluate Community Health Programs for Older Latinas.

PubMed

Schwingel, Andiara; Gálvez, Patricia; Linares, Deborah; Sebastião, Emerson

2017-06-01

This study used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate a promotora-led community health program designed for Latinas ages 50 and older that sought to improve physical activity, nutrition, and stress management. A mixed-methods evaluation approach was administered at participant and organizational levels with a focus on the efficacy, adoption, implementation, and maintenance components of the RE-AIM theoretical model. The program was shown to be effective at improving participants' eating behaviors, increasing their physical activity levels, and lowering their depressive symptoms. Promotoras felt motivated and sufficiently prepared to deliver the program. Some implementation challenges were reported. More child care opportunities and an increased focus on mental well-being were suggested. The promotora delivery model has promise for program sustainability with both promotoras and participants alike expressing interest in leading future programs.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

PubMed

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

The Effectiveness of Parenting Programs: A Review of Campbell Reviews

ERIC Educational Resources Information Center

Barlow, Jane; Coren, Esther

2018-01-01

Parenting practices predict important outcomes for children, and parenting programs are potentially effective means of supporting parents to promote optimal outcomes for children. This review summarizes findings of systematic reviews of parenting programs published in the Campbell Library. Six reviews evaluated the effectiveness of a range of…

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2013 CFR

2013-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2014 CFR

2014-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2012 CFR

2012-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2011 CFR

2011-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

Outcome Evaluation of the Hands-On Parent Empowerment (HOPE) Program

ERIC Educational Resources Information Center

Leung, Cynthia; Tsang, Sandra; Dean, Suzanne

2011-01-01

This study evaluated the effectiveness of the HOPE program. Participants included 120 Chinese new immigrant parents with preschool children in Hong Kong from 13 preschools which were randomized into intervention group (HOPE) and comparison group (6-session parent education program). Parent participants completed measures on child behavior,…

Local Government Leadership Education: Measuring the Impact of Leadership Skill Development on Public Officials

ERIC Educational Resources Information Center

Davis, Gregory A.; Lucente, Joe

2012-01-01

Many Extension leadership development programs have been evaluated for effectiveness. Little literature exists focusing on the evaluation of leadership development programs involving elected and appointed local officials. This article describes an annual program involving elected and appointed local officials and shares quantitative and…

Improving Mandatory Tutoring: A Mixed-Methods Program Evaluation

ERIC Educational Resources Information Center

Baggett, Brooks

2009-01-01

In recent years, the local school leadership in a suburban southern U.S. high school adopted innovative academic intervention programs to assist underperforming students but did not develop formal methods to evaluate program effectiveness. This gap in the professional practice continued with the inception of mandatory tutoring (MT), an…

A CAI (Computer-Assisted Instruction) Course on Constructing PLANIT lessons: Development, Content, and Evaluation

DTIC Science & Technology

1980-06-01

courseware package on how to program lessons for an automated system. Since PLANIT (Programming Language for Interactive Teaching) is the student/author...assisted instruction (CAI), how to program PLANIT lessons, and to evaluate the effectiveness of the package for select Army users. The resultant courseware

Pre- and Post-Planned Evaluation: Which Is Preferable?

ERIC Educational Resources Information Center

Strasser, Stephen; Deniston, O. Lynn

1978-01-01

Factors involved in pre-planned and post-planned evaluation of program effectiveness are compared: (1) reliability and cost of data; (2) internal and external validity; (3) obtrusiveness and threat; (4) goal displacement and program direction. A model to help program administrators decide which approach is more appropriate is presented. (Author/MH)

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2010 CFR

2010-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...

Connect: An Effective Community-Based Youth Suicide Prevention Program

ERIC Educational Resources Information Center

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

A Nonrandomized Evaluation of a Brief Nurtured Heart Approach Parent Training Program

ERIC Educational Resources Information Center

Brennan, Alison L.; Hektner, Joel M.; Brotherson, Sean E.; Hansen, Tracy M.

2016-01-01

Background: Parent training programs are increasingly being offered to the general public with little formal evaluation of their effects. One such program, the Nurtured Heart Approach to parenting (NHA; Glasser and Easley in "Transforming the difficult child: The Nurtured Heart Approach," Vaughan Printing, Nashville, 2008), contains…

Evaluating a Development Program.

ERIC Educational Resources Information Center

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Health Promotion of Faculty and Staff: The School Nurse's Role

ERIC Educational Resources Information Center

Ryan, Kelly M.

2008-01-01

Health promotion of school faculty and staff is an important part of a coordinated school health program. The lack of evaluation of health promotion programs and inconsistent results highlighting the efficacy and benefits of programs adds to employers' perceptions of inconsistent benefits. More studies evaluating effectiveness and development of…

Independent Evaluation of Middle School-Based Drug Prevention Curricula: A Systematic Review.

PubMed

Flynn, Anna B; Falco, Mathea; Hocini, Sophia

2015-11-01

Lack of robust program evaluation has hindered the effectiveness of school-based drug abuse prevention curricula overall. Independently evaluated randomized controlled trials (RCTs) of universal, middle school-based drug abuse prevention curricula are the most useful indicators of whether such programs are effective or ineffective. To conduct a systematic review identifying independently evaluated RCTs of universal, middle school-based drug abuse prevention curricula; extract data on study quality and substance use outcomes; and assess evidence of program effectiveness. PsycInfo, Educational Resources Information Center, Science Citation Index, Social Science Citation Index, Cumulative Index to Nursing and Allied Health Literature, MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews were searched between January 1, 1984, and March 15, 2015. Search terms included variations of drug, alcohol, tobacco, and marijuana use, as well as school, prevention, and effectiveness. Studies included in the review were RCTs carried out by independent evaluators of universal school-based drug prevention curricula available for dissemination in the United States that reported alcohol, tobacco, marijuana, or other drug use outcomes. Two researchers extracted data on study quality and outcomes independently using a data extraction form and met to resolve disagreements. A total of 5071 publications were reviewed, with 13 articles meeting final inclusion criteria. Of the 13 articles, 6 RCTs of 4 distinct school-based curricula were identified for inclusion. Outcomes were reported for 42 single-drug measures in the independent RCTs, with just 3 presenting statistically significant (P < .05) differences between the intervention group and the control group. One program revealed statistically significant positive effects at final follow-up (Lions-Quest Skills for Adolescence). The results of our review demonstrate the dearth of independent research that appropriately evaluates the effectiveness of universal, middle school-based drug prevention curricula. Independent evaluations show little evidence of effectiveness for widely used programs. New methods may be necessary to approach school-based adolescent drug prevention.

A randomized, single-blind cross-over design evaluating the effectiveness of an individually defined, targeted physical therapy approach in treatment of children with cerebral palsy.

PubMed

Franki, Inge; Van den Broeck, Christine; De Cat, Josse; Tijhuis, Wieke; Molenaers, Guy; Vanderstraeten, Guy; Desloovere, Kaat

2014-10-01

A pilot study to compare the effectiveness of an individual therapy program with the effects of a general physical therapy program. A randomized, single-blind cross-over design. Ten ambulant children with bilateral spastic cerebral palsy, age four to nine years. Participants were randomly assigned into a ten-week individually defined, targeted or a general program, followed by a cross-over. Evaluation was performed using the Gross Motor Function Measure-88 and three-dimensional gait analysis. General outcome parameters were Gross Motor Function Measure-88 scores, time and distance parameters, gait profile score and movement analysis profiles. Individual goal achievement was evaluated using z-scores for gait parameters and Goal Attainment Scale for gross motor function. No significant changes were observed regarding gross motor function. Only after individualized therapy, step- and stride-length increased significantly (p = 0.022; p = 0.017). Change in step-length was higher after the individualized program (p = 0.045). Within-group effects were found for the pelvis in transversal plane after the individualized program (p = 0.047) and in coronal plane after the general program (p = 0.047). Between-program differences were found for changes in the knee in sagittal plane, in the advantage of the individual program (p = 0.047). A median difference in z-score of 0.279 and 0.419 was measured after the general and individualized program, respectively. Functional goal attainment was higher after the individual therapy program compared with the general program (48 to 43.5). The results indicate slightly favorable effects towards the individualized program. To detect clinically significant changes, future studies require a minimal sample size of 72 to 90 participants. © The Author(s) 2014.

The National Cross-Site Evaluation of High-Risk Youth Programs. Preventing Substance Abuse: Major Findings from the National Cross-Site Evaluation of High-Risk Youth Programs. Monograph Series.

ERIC Educational Resources Information Center

Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Herman, Jack

This multiple-site study assessed 48 prevention programs for high-risk youth funded by the Center for Substance Abuse Prevention, identifying program characteristics associated with strong substance abuse prevention outcomes. Data analysis indicated that substance abuse programs reduced rates of substance use, and the positive effects of program…

Evaluation of Project P.A.T.H.S. (Secondary 1 Program) by the Program Participants: Findings Based on the Full Implementation Phase

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Sun, Rachel C. F.

2008-01-01

A total of 207 schools (N = 33,693 students) participated in the Secondary 1 Program of Project P.A.T.H.S. in the Full Implementation Phase (2006-07). Participants responded to a Subjective Outcome Evaluation Form (Form A) to assess their views of the program, instructors, and perceived effectiveness after program completion. Utilizing the…

[Psychological Effects of Forest Therapy Program on Workers].

PubMed

Ikei, Harumi; Koizumi, Haruka; Song, Chorong; Kouzuki, Mitsunori; Teratani, Seiichiro; Sakuma, Takahiro; Miyazaki, Yoshifumi

2015-01-01

To examine the psychological effects of forest therapy program on workers. The subjective symptoms index, a shortened version of the profile of mood states (POMS), and a semantic differential (SD) method were used to measure the psychological effects. The evaluations were performed 3 days before, during, and 1, 3, and 5 days after the forest therapy. The following results were obtained: (1) the subjective symptoms improved before breakfast and continued for 5 days; (2) the mood evaluated using POMS improved before breakfast and continued for 3 days; and (3) “comfortable,” “relaxed,” and “natural” feelings evaluated using the SD method were enhanced before breakfast, lunch, and dinner during forest therapy. These results provided scientific evidence of the psychological effects of forest therapy program on workers.

DECISION-MAKING ALIGNED WITH RAPID-CYCLE EVALUATION IN HEALTH CARE.

PubMed

Schneeweiss, Sebastian; Shrank, William H; Ruhl, Michael; Maclure, Malcolm

2015-01-01

Availability of real-time electronic healthcare data provides new opportunities for rapid-cycle evaluation (RCE) of health technologies, including healthcare delivery and payment programs. We aim to align decision-making processes with stages of RCE to optimize the usefulness and impact of rapid results. Rational decisions about program adoption depend on program effect size in relation to externalities, including implementation cost, sustainability, and likelihood of broad adoption. Drawing on case studies and experience from drug safety monitoring, we examine how decision makers have used scientific evidence on complex interventions in the past. We clarify how RCE alters the nature of policy decisions; develop the RAPID framework for synchronizing decision-maker activities with stages of RCE; and provide guidelines on evidence thresholds for incremental decision-making. In contrast to traditional evaluations, RCE provides early evidence on effectiveness and facilitates a stepped approach to decision making in expectation of future regularly updated evidence. RCE allows for identification of trends in adjusted effect size. It supports adapting a program in midstream in response to interim findings, or adapting the evaluation strategy to identify true improvements earlier. The 5-step RAPID approach that utilizes the cumulating evidence of program effectiveness over time could increase policy-makers' confidence in expediting decisions. RCE enables a step-wise approach to HTA decision-making, based on gradually emerging evidence, reducing delays in decision-making processes after traditional one-time evaluations.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

Conversational Skills Instruction for Communication Apprehension and Avoidance: Evaluation of a Treatment Program.

ERIC Educational Resources Information Center

Glaser, Susan R.; And Others

1983-01-01

Describes and evaluates a conversational skills program designed to teach apprehensive communicators how to develop comfortable and effective social behavior in a variety of interpersonal contexts. (PD)

Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations.

PubMed

Wasserman, Deborah L

2010-05-01

This paper offers a framework for using a systems orientation and "foundational theory" to enhance theory-driven evaluations and logic models. The framework guides the process of identifying and explaining operative relationships and perspectives within human service program systems. Self-Determination Theory exemplifies how a foundational theory can be used to support the framework in a wide range of program evaluations. Two examples illustrate how applications of the framework have improved the evaluators' abilities to observe and explain program effect. In both exemplars improvements involved addressing and organizing into a single logic model heretofore seemingly disparate evaluation issues regarding valuing (by whose values); the role of organizational and program context; and evaluation anxiety and utilization. Copyright 2009 Elsevier Ltd. All rights reserved.

Development and evaluation of a learner-centered educational summer camp program on soft skills for baccalaureate nursing students.

PubMed

Lau, Ying; Wang, Wenru

2014-01-01

The objectives were to develop a learner-centered educational camp program for nursing students and to evaluate 4 areas of soft skills, communication ability, clinical interaction, interpersonal relationships, and social problem solving, before and after the program. The results showed that the summer camp program was effective in improving nursing students' soft skills.

Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

ERIC Educational Resources Information Center

Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

2004-01-01

This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

EVALUATION STUDY OF FARM AND HOME MANAGEMENT PROGRAM IN NEW YORK STATE. A SIX-PART REPORT.

ERIC Educational Resources Information Center

ALEXANDER, FRANK D.

IN 1954 CONGRESS EARMARKED FUNDS FOR A FARM AND HOME MANAGEMENT PROGRAM TO OFFER INTENSIVE ON-THE FARM COUNSELING IN MANAGEMENT AND DECISION MAKING. THIS SIX-PART EVALUATION OF THE PROGRAM AS IT WAS CONDUCTED IN NEW YORK STATE, PRIMARILY WITH DAIRY OPERATORS, WAS DESIGNED TO DETERMINE THE PROGRAM'S EFFECTIVENESS RELATIVE TO LESS INTENSIVE…

A Program Evaluation of the Experiences Provided to Novice Teachers through M School District's Teacher-Mentor Training Program

ERIC Educational Resources Information Center

Puryear, Pamela Ann

2012-01-01

Novice teachers often lack effective teaching strategies and exhibit poor classroom management, which creates disruptions in the classroom that lessen the quality of instructional time for students. The purpose of this program evaluation was to examine a teacher-mentor training program and the experiences provided to participants to gain a deeper…

Effects Five Years Later: The Michigan School Readiness Program Evaluation through Age 10.

ERIC Educational Resources Information Center

Xiang, Zongping; Schweinhart, Lawrence J.

This follow-up study examined the outcomes of children who had participated in the Michigan School Readiness Program (MSRP), a preschool program for 4-year-olds identified as being at risk for school failure, up to 5 years following their participation in the program. For the evaluation, 338 children who had participated in the state-funded…

Philosophical Thinking in the Elementary Schools: An Evaluation of the Educational Program Philosophy for Children.

ERIC Educational Resources Information Center

Haas, Hope J.

This essay reports the results of a preliminary evaluation of the effects of Matthew Lipman's Philosophy for Children program on fifth and sixth graders in the first year of the program's use in two settings. The program, which involves the use of a novel about children to promote discussion, attempts to engage elementary students in philosophical…

Which BRCA genetic testing programs are ready for implementation in health care? A systematic review of economic evaluations.

PubMed

D'Andrea, Elvira; Marzuillo, Carolina; De Vito, Corrado; Di Marco, Marco; Pitini, Erica; Vacchio, Maria Rosaria; Villari, Paolo

2016-12-01

There is considerable evidence regarding the efficacy and effectiveness of BRCA genetic testing programs, but whether they represent good use of financial resources is not clear. Therefore, we aimed to identify the main health-care programs for BRCA testing and to evaluate their cost-effectiveness. We performed a systematic review of full economic evaluations of health-care programs involving BRCA testing. Nine economic evaluations were included, and four main categories of BRCA testing programs were identified: (i) population-based genetic screening of individuals without cancer, either comprehensive or targeted based on ancestry; (ii) family history (FH)-based genetic screening, i.e., testing individuals without cancer but with FH suggestive of BRCA mutation; (iii) familial mutation (FM)-based genetic screening, i.e., testing individuals without cancer but with known familial BRCA mutation; and (iv) cancer-based genetic screening, i.e., testing individuals with BRCA-related cancers. Currently BRCA1/2 population-based screening represents good value for the money among Ashkenazi Jews only. FH-based screening is potentially very cost-effective, although further studies that include costs of identifying high-risk women are needed. There is no evidence of cost-effectiveness for BRCA screening of all newly diagnosed cases of breast/ovarian cancers followed by cascade testing of relatives, but programs that include tools for identifying affected women at higher risk for inherited forms are promising. Cost-effectiveness is highly sensitive to the cost of BRCA1/2 testing.Genet Med 18 12, 1171-1180.

An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.

PubMed

Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M

1982-01-01

Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues.

An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.

PubMed Central

Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M

1982-01-01

Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues. PMID:7096223

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

PubMed

Charnley, Susan; Engelbert, Bruce

2005-11-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation project assesses how effective the Superfund community involvement program is in promoting public participation in decisions about how to clean up hazardous wastes at Superfund sites. We do three things in the article: (1) share our experience with evaluating an Agency public participation program, including lessons learned about methods of evaluation; (2) report evaluation results; and (3) address a number of issues pertaining to the evaluation of public participation in environmental decision-making. Our goal is to encourage more environmental managers to incorporate evaluation into their public participation programs as a tool for improving them. We found that written mail surveys were an effective and economical tool for obtaining feedback on EPA's community involvement program at Superfund sites. The evaluation focused on four criteria: citizen satisfaction with EPA information about the Superfund site, citizen understanding of environmental and human health risks associated with the site, citizen satisfaction with opportunities provided by EPA for community input, and citizen satisfaction with EPA's response to community input. While the evaluation results were mixed, in general, community members who were most informed about and involved in the cleanup process at Superfund sites generally were also the most satisfied with the community involvement process, and the job that EPA was doing cleaning up the site. We conclude that systematic evaluation provides meaningful and useful information that agencies can use to improve their public participation programs. However, there need to be institutionalized processes that ensure evaluation results are used to develop and implement strategies for improvement.

Use of children's artwork to evaluate the effectiveness of a hospital preparation program.

PubMed

Wilson, C J

1991-01-01

Approximately 1.5 million children are hospitalized on an emergency basis per year and are not able to be fully prepared for the event due to the emergency (Azarnoff & Woody, 1981). For this reason many pre-crisis hospital preparation programs are being instituted by hospitals and pediatric nurses. This pilot study investigated the use of children's artwork to evaluate the effectiveness of a hospital preparation program. The 6 to 10 year old children attending summer school at a day care center participated in a hospital preparation program. The purpose of the program was to decrease children's anxieties and fears in the event of an emergency hospitalization.

Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

PubMed Central

Burrus, Barri B.; Scott, Alicia Richmond

2012-01-01

Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541

Purposive Facebook Recruitment Endows Cost-Effective Nutrition Education Program Evaluation

PubMed Central

Wamboldt, Patricia

2013-01-01

Background Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. Objective The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. Methods English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Results Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. Conclusions With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy. PMID:23948573

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

PubMed

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy.

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness

PubMed Central

Huen, Jenny MY; Lai, Eliza SY; Shum, Angie KY; So, Sam WK; Chan, Melissa KY; Wong, Paul WC; Law, YW

2016-01-01

Background Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. Objective This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Methods Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Results Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users’ attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users’ initial psychological well-being and initial attainment on the constructs. Conclusions This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs. PMID:27717921

Re-examining Responsibilities: Health Educators as Researchers.

ERIC Educational Resources Information Center

Drolet, Judy C.

1991-01-01

Discusses seven areas of responsibility for entry-level health educators which can be demonstrated through research: assessing individual and community needs for health education; planning effective health education programs; implementing programs; evaluating program effectiveness; coordinating service provision; acting as a resource; and…

"Show me your impact": evaluating transitional justice in contested spaces.

PubMed

Duggan, Colleen

2012-02-01

This paper discusses some of the most significant challenges and opportunities for evaluating the effects of programs in support of transitional justice - the field that addresses how post-conflict or post authoritarian societies deal with legacies of wide spread human rights violations. The discussion is empirically grounded in a case study that assesses the efforts of the International Development Research Centre (IDRC) and one of its Guatemalan partners to evaluate the effects of a museum exposition that is attempting to recast historic memory and challenge racist attitudes in post-conflict Guatemala. The paper argues that despite the increasing trend to fund transitional justice programs, many international aid donors are stuck in traditional and arguably orthodox paradigms of program evaluation. This is having a negative effect not only upon the administration of aid but also upon how transitional justice research is perceived and valued by local populations. The case study experience indicates that there is no perfect evaluation model or approach for evaluating transitional justice programming - only choices to be made by commissioners of evaluation, evaluators, and those being evaluated. These are profoundly influenced by the extreme politics and moral values that define transitional justice settings as contested spaces in which calls to remember the tragic past must be balanced with aspirations to re-build a hopeful future. Copyright © 2010. Published by Elsevier Ltd.

Comparison Studies of Reading Readiness Skills Acquisition by Different Methods: Formal Reading Readiness Program, Informal Reading Readiness Program, and a Kindergarten Science Program.

ERIC Educational Resources Information Center

Quorn, Kerry Charles; Yore, Larry Dean

1978-01-01

Evaluates the effectiveness of two dissimilar programs, SAPA and the First Talking Alphabet (FTA), upon the acquisition of reading readiness skills of kindergarten pupils. Compares the effects of four different programs (SAPA, FTA, an informal language development program, and a control) on the reading readiness of kindergarten pupils. (GA)

Improving health equity through theory-informed evaluations: a look at housing first strategies, cross-sectoral health programs, and prostitution policy.

PubMed

Dunn, James R; van der Meulen, Emily; O'Campo, Patricia; Muntaner, Carles

2013-02-01

The emergent realist perspective on evaluation is instructive in the quest to use theory-informed evaluations to reduce health inequities. This perspective suggests that in addition to knowing whether a program works, it is imperative to know 'what works for whom in what circumstances and in what respects, and how?' (Pawson & Tilley, 1997). This addresses the important issue of heterogeneity of effect, in other words, that programs have different effects for different people, potentially even exacerbating inequities and worsening the situation of marginalized groups. But in addition, the realist perspective implies that a program may not only have a greater or lesser effect, but even for the same effect, it may work by way of a different mechanism, about which we must theorize, for different groups. For this reason, theory, and theory-based evaluations are critical to health equity. We present here three examples of evaluations with a focus on program theories and their links to inequalities. All three examples illustrate the importance of theory-based evaluations in reducing health inequities. We offer these examples from a wide variety of settings to illustrate that the problem of which we write is not an exception to usual practice. The 'Housing First' model of supportive housing for people with severe mental illness is based on a theory of the role of housing in living with mental illness that has a number of elements that directly contradict the theory underlying the dominant model. Multisectoral action theories form the basis for the second example on Venezuela's revolutionary national Barrio Adentro health improvement program. Finally, decriminalization of prostitution and related health and safety policies in New Zealand illustrate how evaluations can play an important role in both refining the theory and contributing to improved policy interventions to address inequalities. The theoretically driven and transformative nature of these interventions create special demands for the use of theory in evaluations. Copyright © 2012 Elsevier Ltd. All rights reserved.

Processes and outcomes of the veterans health administration safe patient handling program: study protocol.

PubMed

Rugs, Deborah; Toyinbo, Peter; Patel, Nitin; Powell-Cope, Gail; Hahm, Bridget; Elnitsky, Christine; Besterman-Dahan, Karen; Campbell, Robert; Sutton, Bryce

2013-11-18

Health care workers, such as nurses, nursing aides, orderlies, and attendants, who manually move patients, are consistently listed in the top professions for musculoskeletal injuries (MSIs) by the Bureau of Labor Statistics. These MSIs are typically caused by high-risk patient caregiving activities. In 2008, a safe patient handling (SPH) program was implemented in all 153 Veterans Administration Medical Centers (VAMCs) throughout the United States to reduce patient handling injuries. The goal of the present study is to evaluate the effects associated with the national implementation of a comprehensive SPH program. The primary objectives of the research were to determine the effectiveness of the SPH program in improving direct care nursing outcomes and to provide a context for understanding variations in program results across sites over time. Secondary objectives of the present research were to evaluate the effectiveness of the program in reducing direct and indirect costs associated with patient handling, to explore the potential mediating and moderating mechanisms, and to identify unintended consequences of implementing the program. This 3-year longitudinal study used mixed methods of data collection at 6- to 9-month intervals. The analyses will include data from surveys, administrative databases, individual and focus group interviews, and nonparticipant observations. For this study, a 3-tiered measurement plan was used. For Tier 1, the unit of analysis was the facility, the data source was the facility coordinator or administrative data, and all 153 VAMCs participated. For Tier 2, frontline caregivers and program peer leaders at 17 facilities each completed different surveys. For Tier 3, six facilities completed qualitative site visits, which included individual interviews, focus groups, and nonparticipant observations. Multiple regression models were proposed to test the effects of SPH components on nursing outcomes related to patient handling. Content analysis and constant comparative analysis were proposed for qualitative data analysis to understand the context of implementation and to triangulate quantitative data. All three tiers of data for this study have been collected. We are now in the analyses and writing phase of the project, with the possibility for extraction of additional administrative data. The focus of this paper is to describe the SPH program, its evaluation study design, and its data collection procedures. This study evaluates the effects associated with the national implementation of a comprehensive SPH program that was implemented in all 153 VAMCs throughout the United States to reduce patient handling injuries. To our knowledge, this is the largest evaluation of an SPH program in the United States. A major strength of this observational study design is that all VAMCs implemented the program and were included in Tier 1 of the study; therefore, population sampling bias is not a concern. Although the design lacks a comparison group for testing program effects, this longitudinal field study design allows for capturing program dose-response effects within a naturalistic context. Implementation of the VA-wide SPH program afforded the opportunity for rigorous evaluation in a naturalistic context. Findings will guide VA operations for policy and decision making about resources, and will be useful for health care, in general, outside of the VA, in implementation and impact of an SPH program.

Assessing Capacity for Sustainability of Effective Programs and Policies in Local Health Departments.

PubMed

Tabak, Rachel G; Duggan, Katie; Smith, Carson; Aisaka, Kristelle; Moreland-Russell, Sarah; Brownson, Ross C

2016-01-01

Sustainability has been defined as the existence of structures and processes that allow a program to leverage resources to effectively implement and maintain evidence-based public health and is important in local health departments (LHDs) to retain the benefits of effective programs. Explore the applicability of the Program Sustainability Framework in high- and low-capacity LHDs as defined by national performance standards. Case study interviews from June to July 2013. Standard qualitative methodology was used to code transcripts; codes were developed inductively and deductively. Six geographically diverse LHD's (selected from 3 of high and 3 of low capacity) : 35 LHD practitioners. Thematic reports explored the 8 domains (Organizational Capacity, Program Adaptation, Program Evaluation, Communications, Strategic Planning, Funding Stability, Environmental Support, and Partnerships) of the Program Sustainability Framework. High-capacity LHDs described having environmental support, while low-capacity LHDs reported this was lacking. Both high- and low-capacity LHDs described limited funding; however, high-capacity LHDs reported greater funding flexibility. Partnerships were important to high- and low-capacity LHDs, and both described building partnerships to sustain programming. Regarding organizational capacity, high-capacity LHDs reported better access to and support for adequate staff and staff training when compared with low-capacity LHDs. While high-capacity LHDs described integration of program evaluation into implementation and sustainability, low-capacity LHDs reported limited capacity for measurement specifically and evaluation generally. When high-capacity LHDs described program adoption, they discussed an opportunity to adapt and evaluate. Low-capacity LHDs struggled with programs requiring adaptation. High-capacity LHDs described higher quality communication than low-capacity LHDs. High- and low-capacity LHDs described strategic planning, but high-capacity LHDs reported efforts to integrate evidence-based public health. Investments in leadership support for improving organizational capacity, improvements in communication from the top of the organization, integrating program evaluation into implementation, and greater funding flexibility may enhance sustainability of evidence-based public health in LHDs.

Promoting Excellence in Nursing Education (PENE): Pross evaluation model.

PubMed

Pross, Elizabeth A

2010-08-01

The purpose of this article is to examine the Promoting Excellence in Nursing Education (PENE) Pross evaluation model. A conceptual evaluation model, such as the one described here, may be useful to nurse academicians in the ongoing evaluation of educational programs, especially those with goals of excellence. Frameworks for evaluating nursing programs are necessary because they offer a way to systematically assess the educational effectiveness of complex nursing programs. This article describes the conceptual framework and its tenets of excellence. Copyright 2009 Elsevier Ltd. All rights reserved.

Performance and prospects of payments for ecosystem services programs: evidence from China.

PubMed

Yang, Wu; Liu, Wei; Viña, Andrés; Luo, Junyan; He, Guangming; Ouyang, Zhiyun; Zhang, Hemin; Liu, Jianguo

2013-09-30

Systematic evaluation of the environmental and socioeconomic effects of Payments for Ecosystem Services (PES) programs is crucial for guiding policy design and implementation. We evaluated the performance of the Natural Forest Conservation Program (NFCP), a national PES program of China, in the Wolong Nature Reserve for giant pandas. The environmental effects of the NFCP were evaluated through a historical trend (1965-2001) analysis of forest cover to estimate a counter-factual (i.e., without-PES) forest cover baseline for 2007. The socioeconomic effects of the NFCP were evaluated using data collected through household interviews carried out before and after NFCP implementation in 2001. Our results suggest that the NFCP was not only significantly associated with increases in forest cover, but also had both positive (e.g., labor reduction for fuelwood collection) and negative (e.g., economic losses due to crop raiding by wildlife) effects on local households. Results from this study emphasize the importance of integrating local conditions and understanding underlying mechanisms to enhance the performance of PES programs. Our findings are useful for the design and implementation of successful conservation policies not only in our study area but also in similar places around the world. Copyright © 2013 Elsevier Ltd. All rights reserved.

When science and politics listen to each other: good prospects from a new school breakfast program in Peru.

PubMed

Jacoby, E R; Cueto, S; Pollitt, E

1998-04-01

This article provides an overview of a school breakfast program implemented in 1993 in the Peruvian Andes. The program, designed by the Instituto de Investigación Nutricional in Lima and supported by the government of Peru, constitutes a clear departure from previous school feeding programs, which were heavily politicized and poorly documented. From the program's inception, nutritionists, managers, and social scientists have collaborated to produce a sound nutritional design, efficient distribution mechanisms, and effective evaluation methods. During the program's first year, controlled evaluations conducted in several Andean regions documented improved dietary intake and a significant decline in the prevalence of anemia. An educational evaluation also found improved verbal skills, higher school attendance, and lower dropout rates among recipients of the school breakfast. The results have prompted the Peruvian government to continue supporting the program, thus setting a new standard for the effective management of social expenditure in the context of economic adjustment.

A Guidebook for Evaluating Programs for the Gifted in Virginia School Divisions. A Cooperative Project.

ERIC Educational Resources Information Center

Pulaski County Schools, VA.

This guidebook aims to provide clear, non-technical descriptions of procedures for evaluating the effectiveness of local gifted education programs in Virginia. The procedures were developed with both external and internal evaluations in mind. The evaluation process is described in four phases: planning, collecting the data, interpreting the data…

78 FR 19723 - Proposed Collection; 60-Day Comment Request; Evaluation of the Brain Disorders in the Developing...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-02

... Comment Request; Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty...: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty International Center... Information Collection: This study seeks to evaluate the management, effectiveness, and outcomes of the Brain...

EVALUATION OF THE NEW YORK STATE EDUCATION DEPARTMENT CONFERENCE, NUMBER 1.

ERIC Educational Resources Information Center

GREEN, ROBERT L.

THE MAJOR PROBLEM FACING EDUCATION, ACCORDING TO THIS REVIEW OF THE CONFERENCE, IS TO DEVELOP THE MOST EFFECTIVE LEARNING PROGRAMS FOR DISADVANTAGED YOUTH, WHICH SHOULD BE EVALUATED SCIENTIFICALLY. RIGOROUS STUDY IS NEEDED OF SUCH ISSUES AS (1) THE NATURE OF THE MOST EFFECTIVE PROGRAM FOR THE DISADVANTAGED LEARNER, (2) THE ASSESSMENT OF THE BASIC…

Framework for a National Testing and Evaluation Program Based Upon the National Stormwater Testing and Evaluation for Products and Practices (STEPP) Initiative (WERF Report INFR2R14)

EPA Science Inventory

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective S...

A Meta-Analytic Review of the Penn Resiliency Program's Effect on Depressive Symptoms

ERIC Educational Resources Information Center

Brunwasser, Steven M.; Gillham, Jane E.; Kim, Eric S.

2009-01-01

The purpose of this review was to evaluate whether the Penn Resiliency Program (PRP), a group cognitive-behavioral intervention, is effective in targeting depressive symptoms in youths. We identified 17 controlled evaluations of PRP (N = 2,498) in which depressive symptoms had been measured via an online search of PsycInfo, Medline, ERIC, and…

Evaluating the Effectiveness of Mental Health First Aid Program for Chinese People in Hong Kong

ERIC Educational Resources Information Center

Wong, Daniel F. K.; Lau, Ying; Kwok, Sylvia; Wong, Prudence; Tori, Christopher

2017-01-01

Purpose: Chinese people generally lack knowledge of mental illness. Such phenomenon may lead to a delay in seeking psychiatric treatments. This study evaluated the effectiveness of Mental Health First Aid (MHFA) program in improving mental health knowledge of the general public in Hong Kong. Methods: A quasi-experimental design was adopted whereby…

Adaptive salinity management in the Murray-Darling Basin: a transaction cost study

NASA Astrophysics Data System (ADS)

Loch, A. J.

2017-12-01

Transaction costs hinder or promote effective management of common good resource intertemporal externalities. Appropriate policy choices may reduce externalities and improve social welfare, and transaction cost analysis can help to evaluate policy choices. However, without measurement of relevant transaction costs such policy evaluation remains challenging. This article uses a time series dataset of salinity management program to test theory aimed at transaction cost-based policy evaluation and adaptive resource management over a period of 30 years worth of data. We identify peaks and troughs in transaction costs over time, lag-effects in program expenditure, and calculate the decay in transaction cost impacts. We conclude that Australian salinity management programs are achieving flexible institutional outcomes and effective policy arrangements with long-term benefits. Proposed changes to the program moving forward add weight to our assertions of adaptive strategies, and illustrate the value of the novel data-driven tracnsaction cost analysis approach for other jurisdictions.

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

Results of an independent evaluation of Project ALERT delivered in schools by Cooperative Extension.

PubMed

St Pierre, Tena L; Osgood, D Wayne; Mincemoyer, Claudia C; Kaltreider, D Lynne; Kauh, Tina J

2005-12-01

Reported are results of an independent effectiveness study of the Project ALERT drug prevention program implemented in eight Pennsylvania middle schools by outside program leaders employed by Cooperative Extension. In this randomized, 2-cohort longitudinal evaluation, 1,649 seventh-grade students completed a pretest and four waves of posttests over the 2-year program and 1-year follow-up. Project ALERT's effectiveness was tested through a 3-level hierarchical linear model. Analyses failed to yield any positive effects for substance use or mediators for use in the adult or teen-assisted delivery of the curriculum. An extensive set of additional analyses detected no differential program effects by student risk level, gender, school, or level of implementation quality. Potential explanations for outcomes relative to Project ALERT's original effectiveness trial are discussed, as well as implications for future research, including the need to conduct independent effectiveness studies of previously validated programs in a variety of contexts.

Understanding Effective Higher Education Programs in Prisons: Considerations from the Incarcerated Individuals Program in North Carolina

ERIC Educational Resources Information Center

Anders, Allison Daniel; Noblit, George W.

2011-01-01

The North Carolina Workplace and Community Transition Youth Offender Program (YOP), recently renamed the Incarcerated Individuals Program (IPP), has proven to be effective in terms of its growth and expansion, the support of education directors across the correctional facilities, university collaboration, student evaluations, and a low recidivism…

Prevention of Child Sexual Abuse Victimization: A Meta Analysis of School Programs.

ERIC Educational Resources Information Center

Rispens, Jan; Aleman, Andre; Goudena, Paul P.

1997-01-01

Meta-analysis of 16 evaluation studies of school programs aimed at the prevention of child sexual abuse victimization found significant and considerable mean postintervention and follow-up effect sizes, indicating that the programs were effective in teaching children sexual abuse concepts and self-protection skills. Program duration and content…

Effectiveness of Medifast supplements combined with obesity pharmacotherapy: A clinical program evaluation

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the long-term impact of Medifast meal-replacement supplements (MMRS) combined with appetite suppressant medication (ASM) among participants who received 52 weeks of treatment. We conducted a systematic program evaluation of weight loss data from a medically supervised w...

Evaluation of an Annual Community-Focused Agricultural Literacy Event

ERIC Educational Resources Information Center

Sandlin, M'Randa R.; Perez, Kauahi

2017-01-01

Agricultural literacy programs are effective pathways to informally teach the public about agriculture through stakeholder (attendee and exhibitor) interaction. Such programs are generally evaluated using attendee feedback but fail to include exhibitors' experience. The purpose of this study was to evaluate a local community agricultural event by…

Teacher Evaluations in Leisure Studies Programs: An Old Issue with a New Slant.

ERIC Educational Resources Information Center

Butts, Frank B.; Swearingen, Tommy

1994-01-01

This paper examines teacher evaluation practices in leisure studies programs, noting the perceived effectiveness of rating instruments. Surveys of leisure studies professors nationwide indicated many institutions used evaluation instruments and processes that were not statistically validated; key decisions were often made on the basis of these…

Outreach and Program Evaluation: Some Measurement Issues.

ERIC Educational Resources Information Center

Richard, Alan J.; And Others

1996-01-01

The experience of 10 years evaluating HIV risk-reduction intervention for drug users leads to the argument that program outreach workers are part of the intervention continuum and have important effects on service delivery. Improving pre-enrollment data collection will address evaluation issues raised by pre-enrollment outreach contacts. (SLD)

A Conceptual Three-Dimensional Model for Evaluating Community-Based Substance Abuse Prevention Programs.

ERIC Educational Resources Information Center

Albers, Eric C.; Santangelo, Linda K.; McKinlay, George; Cavote, Steve; Rock, Stephen L.; Evans, William

2002-01-01

Presents a three-dimensional model for conceptualizing existing prevention programs, defining and measuring effects of prevention programs, and making a connection between those programmatic effects, and the interests of the funder. This paper describes the methodology and its use for promoting the efficiency and effectiveness of substance abuse…

The Effects of the "Groups of Four" Program on Student Achievement.

ERIC Educational Resources Information Center

Johnson, Lizbeth Champagne

The objective of this study was to evaluate the effectiveness of the "Groups of Four" program, examining the impact of the cooperative learning strategy on students' achievement in mathematical problem solving. Effects of three specific independent variables in the program were examined in terms of gender, group assignment, and ability,…

A counterfactual impact evaluation of a bilingual program on students' grade point average at a spanish university.

PubMed

Arco-Tirado, J L; Fernández-Martín, F; Ramos-García, A M; Littvay, L; Villoria, J; Naranjo, J A

2018-06-01

This observational study intends to estimate the causal effects of an English as a Medium of Instruction (EMI) program (as predictor) on students Grade Point Average (GPA) (as outcome) at a particular University in Spain by using a Counterfactual Impact Evaluation (CIE). The need to address the crucial question of causal inferences in EMI programs to produce credible evidences of successful interventions contrasts, however, with the absence of experimental or quasi-experimental research and evaluation designs in the field. CIE approach is emerging as a methodologically viable solution to bridge that gap. The program evaluated here consisted in delivering an EMI program in a Primary Education Teacher Training Degree group. After achieving balance on the observed covariates and recreating a situation that would have been expected in a randomized experiment, three matching approaches such as genetic matching, nearest neighbor matching and Coarsened Exact Matching were used to analyze observational data from a total of 1288 undergraduate students, including both treatment and control group. Results show unfavorable effects of the bilingual group treatment condition. Potential interpretations and recommendations are provided in order to strengthen future causal evidences of bilingual education programs' effectiveness in Higher Education. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

A systematic review of primary prevention strategies for sexual violence perpetration☆

PubMed Central

DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K.; Massetti, Greta M.; Matjasko, Jennifer L.; Tharp, Andra Teten

2018-01-01

This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003). PMID:29606897

A systematic review of primary prevention strategies for sexual violence perpetration.

PubMed

DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K; Massetti, Greta M; Matjasko, Jennifer L; Tharp, Andra Teten

2014-01-01

This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003).

Program Evaluation of a High School Science Professional Learning Community

ERIC Educational Resources Information Center

McLelland-Crawley, Rebecca

2014-01-01

Teachers may benefit more from a professional learning community (PLC) than from professional development initiatives presented in single day workshops. The purpose of this program evaluation study was to identify characteristics of an effective PLC and to determine how the members of the PLC have benefitted from the program. Fullan's educational…

Serving the Needs of At-Risk Refugee Youth: A Program Evaluation

ERIC Educational Resources Information Center

McBrien, J. Lynn

2006-01-01

Refugee students, although frequently subsumed under the "immigrant" heading, often suffer from effects of significant trauma that can make them more vulnerable than children of voluntary immigrant families. This study evaluated a program created specifically for refugee youth at-risk for academic failure and "social death." The program goals…

Effects of a National Indicated Preventive Intervention Program

ERIC Educational Resources Information Center

Husler, Gebhard; Werlen, Egon; Blakeney, Ronny

2005-01-01

As there have been few science-based evaluations of secondary prevention programs, the Federal Office of Public Health in Switzerland carried out a national program evaluation at 12 sites in the French- and German-speaking parts of Switzerland to study the question, "What works in secondary prevention?" These 12 centers offer different…

Cost Savings Threshold Analysis of a Capacity-Building Program for HIV Prevention Organizations

ERIC Educational Resources Information Center

Dauner, Kim Nichols; Oglesby, Willie H.; Richter, Donna L.; LaRose, Christopher M.; Holtgrave, David R.

2008-01-01

Although the incidence of HIV each year remains steady, prevention funding is increasingly competitive. Programs need to justify costs in terms of evaluation outcomes, including economic ones. Threshold analyses set performance standards to determine program effectiveness relative to that threshold. This method was used to evaluate the potential…

Evaluation of Consumer Health Training and Education Programs.

ERIC Educational Resources Information Center

Kellogg, Muriel; And Others

PL89-749, passed in 1966, included a number of provisions for increasing participation of consumers in the improvement of the health care delivery system, including development of training programs to equip consumers for participation in the health planning process. The evaluation attempts to ascertain the direct effect of training programs on…

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

ERIC Educational Resources Information Center

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

A Text-Computer Assisted Instruction Program as a Viable Alternative for Continuing Education in Laboratory Medicine.

ERIC Educational Resources Information Center

Bruce, A. Wayne

1986-01-01

Describes reasons for developing combined text and computer assisted instruction (CAI) teaching programs for delivery of continuing education to laboratory professionals, and mechanisms used for developing a CAI program on method evaluation in the clinical laboratory. Results of an evaluation of the software's cost effectiveness and instructional…

PAL[R] Services Being Measured through Scientifically-Based Evaluation Process

ERIC Educational Resources Information Center

Perspectives in Peer Programs, 2007

2007-01-01

In January 2006, PAL[R] Peer Assistance and Leadership, a Promising Prevention Program of Workers Assistance Program, Inc. (WAP), received a $30,000 grant from the Center for Substance Abuse Prevention (CSAP) in order to be scientifically-evaluated on the outcomes and effectiveness of its programs and services. According to the grant, the…

Findings from the Evaluation of OJJDP's Gang Reduction Program. Juvenile Justice Bulletin

ERIC Educational Resources Information Center

Cahill, Meagan; Hayeslip, David

2010-01-01

This bulletin draws on findings from an independent evaluation, conducted by the Urban Institute, of the Gang Reduction Program's (GRP) Impact in Los Angeles, California; Milwaukee, Wisconsin; North Miami Beach, Florida; and Richmond, Virginia, to examine how effectively these sites implemented the program. Following are some of the authors' key…

Toward the Development of a Program Evaluation Business Model: Promoting the Longevity of Counselling in Schools.

ERIC Educational Resources Information Center

Ernst, Kelly; Hiebert, Bryan

2002-01-01

Presents a model of comprehensive guidance and counseling integrated within a business context. Concludes that using program evaluation to position counseling as a business with effective service products may enhance the long-term viability of comprehensive guidance and counseling programs. (Contains 48 references.) (GCP)

Community Engaged Service-Learning: The Effect on University Students and Community Partners

ERIC Educational Resources Information Center

Steele, Susan C.

2012-01-01

The notion that an ethic of service can be fostered through participation in an academic community engaged service-learning program was the underlying premise for this program evaluation study. The purpose of this program evaluation study, using both quantitative and qualitative measures in a thoughtfully organized setting of university and…

A Critical Review of Research on the Alert Program®

ERIC Educational Resources Information Center

Gill, Kamaldeep; Thompson-Hodgetts, Sandra; Rasmussen, Carmen

2018-01-01

To evaluate the strength of evidence for the effectiveness, feasibility, and appropriateness of the Alert Program®. Multiple databases were systematically searched for peer-reviewed, English-language articles that evaluated the Alert Program®. Six articles met the inclusion criteria. The strength of evidence ranged from weak to moderate using the…

An Evaluation of a Program to Help Dual-Earner Couples Share the Second Shift.

ERIC Educational Resources Information Center

Hawkins, Alan J.; And Others

1994-01-01

Used both traditional scientific and feminist methodologies to evaluate effectiveness of family life education program designed to help dual-earner couples (n=14 couples) share domestic labor. Both quantitative and qualitative data suggest that program produced small increases in husbands' involvement in both housework and child care and large…

Parenting after Divorce: Evaluation of Preventive Programs for Divorcing Families.

ERIC Educational Resources Information Center

Warren, Nancy J.; And Others

Preventive educational programs are potentially useful in reducing the effects of divorce on children and families. Parenting After Divorce is an ongoing study designed to evaluate preventive programs. Divorcing families with children aged 7-12 are identified from court records and contacted to participate. Families are randomly assigned to one of…

The Evaluation of an Early Childhood Teacher Preparation Program: An Action Research Project

ERIC Educational Resources Information Center

Ragno, Kerry Sullivan

2013-01-01

The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…

Evaluation of a Local Designated Driver and Responsible Server Program to Prevent Drinking and Driving.

ERIC Educational Resources Information Center

Simons-Morton, Bruce G.; Cummings, Sharon Snider

1997-01-01

Evaluates the impact of beverage servers' interventions at five establishments participating in the Houston Techniques for Effective Alcohol Management (TEAM) program. The intervention included server training, a designated-driver program, and "Safe Ride Home" taxi vouchers. Findings are discussed within the context of scant public and…

Small Learning Communities: 2000-2003. Evaluation Brief

ERIC Educational Resources Information Center

Heath, Debra

2005-01-01

The purpose of this program evaluation was to identify the effects of Small Learning Community (SLC) reforms on school climate, student attitudes and student performance. Eight SLC programs in five Albuquerque high schools were studied for one to four years, depending on each program's date of inception. Data were collected from students,…

How to Recognize a Quality Technical Education Program.

ERIC Educational Resources Information Center

Doty, Charles R.

Criteria for the evaluation of quality technical educational programs must be identified if follow-up studies are to be effective. Current research shows that problems in the development of such criteria include the tendency to evaluate programs on the basis of organizational structure rather than on the quality of the instructional program…

Evaluating the effectiveness of the Safety Investment Program (SIP) policies for Oregon.

DOT National Transportation Integrated Search

2009-10-01

The Safety Investment Program (SIP) was originally called the Statewide Transportation Improvement Program - : Safety Investment Program (STIP-SIP). The concept of the program was first discussed in October 1997 and the : program was adopted by the O...

The Effects of the Home Instruction Program for Preschool Youngsters (HIPPY) on Children's School Performance at the End of the Program and One Year Later.

ERIC Educational Resources Information Center

Baker, Amy J. L.; Piotrkowski, Chaya S.; Brooks-Gunn, Jeanne

1998-01-01

Evaluated whether participation in HIPPY (Home Instruction Program for Preschool Youngsters) has a positive impact on young children's performance in school. Assessed 182 children at baseline, the program's end, and one year later. Interpreted findings as mixed support for the effectiveness of the HIPPY program. (JS)

The Enhancement Seminar Model as a Strategy to Promote Diversity and Student Success in MSW Programs

ERIC Educational Resources Information Center

Watson, Larry D.; Rycraft, Joan R.

2010-01-01

This study evaluates the effectiveness of an enhancement program by examining a cohort of 57 students admitted on probationary status to an MSW program in 2002 and required to participate in the enhancement program. The demographics for students admitted on probation demonstrate that the program is effective in increasing the diversity of the…

Program Evaluation of Growin' to Win: A Latchkey and Summer Program for At-Risk Youth.

ERIC Educational Resources Information Center

James, William H.; And Others

This document presents an evaluation of the effectiveness of the Growin' to Win Project, an after-school and summer program targeted at elementary and middle school aged youth at high risk of substance abuse and gang involvement. Growin' to Win is an expansion of a model latchkey program piloted at two Tacoma (Washington) schools in 1990. The…

The Effect of a Physiological Evaluation Program on Coronary Heart Disease Risk Scores for Sedentary Individuals.

ERIC Educational Resources Information Center

Finkenberg, Mel; And Others

The purpose of this study was to compare the coronary heart disease (CHD) probability estimates of a group of sedentary males involved in an exercise stress test program from 1968 through 1974 with those of a comparison group of sedentary males not involved in the program. The program was designed to evaluate cardiopulmonary function and improve…

Common Evaluation Tools across Multi-State Programs: A Study of Parenting Education and Youth Engagement Programs in Children, Youth, and Families At-Risk

ERIC Educational Resources Information Center

Payne, Pamela B.; McDonald, Daniel A.

2015-01-01

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

Evaluation of verification and testing tools for FORTRAN programs

NASA Technical Reports Server (NTRS)

Smith, K. A.

1980-01-01

Two automated software verification and testing systems were developed for use in the analysis of computer programs. An evaluation of the static analyzer DAVE and the dynamic analyzer PET, which are used in the analysis of FORTRAN programs on Control Data (CDC) computers, are described. Both systems were found to be effective and complementary, and are recommended for use in testing FORTRAN programs.

Evaluating the Effectiveness of the 2001-2002 NASA "Why?" Files Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2001-2002 NASA 'Why?' Files program that was conducted in March 2002. The analysis is based on the results of 139 surveys collected from educators registered for the program. Respondents indicated that (1) the programs in the series are aligned with the national mathematics, science, and technology standards; (2) the programs are developmentally (grade level) appropriate; and (3) the programs enhance and enrich the teaching and learning of mathematics, science, and technology.

Evaluation Influence: The Evaluation Event and Capital Flow in International Development.

PubMed

Bell, David A

2017-12-01

Assessing program effectiveness in human development is central to informing foreign aid policy-making and organizational learning. Foreign aid effectiveness discussions have increasingly given attention to the devaluing effects of aid flow volatility. This study reveals that the external evaluation event influences actor behavior, serving as a volatility-constraining tool. A case study of a multidonor aid development mechanism served examining the influence of an evaluation event when considering anticipatory effects. The qualitative component used text and focus group data combined with individual interview data (organizations n = 10, including 26 individuals). Quantitative data included financial information on all 75 capital investments. The integrated theory of influence and model of alternative mechanisms used these components to identify the linkage between the evaluation event and capital flow volatility. Aid approved in the year of the midterm evaluation was disbursed by the mechanism with low capital volatility. Anticipating the evaluation event influenced behavior resulting in an empirical record that program outcomes were enhanced and the mechanism was an improved organization. Formative evaluations in a development program can trigger activity as an interim process. That activity provides for a more robust assessment of ultimate consequence of interest. Anticipating an evaluation can stimulate donor reality testing. The findings inform and strengthen future research on the influence of anticipating an evaluation. Closely examining activities before, during, and shortly after the evaluation event can aid development of other systematic methods to improve understanding this phenomenon, as well as improve donor effectiveness strategies.

A framework for improving the cost-effectiveness of DSM program evaluations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sonnenblick, R.; Eto, J.

The prudence of utility demand-side management (DSM) investments hinges on their performance, yet evaluating performance is complicated because the energy saved by DSM programs can never be observed directly but only inferred. This study frames and begins to answer the following questions: (1) how well do current evaluation methods perform in improving confidence in the measurement of energy savings produced by DSM programs; (2) in view of this performance, how can limited evaluation resources be best allocated to maximize the value of the information they provide? The authors review three major classes of methods for estimating annual energy savings: trackingmore » database (sometimes called engineering estimates), end-use metering, and billing analysis and examine them in light of the uncertainties in current estimates of DSM program measure lifetimes. The authors assess the accuracy and precision of each method and construct trade-off curves to examine the costs of increases in accuracy or precision. Several approaches for improving evaluations for the purpose of assessing program cost effectiveness are demonstrated. The methods can be easily generalized to other evaluation objectives, such as shared savings incentive payments.« less

Use of a business excellence model to improve conservation programs.

PubMed

Black, Simon; Groombridge, Jim

2010-12-01

The current shortfall in effectiveness within conservation biology is illustrated by increasing interest in "evidence-based conservation," whose proponents have identified the need to benchmark conservation initiatives against actions that lead to proven positive effects. The effectiveness of conservation policies, approaches, and evaluation is under increasing scrutiny, and in these areas models of excellence used in business could prove valuable. Typically, conservation programs require years of effort and involve rigorous long-term implementation processes. Successful balance of long-term efforts alongside the achievement of short-term goals is often compromised by management or budgetary constraints, a situation also common in commercial businesses. "Business excellence" is an approach many companies have used over the past 20 years to ensure continued success. Various business excellence evaluations have been promoted that include concepts that could be adapted and applied in conservation programs. We describe a conservation excellence model that shows how scientific processes and results can be aligned with financial and organizational measures of success. We applied the model to two well-documented species conservation programs. In the first, the Po'ouli program, several aspects of improvement were identified, such as more authority for decision making in the field and better integration of habitat management and population recovery processes. The second example, the black-footed ferret program, could have benefited from leadership effort to reduce bureaucracy and to encourage use of best-practice species recovery approaches. The conservation excellence model enables greater clarity in goal setting, more-effective identification of job roles within programs, better links between technical approaches and measures of biological success, and more-effective use of resources. The model could improve evaluation of a conservation program's effectiveness and may be used to compare different programs, for example during reviews of project performance by sponsoring organizations. © 2010 Society for Conservation Biology.

Evaluation of a sexual assault education/prevention program for male U.S. Navy personnel.

PubMed

Rau, Terri J; Merrill, Lex L; McWhorter, Stephanie K; Stander, Valerie A; Thomsen, Cynthia J; Dyslin, Christopher W; Crouch, Julie L; Rabenhorst, Mandy M; Milner, Joel S

2010-06-01

A randomized clinical trial was conducted to evaluate the effectiveness of the Navy Sexual Assault Intervention Training (SAIT) program for men. A four-group Solomon design was used to control for possible pretest sensitization effects. Male Navy personnel (N = 1,505) were assessed for rape knowledge, rape myth acceptance (two scales), and rape empathy after participating in the SAIT program or viewing an educational video about HIV/AIDS (comparison condition). The SAIT program was found to be effective in increasing rape knowledge, reducing rape myth acceptance, and increasing empathy for rape victims. As expected, men who had exhibited previous coercive sexual behavior, compared with those who had not, reported lower levels of knowledge, higher levels of rape myth acceptance, and less rape empathy. However, the SAIT program was generally effective in changing men's knowledge, beliefs, and feelings on the key measures, regardless of participants' histories of coercive sexual behavior.

Evaluating portfolio use as a tool for assessment and professional development in graduate nursing education.

PubMed

Ryan, Marybeth

2011-01-01

The portfolio is emerging as an efficient and effective method for evaluating program outcomes and professional development in nursing education. Although there is a host of literature about the use of portfolios in undergraduate nursing programs, fewer reports exist about their use in graduate nursing education. This article presents the results of a formative evaluation process, using student and faculty focus groups, conducted at a midsized university's graduate nursing education program to determine the effectiveness of portfolio use. Content analysis of the focus group data yielded three student themes and two faculty themes with associated theme clusters that revealed similarities and unique perceptions of students and faculty regarding the portfolio process. The information gleaned will provide direction to faculty as they make decisions about the use of this evaluation method in the graduate program. Copyright © 2011. Published by Elsevier Inc.

Survey of university programs in remote sensing funded under grants from the NASA University-Space Applications program

NASA Technical Reports Server (NTRS)

Madigan, J. A.; Earhart, R. W.

1978-01-01

NASA's Office of Space and Terrestrial Applications (OSTA) is currently assessing approaches to transferring NASA technology to both the public and private sectors. As part of this assessment, NASA is evaluating the effectiveness of an ongoing program in remote sensing technology transfer conducted by 20 university contractors/grantees, each supported totally or partially by NASA funds. The University-Space Applications program has as its objective the demonstration of practical benefits from the use of remote sensing technology to a broad spectrum of new users, principally in state and local governments. To evaluate the University-Space Applications program, NASA has a near-term requirement for data on each university effort including total funding, funding sources, length of program, program description, and effectiveness measures.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

PubMed

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic sensitivities, classroom management challenges, and fitting new programs into already busy school schedules. Overall, the program content and individual lessons were well received by the teachers and students. The lessons learned from the development, implementation and evaluation of this program can provide health professionals with key pedagogical strategies for designing culturally responsive educational programs. Culturally responsive programs are critical for ensuring interventions are effective for their specific context.

Sexual assault prevention programs: current issues, future directions, and the potential efficacy of interventions with women.

PubMed

Yeater, E A; O'Donohue, W

1999-11-01

Current problems facing the primary prevention of sexual assault are reviewed. Effective sexual assault prevention programs for both males and females have been slow to develop due to the fact that the etiologies of sexual assault have not been identified. Although dissemination of prevention programs has become increasingly popular in recent years, few programs have evaluated the extent to which the constructs identified in the interventions are effective at decreasing rates of sexual assault. This article discusses previous studies in sexual assault prevention programs, methodological and conceptual problems that currently exist in the field, pragmatic difficulties regarding program implementation and evaluation, and recommendations for future research with an emphasis on interventions with female participants.

Evaluating a community saturation model of abstinence education: an application of social marketing strategies.

PubMed

Tanner, John F; Anne Raymond, Mary; Ladd, Stacey D

2009-01-01

This study examines a community saturation program, a social marketing strategy, promoting abstinence education and evaluates the effects of this strategy on adolescents' attitudes and sexual behaviors. The study also examines components of the strategy to determine which program element was most influential. The Worth the Wait program was implemented in five counties in Texas beginning in 1999 for the first county and in 2000 and 2001 for the other four counties. A total of 2007 students in grades 7 through 12 were tracked and answered an end-of-the-year post-program survey after varying time periods of school program participation. Results indicate that a saturation program can be effective in reducing teen pregnancy.

An Examination of the Indiana State University Aerospace Administration Program

NASA Technical Reports Server (NTRS)

Schwab, Gregory L.

2005-01-01

Declining enrollments in the Indiana State University (ISU) aerospace administration program prompted this case study. which evaluates the program in comparison with parallel programs at other universities, industry standards, and an independent audit. Survey instruments were administered to graduates, faculty, and employers for their views on competencies of an excellent aerospace administration program Results show the deficiency of the ISU program. Graduates, faculty, and employers rated all competencies-from moderate to considerable importance-similarly for an excellent program. Recommendations for program improvement were made, and suggestions for further research include studies to evaluate the effectiveness of a revised aerospace administration program.

TEAM-HF Cost-Effectiveness Model: A Web-Based Program Designed to Evaluate the Cost-Effectiveness of Disease Management Programs in Heart Failure

PubMed Central

Reed, Shelby D.; Neilson, Matthew P.; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H.; Polsky, Daniel E.; Graham, Felicia L.; Bowers, Margaret T.; Paul, Sara C.; Granger, Bradi B.; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara; Levy, Wayne C.

2015-01-01

Background Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. Methods We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics, use of evidence-based medications, and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model (SHFM). Projections of resource use and quality of life are modeled using relationships with time-varying SHFM scores. The model can be used to evaluate parallel-group and single-cohort designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. Results The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. Conclusion The TEAM-HF Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. PMID:26542504

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: results of an economic evaluation alongside a randomised controlled trial.

PubMed

Oostdam, Nicolette; Bosmans, Judith; Wouters, Maurice G A J; Eekhoff, Elisabeth M W; van Mechelen, Willem; van Poppel, Mireille N M

2012-07-04

The prevalence of gestational diabetes mellitus (GDM) is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is cost-effective from a societal perspective as compared to standard care. A randomised controlled trial (RCT) and simultaneous economic evaluation of the FitFor2 program were conducted. Pregnant women at risk for GDM were randomised to an exercise program to prevent high maternal blood glucose (n = 62) or to standard care (n = 59). The exercise program consisted of two sessions of aerobic and strengthening exercises per week. Clinical outcome measures were maternal fasting blood glucose levels, insulin sensitivity and infant birth weight. Quality of life was measured using the EuroQol 5-D and quality-adjusted life-years (QALYs) were calculated. Resource utilization and sick leave data were collected by questionnaires. Data were analysed according to the intention-to-treat principle. Missing data were imputed using multiple imputations. Bootstrapping techniques estimated the uncertainty surrounding the cost differences and incremental cost-effectiveness ratios. There were no statistically significant differences in any outcome measure. During pregnancy, total health care costs and costs of productivity losses were statistically non-significant (mean difference €1308; 95%CI €-229 - €3204). The cost-effectiveness analyses showed that the exercise program was not cost-effective in comparison to the control group for blood glucose levels, insulin sensitivity, infant birth weight or QALYs. The twice-weekly exercise program for pregnant women at risk for GDM evaluated in the present study was not cost-effective compared to standard care. Based on these results, implementation of this exercise program for the prevention of GDM cannot be recommended. NTR1139.

Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

Evaluating the Effectiveness of the 2000-2001 NASA CONNECT(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2000-2001 NASA CONNECT(TM) program conducted in March 2001. The analysis is based on the results collected from 154 surveys collected from educators registered for the program. Respondents indicated that the objectives for each program were met; the programs were aligned with the national (mathematics, science, and technology) standards; the programs were developmentally (grade level) appropriate; and the programs in the 2000-2001 NASA CONNECT(TM) series enhanced/enriched the teaching of mathematics, science, and technology.

Violence in Brazilian schools: Analysis of the effect of the #Tamojunto prevention program for bullying and physical violence.

PubMed

Gusmões, Júlia D S P; Sañudo, Adriana; Valente, Juliana Y; Sanchez, Zila M

2018-02-01

A randomized controlled trial was conducted with 6637 7th- and 8th-grade students in 72 public schools in 6 Brazilian cities to evaluate the effects of the European drug prevention program Unplugged, called #Tamojunto in Brazil. This article evaluates the effects of #Tamojunto on the prevention of bullying and physical violence. Baseline data were collected from both intervention and control groups prior to program implementation. Follow-up data collection was performed 9 and 21 months later. Generalized estimating equations were used to evaluate changes in the reporting of receiving or practicing bullying and physical violence over time. The program was found to reduce the likelihood of receiving bullying, particularly in the stratum of girls aged 13-15 years at the 9-month follow-up time point. The effect was not sustained at 21 months. There was no significant effect for practicing bullying and for receiving or practicing physical violence. Copyright © 2017 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

Anger and Violence Prevention: Enhancing Treatment Effects through Booster Sessions

ERIC Educational Resources Information Center

Bundy, Alysha; McWhirter, Paula T.; McWhirter, J. Jeffries

2011-01-01

This study was designed to evaluate the effectiveness of booster sessions on the maintenance of intervention gains following an anger management prevention program: "Student Created Aggression Replacement Education Program" ("SCARE"). Participants who had completed the "SCARE" program a year earlier were randomly…

Small-grants programs: lessons from community-based approaches to changing nutrition environments.

PubMed

Johnson, Donna B; Smith, Lynne T; Bruemmer, Barbara

2007-02-01

Providing small grants to community organizations can be an effective way to encourage changes in the environment that support better nutrition. This is effective because these organizations can provide insights into their communities, ready-made relationships with community members, and the trust of the community. Small-grants programs are more likely to be successful when they are tailored to the needs of individual communities, led by organizations that have established reputations with the community, fully supported by the lead community organization, and engage local partners that complement the skills and resources of the lead organization. An evaluation of a small-grants program, Grants for Healthy Youth, found that grantees developed unique approaches to improving their community nutrition environments, gained experience and skills in program development, built partnerships, and received recognition for their project work. Grantees faced some common barriers, especially with program evaluation. Small-grants programs can be an effective way to improve community nutrition environments, but granting agencies need to provide effective technical assistance to communities throughout the process.

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

Evaluating the potential of group singing to enhance the well-being of older people.

PubMed

Davidson, Jane W; McNamara, Beverley; Rosenwax, Lorna; Lange, Andrea; Jenkins, Sue; Lewin, Gill

2014-06-01

To evaluate the effect of a singing program developed specifically for older community-dwelling people on measures of health and well-being. An eight-week singing program was developed and evaluated using standardised measures of health and well-being, measures designed to examine specific singing program outcomes, and semi-structured interviews. Participants aged 70 years and older were recruited through a home care service provider (n = 17) and an advertisement in a community newspaper (n = 19). Standard outcome measures indicated that the program had little effect on health and well-being. However, study-specific measures indicated that many participants had positive gains. Those in the home care group required more assistance to attend and continue in the program than those in the general community. Participants reported that the community-based singing facilitator was essential to the program's success. Well-structured community-based singing programs have the potential to impact positively upon the well-being of older people, but program viability depends on support with recruitment, transport and funding. © 2013 The Authors. Australasian Journal on Ageing © 2013 ACOTA.

Multi-criteria group decision making for evaluating the performance of e-waste recycling programs under uncertainty.

PubMed

Wibowo, Santoso; Deng, Hepu

2015-06-01

This paper presents a multi-criteria group decision making approach for effectively evaluating the performance of e-waste recycling programs under uncertainty in an organization. Intuitionistic fuzzy numbers are used for adequately representing the subjective and imprecise assessments of the decision makers in evaluating the relative importance of evaluation criteria and the performance of individual e-waste recycling programs with respect to individual criteria in a given situation. An interactive fuzzy multi-criteria decision making algorithm is developed for facilitating consensus building in a group decision making environment to ensure that all the interest of individual decision makers have been appropriately considered in evaluating alternative e-waste recycling programs with respect to their corporate sustainability performance. The developed algorithm is then incorporated into a multi-criteria decision support system for making the overall performance evaluation process effectively and simple to use. Such a multi-criteria decision making system adequately provides organizations with a proactive mechanism for incorporating the concept of corporate sustainability into their regular planning decisions and business practices. An example is presented for demonstrating the applicability of the proposed approach in evaluating the performance of e-waste recycling programs in organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Synthetic Comparator Approach to Local Evaluation of School-Based Substance Use Prevention Programming.

PubMed

Hansen, William B; Derzon, James H; Reese, Eric L

2014-06-01

We propose a method for creating groups against which outcomes of local pretest-posttest evaluations of evidence-based programs can be judged. This involves assessing pretest markers for new and previously conducted evaluations to identify groups that have high pretest similarity. A database of 802 prior local evaluations provided six summary measures for analysis. The proximity of all groups using these variables is calculated as standardized proximities having values between 0 and 1. Five methods for creating standardized proximities are demonstrated. The approach allows proximity limits to be adjusted to find sufficient numbers of synthetic comparators. Several index cases are examined to assess the numbers of groups available to serve as comparators. Results show that most local evaluations would have sufficient numbers of comparators available for estimating program effects. This method holds promise as a tool for local evaluations to estimate relative effectiveness. © The Author(s) 2012.

The Effects of the Wildlife Habitat Evaluation Program on Targeted Life Skills

ERIC Educational Resources Information Center

Allen, Kevin; Elmore, R. Dwayne

2012-01-01

Does participation in the Wildlife Habitat Evaluation Program (WHEP) help develop life skills? 4-H members and coaches who participated in the National WHEP Contest between the years 2003-2005 and 2007-2009 were asked to complete an evaluation at the end of each contest. A portion of the evaluation asked participants and coaches to determine if…

A Cost-Effectiveness Evaluation Approach to Improving Resource Allocations for School Systems. Administering for Change Program. A Professional Paper.

ERIC Educational Resources Information Center

Temkin, Sanford

This dissertation begins with a description of some methods employed in making public-sector resource-allocation decisions, with conclusions on the appropriateness of each method for evaluating the ongoing programs of a school system. The second section has been rewritten and published as "A Comprehensive Theory of Cost-Effectiveness" (EA 002…

Far from Home: An Experimental Evaluation of the Mother-Child Home Program in Bermuda.

ERIC Educational Resources Information Center

Scarr, Sandra; McCartney, Kathleen

1988-01-01

Effects of the Mother-Child Home Program (MCHP) were evaluated with a broad range of measures on cognition, social behavior, and emotion. Findings indicated that children in Bermuda scored above U.S. norms on cognitive tests and were functioning well in the preschool period. The MCHP had few demonstrable effects on any segment of the sample. (RH)

Who Really Wins? Efficacy of a Croatian Youth Gambling Prevention Program.

PubMed

Huic, Aleksandra; Kranzelic, Valentina; Dodig Hundric, Dora; Ricijas, Neven

2017-09-01

This paper reports on the development and pilot evaluation of a Croatian school-based youth gambling prevention program "Who really wins?". The program is aimed at minimizing risk and enhancing protective factors related to youth gambling. A short-term evaluation of the program was conducted with a sample of 190 first and second year high-school students (67.6% boys, aged 14-17 years; average age 15.61). An experimental design with two groups (Training vs. No Training) and two measurement sessions (pre-test and post-test sessions) was used to evaluate change in problem gambling awareness, cognitive distortions, knowledge of the nature of random events as well as in social skills. Results showed significant changes in the post-test sessions, which can be attributed to changes in the Training group. We observed a decrease in risk factors, namely better knowledge about gambling and less gambling related cognitive distortions. Immediate effects on protective factors such as problem solving skills, refusal skills, and general self-efficacy were not observed. Findings also show program effects to be the same for both boys and girls, students from different types of schools, for those with different learning aptitudes, as well as for those at different risk levels with regard to their gambling, which speaks in favour of the program's universality. The program had no iatrogenic effects on behaviour change and shows promise as an effective tool for youth gambling prevention. Future research and a long-term evaluation are needed to determine whether the observed changes are also linked to behavioural change.

AHRQ series paper 3: identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the effective health-care program.

PubMed

Whitlock, Evelyn P; Lopez, Sarah A; Chang, Stephanie; Helfand, Mark; Eder, Michelle; Floyd, Nicole

2010-05-01

This article discusses the identification, selection, and refinement of topics for comparative effectiveness systematic reviews within the Agency for Healthcare Research and Quality's Effective Health Care (EHC) program. The EHC program seeks to align its research topic selection with the overall goals of the program, impartially and consistently apply predefined criteria to potential topics, involve stakeholders to identify high-priority topics, be transparent and accountable, and continually evaluate and improve processes. A topic prioritization group representing stakeholder and scientific perspectives evaluates topic nominations that fit within the EHC program (are "appropriate") to determine how "important" topics are as considered against seven criteria. The group then judges whether a new comparative effectiveness systematic review would be a duplication of existing research syntheses, and if not duplicative, if there is adequate type and volume of research to conduct a new systematic review. Finally, the group considers the "potential value and impact" of a comparative effectiveness systematic review. As the EHC program develops, ongoing challenges include ensuring the program addresses truly unmet needs for synthesized research because national and international efforts in this arena are uncoordinated, as well as engaging a range of stakeholders in program decisions while also achieving efficiency and timeliness.

Evaluation tools for undergraduate program planning in times of financial austerity.

PubMed

O'Palka, J; Harris, P R

1990-05-01

This article describes the administration and outcome of two evaluation tools developed by faculty of the dietetic program for ongoing assessment of a Plan IV dietetic education program over a 4-year period. Interns and internship directors were asked to evaluate the level of skills and knowledge base of interns compared with their internship classmates. Interns were also asked to rate the effectiveness of undergraduate course assignments and activities for internship preparation. As a result of the surveys, the home economics core course work was deleted, credits were shifted from food science to nutrient metabolism courses, and credits in clinical nutrition were increased. Projects in clinical nutrition and food systems management were modified. The surveys justified program requirements and utilization of resources, and provided an additional, effective measure of faculty competence.

Methodologies for Evaluating the Impact of Contraceptive Social Marketing Programs.

ERIC Educational Resources Information Center

Bertrand, Jane T.; And Others

1989-01-01

An overview of the evaluation issues associated with contraceptive social marketing programs is provided. Methodologies covered include survey techniques, cost-effectiveness analyses, retail audits of sales data, time series analysis, nested logit analysis, and discriminant analysis. (TJH)

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

PubMed Central

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271

Key ingredients of anti-stigma programs for health care providers: a data synthesis of evaluative studies.

PubMed

Knaak, Stephanie; Modgill, Geeta; Patten, Scott B

2014-10-01

As part of its ongoing effort to combat stigma against mental illness among health care providers, the Mental Health Commission of Canada partnered with organizations conducting anti-stigma interventions. Our objective was to evaluate program effectiveness and to better understand what makes some programs more effective than others. Our paper reports the elements of these programs found to be most strongly associated with favourable outcomes. Our study employed a multi-phased, mixed-methods design. First, a grounded theory qualitative study was undertaken to identify key program elements. Next, each program (n = 22) was coded according to the presence or absence of the identified key program ingredients. Then, random-effects, meta-regression modelling was used to examine the association between program outcomes and the key ingredients. The qualitative analysis led to a 6-ingredient model of key program elements. Results of the quantitative analysis showed that programs that included all 6 of these ingredients performed significantly better than those that did not. Individual analyses of each of the 6 ingredients showed that including multiple forms of social contact and emphasizing recovery were characteristics of the most effective programs. The results provide a validation of a 6-ingredient model of key program elements for anti-stigma programming for health care providers. Emphasizing recovery and including multiple types of social contact are of particular importance for maximizing the effectiveness of anti-stigma programs for health care providers.

A Cost-Effectiveness/Benefit Analysis Model for Postsecondary Vocational Programs. Technical Report.

ERIC Educational Resources Information Center

Kim, Jin Eun

A cost-effectiveness/benefit analysis is defined as a technique for measuring the outputs of existing and new programs in relation to their specified program objectives, against the costs of those programs. In terms of its specific use, the technique is conceptualized as a systems analysis method, an evaluation method, and a planning tool for…

Success for All in Acre, Israel: Effects on Hebrew and Arabic Reading and Writing. (First Year).

ERIC Educational Resources Information Center

Hertz-Lazarowitz, Rachel; Schaedel, Bruria

A study investigated the effectiveness of the Success for All (SFA) program developed at Johns Hopkins University. The program emphasizes prevention of failure, personal tutoring, family-school program, and regular evaluation of student progress. In 1996, the program involved schools in northern Israel--Arabic and Jewish, religious and secular.…

Curriculum Development Based on the Big Picture Assessment of the Mechanical Engineering Program

ERIC Educational Resources Information Center

Sabri, Mohd Anas Mohd; Khamis, Nor Kamaliana; Tahir, Mohd Faizal Mat; Wahid, Zaliha; Kamal, Ahmad; Ihsan, Ariffin Mohd; Sulong, Abu Bakar; Abdullah, Shahrum

2013-01-01

One of the major concerns of the Engineering Accreditation Council (EAC) is the need for an effective monitoring and evaluation of program outcome domains that can be associated with courses taught under the Mechanical Engineering program. However, an effective monitoring method that can determine the results of each program outcome using Bloom's…

Strongwomen® Program Evaluation: Effect of Strength Training Exercises on Physical Fitness of Participants

ERIC Educational Resources Information Center

Chaudhary, Anil Kumar; Van Horn, Beth; Corbin, Marilyn

2015-01-01

The Strongwomen® Program (SWP) is a nationally disseminated group strength-training exercise and nutrition education program delivered by Extension. The study reported here examined the effect of strength training exercises in SWP on improvement in physical fitness of program participants. Senior Fitness Test was used to collect data. Upon…

EVALUATION AND FOLLOWUP STUDY OF A SUMMER SCIENCE AND MATHEMATICS PROGRAM FOR TALENTED SECONDARY SCHOOL STUDENTS.

ERIC Educational Resources Information Center

BASSETT, ROBERT D.; COOLEY, WILLIAM W.

THIS STUDY WAS TO EVALUATE A SUMMER PROGRAM IN SCIENCE AND MATHEMATICS FOR 60 PROMISING SCIENCE STUDENTS, AND TO DETERMINE THE EFFECTS OF SUCH A PROGRAM ON THE BEHAVIOR OF STUDENTS IN CLASSES DURING THE ENSUING YEAR AND ON THEIR FUTURE CAREER DECISIONS. THE FIRST 2 OF THE 10 WEEKS OF THIS PROGRAM THE STUDENTS WERE GIVEN ADVANCED INSTRUCTION BY…

Spitting in the Ocean: Realistic Expectations of the Impact of Driver Alcohol Education and Rehabilitation Programs on the Problem of Drunk Driving.

ERIC Educational Resources Information Center

Waller, Patricia F.

Alcohol education and rehabilitation programs are widely accepted as an integral part of the enforcement of drunk driving laws; however, careful evaluations of these programs generally fail to show subsequent beneficial effects on traffic crashes. This fact is due in part to the many barriers to conducting sound program evaluations and in part to…

Program Evaluation: A Study to Evaluate the Effectiveness of Academic and Behavioral Interventions in an Alternative to out of School Suspension Program

ERIC Educational Resources Information Center

Rizzi, Lorenzo

2011-01-01

The purpose of this study was to provide insight regarding the impact that the alternative to suspension program Achievement Character Excellence (ACE) has on the students who are placed there. The study utilized four achievement indicators to track the level of improvement of students after they were placed in the ACE program and after they were…

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

PubMed

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Effectiveness and cost-effectiveness of a self-management group program to improve social participation in patients with neuromuscular disease and chronic fatigue: protocol of the Energetic study.

PubMed

Veenhuizen, Yvonne; Cup, Edith H C; Groothuis, Jan T; Hendriks, Jan C M; Adang, Eddy M M; van Engelen, Baziel G M; Geurts, Alexander C H

2015-04-19

Chronic fatigue is present in more than 60% of the patients with a neuromuscular disease and can be their most disabling symptom. In combination with other impairments, fatigue often results in low levels of physical activity and decreased social participation, leading to high societal costs. 'Energetic' is a self-management group program aimed at improving social participation, physical endurance and alleviating fatigue in these patients. The primary aim of this study is to evaluate the effectiveness and cost-effectiveness of the Energetic program. A multicentered, assessor-blinded, two-armed randomized controlled trial is conducted with evaluations at inclusion and four, seven and fifteen months later. The study includes patients with a neuromuscular disease and chronic fatigue and, when present, their caregivers. The participants are randomized (ratio 1:1) to either an intervention group, receiving the Energetic program, or a control group, receiving usual care (i.e., no specific intervention). The Energetic program covers four months and includes four modules: 1) individually tailored aerobic exercise training; 2) education about aerobic exercise; 3) self-management training in applying energy conservation strategies; and 4) implementation and relapse prevention in daily life. Two months after cessation of the program a booster session is provided. The primary outcome is the perceived performance score of the Canadian Occupational Performance Measure (COPM). Secondary outcomes include the COPM-satisfaction score, and measures of fatigue, physical endurance, activity engagement, mood, and self-efficacy. Caregiver burden is also evaluated as a secondary outcome. Health-related quality of life and medical and societal costs are assessed to estimate cost-effectiveness of the program. The Energetic study is the first randomized controlled trial to evaluate the effectiveness and cost-effectiveness of a combined physical and self-management group training program for improving social participation, physical endurance and alleviating fatigue in patients with neuromuscular diseases. It will generate new insights in (cost-)effective rehabilitation strategies for these incurable conditions. Clinicaltrials.gov NCT02208687 .

Effects of a Self-Management Educational Program for the Control of Childhood Asthma.

ERIC Educational Resources Information Center

Perez, Maria Gabriela; Feldman, Lya; Caballero, Fernan

1999-01-01

Evaluates the effects of a self-management educational program on 29 children and their parents. Program consists of six sessions of information giving and cognitive-behavioral strategies for the children, and two talks and a brochure for the parents. Results indicate a significant effect on children's asthma knowledge and practice of…

Using ecological theory to evaluate the effectiveness of an indigenous community intervention: A study of Sexual Assault Nurse Examiner (SANE) programs.

PubMed

Campbell, Rebecca; Patterson, Debra; Fehler-Cabral, Giannina

2010-12-01

In recent years, there has been renewed interest among community psychologists in indigenous interventions, which are programs created by local practitioners (rather than researchers) already rooted in their communities. Indigenous interventions have strong ecological validity, but their effectiveness is often unknown because so few are rigorously evaluated. The goal of this project was to use Kelly and Trickett's ecological theory as a conceptual framework for evaluating an indigenous intervention and its mediating mechanisms of effectiveness. The focal intervention was a midwestern Sexual Assault Nurse Examiner (SANE) program, which provides post-assault medical care, crisis intervention, and medical forensic exams for sexual assault survivors. Prior studies of SANE programs have suggested that these interventions may help increase sexual assault prosecution rates. In this case example, we used a mixed methods design to determine if this program contributed to increased prosecution rates, and if so, why. Based on qualitative interviews with key stakeholders, we found substantial evidence for the Principle of Interdependence such that the SANE program strengthened the interconnections between the legal and medical systems, which contributed to increased prosecution. The intervention was effective in these outcomes because it promoted Cycling of Resources throughout the systems and fostered Adaptation of new roles for legal and medical personnel. Moving beyond this specific case example, this paper also examines cross-cutting advantages and struggles of using an ecological approach in the evaluation of indigenous community interventions.

Students Training for Academic Readiness (STAR): Year Three Evaluation Report. Executive Summary

ERIC Educational Resources Information Center

Texas Center for Educational Research, 2010

2010-01-01

This executive summary presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation…

Assessing International Evaluations. An Example from USAID's Democracy and Governance Program

ERIC Educational Resources Information Center

Bollen, Kenneth; Paxton, Pamela; Morishima, Rumi

2005-01-01

Each year, hundreds of millions of dollars are spent in international and bilateral aid programs to assist developing countries in expanding democratic governance. Evaluating these efforts' effectiveness is important given the vast needs of the client population. This article reviews a sample of evaluations of the United States Agency for…

Economic evaluation of area-wide pest management program to control asian tiger mosquito in New Jersey

USDA-ARS?s Scientific Manuscript database

Area-wide pest management (AWPM) is recommended to control urban mosquitoes, such as Aedes albopictus, which limit outdoor activities. While several evaluations of effectiveness exist, information on costs is lacking. Economic evaluation of such a program is important to help inform policy makers an...

Improving Human Services: Methods for Systematic Planning, Evaluation, and Staff Development.

ERIC Educational Resources Information Center

Jones, G. Brian; And Others

This monograph speaks to the basic problems confronting human services programs, and offers suggestions for improving guidance services. Specific concerns addressed are: (1) the need for more systematic program planning and evaluation; (2) an approach to effective planning and evaluation; (3) development of staff skills for use in the…

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

ERIC Educational Resources Information Center

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

An Evaluation of a School-Based, Peer-Facilitated, Healthy Relationship Program for At-Risk Adolescents

ERIC Educational Resources Information Center

McLeod, David Axlyn; Jones, Robin; Cramer, Elizabeth P.

2015-01-01

There are few evaluations of peer-facilitated teenage dating violence prevention programs in the literature. To begin to address this gap, this project assessed the effectiveness of a school-based, peer-facilitated healthy relationships program among academically at-risk students. Two hundred and ninety-one ninth graders of mixed race and gender…

A Strategy for Making Decisions and Evaluating Alternative Juvenile Offender Treatment Programs: Compensating for Missing Information.

ERIC Educational Resources Information Center

Roberts, Albert R.; Schervish, Phillip

1988-01-01

National survey data on the cost-effectiveness and cost-benefits of 11 different juvenile offender treatment program types are reviewed. Best-worst-midpoint, threshold, and convergency analyses are applied to these studies. Meaningful ways of dealing with missing information when evaluating alternative juvenile justice policies and programs are…

LANDSAT activities in the Republic of Zaire

NASA Technical Reports Server (NTRS)

Ilunga, S.

1975-01-01

An overview of the LANDSAT data utilization program of the Republic of Zaire is presented. The program emphasizes topics of economic significance to the national development program of Zaire: (1) agricultural land use capability analysis, including evaluation of the effects of large-scale burnings; (2) mineral resources evaluation; and (3) production of mapping materials for poorly covered regions.

Program Evaluation and Replications of School-Based Mental Health Services and Family-Community Interventions with Chronically Disruptive Students

ERIC Educational Resources Information Center

Carpenter-Aeby, Tracy; Aeby, Victor G.

2005-01-01

Although outcomes for alternative schools may be mixed, it is generally agreed that counseling, therapy, group work, case management, and family-community involvement have been credited in some effective programs. This study examined program evaluations from 1994-1999 for an alternative school for chronically disruptive students (599 students,…

Evaluation of the Effectiveness of Educational Preparation for Critical Care Nursing. Research Highlights.

ERIC Educational Resources Information Center

English National Board for Nursing, Midwifery and Health Visiting, London.

Curriculum analysis of the English National Board for Nursing, Midwifery, and Health Visiting (ENB) critical care programs ENB 100, 124, 176/183, 199, and 415 revealed great diversity in programs bearing the same title. An evaluation identified if this diversity was reflected in the competencies acquired by students on different programs,…

Evaluating a Blended Degree Program through the Use of the NSSE Framework

ERIC Educational Resources Information Center

Vaughan, Norman; Cloutier, David

2017-01-01

The purpose of this student-faculty partnership research study was to evaluate the effectiveness of a blended four-year Bachelor of Education Elementary Program at a Canadian university using the National Survey of Student Engagement (NSSE) framework. Data was collected from the first graduating cohort of students from the B.Ed. program in…

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

ERIC Educational Resources Information Center

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Pawtucket Heart Health Program Point-of-Purchase Nutrition Education Program in Supermarkets.

ERIC Educational Resources Information Center

Hunt, Mary K.; And Others

1990-01-01

Evaluates a point-of-purchase nutrition education program in Pawtucket (Rhode Island). Uses consumer interviews to evaluate the effect of awareness of shelf labels on purchase behavior. Reports increases in shoppers' ability to identify correct shelf labels and in the number of shoppers who were encouraged to buy the identified foods. (FMW)

Demonstrating Impact through Replicable Analysis: Implications of an Evaluation of Arkansas's Expanded Food and Nutrition Education Program

ERIC Educational Resources Information Center

Phelps, Josh; Brite-Lane, Allison; Crook, Tina; Hakkak, Reza; Fuller, Serena

2017-01-01

The evaluation described in this article focused on the effectiveness of Arkansas's Extension-based Expanded Food and Nutrition Education Program (EFNEP) but demonstrates an analytic approach that may be useful across Extension programs. We analyzed data from 1,810 Arkansas EFNEP participants' entry and exit Behavior Checklists to assess…

Evaluation of a Classroom Program of Creative Expression Workshops for Refugee and Immigrant Children

ERIC Educational Resources Information Center

Rousseau, Cecile; Drapeau, Aline; Lacroix, Louise; Bagilishya, Deogratias; Heusch, Nicole

2005-01-01

Objective: This evaluative study assessed the effect of a creative expression program designed to prevent emotional and behavioral problems and to enhance self-esteem in immigrant and refugee children attending multiethnic schools. Method: The 12-week program involved 138 children, aged 7 to 13, registered in both integration classes designed for…

Evaluation of an Organizational Development Program for Social Service Agencies. Final Report 77-2.

ERIC Educational Resources Information Center

Olmstead, Joseph A.

This report describes and evaluates an agency development program designed to aid administrators and supervisors of local social services to achieve effective agency performance. The program was conducted for a period of one year within four local agencies; two additional agencies were used as control groups. Assistance was provided through…

EVALUATION OF E.S.E.A. PROGRAMS AND SERVICES FOR THE EDUCATIONALLY DISADVANTAGED, 1966-67.

ERIC Educational Resources Information Center

Sacramento City Unified School District, CA.

Along with general information on the 1966-67 Title I compensatory education programs in the Sacramento City Unified School District and on the instruments used in evaluation the effectiveness of these programs, this report contains descriptions of individual activities: (1) language arts development and reading remediation (also information on…

Teaching-skills training programs for family medicine residents

PubMed Central

Lacasse, Miriam; Ratnapalan, Savithiri

2009-01-01

ABSTRACT OBJECTIVE To review the literature on teaching-skills training programs for family medicine residents and to identify formats and content of these programs and their effects. DATA SOURCES Ovid MEDLINE (1950 to mid-July 2008) and the Education Resources Information Center database (pre-1966 to mid-July 2008) were searched using and combining the MeSH terms teaching, internship and residency, and family practice; and teaching, graduate medical education, and family practice. STUDY SELECTION The initial MEDLINE and Education Resources Information Center database searches identified 362 and 33 references, respectively. Titles and abstracts were reviewed and studies were included if they described the format or content of a teaching-skills program or if they were primary studies of the effects of a teaching-skills program for family medicine residents or family medicine and other specialty trainees. The bibliographies of those articles were reviewed for unidentified studies. A total of 8 articles were identified for systematic review. Selection was limited to articles published in English. SYNTHESIS Teaching-skills training programs for family medicine residents vary from half-day curricula to a few months of training. Their content includes leadership skills, effective clinical teaching skills, technical teaching skills, as well as feedback and evaluation skills. Evaluations mainly assessed the programs’ effects on teaching behaviour, which was generally found to improve following participation in the programs. Evaluations of learner reactions and learning outcomes also suggested that the programs have positive effects. CONCLUSION Family medicine residency training programs differ from all other residency training programs in their shorter duration, usually 2 years, and the broader scope of learning within those 2 years. Few studies on teaching-skills training, however, were designed specifically for family medicine residents. Further studies assessing the effects of teaching-skills training in family medicine residents are needed to stimulate development of adapted programs for the discipline. Future research should also assess how residents’ teaching-skills training can affect their learners’ clinical training and eventually patient care. PMID:19752261

Health promotion in young adults at a university in Korea: A cross-sectional study of 625 participants in a university.

PubMed

Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

2017-02-01

Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program.A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test.The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants' overall evaluation score (83% rated "excellent" or "good") and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events.In conclusion, the university-wide health promotion program was effective in improving university members' health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs.

Health promotion in young adults at a university in Korea

PubMed Central

Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

2017-01-01

Abstract Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program. A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test. The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants’ overall evaluation score (83% rated “excellent” or “good”) and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events. In conclusion, the university-wide health promotion program was effective in improving university members’ health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs. PMID:28207551

Program of policy studies in science and technology

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1973-01-01

The application of an interdisciplinary, problem-oriented capability to the performance of total social impact evaluations is discussed. The consequences of introducing new configurations, technological or otherwise into future social environments are presented. The primary characteristics of the program are summarized: (1) emphasis on interdisciplinary, problem-oriented analysis; (2) development of intra- and inter-institutional arrangements for the purpose of analyzing social problems, evaluating existing programs, and assessing the social impacts of prospective policies, programs, and other public actions; (3) focus on methodological approaches to the projection of alternative future social environments, the identification of the effects of the introduction of new policies, programs, or other actions into the social system, and the evaluation of the social impacts of such effects; (4) availability of analytical resources for advisory and research tasks, and provision for use of program facilities as a neutral forum for the discussion of public issues involving involving the impact of advancing technology on social value-institutional processes.

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

Children, teachers and nature: An analysis of an environmental education program

NASA Astrophysics Data System (ADS)

Cheng, Judith Chen-Hsuan

Environmental education is an important tool for providing knowledge, supporting positive attitudes toward nature, and building skills to protect and improve the environment. Because of limited funding sources and increasing environmental challenges, it is important to provide effective environmental education programs. Program evaluation is one strategy to engage stakeholders and increase program effectiveness. An evaluation of a fourth grade environmental education program, Lagoon Quest developed by Brevard Zoo, provides an unique opportunity to answer several questions about implementing an effective environmental education program. The first question is about the effectiveness of Lagoon Quest. Evaluation data are reported in a case study that provides details about the development of the evaluation questions and evaluation instruments. The pre/posttest comparison suggests that participating in Lagoon Quest effectively increases students' knowledge of Indian River Lagoon (mean increase = 5.03, p<0.05). This program is effective among students' from different socio-economic background. Moreover, teachers and parents indicate that the program positively influenced the students and are supportive of it. Lagoon Quest is now a required program in the fourth grade curriculum in Brevard County, which raises the second question: how do teachers react to a required fourth grade program? Teachers' prior experience in environmental education, science education, Lagoon Quest and their attitudes toward Lagoon Quest were examined. A teacher survey was conducted to explore teachers' attitudes, but the low response rate necessitated a process to explore non-respondents' attitudes. Follow-up focus groups at schools with few respondents suggest that teachers who had prior experience in teaching science were more likely to be highly supportive of Lagoon Quest and were more likely to use additional resources to support the program. Also, teachers' interest in Indian River Lagoon is positively associated with their attitude toward nature. The third question uses Lagoon Quest to explore how to measure children's attitudes toward nature and the long-term development of conservation ethics. A Connection to Nature Index was developed and validated with fourth-grade students. A correlation analysis was conducted, and Connection to Nature was linked to other variables to explore its predictive ability. Four major elements were in the Connection to Nature Index: enjoyment of nature, empathy for living creatures, sense of oneness and sense of responsibility. The results suggest that measuring connection to nature (beta=0.38, p<0.05) is a promising strategy to predict children's interest in participating in nature-based activities. Also, connection to nature (beta=0.30, p<0.05) can predict children's interest in performing environmental friendly practices.

[Evaluation of an education program for patients with asthma who use inhalers].

PubMed

Lee, Jong Kyung; Yang, Young Hee

2010-04-01

This study was done to evaluate the effectiveness of an education program for patients with asthma who use inhalers. The research design for this study was a non-equivalent control group quasi-experimental study. Participants in this study were 36 patients for the control group, and 43 patients for the experimental group. The experimental group participated in the education program. The control group received the usual care. Data were collected before and 1 month and 2 months after the program finished and were analyzed using the SPSS 12.0 program. The experimental group had significantly higher scores of knowledge of inhalers, and inhalation technique compared to the control group. However, no significant differences were found between two groups for PEFR, asthma instability, and satisfaction with inhalers. According to the results, the education program was effective in improving knowledge of inhalers, and inhalation technique. Therefore, it is recommended that this education program be used in clinical practice as an effective nursing intervention for patients with asthma on inhalers.

Innovative strategies for nursing education program evaluation.

PubMed

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Are You Making an Impact? Evaluating the Population Health Impact of Community Benefit Programs.

PubMed

Rains, Catherine M; Todd, Greta; Kozma, Nicole; Goodman, Melody S

The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years. Such health care entities are challenged to evaluate the effectiveness of community benefit programs addressing the health needs identified. In an effort to determine the population health impact of community benefit programs in 1 hospital outreach department, researchers and staff conducted an impact evaluation to develop priority areas and overarching goals along with program- and department-level objectives. The longitudinal impact evaluation study design consists of retrospective and prospective secondary data analyses. As an urban pediatric hospital, St Louis Children's Hospital provides an array of community benefit programs to the surrounding community. Hospital staff and researchers came together to form an evaluation team. Data from program evaluation and administrative data for analysis were provided by hospital staff. Impact scores were calculated by scoring objectives as met or unmet and averaged across goals to create impact scores that measure how closely programs meet the overarching departmental mission and goals. Over the 4-year period, there is an increasing trend in program-specific impact scores across all programs except one, Healthy Kids Express Asthma, which had a slight decrease in year 4 only. Current work in measuring and assessing the population health impact of community benefit programs is mostly focused on quantifying dollars invested into community benefit work rather than measuring the quality and impact of services. This article provides a methodology for measuring population health impact of community benefit programs that can be used to evaluate the effort of hospitals in providing community benefit. This is particularly relevant in our changing health care climate, as hospitals are being asked to justify community benefit and make meaningful contributions to population health. The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years, and requires evaluation of program effectiveness; yet, it does not require any quantification of the impact of community benefit programs. The IRS Schedule H 990 policies could be strengthened by requiring an impact evaluation such as outlined in this article. As hospitals are being asked to justify community benefit and make meaningful contributions to population health, impact evaluations can be utilized to demonstrate the cumulative community benefit of programs and assess population health impact of community benefit programs.

Establishing a methodology to evaluate teen driver-training programs.

DOT National Transportation Integrated Search

2013-11-01

The goal of this research project was to develop a methodology to assist the Wisconsin Department of : Transportation (WisDOT) in the evaluation of effectiveness of teen driver education programs over the : short and long terms. The research effort w...

Evaluation of Arsenic Removal Technology: Arsenic Demonstration Program

EPA Science Inventory

Specific objectives of this program are to evaluate the reliability of the arsenic technologies of small scale systems; to gauge the simplicity of system operations, maintenance and operator skill; to determine the cost-effectiveness of the treatment technologies; and to characte...

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

Effectiveness of Parent-Child Mediation in Improving Family Functioning and Reducing Adolescent Problem Behavior: Results from a Pilot Randomized Controlled Trial.

PubMed

Tucker, Joan S; Edelen, Maria Orlando; Huang, Wenjing

2017-03-01

Parent-child mediation programs are intended to resolve or manage disputes and improve family functioning, but rigorous evaluations of their effectiveness are lacking. Families referred to a community-based mediation program (N = 111) were randomized to an intervention or wait-list control group, and completed three surveys over a 12-week period. With the exception of parent-reported child delinquency (which decreased more in the intervention group), this evaluation provides little support for the short-term effectiveness of parent-child mediation for improving family functioning and reducing child problem behaviors in general. Given that this is the first randomized controlled trial of a parent-child mediation program, additional evaluations involving larger samples and longer follow-ups are needed before firm conclusions can be drawn about the effectiveness of this intervention.

Effectiveness of Parent-Child Mediation in Improving Family Functioning and Reducing Adolescent Problem Behavior: Results from a Pilot Randomized Controlled Trial

PubMed Central

Tucker, Joan S.; Edelen, Maria Orlando; Huang, Wenjing

2016-01-01

Parent-child mediation programs are intended to resolve or manage disputes and improve family functioning, but rigorous evaluations of their effectiveness are lacking. Families referred to a community-based mediation program (N=111) were randomized to an intervention or wait-list control group, and completed three surveys over a 12-week period. With the exception of parent-reported child delinquency (which decreased more in the intervention group), this evaluation provides little support for the short-term effectiveness of parent-child mediation for improving family functioning and reducing child problem behaviors in general. Given that this is the first randomized controlled trial of a parent-child mediation program, additional evaluations involving larger samples and longer follow-ups are needed before firm conclusions can be drawn about the effectiveness of this intervention. PMID:26762375

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

The Efficacy of Stuttering Measurement Training: Evaluating Two Training Programs

PubMed Central

Bainbridge, Lauren A.; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong

2015-01-01

Purpose Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Method Four groups, each with 12 randomly allocated participants, completed a pretest–posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Results Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. Conclusions The SMS program was shown to produce a “medium” effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training. PMID:25629956

The efficacy of stuttering measurement training: evaluating two training programs.

PubMed

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Evolution and outcomes of a quality improvement program.

PubMed

Thor, Johan; Herrlin, Bo; Wittlöv, Karin; Øvretveit, John; Brommels, Mats

2010-01-01

The purpose of this paper is to examine the outcomes and evolution over a five-year period of a Swedish university hospital quality improvement program in light of enduring uncertainty regarding the effectiveness of such programs in healthcare and how best to evaluate it. The paper takes the form of a case study, using data collected as part of the program, including quality indicators from clinical improvement projects and participants' program evaluations. Overall, 58 percent of the program's projects (39/67) demonstrated success. A greater proportion of projects led by female doctors demonstrated success (91 percent, n=11) than projects led by male doctors (51 percent, n=55). Facilitators at the hospital continuously adapted the improvement methods to the local context. A lack of dedicated time for improvement efforts was the participants' biggest difficulty. The dominant benefits included an increased ability to see the "bigger picture" and the improvements achieved for patients and employees. Quality measurement, which is important for conducting and evaluating improvement efforts, was weak with limited reliability. Nevertheless, the present study adds evidence about the effectiveness of healthcare improvement programs. Gender differences in improvement team leadership merit further study. Improvement program evaluation should assess the extent to which improvement methods are locally adapted and applied. This case study reports the outcomes of all improvement projects undertaken in one healthcare organization over a five-year period and provides in-depth insight into an improvement program's changeable nature.

Program Participants Increase Equitable Attitudes.

ERIC Educational Resources Information Center

New Jersey Research Bulletin, 1996

1996-01-01

In 1996, the effectiveness of New Jersey's Perkins Act-funded single parent/displaced homemaker and gender equity programs were evaluated by using a modified version of MacDonald's Sex Role Survey to determine the effects of program participation on participants' attitudes toward four dimensions of sex equity: work, behavior, equity, and home.…

The Differential Effects of Rape Prevention Programming on Attitudes, Behavior, and Knowledge.

ERIC Educational Resources Information Center

Heppner, Mary J.; And Others

1995-01-01

Evaluates whether type of programming differentially affects the processing of rape prevention messages, attitudes, knowledge, behaviors, and stability of change. Participants (n=258) were assigned to a didactic-video program, an interactive drama, or control. Results indicated that the interactive video was most effective in central route…

75 FR 17940 - Draft Programmatic Environmental Assessment for the Evaluation of the Grant Programs Directorate...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-08

... and emergency preparedness grant programs that it administers. These programs provide grant funding to... effects of communication facilities construction or modification subject to review by the Federal... have or are likely to have a measurable negative effect on migratory bird populations. Avian mortality...

Evaluating the Effectiveness of Traditional and Alternative Principal Preparation Programs

ERIC Educational Resources Information Center

Pannell, Summer; Peltier-Glaze, Bernnell M.; Haynes, Ingrid; Davis, Delilah; Skelton, Carrie

2015-01-01

This study sought to determine the effectiveness on increasing student achievement of principals trained in a traditional principal preparation program and those trained in an alternate route principal preparation program within the same Mississippi university. Sixty-six Mississippi principals and assistant principals participated in the study. Of…

Effective Dropout Prevention and College Attendance Programs for Latino Students.

ERIC Educational Resources Information Center

Fashola, Olatokunbo S.; Slavin, Robert E.

This paper reviews research related to effective secondary school programs aimed at dropout prevention and increasing college enrollment rates for at-risk Latino youth. The review identifies programs that have demonstrated a significant impact on dropout rates, college attendance, school performance, or related outcomes in rigorous evaluations;…

Evaluation of alternative programs for repeat DWI offenders

DOT National Transportation Integrated Search

1996-10-01

This report documents the results of a study to determine the effectiveness of two alternative sanctions programs for repeat DWIs. The programs were an Intensive Supervision Probation (ISP) program in Milwaukee County, Wisconsin, and an Electronic Mo...

Qualitative Evaluation of Project P.A.T.H.S.: An Integration of Findings Based on Program Participants

PubMed Central

Shek, Daniel T. L.; Sun, Rachel C. F.

2012-01-01

An integration of the qualitative evaluation findings collected in different cohorts of students who participated in Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) (n = 252 students in 29 focus groups) was carried out. With specific focus on how the informants described the program, results showed that the descriptions were mainly positive in nature, suggesting that the program was well received by the program participants. When the informants were invited to name three metaphors that could stand for the program, positive metaphors were commonly used. Beneficial effects of the program in different psychosocial domains were also voiced by the program participants. The qualitative findings integrated in this paper provide further support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in promoting holistic development in Chinese adolescents in Hong Kong. PMID:22666134

Evaluating effects of developmental education for college students using a regression discontinuity design.

PubMed

Moss, Brian G; Yeaton, William H

2013-10-01

Annually, American colleges and universities provide developmental education (DE) to millions of underprepared students; however, evaluation estimates of DE benefits have been mixed. Using a prototypic exemplar of DE, our primary objective was to investigate the utility of a replicative evaluative framework for assessing program effectiveness. Within the context of the regression discontinuity (RD) design, this research examined the effectiveness of a DE program for five, sequential cohorts of first-time college students. Discontinuity estimates were generated for individual terms and cumulatively, across terms. Participants were 3,589 first-time community college students. DE program effects were measured by contrasting both college-level English grades and a dichotomous measure of pass/fail, for DE and non-DE students. Parametric and nonparametric estimates of overall effect were positive for continuous and dichotomous measures of achievement (grade and pass/fail). The variability of program effects over time was determined by tracking results within individual terms and cumulatively, across terms. Applying this replication strategy, DE's overall impact was modest (an effect size of approximately .20) but quite consistent, based on parametric and nonparametric estimation approaches. A meta-analysis of five RD results yielded virtually the same estimate as the overall, parametric findings. Subset analysis, though tentative, suggested that males benefited more than females, while academic gains were comparable for different ethnicities. The cumulative, within-study comparison, replication approach offers considerable potential for the evaluation of new and existing policies, particularly when effects are relatively small, as is often the case in applied settings.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques

PubMed Central

Jones, Kelly W.; Lewis, David J.

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented—from protected areas to payments for ecosystem services (PES)—to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing ‘matching’ to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods—an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators—due to the presence of unobservable bias—that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs. PMID:26501964

Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques.

PubMed

Jones, Kelly W; Lewis, David J

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented--from protected areas to payments for ecosystem services (PES)--to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing 'matching' to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods--an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators--due to the presence of unobservable bias--that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs.

A Randomized Controlled Trial Evaluation of "Time to Read", a Volunteer Tutoring Program for 8- to 9-Year-Olds

ERIC Educational Resources Information Center

Miller, Sarah; Connolly, Paul

2013-01-01

Tutoring is commonly employed to prevent early reading failure, and evidence suggests that it can have a positive effect. This article presents findings from a large-scale ("n" = 734) randomized controlled trial evaluation of the effect of "Time to Read"--a volunteer tutoring program aimed at children aged 8 to 9 years--on…

The Evaluation of a Three-Tier Model of Positive Behavior Interventions and Supports for Preschoolers in Head Start

ERIC Educational Resources Information Center

Stanton-Chapman, Tina L.; Walker, Virginia L.; Voorhees, Mary D.; Snell, Martha E.

2016-01-01

The purpose of this study was to evaluate the overall effectiveness of a three-tier model of positive behavior interventions and supports (PBIS), which was developed and tested in Head Start (HS) programs. Ten HS classrooms from five HS programs participated in the current study. Results indicated that PBIS was effective in improving classroom…

Know How to Teach Me… Evaluating the Effects of an In-Service Training Program for Regular School Teachers toward Inclusive Education

ERIC Educational Resources Information Center

Srivastava, Meenakshi; de Boer, Anke A.; Pijl, Sip Jan

2015-01-01

Teachers are seen as key players in implementing inclusive education. However, extremely little attention has been paid to teacher preparation, particularly in India. The aim of the current study was to implement a teacher training program and evaluate its effects and appropriateness. This focused on increasing teachers' (a) attitudes, (b)…

An Early Look at Families and Local Programs in the Mother and Infant Home Visiting Program Evaluation-Strong Start: Third Annual Report. OPRE Report 2016-37

ERIC Educational Resources Information Center

Lee, Helen; Crowne, Sarah; Faucetta, Kristen; Hughes, Rebecca

2016-01-01

The Mother and Infant Home Visiting Program Evaluation-Strong Start (MIHOPE-Strong Start) is the largest random assignment study to date to examine the effectiveness of home visiting services on improving birth outcomes and infant and maternal health care use for expectant mothers. The study includes local home visiting programs that use one of…

Measures of Student Non-Cognitive Skills and Political Tolerance after Two Years of the Louisiana Scholarship Program. Louisiana Scholarship Program Evaluation Report #2. Technical Report

ERIC Educational Resources Information Center

Mills, Jonathan N.; Cheng, Albert; Hitt, Collin E.; Wolf, Patrick J.; Greene, Jay P.

2016-01-01

This report examines the short-term effects of the Louisiana Scholarship Program (LSP) on students' non-cognitive skills and civic values. While a growing number of studies have evaluated K-12 school voucher programs along academic dimensions, few have focused on the development of non-cognitive skills and civic values. This study aims to address…

Evaluation of the TEAM Train-the-Trainer program

DOT National Transportation Integrated Search

1992-05-22

Author's abstract: The objective of this study was to evaluate the effectiveness of Techniques for Effective Alcohol Management (TEAM) Train-the-Trainer workshops. Effectiveness was measured in terms of the success facility representatives had, after...

Evaluation of the implementation of an integrated primary care network for prevention and management of cardiometabolic risk in Montréal.

PubMed

Provost, Sylvie; Pineault, Raynald; Tousignant, Pierre; Hamel, Marjolaine; Da Silva, Roxane Borgès

2011-11-10

The goal of this project is to evaluate the implementation of an integrated and interdisciplinary program for prevention and management of cardiometabolic risk (PCMR). The intervention is based on the Chronic Care Model. The study will evaluate the implementation of the PCMR in 6 of the 12 health and social services centres (CSSS) in Montréal, and the effects of the PCMR on patients and the practice of their primary care physicians up to 40 months following implementation, as well as the sustainability of the program. Objectives are: 1-to evaluate the effects of the PCMR and their persistence on patients registered in the program and the practice of their primary care physicians, by implementation site and degree of exposure to the program; 2-to assess the degree of implementation of PCMR in each CSSS territory and identify related contextual factors; 3-to establish the relationships between the effects observed, the degree of PCMR implementation and the related contextual factors; 4-to assess the impact of the PCMR on strengthening local services networks. The evaluation will use a mixed design that includes two complementary research strategies. The first strategy is similar to a quasi-experimental "before-after" design, based on a quantitative approach; it will look at the program's effects and their variations among the six territories. The effects analysis will use data from a clinical database and from questionnaires completed by participating patients and physicians. Over 3000 patients will be recruited. The second strategy corresponds to a multiple case study approach, where each of the six CSSS constitutes a case. With this strategy, qualitative methods will set out the context of implementation using data from semi-structured interviews with program managers. The quantitative data will be analyzed using linear or multilevel models complemented with an interpretive approach to qualitative data analysis. Our study will identify contextual factors associated with the effectiveness, successful implementation and sustainability of such a program. The contextual information will enable us to extrapolate our results to other contexts with similar conditions. ClinicalTrials.gov: NCT01326130.

Program evaluation of remote heart failure monitoring: healthcare utilization analysis in a rural regional medical center.

PubMed

Riley, William T; Keberlein, Pamela; Sorenson, Gigi; Mohler, Sailor; Tye, Blake; Ramirez, A Susana; Carroll, Mark

2015-03-01

Remote monitoring for heart failure (HF) has had mixed and heterogeneous effects across studies, necessitating further evaluation of remote monitoring systems within specific healthcare systems and their patient populations. "Care Beyond Walls and Wires," a wireless remote monitoring program to facilitate patient and care team co-management of HF patients, served by a rural regional medical center, provided the opportunity to evaluate the effects of this program on healthcare utilization. Fifty HF patients admitted to Flagstaff Medical Center (Flagstaff, AZ) participated in the project. Many of these patients lived in underserved and rural communities, including Native American reservations. Enrolled patients received mobile, broadband-enabled remote monitoring devices. A matched cohort was identified for comparison. HF patients enrolled in this program showed substantial and statistically significant reductions in healthcare utilization during the 6 months following enrollment, and these reductions were significantly greater compared with those who declined to participate but not when compared with a matched cohort. The findings from this project indicate that a remote HF monitoring program can be successfully implemented in a rural, underserved area. Reductions in healthcare utilization were observed among program participants, but reductions were also observed among a matched cohort, illustrating the need for rigorous assessment of the effects of HF remote monitoring programs in healthcare systems.

Implemented or Not Implemented? Process Evaluation of the School-Based Obesity Prevention Program DOiT and Associations with Program Effectiveness

ERIC Educational Resources Information Center

van Nassau, Femke; Singh, Amika S.; Hoekstra, Trynke; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J. M.

2016-01-01

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators: recruitment, reach, dosage, fidelity, satisfaction,…

The Development of a Museum Multimedia Program and the Effect of Audio on User Completion Rate.

ERIC Educational Resources Information Center

Chadwick, John

1992-01-01

Discusses the role of interactive multimedia in museums; describes the development and design at the New Mexico Museum of Natural History of a multimedia program on water conservation; analyzes the effect of the presence of audio on the users' completion of the program; and discusses evaluation of the program. (10 references) (LRW)

The Effects of a Contingency Contracting Program on the Nocturnal Enuresis of Three Children

ERIC Educational Resources Information Center

Stover, Anthony C.; Dunlap, Glen; Neff, Bryon

2008-01-01

Objective: This study was conducted to evaluate the effects of a contingency contracting program to eliminate nocturnal enuresis of three children ages 5 to 12. Methods: The program was implemented by the children's primary caregivers, two of whom were foster parents and the third a case worker in the foster care system. The program was a package…

Is an Early Start the Best Start?: Evaluating the Effectiveness of a Political Science Summer Bridge Program

ERIC Educational Resources Information Center

Woodall, Gina Serignese; Herrera, Richard; Thompson, Joshua R.; Ortega, Jorge Coss

2017-01-01

Summer bridge programs are supposed to connect a graduating high school senior's summer to their first semester in college, easing the transition away from home and into a university setting. Although research is plentiful on the programs, assessments regarding the overall effectiveness of such programs have been mixed (e.g., Cabrera, Miner, and…

Healthcare team training programs aimed at improving depression management in primary care: A systematic review.

PubMed

Vöhringer, Paul A; Castro, Ariel; Martínez, Pablo; Tala, Álvaro; Medina, Simón; Rojas, Graciela

2016-08-01

Although evidence from Latin America and the Caribbean suggests that depression can be effectively treated in primary care settings, depression management remains unevenly performed. This systematic review evaluates all the international evidence on healthcare team training programs aimed at improving the outcomes of patients with depression. Three databases were searched for articles in English or Spanish indexed up to November 20, 2014. Studies were included if they fulfilled the following conditions: clinical trials, meta-analyses, or systematic reviews; and if they evaluated a training or educational program intended to improve the management of depression by primary healthcare teams, and assessed change in depressive symptoms, diagnosis or response rates, referral rates, patients' satisfaction and/or quality of life, and the effectiveness of treatments. Nine studies were included in this systematic review. Five trials tested the effectiveness of multi-component interventions (training included), and the remaining studies evaluated the effectiveness of specific training programs for depression management. All the studies that implemented multi-component interventions were efficacious, and half of the training trials were shown to be effective. Contribution of training programs alone to the effectiveness of multi-component interventions is yet to be established. The lack of specificity regarding health providers' characteristics might be a confounding factor. The review conducted suggests that stand-alone training programs are less effective than multi-component interventions. In applying the evidence gathered from developed countries to Latin America and the Caribbean, these training programs must consider and address local conditions of mental health systems, and therefore multi-component interventions may be warranted. Copyright © 2016 Elsevier B.V. All rights reserved.

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

PubMed

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

PubMed

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

An Evaluation of the Effectiveness of U.S. Naval Aviation Crew Resource Management Training Programs: A Reassessment for the Twenty-First Century Operating Environment

DTIC Science & Technology

2009-06-01

3. Previous Navy CRM Assessments ....................................................24 4. Applying Kirkpatrick’s Topology of Evaluation...development within each aviation community. Kirkpatrick’s (1976) hierarchy of training evaluation technique was applied to examine three levels of... Applying methods and techniques used in previous CRM evaluation research, this thesis provided an updated evaluation of the Naval CRM program to fill

Evaluation of STD/AIDS prevention programs: a review of approaches and methodologies.

PubMed

da Cruz, Marly Marques; dos Santos, Elizabeth Moreira; Monteiro, Simone

2007-05-01

The article presents a review of approaches and methodologies in the evaluation of STD/AIDS prevention programs, searching for theoretical and methodological support for the institutionalization of evaluation and decision-making. The review included the MEDLINE, SciELO, and ISI Web of Science databases and other sources like textbooks and congress abstracts from 1990 to 2005, with the key words: "evaluation", "programs", "prevention", "STD/AIDS", and similar terms. The papers showed a predominance of quantitative outcome or impact evaluative studies with an experimental or quasi-experimental design. The main use of evaluation is accountability, although knowledge output and program improvement were also identified in the studies. Only a few evaluative studies contemplate process evaluation and its relationship to the contexts. The review aimed to contribute to the debate on STD/AIDS, which requires more effective, consistent, and sustainable decisions in the field of prevention.

Evaluation of a Life Skills Program to Prevent Adolescent Alcohol Use in Two European Countries: One-Year Follow-Up

ERIC Educational Resources Information Center

Giannotta, Fabrizia; Weichold, Karina

2016-01-01

Background: Life skills programs are effective tools to combat youth substance use. However there is a lack of studies concerning their effectiveness in Europe. Objective: This study investigated the 1 year follow up effects and the program implementation of a life skills school-based intervention (IPSY: Information + Psychosocial…

Cost-Effectiveness Analysis of the New South Wales Adult Drug Court Program

ERIC Educational Resources Information Center

Shanahan, Marian; Lancsar, Emily; Haas, Marion; Lind, Bronwyn; Weatherburn, Don; Chen, Shuling

2004-01-01

In New South Wales, Australia, a cost-effectiveness evaluation was conducted of an adult drug court (ADC) program as an alternative to jail for criminal offenders addicted to illicit drugs. This article describes the program, the cost-effectiveness analysis, and the results. The results of this study reveal that, for the 23-month period of the…

Cost-Utility and Cost-Effectiveness Analyses of Face-to-Face Versus Telephone-Based Nonpharmacologic Multidisciplinary Treatments for Patients With Generalized Osteoarthritis.

PubMed

Cuperus, Nienke; van den Hout, Wilbert B; Hoogeboom, Thomas J; van den Hoogen, Frank H J; Vliet Vlieland, Thea P M; van den Ende, Cornelia H M

2016-04-01

To evaluate, from a societal perspective, the cost utility and cost effectiveness of a nonpharmacologic face-to-face treatment program compared with a telephone-based treatment program for patients with generalized osteoarthritis (GOA). An economic evaluation was carried out alongside a randomized clinical trial involving 147 patients with GOA. Program costs were estimated from time registrations. One-year medical and nonmedical costs were estimated using cost questionnaires. Quality-adjusted life years (QALYs) were estimated using the EuroQol (EQ) classification system, EQ rating scale, and the Short Form 6D (SF-6D). Daily function was measured using the Health Assessment Questionnaire (HAQ) disability index (DI). Cost and QALY/effect differences were analyzed using multilevel regression analysis and cost-effectiveness acceptability curves. Medical costs of the face-to-face treatment and telephone-based treatment were estimated at €387 and €252, respectively. The difference in total societal costs was nonsignificantly in favor of the face-to-face program (difference €708; 95% confidence interval [95% CI] -€5,058, €3,642). QALYs were similar for both groups according to the EQ, but were significantly in favor of the face-to-face group, according to the SF-6D (difference 0.022 [95% CI 0.000, 0.045]). Daily function was similar according to the HAQ DI. Since both societal costs and QALYs/effects were in favor of the face-to-face program, the economic assessment favored this program, regardless of society's willingness to pay. There was a 65-90% chance that the face-to-face program had better cost utility and a 60-70% chance of being cost effective. This economic evaluation from a societal perspective showed that a nonpharmacologic, face-to-face treatment program for patients with GOA was likely to be cost effective, relative to a telephone-based program. © 2016, American College of Rheumatology.

The use of one- versus two-tailed tests to evaluate prevention programs.

PubMed

Ringwalt, Chris; Paschall, M J; Gorman, Dennis; Derzon, James; Kinlaw, Alan

2011-06-01

Investigators have used both one- and two-tailed tests to determine the significance of findings yielded by program evaluations. While the literature that addresses the appropriate use of each type of significance test should be used is historically inconsistent, almost all authorities now agree that one-tailed tests are rarely (if ever) appropriate. A review of 85 published evaluations of school-based drug prevention curricula specified on the National Registry of Effective Programs and Practices revealed that 20% employed one-tailed tests and, within this subgroup, an additional 4% also employed two-tailed tests. The majority of publications either did not specify the type of statistical test employed or used some other criterion such as effect sizes or confidence intervals. Evaluators reported that they used one-tailed tests either because they stipulated the direction of expected findings in advance, or because prior evaluations of similar programs had yielded no negative results. The authors conclude that one-tailed tests should never be used because they introduce greater potential for Type I errors and create an uneven playing field when outcomes are compared across programs. The authors also conclude that the traditional threshold of significance that places α at .05 is arbitrary and obsolete, and that evaluators should consistently report the exact p values they find.

[Development and Evaluation of a Self-Reflection Program for Intensive Care Unit Nurses Who Have Experienced the Death of Pediatric Patients].

PubMed

Kang, Hyun Ju; Bang, Kyung Sook

2017-06-01

This study aims to develop a self-reflection program for nurses who have experienced the death of pediatric patients in the intensive care unit and to evaluate its effectiveness. The self-reflection program was developed by means of the following four steps: establishment of the goal through investigation of an initial request, drawing up the program, preliminary research, and implementation and improvement of the program. The study employed a methodological triangulation to evaluate the effectiveness of the program. Participants were 38 nurses who had experienced the death of pediatric patients (experimental group=15, control group=23); they were recruited using convenience sampling. The self-reflection program was provided over 6 weeks (6 sessions). Data were collected from April to August, 2014 and analyzed using t-tests and content analysis. The quantitative results showed that changes in personal growth (t=-6.33, p<.001) and burnout scores (z=-2.76, p=.005) were better in the experimental group compared to the control group. The qualitative results exhibited two themes, namely "personal growth" and "professional growth", and ten sub-themes. The self-reflection program developed by this study was effective in helping nurses who had experienced the death of pediatric patients to achieve personal growth through self-reflection, and it was confirmed that the program can be applied in a realistic clinical nursing setting. Furthermore, it can be recommended as an intervention program for clinical nurses. © 2017 Korean Society of Nursing Science

Evaluation Study of Short-Term Programs at a Residential School for Students Who Are Blind and Visually Impaired

ERIC Educational Resources Information Center

Pogrund, Rona L.; Darst, Shannon; Boland, Teryl

2013-01-01

Introduction: The results of a 2009-2010 program evaluation study that examined parents, teachers of students with visual impairments, administrators, and students regarding overall satisfaction with and effectiveness of the short-term programs at a residential school for students who are blind and visually impaired are described. The findings are…

A Large Sample Evaluation of a Court-Mandated Batterer Intervention Program: Investigating Differential Program Effect for African American and Caucasian Men

ERIC Educational Resources Information Center

Buttell, Frederick P.; Carney, Michelle Mohr

2006-01-01

Objective: The purpose of the present study was to (a) evaluate a 26-week batterer intervention program by investigating changes in psychological variables related to abuse (i.e., truthfulness, violence, lethality, control, alcohol use, drug use, and stress coping abilities) between pretreatment and posttreatment assessments in a large sample of…

WWC Review of the Report "Evaluation of the College Possible Program: Results from a Randomized Controlled Trial." What Works Clearinghouse Single Study Review

ERIC Educational Resources Information Center

What Works Clearinghouse, 2014

2014-01-01

The 2013 study, "Evaluation of the College Possible Program: Results From a Randomized Controlled Trial", investigated the effect of the "College Possible" program, which is designed to serve low-income high school students by providing SAT/ACT test preparation, financial aid consulting, and college admissions guidance in an…

Adding to the Pool of Methods for Program Evaluation: A Comparison of Latent Class Analysis and Propensity Score Analysis

ERIC Educational Resources Information Center

Taylor, Lauren Christine

2013-01-01

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

Development of the SIT, an Instrument to Evaluate the Transfer Effects of Adult Education Programs for Social Inclusion

ERIC Educational Resources Information Center

de Greef, Maurice; Segers, Mien; Verte, Dominique

2010-01-01

To date, hardly any evidence is available on the quality of adult education programs for vulnerable adults. Evaluation instruments or models mostly focussed on regular education and less on programs of adult education aiming to enhance social inclusion. This study presents a first exploration of the construct validity of a newly developed…

Youth Empowerment Solutions: Evaluation of an After-School Program to Engage Middle School Students in Community Change

ERIC Educational Resources Information Center

Zimmerman, Marc A.; Eisman, Andria B.; Reischl, Thomas M.; Morrel-Samuels, Susan; Stoddard, Sarah; Miller, Alison L.; Hutchison, Pete; Franzen, Susan; Rupp, Laney

2018-01-01

We report on an effectiveness evaluation of the Youth Empowerment Solutions (YES) program. YES applies empowerment theory to an after-school program for middle school students. YES is an active learning curriculum designed to help youth gain confidence in themselves, think critically about their community, and work with adults to create positive…

An Evaluation of the Employee Training and Development Process for Nicolet Area Technical College's Basic Education Program.

ERIC Educational Resources Information Center

Karl, Luis C.

The adult basic education (ABE) program at Nicolet Area Technical College (NATC) evaluated its training and development (T&D) process for new basic education instructors. The study gathered monitoring and screening criteria that addressed valuable components for use in an instrument for validating effectiveness of the ABE program (T&D)…

Evaluation of the Pilot Mentoring Program at the Research Foundation for SUNY

ERIC Educational Resources Information Center

Henderson-Harr, Amy; Caggiano-Siino, Kathleen; Prewitt, Ashlee

2016-01-01

This article provides a description of an 18-month pilot program focused on the leadership development of the next generation of research administrators (RAs) in the State University of New York system (SUNY). The key questions for the evaluators were: 1) can we create a developmental program that effectively prepares the next generation of RAs;…

Decreasing Heavy Drinking in First-Year Students: Evaluation of a Web-Based Personalized Feedback Program Administered during Orientation

ERIC Educational Resources Information Center

Doumas, Diana M.; Kane, Christina M.; Navarro, Tabitha B.; Roman, Jennifer

2011-01-01

This study evaluated the effectiveness of a web-based personalized normative feedback program, electronic Check-Up to Go (e-CHUG), in decreasing heavy drinking among 1st-year university students. Results indicated high-risk students receiving the e-CHUG program during 1st-year orientation activities reported significantly greater reductions in…

Evaluation of the Student Engagement Process in a Criminal Justice Program at a Technical College

ERIC Educational Resources Information Center

Totzke, Martin W.

2007-01-01

This applied dissertation was an evaluation of the student engagement practices offered to students in a criminal justice program at a Midwestern technical college. The problem was that an evaluation of the practices had not been conducted to provide data to indicate whether the current practices were effective. The researcher developed an…

Design and evaluation of brushless electrical generators

NASA Technical Reports Server (NTRS)

Collins, F. A.; Ellis, J. N.

1970-01-01

Ten design manuals assembled and nine computer programs are developed for evaluation of proposed designs of brushless rotating electrical generators. Design manual package provides all information required for generator design, and computer programs permit calculation of performance of specific designs including effects of materials.

An Evaluation of Micro PLATO Fortran 77 Instruction.

ERIC Educational Resources Information Center

Funk, Kenneth; And Others

1986-01-01

Evaluated the use of computer assisted instruction in teaching Fortran 77 in the College of Engineering at Oregon State University. Also investigated the effect of such factors as mathematics and computer programming background on student performance in an introductory programming course sequence. (JN)

Evaluation plan for state gas heating system retrofit pilot programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berry, L.; Vineyard, T.

This report presents a detailed plan for the evaluation of state gas heating system retrofit pilot programs. The major goals of the evaluation procedures are to document the fuel savings and cost effectiveness of (1) the programs implemented by the states and (2) the four retrofit types installed. The major tasks involved in the evaluation include identification of program-eligible households, screening for data quality, assignment of eligible households to treatment or control groups, assembling cost data, collecting pre- and postretrofit consumption data, obtainin pre- and postretrofit weather data, checking for data quality, and analyzing the data. Data analysis relies onmore » the calculation of weather-adjusted normalized annual consumption (NAC) figures for pre- and postretrofit years for treatment and control groups. The differences between the treatment and control groups' NACs for the pre- and postretrofit years are the measure of the program's impact. Cost effectiveness analysis will combine the NAC results with cost data and with a variety of assumptions concerning future fuel prices, retrofit lifetimes, and discount rates to produce benefit/cost indicators.« less

An evaluation of undergraduate family care programs.

PubMed

Silberstein, E B; Scott, C J

1978-01-01

Evaluation of the many new family care programs (FCP), and others of similar intent, however defined, is as essential as determining the value of any other curriculum change. Replies to a questionnaire from 101 U.S. and 15 Canadian medical schools indicated that 80% of the former and 93% of the latter had FCPs; 35% and 29%, respectively, were not evaluating their program by any method. No single evaluative technique was used by more than 42% of the American medical schools. A review of the literature on FCPs frequently indicated that the conclusions that could be drawn about the programs were ambiguous. Students in the University of Cincinnati Medical Center FCPs elected family practice or pediatric internships significantly more often than did the FCP nonparticipants, but they indicated that the program had little effect on this choice, despite almost uniformly favorable testimonials. We discuss the possibility that FCPs may be educating the wrong students, that FCPs, if not reinforced in other clinical areas, may have few lasting effects on student attitudes or career choice, and that we may be asking the wrong questions, and with inadequate methods.

Simulation of the XV-15 tilt rotor research aircraft

NASA Technical Reports Server (NTRS)

Churchill, G. B.; Dugan, D. C.

1982-01-01

The effective use of simulation from issuance of the request for proposal through conduct of a flight test program for the XV-15 Tilt Rotor Research Aircraft is discussed. From program inception, simulation complemented all phases of XV-15 development. The initial simulation evaluations during the source evaluation board proceedings contributed significantly to performance and stability and control evaluations. Eight subsequent simulation periods provided major contributions in the areas of control concepts; cockpit configuration; handling qualities; pilot workload; failure effects and recovery procedures; and flight boundary problems and recovery procedures. The fidelity of the simulation also made it a valuable pilot training aid, as well as a suitable tool for military and civil mission evaluations. Simulation also provided valuable design data for refinement of automatic flight control systems. Throughout the program, fidelity was a prime issue and resulted in unique data and methods for fidelity evaluation which are presented and discussed.

Bearing tester data compilation, analysis, and reporting and bearing math modeling

NASA Technical Reports Server (NTRS)

1983-01-01

The Shaberth bearing analysis computer program was developed for the analysis of jet engine shaft/bearing systems operating above room temperature with normal hydrocarbon lubricants. It is also possible to use this tool to evaluate the shaft bearing systems operating in cryogenics. Effects such as fluid drag, radial temperature gradients, outer race misalignments and clearance changes were simulated and evaluated. In addition, the speed and preload effects on bearing radial stiffness was evaluated. The Shaberth program was also used to provide contact stresses from which contact geometry was calculated to support other analyses such as the determination of cryogenic fluid film thickness in the contacts and evaluation of surface and subsurface stresses necessary for bearing failure evaluation. This program was a vital tool for the thermal analysis of the bearing in that it provides the heat generation rates at the rolling element/race contacts for input into a thermal model of the bearing/shaft assembly.

Evaluating the Effectiveness of the Self-Test on Structured Classroom Learning

ERIC Educational Resources Information Center

Gilkey, Anthony Dean

1977-01-01

The study focused on the effect of the self-evaluation component of self-instructional packets in radiologic technology programs. It was found that the self-evaluation component clearly had a significant positive effect on learning, although the relative learning contribution of the component was not established. (MF)

"Volunteering by chance" to promote civic responsibility and civic engagement: does it work?

PubMed

Santinello, Massimo; Cristini, Francesca; Vieno, Alessio; Scacchi, Luca

2012-01-01

This study investigated the effectiveness of a program to promote civic responsibility and prevent antisocial behavior in a sample of Italian adolescents. Participants were 83 Italian male adolescents, attending the second year of high school (Mean age = 15.79; SD = 0.87). In order to test the efficacy of different strategies (in-classroom training and service activity in a voluntary organization) we divided students into two experimental groups--one classroom of students participated in both strategies (training + volunteering group) and another classroom only participated in the training (training only group)--and one control group. Process and efficacy evaluations were completed. Data were collected before and following the intervention. The process evaluation revealed that the program was highly accepted and appreciated by students. The efficacy evaluation revealed no intervention effects on civic responsibility. However, the training + volunteering group reported a significant decrease in antisocial behavior after the program. Thus, the program was effective in preventing antisocial behavior but not in promoting civic responsibility in our sample.

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

PubMed Central

Arseneault, Catherine; Alain, Marc; Plourde, Chantal; Ferland, Francine; Blanchette-Martin, Nadine; Rousseau, Michel

2015-01-01

OBJECTIVES This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. METHOD A quasi-experimental repeated measures design (0, 6 weeks, and 6 months) was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program (n = 80; experimental group) with those of another group who had received no intervention (n = 70; control group). RESULTS The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. CONCLUSION Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used. PMID:26056466

Methodological Considerations for Use of Routine Health Information System Data to Evaluate Malaria Program Impact in an Era of Declining Malaria Transmission

PubMed Central

Ashton, Ruth A.; Bennett, Adam; Yukich, Joshua; Bhattarai, Achuyt; Keating, Joseph; Eisele, Thomas P.

2017-01-01

Abstract. Coverage of malaria control interventions is increasing dramatically across endemic countries. Evaluating the impact of malaria control programs and specific interventions on health indicators is essential to enable countries to select the most effective and appropriate combination of tools to accelerate progress or proceed toward malaria elimination. When key malaria interventions have been proven effective under controlled settings, further evaluations of the impact of the intervention using randomized approaches may not be appropriate or ethical. Alternatives to randomized controlled trials are therefore required for rigorous evaluation under conditions of routine program delivery. Routine health management information system (HMIS) data are a potentially rich source of data for impact evaluation, but have been underused in impact evaluation due to concerns over internal validity, completeness, and potential bias in estimates of program or intervention impact. A range of methodologies were identified that have been used for impact evaluations with malaria outcome indicators generated from HMIS data. Methods used to maximize internal validity of HMIS data are presented, together with recommendations on reducing bias in impact estimates. Interrupted time series and dose-response analyses are proposed as the strongest quasi-experimental impact evaluation designs for analysis of malaria outcome indicators from routine HMIS data. Interrupted time series analysis compares the outcome trend and level before and after the introduction of an intervention, set of interventions or program. The dose-response national platform approach explores associations between intervention coverage or program intensity and the outcome at a subnational (district or health facility catchment) level. PMID:28990915

Study protocol: translating and implementing psychosocial interventions in aged home care the lifestyle engagement activity program (LEAP) for life

PubMed Central

2013-01-01

Background Tailored psychosocial activity-based interventions have been shown to improve mood, behaviour and quality of life for nursing home residents. Occupational therapist delivered activity programs have shown benefits when delivered in home care settings for people with dementia. The primary aim of this study is to evaluate the effect of LEAP (Lifestyle Engagement Activity Program) for Life, a training and practice change program on the engagement of home care clients by care workers. Secondary aims are to evaluate the impact of the program on changes in client mood and behaviour. Methods/design The 12 month LEAP program has three components: 1) engaging site management and care staff in the program; 2) employing a LEAP champion one day a week to support program activities; 3) delivering an evidence-based training program to care staff. Specifically, case managers will be trained and supported to set meaningful social or recreational goals with clients and incorporate these into care plans. Care workers will be trained in and encouraged to practise good communication, promote client independence and choice, and tailor meaningful activities using Montessori principles, reminiscence, music, physical activity and play. LEAP Champions will be given information about theories of organisational change and trained in interpersonal skills required for their role. LEAP will be evaluated in five home care sites including two that service ethnic minority groups. A quasi experimental design will be used with evaluation data collected four times: 6-months prior to program commencement; at the start of the program; and then after 6 and 12 months. Mixed effect models will enable comparison of change in outcomes for the periods before and during the program. The primary outcome measure is client engagement. Secondary outcomes for clients are satisfaction with care, dysphoria/depression, loneliness, apathy and agitation; and work satisfaction for care workers. A process evaluation will also be undertaken. Discussion LEAP for Life may prove a cost-effective way to improve client engagement and other outcomes in the community setting. Trial registration Australian New Zealand Clinical Trials Registry ACTRN12612001064897. PMID:24238067

An Outcome Evaluation of the Success for Kids Program

PubMed Central

Maestas, Nicole; Gaillot, Sarah J.

2012-01-01

Abstract This article presents results from a multisite, quantitative evaluation of the international Success for Kids (SFK) after-school program. The program seeks to build resilience in children by teaching them to access inner resources and build positive connections with others. The SFK program is unlike most after-school programs both in its focus on spiritual development and in its emphasis on outcomes related to resilience rather than academics. The authors found that the program had beneficial effects on adaptive skills, behavioral problems, overexternalization of problems, and school problems, and the effects persisted at 12-week follow-up. Interestingly, the program positively affected school-related outcomes, even though SFK is not an academic intervention. Specifically, it improved reported study skills and reduced reported learning problems and attention problems. Overall, a major strength of the program appears to be its careful attention to uniformity of program delivery—in particular, its standardized curriculum, use of experienced teachers, and formal teacher-training program. PMID:28083226

An Outcome Evaluation of the Success for Kids Program.

PubMed

Maestas, Nicole; Gaillot, Sarah J

2012-01-01

This article presents results from a multisite, quantitative evaluation of the international Success for Kids (SFK) after-school program. The program seeks to build resilience in children by teaching them to access inner resources and build positive connections with others. The SFK program is unlike most after-school programs both in its focus on spiritual development and in its emphasis on outcomes related to resilience rather than academics. The authors found that the program had beneficial effects on adaptive skills, behavioral problems, overexternalization of problems, and school problems, and the effects persisted at 12-week follow-up. Interestingly, the program positively affected school-related outcomes, even though SFK is not an academic intervention. Specifically, it improved reported study skills and reduced reported learning problems and attention problems. Overall, a major strength of the program appears to be its careful attention to uniformity of program delivery-in particular, its standardized curriculum, use of experienced teachers, and formal teacher-training program.

Defining a staged-based process for economic and financial evaluations of mHealth programs.

PubMed

LeFevre, Amnesty E; Shillcutt, Samuel D; Broomhead, Sean; Labrique, Alain B; Jones, Tom

2017-01-01

Mobile and wireless technology for health (mHealth) has the potential to improve health outcomes by addressing critical health systems constraints that impede coverage, utilization, and effectiveness of health services. To date, few mHealth programs have been implemented at scale and there remains a paucity of evidence on their effectiveness and value for money. This paper aims to improve understanding among mHealth program managers and key stakeholders of how to select methods for economic evaluation (comparative analysis for determining value for money) and financial evaluation (determination of the cost of implementing an intervention, estimation of costs for sustaining or expanding an intervention, and assessment of its affordability). We outline a 6 stage-based process for selecting and integrating economic and financial evaluation methods into the monitoring and evaluation of mHealth solutions including (1) defining the program strategy and linkages with key outcomes, (2) assessment of effectiveness, (3) full economic evaluation or partial evaluation, (4) sub-group analyses, (5) estimating resource requirements for expansion, (6) affordability assessment and identification of models for financial sustainability. While application of these stages optimally occurs linearly, finite resources, limited technical expertise, and the timing of evaluation initiation may impede this. We recommend that analysts prioritize economic and financial evaluation methods based on programmatic linkages with health outcomes; alignment with an mHealth solution's broader stage of maturity and stage of evaluation; overarching monitoring and evaluation activities; stakeholder evidence needs; time point of initiation; and available resources for evaluations.

Pediatric Resident-as-Teacher Curricula: A National Survey of Existing Programs and Future Needs.

PubMed

Fromme, H Barrett; Whicker, Shari A; Paik, Steve; Konopasek, Lyuba; Koestler, Jennifer L; Wood, Beverly; Greenberg, Larrie

2011-06-01

We conducted a national survey of US pediatric program directors to explore the current status, content, and teaching methods of Resident-as-Teacher (RAT) curricula. The purposes of the survey were to (1) determine the level and method of evaluation of such curricula, and (2) assess the need for a national curricular resource in this area. A survey was sent to US pediatric program directors that asked questions regarding demographics, support, design, development, content, and evaluation of RAT curricula, as well as existing needs and desires for RAT curricular resources. Sixty-two percent of pediatric program directors completed our survey. Eighty-seven percent have a formal RAT curriculum, but more than 50% allocate 10 hours or less to it during residency. The primary teaching modalities are lectures and workshops. Content areas include feedback, in-patient teaching, communication skills, case-based teaching, role modeling, evaluation, leadership skills, 1-minute preceptors, teaching/learning styles, professionalism, and small-group teaching. Sixty-three percent of programs report evaluating their curricula, but only 27% perceive their program to be very/extremely effective. Nearly all respondents expressed interest in a national RAT curriculum, preferring web-based modules for dissemination. Despite an Accreditation Council for Graduate Medical Education requirement for a RAT curriculum, some pediatrics programs still lack one, and some consider their program only moderately effective. A wealth of curricular material exists across programs, which could be shared nationally. Establishing a national RAT curriculum would offer programs resources to meet educational mandates and the ability to tailor programs to best fit their own program needs.

A worksite prevention program for construction workers: design of a randomized controlled trial.

PubMed

Oude Hengel, Karen M; Joling, Catelijne I; Proper, Karin I; Blatter, Birgitte M; Bongers, Paulien M

2010-06-14

A worksite prevention program was developed to promote the work ability of construction workers and thereby prolong a healthy working life. The objective of this paper is to present the design of a randomized controlled trial evaluating the effectiveness of that intervention program compared with usual care for construction workers. The study is designed as a randomized controlled trial with a follow-up of one year. Employees eligible for this study are construction workers performing actual construction work. The worksite intervention will be compared with usual care. This intervention was developed by using the Intervention Mapping approach and consists of the following components: (1) two individual training sessions of a physical therapist to lower the physical workload, (2) a Rest-Break tool to improve the balance between work and recovery, and (3) two empowerment training sessions to increase the influence of the construction workers at the worksite. Outcome measures are assessed at baseline, 3, 6, and 12 months. The primary outcome measures of this study are work ability and health-related quality of life. Secondary outcome measures include need for recovery, musculoskeletal complaints, work engagement and self efficacy. Cost-effectiveness will be evaluated from the company perspective. Moreover, a process evaluation will be conducted. The feasibility of the intervention and the study has been enhanced by creating an intervention program that explicitly appeals to construction workers and will not interfere too much with the ongoing construction. The feasibility and effectiveness of this worksite prevention program will be investigated by means of an effect- and a process evaluation. If proven effective, this worksite prevention program can be implemented on a larger scale within the construction industry. NTR1278.

A worksite prevention program for construction workers: design of a randomized controlled trial

PubMed Central

2010-01-01

Background A worksite prevention program was developed to promote the work ability of construction workers and thereby prolong a healthy working life. The objective of this paper is to present the design of a randomized controlled trial evaluating the effectiveness of that intervention program compared with usual care for construction workers. Methods The study is designed as a randomized controlled trial with a follow-up of one year. Employees eligible for this study are construction workers performing actual construction work. The worksite intervention will be compared with usual care. This intervention was developed by using the Intervention Mapping approach and consists of the following components: (1) two individual training sessions of a physical therapist to lower the physical workload, (2) a Rest-Break tool to improve the balance between work and recovery, and (3) two empowerment training sessions to increase the influence of the construction workers at the worksite. Outcome measures are assessed at baseline, 3, 6, and 12 months. The primary outcome measures of this study are work ability and health-related quality of life. Secondary outcome measures include need for recovery, musculoskeletal complaints, work engagement and self efficacy. Cost-effectiveness will be evaluated from the company perspective. Moreover, a process evaluation will be conducted. Discussion The feasibility of the intervention and the study has been enhanced by creating an intervention program that explicitly appeals to construction workers and will not interfere too much with the ongoing construction. The feasibility and effectiveness of this worksite prevention program will be investigated by means of an effect- and a process evaluation. If proven effective, this worksite prevention program can be implemented on a larger scale within the construction industry. Trial Registration NTR1278 PMID:20546568

Findings From a Prospective Randomized Controlled Trial of an Individualized Music Listening Program for Persons With Dementia.

PubMed

Kwak, Jung; Anderson, Keith; O'Connell Valuch, Katharine

2018-06-01

Music & Memory (M&M) is a passive music intervention that uses personalized music playlists delivered on digital music players. This program has been increasingly adopted in nursing homes across the United States to facilitate communication, engagement, and socialization among persons with dementia (PWDs); however, few studies have evaluated the program's effect on PWDs' outcomes. In the present study, a randomized controlled crossover design was used to examine the impact of the M&M program on 59 PWDs in 10 nursing homes over a 14-week period. Residents' evaluated outcomes included agitation, behavioral symptoms, and use of psychotropic medications. Although trends supported the positive effects of M&M, no statistically significant differences were found in any of the outcomes measured over time. Methodological limitations withstanding, these findings call into question the effectiveness of the M&M program and the ability of facility staff to implement this intervention with fidelity.

Evaluation of a community-based, family focused healthy weights initiative using the RE-AIM framework.

PubMed

Jung, Mary E; Bourne, Jessica E; Gainforth, Heather L

2018-01-26

Childhood overweight and obesity is a major public health concern. Community-based interventions have the potential to reach caregivers and children. However, the overall health impact of these programs is rarely comprehensively assessed. This study evaluated a physical activity and healthy eating family program (Healthy Together; HT) using the RE-AIM framework. Ten sites implemented the 5-week program. Thirty-nine staff members and 277 program participants (126 caregivers [M age  = 35.6] and 151 children [M age  = 13]) participated in the evaluation. Each RE-AIM dimension was assessed independently using a mixed-methods approach. Sources of data included archival records, interviews and surveys. Effectiveness outcome variables were assessed at pre- and post-intervention and 6-month follow-up. Reach: HT participants were almost entirely recruited from existing programs within sites. Effectiveness: Caregivers' nutrition related efficacy beliefs increased following HT (ps < .03). Participation in HT was not associated with significant changes in physical activity or nutrition behaviour or perceived social support (ps > .05). Knowledge surrounding healthy diets and physical activity increased in children and caregivers (ps < .05). Adoption: Thirty-five percent of sites approached to implement HT expressed interest. The 10 sites selected recruited existing staff members to implement HT. Program objectives were met 72.8% of the time and 71 adaptations were made. HT was finance- and time-dependent. Maintenance: Two sites fully implemented HT in the follow-up year and 5 sites incorporated aspects of HT into other programs. Working alongside organizations that develop community programs to conduct comprehensive, arms-length evaluations can systematically highlight areas of success and challenges. Overall HT represents a feasible community-based intervention; however further support is required in order to ensure the program is effective at positively targeting the desired outcomes. As a result of this evaluation, modifications are currently being implemented to HT.

Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

PubMed Central

2013-01-01

Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

A 3-Month Jump-Landing Training Program: A Feasibility Study Using the RE-AIM Framework

PubMed Central

Aerts, Inne; Cumps, Elke; Verhagen, Evert; Mathieu, Niels; Van Schuerbeeck, Sander; Meeusen, Romain

2013-01-01

Context: Evaluating the translatability and feasibility of an intervention program has become as important as determining the effectiveness of the intervention. Objective: To evaluate the applicability of a 3-month jump-landing training program in basketball players, using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. Design: Randomized controlled trial. Setting: National and regional basketball teams. Patients or Other Participants: Twenty-four teams of the second highest national division and regional basketball divisions in Flanders, Belgium, were randomly assigned (1:1) to a control group and intervention group. A total of 243 athletes (control group = 129, intervention group = 114), ages 15 to 41 years, volunteered. Intervention(s): All exercises in the intervention program followed a progressive development, emphasizing lower extremity alignment during jump-landing activities. Main Outcome Measure(s): The results of the process evaluation of the intervention program were based on the 5 dimensions of the RE-AIM framework. The injury incidence density, hazard ratios, and 95% confidence intervals were determined. Results: The participation rate of the total sample was 100% (reach). The hazard ratio was different between the intervention group and the control group (0.40 [95% confidence interval = 0.16, 0.99]; effectiveness). Of the 12 teams in the intervention group, 8 teams (66.7%) agreed to participate in the study (adoption). Eight of the participating coaches (66.7%) felt positively about the intervention program and stated that they had implemented the training sessions of the program as intended (implementation). All coaches except 1 (87.5%) intended to continue the intervention program the next season (maintenance). Conclusions: Compliance of the coaches in this coach-supervised jump-landing training program was high. In addition, the program was effective in preventing lower extremity injuries. PMID:23675788

A 3-month jump-landing training program: a feasibility study using the RE-AIM framework.

PubMed

Aerts, Inne; Cumps, Elke; Verhagen, Evert; Mathieu, Niels; Van Schuerbeeck, Sander; Meeusen, Romain

2013-01-01

Evaluating the translatability and feasibility of an intervention program has become as important as determining the effectiveness of the intervention. To evaluate the applicability of a 3-month jump-landing training program in basketball players, using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework. Randomized controlled trial. National and regional basketball teams. Twenty-four teams of the second highest national division and regional basketball divisions in Flanders, Belgium, were randomly assigned (1:1) to a control group and intervention group. A total of 243 athletes (control group = 129, intervention group = 114), ages 15 to 41 years, volunteered. All exercises in the intervention program followed a progressive development, emphasizing lower extremity alignment during jump-landing activities. The results of the process evaluation of the intervention program were based on the 5 dimensions of the RE-AIM framework. The injury incidence density, hazard ratios, and 95% confidence intervals were determined. The participation rate of the total sample was 100% (reach). The hazard ratio was different between the intervention group and the control group (0.40 [95% confidence interval = 0.16, 0.99]; effectiveness). Of the 12 teams in the intervention group, 8 teams (66.7%) agreed to participate in the study (adoption). Eight of the participating coaches (66.7%) felt positively about the intervention program and stated that they had implemented the training sessions of the program as intended (implementation). All coaches except 1 (87.5%) intended to continue the intervention program the next season (maintenance). Compliance of the coaches in this coach-supervised jump-landing training program was high. In addition, the program was effective in preventing lower extremity injuries.

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

DOE Office of Scientific and Technical Information (OSTI.GOV)

White, M R

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledgemore » regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna (ground receiving station).« less

PASHA: facilitating the replication and use of effective adolescent pregnancy and STI/HIV prevention programs.

PubMed

Card, Josefina J; Lessard, Laura; Benner, Tabitha

2007-03-01

It is important that interventions that have been shown effective in changing risky behavior be disseminated, so that they can be replicated (implemented in a new site) and so that their effectiveness in a new setting can be investigated. This article provides an update on an innovative resource for promoting the replication of effective teen pregnancy and STI/HIV prevention programs. The resource is called the Program Archive on Sexuality, Health & Adolescence (PASHA). A Scientist Expert Panel rates candidate adolescent pregnancy and STI/HIV prevention programs based on the strength of the evidence of their effectiveness in changing risky sexual behavior among youth ages 10-19 (10-21 for STI/HIV prevention programs). Developers of selected programs are invited to make their program and evaluation materials publicly available through PASHA. PASHA publishes and disseminates replication kits for programs it successfully acquires. Fifty-six programs have been selected by PASHA's Scientist Expert Panel as "effective" in changing one or more risky behaviors associated with adolescent pregnancy or STI/HIV. Complete program and evaluation materials from 35 of these programs are now currently available through PASHA, five are pending, 12 are publicly available from other sources, and only four are not publicly available. PASHA programs are aimed at a diverse target population and cover diverse content on many abstinence and contraception/condom-related topics. Many pedagogical techniques are used to effect behavior change, noticeably role play and group discussion. PASHA illustrates well the productive research-to-practice feedback loop that is the backbone of "translation research." The resource can be used by adolescent pregnancy and STI/HIV prevention practitioners to put what works to work to continue the lowering of the nation's adolescent pregnancy and STI/HIV rates.

2010 Wind Program Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Swisher, Randy; Clark, Charlton; Beaudry-Losique, Jacques

This report documents the evaluation of the technical, scientific, and business results of over 80 projects of the Wind Program, as well as the productivity and management effectiveness of the Wind Program itself.

Evaluation of programs for adolescents with greater psychosocial needs: community-based Project P.A.T.H.S. in Hong Kong.

PubMed

Shek, Daniel T L; Law, Moon Y M

2017-02-01

This study examined the perceptions of the Tier 2 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social programmes) among Chinese secondary school students displaying greater psychosocial needs. Results showed that participants held positive views of program qualities, implementer qualities, as well as the perceived effectiveness of the program. Significant grade differences in terms of various indicators of satisfaction related to program qualities, implementer qualities, and program effectiveness were found. Correlation analyses showed that there were significant inter-relationships amongst program qualities, implementer qualities and program effectiveness. In line with the predictions, both program qualities and implementer qualities were significant predictors of perceived program effectiveness. The present study provides support for the perceived effectiveness of the Tier 2 Program of the Project P.A.T.H.S. in the community-based project context.

Program Evaluation Grant. Final Report.

ERIC Educational Resources Information Center

Quadco Rehabilitation Center, Inc., Stryker, OH.

The purpose of the project was to increase the effectiveness and efficiency of those rehabilitation facilities which were utilized by the Ohio Rehabilitation Services Commission (RSC) through the development, installation, and utilization of a program evaluation system and a management information system. The two systems were developed and…

Crossroads Cafe Implementation Florida Evaluation.

ERIC Educational Resources Information Center

McLean, Teri

The evaluation reviews the implementation of the "Crossroads Cafe" English language instruction program in Florida, focusing on the program's management, training, and overall effectiveness as measured by its impact on adult English-as-a-Second-Language (ESL) teachers and learners. "Crossroads Cafe" is a series of videotape…