Oasis Connections: Results from an Evaluation Study

ERIC Educational Resources Information Center

Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-01-01

Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Evaluation and communication: using a communication audit to evaluate organizational communication.

PubMed

Hogard, Elaine; Ellis, Roger

2006-04-01

This article identifies a surprising dearth of studies that explicitly link communication and evaluation at substantive, theoretical, and methodological levels. A three-fold typology of evaluation studies referring to communication is proposed and examples given. The importance of organizational communication in program delivery is stressed and illustrative studies reviewed. It is proposed that organizational communication should be considered in all program evaluations and that this should be approached through communication audit. Communication audits are described with particular reference to established survey questionnaire instruments. Two case studies exemplify the use of such instruments in the evaluation of educational and social programs.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

PubMed Central

Jaafaripooyan, Ebrahim

2014-01-01

Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

Integrating Program Theory and Systems-Based Procedures in Program Evaluation: A Dynamic Approach to Evaluate Educational Programs

ERIC Educational Resources Information Center

Grammatikopoulos, Vasilis

2012-01-01

The current study attempts to integrate parts of program theory and systems-based procedures in educational program evaluation. The educational program that was implemented, called the "Early Steps" project, proposed that physical education can contribute to various educational goals apart from the usual motor skills improvement. Basic…

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

PubMed

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design in evaluating the training program, the training program is expected to be efficiently and rapidly implemented into and adjusted to care practice and medical education.

Program Evaluation of Community College Learning Assistance Centers: What Do LAC Directors Think?

ERIC Educational Resources Information Center

Franklin, Doug; Blankenberger, Bob

2016-01-01

Objective: This study seeks to determine the nature of current program evaluation practices for learning assistance centers (LACs), the practices being used for program evaluation, and whether LAC directors believe their practices are appropriate for evaluating program effectiveness. Method: We conducted a survey (n = 61) of community college LAC…

The Positive Alternative Credit Experience (PACE) Program a Quantitative Comparative Study

ERIC Educational Resources Information Center

Warren, Rebecca Anne

2011-01-01

The purpose of this quantitative comparative study was to evaluate the Positive Alternative Credit Experience (PACE) Program using an objectives-oriented approach to a formative program evaluation. The PACE Program was a semester-long high school alternative education program designed to serve students at-risk for academic failure or dropping out…

Conceptual framework for development of comprehensive e-health evaluation tool.

PubMed

Khoja, Shariq; Durrani, Hammad; Scott, Richard E; Sajwani, Afroz; Piryani, Usha

2013-01-01

The main objective of this study was to develop an e-health evaluation tool based on a conceptual framework including relevant theories for evaluating use of technology in health programs. This article presents the development of an evaluation framework for e-health programs. The study was divided into three stages: Stage 1 involved a detailed literature search of different theories and concepts on evaluation of e-health, Stage 2 plotted e-health theories to identify relevant themes, and Stage 3 developed a matrix of evaluation themes and stages of e-health programs. The framework identifies and defines different stages of e-health programs and then applies evaluation theories to each of these stages for development of the evaluation tool. This framework builds on existing theories of health and technology evaluation and presents a conceptual framework for developing an e-health evaluation tool to examine and measure different factors that play a definite role in the success of e-health programs. The framework on the horizontal axis divides e-health into different stages of program implementation, while the vertical axis identifies different themes and areas of consideration for e-health evaluation. The framework helps understand various aspects of e-health programs and their impact that require evaluation at different stages of the life cycle. The study led to the development of a new and comprehensive e-health evaluation tool, named the Khoja-Durrani-Scott Framework for e-Health Evaluation.

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Revisioning the Process: A Case Study in Feminist Program Evaluation.

ERIC Educational Resources Information Center

Beardsley, Rebecca M.; Miller, Michelle Hughes

2002-01-01

Conducted a case study of the evaluation of a women's substance abuse prevention program and identified three key aspects of negotiated evaluation. Discusses the processes involved in feminist evaluation, including collaborative agenda setting and cooperative teamwork. (SLD)

A systematic review of school-based suicide prevention programs.

PubMed

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

Integrating Data Mining in Program Evaluation of K-12 Online Education

ERIC Educational Resources Information Center

Hung, Jui-Long; Hsu, Yu-Chang; Rice, Kerry

2012-01-01

This study investigated an innovative approach of program evaluation through analyses of student learning logs, demographic data, and end-of-course evaluation surveys in an online K-12 supplemental program. The results support the development of a program evaluation model for decision making on teaching and learning at the K-12 level. A case study…

Evaluation of the impact of the drug evaluation and classification program on enforcement and adjudication

DOT National Transportation Integrated Search

1992-12-01

This study examined the effect of the Drug Evaluation and Classification (DEC) Program on impaired driving (DWI) enforcement and adjudication. Drug Recognition Experts (DREs) in DEC programs evaluate suspects when drugs other than alcohol are suspect...

76 FR 74076 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Final Notice

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-30

... Evaluate the YouthBuild Program; Final Notice AGENCY: Employment and Training Administration (ETA), Labor... rigorous, nationally-representative estimates of the net impacts of the YouthBuild program. The Department... study. In the sites randomly selected to participate in this evaluation, all applicants for YouthBuild...

Use of Bennett's Hierarchical Model in the Evaluation of the Extension Education Program for Cacao Farmers in the Northeast Region of the Dominican Republic. Summary of Research 54.

ERIC Educational Resources Information Center

De los Santos, Saturnino; Norland, Emmalou Van Tilburg

A study evaluated the cacao farmer training program in the Dominican Republic by testing hypothesized relationships among reactions, knowledge and skills, attitudes, aspirations, and some selected demographic characteristics of farmers who attended programs. Bennett's hierarchical model of program evaluation was used as the framework of the study.…

Training the Poor. A Benefit-Cost Analysis of Manpower Programs in the U.S. Antipoverty Program.

ERIC Educational Resources Information Center

Sewell, D. O.

This report critically reviews past benefit-cost studies of manpower programs and offers an alternative methodology for program evaluation. Because of selective admission criteria and a tendency to attribute all income changes to training, previous studies have had an upward bias in measuring the effectiveness of training. This study evaluates a…

An Evaluative Case Study of Nine Virtual High School Programs

ERIC Educational Resources Information Center

Bannister, Clara M.

2009-01-01

The purpose of this study was to conduct a program evaluation of nine virtual high school programs in the states of Alabama, California, Florida, Idaho, Colorado, Illinois, Michigan, North Carolina and Massachusetts. In order to assess the quality and effectiveness of the virtual high school programs in the study in terms of overall quality and…

Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

A Value-Added Approach to Selecting the Best Master of Business Administration (MBA) Program

ERIC Educational Resources Information Center

Fisher, Dorothy M.; Kiang, Melody; Fisher, Steven A.

2007-01-01

Although numerous studies rank master of business administration (MBA) programs, prospective students' selection of the best MBA program is a formidable task. In this study, the authors used a linear-programming-based model called data envelopment analysis (DEA) to evaluate MBA programs. The DEA model connects costs to benefits to evaluate the…

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

PubMed

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of a Group-Based Trauma Recovery Program in Gaza: Students' Subjective Experiences

ERIC Educational Resources Information Center

Barron, Ian; Abdullah, Ghassan

2012-01-01

Internationally, evaluation of group-based trauma recovery programs has relied upon normative outcome measures, with no studies systematically analyzing children's subjective experience for program development. In contrast, the current study explored children's experience of a Gazan recovery program "in their own words." Twenty-four…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Evaluation of the Radiography Program at Caldwell Community College and Technical Institute--Summer, 1982.

ERIC Educational Resources Information Center

Pipes, V. David

As part of a periodic evaluation of the occupational programs at Caldwell Community College and Technical Institute (CCC&TI), a study of the radiography program was conducted to collect information to facilitate planning, aid in program improvement, and meet accountability demands. The specific objectives of the program evaluation were to…

Program Evaluation of the English Language Proficiency Program for Foreign Students a Case Study: University of the East, Manila Campus

ERIC Educational Resources Information Center

Salimi, Esmaeel Ali; Farsi, Mitra

2016-01-01

This study on evaluating an English program of studies for foreign students seeking admission to the UE Graduate School attempts to examine the prevailing conditions of foreign students in the UE Graduate School with respect to their competence and competitiveness in English proficiency. It looks into the existing English programs of studies in…

Primary prevention research: a preliminary review of program outcome studies.

PubMed

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Developing and Using a Logic Model for Evaluation and Assessment of University Student Affairs Programming: A Case Study

ERIC Educational Resources Information Center

Cooper, Jeff

2009-01-01

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

Evaluation of STD/AIDS prevention programs: a review of approaches and methodologies.

PubMed

da Cruz, Marly Marques; dos Santos, Elizabeth Moreira; Monteiro, Simone

2007-05-01

The article presents a review of approaches and methodologies in the evaluation of STD/AIDS prevention programs, searching for theoretical and methodological support for the institutionalization of evaluation and decision-making. The review included the MEDLINE, SciELO, and ISI Web of Science databases and other sources like textbooks and congress abstracts from 1990 to 2005, with the key words: "evaluation", "programs", "prevention", "STD/AIDS", and similar terms. The papers showed a predominance of quantitative outcome or impact evaluative studies with an experimental or quasi-experimental design. The main use of evaluation is accountability, although knowledge output and program improvement were also identified in the studies. Only a few evaluative studies contemplate process evaluation and its relationship to the contexts. The review aimed to contribute to the debate on STD/AIDS, which requires more effective, consistent, and sustainable decisions in the field of prevention.

Arts Integration and Students' Reading Achievement: A Formative Evaluation Study

ERIC Educational Resources Information Center

Hosfelt, Patricia D.

2017-01-01

The purpose of this dissertation was to evaluate essential components of an arts-integration program that may contribute to improved student achievement in elementary reading at the school of study through a formative evaluation. Stufflebeam's CIPP model of program evaluation served as the conceptual framework for the study's findings. Creative…

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

PubMed

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Supplemental Literacy Instruction for Students with Down Syndrome: A Program Evaluation

ERIC Educational Resources Information Center

Regan, Lisa Michelle

2013-01-01

The study utilizes an inductive, qualitative approach to program evaluation to understand the nature of an afterschool literacy tutoring program for students with Down syndrome. Two research questions guide this study: (a) What are the curricular and instructional elements of the Let's Read Now (LRN) literacy tutoring program for students…

A Review of Elementary School-Based Substance Use Prevention Programs: Identifying Program Attributes

ERIC Educational Resources Information Center

Hopfer, S.; Davis, D.; Kam, J. A.; Shin, Y.; Elek, E.; Hecht, M. L.

2010-01-01

This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary…

Effects of the Saluda Prevention Program: A Review of Controlled Evaluation Studies

ERIC Educational Resources Information Center

Espada-Sánchez, José P.; Hernández-Serrano, Olga

2015-01-01

The objective of the present study is to review the evidence on the effectiveness concerning the Saluda program, a school-based substance use prevention protocol used amongst adolescents. We provide a description of the program content and the results from nine controlled trials evaluating the program effectiveness. Participants were Spanish…

Evaluating Federal Social Programs: An Uncertain Act.

ERIC Educational Resources Information Center

Levitan, Sar A.; Wurzburg, Gregory K.

This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

The Implementation of Program Evaluation Recommendations in Wisconsin Technical Colleges.

ERIC Educational Resources Information Center

Ruhland, Sheila K.

Implementation of program evaluation recommendations should persuade people that the rewards of an evaluation outweigh the reasons for resistance. A study was undertaken with the following purposes: identify facilitators and barriers to the implementation of program evaluation; determine the proportion of recommendations made in each of the nine…

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

PubMed

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

Academic Library Development Program: A Self Study.

ERIC Educational Resources Information Center

Carnegie-Mellon Univ., Pittsburgh, PA. University Libraries.

Results of a 4-month library self-evaluation program conducted by staff members at Carnegie-Mellon University Libraries are reported in this document. The study was conducted using the Academic Library Development Program (ALDP), a self-improvement strategy for libraries to evaluate and develop their performance. The study team consisting of four…

Data Collection Methods for Evaluating Museum Programs and Exhibitions

ERIC Educational Resources Information Center

Nelson, Amy Crack; Cohn, Sarah

2015-01-01

Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

PubMed

Jacobson, Miriam R; Azzam, Tarek

2018-06-01

This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluation of a Community-Based Aging Intervention Program

ERIC Educational Resources Information Center

Hsu, Hui-Chuan; Wang, Chun-Hou; Chen, Yi-Chun; Chang, Ming-Chen; Wang, Jean

2010-01-01

This study evaluated the outcome and process of a community-based aging intervention program for the elderly in Taiwan. The program included education on nutrition and dietary behavior and on physical activities. Outcome and process evaluations were conducted. The program may have had some effects on decreasing some dietary behavioral problems and…

Evaluation of a Research Mentorship Program in Community Care

ERIC Educational Resources Information Center

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

PubMed

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

PubMed Central

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

An Evaluation of the Cost Effectiveness of Alternative Compensatory Reading Programs, Volume IV: Cost Analysis of Summer Programs. Final Report.

ERIC Educational Resources Information Center

Al-Salam, Nabeel; Flynn, Donald L.

This report describes the results of a study of the cost and cost effectiveness of 27 summer reading programs, carried through as part of a large-scale evaluation of compensatory reading programs. Three other reports describe cost and cost-effectiveness studies of programs during the regular school year. On an instructional-hour basis, the total…

Curated Collections for Educators: Five Key Papers about Program Evaluation.

PubMed

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Curated Collections for Educators: Five Key Papers about Program Evaluation

PubMed Central

Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-01-01

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

An Evaluation System for the Online Training Programs in Meteorology and Hydrology

ERIC Educational Resources Information Center

Wang, Yong; Zhi, Xiefei

2009-01-01

This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Women's Studies Collections: A Checklist Evaluation

ERIC Educational Resources Information Center

Bolton, Brooke A.

2009-01-01

A checklist evaluation on thirty-seven Women's Studies programs conducted using the individual institutions' online public access catalogs (OPACs) is presented. Although Women's Studies collections are very difficult to build, an evaluation of existing programs shows that collections, for the most part, have managed substantial coverage of the…

Inside the Black Box--An Implementation Evaluation Case Study

ERIC Educational Resources Information Center

Rector, Patricia; Bakacs, Michele; Rowe, Amy; Barbour, Bruce

2016-01-01

The case study presented in this article is an example of an implementation evaluation. The evaluation investigated significant components of the implementation of a long-term environmental educational program. Direct observation, evaluation-specific survey data, and historical data were used to determine program integrity as identified by…

Evaluating Federal Social Programs: Finding out What Works and What Does Not

ERIC Educational Resources Information Center

Muhlhausen, David B.

2012-01-01

Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

A responsive evaluation of an Aboriginal nursing education access program.

PubMed

Curran, Vernon; Solberg, Shirley; LeFort, Sandra; Fleet, Lisa; Hollett, Ann

2008-01-01

Nursing education access programs have been introduced in a number of countries to address the shortage of healthcare providers of Aboriginal descent. An evaluation study of a nursing education access program in Labrador, Canada, was undertaken using a Responsive Evaluation approach. Interviews and focus groups with program stakeholders were conducted. Program effectiveness was influenced by culturally relevant curriculum, experiential and authentic learning opportunities, academic and social support, and the need for partnership building between stakeholders. The authors report key findings resulting from the Responsive Evaluation.

Multimethod Strategy for Assessing Program Fidelity: The National Evaluation of the Revised G.R.E.A.T. Program

ERIC Educational Resources Information Center

Esbensen, Finn-Aage; Matsuda, Kristy N.; Taylor, Terrance J.; Peterson, Dana

2011-01-01

This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

Evaluation of a PhD Program: Paving the Way.

ERIC Educational Resources Information Center

Germain, Carol P.; And Others

1994-01-01

During the evolution of an evaluation process for the University of Pennsylvania's doctoral program in nursing, a task force developed criteria and sources for program evaluation and surveyed students, alumni, and faculty to write a self-study report for external reviewers. (JOW)

Meta-analytic Evaluation of a Virtual Field Trip to Connect Middle School Students with University Scientists

NASA Astrophysics Data System (ADS)

Adedokun, Omolola A.; Liu, Jia; Parker, Loran Carleton; Burgess, Wilella

2015-02-01

Although virtual field trips are becoming popular, there are few empirical studies of their impacts on student outcomes. This study reports on a meta-analytic evaluation of the impact of a virtual field trip on student perceptions of scientists. Specifically, the study examined the summary effect of zipTrips broadcasts on evaluation participants' perceptions of scientists, as well as the moderating effect of program type on program impact. The results showed statistically significant effect of each broadcast, as well as statistically significant summary (combined) effect of zipTrips on evaluation participants' perceptions of scientists. Results of the moderation analysis showed that the effect was greater for the students that participated in the evaluation of the 8th grade broadcasts, providing additional insight into the role of program variation in predicting differential program impact. This study illustrates how meta-analysis, a methodology that should be of interest to STEM education researchers and evaluation practitioners, can be used to summarize the effects of multiple offerings of the same program. Other implications for STEM educators are discussed.

Flight program language requirements. Volume 3: Appendices

NASA Technical Reports Server (NTRS)

1972-01-01

Government-sponsored study and development efforts were directed toward design and implementation of high level programming languages suitable for future aerospace applications. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of language requirements was synthesized from these activities.

Evaluating an English Language Teacher Education Program through Peacock's Model

ERIC Educational Resources Information Center

Coskun, Abdullah; Daloglu, Aysegul

2010-01-01

The main aim of this study is to draw attention to the importance of program evaluation for teacher education programs and to reveal the pre-service English teacher education program components that are in need of improvement or maintenance both from teachers' and students' perspectives by using Peacock's (2009) recent evaluation model in a…

Participants' perceptions of the 1997-1998 Missouri State Parks Passport Program

Treesearch

Yi-Jin Ye; Jaclyn Card

2002-01-01

Service quality is increasingly important to park managers. Recreation and park evaluation measures the implementation and outcome of programs for decision-making. Decisions based on evaluations are often concerned with improving the quality of the program for participants. The purpose of the study was to evaluate the Missouri State Parks Passport Program (MSPPP) by...

77 FR 61789 - Agency Information Collection Activities; Submission for OMB Review; Comment Request; Workforce...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-11

... Programs Gold Standard Evaluation Follow-Up Surveys, Veterans Study, and Cost Data,'' to the Office of... Standard Evaluation Follow-Up Surveys, Veterans Study, and Cost Data ACTION: Notice. SUMMARY: The... Worker Programs Gold Standard Evaluation Follow-Up Surveys, Veterans Study, and Cost Data. OMB ICR...

Teacher Evaluations in Leisure Studies Programs: An Old Issue with a New Slant.

ERIC Educational Resources Information Center

Butts, Frank B.; Swearingen, Tommy

1994-01-01

This paper examines teacher evaluation practices in leisure studies programs, noting the perceived effectiveness of rating instruments. Surveys of leisure studies professors nationwide indicated many institutions used evaluation instruments and processes that were not statistically validated; key decisions were often made on the basis of these…

Program Evaluation: A Study to Evaluate the Effectiveness of Academic and Behavioral Interventions in an Alternative to out of School Suspension Program

ERIC Educational Resources Information Center

Rizzi, Lorenzo

2011-01-01

The purpose of this study was to provide insight regarding the impact that the alternative to suspension program Achievement Character Excellence (ACE) has on the students who are placed there. The study utilized four achievement indicators to track the level of improvement of students after they were placed in the ACE program and after they were…

An Evaluation of the Right Choices Program to Determine Effectiveness in Delivering Constructive Interventions and Providing an Early Support Program in Order to Modify Behavior of First-Time Student Offenders Who Commit Drug and Violent Acts

ERIC Educational Resources Information Center

Barnes, Lisa B.

2010-01-01

The purpose of the study was to perform a program evaluation of the Right Choices Program to determine the program's effectiveness in delivering constructive interventions that modify student behavior once students have left the program and have returned to their regular learning environment. This mixed-method evaluation consisted of an…

Evaluating Afterschool Programs

ERIC Educational Resources Information Center

Little, Priscilla M.

2014-01-01

Well-implemented afterschool programs can promote a range of positive learning and developmental outcomes. However, not all research and evaluation studies have shown the benefits of participation, in part because programs and their evaluation were out of sync. This chapter provides practical guidance on how to foster that alignment between…

What Is the Purpose of the Theses Addressing the Issue of Program Evaluation in Turkey? (The Case of Curriculum and Instruction: 1997-2015)

ERIC Educational Resources Information Center

Alkin-Sahin, Senar; Tunca, Nihal

2016-01-01

In the current study, the aim is to investigate the theses addressing the issue of program evaluation in the field of Curriculum and Instruction (C&I) in 1997-2015. The study employed the survey model. The universe of the study consists of totally 87 theses addressing the issue of program evaluation in the field of C&I in 1997-2015. As the…

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

Improving the Textbook Selection Process: Case Studies of the Textbook Adoption Guidelines Project. Technical Report No. 478.

ERIC Educational Resources Information Center

Dole, Janice; And Others

A study followed three textbook adoption committees as they evaluated basal reading programs. The committees used "A Guide to Selecting Basal Reading Programs" (developed at the Center for the Study of Reading) to help them evaluate the quality of instruction in existing programs. Case studies of the three committees sought to address the…

Automated Writing Evaluation Program's Effect on Student Writing Achievement

ERIC Educational Resources Information Center

Holman, Lester Donnie

2011-01-01

In an ex post facto causal-comparative research design, this study investigated the effectiveness of Automated Writing Evaluation (AWE) programs on raising the student writing achievement. Tennessee Comprehensive Assessment Program (TCAP) writing achievement scores from the 2010 administration were utilized for this study. The independent variable…

Case Study Evaluation of the Boston Area Carpooling Program

DOT National Transportation Integrated Search

1976-05-01

The report evaluates a carpooling program in operation in the Boston, Massachusetts area from August, 1973 through August, 1974. The program, entitled the WBZ/ALA Commuter Computer Campaign, was the first program in the nation to promote and organize...

Financial Audit: Guaranteed Student Loan Program's Internal Controls and Structure Need Improvement. Report to the Congress.

ERIC Educational Resources Information Center

Wurtz, Donald R.; And Others

An evaluative study was done of the Department of Education's system of internal accounting controls over the Federal Family Education Loan Program, known as the guaranteed student loan program. The study evaluated internal control systems, the structure of the program with respect to the role of guaranty agencies, and the Department's ability to…

Crossroads Cafe: An ESOL Program for Adult Learners. Formative Evaluation Study, Summer 1996 Pilot Implementation.

ERIC Educational Resources Information Center

Spiegel, Seymour; Rayman, Irene C.

The reports presents findings of a formative evaluation of "Crossroads Cafe," an adult-level distance learning program designed to teach English to speakers of other languages (ESOL). The study focused on how 22 programs were implemented in 6 different regions of New York State. The program is a collaborative efforts of the Department of…

An Evaluation of the ELNP e-Learning Quality Assurance Program: Perspectives of Gap Analysis and Innovation Diffusion

ERIC Educational Resources Information Center

Chen, Ming-Puu

2009-01-01

The purpose of this study was to examine the appropriateness of a nationwide quality assurance framework for e-learning from participants' perspectives. Two types of quality evaluation programs were examined in this study, including the e-Learning Service Certification program (eLSC) and the e-Learning Courseware Certification program (eLCC). Gap…

The Stanford Medical Youth Science Program: Educational and Science-Related Outcomes

ERIC Educational Resources Information Center

Crump, Casey; Ned, Judith; Winkleby, Marilyn A.

2015-01-01

Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer…

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

ERIC Educational Resources Information Center

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Redesigning and Aligning Assessment and Evaluation for a Federally Funded Math and Science Teacher Educational Program

ERIC Educational Resources Information Center

Hardre, Patricia L.; Slater, Janis; Nanny, Mark

2010-01-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

School Community Education Program in New York City 1988-89. Volume II. OREA Evaluation Section Report.

ERIC Educational Resources Information Center

Guerrero, Frank; Abbott, Lori

This second volume of a four-volume evaluation of the 1988-89 New York City School Community Education Program (also known as the Umbrella Program) comprises reports evaluating nine innovative elementary school projects on social, ethnical, and environmental studies, four of which included staff development workshops. Evaluation sources included…

An Examination of the Indiana State University Aerospace Administration Program

NASA Technical Reports Server (NTRS)

Schwab, Gregory L.

2005-01-01

Declining enrollments in the Indiana State University (ISU) aerospace administration program prompted this case study. which evaluates the program in comparison with parallel programs at other universities, industry standards, and an independent audit. Survey instruments were administered to graduates, faculty, and employers for their views on competencies of an excellent aerospace administration program Results show the deficiency of the ISU program. Graduates, faculty, and employers rated all competencies-from moderate to considerable importance-similarly for an excellent program. Recommendations for program improvement were made, and suggestions for further research include studies to evaluate the effectiveness of a revised aerospace administration program.

Overview of a pharmacist anticoagulation certificate program.

PubMed

Kirk, Julienne K; Edwards, Rebecca; Brewer, Andrew; Miller, Cathey; Bray, Bryan; Groce, James B

2017-07-01

To describe the design of an ongoing anticoagulation certificate program and annual renewal update for pharmacists. Components of the anticoagulation certificate program include home study, pre- and posttest, live sessions, case discussions with evaluation and presentation, an implementation plan, and survey information (program evaluation and use in practice). Clinical reasoning skills were assessed through case work-up and evaluation prior to live presentation. An annual renewal program requires pharmacists to complete home study and case evaluations. A total of 361 pharmacists completed the anticoagulation certificate program between 2002 and 2015. Most (62%) practiced in ambulatory care and 38% in inpatient care settings (8% in both). In the past four years, 71% were working in or starting anticoagulation clinics in ambulatory and inpatient settings. In their evaluations of the program, an average of 90% of participants agreed or strongly agreed the lecture material was relevant and objectives were met. Pharmacists are able to apply knowledge and skills in management of anticoagulation. This structured practice-based continuing education program was intended to enhance pharmacy practice and has achieved that goal. The certificate program in anticoagulation was relevant to pharmacists who attended the program. Copyright © 2017. Published by Elsevier Inc.

Design and Implementation of a Multi-Strategy, Collegewide Program of Evaluation and Planning: The Mercy College Self-Study Project.

ERIC Educational Resources Information Center

Kraetzer, Mary C.; And Others

The rationale, strategies, and methods of The Mercy College Self-Study Project are considered, and evaluation instruments are provided. This program of institutional evaluation and planning was initiated in 1980 and consists of: standardized surveys, a 10-year longitudinal (panel) study, and academic department self-studies. Questionnaires…

Evaluating the effectiveness of clinical medical librarian programs: a systematic review of the literature*

PubMed Central

Wagner, Kay Cimpl; Byrd, Gary D.

2004-01-01

Objective: This study was undertaken to determine if a systematic review of the evidence from thirty years of literature evaluating clinical medical librarian (CML) programs could help clarify the effectiveness of this outreach service model. Methods: A descriptive review of the CML literature describes the general characteristics of these services as they have been implemented, primarily in teaching-hospital settings. Comprehensive searches for CML studies using quantitative or qualitative evaluation methods were conducted in the medical, allied health, librarianship, and social sciences literature. Findings: Thirty-five studies published between 1974 and 2001 met the review criteria. Most (30) evaluated single, active programs and used descriptive research methods (e.g., use statistics or surveys/questionnaires). A weighted average of 89% of users in twelve studies found CML services useful and of high quality, and 65% of users in another overlapping, but not identical, twelve studies said these services contributed to improved patient care. Conclusions: The total amount of research evidence for CML program effectiveness is not great and most of it is descriptive rather than comparative or analytically qualitative. Standards are needed to consistently evaluate CML or informationist programs in the future. A carefully structured multiprogram study including three to five of the best current programs is needed to define the true value of these services. PMID:14762460

Qualitative Evaluation of Emotional Intelligence In-Service Program for Secondary School Teachers

ERIC Educational Resources Information Center

Fer, Seval

2004-01-01

This paper is an attempt to evaluate the Emotional Intelligence (EQ) In-Service Program on the basis of experiences of 20 secondary school teachers who attended the program in a private school in Turkey. A phenomenological approach, with a focus group method was used. The first objective of this study was to evaluate EQ program on the basis of…

Evaluation of the Cosmetology Program at Caldwell Community College and Technical Institute--Fall, 1981.

ERIC Educational Resources Information Center

Pipes, V. David

In fall 1981, the cosmetology program at Caldwell Community College and Technical Institute (CCC&TI) was evaluated as part of a process to create a model for the periodic evaluation of all occupational programs at the school. In addition to collecting information for planning and program improvement, the study sought to assess the achievement of…

A Program Evaluation of a Special Education Day School for Students with Emotional and Behavioral Disabilities

ERIC Educational Resources Information Center

Klein-Lombardo, Lucinda

2012-01-01

The purpose of this study was the program evaluation of a special education day school compared to a set of best practice standards for school programs for students with emotional and behavioral disorders. This evaluation will enable the organization to make decisions about which aspects of the program to continue, strengthen, or discontinue. …

Career Development in Language Education Programs

ERIC Educational Resources Information Center

Shawer, Saad Fathy; Alkahtani, Saad Ali

2013-01-01

This study assesses the influence of a two-year language program evaluation on program directors and faculty career development. The study makes use of mixed-paradigms (positivism and qualitative interpretive), mixed-strategies (survey research and qualitative evaluation), one-way analysis of variance (ANOVA) and a post-hoc test of multiple…

Supporting School Leaders in Blended Learning with Blended Learning

ERIC Educational Resources Information Center

Acree, Lauren; Gibson, Theresa; Mangum, Nancy; Wolf, Mary Ann; Kellogg, Shaun; Branon, Suzanne

2017-01-01

This study provides a mixed-methods case-study design evaluation of the Leadership in Blended Learning (LBL) program. The LBL program uses blended approaches, including face-to-face and online, to prepare school leaders to implement blended learning initiatives in their schools. This evaluation found that the program designers effectively…

An Evaluation Model Applied to a Mathematics-Methods Program Involving Three Characteristics of Teaching Style and Their Relationship to Pupil Achievement. Teacher Education Forum; Volume 3, Number 4.

ERIC Educational Resources Information Center

Dodd, Carol Ann

This study explores a technique for evaluating teacher education programs in terms of teaching competencies, as applied to the Indiana University Mathematics Methods Program (MMP). The evaluation procedures formulated for the study include a process product design in combination with a modification of Pophan's performance test paradigm and Gage's…

Evaluating the Implementation of an Olympic Education Program in Greece

NASA Astrophysics Data System (ADS)

Grammatikopoulos, Vasilios; Tsigilis, Nikolaos; Koustelios, Athanasios; Theodorakis, Yannis

2005-11-01

The aim of this study was to develop an instrument for evaluating how an education program has been implemented. Such evaluation can provide insight into the effectiveness of a program. Examined here was the Olympic Education Program used in Greek schools since 2000. In it, students learn the history of the Olympic games and the importance of exercise for health along with the principles and values of sports and volunteerism. The evaluation instrument underlying this study addressed the following six factors: `facilities', `administration', `educational material', `student-teacher relationships', `educational procedures', and `training'. Results indicate that the instrument, while adequate for assessing effectiveness, should be combined with advanced statistical methods.

Evaluation of the Capillary Blood Glucose Self-monitoring Program

PubMed Central

Augusto, Mariana Cristina; Nitsche, Maria José Trevizani; Parada, Cristina Maria Garcia de Lima; Zanetti, Maria Lúcia; Carvalhaes, Maria Antonieta de Barros Leite

2014-01-01

OBJECTIVE: to evaluate the structure, process and results of the Capillary Blood Glucose Self-monitoring Program in a Brazilian city. METHOD: epidemiological, cross-sectional study. The methodological framework of Donabedian was used to construct indicators of structure, process and outcome. A random sample (n = 288) of users enrolled and 96 health professionals who worked in the program was studied. Two questionnaires were used that were constructed for this study, one for professionals and one for users, both containing data for the evaluation of structure, process and outcome. Anthropometric measures and laboratory results were collected by consulting the patients' health records. The analysis involved descriptive statistics. RESULTS: most of the professionals were not qualified to work in the program and were not knowledgeable about the set of criteria for patient registration. None of the patients received complete and correct orientations about the program and the percentage with skills to perform conducts autonomously was 10%. As regards the result indicators, 86.4% of the patients and 81.3% of the professionals evaluated the program positively. CONCLUSION: the evaluation indicators designed revealed that one of the main objectives of the program, self-care skills, has not been achieved. PMID:25493676

78 FR 66905 - Agency Information Collection Activities; Comment Request; Evaluating the Retired Mentors for...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-07

...; Comment Request; Evaluating the Retired Mentors for Teachers Program AGENCY: Institute of Education... considered public records. Title of Collection: Evaluating the Retired Mentors for Teachers Program. OMB... study of the Retired Mentors for New Teachers program for probationary teachers developed by the Aurora...

Manipulator system man-machine interface evaluation program. [technology assessment

NASA Technical Reports Server (NTRS)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of a Bullying Prevention Program

ERIC Educational Resources Information Center

Hallford, Abby; Borntrager, Cameo; Davis, Joanne L.

2006-01-01

In order to address the federal "No Child Left Behind Act", the state of Oklahoma required that all public schools address the problem of bullying. Although numerous anti-bullying programs exist, few have been evaluated to determine their effectiveness. The present study evaluated the effectiveness of one such program,…

Evaluating Teacher Preparation Using Graduates' Observational Ratings

ERIC Educational Resources Information Center

Ronfeldt, Matthew; Campbell, Shanyce L.

2016-01-01

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Prevalence of Evaluation Method Courses in Education Leader Doctoral Preparation

ERIC Educational Resources Information Center

Shepperson, Tara L.

2013-01-01

This exploratory study investigated the prevalence of single evaluation methods courses in doctoral education leadership programs. Analysis of websites of 132 leading U.S. university programs found 62 evaluation methods courses in 54 programs. Content analysis of 49 course catalog descriptions resulted in five categories: survey, planning and…

Evaluation of an online continuing education program from the perspective of new graduate nurses.

PubMed

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Programs for the Prevention of Youth Depression: Evaluation of Efficacy, Effectiveness, and Readiness for Dissemination

PubMed Central

Brunwasser, Steven M.; Garber, Judy

2015-01-01

Objective To evaluate the current state of evidence of the effectiveness of depression prevention programs for youth, assess the degree to which current evidence supports broad implementation, and outline additional steps needed to close the gap between effectiveness and dissemination. Method We used the Society for Prevention Research’s Standards of Evidence (Flay et al., 2005) to evaluate the degree to which existing depression prevention programs have established intervention efficacy, effectiveness, and readiness for dissemination. We reviewed all depression prevention programs for youth that have been evaluated in at least two published, randomized controlled trials in which the intervention was compared to a no-intervention control group. A total of 37 studies evaluating 11 different programs were reviewed with regard to depressive symptoms and diagnoses post intervention and at follow-up (at least 6 months). Results Eight programs demonstrated significant main effects on depressive symptoms relative to controls in multiple RCTs; five programs had at least one trial with significant main effects present at least one year post-intervention. Two programs demonstrated efficacy for both depressive symptoms and depressive episodes across multiple independent trials. Regarding effectiveness, six programs had at least one study showing significant effects when delivered by endogenous service providers; four programs had significant effects in studies conducted independently of the program developers. Conclusions Several programs have demonstrated promise in terms of efficacy, but no depression prevention program for children or adolescents as yet has garnered sufficient evidence of effectiveness under real-world conditions to warrant widespread dissemination at this time. PMID:25933173

Children's Kindergarten Outcomes and Program Quality in the North Carolina Pre-Kindergarten Program: 2013-2014 Statewide Evaluation

ERIC Educational Resources Information Center

Peisner-Feinberg, Ellen S.; Schaaf, Jennifer M.; Hildebrandt, Lisa M.; Pan, Yi; Warnaar, Bethany L.

2015-01-01

The 2013-2014 North Carolina Pre-Kindergarten (NC Pre-K) Evaluation study was designed to examine the longitudinal outcomes through kindergarten for children who attended the Pre-K program, along with comparisons to previous cohorts of program attendees. A sample of 561 children was included in the study, with data gathered at the beginning and…

Common Evaluation Tools across Multi-State Programs: A Study of Parenting Education and Youth Engagement Programs in Children, Youth, and Families At-Risk

ERIC Educational Resources Information Center

Payne, Pamela B.; McDonald, Daniel A.

2015-01-01

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

An Evaluation of a Mixed-Gender Sexual Assault Prevention Program

ERIC Educational Resources Information Center

Bradley, April R.; Yeater, Elizabeth A.; O'Donohue, William

2009-01-01

This study evaluated the short-term effectiveness of a mixed-gender sexual assault prevention program developed for college students. Program participants (n = 177) were compared to non-program participants (n = 132) prior to the program and during a 2-week follow-up period on measures of rape myths, victim empathy, perceived negative consequences…

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

PubMed

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

The Case for Evaluating Student Outcomes and Equity Gaps to Improve Pathways and Programs of Study

ERIC Educational Resources Information Center

Bragg, Debra D.

2017-01-01

When linked to program review and improvement, program evaluation can help practitioners to ensure that career-technical education (CTE) and science, technology, engineering, and mathematics (STEM) programs offer equitable access and outcomes for underserved student groups.

Building for the Future: Community College Leadership Development Program Evaluation

ERIC Educational Resources Information Center

Bresso, Michele

2012-01-01

This qualitative descriptive study examines and evaluates an internal, grow-your-own, community college leadership development program. Participants in a community college leadership development program self-reported their leadership knowledge, attitudes, and practices (KAP) before, during, and after participation in the program. Study…

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of the Professional Development Program on Web Based Content Development

ERIC Educational Resources Information Center

Yurdakul, Bünyamin; Uslu, Öner; Çakar, Esra; Yildiz, Derya G.

2014-01-01

The aim of this study is to evaluate the professional development program on web based content development (WBCD) designed by the Ministry of National Education (MoNE). Based on the theoretical CIPP model by Stufflebeam and Guskey's levels of evaluation, the study was carried out as a case study. The study group consisted of the courses that…

Economic evaluation of drug abuse treatment and HIV prevention programs in pregnant women: a systematic review.

PubMed

Ruger, Jennifer Prah; Lazar, Christina M

2012-01-01

Drug abuse and transmission of HIV during pregnancy are public health problems that adversely affect pregnant women, their children and surrounding communities. Programs that address this vulnerable population have the ability to be cost-effective due to resulting cost savings for mother, child and society. Economic evaluations of programs that address these issues are an important tool to better understand the costs of services and create sustainable healthcare systems. This study critically examined economic evaluations of drug abuse treatment and HIV prevention programs in pregnant women. A systematic review was conducted using the criteria recommended by the Panel on Cost-Effectiveness in Health and Medicine and the British Medical Journal (BMJ) checklist for economic evaluations. The search identified 6 economic studies assessing drug abuse treatment for pregnant women, and 12 economic studies assessing programs that focus on prevention of mother-to-child transmission (PMTCT) of HIV. Results show that many programs for drug abuse treatment and PMTCT among pregnant women are cost-effective or even cost-saving. This study identified several shortcomings in methodology and lack of standardization of current economic evaluations. Efforts to address methodological challenges will help make future studies more comparable and have more influence on policy makers, clinicians and the public. Copyright © 2011 Elsevier Ltd. All rights reserved.

A Case Study of the Implementation of Conflict Resolution in a Second Grade Classroom.

ERIC Educational Resources Information Center

LeBlanc, Patrice R.; Lacey, Candace; Adler, Alison

This case study evaluated a second grade teacher and her students and the implementation of a conflict resolution program in the classroom; the goals of the evaluation were to provide descriptive data on the success or failure of the program and why those results occurred, and to make recommendations for program improvement. The study used…

An Evaluation of a 4-8 Mathematics Teacher Preparation Program at a Large State Institution in Texas

ERIC Educational Resources Information Center

Lim, Woong

2011-01-01

This study provided a springboard for future teacher preparation evaluation studies by examining the 4-8 mathematics teacher preparation component of the teacher preparation program at a large state institution in Texas. The research questions for this study were: (1) To what extent is the 4-8 mathematics teacher preparation program consistent…

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

NASA Astrophysics Data System (ADS)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in its vision, mission, goals and activities. In addition to the documentation of evaluative process, the case study also provides insight on the establishment of mutually supportive principal investigator and evaluator partnerships as necessary foundations for building effective teams. The study addresses frequently asked questions (FAQ's) on the formation and sustenance of partnerships among visionaries and evaluators and the impact of this partnership on the achievement of program outcomes.

An Empirical Evaluation of the Florida Tax Credit Scholarship Program. School Choice Issues in the State

ERIC Educational Resources Information Center

Forster, Greg; D'Andrea, Christian

2009-01-01

This study examines the Florida Tax Credit Scholarship program, one of the nation's largest school choice programs. It is the first ever completed empirical evaluation of a tax-credit scholarship program, a type of program that creates school choice through the tax code. Earlier reports, including a recent one on the Florida program, have not…

National impacts of the Weatherization Assistance Program in single-family and small multifamily dwellings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brown, M.A.; Berry, L.G.; Balzer, R.A.

1993-05-01

Since 1976, the US Department of Energy (DOE) has operated one of the largest energy conservation programs in the nation -- the low-income Weatherization Assistance Program. The program strives to increase the energy efficiency of dwellings occupied by low-income persons in order to reduce their energy consumption, lower their fuel bills, increase the comfort of their homes, and safeguard their health. It targets vulnerable groups including the elderly, people with disabilities, and families with children. The most recent national evaluation of the impacts of the Program was completed in 1984 based on energy consumption data for households weatherized in 1981.more » DOE Program regulations and operations have changed substantially since then: new funding sources, management principles, diagnostic procedures, and weatherization technologies have been incorporated. Many of these new features have been studied in isolation or at a local level; however, no recent evaluation has assessed their combined, nationwide impacts to date or their potential for the future. In 1990, DOE initiated such an evaluation. This evaluation is comprised of three ``impact`` studies (the Single-Family Study, High-Density Multifamily Study, and Fuel-Oil Study) and two ``policy`` studies. Altogether, these five studies will provide a comprehensive national assessment of the Weatherization Assistance Program as it existed in the 1989 Program Year (PY 1989). This report presents the results of the first phase of the Single-Family Study. It evaluates the energy savings and cost effectiveness of the Program as it has been applied to the largest portion of its client base -- low-income households that occupy single-family dwellings, mobile homes, and small (2- to 4-unit) multifamily dwellings. It is based upon a representative national sample that covers the full range of conditions under which the program was implemented in PY 1989.« less

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

PubMed

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

"PASSport to Success": An Examination of a Parent Education Program

ERIC Educational Resources Information Center

Ramirez, A. Y.

2004-01-01

This report highlights the evaluation of a parent education program conducted with an urban middle school in Southern California. The program called "PASSport to Success" enables parents to learn study skills and how to better teach their children how to study in school. This evaluative report conducted a pretest and a posttest on…

Evaluation Study of the Exploratory Visit: An Innovative Outreach Activity of the ILGWU's Friendly Visiting Program

ERIC Educational Resources Information Center

Wright, Holly; And Others

1977-01-01

The exploratory visit to recent retirees, an outreach component of the International Ladies Garment Workers Union Friendly Visiting Program, was evaluated. A post-test only control group effect study revealed exploratory visits were effective in establishing a link between the program and the retiree. (Author)

The University Seminar Program: A Formative Evaluation of the First Year.

ERIC Educational Resources Information Center

Litwin, James; And Others

In the Fall Quarter, 1975, the University Division of General Studies introduced a University Seminar Program whose aim was to provide new students, freshmen and transfers, with a more humanistic introduction to Bowling Green State University. The results and conclusions of the evaluation study regarding the first year of the program's operation…

Community Engaged Service-Learning: The Effect on University Students and Community Partners

ERIC Educational Resources Information Center

Steele, Susan C.

2012-01-01

The notion that an ethic of service can be fostered through participation in an academic community engaged service-learning program was the underlying premise for this program evaluation study. The purpose of this program evaluation study, using both quantitative and qualitative measures in a thoughtfully organized setting of university and…

Middle Immersion Study 1988. Research Paper 88-08.

ERIC Educational Resources Information Center

Parkin, Michael; And Others

Ottawa's program of middle French immersion (MFI) instruction, beginning in fourth grade, was evaluated when the first cohort reached sixth grade. Results of the study were compared with those of other groups, particularly the early French immersion (EFI) program and late French immersion (LFI) program students. The evaluation also added data from…

Understanding Evaluation Training in Schools and Programs of Public Health

ERIC Educational Resources Information Center

Fierro, Leslie A.; Christie, Christina A.

2011-01-01

This study provides an understanding of how the coursework required for attaining a Masters of Public Health (MPH) degree in epidemiology or health education from accredited schools or programs of public health prepares students to evaluate programs or interventions. Study data were generated using a content analysis of required coursework…

Evaluating Predictors of Program Attrition among Women Mandated into Batterer Intervention Treatment

ERIC Educational Resources Information Center

Buttell, Frederick P.; Powers, Dolores; Wong, Asia

2012-01-01

Objective: The purpose of the present study was to evaluate pretreatment differences between treatment completers and dropouts among a large sample of women ordered into a 26-week batterer intervention program (BIP). Method: The study employed a nonequivalent, control-group design (comparing program completers to dropouts) in a secondary analysis…

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Evaluation of drug interaction microcomputer software: comparative study.

PubMed

Poirier, T I; Giudici, R

1991-01-01

Twelve drug interaction microcomputer software programs were evaluated and compared using general and specific criteria. This article summarizes and compares the features, ratings, advantages, and disadvantages of each program. Features of an ideal drug interaction program are noted. Recommended programs based on three price ranges are suggested.

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Using EPAS[TM] to Evaluate School-Based Intervention Programs: GEAR UP. Case Study

ERIC Educational Resources Information Center

ACT, Inc., 2007

2007-01-01

This brief examines how the ACT's EPAS[TM] (Educational Planning and Assessment System) can be used to evaluate school-based intervention programs. Specific evaluation considered is that of the federal government's Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP), an initiative designed to increase the college awareness…

Leveraging Volunteers: An Experimental Evaluation of a Tutoring Program for Struggling Readers

ERIC Educational Resources Information Center

Jacob, Robin; Armstrong, Catherine; Bowden, A. Brooks; Pan, Yilin

2016-01-01

This study evaluates the impacts and costs of the Reading Partners program, which uses community volunteers to provide one-on-one tutoring to struggling readers in under-resourced elementary schools. The evaluation uses an experimental design. Students were randomly assigned within 19 different Reading Partners sites to a program or control…

An Evaluation of Newgate and Other Prisoner Education Programs.

ERIC Educational Resources Information Center

Kaplan (Marshall), Gans and Kahn, San Francisco, CA.

In a study to determine what impact prison college programs have had and to provide information useful to policy decisions, an evaluation, findings, and conclusions are presented for the Newgate and four other programs. An evaluation is made of post prison careers utilizing recidivism, "making it", and "doing good" as a…

Assessing Operation Purple: A Program Evaluation of a Summer Camp for Military Youth

DTIC Science & Technology

2012-01-01

However, it should be noted that the four FOCUS studies employed evaluation designs with no control or comparison group . Furthermore, despite...evaluation design was more robust than other military youth program evaluations that do not have a control or comparison group (Beardslee, Lester, et al...Operation Purple: A Program Evaluation of a Summer Camp for Military Youth camp group ); the remaining group formed the no-camp, or control , group . We

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

EVALUATION AND FOLLOWUP STUDY OF A SUMMER SCIENCE AND MATHEMATICS PROGRAM FOR TALENTED SECONDARY SCHOOL STUDENTS.

ERIC Educational Resources Information Center

BASSETT, ROBERT D.; COOLEY, WILLIAM W.

THIS STUDY WAS TO EVALUATE A SUMMER PROGRAM IN SCIENCE AND MATHEMATICS FOR 60 PROMISING SCIENCE STUDENTS, AND TO DETERMINE THE EFFECTS OF SUCH A PROGRAM ON THE BEHAVIOR OF STUDENTS IN CLASSES DURING THE ENSUING YEAR AND ON THEIR FUTURE CAREER DECISIONS. THE FIRST 2 OF THE 10 WEEKS OF THIS PROGRAM THE STUDENTS WERE GIVEN ADVANCED INSTRUCTION BY…

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Title I of the Higher Education Act of 1965: Evaluation of the Present Program: Recommendations for the Future.

ERIC Educational Resources Information Center

Whipple, James B.

In this document, which points out weaknesses in evaluation procedures and offers a new approach to the subject, it is suggested that in the area of the United States studied, the Title 1 program is drifting without direction, leadership, or system. This makes evaluation impossible. Evaluation is sometimes a description of a program and often…

The Evaluation of an Employee Assistance Program.

ERIC Educational Resources Information Center

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

A Multi-Stage Longitudinal Comparative Design Stage II Evaluation of the Changing Lives Program: The Life Course Interview (RDA-LCI)

ERIC Educational Resources Information Center

Arango, Lisa Lewis; Kurtines, William M.; Montgomery, Marilyn J.; Ritchie, Rachel

2008-01-01

The study reported in this article, a Multi-Stage Longitudinal Comparative Design Stage II evaluation conducted as a planned preliminary efficacy evaluation (psychometric evaluation of measures, short-term controlled outcome studies, etc.) of the Changing Lives Program (CLP), provided evidence for the reliability and validity of the qualitative…

Program Evaluation of a Competency-Based Online Model in Higher Education

ERIC Educational Resources Information Center

DiGiacomo, Karen

2017-01-01

In order to serve its nontraditional students, a university piloted a competency-based program as alternative method for its students to earn college credit. The purpose of this mixed-methods study was to conduct a summative program evaluation to determine if the program was successful in order to make decisions about program revision and…

Factors Influencing Participant Perceptions of Program Impact: Lessons from a Virtual Fieldtrip for Middle-School Students

ERIC Educational Resources Information Center

Adedokun, Omolola A.; Parker, Loran C.; Loizzo, Jamie; Burgess, Wilella D.; Robinson, J. Paul

2011-01-01

Participant perceptions of program effectiveness and impact are undoubtedly a popular focus of Extension program evaluations. However, the effects of participants' characteristics and contextual variables on program perceptions and how the resulting data can be used for program improvement are less explored in evaluation studies. Using data from…

Design Exception In-Service Monitoring Program Development

DOT National Transportation Integrated Search

2017-05-01

This study evaluates various possible program designs for in-service monitoring of design exceptions (DEs) for the Georgia Department of Transportation. The study recommends a multitier stepwise approach to the evaluation of DEs. Specifically, the pr...

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

Program Evaluation of Math Factual Operations for Understanding

ERIC Educational Resources Information Center

Rouse, Julie A.

2013-01-01

Deficiencies in mathematics standardized test scores prompted school district policymakers to consider implementing a program designed to increase students' basic multiplication fact skills. This study was an evaluation of the Math Factual Operations for Understanding program. The program, marketed with a martial arts theme, was intended to…

A Case Study of the Impact of a Sytematic Evaluation Process in a Graduate Medical Education Residency Program

ERIC Educational Resources Information Center

Kromrei, Heidi T.

2014-01-01

The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if…

Student Perspectives: Evaluating a Higher Education Administration Program

ERIC Educational Resources Information Center

Roberts, Jalynn; Gentry, Debra; Townsend, Amy

2011-01-01

The purpose of this mixed-method study was to evaluate a Higher Education Administration doctoral program, to understand student perceptions of program quality, to improve both student satisfaction and retention to degree completion, and to plan for the future. Findings from survey data and focus group interviews indicated program strengths to…

Assessing the Value of the Enviroscape Watershed Learning Module

ERIC Educational Resources Information Center

Edwards, Warren Patrick

2013-01-01

Scope and Method of Study: The researcher's evaluation of the West Atlanta Watershed Alliance's (WAWA) programs highlighted that few if any of the offered educational programs included a program evaluation, especially the most promising, the Enviroscape® Watershed learning module. The education programs that were customized and developed by the…

An Evaluation Study of an Executive Master of Business Administration (EMBA) Program in an Urban City: Examining the Transfer of Knowledge and Leadership Practices

ERIC Educational Resources Information Center

Choi, Hye Lim

2011-01-01

This study examined the effectiveness of the Executive Master of Business Administration (EMBA) degree program in terms of transfer of knowledge and leadership practices. Based on a review of literature related to adult learning theories, EMBA programs, the importance of evaluation practices, and leadership practices, this study was designed to…

Program Implementers' Evaluation of the Project P.A.T.H.S.: Findings Based on Different Datasets over Time

PubMed Central

Shek, Daniel T. L.; Ma, Cecilia M. S.

2012-01-01

This paper integrates the evaluation findings based on program implementers in nine datasets collected from 2005 to 2009 (244 schools and 7,926 implementers). Using consolidated data with schools as the unit of analysis, results showed that program implementers generally had positive perceptions of the program, themselves, and benefits of the program, with more than four-fifths of the implementers regarding the program as beneficial to the program participants. The subjective outcome evaluation instrument was found to be internally consistent. Multiple regression analyses revealed that perceived qualities of the program and program implementers predicted perceived effectiveness of the program. In conjunction with evaluation findings based on other sources, the present study provides support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) in Hong Kong. PMID:22629224

Investigating the criteria and processes used in the selection, implementation, and evaluation of STEM within K-12 education

NASA Astrophysics Data System (ADS)

Delp, Matthew J.

This study utilized survey research to investigate how school districts within K-12 education select, implement, and evaluate Science, Technology, Engineering, and Mathematics (STEM) programs. Thirty school districts within the Math and Science Collaborative located in Western Pennsylvania participated in this research. In addition to characterizing the STEM programs of the participating school districts, this study also analyzed the alignment of these programs to the components of comprehensive STEM programs and critical approaches to substantiate STEM program implementation as stated in the literature (Augustine, 2005; Bybee, 2010a, 2010b; Carnevale et al., 2011; DeJarnette, 2010; Epstein & Miller, 2011b; Gardner et al., 1983; Hossain & Robinson, 2011, 2012; Kuenzi, 2008). Findings suggest that the primary goal for school districts, as it relates to STEM program implementation, is to influence students' interest and pursuit of STEM-related careers and degrees. In order to achieve this goal, results of this study indicate the focus of STEM program implementation occurs with the greatest frequency at the middle school (grades seven and eight) level, are developed as an adaptation to the curriculum, and are very diverse from one school district to the next. In addition, findings suggest that although school districts maintain they aim to promote careers and degrees in STEM, districts rely on traditional methods of evaluating STEM program implementation (i.e. standardized test scores) and do not track the longitudinal impact their STEM programs as they related to degrees and careers in STEM. Furthermore, results indicate district STEM programs are not aligned to the characteristics of comprehensive STEM programs as defined by the literature. In order to address the misalignment of school district goals and evaluation processes involved in STEM program implementation and the absence of the characteristics commensurate with comprehensive STEM programs, this study has created a framework to guide school districts in STEM program selection, implementation, and evaluation.

Housing First and Photovoice: Transforming Lives, Communities, and Systems

PubMed Central

Barile, John P.; Ogawa, Terry Yasuko; Peralta, Nelson; Bugg, Reumell; Lau, John; Lamberton, Thomas; Hall, Corazon; Mori, Victor

2018-01-01

This article presents findings from a community-based participatory evaluation of a Housing First program on the Island of O’ahu. In this study, clients in a Housing First program used Photovoice to evaluate the program and to advocate for progressive housing policies. Written together by members of the Housing First Photovoice group, this collaborative article describes the outcomes from both the Housing First program and the Photovoice project and demonstrates the ways in which participatory program evaluations can interact with client-driven programs like Housing First to produce a cumulative, transformative impact. Findings suggest that community psychologists hoping to re-engage with community mental health systems through enacting transformative change should consider taking a community-based participatory approach to program evaluation because increased client voice in community mental health programs and their evaluations can have far-reaching, transformative impacts for research, practice, and policy. PMID:29323410

Evolution and outcomes of a quality improvement program.

PubMed

Thor, Johan; Herrlin, Bo; Wittlöv, Karin; Øvretveit, John; Brommels, Mats

2010-01-01

The purpose of this paper is to examine the outcomes and evolution over a five-year period of a Swedish university hospital quality improvement program in light of enduring uncertainty regarding the effectiveness of such programs in healthcare and how best to evaluate it. The paper takes the form of a case study, using data collected as part of the program, including quality indicators from clinical improvement projects and participants' program evaluations. Overall, 58 percent of the program's projects (39/67) demonstrated success. A greater proportion of projects led by female doctors demonstrated success (91 percent, n=11) than projects led by male doctors (51 percent, n=55). Facilitators at the hospital continuously adapted the improvement methods to the local context. A lack of dedicated time for improvement efforts was the participants' biggest difficulty. The dominant benefits included an increased ability to see the "bigger picture" and the improvements achieved for patients and employees. Quality measurement, which is important for conducting and evaluating improvement efforts, was weak with limited reliability. Nevertheless, the present study adds evidence about the effectiveness of healthcare improvement programs. Gender differences in improvement team leadership merit further study. Improvement program evaluation should assess the extent to which improvement methods are locally adapted and applied. This case study reports the outcomes of all improvement projects undertaken in one healthcare organization over a five-year period and provides in-depth insight into an improvement program's changeable nature.

A cognitive-behavioral program for parents of children with chronic musculoskeletal pain; A feasibility study.

PubMed

Wiertz, C; Goossens, M; Spek, E M; Verbunt, J A

2017-10-01

The purpose of the study is to evaluate the feasibility of a newly developed parent program for parents of children with non-specific chronic musculoskeletal pain. This program is part of the child's interdisciplinary outpatient pain rehabilitation treatment. The goal of the parent program is to change parent's thoughts/behaviour regarding pain with the ultimate intention to further improve their child's functioning. There were two main objectives in the study: First, to evaluate the feasibility of the parent program. Second, to evaluate changing in parental behavioral factors pre- and posttreatment. Participants were parents of adolescents, who underwent a interdisciplinary outpatient pain program for non-specific chronic musculoskeletal pain. Parents participated in a parent program as part of their child's treatment. Adolescents reported their level of disability, pain intensity, fear of pain and pain catastrophizing by filling out questionnaires. Parents reported catastrophic thinking about their child's pain, fear of pain and disabilities of their child. In addition, they evaluated the parent program. Sixty five parents (36 mothers and 29 fathers) of 44 adolescents filled in the baseline questionnaires. Result showed significant and clinically relevant improvements for both parents as well for adolescents. Parents were positive about the content of the parent program, they evaluated the program as supportive and informative. Adding a parent program to a interdisciplinary outpatient pain program for adolescent with chronic musculoskeletal pain, seems to be feasible in daily life of the parents and results in positive behavioural changes for both parents and adolescents. A parent program, designed to change cognition and behaviour of parents of children with chronic musculoskeletal pain is feasible. © 2017 European Pain Federation - EFIC®.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

"India Population Projects" in Karnataka.

PubMed

Reddy, P H; Badari, V S

1991-12-01

An overview, objectives, implementation, and research and evaluation studies of 2 India Population Projects in Karnataka are presented. The India Population Project I (IPP-I) was conducted in Karnataka and Uttar Pradesh. India Population Project III (IPP-III) took place between 1984-92 in 6 districts of Karnataka: Belgaum, Bijapur, Dharwad, Bidar, Gulbarga, and Raichur, and 4 districts in Kerala. The 6 districts in Karnataka accounted for 36% (13.2 million) of the total national population. The project cost was Rs. 713.1 million which was shared by the World Bank, and the Indian national and regional government. Due to poor past performance, these projects were undertaken to improve health and family welfare status. Specific project objectives are outlined. IPP-I included an urban component, and optimal Government of India program, and an intensive rural initiative. The urban program aimed to improved pre- and postnatal services and facilities, and the family planning (FP) in Bangalore city. The rural program was primarily to provide auxiliary nurse-midwives and hospitals and clinics, and also supplemental feeding program for pregnant and nursing mothers and children up to 2 years. The government program provided FP staff and facilities. IPP-I had 3 units to oversee building construction, to recruit staff and provide supplies and equipment, and to establish a Population Center. IPP-III was concerned with service delivery; information, education, and communication efforts (IEC) and population education; research and evaluation; and project management. Both projects contributed significantly to improving the infrastructure. A brief account of the types and kinds of studies undertaken is given. Studies were grouped into longitudinal studies of fertility, mortality, and FP; management information and evaluation systems for health and family welfare programs; experimental strategies; and other studies. Research and evaluation studies in IPP-III encompassed studies in gaps in knowledge, skills, and practice of health and FP personnel; baseline and endline surveys; and operational evaluation of the management information and evaluation system; factors affecting primary health care in Gulbarga district; evaluation of radio health lessons and the impact of the Kalyana Matha Program; and studies of vaccination and child survival and maternal mortality. Training programs were also undertaken.

Implementing a Sustainable Program Evaluation Component at a Large University Counseling Center

ERIC Educational Resources Information Center

Lacey, Sheila

2012-01-01

This action research dissertation study was undertaken to establish the foundation of a comprehensive evaluation component for the Turn-It-Around (TIA) workshop intervention program at Arizona State University (ASU), and was delivered in the form of a program development consultation. The study's intent was to enhance the ASU Counseling Service's…

An Evaluative Study of the Nurse Education Program. Research Report Number 82-1.

ERIC Educational Resources Information Center

Capoor, Madan

An evaluation of the nurse education program at Middlesex County College (MCC) was conducted in response to an increasing dropout rate and a decline in the passing rate of program graduates on the Licensing Board Examination (LBE). The study focused on the relationship between student background and performance and between student performance in…

National Home Start Evaluation. Interim Report V: Case Studies.

ERIC Educational Resources Information Center

Jerome, Chris H.; And Others

One of a series of documents on the evaluation of the National Home Start (NHS) program this third year interim report of case studies describes program efforts and successes with 16 Home Start families throughout the nation. A federally funded demonstration program, NHS is aimed at providing home-based services (such as health, education,…

Evaluation of College Reading and Study Skills Programs; Problems and Approaches.

ERIC Educational Resources Information Center

Anderson, William W.

The purpose of this paper was to bring together some of the most outstanding and significant research in recent years relating to the problems of evaluating college reading and study skills programs and the corresponding prospects and implications for improvement. The sections of the paper include: "Criterion Measures of Program Success," which is…

An Evaluation of the Antibullying Program at a Public Suburban High School

ERIC Educational Resources Information Center

Drury, Brian

2014-01-01

This project study addressed the problem of harassment, intimidation, and bullying (HIB) at a public suburban high school in the Northeast United States. The study school implemented the Anti-bullying Program in September 2011, yet no evaluation had been conducted on whether the program was meeting its goals. Two conceptual frameworks that drove…

Insights on Using Developmental Evaluation for Innovating: A Case Study on the Cocreation of an Innovative Program

ERIC Educational Resources Information Center

Lam, Chi Yan; Shulha, Lyn M.

2015-01-01

This article contributes to research on evaluation by examining the capacity and contribution of developmental evaluation for innovating. This case study describes the "preformative development" of an educational program (from conceptualization to pilot implementation) and analyzes the processes of innovation within a developmental…

Evaluability Assessment Thesis and Dissertation Studies in Graduate Professional Degree Programs

ERIC Educational Resources Information Center

Walser, Tamara M.; Trevisan, Michael S.

2016-01-01

Evaluability assessment (EA) has potential as a design option for thesis and dissertation studies, serving as a practical training experience for both technical and nontechnical evaluation skills. Based on a content review of a sample of EA theses and dissertations from graduate professional degree programs, the authors of this article found that…

"Evaluation as Illumination: A New Approach to the Study of Innovatory Programs". Occasional Paper.

ERIC Educational Resources Information Center

Parlett, Malcolm; Hamilton, David

Conventional approaches to program evaluation have followed the experimental and psychometric traditions dominant in educational research. Their aim (unfulfilled) of achieving fully objective methods had led to studies that are artificial and restricted in scope. Illuminative evaluation is introduced as a total re-appraisal of the rationale and…

A Mixed Methods Approach to Understanding School Counseling Program Evaluation: High School Counselors' Methods and Perceptions

ERIC Educational Resources Information Center

Aucoin, Jennifer Mangrum

2013-01-01

The purpose of this mixed methods concurrent triangulation study was to examine the program evaluation practices of high school counselors. A total of 294 high school counselors in Texas were assessed using a mixed methods concurrent triangulation design. A researcher-developed survey, the School Counseling Program Evaluation Questionnaire…

Evaluation of the Leadership Institute: A Program to Build Individual and Organizational Capacity through Emotional Intelligence

ERIC Educational Resources Information Center

Chen, Claire Yueh-Ti; King, Jeff; Cochran, Graham R.; Argabright, Karen J.

2014-01-01

The purpose of the study reported here was to evaluate the impact of Leadership Institute, a program designed to strengthen leadership capacity through developing individuals' emotional intelligence (EQ). A pre-and posttest approach was used to collect data from two workshops with identical EQ content, program structure, and evaluation.…

Residential Wilderness Programs: The Role of Social Support in Influencing Self-Evaluations of Male Adolescents

ERIC Educational Resources Information Center

Cook, Emily C.

2008-01-01

This qualitative study explores the aspects of a residential wilderness experience that informed self-evaluations in male adolescents, ages 12-16. To assess change in self-evaluations and program factors associated with change, qualitative interviews were conducted with adolescents upon entry to the program and four months later. Participants'…

Improving Program Results through the Use of Predictive Operational Performance Indicators: A Canadian Case Study

ERIC Educational Resources Information Center

Barrados, Maria; Blain, J. S.

2013-01-01

In Canada, in-depth evaluations of federal programs are intended to occur every 5 years. As such, evaluation is a periodic retrospective (lag) indicator examining results achieved versus program objectives. In a Canadian context, stand-alone evaluations have proved challenging to implement, time consuming, and not well adapted to annual management…

An Early Look at Families and Local Programs in the Mother and Infant Home Visiting Program Evaluation-Strong Start: Third Annual Report. OPRE Report 2016-37

ERIC Educational Resources Information Center

Lee, Helen; Crowne, Sarah; Faucetta, Kristen; Hughes, Rebecca

2016-01-01

The Mother and Infant Home Visiting Program Evaluation-Strong Start (MIHOPE-Strong Start) is the largest random assignment study to date to examine the effectiveness of home visiting services on improving birth outcomes and infant and maternal health care use for expectant mothers. The study includes local home visiting programs that use one of…

Measures of Student Non-Cognitive Skills and Political Tolerance after Two Years of the Louisiana Scholarship Program. Louisiana Scholarship Program Evaluation Report #2. Technical Report

ERIC Educational Resources Information Center

Mills, Jonathan N.; Cheng, Albert; Hitt, Collin E.; Wolf, Patrick J.; Greene, Jay P.

2016-01-01

This report examines the short-term effects of the Louisiana Scholarship Program (LSP) on students' non-cognitive skills and civic values. While a growing number of studies have evaluated K-12 school voucher programs along academic dimensions, few have focused on the development of non-cognitive skills and civic values. This study aims to address…

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

National Weatherization Assistance Program Characterization - Describing the Pre-ARRA Progam

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bensch, Ingo; Keene, Ashleigh; Cowan, Claire

2014-09-01

This report characterizes the Department of Energy s Weatherization Assistance Program (WAP) as it was administered in Program Year 2008. WAP has supported energy efficiency improvements to the homes of low-income households in the United States since 1976. The program provides grants, guidance, and other support to grantees: weatherization programs administered by each of the 50 states, the District of Columbia and some Native American tribes. Although there have been studies of some grantee-administered weatherization programs, the overall effectiveness of the national weatherization program has not been formally evaluated since Program Year 1989. Since that time, the program has evolvedmore » significantly, with an increased focus on baseload electric usage, continued evolution of diagnostic tools, new guidelines and best practices for heating-related measures, and adjustments in program rules. More recently, the program has also adjusted to large, temporary funding increases and changes in federal rules spurred by the American Recovery and Reinvestment Act (ARRA). Because the Weatherization Assistance Program of today is dramatically different from the one evaluated in 1989, DOE determined to undertake a new comprehensive evaluation of the national program. This new national evaluation is managed by Oak Ridge National Laboratory (ORNL). Under a competitive solicitation process, ORNL selected APPRISE, Inc., Blasnik & Associates, Dalhoff Associates and the Energy Center of Wisconsin to conduct the evaluation. The national evaluation comprises two independent evaluations. The first evaluation of which this report is a part focuses on Program Year 2008 (PY08). The second evaluation focuses on the ARRA-funded years of 2009 through 2011. This report, together with its companion the Eligible Population Study addresses specific program characterization goals established for the greater evaluation. The Energy Center led grantee and subgrantee data collection efforts, administering surveys to 51 grantees and 851 of the approximately 900 subgrantees that were slated to receive DOE weatherization funds in PY08. In all, seven different data collection instruments were used to gather the needed data two instruments for grantees and five for subgrantees. See Table 1 for a list of these survey instruments. These surveys were used to determine, among other things: Structure and funding of weatherization programs Training and staff development of service providers How weatherization services are delivered Clients served« less

Evaluation of the Meaning of Life Program in Israel

ERIC Educational Resources Information Center

Kasler, Jonathan; White, Gwyne W.; Elias, Maurice J.

2013-01-01

During the 2009-2010 academic year, 10 schools participated in the Meaning of Life educational program, an adaption of the popular U.S. Laws of Life program. The program sought to encourage each participant to develop a personal approach to finding meaning in life. To evaluate the success of the program, we conducted a study to compare measures of…

Evaluation of a Postdischarge Call System Using the Logic Model.

PubMed

Frye, Timothy C; Poe, Terri L; Wilson, Marisa L; Milligan, Gary

2018-02-01

This mixed-method study was conducted to evaluate a postdischarge call program for congestive heart failure patients at a major teaching hospital in the southeastern United States. The program was implemented based on the premise that it would improve patient outcomes and overall quality of life, but it had never been evaluated for effectiveness. The Logic Model was used to evaluate the input of key staff members to determine whether the outputs and results of the program matched the expectations of the organization. Interviews, online surveys, reviews of existing patient outcome data, and reviews of publicly available program marketing materials were used to ascertain current program output. After analyzing both qualitative and quantitative data from the evaluation, recommendations were made to the organization to improve the effectiveness of the program.

Home Start Evaluation Study. Interim Case Studies IIa.

ERIC Educational Resources Information Center

Fein, Robert

This formative evaluation study of Home Start uses a case study approach. A brief case study focuses on the administrative structure and staff resources and responsibilities of National Home Start. Also included are reports on seven local programs developed after two field visits had been made to each program. In the first visit, objectives chosen…

Evaluating Why and How the Teen Outreach Program Works: Years 3-5 of the Teen Outreach National Replication (1986/87-1988/89).

ERIC Educational Resources Information Center

Allen, Joseph P.; Philliber, Susan

An evaluative study was done of the Teen Outreach Program, a national, multi-site effort to reduce teenage pregnancy, school failure, and dropout. The study sought to identify the critical "active ingredients" of the program responsible for its success. The study was based on analyses of data collected at 114 different sites nationally,…

45 CFR 2522.810 - What will the Corporation do to evaluate the overall success of the AmeriCorps programs?

Code of Federal Regulations, 2011 CFR

2011-10-01

... Corporation will conduct independent evaluations of programs, including in-depth studies of selected programs... adversely affected by reductions in defense spending, or in areas that have an unemployment rate greater...

Lifeskills Program Evaluation at Mammoth Heights Elementary School

ERIC Educational Resources Information Center

Tanner, Emma Moss

2016-01-01

This study is a program evaluation of the Life Skills Program at Mammoth Heights Elementary in the Douglas County School District. The overall goal of the Life Skills Program is to increase students' independent and daily living skills through the teaching of communication, social-emotional skills and academic skills. Students in the Life Skills…

California's Past Programs to Support School and District Improvement: A Synthesis of Evaluation Studies

ERIC Educational Resources Information Center

California Collaborative on District Reform, 2017

2017-01-01

This document synthesizes the findings from the evaluations of four statewide programs designed to provide support for underperforming schools and districts in California as part of the state accountability system: (1) Immediate Intervention/Underperforming Schools Program (II/USP); (2) High Priority Schools Grant (HPSG) Program; (3) School…

Stirring up the Mud: Using a Community-Based Participatory Approach to Address Health Disparities through a Faith-Based Initiative

PubMed Central

Kaplan, Sue A.; Ruddock, Charmaine; Golub, Maxine; Davis, Joyce; Foley, Robert; Devia, Carlos; Rosen, Rosa; Berry, Carolyn; Barretto, Brenda; Carter, Toni; Irish-Spencer, Evalina; Marchena, Maria; Purcaro, Ellenrita; Calman, Neil

2011-01-01

This case study provides a mid-course assessment of the Bronx Health REACH faith-based initiative four years into its implementation. The study uses qualitative methods to identify lessons learned and to reflect on the benefits and challenges of using a community-based participatory approach for the development and evaluation of a faith-based program designed to address health disparities. Key findings concern the role of pastoral leadership, the importance of providing a religious context for health promotion and health equality messages, the challenges of creating a bilingual/bi-cultural program, and the need to provide management support to the lay program coordinators. The study also identifies lessons learned about community-based evaluation and the importance of addressing community concern about the balance between evaluation and program. Finally, the study identifies the challenges that lie ahead, including issues of program institution-alization and sustainability. PMID:20168022

Encyclopedia of Educational Evaluation: Concepts and Techniques for Evaluating Education and Training Programs.

ERIC Educational Resources Information Center

Anderson, Scarvia B.; And Others

Arranged like an encyclopedia, this book, addressed to directors and sponsors of education/training programs, as well as evaluators and those studying to become evaluators, unifies and systematizes the field of evaluation by organizing its main concepts and techniques into one volume. Researched and documented articles, contributed by recognized…

Program Evaluation at HEW: Research versus Reality. Part 2: Education.

ERIC Educational Resources Information Center

Abert, James G., Ed.

Intended for both the student and the practitioner of evaluation, this book describes the state of the practice of program evaluation. Its focus is mainly institutional. Results of evaluation studies are of secondary importance. An introductory chapter written by the editor discusses evaluation at the Office of Education from 1967 through 1973.…

A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

PubMed Central

Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

2018-01-01

Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

Evaluative Thinking in Practice: The National Asthma Control Program.

PubMed

Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

Evaluation of Arabic Language Learning Program for Non-Native Speakers in Saudi Electronic University According to Total Quality Standards

ERIC Educational Resources Information Center

Alowaydhi, Wafa Hafez

2016-01-01

The current study aimed at standardizing the program of learning Arabic for non-native speakers in Saudi Electronic University according to certain standards of total quality. To achieve its purpose, the study adopted the descriptive analytical method. The author prepared a measurement tool for evaluating the electronic learning programs in light…

Evaluation Study of Short-Term Programs at a Residential School for Students Who Are Blind and Visually Impaired

ERIC Educational Resources Information Center

Pogrund, Rona L.; Darst, Shannon; Boland, Teryl

2013-01-01

Introduction: The results of a 2009-2010 program evaluation study that examined parents, teachers of students with visual impairments, administrators, and students regarding overall satisfaction with and effectiveness of the short-term programs at a residential school for students who are blind and visually impaired are described. The findings are…

The Evaluation of a Sexual Assault Self-Defense and Risk-Reduction Program for College Women: A Prospective Study

ERIC Educational Resources Information Center

Gidycz, Christine A.; Rich, Cindy L.; Orchowski, Lindsay; King, Carrie; Miller, Audrey K.

2006-01-01

The present study evaluated the efficacy of a sexual assault risk-reduction program that included a physical self-defense component for college women ("N"=500). Program group women significantly increased their protective behaviors over the 6-month follow-up period compared to the waiting-list control group. However, there were no significant…

School-Based Smoking Prevention Programs for Adolescents in South Korea: A Systematic Review

ERIC Educational Resources Information Center

Park, Eunok

2006-01-01

The number of research papers evaluating programs designed to prevent adolescent smoking have increased in the last 13 years in Korea. The purpose of this study was to evaluate these programs, to review the features of the studies and to systemically assess the results on the knowledge about, and attitude to, smoking and smoking behavior. Database…

WWC Review of the Report "Evaluation of the College Possible Program: Results from a Randomized Controlled Trial." What Works Clearinghouse Single Study Review

ERIC Educational Resources Information Center

What Works Clearinghouse, 2014

2014-01-01

The 2013 study, "Evaluation of the College Possible Program: Results From a Randomized Controlled Trial", investigated the effect of the "College Possible" program, which is designed to serve low-income high school students by providing SAT/ACT test preparation, financial aid consulting, and college admissions guidance in an…

A Curriculum Evaluation Study of Commercial Art Programs in the Wisconsin Vocational, Technical and Adult Schools: Final Report.

ERIC Educational Resources Information Center

Crandall, William H.; Niesl, Joseph

A study of 2-year associate degree commercial arts programs in Wisconsin was conducted to determine the entry-level job requirements of commercial artists on a statewide basis; to identify skill tasks, performance levels, and learning experiences required of commercial artists; to evaluate the relevance of 2-year programs to industry requirements;…

An Evaluation of the National Teachers' Institute's Manpower Training Program for Teaching Personnel in Mid-Western Nigeria

ERIC Educational Resources Information Center

Osunde, A. U.; Omoruyi, F. E. O.

2004-01-01

This study evaluated the manpower-training program for teaching personnel in mid-western Nigeria by the National Teachers' Institute. Overall, 240 participants involved in the training program who were randomly selected from the area constituted the sample for the study. A questionnaire designed by the authors was the major instrument used for…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

Impact of a provider training program on the treatment of children with autism spectrum disorder at psychosocial care units in Brazil.

PubMed

Silva, Luciana C; Teixeira, Maria C T V; Ribeiro, Edith L; Paula, Cristiane S

2017-12-18

To develop, implement, and verify the impact of a training program for health care providers working with children with autism spectrum disorder (ASD) in psychosocial care centers for children and adolescents (Centro de Atenção Psicossocial à Infância e à Adolescência - CAPSi) in São Paulo, Brazil. This quasi-experimental study was conducted with 14 professionals from four CAPSi units. The training program consisted of six phases: 1) pre-intervention observation; 2) meeting with staff to assess the main needs of the training program; 3) developing materials for training and evaluation; 4) meetings to discuss program implementation; 5) a final meeting for case discussion and evaluation; and 6) distance supervision. Three measures were used to evaluate the training program: i) the Knowledge, Attitudes, and Practices (KAP) questionnaire; ii) videos containing questions designed to assess program comprehension; and iii) a satisfaction survey. Thirteen videos were produced to as visual aids for use during the training program, and a further 26 videos were developed to evaluate it. The program was well evaluated by the participants. The video responses and KAP questionnaire scores suggest that staff knowledge and attitudes improved after training. The positive findings of this study suggest that the tested training program is feasible for use with multidisciplinary teams working in the CAPSi environment.

Breaking bad news: A communication competency for ophthalmology training programs.

PubMed

Hilkert, Sarah M; Cebulla, Colleen M; Jain, Shelly Gupta; Pfeil, Sheryl A; Benes, Susan C; Robbins, Shira L

As the ophthalmology accreditation system undergoes major changes, training programs must evaluate residents in the 6 core competencies, including appropriately communicating bad news. Although the literature is replete with recommendations for breaking bad news across various non-ophthalmology specialties, no formal training programs exist for ophthalmology. There are many valuable lessons to be learned from our colleagues regarding this important skill. We examine the historic basis for breaking bad news, explore current recommendations among other specialties, and then evaluate a pilot study in breaking bad news for ophthalmology residents. The results of this study are limited by a small number of residents at a single academic center. Future studies from multiple training programs should be conducted to further evaluate the need and efficacy of formal communication skills training in this area, as well as the generalizability of our pilot training program. If validated, this work could serve as a template for future ophthalmology resident training and evaluation in this core competency. Copyright © 2016 Elsevier Inc. All rights reserved.

Breaking bad news: a communication competency for ophthalmology training programs

PubMed Central

Hilkert, Sarah M.; Cebulla, Colleen M.; Jain, Shelly Gupta; Pfeil, Sheryl A.; Benes, Susan C.; Robbins, Shira L.

2016-01-01

As the ophthalmology accreditation system undergoes major changes, training programs must evaluate residents in the 6 core competencies, including appropriately communicating bad news. Although the literature is replete with recommendations for breaking bad news across various non-ophthalmology specialties, no formal training programs exist for ophthalmology. There are many valuable lessons to be learned from our non-ophthalmology colleagues regarding this important skill. We examine the historic basis for breaking bad news, explores current recommendations among other specialties, and then evaluate a pilot study to teach breaking bad news to ophthalmology residents. The results of this study are limited by a small number of residents at a single academic center. Future studies from multiple training programs should be conducted to further evaluate the need and efficacy of formal communication skills training in this area, as well as the generalizability of our pilot training program. If validated, this work could serve as a template for future ophthalmology resident training and evaluation in this core competency. PMID:27134009

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

Effects of NIGMS Training Programs on Graduate Education in the Biomedical Sciences. An Evaluative Study of the Training Programs of the National Institute of General Medical Sciences 1958-1967.

ERIC Educational Resources Information Center

National Inst. of General Medical Sciences (NIH), Bethesda, MD.

This report was prepared by the National Research Council, at the request of the National Institutes of Health, in an attempt to evaluate the Graduate Research Training Grant Program and Fellowship Program in bioscience. One of the purposes of the study was to collect objective data that would provide answers to such questions as: What have been…

Three-Year Evaluation of a Large Scale Early Grade French Immersion Program: The Ottawa Study

ERIC Educational Resources Information Center

Barik, Henri; Swain, Marrill

1975-01-01

The school performance of pupils in grades K-2 of the French immersion program in operation in Ottawa public schools is evaluated in comparison with that of pupils in the regular English program. (Author/RM)

EVALUATION OF THE REAL-TIME AIR-QUALITY MODEL USING THE RAPS (REGIONAL AIR POLLUTION STUDY) DATA BASE. VOLUME 3. PROGRAM USER'S GUIDE

EPA Science Inventory

The theory and programming of statistical tests for evaluating the Real-Time Air-Quality Model (RAM) using the Regional Air Pollution Study (RAPS) data base are fully documented in four volumes. Moreover, the tests are generally applicable to other model evaluation problems. Volu...

Using UAM Corpustool to Explore the Language of Evaluation in Interview Program

ERIC Educational Resources Information Center

Hu, Chunyu; Tan, Jinlin

2017-01-01

As an interactional encounter between a journalist and one or more newsworthy public figures, an interview program is a special type of discourse that is full of evaluative language. This paper sets out to explore evaluation in interview programs from the perspective of appraisal system. The corpus software used in this study is UAM CorpusTool…

Bystander intervention and litter control: Evaluation of an appeal-to-help program.

Treesearch

Harriet H. Christensen

1981-01-01

Managers of public recreation areas are concerned about increases in vandalism and disregard for regulations and the rights of others by some users. Other than the litter incentive program, none of the approaches for reducing violations have been evaluated or proved effective. The present study evaluated a program to increase involvement of campers in the management of...

Washington State Even Start 1993-1994: Final Evaluation. A Report to the Office of Adult Literacy.

ERIC Educational Resources Information Center

Iglitzin, Lynne; Wandschneider, Mary

All 18 Washington State Even Start sites participated in the program's evaluation. Site coordinators administered the assessment and evaluation measures to the adults served by the program and to teachers working with children at both entry and exit from the program. An indepth study was conducted of 134 families for whom there were complete sets…

Evaluation of a Sexual Assault Risk Reduction and Self-Defense Program: A Prospective Analysis of a Revised Protocol

ERIC Educational Resources Information Center

Orchowski, Lindsay M.; Gidycz, Christine A.; Raffle, Holly

2008-01-01

The current study extends the development and evaluation of an existing and previously evaluated sexual assault risk reduction program with a self-defense component for college women (N = 300). The program protocol was revised to address psychological barriers to responding assertively to risky dating situations, and a placebo-control group was…

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Abriendo Puertas/Opening Doors Parenting Program: Summary Report of Program Implementation and Impacts. Publication #2014-24

ERIC Educational Resources Information Center

Moore, Kristin A.; Caal, Selma; Lawner, Elizabeth K.; Rojas, Angela; Walker, Karen

2014-01-01

Child Trends conducted a random assignment evaluation of the Abriendo Puertas/Opening Doors program, one of the largest programs in the United States working with low-income Latino parents of children ages zero to five. Since it began in 2007, the program has served over 30,000 parents/families in 34 states. The evaluation study examined the…

A mixed integer bi-level DEA model for bank branch performance evaluation by Stackelberg approach

NASA Astrophysics Data System (ADS)

Shafiee, Morteza; Lotfi, Farhad Hosseinzadeh; Saleh, Hilda; Ghaderi, Mehdi

2016-03-01

One of the most complicated decision making problems for managers is the evaluation of bank performance, which involves various criteria. There are many studies about bank efficiency evaluation by network DEA in the literature review. These studies do not focus on multi-level network. Wu (Eur J Oper Res 207:856-864, 2010) proposed a bi-level structure for cost efficiency at the first time. In this model, multi-level programming and cost efficiency were used. He used a nonlinear programming to solve the model. In this paper, we have focused on multi-level structure and proposed a bi-level DEA model. We then used a liner programming to solve our model. In other hand, we significantly improved the way to achieve the optimum solution in comparison with the work by Wu (2010) by converting the NP-hard nonlinear programing into a mixed integer linear programming. This study uses a bi-level programming data envelopment analysis model that embodies internal structure with Stackelberg-game relationships to evaluate the performance of banking chain. The perspective of decentralized decisions is taken in this paper to cope with complex interactions in banking chain. The results derived from bi-level programming DEA can provide valuable insights and detailed information for managers to help them evaluate the performance of the banking chain as a whole using Stackelberg-game relationships. Finally, this model was applied in the Iranian bank to evaluate cost efficiency.

Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

PubMed Central

Burrus, Barri B.; Scott, Alicia Richmond

2012-01-01

Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

PubMed

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Outcome Evaluation: Student Development Program, Special Studies Division, Cleveland State University.

ERIC Educational Resources Information Center

Pasch, Marvin

Techniques and procedures used to evaluate the outcomes of the student development program, and to use the evaluation results, are presented. Specific evaluation questions are posed that address overall outcomes, not individual student outcomes, and quantitative measures are suggested to accompany the questions. The measures include statistical…

Evaluating Community College Personnel: A Research Report.

ERIC Educational Resources Information Center

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

Mapping New Approaches in Program Evaluation: A Cross-Cultural Perspective.

ERIC Educational Resources Information Center

Gorostiaga, Jorge M.; Paulston, Rolland G.

This paper examines new approaches to program evaluation and explores their possible utility in Latin American educational settings. Part 1 briefly discusses why new ideas for evaluating educational studies are needed. Part 2 examines seven new evaluative approaches as follows: (1) "Concept Mapping," a type of structural…

Evaluation of Nosocomial Infection Control Programs in health services 1

PubMed Central

Menegueti, Mayra Gonçalves; Canini, Silvia Rita Marin da Silva; Bellissimo-Rodrigues, Fernando; Laus, Ana Maria

2015-01-01

OBJECTIVES: to evaluate the Nosocomial Infection Control Programs in hospital institutions regarding structure and process indicators. METHOD: this is a descriptive, exploratory and quantitative study conducted in 2013. The study population comprised 13 Nosocomial Infection Control Programs of health services in a Brazilian city of the state of São Paulo. Public domain instruments available in the Manual of Evaluation Indicators of Nosocomial Infection Control Practices were used. RESULTS: The indicators with the highest average compliance were "Evaluation of the Structure of the Nosocomial Infection Control Programs" (75%) and "Evaluation of the Epidemiological Surveillance System of Nosocomial Infection" (82%) and those with the lowest mean compliance scores were "Evaluation of Operational Guidelines" (58.97%) and "Evaluation of Activities of Control and Prevention of Nosocomial Infection" (60.29%). CONCLUSION: The use of indicators identified that, despite having produced knowledge about prevention and control of nosocomial infections, there is still a large gap between the practice and the recommendations. PMID:25806637

The evaluation of reproductive health PhD program in Iran: The input indicators analysis.

PubMed

AbdiShahshahani, Mahshid; Ehsanpour, Soheila; Yamani, Nikoo; Kohan, Shahnaz

2014-11-01

Appropriate quality achievement of a PhD program requires frequent assessment and discovering the shortcomings in the program. Inputs, which are important elements of the curriculum, are frequently missed in evaluations. The purpose of this study was to evaluate the input indicators of reproductive health PhD program in Iran based on the Context, Input, Process, and Product (CIPP) evaluation model. This is a descriptive and evaluative study based on the CIPP evaluation model. It was conducted in 2013 in four Iranian schools of nursing and midwifery of medical sciences universities. Statistical population consisted of four groups: heads of departments (n = 5), faculty members (n = 18), graduates (n = 12), and PhD students of reproductive health (n = 54). Data collection tools were five separate questionnaires including 37 indicators that were developed by the researcher. Content and face validity were evaluated based on the experts' indications. The Cronbach's alpha coefficient was calculated in order to obtain the reliability of the questionnaires. Collected data were analyzed by SPSS software. Data were analyzed by descriptive statistics (mean, frequency, percentage, and standard deviation), and one-way analysis of variance (ANOVA) and least significant difference (LSD) post hoc tests to compare means between groups. The results of the study indicated that the highest percentage of the heads of departments (80%), graduates (66.7%), and students (68.5%) evaluated the status of input indicators of reproductive health PhD program as relatively appropriate, while most of the faculties (66.7%) evaluated that as appropriate. It is suggested to explore the reasons for relatively appropriate evaluation of input indicators by further academic researches and improve the reproductive health PhD program accordingly.

Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation.

PubMed

Boyce, Ayesha S

2017-10-01

Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator-stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Quantitative Evaluation of the Clinical and Translational Science Awards (CTSA) Program Based on Science Mapping and Scientometric Analysis

PubMed Central

Zhang, Yin; Wang, Lei

2013-01-01

Abstract The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. PMID:24330689

The quantitative evaluation of the Clinical and Translational Science Awards (CTSA) program based on science mapping and scientometric analysis.

PubMed

Zhang, Yin; Wang, Lei; Diao, Tianxi

2013-12-01

The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. © 2013 Wiley Periodicals, Inc.

How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

PubMed

Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

2017-07-01

In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P < .01). Larger programs were more likely to teach (P = .04) and evaluate (P = .02) community-based research. Experiential learning and classroom-based didactics were the most frequent teaching methodologies. Many programs used multiple teaching methodologies for all competencies. Observation was the most frequent evaluation technique used; portfolio review and written reflection were also commonly reported. Our findings show a strong emphasis on community pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

A pharmacy leadership action study.

PubMed

Louie, Clifton; Mertz, Elizabeth; Penfil, Brett; O'Neil, Edward

2009-01-01

To report on the creation of a leadership development program targeted exclusively at pharmacists working in management in the professional community. Large staff-model health maintenance organization (HMO) in California between 2004 and 2008. The Pharmacy Leadership Institute (PLI; a joint effort of the School of Pharmacy and the Center for the Health Professions at the University of California, San Francisco) tested a program in a large staff-model HMO with hundreds of pharmacists in leadership roles. This program included learning seminars, psychometric assessments, leadership goals, intersession activities, coaching/mentoring, and leadership projects. Not applicable. PLI collected survey data in order to evaluate the effectiveness of the institute's leadership development program. In addition, an external evaluator was hired to conduct interviews with the pharmacy directors of the organization which chose to pilot the program. The evaluations from the participants indicate that the leadership development program met many but not all of its initial objectives. Consistent with action research methodology, the faculty of the institute met to redesign some sections of the program in order to meet the established goals. Adjustments were made to different components of the program over the next 4 years. Evaluation data show that these revisions were successful. In addition, follow-up evaluations with participants showed a lasting impact of the program on both individual leadership skills and organizational outcomes. Given the positive outcomes indicated by the evaluation data used in this study, the work of PLI indicates that broader leadership skills can be identified and enhanced within a group of pharmacy managers.

An experimental evaluation of theory-based mother and mother-child programs for children of divorce.

PubMed

Wolchik, S A; West, S G; Sandler, I N; Tein, J Y; Coatsworth, D; Lengua, L; Weiss, L; Anderson, E R; Greene, S M; Griffin, W A

2000-10-01

This study evaluated the efficacy of 2 theory-based preventive interventions for divorced families: a program for mothers and a dual component mother-child program. The mother program targeted mother-child relationship quality, discipline, interparental conflict, and the father-child relationship. The child program targeted active coping, avoidant coping, appraisals of divorce stressors, and mother-child relationship quality. Families with a 9- to 12-year-old child (N = 240) were randomly assigned to the mother, dual-component, or self-study program. Postintervention comparisons showed significant positive program effects of the mother program versus self-study condition on relationship quality, discipline, attitude toward father-child contact, and adjustment problems. For several outcomes, more positive effects occurred in families with poorer initial functioning. Program effects on externalizing problems were maintained at 6-month follow-up. A few additive effects of the dual-component program occurred for the putative mediators; none occurred for adjustment problems.

Evaluation of the Courtlink Auto Crime Prevention Program (CACPP) for Senior Elementary and Alternative School Students in British Columbia.

ERIC Educational Resources Information Center

Curtis, Charles K.; Meehan, George

This study evaluated the Courtlink Auto Crime Prevention Program (CACPP), a 13-hour curriculum for senior elementary school and secondary school alternative program at-risk students in British Columbia, Canada. The program provides students with information about automobile crime and its costs, consequences, and prevention. It promotes positive…

An Analysis of Evaluation Plans in a Federally Funded Leadership Preparation Program: Implications for the Improvement of Practice

ERIC Educational Resources Information Center

Sanzo, Karen L.

2012-01-01

This study is a content analysis of selected federally funded leadership preparation program evaluation proposals for the 2008, 2009, and 2010 School Leadership Program grants. The United States Department of Education (USDE) began awarding funding in 2002 to develop and implement preparation programs for aspiring and current assistant principals…

An Evaluation of the University of Pennsylvania's Practice Doctorate (DSW) Program

ERIC Educational Resources Information Center

Hartocollis, Lina; Solomon, Phyllis; Doyle, Andrea; Ditty, Matthew

2015-01-01

This article reports on an evaluation of the University of Pennsylvania's doctorate in social work (DSW), the first of the newly emerging practice doctorates. The study sample was current students and program alumni. Data were from program records and from an online survey of DSW alumni with an 81.6% response rate. Overall, the program is…

The Floating Lab Research Project: An Approach to Evaluating Field Programs.

ERIC Educational Resources Information Center

Brody, Michael J.

This report explains an evaluative study of the conceptual and affective development of students associated with the Floating Lab Program, an experiential field project sponsored by the University of New Hampshire and the Maine Sea Grant Program. The field program involved an opportunity for students to have hands-on experiences aboard a 65-foot…

The National Evaluation of School Nutrition Programs. Final Report - Executive Summary.

ERIC Educational Resources Information Center

Radzikowski, Jack

This is a summary of the final report of a study (begun in 1979) of the National School Lunch, School Breakfast, and Special Milk Programs. The major objectives of the evaluation were to (1) identify existing information on the school nutrition programs; (2) identify determinants of participation in the programs and develop statistical models for…

Improving Mathematics Teacher Education in Germany: Empirical Results from a Longitudinal Evaluation of Innovative Programs

ERIC Educational Resources Information Center

Buchholtz, Nils; Kaiser, Gabriele

2013-01-01

Innovative programs for restructuring the entry phase of mathematics teacher education programs have been implemented at various German universities within the last few years. This article reports about the design and the results of a longitudinal evaluation study of the effectiveness of two of these programs aiming to improve mathematics teacher…

Social Capital Development within a Novice District-Grown Principal Preparation Program: A Case Study of the DCPS Patterson Fellowship

ERIC Educational Resources Information Center

Hansen, Allison

2016-01-01

In the last decade district-managed principal preparation programs have become common as a means for school leadership preparation (Leithwood, Seashore-Lewis, Anderson, & Wahlstrom, 2004; Turnbull, Riley, & MacFarlane, 2015), but evaluations of these programs are relatively rare. This dissertation evaluates one such program, the Mary Jane…

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

PubMed

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Using health promotion guidelines for persons with disabilities to develop and evaluate a physical activity program for individuals with multiple sclerosis: A feasibility study.

PubMed

Dixon-Ibarra, Alicia; Nery-Hurwit, Mara; Driver, Simon; MacDonald, Megan

2017-04-01

The Health Education for Persons with Multiple Sclerosis (HEMS) program was developed in response to the need for interventions aimed at increasing physical activity for individuals with Multiple Sclerosis (MS). It was developed and evaluated using Drum and colleagues (2009) guidelines for implementing health promotion programs for individuals with disabilities. The purpose of this feasibility study is to describe the development, implementation, and evaluation of the HEMS program. Thirteen individuals with MS completed the 8-week health education program. A mixed method approach for evaluation was implemented (i.e., survey and focus groups). Process and resource feasibility demonstrated that over half of the participants attended at least 80% of the weekly sessions. Focus group data provided valuable feedback for future iterations of the program including critiques on the delivery, content, and group support provided. Outcome evaluation showed increases in self-efficacy (survey), improvements in theoretical constructs (focus groups), and increased physical activity (focus groups). Results show that health promotion programs for persons with MS can improve physical activity and related constructs. Next steps will be to revise, implement, and reevaluate the HEMS program in a larger randomized control trial. Published by Elsevier Ltd.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

PubMed

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. ©Patrick Ware, Heather J Ross, Joseph A Cafazzo, Audrey Laporte, Emily Seto. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 03.05.2018.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol

PubMed Central

Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-01-01

Background Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. Objective The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. Methods The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. Results The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. Conclusions The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. PMID:29724704

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

PubMed

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

PubMed

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

PubMed Central

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-01-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies. PMID:29234174

Field and Simulator Evaluations of a PC-Based Attention Maintenance Training Program

DOT National Transportation Integrated Search

2011-07-01

This report presents the results of three research studies regarding driver distraction from the forward roadway due to : secondary in-vehicle tasks. Study 1 included the development and evaluation of a PC-based training program named : FOrward Conce...

77 FR 28360 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-14

... study has two main components: (1) A review of recent research on the identification of ELs with special... descriptive in nature. The study is not a program evaluation and does not purport to assess program outcomes...

Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness☆

PubMed Central

Sobelson, Robyn K.; Young, Andrea C.

2017-01-01

The Centers for Public Health Preparedness (CPHP) program was a five-year cooperative agreement funded by the Centers for Disease Control and Prevention (CDC). The program was initiated in 2004 to strengthen terrorism and emergency preparedness by linking academic expertise to state and local health agency needs. The purposes of the evaluation study were to identify the results achieved by the Centers and inform program planning for future programs. The evaluation was summative and retrospective in its design and focused on the aggregate outcomes of the CPHP program. The evaluation results indicated progress was achieved on program goals related to development of new training products, training members of the public health workforce, and expansion of partnerships between accredited schools of public health and state and local public health departments. Evaluation results, as well as methodological insights gleaned during the planning and conduct of the CPHP evaluation, were used to inform the design of the next iteration of the CPHP Program, the Preparedness and Emergency Response Learning Centers (PERLC). PMID:23380597

REQUIREMENT VERIFICATION AND SYSTEMS ENGINEERING TECHNICAL REVIEW (SETR) ON A COMMERCIAL DERIVATIVE AIRCRAFT (CDA) PROGRAM

DTIC Science & Technology

2017-09-01

the SETR entrance criteria of these events. Out of 30 evaluated SETR entrance criteria, 22 map to FAA elements. A case study of a military CDA...evaluated SETR entrance criteria, 22 map to FAA elements. A case study of a military CDA program, the Presidential Helicopter Replacement Program...3 C. SCOPE AND METHODOLOGY .................................................. 4 D. ORGANIZATION OF THESIS

A Comparison of Participant and Practitioner Beliefs About Evaluation

PubMed Central

Whitehall, Anna K.; Hill, Laura G.; Koehler, Christian R.

2014-01-01

The move to build capacity for internal evaluation is a common organizational theme in social service delivery, and in many settings, the evaluator is also the practitioner who delivers the service. The goal of the present study was to extend our limited knowledge of practitioner evaluation. Specifically, the authors examined practitioner concerns about administering pretest and posttest evaluations within the context of a multisite 7-week family strengthening program and compared those concerns with self-reported attitudes of the parents who completed evaluations. The authors found that program participants (n = 105) were significantly less likely to find the evaluation process intrusive, and more likely to hold positive beliefs about the evaluation process, than practitioners (n = 140) expected. Results of the study may address a potential barrier to effective practitioner evaluation—the belief that having to administer evaluations interferes with establishing a good relationship with program participants. PMID:25328379

Report to the Board of Regents State University System of Florida. Review of Programs: Architecture, Architectural Technology, Landscape Architecture, Interior Design, Construction and Construction Technology, Building Construction, Urban and Regional Planning.

ERIC Educational Resources Information Center

McMinn, William G.

An evaluation and report was done on the status of programs in architecture and related fields in the Florida State University System as a follow-up to a 1983 evaluation. The evaluation involved self-studies prepared by each program and a series of site visits to each of seven campuses and two centers with programs under review. These institutions…

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

Moving evidence-based drug abuse prevention programs from basic science to practice: "bridging the efficacy-effectiveness interface".

PubMed

August, Gerald J; Winters, Ken C; Realmuto, George M; Tarter, Ralph; Perry, Cheryl; Hektner, Joel M

2004-01-01

This article examines the challenges faced by developers of youth drug abuse prevention programs in transporting scientifically proven or evidence-based programs into natural community practice systems. Models for research on the transfer of prevention technology are described with specific emphasis given to the relationship between efficacy and effectiveness studies. Barriers that impede the successful integration of efficacy methods within effectiveness studies (e.g., client factors, practitioner factors, intervention structure characteristics, and environmental and organizational factors) are discussed. We present a modified model for program development and evaluation that includes a new type of research design, the hybrid efficacy-effectiveness study that addresses program transportability. The utility of the hybrid study is illustrated in the evaluation of the Early Risers "Skills for Success" prevention program.

The Utility of the Memorable Messages Framework as an Intermediary Evaluation Tool for Fruit and Vegetable Consumption in a Nutrition Education Program

ERIC Educational Resources Information Center

Davis, LaShara A.; Morgan, Susan E.; Mobley, Amy R.

2016-01-01

Additional strategies to evaluate the impact of community nutrition education programs on low-income individuals are needed. The objective of this qualitative study was to examine the use of the Memorable Messages Framework as an intermediary nutrition education program evaluation tool to determine what fruit and vegetable messages were reported…

Base Realignment and Closure Environmental Evaluation (BRAC EE) Fort Devens, Massachusetts

DTIC Science & Technology

1995-09-01

Not Sampled ......... 6 2.3.2 Transformer Sites Sampled ........................ 7 2.4 Soil Sampling Protocol and Analytical Program ...Evaluation (AREE) 66. The study included evaluating the current PCB Transformer Management Program administered by the Fort Devens Environmental Management...Office (EMO), the Fort Devens Spill Contingency Plan, and the ongoing transformer inspection program . Personnel in both the Fort Devens EMO and the Fort

Satellite Power System (SPS) financial/management scenarios

NASA Technical Reports Server (NTRS)

Vajk, J. P.

1978-01-01

The possible benefits of a Satellite Power System (SPS) program, both domestically and internationally, justify detailed and imaginative investigation of the issues involved in financing and managing such a large-scale program. In this study, ten possible methods of financing a SPS program are identified ranging from pure government agency to private corporations. The following were analyzed and evaluated: (1) capital requirements for SPS; (2) ownership and control; (3) management principles; (4) organizational forms for SPS; (5) criteria for evaluation; (6) detailed description and preliminary evaluation of alternatives; (7) phased approaches; and (8) comparative evaluation. Key issues and observations and recommendations for further study are also presented.

The National Cross-Site Evaluation of High-Risk Youth Programs. Preventing Substance Abuse: Major Findings from the National Cross-Site Evaluation of High-Risk Youth Programs. Monograph Series.

ERIC Educational Resources Information Center

Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Herman, Jack

This multiple-site study assessed 48 prevention programs for high-risk youth funded by the Center for Substance Abuse Prevention, identifying program characteristics associated with strong substance abuse prevention outcomes. Data analysis indicated that substance abuse programs reduced rates of substance use, and the positive effects of program…

Development and Evaluation of a Peer Mentorship Program for Aboriginal University Students

ERIC Educational Resources Information Center

Rawana, Jennine S.; Sieukaran, Daniella D.; Nguyen, Hien T.; Pitawanakwat, Randy

2015-01-01

Although Aboriginal students encounter educational challenges, few post-secondary mentorship programs that facilitate positive educational and mental health outcomes within this population are described in the literature. This study describes the development and evaluation of a mentorship program for Aboriginal university students. Program…

Designing Studies of Extension Program Results: A Resource for Program Leaders and Specialists. Volume II--Abstracts.

ERIC Educational Resources Information Center

Rivera, William M., Ed.; And Others

These abstracts of 42 studies of extension program results, which make up the second volume of a two-volume resource, are intended to advise state administrative program leaders and others with program evaluation responsibilities of how to design studies of cooperative extension programs. Designed to support volume I, which refers to these…

An Evaluative Study of an ICT Module for a School Leadership and Management Preparation Program

ERIC Educational Resources Information Center

Musgrave, Sarietjie; De Wet, Corene

2017-01-01

This study reports on findings of an evaluative study on the effectiveness of an information and communication technology (ICT) module that forms part of the Advanced Certificate in Education: School Leadership and Management program. The study was carried out among distance education (DE) students from the University of the Free State enrolled…

21st Century Community Learning Centers Descriptive Study of Program Practices

ERIC Educational Resources Information Center

Penuel, William R.; McGhee, Raymond, Jr.

2010-01-01

In 2004, the U.S. Department of Education's Policy and Program Studies Service contracted with SRI International and its partner, Policy Studies Associates, to undertake an evaluation of the 21st Century Community Learning Centers. The following evaluation questions informed this study: (1) What is the nature of activities in centers that are…

Online evaluation programs: benefits and limitations.

PubMed

Burhansstipanov, Linda; Clark, Richard E; Watanabe-Galloway, Shinobu; Petereit, Daniel G; Eschiti, Valerie; Krebs, Linda U; Pingatore, Noel L

2012-04-01

Patient navigation programs are increasing throughout the USA, yet some evaluation measures are too vague to determine what and how navigation functions. Through collaborative efforts an online evaluation program was developed. The goal of this evaluation program is to make data entry accurate, simple, and efficient. This comprehensive program includes major components on staff, mentoring, committees, partnerships, grants/studies, products, dissemination, patient navigation, and reports. Pull down menus, radio buttons, and check boxes are incorporated whenever possible. Although the program has limitations, the benefits of having access to current, up-to-date program data 24/7 are worth overcoming the challenges. Of major benefit is the ability of the staff to tailor summary reports to provide anonymous feedback in a timely manner to community partners and participants. The tailored data are useful for the partners to generate summaries for inclusion in new grant applications.

The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation

ERIC Educational Resources Information Center

Brandon, Paul R.; Fukunaga, Landry L.

2014-01-01

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

ERIC Educational Resources Information Center

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

A Product Evaluation of the Selective Abandonment Process for School Budgeting

ERIC Educational Resources Information Center

Loofe, Christopher M.

2016-01-01

The purpose of this study is to evaluate the degree to which the Selective Abandonment budget process objectives were achieved by analyzing stakeholder perceptions. Use of this evaluation may enable the district to become more effective, efficient, and more fiscally responsible when developing future program budgeting plans. Program evaluation was…

An Evaluation of Programmed Treatment-integrity Errors during Discrete-trial Instruction

ERIC Educational Resources Information Center

Carroll, Regina A.; Kodak, Tiffany; Fisher, Wayne W.

2013-01-01

This study evaluated the effects of programmed treatment-integrity errors on skill acquisition for children with an autism spectrum disorder (ASD) during discrete-trial instruction (DTI). In Study 1, we identified common treatment-integrity errors that occur during academic instruction in schools. In Study 2, we simultaneously manipulated 3…

Teaching Study Skills and Test-Taking Strategies to Elementary School Students.

ERIC Educational Resources Information Center

Beidel, Deborah C.; Turner, Samuel M.; Taylor-Ferreira, Jill C.

1999-01-01

Presents and evaluates a pilot program to reduce test anxiety and related social-evaluative concerns. The Testbusters program teaches effective study habits, study skills, and test-taking strategies for children in grades 4 through 7. Results indicate that Testbusters decreased general levels of test anxiety and improved overall grade point…

Using a set-aside to encourage the evaluation of public health service programs.

PubMed

Riggin, L J; Shipman, S L; York, R L

1995-03-01

For over 20 years, the secretary of the Department of Health and Human Services (HHS) has had the authority to use up to 1% of the annual Public Health Service (PHS) appropriations for the evaluation of federal health programs. However, recent changes to the Public Health Service Act put not only a ceiling (1%) but also a floor (0.2%) on the funds that the secretary can set aside for evaluation. The changes to the legislation are intended to encourage HHS to dedicate more funds to evaluation, focus the funds set aside for evaluation on studies of PHS program implementation and effectiveness, and regularly report the findings of the evaluations to Congress. These changes respond to concerns raised by the U.S. General Accounting Office in a study of the PHS evaluation set-aside conducted for Congress.

Evaluation of Achieving a College Education Plus: A Credit-Based Transition Program

ERIC Educational Resources Information Center

Luna, Gaye; Fowler, Michael

2011-01-01

This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

EVALUATION STUDY OF FARM AND HOME MANAGEMENT PROGRAM IN NEW YORK STATE. A SIX-PART REPORT.

ERIC Educational Resources Information Center

ALEXANDER, FRANK D.

IN 1954 CONGRESS EARMARKED FUNDS FOR A FARM AND HOME MANAGEMENT PROGRAM TO OFFER INTENSIVE ON-THE FARM COUNSELING IN MANAGEMENT AND DECISION MAKING. THIS SIX-PART EVALUATION OF THE PROGRAM AS IT WAS CONDUCTED IN NEW YORK STATE, PRIMARILY WITH DAIRY OPERATORS, WAS DESIGNED TO DETERMINE THE PROGRAM'S EFFECTIVENESS RELATIVE TO LESS INTENSIVE…

Getting Teachers in on the Act: Evaluation of a Theater- and Classroom-Based Youth Violence Prevention Program

ERIC Educational Resources Information Center

Zucker, Marla; Spinazzola, Joseph; Pollack, Amie Alley; Pepe, Lauren; Barry, Stephanie; Zhang, Lynda; van der Kolk, Bessel

2010-01-01

This study replicated and extended our previous evaluation of Urban Improv (UI), a theater-based youth violence prevention (YVP) program developed for urban youth. It assessed the replicability of positive program impacts when implemented by nonprogram originators, as well as the utility of a comprehensive version of the UI program that included a…

Effects Five Years Later: The Michigan School Readiness Program Evaluation through Age 10.

ERIC Educational Resources Information Center

Xiang, Zongping; Schweinhart, Lawrence J.

This follow-up study examined the outcomes of children who had participated in the Michigan School Readiness Program (MSRP), a preschool program for 4-year-olds identified as being at risk for school failure, up to 5 years following their participation in the program. For the evaluation, 338 children who had participated in the state-funded…

The Internet as a communication tool for orthopedic spine fellowships in the United States.

PubMed

Silvestre, Jason; Guzman, Javier Z; Skovrlj, Branko; Overley, Samuel C; Cho, Samuel K; Qureshi, Sheeraz A; Hecht, Andrew C

2015-04-01

Orthopedic residents seeking additional training in spine surgery commonly use the Internet to manage their fellowship applications. Although studies have assessed the accessibility and content of Web sites in other medical specialties, none have looked at orthopedic spine fellowship Web sites (SFWs). The purpose of this study was to evaluate the accessibility of information from commonly used databases and assess the content of SFWs. This was a Web site accessibility and content evaluation study. A comprehensive list of available orthopedic spine fellowship programs was compiled by accessing program lists from the SF Match, North American Spine Society, Fellowship and Residency Electronic Interactive Database (FREIDA), and Orthopaedicsone.com (Ortho1). These databases were assessed for accessibility of information including viable links to SFWs and responsive program contacts. A Google search was used to identify SFWs not readily available on these national databases. SFWs were evaluated based on online education and recruitment content. Evaluators found 45 SFWs of 63 active programs (71%). Available SFWs were often not readily accessible from national program lists, and no program afforded a direct link to their SFW from SF Match. Approximately half of all programs responded via e-mail. Although many programs described surgical experience (91%) and research requirements (87%) during the fellowship, less than half mentioned didactic instruction (46%), journal clubs (41%), and national meetings or courses attended (28%). Evaluators found an average 45% of fellow recruitment content. Comparison of SFWs by program characteristics revealed three significant differences. Programs with greater than one fellowship position had greater online education content than programs with a single fellow (p=.022). Spine fellowships affiliated with an orthopedic residency program maintained greater education (p=.006) and recruitment (p=.046) content on their SFWs. Most orthopedic spine surgery programs underuse the Internet for fellow education and recruitment. The inaccessibility of information and paucity of content on SFWs allow for future opportunity to optimize these resources. Copyright © 2015 Elsevier Inc. All rights reserved.

Processes and outcomes of the veterans health administration safe patient handling program: study protocol.

PubMed

Rugs, Deborah; Toyinbo, Peter; Patel, Nitin; Powell-Cope, Gail; Hahm, Bridget; Elnitsky, Christine; Besterman-Dahan, Karen; Campbell, Robert; Sutton, Bryce

2013-11-18

Health care workers, such as nurses, nursing aides, orderlies, and attendants, who manually move patients, are consistently listed in the top professions for musculoskeletal injuries (MSIs) by the Bureau of Labor Statistics. These MSIs are typically caused by high-risk patient caregiving activities. In 2008, a safe patient handling (SPH) program was implemented in all 153 Veterans Administration Medical Centers (VAMCs) throughout the United States to reduce patient handling injuries. The goal of the present study is to evaluate the effects associated with the national implementation of a comprehensive SPH program. The primary objectives of the research were to determine the effectiveness of the SPH program in improving direct care nursing outcomes and to provide a context for understanding variations in program results across sites over time. Secondary objectives of the present research were to evaluate the effectiveness of the program in reducing direct and indirect costs associated with patient handling, to explore the potential mediating and moderating mechanisms, and to identify unintended consequences of implementing the program. This 3-year longitudinal study used mixed methods of data collection at 6- to 9-month intervals. The analyses will include data from surveys, administrative databases, individual and focus group interviews, and nonparticipant observations. For this study, a 3-tiered measurement plan was used. For Tier 1, the unit of analysis was the facility, the data source was the facility coordinator or administrative data, and all 153 VAMCs participated. For Tier 2, frontline caregivers and program peer leaders at 17 facilities each completed different surveys. For Tier 3, six facilities completed qualitative site visits, which included individual interviews, focus groups, and nonparticipant observations. Multiple regression models were proposed to test the effects of SPH components on nursing outcomes related to patient handling. Content analysis and constant comparative analysis were proposed for qualitative data analysis to understand the context of implementation and to triangulate quantitative data. All three tiers of data for this study have been collected. We are now in the analyses and writing phase of the project, with the possibility for extraction of additional administrative data. The focus of this paper is to describe the SPH program, its evaluation study design, and its data collection procedures. This study evaluates the effects associated with the national implementation of a comprehensive SPH program that was implemented in all 153 VAMCs throughout the United States to reduce patient handling injuries. To our knowledge, this is the largest evaluation of an SPH program in the United States. A major strength of this observational study design is that all VAMCs implemented the program and were included in Tier 1 of the study; therefore, population sampling bias is not a concern. Although the design lacks a comparison group for testing program effects, this longitudinal field study design allows for capturing program dose-response effects within a naturalistic context. Implementation of the VA-wide SPH program afforded the opportunity for rigorous evaluation in a naturalistic context. Findings will guide VA operations for policy and decision making about resources, and will be useful for health care, in general, outside of the VA, in implementation and impact of an SPH program.

A Lesson in Carefully Managing Resources: A Case Study from an Evaluation of a Music Education Program

ERIC Educational Resources Information Center

Hobson, Kristin A.; Burkhardt, Jason T.

2012-01-01

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

Outcome Evaluation of the Hands-On Parent Empowerment (HOPE) Program

ERIC Educational Resources Information Center

Leung, Cynthia; Tsang, Sandra; Dean, Suzanne

2011-01-01

This study evaluated the effectiveness of the HOPE program. Participants included 120 Chinese new immigrant parents with preschool children in Hong Kong from 13 preschools which were randomized into intervention group (HOPE) and comparison group (6-session parent education program). Parent participants completed measures on child behavior,…

Evaluation of a Sandplay Program for Preschoolers in a Multiethnic Neighborhood

ERIC Educational Resources Information Center

Rousseau, Cecile; Benoit, Maryse; Lacroix, Louise; Gauthier, Marie-France

2009-01-01

Background: This evaluative study assesses the efficacy of a school-based secondary prevention program consisting of creative expression workshops for immigrant and refugee preschoolers in a predominantly South Asian multiethnic neighborhood. Coincidentally, the program began in the wake of the tsunami. Method: Pretest and posttest data were…

Connect: An Effective Community-Based Youth Suicide Prevention Program

ERIC Educational Resources Information Center

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

Massachusetts Workplace Education Initiative. Year 3 Evaluation. Final Report.

ERIC Educational Resources Information Center

Rayman, Paula; And Others

An evaluation of the Massachusetts Workplace Education Initiative brings together three phases: (1) a pilot outcome study conducted with a sample of six local workplace education programs and featuring the perspectives of workers, labor, and management; (2) program profiles for seven federally funded workplace education programs coordinated by the…

Evaluating a Psychology Graduate Student Peer Mentoring Program

ERIC Educational Resources Information Center

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

Evaluation of an Educational Program for Adolescents with Asthma

ERIC Educational Resources Information Center

Berg, Jill; Tichacek, Mary J.; Theodorakis, Renee

2004-01-01

In addition to challenges of adolescence itself, teens with asthma face demands of asthma management and risks of asthma sequelae, including fatalities. Few asthma educational programs specifically address their needs. In response to school nurse concern, this pilot study evaluated an adolescent asthma education program, the "Power Breathing[TM]…

EVALUATION OF THE IMPLEMENTATION OF OPERATIONS AND MAINTENANCE PROGRAMS IN NEW JERSEY SCHOOLS

EPA Science Inventory

The Asbestos Hazard Emergency Response Act (AHERA) required all schools to develop and implement an asbestos management plan (AMP). The key component of the AMP is the operations and maintenance (O&M) program. A study was conducted to evaluate the implementation of O&M programs a...

Health Promotion of Faculty and Staff: The School Nurse's Role

ERIC Educational Resources Information Center

Ryan, Kelly M.

2008-01-01

Health promotion of school faculty and staff is an important part of a coordinated school health program. The lack of evaluation of health promotion programs and inconsistent results highlighting the efficacy and benefits of programs adds to employers' perceptions of inconsistent benefits. More studies evaluating effectiveness and development of…

Impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or chronic obstructive pulmonary disease: a systematic review of the literature.

PubMed

de Bruin, Simone R; Heijink, Richard; Lemmens, Lidwien C; Struijs, Jeroen N; Baan, Caroline A

2011-07-01

Evaluating the impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or COPD. Systematic Pubmed search for studies reporting the impact of disease management programs on healthcare expenditures. Included were studies that contained two or more components of Wagner's chronic care model and were published between January 2007 and December 2009. Thirty-one papers were selected, describing disease management programs for patients with diabetes (n=14), depression (n=4), heart failure (n=8), and COPD (n=5). Twenty-one studies reported incremental healthcare costs per patient per year, of which 13 showed cost-savings. Incremental costs ranged between -$16,996 and $3305 per patient per year. Substantial variation was found between studies in terms of study design, number and combination of components of disease management programs, interventions within components, and characteristics of economic evaluations. Although it is widely believed that disease management programs reduce healthcare expenditures, the present study shows that evidence for this claim is still inconclusive. Nevertheless disease management programs are increasingly implemented in healthcare systems worldwide. To support well-considered decision-making in this field, well-designed economic evaluations should be stimulated. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Program of Policy Studies in Science and Technology, supplement to seven year review

NASA Technical Reports Server (NTRS)

Mayo, L. H.

1975-01-01

The activities of the Program of Policy Studies are described and evaluated. Awards, seminars, publications are included along with student researcher profiles, graduate program in science, technology, and public policy, and a statement of program capability.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

The Development and Evaluation of a Peer-Training Program for Elementary School Students Teaching Secure Internet Use

ERIC Educational Resources Information Center

Korkmaz, Murat; Esen, Binnaz Kiran

2013-01-01

The aim of this study is to design and evaluate a peer-training program about changing students' internet use habits. This study was conducted with students from two different elementary schools in Mersin, Turkey, who were enrolled in 7th or 8th grade in the 2009-2010 academic year. A total of 24 students participated in the program, 12 of whom…

Assessment Inventories, Surveys, and Templates for Evaluating Educational Technology Regional and Local Assistance Programs. Phase IV of the Comprehensive Study of Educational Technology Programs Authorized from 1984-1992.

ERIC Educational Resources Information Center

Far West Lab. for Educational Research and Development, San Francisco, CA.

This report on Phase IV, of a four-phase study, provided for the development of evaluation templates and instruments to be used by the California Department of Education to facilitate systematic assessment of state funded educational technology programs and projects. These assessment documents comprised the major data collection sources for the…

A Formative Evaluation of the Team Advisory Program at Boston English High School from the Perspective of the Program's Advisors

ERIC Educational Resources Information Center

Cartin, Gregory Edward

2012-01-01

The purpose of this study was to conduct a formative evaluation of the efficacy of the Team Advisory program, an in-school intervention in an urban public high school using fitness to teach study skills and social responsibility, based on the perspective of its faculty (n = 9). The first research question asks what do Boston English Advisors…

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase frommore » $3.1 billion in 2008 to $$7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources often with multiple program administrators and intended to meet multiple purposes.« less

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

Evaluation Study of "Language, Literacy, & Vocabulary!" Spring 2006 Pilot

ERIC Educational Resources Information Center

McNabb, Mary

2006-01-01

Purpose: A pilot study of the "Language, Literacy, & Vocabulary!" program was conducted by Learning Gauger, Inc., for National Geographic School Publishing, in spring 2006. The program evaluation examined the classroom adoption approaches used by participating teachers and the subsequent impact of the "Language, Literacy, &…

Formative Evaluation of the ACSC Distance Learning Program: A Status Study.

ERIC Educational Resources Information Center

MacCuish, Donald A.

2001-01-01

Describes a formative evaluation of the Air Command and Staff College (ACSC) distance learning program, which offers professional military education (PME). Highlights include use of the status study methodology; curriculum development; course design; learning theories; instructional systems design; best practices; and student assessment. (LRW)

Evaluating Training by Four Economic Indices.

ERIC Educational Resources Information Center

Rosentreter, Gary

1979-01-01

This study was intended to demonstrate the effectiveness of four selected economic indicators as criteria for evaluation of a manufacturing firm's management training program in communication skills. Though the results indicated that the program effected change only in employee turnover, the study supports the measurement of training by economic…

Comparative Analysis of the Religious Orientation and Spiritual and Character Development of Christian Student-Athletes at a Christian University and a Secular University: An Exploratory Study

ERIC Educational Resources Information Center

Schultz, Donald Glen

2009-01-01

Program evaluation is an essential part of the ongoing success of any organization. Program evaluations can be done for entire organizations or for any entity within that organization. Christian university athletic programs need to be evaluated frequently to assess whether the organization is fulfilling its goals and objectives. This study…

What works in implementation of integrated care programs for older adults with complex needs? A realist review

PubMed Central

Kirst, Maritt; Im, Jennifer; Burns, Tim; Baker, G. Ross; Goldhar, Jodeme; O'Campo, Patricia; Wojtak, Anne; Wodchis, Walter P

2017-01-01

Abstract Purpose A realist review of the evaluative evidence was conducted on integrated care (IC) programs for older adults to identify key processes that lead to the success or failure of these programs in achieving outcomes such as reduced healthcare utilization, improved patient health, and improved patient and caregiver experience. Data sources International academic literature was searched in 12 indexed, electronic databases and gray literature through internet searches, to identify evaluative studies. Study selection Inclusion criteria included evaluative literature on integrated, long-stay health and social care programs, published between January 1980 and July 2015, in English. Data extraction Data were extracted on the study purpose, period, setting, design, population, sample size, outcomes, and study results, as well as explanations of mechanisms and contextual factors influencing outcomes. Results of data synthesis A total of 65 articles, representing 28 IC programs, were included in the review. Two context-mechanism-outcome configurations (CMOcs) were identified: (i) trusting multidisciplinary team relationships and (ii) provider commitment to and understanding of the model. Contextual factors such as strong leadership that sets clear goals and establishes an organizational culture in support of the program, along with joint governance structures, supported team collaboration and subsequent successful implementation. Furthermore, time to build an infrastructure to implement and flexibility in implementation, emerged as key processes instrumental to success of these programs. Conclusions This review included a wide range of international evidence, and identified key processes for successful implementation of IC programs that should be considered by program planners, leaders and evaluators. PMID:28992156

Maintenance of a smoking cessation program in public health clinics beyond the experimental evaluation period.

PubMed Central

Manfredi, C.; Crittenden, K.; Cho, Y. I.; Engler, J.; Warnecke, R.

2001-01-01

OBJECTIVES: As phase 3 of a study to evaluate a smoking cessation program in public health practice, the authors assess the maintenance and impact of the It's Time smoking cessation program in seven public maternal and child health clinics in Chicago. METHODS: The authors interviewed 404 clinic patients in the study's baseline phase (prior to introduction of the It's Time intervention program), and 610 in the program maintenance phase (in the year after experimental evaluation had ended) to assess exposure to smoking cessation interventions offered at the clinic, and smoking cessation outcomes (quit, actions toward quitting, scores on action, motivation, readiness, and confidence scales). The authors controlled for clustering of smokers within clinics, smokers' characteristics prior to clinic visit, and type of clinic service. They compared outcomes by study group (control or intervention) to which each clinic had been assigned in the earlier experimental phase. RESULTS: Compared to baseline, smokers in the maintenance phase had greater exposure to posters, provider advice and booklet, and better outcomes on seven of eight smoking cessation measures, including quitting. These improvements were larger for clinics with prior experience implementing It's Time. CONCLUSION: Participation in the experimental evaluation of the It's Time program prepared and possibly motivated the clinics to continue the program. Continuing the program resulted in greater delivery of interventions and improved smoking cessation outcomes for smokers in the clinics. PMID:11889280

Assessment of Program Impact Through First Grade, Volume II: Impact on Institutions. An Evaluation of Project Developmental Continuity. Interim Report X.

ERIC Educational Resources Information Center

Rosario, Jose; And Others

As part of a longitudinal study evaluating program effects, this report, the second in a series of six, describes the impact of Project Developmental Continuity (PDC) on the institutional policies and procedures of participating Head Start centers and elementary schools up to the time the evaluation study's cohort of children had completed grade…

More, but Not Yet Better: An Evaluation of USAID's Programs and Policies To Improve Girls' Education. USAID Program and Operations Assessment Report No. 25.

ERIC Educational Resources Information Center

O'Gara, Chloe; Benoliel, Sharon; Sutton, Margaret; Tietjen, Karen

This report evaluates U.S. Agency for International Development (USAID) efforts to improve basic education for girls. The evaluation drew on field studies in: Guatemala, Guinea, Malawi, Nepal, and Pakistan; a country desk study of Egypt; issue-oriented research on Bolivia and Thailand; and a literature review. Findings indicate that effective…

Weatherization Works--Summary of Findings from the Retrospective Evaluation of the U.S. DOE's Weatherization Assistance Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tonn, Bruce Edward; Carroll, David; Pigg, Scott

This report presents a summary of the studies and analyses that compose the retrospective evaluation of the U.S. Department of Energy s low-income Weatherization Assistance Program (WAP). WAP provides grants to Grantees (i.e., states) that then provide grants to Subgrantees (i.e., local weatherization agencies) to weatherize low-income homes. This evaluation focused on the WAP Program Year 2008. The retrospective evaluation produced twenty separate reports, including this summary. Four separate reports address the energy savings, energy cost savings, and cost effectiveness of WAP across four housing types: single family, mobile home, small multifamily, and large multifamily. Other reports address the environmentalmore » emissions, macroeconomic, and health and household-related benefits attributable to WAP, and characterize the program, its recipients, and those eligible for the program. Major field studies are also summarized, including a major indoor air quality study and a follow-up ventilation study, an in-depth in-field assessment of weatherization work and quality, and a study that assesses reasons for variations in energy savings across homes. Results of surveys of weatherization staff, occupants, occupants satisfaction with weatherization services provided, and weatherization trainees are summarized. Lastly, this report summarizes a set of fifteen case studies of high-performing and unique local weatherization agencies.« less

Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

NASA Astrophysics Data System (ADS)

Warburton, J.; Crowley, S.; Larson, A.

2012-12-01

PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

Evaluated community fire safety interventions in the United States: a review of current literature.

PubMed

Ta, Van M; Frattaroli, Shannon; Bergen, Gwendolyn; Gielen, Andrea Carlson

2006-06-01

The purpose of the study was to assess the state of fire prevention research, provide an updated synthesis of evaluated fire prevention programs, and discuss the role of fire fighters and data systems in prevention efforts. The review included all evaluations of U.S. based fire prevention interventions published between January 1998 and September 2004 and any earlier articles about U.S. fire prevention interventions not included in two prior review articles. We retrieved information from each identified study including evaluation findings, involvement of fire service personnel and use of existing data systems. We identified twelve articles: seven reported on smoke alarm interventions, three on multi-faceted programs, and two other programs. Five programs involved fire service personnel in the design, implementation, and/or evaluation, and three used existing data systems. Studies reviewed suggest that canvassing and smoke alarm installations are the most effective means of distributing alarms and increasing the functional status of distributed alarms. The functionality of smoke alarms, an issue noted in earlier reviews, remains a problem. Programs involving partnerships with fire departments have indicated success in preventing fires and deaths, improving smoke alarm ownership and functional status, and improving children's fire safety knowledge. Using existing data systems to target and to evaluate interventions was effective. In the years since prior reviews, some improvements in the rigor of evaluation designs have been made, but there is still a need for high quality evaluations that will inform fire injury prevention efforts.

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

PubMed

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

PubMed

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Caregiver education in Parkinson's disease: formative evaluation of a standardized program in seven European countries.

PubMed

A'Campo, L E I; Spliethoff-Kamminga, N G A; Macht, M; Roos, R A C

2010-02-01

The formative evaluation of a standardized psychosocial education program for patients with Parkinson's disease (PD) and their caregivers. The results of the participation of the caregivers are presented next to the data of the patients. Caregivers (n = 137) and patients with PD (n = 151) participated in the 8-week program in separate groups. Measurements were performed on psychosocial problems (BELA-P/A-k), health state (EQ-5D VAS), quality of life (PDQ-39) and depression (SDS) 1 week before and 1 week after the program. Participants rated their mood on a visual analogue scale before and after each session, and they filled in an evaluation questionnaire after the last session. Scores on the BELA-P/A-k improved significantly on the 'bothered by scale' as well as the 'need for help scale'. No improvements were found on EQ-5D VAS, PDQ-39 and SDS. Mood ratings improved significantly after each session. Most participants evaluated the program as positive. Feedback led to improvements in the program, which are incorporated in a final manual. The program was feasible to run in the different countries. This exploratory study led to improvements in the program and recommendations for further research. A study on the effectiveness of the program is the next step.

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Who Is Afraid of Evaluation? Ethics in Evaluation Research as a Way to Cope with Excessive Evaluation Anxiety: Insights from a Case Study

ERIC Educational Resources Information Center

Bechar, Shlomit; Mero-Jaffe, Irit

2014-01-01

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

7 CFR 295.4 - Program evaluation status reports.

Code of Federal Regulations, 2012 CFR

2012-01-01

... projects concerning evaluation of FNS food assistance programs. A copy of the current status report on completed studies may be obtained by writing the Director, Office of Analysis and Evaluation, Food and... Agriculture Regulations of the Department of Agriculture (Continued) FOOD AND NUTRITION SERVICE, DEPARTMENT OF...

7 CFR 295.4 - Program evaluation status reports.

Code of Federal Regulations, 2014 CFR

2014-01-01

... projects concerning evaluation of FNS food assistance programs. A copy of the current status report on completed studies may be obtained by writing the Director, Office of Analysis and Evaluation, Food and... Agriculture Regulations of the Department of Agriculture (Continued) FOOD AND NUTRITION SERVICE, DEPARTMENT OF...

7 CFR 295.4 - Program evaluation status reports.

Code of Federal Regulations, 2010 CFR

2010-01-01

... projects concerning evaluation of FNS food assistance programs. A copy of the current status report on completed studies may be obtained by writing the Director, Office of Analysis and Evaluation, Food and... Agriculture Regulations of the Department of Agriculture (Continued) FOOD AND NUTRITION SERVICE, DEPARTMENT OF...

7 CFR 295.4 - Program evaluation status reports.

Code of Federal Regulations, 2013 CFR

2013-01-01

... projects concerning evaluation of FNS food assistance programs. A copy of the current status report on completed studies may be obtained by writing the Director, Office of Analysis and Evaluation, Food and... Agriculture Regulations of the Department of Agriculture (Continued) FOOD AND NUTRITION SERVICE, DEPARTMENT OF...

Bilingual Development in Study-Abroad Journal Narratives: Three Case Studies from a Short-Term Program in Mexico

ERIC Educational Resources Information Center

Menard-Warwick, Julia; Palmer, Deborah

2012-01-01

This paper examines the linguistic and cultural development of three US university students in a one-month study-abroad program in Mexico, as represented in their bilingual journals. Through narrative analysis, the paper explores students' varied evaluations of their study-abroad experiences, as well as how these evaluations seemed to affect their…

Evaluation of overhead support inspection program.

DOT National Transportation Integrated Search

2015-01-01

This study evaluated the adequacy and frequency of the current structural support inspection program for overhead : sign supports (including bridge mounted), mast arm signal supports and high mast light supports. While ODOT provides : statewide guida...

Space Tug systems study (storable). Volume 3: Executive summary

NASA Technical Reports Server (NTRS)

1974-01-01

Space tug program options that consider key issues and mission requirements are assessed, component and subsystem candidates are evaluated, and tug configurations synthesized. Three tug program options are defined and evaluated.

The feasibility of a telephone coaching program on heart failure home management for family caregivers

PubMed Central

Piamjariyakul, Ubolrat; Smith, Carol E.; Russell, Christy; Werkowitch, Marilyn; Elyachar, Andrea

2012-01-01

Objectives To test the feasibility of delivery and evaluate the helpfulness of a coaching heart failure (HF) home management program for family caregivers. Background The few available studies on providing instruction for family caregivers are limited in content for managing HF home care and guidance for program implementation. Method This pilot study employed a mixed methods design. The measures of caregiver burden, confidence, and preparedness were compared at baseline and 3 months post-intervention. Descriptive statistics were used to summarize program costs and demographic data. Content analysis research methods were used to evaluate program feasibility and helpfulness. Results Caregiver (n=10) burden scores were significantly reduced and raw scores of confidence and preparedness for HF home management improved 3 months after the intervention. Content analyses of nurse and caregiver post-intervention data found caregivers rated the program as helpful and described how they initiated HF management skills based on the program. Conclusion The program was feasible to implement. These results suggest the coaching program should be further tested with a larger sample size to evaluate its efficacy. PMID:23116654

Learning for All: The Value of Field Experience in Training a New Generation of Program Evaluators

ERIC Educational Resources Information Center

Buitrag, Carolina

2015-01-01

Professionals in various fields have the opportunity to train in real-life situations before they take on a job by themselves. In program evaluation, however, preservice training usually focuses on coursework oriented to research design and methods. After completing these studies, evaluators go off to conduct evaluations guided primarily by their…

The Educational Predicament Confronting Taiwan's Gifted Programs: An Evaluation of Current Practices and Future Challenges

ERIC Educational Resources Information Center

Kao, Chen-yao

2012-01-01

This study examines the current problems affecting Taiwan's gifted education through a large-scale gifted program evaluation. Fifty-one gifted classes at 15 elementary schools and 62 gifted classes at 18 junior high schools were evaluated. The primary activities included in this biennial evaluation were document review, observation of…

Home Start Evaluation Study. Interim Report II: Program Analysis. Revised Draft.

ERIC Educational Resources Information Center

Deloria, Dennis; And Others

This document is the second in a series of evaluative reports directed to evaluation needs of Home Start planners and administrators. It focuses on implementation data about programs gathered during local site visits conducted in the spring and fall of 1972. The two basic evaluative questions asked are: (1) What was Home Start intended by its…

Evaluation of Adult Literacy Education in the United States: A Review of Methodological Issues

ERIC Educational Resources Information Center

Shi, Yan; Tsang, Mun C.

2008-01-01

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

78 FR 19723 - Proposed Collection; 60-Day Comment Request; Evaluation of the Brain Disorders in the Developing...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-02

... Comment Request; Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty...: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty International Center... Information Collection: This study seeks to evaluate the management, effectiveness, and outcomes of the Brain...

Translation Training in the Jordanian Context: Curriculum Evaluation in Translator Education

ERIC Educational Resources Information Center

Mahasneh, Anjad

2013-01-01

This study aims at drawing a clear picture of translator training in Jordan through the evaluation of translation programs at the Master's level. The framework of the Context, Input, Process, and Product components of the CIPP evaluation model developed by Daniel Stufflebeam in 1971 was used to evaluate the three translation Master's programs at…

The Effectiveness of SRA Corrective Reading and SRA Connecting Math Programs as Reading and Math Intervention Programs for Students with Disabilities

ERIC Educational Resources Information Center

Guinn, Toby Ready

2009-01-01

The purpose of this study was to evaluate the effectiveness of the SRA Corrective Reading and SRA Connecting Math Intervention Programs when used as a scripted intervention program with identified students with disabilities and was evaluated to determine whether the effectiveness was affected by the student's gender or academic skill proficiency.…

A Preliminary Evaluation of a Massage Program for Children Who Have Been Sexually Abused and Their Nonabusing Mothers

ERIC Educational Resources Information Center

Powell, Lesley; Cheshire, Anna

2010-01-01

The aim of this study was to conduct a pilot evaluation of the Mosac Massage Program, a novel program that uses massage to address some of the difficulties faced by children who have been sexually abused and their nonabusing parents. Interviews were conducted with four participating mothers immediately before and after the program. Benefits…

Description of a Compensatory College Education Program for the Disadvantaged and Its Associated Research and Evaluation Program.

ERIC Educational Resources Information Center

Spuck, Dennis W.; And Others

This paper reports on a large-scale project of research and evaluation of a program for disadvantaged minority group students conducted by the Center for Educational Opportunity at the Claremont Colleges. The Program of Special Directed Studies for Transition to College (PSDS), a five-year experimental project, is aimed at providing a four-year,…

The Effectiveness of Adapted Versions of an Evidence-Based Prevention Program in Reducing Alcohol Use among Alternative School Students

ERIC Educational Resources Information Center

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youths, there is a need to facilitate the implementation and evaluation of these programs in real-world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin' it REAL (kiR), with alternative…

An Evaluation of a Peer-Based HIV/AIDS Education Program as Implemented in a Suburban High School Setting

ERIC Educational Resources Information Center

Cole, Brian P.; Nelson, Timothy D.; Steele, Ric G.

2008-01-01

This study presents the results of an evaluation of a peer-based HIV/AIDS education program, the BASE program, as implemented in a suburban high school setting. The participants were 132 high school students who participated in an "AIDS Awareness Day" as a part of the BASE program in their high school. Each student completed preintervention and…

The Effect of a Physiological Evaluation Program on Coronary Heart Disease Risk Scores for Sedentary Individuals.

ERIC Educational Resources Information Center

Finkenberg, Mel; And Others

The purpose of this study was to compare the coronary heart disease (CHD) probability estimates of a group of sedentary males involved in an exercise stress test program from 1968 through 1974 with those of a comparison group of sedentary males not involved in the program. The program was designed to evaluate cardiopulmonary function and improve…

Health promotion in young adults at a university in Korea: A cross-sectional study of 625 participants in a university.

PubMed

Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

2017-02-01

Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program.A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test.The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants' overall evaluation score (83% rated "excellent" or "good") and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events.In conclusion, the university-wide health promotion program was effective in improving university members' health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs.

The Total Impact of Manpower Programs: A Four-City Case Study. Volume II--Final Report.

ERIC Educational Resources Information Center

Olympus Research Corp., Washington, DC.

Based on followup interviews with 1700 participants, this study is an evaluation of Federal manpower programs in Boston, Denver, and San Francisco-Oakland. Included are Manpower Development and Training Act Programs, Work Incentive Programs, and Concentrated Employment Program from late 1969 to early 1970. Program impact on enrollees, employers,…

Management System for EMR Work Study Program.

ERIC Educational Resources Information Center

Columbia County Board of Public Instruction, Lake City, FL. Exceptional Child Education Dept.

A computerized information management system involving the specification of objectives, the coding of teacher evaluations of students, and a variety of possible outputs has been used in a work study program for educable mentally retarded adolescents. Instructional objectives are specified and coded by number and category. Evaluation is by means of…

COPES Report: System Reliability Study.

ERIC Educational Resources Information Center

Foothill-De Anza Community Coll. District, Los Altos Hills, CA.

The study examines the reliability of the Community College Occupational Programs Evaluation System (COPES). The COPES process is a system for evaluating program strengths and needs. A two-way test, college self-appraisal with third party validation of the self-appraisal, is utilized to assist community colleges in future institutional planning…

Program Evaluation of a School District's Multisensory Reading Initiative

ERIC Educational Resources Information Center

Asip, Michael Patrick

2012-01-01

The purpose of this study was to conduct a formative program evaluation of a school district's multisensory reading initiative. The mixed methods study involved semi-structured interviews, online survey, focus groups, document review, and analysis of extant special education student reading achievement data. Participants included elementary…

How Methodological Features Affect Effect Sizes in Education

ERIC Educational Resources Information Center

Cheung, Alan C. K.; Slavin, Robert E.

2016-01-01

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

Process and impact evaluation of a legal assistance and health care community partnership.

PubMed

Teufel, James A; Brown, Stephen L; Thorne, Woody; Goffinet, Diane M; Clemons, Latesha

2009-07-01

Community health partnerships have increased in popularity, but their effectiveness is often not evaluated. Through secondary data analysis, this study evaluates a program that offered access to legal services to address health-related issues, such as Medicaid reimbursement, Social Security benefits, medication coverage, and divorce. Based on the analysis reimbursements to expenditures, the health and law program appears to be cost-effective and thereby economically sustainable. The cost-effectiveness of this program increases the likelihood that it will be institutionalized and/or expanded. This program evaluation is used to exemplify how community stakeholders could partner to leverage resources to establish a sustainable community health and law program to address the needs of people living in medically underserved areas.

Bystander programs addressing sexual violence on college campuses: A systematic review and meta-analysis of program outcomes and delivery methods.

PubMed

Jouriles, Ernest N; Krauss, Alison; Vu, Nicole L; Banyard, Victoria L; McDonald, Renee

2018-02-06

This systematic review and meta-analysis evaluates the effectiveness of bystander programs that address sexual violence on college campuses. Program effects on student attitudes/beliefs and bystander behavior were examined. Durability of program outcomes and the influence of program-delivery methods (e.g., facilitator-led programs vs. video, online or poster campaign programs) and program-parameters (e.g., program length) were also evaluated. Twenty-four studies met criteria for inclusion in the meta-analysis, and 207 separate results from these studies were coded. Students who participated in a bystander program, compared to those who had not, had more pro-social attitudes/beliefs about sexual violence and intervening to prevent it, and engaged in more bystander behavior. Program effects diminished over time, but meaningful changes persisted for at least three months following program delivery. Longer programs had greater effects than shorter programs on attitudes/beliefs. Bystander programs can be a valuable addition to colleges' violence prevention efforts.

An overview of the effectiveness and efficiency of HIV prevention programs.

PubMed Central

Holtgrave, D R; Qualls, N L; Curran, J W; Valdiserri, R O; Guinan, M E; Parra, W C

1995-01-01

Because of the enormity of the HIV-AIDS epidemic and the urgency for preventing transmission, HIV prevention programs are a high priority for careful and timely evaluations. Information on program effectiveness and efficiency is needed for decision-making about future HIV prevention priorities. General characteristics of successful HIV prevention programs, programs empirically evaluated and found to change (or not change) high-risk behaviors or in need of further empirical study, and economic evaluations of certain programs are described and summarized with attention limited to programs that have a behavioral basis. HIV prevention programs have an impact on averting or reducing risk behaviors, particularly when they are delivered with sufficient resources, intensity, and cultural competency and are based on a firm foundation of behavioral and social science theory and past research. Economic evaluations have found that some of these behaviorally based programs yield net economic benefits to society, and others are likely cost-effective (even if not cost-saving) relative to other health programs. Still, specific improvements should be made in certain HIV prevention programs. PMID:7630989

Do adolescents perceive police officers as credible instructors of substance abuse prevention programs?

PubMed

Hammond, Augustine; Sloboda, Zili; Tonkin, Peggy; Stephens, Richard; Teasdale, Brent; Grey, Scott F; Williams, Joseph

2008-08-01

Although program recipients' attitudes toward instructors are crucial to program outcomes, they have not been adequately examined in the substance abuse prevention literature. This study uses survey data to explore attitudes toward instructors of prevention programming held by students from a national longitudinal evaluation of a school-based substance abuse prevention program delivered by Drug Abuse Resistance Education (D.A.R.E.) officers. Our analyses indicated that students who had police officers as instructors evaluated program instructors significantly higher than students who had non-police officers as instructors. The evaluation of police instructors varied according to students' sociodemographic characteristics. Implications for future research and practice are considered.

When Worlds Collide: Evaluating the Impact of Short-Term Study Abroad Programs

ERIC Educational Resources Information Center

Sato, Deirdre Colby

2009-01-01

The purpose of this study was to determine whether and how short-term study abroad programs transform college students' perspectives. The study examined attitudes about host country and international outlook, as well as intellectual, social and personal understandings. Short-term programs were defined as programs of less than a semester or a…

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review

PubMed Central

MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-01-01

Background Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. Objective We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. Methods This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. Results The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner satisfaction surveys, were found to be the most common types of TEL evaluations evident in the literature. The studies reviewed had low scores across reporting on ethical matters, design, and data collection categories. Conclusions There continues to be a need to develop effective and standard TEL evaluation tools, and good quality studies that describe effective evaluation of TEL education for health care professionals. Studies often fail to provide sufficient detail to support transferability or direct future TEL health care education programs. PMID:29643049

Intern evaluation strategies in family medicine residency education: what is-and is not-being done.

PubMed

Yates, Jennifer E

2013-06-01

Family medicine interns often have deficiencies that are not initially appreciated. By recognizing those growth opportunities early, programs may be able to better meet their interns' training needs. This study provides a needs assessment to ascertain what evaluation tools are being utilized by residency programs to assess their incoming interns. A questionnaire was sent to all US family medicine residency program coordinators (439 programs) via Survey Monkey© inquiring about whether intern evaluation is performed and, if so, what strategies are used. A mixed mode methodology was used: mailing with incentive, email prompts, and telephone calls. Of 439 programs, 220 (50%) responded to the survey. Most respondents (145, 66%) think intern evaluation is needed. However, only 79 (36%) programs are actually doing intern evaluations-only 14 (6.4%) extensively. Most programs are performing simulations (81, 45%) and assessing knowledge/comfort levels (79, 36%); less than one third are considering personality/learning styles, and almost no programs are evaluating skills such as typing (three, 1.4%) and math (one, 0.5%). Many programs use evaluations to guide future planning, help with early identification of challenging learners, and to match training to the residents' needs. Several programs expressed concern about how they would use the information once obtained. The majority of respondents agreed that a baseline intern evaluation is useful; few are actually doing it. This area is not well-described in the literature; residency programs could benefit from information sharing. The next step is to encourage interest in and implementation of such strategies.

The St. Jude Cancer Education for Children Program Pilot Study: Determining the Knowledge Acquisition and Retention of 4th-Grade Students.

PubMed

Ayers, Katherine; Villalobos, Aubrey Van Kirk; Li, Zhenghong; Krasin, Matthew

2016-03-01

In 2006, St. Jude Children's Research Hospital began developing a school-based outreach program known as the St. Jude Cancer Education for Children Program (SJCECP). The program aimed to teach children about cancer and healthy habits that can prevent the formation of cancers into adulthood. During the 2010-2011 academic years, we conducted a pilot evaluation of the SJCECP curriculum, with the primary objective of evaluating the impact of the intervention on knowledge acquisition and retention among 4th-grade students participating in the program. Seven local schools and 481 students from the Memphis area participated in the program evaluation. The results of this study show that 4th-grade students are able to acquire gains in knowledge related to cells, cancer, and healthy living after receiving the SJCECP intervention. We conclude that the program can be a useful tool for improving knowledge of cancer concepts at the 4th-grade level.

Program Evaluation of a High School Science Professional Learning Community

ERIC Educational Resources Information Center

McLelland-Crawley, Rebecca

2014-01-01

Teachers may benefit more from a professional learning community (PLC) than from professional development initiatives presented in single day workshops. The purpose of this program evaluation study was to identify characteristics of an effective PLC and to determine how the members of the PLC have benefitted from the program. Fullan's educational…

Serving the Needs of At-Risk Refugee Youth: A Program Evaluation

ERIC Educational Resources Information Center

McBrien, J. Lynn

2006-01-01

Refugee students, although frequently subsumed under the "immigrant" heading, often suffer from effects of significant trauma that can make them more vulnerable than children of voluntary immigrant families. This study evaluated a program created specifically for refugee youth at-risk for academic failure and "social death." The program goals…

Postadoption and Guardianship: An Evaluation of the Adoption Preservation, Assessment, and Linkage Program

ERIC Educational Resources Information Center

Liao, Minli; Testa, Mark

2016-01-01

Objectives: This study evaluated the effects of the Adoption Preservation, Assessment, and Linkage (APAL) postpermanency program. Method: A quasi-experimental, posttest-only design was used to estimate the program's effects on youth discharged from foster care to adoption or legal guardianship. A random sample was surveyed (female = 44.7%; African…

Effects of a National Indicated Preventive Intervention Program

ERIC Educational Resources Information Center

Husler, Gebhard; Werlen, Egon; Blakeney, Ronny

2005-01-01

As there have been few science-based evaluations of secondary prevention programs, the Federal Office of Public Health in Switzerland carried out a national program evaluation at 12 sites in the French- and German-speaking parts of Switzerland to study the question, "What works in secondary prevention?" These 12 centers offer different…

School-Based Smoking Prevention with Media Literacy: A Pilot Study

ERIC Educational Resources Information Center

Bier, Melinda C.; Schmidt, Spring J.; Shields, David; Zwarun, Lara; Sherblom, Stephen; Pulley, Cynthia; Rucker, Billy

2011-01-01

School-based tobacco prevention programs have had limited success reducing smoking rates in the long term. Media literacy programs offer an innovative vehicle for delivery of potentially more efficacious anti-tobacco education. However, these programs have been neither widely implemented nor well evaluated. We conducted a pre-post evaluation of a…

Innovations in Doctoral Education: Distance Education Methodology Applied

ERIC Educational Resources Information Center

Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan

2009-01-01

This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…

A Transition Program for Underprepared Students in General Chemistry: Diagnosis, Implementation, and Evaluation

ERIC Educational Resources Information Center

Shields, Shawn P.; Hogrebe, Mark C.; Spees, William M.; Handlin, Larry B.; Noelken, Greg P.; Riley, Julie M.; Frey, Regina F.

2012-01-01

We developed an online exam to diagnose students who are underprepared for college-level general chemistry and implemented a program to support them during the general chemistry sequence. This transition program consists of extended-length recitations, peer-led team-learning (PLTL) study groups, and peer-mentoring groups. We evaluated this…

The Boeing Company's Manufacturing Technology Student Internship. Final Evaluation Report for 1996.

ERIC Educational Resources Information Center

Owens, Tom

A study evaluated The Boeing Company's Student Internship Program for students enrolled in a manufacturing technology program. The programs in the Seattle (Washington) and Portland (Oregon) areas provided students with three progressive internship levels offered in the summers of grades 11, 12, and 13 (the first year of community college). The…

Post-Evaluation of an Entrepreneurship Program for Inner-City Youth

ERIC Educational Resources Information Center

Doucet, LaRon

2010-01-01

This study evaluated program graduates of National Foundation for Teaching Entrepreneurship 1 to years after completing the program in inner city schools of Los Angeles, California. Twenty-seven out of 150 graduates participated in 2 semi-structured interviews in Northern and Southern California, or long semi-structured telephone interviews for…

Social Validity Evaluation of the FRIENDS for Life Program with Mexican Children

ERIC Educational Resources Information Center

Gallegos-Guajardo, Julia; Ruvalcaba-Romero, Norma Alicia; Garza-Tamez, Martha; Villegas-Guinea, Diana

2013-01-01

This study is the first social validity evaluation of the Spanish version of the "FRIENDS for Life" program with Mexican children. "FRIENDS for Life" is a cognitive-behavioral intervention aimed at increasing social and emotional competence and decreasing anxiety and depressive symptoms in children. The program is designed to…

Evaluation of an Occupational Therapy Mentorship Program: Effects on Therapists' Skills and Family-Centered Behavior

ERIC Educational Resources Information Center

King, Gillian; Tam, Cynthia; Fay, Linda; Pilkington, Martha; Servais, Michelle; Petrosian, Hasmik

2011-01-01

There is growing interest in understanding the usefulness of mentorship programs for children's rehabilitation service providers. This evaluation study examined the effects of an occupational therapy mentorship program on the skills and behaviors of 8 new and 17 experienced occupational therapists practicing at a regional children's rehabilitation…

An Evaluation System for Training Programs: A Case Study Using a Four-Phase Approach

ERIC Educational Resources Information Center

Lingham, Tony; Richley, Bonnie; Rezania, Davar

2006-01-01

Purpose: With the increased importance of training in organizations, creating important and meaningful programs are critical to an organization and its members. The purpose of this paper is to suggest a four-phase systematic approach to designing and evaluating training programs that promotes collaboration between organizational leaders, trainers,…

Effectiveness of the Combat Operational Stress Control Training Program: Expectations of the U.S. Marine Corps

ERIC Educational Resources Information Center

Sipko, Marek M.

2010-01-01

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions. The…

Evaluation of an Innovative Post-Arrest Diversion Program: 12-Month Recidivism Analysis

ERIC Educational Resources Information Center

Dembo, Richard; Walters, Wansley; Wareham, Jennifer; Burgos, Catherimarty; Schmeidler, James; Hoge, Robert; Underwood, Lee

2008-01-01

We report the results of an evaluation study of a diversion program, operated by the Miami-Dade County Juvenile Assessment Center in Florida. The Post-Arrest Diversion (PAD) program represents an innovative approach to treatment and intervention within the juvenile justice system that utilizes standardized psychosocial risks and needs assessment…

Outcome Evaluation of a Community Center-Based Program for Mothers at High Psychosocial Risk

ERIC Educational Resources Information Center

Rodrigo, Maria Jose; Maiquez, Maria Luisa; Correa, Ana Delia; Martin, Juan Carlos; Rodriguez, Guacimara

2006-01-01

Objective: This study reported the outcome evaluation of the "Apoyo Personal y Familiar" (APF) program for poorly-educated mothers from multi-problem families, showing inadequate behavior with their children. APF is a community-based multi-site program delivered through weekly group meetings in municipal resource centers. Method: A total…

An Evaluation of the Technical Adequacy of a Revised Measure of Quality Indicators of Transition

ERIC Educational Resources Information Center

Morningstar, Mary E.; Lee, Hyunjoo; Lattin, Dana L.; Murray, Angela K.

2016-01-01

This study confirmed the reliability and validity of the Quality Indicators of Exemplary Transition Programs Needs Assessment-2 (QI-2). Quality transition program indicators were identified through a systematic synthesis of transition research, policies, and program evaluation measures. To verify reliability and validity of the QI-2, we…

Evaluating a New and Aspiring County Extension Director Leadership Education Program: Determining Outcomes and Needed Improvements

ERIC Educational Resources Information Center

Jayaratne, K. S. U.; Owen, Mitchel; Jones, David

2010-01-01

This leadership education evaluation study explored the leadership development outcomes of potential county extension directors and the ways to improve the program. The leadership education program aimed to improve participants' leadership abilities in understanding self, building relationships and managing resources. The analysis of quantitative…

Guidelines for Self-Study and External Evaluation of Undergraduate Physics Programs

ERIC Educational Resources Information Center

American Association of Physics Teachers (NJ1), 2005

2005-01-01

Influenced by the project entitled "Strategic Programs for Innovations in Undergraduate Physics", this document is intended to guide a physics department in initial, or mid-stream evaluation of a program of undergraduate physics education. The original Guidelines were developed by the American Association of Physics Teachers (AAPT) in 1986. The…

An Evaluation of a Community College Workforce-Training Program

ERIC Educational Resources Information Center

Duru-Nnebue, Thomisha M.

2012-01-01

This project study is an evaluation of a job-training program designed to serve unemployed adult learners at a community college. The program lacked empirical data about participants finding employment. The rationale for selecting the problem is the need to provide skill development and vocational training in response to high unemployment rates.…

Parenting after Divorce: Evaluation of Preventive Programs for Divorcing Families.

ERIC Educational Resources Information Center

Warren, Nancy J.; And Others

Preventive educational programs are potentially useful in reducing the effects of divorce on children and families. Parenting After Divorce is an ongoing study designed to evaluate preventive programs. Divorcing families with children aged 7-12 are identified from court records and contacted to participate. Families are randomly assigned to one of…

The Evaluation of an Early Childhood Teacher Preparation Program: An Action Research Project

ERIC Educational Resources Information Center

Ragno, Kerry Sullivan

2013-01-01

The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…

Small Learning Communities: 2000-2003. Evaluation Brief

ERIC Educational Resources Information Center

Heath, Debra

2005-01-01

The purpose of this program evaluation was to identify the effects of Small Learning Community (SLC) reforms on school climate, student attitudes and student performance. Eight SLC programs in five Albuquerque high schools were studied for one to four years, depending on each program's date of inception. Data were collected from students,…

How to Recognize a Quality Technical Education Program.

ERIC Educational Resources Information Center

Doty, Charles R.

Criteria for the evaluation of quality technical educational programs must be identified if follow-up studies are to be effective. Current research shows that problems in the development of such criteria include the tendency to evaluate programs on the basis of organizational structure rather than on the quality of the instructional program…

Widening Our Evaluative Lenses of Formal, Facilitated, and Spontaneous Academic Development

ERIC Educational Resources Information Center

Hoessler, Carolyn; Godden, Lorraine; Hoessler, Brian

2015-01-01

As conceptions of academic development expand to encompass a more diverse and flexible set of supports, traditional approaches to evaluation, including impact studies of formal programming, become insufficient. A program may appear ineffective when evaluation ignores additional supports that interact to counteract implementation or alternatively…

Evaluation of an Annual Community-Focused Agricultural Literacy Event

ERIC Educational Resources Information Center

Sandlin, M'Randa R.; Perez, Kauahi

2017-01-01

Agricultural literacy programs are effective pathways to informally teach the public about agriculture through stakeholder (attendee and exhibitor) interaction. Such programs are generally evaluated using attendee feedback but fail to include exhibitors' experience. The purpose of this study was to evaluate a local community agricultural event by…

ACORN's Accelerated Income Redistribution Project: A Program Evaluation

ERIC Educational Resources Information Center

Brooks, Fred; Russell, Daniel; Fisher, Robert

2006-01-01

Objective: This study evaluated the Association of Community Organizations for Reform Now's (ACORN) efforts to increase the uptake of families claiming the earned income tax credit through door-to-door canvassing and managing free tax preparation clinics in three pilot cities. Method: The mixed-method program evaluation included administrative…

A View of Current Evaluative Practices in Instrumental Music Teacher Education

ERIC Educational Resources Information Center

Peterson, Amber Dahlén

2014-01-01

The purpose of this study was to examine how instrumental music educator skills are being evaluated in current undergraduate programs. While accrediting organizations mandate certain elements of these programs, they provide limited guidance on what evaluative approaches should be used. Instrumental music teacher educators in the College Music…

Evaluating Alternative High Schools: Program Evaluation in Action

ERIC Educational Resources Information Center

Hinds, Drew Samuel Wayne

2013-01-01

Alternative high schools serve some of the most vulnerable students and their programs present a significant challenge to evaluate. Determining the impact of an alternative high school that serves mostly at-risk students presented a significant research problem. Few studies exist that dig deeper into the characteristics and strategies of…

Using the RE-AIM framework to evaluate physical activity public health programs in Mexico

USDA-ARS?s Scientific Manuscript database

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizationa...

The Efficacy of Stuttering Measurement Training: Evaluating Two Training Programs

ERIC Educational Resources Information Center

Bainbridge, Lauren A.; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J.

2015-01-01

Purpose: Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Method: Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of…

Evaluative Thinking in Practice: The National Asthma Control Program

PubMed Central

Fierro, Leslie A.; Codd, Heather; Gill, Sarah; Pham, Phung K.; Grandjean Targos, Piper T.; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings—specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention’s National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs’ evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts. PMID:29950803

Evaluating the Application of Program Outcomes to Study Abroad Experiences

ERIC Educational Resources Information Center

Smith, Patricia Joanne; Mrozek, Lawrence J.

2016-01-01

A search through the 2015 annual conference program of the National Collegiate Honors Council (NCHC) turned up a dozen sessions focusing on the topic of study abroad, demonstrating that a growing number of honors programs and colleges are encouraging or requiring study abroad. Many programs now offer and support honors semesters abroad or…

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

Employer evaluations of nurse graduates: a critical program assessment element.

PubMed

Ryan, M E; Hodson, K E

1992-05-01

Accountability in higher education dictates implementation of a comprehensive evaluation plan. Employer evaluation of graduates is an important component of program evaluation and contributes a different view that is rarely reported in the literature. The purpose of this study was to establish a database by surveying employers of baccalaureate-prepared nurses, postgraduation, over a five-year period. Employer surveys measured perceptions of graduates' functioning. Findings indicated that graduates function above expected levels for leadership skills, nursing skills, communication skills, and professionalism. Systematic program evaluation by employers is recommended at one and five years after graduation. A tool for employer evaluation of baccalaureate graduates is discussed.

Independence Community College Program Review Process.

ERIC Educational Resources Information Center

Romine, Robert J.

Program review at Independence Community College (ICC) is structured so that every program of study will undergo review within a 5-year period. The purpose of the program review effort is to assess the relationship of inputs to outcomes, so that actual outcomes can be compared to expected outcomes. Each program of study is evaluated according to…

Chile: Acceptability of a Training Program for Depression Management in Primary Care.

PubMed

Marín, Rigoberto; Martínez, Pablo; Cornejo, Juan P; Díaz, Berta; Peralta, José; Tala, Álvaro; Rojas, Graciela

2016-01-01

In Chile, there are inconsistencies in the management of depression in primary care settings, and the National Depression Program, currently in effect, was implemented without a standardized training program. The objective of this study is to evaluate the acceptability of a training program on the management of depression for primary care health teams. The study was a randomized controlled trial, and two primary centers from the Metropolitan Region of Santiago were randomly selected to carry out the intervention training program. Pre-post surveys were applied, to evaluate expectations and satisfaction with the intervention, respectively. Descriptive and content analysis was carried out. The sample consisted of 41 health professionals, 56.1% of who reported that their expectations for the intervention were met. All of the training activities were evaluated with scores higher than 6.4 (on a 1-7 scale). The trainers, the methodology, and the learning environment were considered strengths and facilitators of the program, while the limited duration of the training, the logistical problems faced during part of the program, and the lack of educational material were viewed as weaknesses. The intervention was well accepted by primary health care teams. However, the clinical impact in patients still has to be evaluated.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic

PubMed Central

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B.

2016-01-01

Background: The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. Objectives: A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. Study Design/Methods: This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. Results: The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. Conclusions: This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies. PMID:29444602

The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

NASA Astrophysics Data System (ADS)

Luera, Gail Rose

As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

ERIC Educational Resources Information Center

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Tai Chi: moving for better balance -- development of a community-based falls prevention program.

PubMed

Li, Fuzhong; Harmer, Peter; Mack, Karin A; Sleet, David; Fisher, K John; Kohn, Melvin A; Millet, Lisa M; Xu, Junheng; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-05-01

This study was designed to develop an evidence- and community based falls prevention program -- Tai Chi: Moving for Better Balance. A mixed qualitative and quantitative approach was used to develop a package of materials for program implementation and evaluation. The developmental work was conducted in 2 communities in the Pacific Northwest. Participants included a panel of experts, senior service program managers or activity coordinators, and older adults. Outcome measures involved program feasibility and satisfaction. Through an iterative process, a program package was developed. The package contained an implementation plan and class training materials (ie, instructor's manual, videotape, and user's guidebook). Pilot testing of program materials showed that the content was appropriate for the targeted users (community-living older adults) and providers (local senior service organizations). A feasibility survey indicated interest and support from users and providers for program implementation. A 2-week pilot evaluation showed that the program implementation was feasible and evidenced good class attendance, high participant satisfaction, and interest in continuing Tai Chi. The package of materials developed in this study provides a solid foundation for larger scale implementation and evaluation of the program in community settings.

An Incentive Program for Nurse Aides Implementation Report: Description and Evaluation. Illinois Long Term Care Research and Demonstration Projects Series. Final Report.

ERIC Educational Resources Information Center

Sinke, Mary

This study examined a nursing aide recognition program in a nursing home with 50 nurses and 200 nurse aides. Before the program was implemented, baseline data on job satisfaction were gathered with a questionnaire. A one-page description of the program and an evaluation tool were distributed to the nurse aides at their information sessions. Nurse…

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

A Process Evaluation of Project Developmental Continuity. Interim Report II, Part A: Program Case Studies. Volume 2.

ERIC Educational Resources Information Center

Spencer, Lynn, Ed.

These 7 case studies are part of a series of documents on the evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Each case study reviews the planning year at a PDC demonstration site in one…

A Process Evaluation of Project Developmental Continuity. Interim Report II, Part A: Program Case Studies. Volume I.

ERIC Educational Resources Information Center

Spencer, Lynn, Ed.

These 8 case studies are part of a series of documents on the evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Each case study reviews the planning year at a PDC demonstration site in one…

Development, Implementation, and Evaluation of a Professional Skills Development Program: The Case of Concordia University's GradProSkills

ERIC Educational Resources Information Center

Venkatesh, Vivek; Rabah, Jihan; Lamoureux-Scholes, Laurie; Pelczer, Ildiko; Urbaniak, Kathryn; Martin, Frédérica

2014-01-01

The Graduate and Professional Skills (GradProSkills) program is an initiative developed and run by Concordia University's School of Graduate Studies and the university's Office of the Vice-President, Research and Graduate Studies. This paper presents a case study in which we describe the development, implementation, and evaluative components of…

Self-Study and Evaluation Guide/1968 Edition. Section D-2B: Orientation on Mobility Services. (Dog Guide Program Only).

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on orientation and mobility services (dog guide program emphasis) is one of 28 guides designed for organizations undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of…

Systematic review of economic evaluations of vaccination programs in mainland China: Are they sufficient to inform decision making?

PubMed

Pan, Xiong-Fei; Griffiths, Ulla K; Pennington, Mark; Yu, Hongjie; Jit, Mark

2015-11-17

The purpose of the study was to systematically review economic evaluations of vaccine programs conducted in mainland China. We searched for economic evaluations of vaccination in China published prior to August 3, 2015 in eight English-language and three Chinese-language databases. Each article was appraised against the 19-item Consensus on Health Economic Criteria list (CHEC-list). We found 23 papers evaluating vaccines against hepatitis B (8 articles), Streptococcus pneumoniae (5 articles), human papillomavirus (3 articles), Japanese encephalitis (2 articles), rotavirus (2 articles), hepatitis A (1 article), Enterovirus 71 (1 article) and influenza (1 article). Studies conformed to a mean of 12 (range: 6-18) items in the CHEC-list criteria. Five of six Chinese-language articles conformed to fewer than half of the 19 criteria items. The main criteria that studies failed to conform to included: inappropriate measurement (20 articles) and valuation (18 articles) of treatment and/or vaccination costs, no discussion about distributional implications (18 articles), missing major health outcomes (14 articles), no discussion about generalizability to other contexts (14 articles), and inadequate sensitivity analysis (13 articles). In addition, ten studies did not include major cost components of vaccination programs, and nine did not report outcomes in terms of life years even in cases where QALYs or DALYs were calculated. Only 13 studies adopted a societal perspective for analysis. All studies concluded that the appraised vaccination programs were cost-effective except for one evaluation of universal 7-valent pneumococcal conjugate vaccine (PCV-7) in children. However, three of the five studies on PCV-7 showed poor overall quality, and the number of studies on vaccines other than hepatitis B vaccine and PCV-7 was limited. In conclusion, major methodological flaws and reporting problems exist in current economic evaluations of vaccination programs in China. Local guidelines for good practice and reporting, institutional mechanisms and education may help to improve the overall quality of these evaluations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Program evaluation of an Integrated Basic Science Medical Curriculum in Shiraz Medical School, Using CIPP Evaluation Model

PubMed Central

ROOHOLAMINI, AZADEH; AMINI, MITRA; BAZRAFKAN, LEILA; DEHGHANI, MOHAMMAD REZA; ESMAEILZADEH, ZOHREH; NABEIEI, PARISA; REZAEE, RITA; KOJURI, JAVAD

2017-01-01

Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by stablishing the horizontal basic science integration model and Early Clinical Exposure (ECE) for undergraduate medical education. The purpose of this study was to provide the required data for the program evaluation of this curriculum for undergraduate medical students, using CIPP program evaluation model. Methods: This study is an analytic descriptive and triangulation mixed method study which was carried out in Shiraz Medical School in 2012, based on the views of professors of basic sciences courses and first and second year medical students. The study evaluated the quality of the relationship between basic sciences and clinical courses and the method of presenting such courses based on the Context, Input, Process and Product (CIPP) model. The tools for collecting data, both quantitatively and qualitatively, were some questionnaires, content analysis of portfolios, semi- structured interview and brain storming sessions. For quantitative data analysis, SPSS software, version 14, was used. Results: In the context evaluation by modified DREEM questionnaire, 77.75%of the students believed that this educational system encourages them to actively participate in classes. Course schedule and atmosphere of class were reported suitable by 87.81% and 83.86% of students. In input domain that was measured by a researcher made questionnaire, the facilities for education were acceptable except for shortage of cadavers. In process evaluation, the quality of integrated modules presentation and Early Clinical Exposure (ECE) was good from the students’ viewpoint. In product evaluation, students’ brain storming, students’ portfolio and semi-structured interview with faculties were done, showing some positive aspects of integration and some areas that need improvement. Conclusion: The main advantage of assessing an educational program based on CIPP evaluation model is that the context, input, process and product of the program are viewed and evaluated systematically. This will help the educational authorities to make proper decisions based on the weaknesses and strengths of the program on its continuation, cessation and revision. Based on the results of this study, the integrated basic sciences course for undergraduate medical students in Shiraz Medical School is at a desirable level. However, attempts to improve or reform some sections and continual evaluation of the program and its accreditation seem to be necessary. PMID:28761888

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

Curricular Innovation in an Undergraduate Medical Program: What Is "Appropriate" Assessment?

ERIC Educational Resources Information Center

Ruhe, Valerie; Boudreau, J. Donald

2011-01-01

In post-secondary education, there is a widely-held belief in a "gold standard" for evaluative studies of curricular innovations. In this context, "appropriate" assessment is understood to refer to experimental designs and statistically significant differences in group outcomes. Yet in our evaluative study of a medical undergraduate program, we…

Assessment of Public Schools' Out-of-School Time Academic Support Programs with Participant-Oriented Evaluation

ERIC Educational Resources Information Center

Berk, Saban

2018-01-01

Using the participants-oriented approach, this study evaluated public schools' out-of-school time academic support programs, corresponding to the corrective/enrichment stage of Bloom's Mastery Learning Model and offered outside formal education's weekday hours and on weekends. Study participants included 50 principals, 110 teachers, 170 students…

Class Size Reduction in a Large Urban School District: A Mixed Methodology Evaluation Research Study.

ERIC Educational Resources Information Center

Munoz, Marco A.

This study evaluated the Class Size Reduction (CSR) program in 34 elementary schools in Kentucky's Jefferson County Public Schools. The CSR program is a federal initiative to help elementary schools improve student learning by hiring additional teachers. Qualitative data were collected using unstructured interviews, site observations, and document…

Transitional Services for Youth with Developmental Disabilities: Living in College Dorms

ERIC Educational Resources Information Center

Kirkendall, Abbie; Doueck, Howard J.; Saladino, Albert

2009-01-01

This study evaluates the impact of a college-based dormitory program on transitioning youth with intellectual disabilities. A qualitative study, with interviews at pre and post, was conducted to evaluate the program's impact. Data were collected with semistructured interviews from young adults with intellectual disabilities who participated in a…

Spacelab Level 4 programmatic Implementation Assessment Study. Volume 3: Optimization and programmatics

NASA Technical Reports Server (NTRS)

1978-01-01

Alternate level 4 integration approaches were synthesized and evaluated to establish the most cost effective experiment integration approach. Program baseline system trade studies are described, as well as Spacelab equipment utilization. Programmatic analysis of the baseline program was evaluated; the 2/3 and 1/3 traffic models were also considered.

Evaluation of Child Care Subsidy Strategies: Massachusetts Family Child Care Study

ERIC Educational Resources Information Center

Collins, Ann; Goodson, Barbara; Luallen, Jeremy; Fountain, Alyssa Rulf; Checkoway, Amy

2010-01-01

This report presents findings from the Massachusetts Family Child Care study, a two-year evaluation of the impacts of an early childhood education program on providers and children in family child care. The program--"LearningGames"--is designed to train caregivers to stimulate children's cognitive, language, and social-emotional…

An Evaluation of Taiwan Vocational and Technical Education Programs in Agriculture.

ERIC Educational Resources Information Center

Meaders, O. Donald; Chi-ho, Hu

Presented in both English and Chinese, this study of the system of agricultural education in Taiwan secondary and postsecondary schools resulted from the author's five-month stay in Taiwan and subsequent visits. Focus of the study is on evaluation of Taiwan's vocational agriculture education programs with information about students, faculties,…

Stage I Final Report for the Study of Program Management Procedures in the Campus-Based and Basic Grant Programs. (Volume I).

ERIC Educational Resources Information Center

Puma, Michael J.; And Others

The third phase of SISFAP (Study on the Impact of Student Financial Aid Programs), the primary purpose of this study is to evaluate federal and institutional management policies and practices for Basic Educational Opportunity Grant (BEOG) and campus-based programs as they impact on the extent to which the programs are meeting their legislative…

African Social Studies Program-1, 1988-89. Final Report. A Master's Degree Program for African Social Studies Leaders.

ERIC Educational Resources Information Center

Indiana Univ., Bloomington.

This paper presents the final report on a project that brought African social studies education leaders to Indiana University (Bloomington) to take part in a Master's Degree program. The report contains a brief history of the program, a description of the program, a discussion of issues relating to acculturation, an evaluation, a list of…

Promoting organ donation through an entertainment-education TV program in Korea: Open Your Eyes.

PubMed

Byoung Kwan Lee; Hyun Soon Park; Choi, Myung-Il; Cheon Soo Kim

2010-01-01

The purpose of this study is to investigate the effects of the characteristics of the program, Open Your Eyes, an entertainment-education TV program in Korea, on parasocial interaction and behavioral intention for organ donation. The results indicated that affective evaluation positively affected parasocial interaction with the program but cognitive evaluation negatively affected involvement with beneficiaries in the program. Also, it was found that cognitive evaluation of Open Your Eyes had a significant positive effect on behavioral intention. In addition, a significant positive effect of program engagement on the behavioral intention was found. Thus, the results indicate that individuals who feel program engagement of Open Your Eyes will be more likely to proceed with organ donation. However, no direct effect of involvement with the beneficiary and program hosts was found.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

ERIC Educational Resources Information Center

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

Literacy Block: Meeting the Needs of All Learners; A Summative Program Evaluation

ERIC Educational Resources Information Center

Pelletier, Nancy L.

2011-01-01

This summative program evaluation study investigated the Response to Intervention (RTI) pilot literacy block program that was implemented in first and second grade classrooms in a small southeastern suburban school. All 111 students in the first and second grade were involved in this RTI model during the 2010-2011 school year including special…

Evaluation of Link Courses and Other Co-Operative Educational Programs in New South Wales During 1979.

ERIC Educational Resources Information Center

Craig, Alan; And Others

Link courses and other cooperative educational programs designed for secondary school students in New South Wales were evaluated in 1979. Link courses/programs are instructional sessions in which secondary students attend a postsecondary institution, or in which postsecondary faculty give lessons to students at the secondary school. The study was…

A Strategy for Making Decisions and Evaluating Alternative Juvenile Offender Treatment Programs: Compensating for Missing Information.

ERIC Educational Resources Information Center

Roberts, Albert R.; Schervish, Phillip

1988-01-01

National survey data on the cost-effectiveness and cost-benefits of 11 different juvenile offender treatment program types are reviewed. Best-worst-midpoint, threshold, and convergency analyses are applied to these studies. Meaningful ways of dealing with missing information when evaluating alternative juvenile justice policies and programs are…

Evaluation of the Waterford Early Reading Program in Kindergarten, 2005-06

ERIC Educational Resources Information Center

Powers, Stephen; Price-Johnson, Connie

2006-01-01

Background: The Waterford Early Reading Program (WERP), a technology-based program for early elementary grades, was provided through Arizona all day kindergarten funds to kindergarten students in 15 Title I elementary schools in the Tucson Unified School District (TUSD) in the 2005-06 school year. The purpose of this study is to evaluate the…

Evaluating a Social Learning Program in On-Line Mental Health Agencies.

ERIC Educational Resources Information Center

Fleischman, Matthew J.

During the past 12 years the Oregon Social Learning Center has been studying the application of social learning theory to aggressive children. One result has been the development of a treatment program in which parents are trained to alter their child's behavior. That program has been evaluated on three separate samples of aggressive children.…

Challenging the Gifted through Problem Solving Experiences: Design and Evaluation of the COMET Program.

ERIC Educational Resources Information Center

Feldhusen, John F.; And Others

1992-01-01

The COMET summer residential program at Purdue University (Indiana) offers gifted and talented youth in grades 4-6 a week of intensive study in a single content area. Courses stress specific problem-solving skills and development of a rich knowledge base. Extensive program evaluation by students, teachers, counselors, and parents was highly…

Grover Cleveland High School. Basic Bilingual Program. O.E.E. Evaluation Report, 1981-1982.

ERIC Educational Resources Information Center

Di Martino, Vincent James; And Others

This paper evaluates the bilingual educational program at Grover Cleveland High School, Queens, New York City. The program offered instruction in English as a second language (ESL) and native language skills in Italian and Spanish as well as courses in science, mathematics, and social studies to 142 students with limited English proficiency. The…

Self-Study and Evaluation Guide/1979 Edition. Section D-16: Other Service Program.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

The self evaluation guide is explained to be designed for accreditation of services to blind and visually handicapped students in service programs for which the NAC (National Accreditation Council for Agencies Serving the Blind and Visually Handicapped) does not have specific program standards (such as radio reading services and library services).…

A Program Evaluation of a Worksite Wellness Initiative for Weight Loss

ERIC Educational Resources Information Center

Martinez, Nicholas

2017-01-01

The purpose of this study was to conduct a program evaluation of ACME's worksite weight loss initiative and collect evidence relative to the efficacy of the program. An anonymous online survey was administered to participants of the weight loss initiative. The survey was designed to gather information relative to the research questions, which…

Evaluating the Efficacy of Children Participating in Home Instruction for Parents of Preschool Youngsters and Head Start

ERIC Educational Resources Information Center

Brown, Amber L; Lee, Joohi

2017-01-01

The purpose of this study was to evaluate the efficacy of the Home Instruction for Parents of Preschool Youngsters program when implemented within Head Start programs by measuring children's language proficiency scores. Participants were kindergarteners concurrently enrolled in both a Head Start program and the Home Instruction for Parents of…

Program Evaluation and Replications of School-Based Mental Health Services and Family-Community Interventions with Chronically Disruptive Students

ERIC Educational Resources Information Center

Carpenter-Aeby, Tracy; Aeby, Victor G.

2005-01-01

Although outcomes for alternative schools may be mixed, it is generally agreed that counseling, therapy, group work, case management, and family-community involvement have been credited in some effective programs. This study examined program evaluations from 1994-1999 for an alternative school for chronically disruptive students (599 students,…

Evaluating a Blended Degree Program through the Use of the NSSE Framework

ERIC Educational Resources Information Center

Vaughan, Norman; Cloutier, David

2017-01-01

The purpose of this student-faculty partnership research study was to evaluate the effectiveness of a blended four-year Bachelor of Education Elementary Program at a Canadian university using the National Survey of Student Engagement (NSSE) framework. Data was collected from the first graduating cohort of students from the B.Ed. program in…

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

ERIC Educational Resources Information Center

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

A Multi-Phased Evaluation of the Impact of a Non-School Science Exhibition.

ERIC Educational Resources Information Center

Fortner, Rosanne W.

The impact of "The Great Lake Erie," an outreach program that aimed to improve visitor knowledge and attitudes about Lake Erie, is discussed in this evaluative study. "The Great Lake Erie" was presented as a two-part program consisting of a lecture and demonstration stage presentation and a series of exhibits. The program was…

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

ERIC Educational Resources Information Center

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

Evaluation of a Classroom Program of Creative Expression Workshops for Refugee and Immigrant Children

ERIC Educational Resources Information Center

Rousseau, Cecile; Drapeau, Aline; Lacroix, Louise; Bagilishya, Deogratias; Heusch, Nicole

2005-01-01

Objective: This evaluative study assessed the effect of a creative expression program designed to prevent emotional and behavioral problems and to enhance self-esteem in immigrant and refugee children attending multiethnic schools. Method: The 12-week program involved 138 children, aged 7 to 13, registered in both integration classes designed for…

Preventing Dating Violence in Public Schools: An Evaluation of an Interagency Collaborative Program for Youth

ERIC Educational Resources Information Center

Lowe, Laura A.; Jones, Chris D.; Banks, Leon

2007-01-01

Many communities offer programs aimed at improving teen dating skills and knowledge about violence and sexual behavior. This research study evaluates one such program, operated by an interagency collaborative. Each of four participating community agencies provided one hour of curriculum during one week of health class. Lecture, group activities,…

Development and Pilot Evaluation of a Psychosocial Intervention Program for Patients with Age-Related Macular Degeneration

ERIC Educational Resources Information Center

Birk, Tanja; Hickl, Susanne; Wahl, Hans-Werner; Miller, Daniel; Kammerer, Annette; Holz, Frank; Becker, Stefanie; Volcker, Hans E.

2004-01-01

Purpose: The psychosocial needs of patients suffering from severe visual loss associated with advanced age-related macular degeneration (ARMD) are generally ignored in the clinical routine. The aim of this study was to develop and evaluate a psychosocial intervention program for ARMD patients. This intervention program was based on six modules…

Evaluations of School Readiness Initiatives: What Are We Learning? SERVE's Expanded Learning Opportunities National Leadership Area Research Report.

ERIC Educational Resources Information Center

Brown, Elizabeth G.; Scott-Little, Catherine

Encouraged by evidence linking quality early care/education programs and improved student outcomes, a variety of school readiness programs and initiatives have been created. This report reviews and synthesizes evaluation studies conducted on early childhood interventions, focusing on programs emphasizing a school readiness goal. The report…

Assessing communications effectiveness in meeting corporate goals of public health organizations.

PubMed

Brown, Gordon D; Bopp, Kenneth D; Boren, Suzanne Austin

2005-01-01

Much evaluation of health communications in public health is considered from a program perspective of smoking cessation, weight reduction, education on sexually transmitted diseases, etc. These studies have advanced the knowledge base of communications theory and evaluation and have contributed to program effectiveness. In program-based evaluation the communications process is structured as part of the program itself. This article extends program-based communications evaluation to view communications from the perspective of the consumer and how effectively public health departments respond to consumer expectations. It develops a conceptual model for evaluating elements of communications such as its importance in defining mission and goals within the community, managing strategic constituencies, and enlisting individuals and groups as customers and co-producers of health. It gives a broader perspective on how communications in public heath organizations are managed and a basis for assessing whether they are being managed effectively.

Methods and Purposes for Conducting Students' Course Evaluations Reported by North American Dental School and Dental Hygiene Program Leaders: A Preliminary Survey Study.

PubMed

Reinke, Robin E; Enright, Tonya; Love, Rebecca; Patel, Shalizeh A; Ali, Ala Omar; Horvath, Zsuzsa

2018-03-01

The aim of this preliminary survey study was to determine the perceptions of leaders of dental schools and dental hygiene programs regarding methods of and purposes for conducting students' course evaluations and their role in course improvement, curriculum design, and faculty assessment. A short electronic survey was distributed in 2016 to the academic deans of all 76 dental schools in the U.S. and Canada and a convenience sample of program directors of 232 of the total 332 accredited dental hygiene programs. Individuals from 93 institutions responded for an overall response rate of 30%: 30 of 76 dental schools (39.5% response rate) and 63 of the 232 dental hygiene programs (27% response rate). All of the respondents (100%) reported that their institutions' full-time faculty members were assessed by students in course evaluations for each course and semester they taught. However, only 78% reported that their part-time faculty members were evaluated by students. Course evaluations were mandatory in 62% (n=58) of the responding institutions, with the remaining 38% (n=35) optional. Respondents indicated course directors received the evaluation results for purposes of annual review (n=73, 78%) and instructional review (n=70, 75%). Further investigation of the use and effects of student evaluations is needed to better understand their role in faculty assessment and other aspects of the administration of dental schools and dental hygiene programs.

When Control Groups Do Not Exist: Program Evaluation without a Net.

ERIC Educational Resources Information Center

Clark, Sheldon B.; And Others

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Does the Kids Cafe Program's nutrition education improve children's dietary intake? A pilot evaluation study

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the Kids Café Program (KCP) nutrition education intervention and assess its impact on children's diet quality and body mass index (BMI) percentile. An experimental design consisting of pretest-posttest comparison groups using mixed methods was used to evaluate the 6-ses...

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Three

ERIC Educational Resources Information Center

Wolanin, Natalie; Wade, Julie

2014-01-01

The Office of Shared Accountability conducted an evaluation of the implementation of the third and final year (2012-2013) of the "Science, Technology, and Engineering Leadership Program" (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard…

An Examination of Final Evaluation Methods Used in Master's Level Counseling Programs.

ERIC Educational Resources Information Center

Carney, Jamie S.; Cobia, Debra C.; Shannon, David M.

1998-01-01

Reports the findings of a national study examining methods used for final evaluation in master's level counseling programs. Suggests that as faculty review their policies and procedures with regard to student evaluation, these data may provide valuable information concerning methods selection, content, and delivery of feedback to students.…

Evaluation of Training Programs in Russian Manufacturing Companies

ERIC Educational Resources Information Center

Kucherov, Dmitry; Manokhina, Daria

2017-01-01

Purpose: This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels…

Shared Features of High-Performing After-School Programs: A Follow-Up to the TASC Evaluation

ERIC Educational Resources Information Center

Birmingham, Jennifer; Pechman, Ellen M.; Russell, Christina A.; Mielke, Monica

2005-01-01

This study examined high-performing after-school projects funded by The After-School Corporation (TASC), to determine what characteristics, if any, these projects shared. Evaluators reanalyzed student performance data collected during the multi-year evaluation of the TASC initiative to identify projects where the after-school program was…

Evaluating a Graduate Professional Development Program for Informal Science Educators

ERIC Educational Resources Information Center

Lake, Jeremy Paul

2017-01-01

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the "Informal Science Institutions Environmental Education Graduate Certificate Program" truly provided the long term…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Two

ERIC Educational Resources Information Center

Wolanin, Natalie L.; Wade, Julie H.

2013-01-01

The Office of Shared Accountability (OSA) conducted an evaluation of the implementation of the second year (2011-2012) of the Science, Technology, and Engineering Leadership Program (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard Hughes Medical…

Employer Expectations of Sport Managers and Evaluation of Sport Management Programs in the United States.

ERIC Educational Resources Information Center

DeSensi, Joy T.; And Others

The report consists of a series of studies designed to assess the needs of sport management positions and evaluate sport management programs/curricula in institutions of higher education. Three surveys were conducted to determine: (1) employer expectations of sport managers; (2) employer evaluation of educational sport management…

Buffering Negative Impacts of Divorce on Children: Evaluating Impact of Divorce Education

ERIC Educational Resources Information Center

Crawford, Jennifer K.; Riffe, Jane; Trevisan, Dominic A.; Adesope, Olusola O.

2014-01-01

Following the call for more stringent evaluation methodology and recently documented national Extension presence in the field of divorce education for parents and children, the study reported here describes a local multi-level evaluation to capture program impact of a stakeholder-accepted divorce education program. Using a post-then-pre…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

The Role of NIE in Foreign Language Dissemination and Evaluation.

ERIC Educational Resources Information Center

Eddy, Peter A.

One of 10 studies commissioned to investigate research needs and to stimulate planning activities, this paper reviews program evaluation in foreign language education (FLED), and offers a number of recommendations to improve present practice. It begins by noting that very little FLED program evaluation is taking place today, and by arguing that…

Evaluation of the 1985-86 Beginning Teacher Program.

ERIC Educational Resources Information Center

Feldman, H. S.

The Florida Beginning Teacher Program was evaluated in 1985-86 to determine its impact on teacher performance and to study problem areas identified in the 1984-85 evaluation. A sample of 43 beginning teachers and their support team members (a peer teacher, a building-level administrator, and one or more professional educators) completed surveys.…

House fire injury prevention update. Part II. A review of the effectiveness of preventive interventions

PubMed Central

Warda, L.; Tenenbein, M.; Moffatt, M.

1999-01-01

Objective—To evaluate and summarize the house fire injury prevention literature. Methods—MEDLINE (1983 to March 1997) was searched by keyword: fire, burn, etiology, cause, prevention, epidemiology, and smoke detector/alarm. ERIC (1966 to March 1997) and PSYCLIT (1974 to June 1997) were searched by keyword: as above, and safety, skills, education, and training. Other sources included references of retrieved publications, review articles, and books; Injury Prevention hand search; government documents; and internet sources. Sources relevant to residential fire injury prevention were selected, evaluated, and summarized. Results—Forty three publications were selected for review, including seven randomized controlled trials, nine quasiexperiments, two natural experiments, 21 prospective cohort studies, two cross sectional surveys, one case report, and one program evaluation. These studies examined the following types of interventions: school (9), preschool (1), and community based educational programs (5); fire response training programs for children (7), blind adolescents (2), and mentally retarded adults (5) and children (1); office based counseling (4); home inspection programs (3); smoke detector giveaway campaigns (5); and smoke detector legislation (1). Conclusions—This review of house fire prevention interventions underscores the importance of program evaluation. There is a need for more rigorous evaluation of educational programs, particularly those targeted at schools. An evidence based, coordinated approach to house fire injury prevention is critical, given current financial constraints and the potential for program overload for communities and schools. PMID:10518271

School-Based Peer Mentoring in High School: A Program Evaluation Study

ERIC Educational Resources Information Center

Cooper, Felicia Cecile

2017-01-01

The dissertation is an initial investigation of a peer mentoring program in a suburban high school in the southeastern United States. Additionally, the Peer Mentoring Program (PMP) study examined whether the Program improves academic performance and attendance, and decreases referrals. Utilizing an experimental design, a Participant and a…

Building on a YMCA's health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_.

PubMed

Bush, Paula Louise; García Bengoechea, Enrique

2016-08-01

School-based physical activity programs are only effective for increasing adolescents' school-based physical activity. To increase out-of-school-time physical activity, complementary community programs are warranted. Partnerships between universities and community organizations may help build the capacity of these organizations to provide sustainable programs. To understand capacity building processes and outcomes, we partnered with a YMCA to build on their adolescent physical activity promotion capacity. Together, we designed and implemented means to evaluate the YMCA teen program to inform program planning. For this qualitative case study, emails and interviews and meetings transcripts were collected over 2.5 years and analyzed using inductive and deductive thematic analysis. Findings illustrate that the YMCA's workforce and organizational development capacities (e.g., evaluation and health promotion capacity and competence) were increased through our partnership, resource allocation, and leadership. We responded to YMCA partners' perceived needs, yet guided them beyond those needs, successfully combining our complementary objectives, knowledge, and skills to generate an integrated program vision, rationale, and evaluation results. This provided YMCA partners with validation, reminders, and awareness. In turn, this contributed to programming and evaluation practice changes. In light of extant capacity building literature, we discuss how our partnership increased the YMCA's capacity to promote healthy adolescent programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].

PubMed

Nagahama, Elizabeth Eriko Ishida

2009-01-01

The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.

In situ ozone data for evaluation of the laser absorption spectrometer ozone remote sensor: 1979 southeastern Virginia urban plume study summer field program

NASA Technical Reports Server (NTRS)

Gregory, G. L.; Mcdougal, D. S.; Mathis, J. J., Jr.

1980-01-01

Ozone data from the 1979 Southeastern Virginia Urban Study (SEV-UPS) field program are presented. The SEV-UPS was conducted for evaluation of an ozone remote sensor, the Laser Absorption Spectrometer. During the measurement program, remote-sensor evaluation was in two areas; (1) determination of the remote sensor's accuracy, repeatability, and operational characteristics, and (2) demonstration of the application of remotely sensed ozone data in air-quality studies. Data from six experiments designed to provide in situ ozone data for evaluation of the sensor in area 1, above, are presented. Experiments consisted of overflights of a test area with the remote sensor aircraft while in situ measurements with a second aircraft and selected surface stations provided correlative ozone data within the viewing area of the remote sensor.

The Evaluation of Industry Practical of Mechanical Engineering in Vocational Education: A CIPP Model Approach

NASA Astrophysics Data System (ADS)

Kamaludin, M.; Munawar, W.; Mahdan, D.; Simanjuntak, M. V.; Wendi, H. F.

2018-02-01

The learning system is not only studied on campus but also practicing in the world of work. Industry Practical aims to enable students to develop their skills in accordance with the real world of work. To know the success of the implementation of industry practical program then held evaluation. The evaluation of the program in this study used the CIPP evaluation approach (Context, Input, Process, Product). The purpose of this research is to know the extent of achievement and success of industry practical program at vocational school in Bandung with descriptive research method using mix method approach. The sample in this research is students majoring in mechanical engineering in the city of Bandung who have done industry practical.

Using the RE-AIM framework to evaluate physical activity public health programs in México.

PubMed

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

PubMed

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Evaluating a community saturation model of abstinence education: an application of social marketing strategies.

PubMed

Tanner, John F; Anne Raymond, Mary; Ladd, Stacey D

2009-01-01

This study examines a community saturation program, a social marketing strategy, promoting abstinence education and evaluates the effects of this strategy on adolescents' attitudes and sexual behaviors. The study also examines components of the strategy to determine which program element was most influential. The Worth the Wait program was implemented in five counties in Texas beginning in 1999 for the first county and in 2000 and 2001 for the other four counties. A total of 2007 students in grades 7 through 12 were tracked and answered an end-of-the-year post-program survey after varying time periods of school program participation. Results indicate that a saturation program can be effective in reducing teen pregnancy.

A participatory approach to evaluating a national training and institutional change initiative: the BUILD longitudinal evaluation.

PubMed

Davidson, Pamela L; Maccalla, Nicole M G; Afifi, Abdelmonem A; Guerrero, Lourdes; Nakazono, Terry T; Zhong, Shujin; Wallace, Steven P

2017-01-01

The National Institutes of Health (NIH) funds training programs to increase the numbers and skills of scientists who obtain NIH research grants, but few programs have been rigorously evaluated. The sizeable recent NIH investment in developing programs to increase the diversity of the NIH-funded workforce, implemented through the Diversity Program Consortium (DPC), is unusual in that it also funds a Consortium-wide evaluation plan, which spans the activities of the 10 BUilding Infrastructure Leading to Diversity (BUILD) awardees and the National Research Mentoring Network (NRMN). The purpose of this article is to describe the evaluation design and innovations of the BUILD Program on students, faculty, and institutions of the 10 primarily undergraduate BUILD sites. Our approach to this multi-methods quasi-experimental longitudinal evaluation emphasizes stakeholder participation and collaboration. The evaluation plan specifies the major evaluation questions and key short- to long-term outcome measures (or Hallmarks of Success). The Coordination and Evaluation Center (CEC) embarked on a comprehensive evaluation strategy by developing a set of logic models that incorporate the Hallmarks of Success and other outcomes that were collaboratively identified by the DPC. Data were collected from each BUILD site through national surveys from the Higher Education Research Institute at UCLA (HERI), annual followup surveys that align with the HERI instruments, site visits and case studies, program encounter data ("tracker" data), and institutional data. The analytic approach involves comparing changes in Hallmarks (key outcomes) within institutions for biomedical students who participated versus those who did not participate in the BUILD program at each institution, as well as between institution patterns of biomedical students at the BUILD sites, and matched institutions that were not BUILD grantees. Case studies provide insights into the institutionalization of these new programs and help to explain the processes that lead to the observed outcomes. Ultimately, the results of the consortium-wide evaluation will be used to inform national policy in higher education and will provide relevant examples of institutional and educational programmatic changes required to diversify the biomedical workforce in the USA.

Interim evaluation of the Tier 1 Program of Project P.A.T.H.S.: continuation of evidence.

PubMed

Shek, Daniel T L; Yu, Lu; Chan, Alex C W

2012-01-17

An interim evaluation study was conducted to understand the implementation of the Tier 1 Program of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) in the 2008/09 school year. One hundred and twenty-eight schools were randomly selected to provide information on the implementation details of the program via interviews, telephone interviews and self-completed questionnaires. Results showed that a majority of the workers perceived that the students had positive responses to the program and the program was helpful to the students. Program workers' views toward the implementation of the Tier 1 Program were positive across different grades and program implementation modes. In conjunction with previous studies, the present findings suggest that the Tier 1 Program of Project P.A.T.H.S. is well received by different stakeholders.

[Evaluation of an education program for patients with asthma who use inhalers].

PubMed

Lee, Jong Kyung; Yang, Young Hee

2010-04-01

This study was done to evaluate the effectiveness of an education program for patients with asthma who use inhalers. The research design for this study was a non-equivalent control group quasi-experimental study. Participants in this study were 36 patients for the control group, and 43 patients for the experimental group. The experimental group participated in the education program. The control group received the usual care. Data were collected before and 1 month and 2 months after the program finished and were analyzed using the SPSS 12.0 program. The experimental group had significantly higher scores of knowledge of inhalers, and inhalation technique compared to the control group. However, no significant differences were found between two groups for PEFR, asthma instability, and satisfaction with inhalers. According to the results, the education program was effective in improving knowledge of inhalers, and inhalation technique. Therefore, it is recommended that this education program be used in clinical practice as an effective nursing intervention for patients with asthma on inhalers.

What Works to Reduce Victimization? Synthesizing What We Know and Where to Go From Here.

PubMed

Fox, Kathleen A; Shjarback, John A

2016-01-01

While some attention has been paid to "what works" to reduce crime, little is known about the effectiveness of programs designed to reduce victimization. This study systematically reviews 83 program evaluations to identify what works to (a) reduce victimization, (b) enhance beliefs/attitudes about victims, and (c) improve knowledge/awareness of victimization issues. Evidence-based findings are organized around 4 major forms of victimization, including bullying, intimate partner violence, sexual abuse, and other general forms of victimization. Determining whether certain types of programs can reduce the risk of victimization has important implications for improving people's quality of life. Based on our findings, we offer several promising directions for the next generation of research on evaluating victimization programs. The goal of this study is to improve the strength of future program evaluations, replications, and other systematic reviews as researchers and practitioners continue to learn what works to reduce victimization.

An Agent-Based Cockpit Task Management System

NASA Technical Reports Server (NTRS)

Funk, Ken

1997-01-01

An agent-based program to facilitate Cockpit Task Management (CTM) in commercial transport aircraft is developed and evaluated. The agent-based program called the AgendaManager (AMgr) is described and evaluated in a part-task simulator study using airline pilots.

Evaluation of the traffic count program.

DOT National Transportation Integrated Search

1978-01-01

The purpose of this study was to determine the Department's needs for traffic count data, to relate them to an evaluation of the traffic count programs and procedures, to identify problems and deficiencies with data requirements, and to seek means of...

Evaluating local food programs: the case of Select Nova Scotia.

PubMed

Knight, Andrew J

2013-02-01

This study evaluated the effectiveness of the buy local food program Select Nova Scotia; a government program with the goal to increase awareness and consumption of Nova Scotia produced and processed agri-food products by Nova Scotians and visitors. The evaluation methodology was based on prior evaluation resources and local food consumer research. Data were gathered through a web panel survey; 877 respondents completed the survey in June 2010. The results suggest that the program is reaching a wider audience than just those predisposed to local food initiatives. In addition, awareness of Select Nova was related to perceptions of local benefits and barriers, as well as purchase motivation and behavior. Respondents who were aware of Select Nova Scotia rated societal benefits as more important and viewed location and price as less of a barrier; they were also more likely to be highly motivated to purchase local foods. This study also informs results found in previous consumer research studies and identifies marketing opportunities to enhance the effectiveness of local food programs. The results suggest that societal benefits might be used as a way to differentiate products with similar attributes. Copyright © 2012 Elsevier Ltd. All rights reserved.

Using student satisfaction data to evaluate a new online accelerated nursing education program.

PubMed

Gazza, Elizabeth A; Matthias, April

2016-10-01

As increasing numbers of students enroll in online education, institutions of higher education are responsible for delivering quality online courses and programs. Agencies that accredit institutions and programs require evidence of program quality, including student satisfaction. A large state university in the Southeastern United States transitioned an online nursing education degree completion, or Registered Nurse-to-Bachelor of Science in Nursing, program to an online accelerated format in order to meet the needs of working nurses and ultimately, increase the number of nurses prepared at the baccalaureate level. This article describes a descriptive, cross-sectional study that evaluated the effectiveness of the new online accelerated program using the quality indicator of student satisfaction. Ninety-one (32%) of the 284 students who were enrolled or had been enrolled in a course within the online accelerated degree completion program between fall 2013 session 1 and summer 2014 session participated in the study. The electronic Noel-Levitz Priorities Survey for Online Learners™ was used to measure student satisfaction with the program and associated services. Results provided insight into the students' satisfaction with the new program format and served as the basis for an interdepartmental program enhancement plan aimed at maintaining and enhancing student satisfaction and overall program quality. Findings indicated that measuring and evaluating student satisfaction can provide valuable information about the effectiveness of an online program. Recommendations for using the measurement tool in online program planning and studying student satisfaction in relation to retention and program completion were identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

Performance Evaluation of Community Health Workers: Case Study in the Amazon of Peru.

PubMed

Westgard, Christopher; Naraine, Renuka; Paucar Villacorta, Diego Mauricio

2018-03-26

A shortage in human resources for health is a growing crisis that has led to an inability to provide adequate health services to impoverished populations. By "task-shifting", health systems can delegate certain activities, such as health promotion and referral, to trained community members to help fill the human resource gap. An effective community health agent program can improve maternal and child health and overall effectiveness of rural health systems. Such a program is most effective when the community health agents receive supervision and evaluation of their performance. There is a shortage of literature that provides instruction and example on how to conduct a performance evaluation in the developing world to improve maternal and child health outcomes. The current study provides a case study of a performance evaluation in the Amazon region of Peru and how the findings can be used to make program adjustments. A set of instruments to measure the performance of CHWs was adapted from the literature and then implemented in the field. The instruments were used to measure the quality of home visits by the CHWs, their knowledge of the health topics, and structural activities. Three communities with an active CHW program in Loreto, Peru were chosen to receive the evaluation. All CHWs in the communities were evaluated. The scores from the evaluation were compared internally to identify strengths and weaknesses of the program and within the population of CHWs. The evaluation was completed on 52 home visits and 27 CHWs in three communities. The CHWs were found to be most effective at creating good relationships with caregivers and delivering health messages, and least effective at interacting with the child during the home visit and using material to deliver health messages. The evaluation instruments were well suited for the CHW program that utilizes home visits to teach about child health and development.

Supplemental Instruction (SI) at the Faculty of Engineering (LTH), Lund University, Sweden. An Evaluation of the SI-Program at Five LTH Engineering Programs Autumn 2008

ERIC Educational Resources Information Center

Malm, Joakim; Bryngfors, Leif E.; Mörner, Lise-Lotte

2010-01-01

The study presents an evaluation of the SI program in five engineering programs within the Faculty of Engineering (LTH) based on data from questionnaires to SI participants and SI-Leaders, credits taken by the students during the first year, and average grade data from high school for the first year students. The results show that participation in…

Framework for a National Testing and Evaluation Program ...

EPA Pesticide Factsheets

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

The Effectiveness of Adapted Versions of an Evidence-based Prevention Program in Reducing Alcohol Use among Alternative School Students

PubMed Central

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youth, there is a need to facilitate the implementation and evaluation of these programs in real world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin’ it REAL (kiR), with alternative school students. Programs are often adapted when used in schools and other community settings for a variety of reasons. The kiR adaptations, developed during an earlier phase of this study, were created to make the curriculum more appropriate for alternative high school youth. The adaptations were evaluated using a quasi-experimental design in which questionnaires were administered at pretest, posttest, and follow-up, and focus groups were conducted at posttest. MANOVA analyses indicate significantly reduced intentions to accept alcohol and, for younger participants, reduced alcohol use. Focus group data support the need for age appropriate prevention content. The authors discuss implications for practitioners implementing prevention programs in schools. PMID:20622971

Nurse education regarding agitated patients and its effects on clinical practice.

PubMed

Ozdemir, Leyla; Karabulut, Erdem

This study identified the impact of an education program on nurses' practices for agitated patients and documented the changes in practice after completion of the training. Eighteen cardiac intensive care nurses were included to the study. Prior to nurses' participation in an education program, a pre-test indicating nurses' current practices for 40 agitated patients was evaluated with the 'Nurse Practice Form'. After the pre-test data collection period was completed, the 2-day training program on caring for agitated patients was conducted. The last step of the study was evaluation of post-test nurses' practices for 40 agitated patients using the 'Nurse Practice Form'. The findings indicated that instead of pre-test nurses' use of physical restraints for controlling agitated patients without a physician order, none of post-test nurses applied them. The training program provided nurses the knowledge and skills needed to evaluate and to manage the causes of agitation.

Comments on Professor Lortie's Paper Entitled "The Cracked Cake of Educational Custom and Emerging Issues in Evaluation." Center for the Study of Evaluation of Instructional Programs Occasional Report No. 21.

ERIC Educational Resources Information Center

Gage, N. L.

This commentary takes no serious exception to Professor Lortie's conclusions about educational changes and issues in evaluation, but it examines certain assumptions. It questions the implications that each school district needs independent evaluation and that evaluation should be applied at the end of a given educational program, and asks what…

Redesigning a clinical mentoring program for improved outcomes in the clinical training of clerks

PubMed Central

Lin, Chia-Der; Lin, Blossom Yen-Ju; Lin, Cheng-Chieh; Lee, Cheng-Chun

2015-01-01

Introduction Mentorship has been noted as critical to medical students adapting to clinical training in the medical workplace. A lack of infrastructure in a mentoring program might deter relationship building between mentors and mentees. This study assessed the effect of a redesigned clinical mentoring program from the perspective of clerks. The objective was to assess the benefits of the redesigned program and identify potential improvements. Methods A redesigned clinical mentoring program was launched in a medical center according to previous theoretical and practical studies on clinical training workplaces, including the elements of mentor qualifications, positive and active enhancers for mentor–mentee relationship building, the timing of mentoring performance evaluation, and financial and professional incentives. A four-wave web survey was conducted, comprising one evaluation of the former mentoring program and three evaluations of the redesigned clinical mentoring program. Sixty-four fifth-year medical students in clerkships who responded to the first wave and to at least two of the three following waves were included in the study. A structured and validated questionnaire encompassing 15 items on mentor performance and the personal characteristics of the clerks was used. Mixed linear models were developed for repeated measurements and to adjust for personal characteristics. Results The results revealed that the redesigned mentoring program improved the mentors’ performance over time for most evaluated items regarding professional development and personal support provided to the mentees. Conclusions Our findings serve as an improved framework for the role of the institution and demonstrate how institutional policies, programs, and structures can shape a clinical mentoring program. We recommend the adoption of mentorship schemes for other cohorts of medical students and for different learning and training stages involved in becoming a physician. PMID:26384479

Evaluation of English as a Foreign Language Program--Using CIPP (Context, Input, Process and Product) Model

ERIC Educational Resources Information Center

Ulum, Ömer Gökhan

2016-01-01

The aim of this study is to evaluate a state high school EFL Program through CIPP (context, input, process and product) model. The participants of the study include 504 students. The source of data has been obtained through a 46-itemed questionnaire and an interview for the students. In the study, the data has been analysed using statistical…

A new version of the helicopter aural detection program, ICHIN

NASA Technical Reports Server (NTRS)

Mueller, A. W.; Smith, C. D.; Shepherd, K. P.; Sullivan, B. M.

1986-01-01

NASA Langley Research Center personnel have conducted an evaluation of the helicopter aural detection program I Can Hear It Now (ICHIN version-5). This was accomplished using flight noise data of five helicopters, obtained from a joint NASA and U.S. Army acoustics measurement program. The evaluation consisted of presenting the noise data to a jury of 20 subjects and to the ICHIN-5 program. A comparative study was then made of the detection distances determined by the jury and predicted by ICHIN-5. This report presents the changes made in the ICHIN-5 program as a result of this comparative study. The changes represent current psychoacoustics and propagation knowledge.

Evaluating Different Dimensions of Programme Effectiveness for Private Medicine Retailer Malaria Control Interventions in Kenya

PubMed Central

Abuya, Timothy O.; Fegan, Greg; Amin, Abdinasir A.; Akhwale, Willis S.; Noor, Abdisalan M.; Snow, Robert W.; Marsh, Vicki

2010-01-01

Background Private medicine retailers (PMRs) are key partners in the home management of fevers in many settings. Current evidence on effectiveness for PMR interventions at scale is limited. This study presents evaluation findings of two different programs implemented at moderate scale targeting PMRs for malaria control in the Kisii and Kwale districts of Kenya. Key components of this evaluation were measurement of program performance, including coverage, PMR knowledge, practices, and utilization based on spatial analysis. Methodology/Principal Findings The study utilized mixed quantitative methods including retail audits and surrogate client surveys based on post-intervention cross-sectional surveys in intervention and control areas and mapping of intervention outlets. There was a large and significant impact on PMR knowledge and practices of the program in Kisii, with 60.5% of trained PMRs selling amodiaquine medicines in adequate doses compared to 2.8% of untrained ones (OR; 53.5: 95% CI 6.7, 428.3), a program coverage of 69.7% targeted outlets, and a potential utilization of about 30,000 children under five. The evaluation in Kwale also indicates a significant impact with 18.8% and 2.3% intervention and control PMRs selling amodiaquine with correct advice, respectively (OR; 9.4: 95% CI 1.1, 83.7), a program coverage of 25.3% targeted outlets, and a potential utilization of about 48,000 children under five. A provisional benchmark of 7.5 km was a reasonable threshold distance for households to access PMR services. Conclusions/Significance This evaluation show that PMR interventions operationalized in the district level settings are likely to impact PMR knowledge and practices and lead to increased coverage of appropriate treatment to target populations. There is value of evaluating different dimensions of public health programs, including quality, spatial access, and implementation practice. This approach strengthens the potential contribution of pragmatic study designs to evaluating public health programs in the real world. PMID:20126620

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ruegg, Rosalie; O'Connor, Alan C.; Loomis, Ross J.

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

A Process Evaluation of Project Developmental Continuity. Interim Report IV, Volume 2: Development of the Implementation and Cost Studies.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This interim report describes the development of program implementation and cost studies for Year II of the process evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Specific areas focused…

The Effect of Persuasion on the Utilization of Program Evaluation Information: A Preliminary Study.

ERIC Educational Resources Information Center

Eason, Sandra H.; Thompson, Bruce

The utilization of program evaluation may be made more effective by means of the application of contemporary persuasion theory. The Elaboration Likelihood Model--a model of cognitive processing, ability, and motivation--was used in this study to test the persuasive effects of source credibility and involvement on message acceptance of evaluation…

Increasing Physical Activity in Preschool: A Pilot Study to Evaluate Animal Trackers

ERIC Educational Resources Information Center

Williams, Christine L.; Carter, Betty Jean; Kibbe, Debra L.; Dennison, David

2009-01-01

Objective: This report describes a pilot study to evaluate Animal Trackers (AT), a preschool program designed to (1) increase structured physical activity (PA) during the preschool day; (2) increase practice of gross motor skills; (3) provide teachers with an easy-to-use PA program regardless of teacher experience; and (4) implement a teacher…

Evaluating JTPA Programs for Economically Disadvantaged Adults: A Case Study of Utah and General Findings. Research Report No. 92-02.

ERIC Educational Resources Information Center

Bowman, William R.

A study examined the feasibility of using a "nonexperimental" technique to evaluate Job Training Partnership Act (JTPA) programs for economically disadvantaged adults. New statistical techniques were applied to data about a sample of Utah JTPA participants and data about Employment Security registrants linked with their individual…

An Evaluation of a Comprehensive Mentoring Program on Selected At-Risk Students with Specific School Problems

ERIC Educational Resources Information Center

Washington, Taren L.

2015-01-01

This study evaluated a comprehensive mentoring program on selected at-risk students with specific school problems (attendance, discipline referrals, and core area grades). The sample included youths in Grades 4-8 who differed on some characteristics including grade-level, ethnicity, and gender. For the purpose of this mixed methods study, the…

Pearls and Pitfalls in Evaluating a Student Assistance Program: A Five-Year Case Study

ERIC Educational Resources Information Center

Wilburn, Sharon T.; Wilburn, Kenneth T.; Weaver, Dax M.; Bowles, Kathy

2007-01-01

This article presents data from a five-year evaluation-research case study of a large urban schools district's internal Student Assistance Program (SAP). The district employed specially trained and licensed school-based counselors to implement an internal SAP expanded to include tertiary prevention, and modeled after an employee assistance program…

APPLICATION OF THE SPERM CHROMATIN STRUCTURE ASSAY TO THE TEPLICE PROGRAM SEMEN STUDIES: A NEW METHOD FOR EVALUATING SPERM NUCLEAR CHROMATIN DAMAGE

EPA Science Inventory

ABSTRACT
A measure of sperm chromatin integrity was added to the routine semen end points evaluated in the Teplice Program male reproductive health studies. To address the hypothesis that exposure to periods of elevated air pollution may be associated with abnormalities in sp...

Evaluating Outcomes of High Fidelity Simulation Curriculum in a Community College Nursing Program

ERIC Educational Resources Information Center

Denlea, Gregory Richard

2017-01-01

This study took place at a Wake Technical Community College, a multi-campus institution in Raleigh, North Carolina. An evaluation of the return on investment in high fidelity simulation used by an associate degree of nursing program was conducted with valid and reliable instruments. The study demonstrated that comparable student outcomes are…

Perceptions of L1 Glossed Feedback in Automated Writing Evaluation: A Case Study

ERIC Educational Resources Information Center

Wilken, Jayme Lynn

2018-01-01

Learner perceptions toward and utilization of L1 glossed feedback in an automated writing evaluation (AWE) program were investigated in an Intensive English Program (IEP) class. This small case study focused on two Chinese students who responded to weekly surveys, semi-structured interviews, and screen capture videos of their revisions over a…

Students' Reactions to the Use of Animals as Instructional Tools for Science

ERIC Educational Resources Information Center

Gurzau, Vickie Anne

2013-01-01

Teaching science to students with special needs requires different approaches. A program at the study site supplemented packaged science kits with animal-assisted instruction, but such an approach was never evaluated. The purpose of this study was to provide a formative program evaluation documenting students' reactions to the use of animals…

Retaining minorities in engineering: Assessment of a program prototype

NASA Astrophysics Data System (ADS)

Good, Jennifer Marie (Phillips)

Program assessment is an essential part of healthy program development. Assessment should include multiple considerations, dimensions, and outcomes that match the program's objectives. As a newly formed retention program, the Auburn University Minority Engineering Program, designed to help pre-engineering minority students make the transition into their freshman year of university studies, incorporated evaluation and assessment into all three components of the program (the interactive learning laboratory, critical-thinking workshops, and Sunday-evening tutorials) from the program's inception. If students successfully adapted to the university environment and the demands of the pre-engineering course of study, then retention of minority students in the College of Engineering should improve. Data were gathered on the students involved in the various program components. Students who entered the Minority Engineering Program were pre- and posttested on three standardized subtests (critical thinking, mathematics, and science reasoning) of the Collegiate Assessment of Academic Proficiency. The first-quarter grade-point averages of the students were also gathered to compare their grades to freshman students in previous quarters within the College of Engineering. Qualitative data were also gathered on this same group of students. An analysis of the data revealed that student achievement is affected by involvement in the Minority Engineering Program. Specifically, the first quarter grade point averages of students involved in the program exceeded those of their peers in earlier years of study prior to the program's existence. In addition, mathematics and science reasoning scores on standardized tests increased pre- to postintervention. Comments collected in journals and files also demonstrated use of critical-thinking and problem-solving skills employed by the students. Recommendations for alterations of the program were made based on the outcome of the program evaluation. Further suggestions for research in minority engineering program development and evaluation were also discussed.

A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

PubMed

Crawford, S; Garrard, J

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

PubMed Central

Crawford, S.; Garrard, J.

2013-01-01

This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

Evaluating the economic benefits of nonmotorized transportation : case studies and methods for the nonmotorized transportation pilot program communities.

DOT National Transportation Integrated Search

2015-03-01

This report examines potential methods for evaluating the economic benefits from nonmotorized transportation investments. The variety of potential economic benefits of bicycle and pedestrian infrastructure and programming investments discussed includ...

Evaluation of traffic signal timing optimization methods using a stochastic and microscopic simulation program.

DOT National Transportation Integrated Search

2003-01-01

This study evaluated existing traffic signal optimization programs including Synchro,TRANSYT-7F, and genetic algorithm optimization using real-world data collected in Virginia. As a first step, a microscopic simulation model, VISSIM, was extensively ...

English-French Bilingual Education in the Early Grades: The Elgin Study

ERIC Educational Resources Information Center

Barik, Henri C.; Swain, Merrill

1974-01-01

Presents findings of an evaluation of an English-French bilingual education program using partial instruction in the second language in St. Thomas, Ontario. The evaluation covers grades 1-3. The program operates in unilingual English environment. (RM)

Evaluation of freeway motorist assist : staff summary, February 2010.

DOT National Transportation Integrated Search

2010-02-01

This research document builds on the previous Return on Investment (ROI) Study of Motorist Assist (1994) that evaluated the St. Louis Motor Assist program to establish and update current benefits of this program. The following is a summary of finding...

Evaluation of the focused approach to pedestrian safety program

DOT National Transportation Integrated Search

2009-02-02

This report summarizes the results of an evaluation of the Federal Highway Administration (FHWA) Focused Approach to Pedestrian Safety Program. The study was done by the Volpe National Transportation Systems Center at the request of the FHWA Office o...

Pilot Evaluation of a Sexual Abuse Prevention Program for Taiwanese Children

ERIC Educational Resources Information Center

Chen, Yi-Chuen; Fortson, Beverly L.; Tseng, Kai-Wen

2012-01-01

The purpose of the current study was to develop and evaluate the efficacy of a school-based child sexual abuse prevention program for Taiwanese children. Forty-six Taiwanese children age 6 to 13 were divided into one of two groups based on their school grade and then randomly assigned to a skills-based child sexual abuse prevention program who…

A Program Evaluation of the Language Lab™: Response to Intervention Program for Teaching Grammar, Vocabulary, and Storytelling

ERIC Educational Resources Information Center

Wiechmann, JoAnn; Richardson, Martha; Jones, Don

2014-01-01

This program evaluation study addressed the struggle of local elementary school speech-language pathologists (SLPs) in a school district to provide evidence-based intervention in language for students below grade level as required by the U.S. Department of Education. Recently, Language Lab™ was published to address the needs of oral language…

A Drawing and Multi-Representational Computer Environment for Beginners' Learning of Programming Using C: Design and Pilot Formative Evaluation

ERIC Educational Resources Information Center

Kordaki, Maria

2010-01-01

This paper presents both the design and the pilot formative evaluation study of a computer-based problem-solving environment (named LECGO: Learning Environment for programming using C using Geometrical Objects) for the learning of computer programming using C by beginners. In its design, constructivist and social learning theories were taken into…

Suicide Prevention among High School Students: Evaluation of a Nonrandomized Trial of a Multi-Stage Suicide Screening Program

ERIC Educational Resources Information Center

Torcasso, Gina; Hilt, Lori M.

2017-01-01

Background: Suicide is a leading cause of death among youth. Suicide screening programs aim to identify mental health issues and prevent death by suicide. Objective: The present study evaluated outcomes of a multi-stage screening program implemented over 3 school years in a moderately-sized Midwestern high school. Methods: One hundred ninety-three…

Development, Implementation, and Evaluation of a Comprehensive Course on Suicide in a Master's of Social Work Program

ERIC Educational Resources Information Center

Almeida, Joanna; O'Brien, Kimberly H. M.; Gironda, Christina M.; Gross, Emma B.

2017-01-01

Most master of social work (MSW) programs provide minimal education or training on suicide prevention, intervention, and postvention despite that the majority of social workers encounter suicidal clients during their professional careers. This study describes the development, implementation, and evaluation of a course on suicide in an MSW program.…

Evaluating the Impact of the "Teaching as a Chemistry Laboratory Graduate Teaching Assistant" Program on Cognitive and Psychomotor Verbal Interactions in the Laboratory

ERIC Educational Resources Information Center

Flaherty, A.; O'Dwyer, A.; Mannix-McNamara, P.; Leahy, J. J.

2017-01-01

Designing and evaluating teacher development programs for graduate teaching assistants (GTAs) who teach in the laboratory is a prominent feature of chemistry education research. However, few studies have investigated the impact of a GTA teacher development program on the verbal interactions between participating GTAs and students in the…