Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

ERIC Educational Resources Information Center

Hawkins, J. David; Nederhood, Britt

This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

[Development and evaluation of an educational program for promotion of healthy nutrition and physical activity by health volunteers].

PubMed

Yamaguchi, Yukio; Kai, Yuko; Kumamoto, Hiroko

2009-12-01

The purpose of the present trial was to develop and evaluate an educational program for promotion of healthy nutrition and physical activity by health volunteers. The educational program consisted of the following four phases: preliminary self-learning by mail (3 weeks), basic learning (3 sessions of 3 hours), practice of planned activities (2 months), and a report session (1 session of 3 hours). Beginner volunteers (n=18, mean age 63.3 +/- 6.4) were recruited from two volunteer health organizations in Kurume city. They then participated in a program that taught basic health knowledge regarding nutrition and physical activity, how to plan effective support activities, and methods for self-evaluation. In the preliminary self-learning phase, an assessment sheet, health information, and homework (goal setting, etc.) were delivered to the volunteers by mail. In the basic learning phase, volunteers attended a 3 day seminar on essential principles for behavioral change and assessment methods for volunteer activity. In addition, effective support activities were planned through group discussion. After a 2-month practice of support activities, each group reported and discussed the results of their activity in a 3-hour report session. Main outcome measures were health knowledge (15 items, 0-1 points), self-efficacy for life style support (5 items, 0-100%), and evaluation of the educational program (9 items, 1-5 points). All measures were self-administered. Significant increases in rate of true answers for health knowledge were observed during the preliminary self-learning and before basic learning phases (54.8% --> 67.1%, P < 0.05), and before and after basic learning phases (67.1% --> 87.6%, P < 0.05). Self-efficacy for life style support were significantly higher after the report session than before the preliminary self-learning phase (35.1% --> 53.1%, P < 0.05). In the two-month practice, all groups received feedback through questionnaires completed by participants who

Program Evaluation Interest and Skills of School Counselors

ERIC Educational Resources Information Center

Astramovich, Randall L.

2017-01-01

School counselors participated in a study examining their program evaluation interest and skills. Findings suggest that school counselors understand the importance of program evaluation, yet they may lack the skills and confidence to successfully engage in program evaluation activities. Professional development training may be an important method…

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

45 CFR 2516.820 - What types of internal evaluation activities are required of programs?

Code of Federal Regulations, 2013 CFR

2013-10-01

... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2013-10-01 2013-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...

45 CFR 2516.820 - What types of internal evaluation activities are required of programs?

Code of Federal Regulations, 2012 CFR

2012-10-01

... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2012-10-01 2012-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...

45 CFR 2516.820 - What types of internal evaluation activities are required of programs?

Code of Federal Regulations, 2014 CFR

2014-10-01

... of the participants including sex, age, economic background, education level, ethnic group... 45 Public Welfare 4 2014-10-01 2014-10-01 false What types of internal evaluation activities are required of programs? 2516.820 Section 2516.820 Public Welfare Regulations Relating to Public Welfare...

Evaluation of preventive programs in high caries active preschool children.

PubMed

Sundell, Anna Lena; Ullbro, Christer; Koch, Göran

2013-01-01

Although caries prevalence in preschool children has dramatically decreased during the last decades it is still a large problem for a minor group of these children. Great efforts have been invested in finding effective preventive programs for the high caries active preschool children. However, few studies have evaluated and discussed which approach will give the best effect. The aim of the present study was to compare the effect of a "standard" preventive program with a series of programs with more extensive measures during a two-year period. At start one hundred and sixty high caries active preschool children (mean age 4 years) were included in the study. The children were randomly distributed to four groups. All groups were exposed to the basic program composed of dietary counselling, oral hygiene instructions and fluoride varnish application. Three groups were exposed to one additional preventive measure e.g. 1% chlorhexidine gel in trays, 0.2% NaF gel in trays or daily tooth brushing with 1% chlorhexidine gel. The programs were repeated seven times during the two-year study period and were executed by trained dental hygienists. Caries examination and saliva sampling for Streptococcus mutans measurements were performed at start of the study and after two years. The mean defs at start was between 10.8 and 12.6 for the four groups (NS). After two years the caries increment was 1.9 ds in the basic preventive group and between 1.9 and 2.6 (NS) in the other groups. Numerically there were more children in the chlorhexidine groups that showed reduction of Streptococcus mutans counts compared to the other groups, but the differences were small. The mean caries increment of about 1.9 ds per year in all groups indicate that all programs were effective taken into account that the children had about 11 defs at start. There were no differences in caries increment between the basic preventive group and the other groups. The conclusion was that addition of preventive measures

Solar energy program evaluation: an introduction

DOE Office of Scientific and Technical Information (OSTI.GOV)

deLeon, P.

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the rolemore » and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)« less

Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program.

PubMed

Hallinan, Christine M

2010-01-01

In this paper, program logic will be used to 'map out' the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.

Competency-based goals, objectives, and linked evaluations for rheumatology training programs: a standardized template of learning activities from the Carolinas Fellows Collaborative.

PubMed

Criscione-Schreiber, Lisa G; Bolster, Marcy B; Jonas, Beth L; O'Rourke, Kenneth S

2013-06-01

American Council on Graduate Medical Education program requirements mandate that rheumatology training programs have written goals, objectives, and performance evaluations for each learning activity. Since learning activities are similar across rheumatology programs, we aimed to create competency-based goals and objectives (CBGO) and evaluations that would be generalizable nationally. Through an established collaboration of the 4 training programs' directors in North Carolina and South Carolina, we collaboratively composed CBGO and evaluations for each learning activity for rheumatology training programs. CBGO and linked evaluations were written using appropriate verbs based on Bloom's taxonomy. Draft documents were peer reviewed by faculty at the 4 institutions and by members of the American College of Rheumatology (ACR) Clinician Scholar Educator Group. We completed templates of CBGO for core and elective rotations and conferences. Templates detail progressive fellow performance improvement appropriate to educational level. Specific CBGO are mirrored in learning activity evaluations. Templates are easily modified to fit individual program attributes, have been successfully implemented by our 4 programs, and have proven their value in 4 residency review committee reviews. We propose adoption of these template CBGO by the ACR, with access available to all rheumatology training programs. Evaluation forms that exactly reflect stated objectives ensure that trainees are assessed using standardized measures and that trainees are aware of the learning expectations. The objectives mirrored in the evaluations closely align with the proposed milestones for internal medicine training, and will therefore be a useful starting point for creating these milestones in rheumatology. Copyright © 2013 by the American College of Rheumatology.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

PubMed

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Developmental Kindergarten Program Evaluation Report.

ERIC Educational Resources Information Center

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Traffic control device evaluation program : FY 2016.

DOT National Transportation Integrated Search

2017-03-01

This report presents findings on three different activities conducted in the Traffic Control Device Evaluation Program during the 2016 fiscal year. The first two activities are evaluations of full-matrix color light-emitting diode changeable message ...

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers.

PubMed

Viester, Laura; Verhagen, Evert A L M; Bongers, Paulien M; van der Beek, Allard J

2014-11-01

To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions. Effectiveness was assessed on motivational stage-of-change, self-efficacy, and decisional balance for physical activity and dietary behavior. The external validity of the trial was satisfactory with representative reach of workers and adoption of workplace units in the participating construction company. The extent to which the program was implemented as intended was modest. The intervention was effective on participants' progress through stages of behavior change. Based on the RE-AIM dimensions, it is concluded that for construction workers, the program is feasible and potentially effective, but adjustments are required before widespread implementation.

Evaluation of a Community-Based Aging Intervention Program

ERIC Educational Resources Information Center

Hsu, Hui-Chuan; Wang, Chun-Hou; Chen, Yi-Chun; Chang, Ming-Chen; Wang, Jean

2010-01-01

This study evaluated the outcome and process of a community-based aging intervention program for the elderly in Taiwan. The program included education on nutrition and dietary behavior and on physical activities. Outcome and process evaluations were conducted. The program may have had some effects on decreasing some dietary behavioral problems and…

Title V Delinquency Prevention Program. Community Self-Evaluation Workbook.

ERIC Educational Resources Information Center

Caliber Associates, Fairfax, VA.

This workbook is designed to help communities and program administrators assess the success of their Title V delinquency prevention programs, but it may serve as an evaluation tool for other prevention efforts as well. It provides information and resource aids on program planning, conducting evaluations, tracking programs, describing activities,…

Strategies for Evaluating Complex Environmental Education Programs

NASA Astrophysics Data System (ADS)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Evaluating Active Parental Consent Procedures for School Programming: Addressing the Sensitive Topic of Suicide Prevention.

PubMed

Totura, Christine M Wienke; Kutash, Krista; Labouliere, Christa D; Karver, Marc S

2017-02-01

Suicide is the second leading cause of death for adolescents. Whereas school-based prevention programs are effective, obtaining active consent for youth participation in public health programming concerning sensitive topics is challenging. We explored several active consent procedures for improving participation rates. Five active consent methods (in-person, students taking forms home, mailing, mailing preceded by primers, mailing followed by reminder calls) were compared against passive consent procedures to evaluate recruitment success, as determined by participation (proportion who responded yes) and response (proportion who returned any response) rates. Participation acceptance rates ranged from 38 to 100% depending on consent method implemented. Compared with passive consent, active consent procedures were more variable in response and participation rates. In-person methods provided higher rates than less interpersonal methods, such as mailing or students taking consents home. Mailed primers before or reminder calls after consent forms were mailed increased response but not participation rates. Students taking consents home resulted in the lowest rates. Although passive consent produces the highest student participation, these methods are not always appropriate for programs addressing sensitive topics in schools. In-person active consent procedures may be the best option when prioritizing balance between parental awareness and successful student recruitment. © 2017, American School Health Association.

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined

Evaluating Programs for Strengthening Teaching and Leadership

ERIC Educational Resources Information Center

Teacher Incentive Fund, US Department of Education, 2016

2016-01-01

The U.S. Department of Education (ED) expects all Teacher Incentive Fund (TIF) grantees to conduct an evaluation of their programs. Experience with earlier rounds of TIF grants has shown that evaluations can provide valuable information for managing and improving TIF-supported activities, as well as evidence that these activities have had a…

A Model for Evaluating Development Programs. Miscellaneous Report.

ERIC Educational Resources Information Center

Burton, John E., Jr.; Rogers, David L.

Taking the position that the Classical Experimental Evaluation (CEE) Model does not do justice to the process of acquiring information necessary for decision making re planning, programming, implementing, and recycling program activities, this paper presents the Inductive, System-Process (ISP) evaluation model as an alternative to be used in…

Evaluating Cooperative Education Programs.

ERIC Educational Resources Information Center

Alvir, Howard P.

This document defines cooperative education as any form of occupational or professional activity that required the cooperation of both school and the labor market. In some cases, this might be the school and industry or business. In this process, evaluation is defined as the improvement of learner success through measurement of program components.…

Stakeholder evaluation of an online program to promote physical activity and workplace safety for individuals with disability.

PubMed

Nery-Hurwit, Mara; Kincl, Laurel; Driver, Simon; Heller, Brittany

2017-08-01

Individuals with disabilities face increasing health and employment disparities, including increased risk of morbidity and mortality and decreased earnings, occupational roles, and greater risk of injury at work. Thus, there is a need to improve workplace safety and health promotion efforts for people with disability. The purpose of this study was to obtain stakeholder feedback about an online program, Be Active, Work Safe, which was developed to increase the physical activity and workplace safety practices of individuals with disability. Eight stakeholders (content experts and individuals with disability) evaluated the 8-week online program and provided feedback on accessibility, usability, and content using quantitative and qualitative approaches. Stakeholders suggested changes to the organization, layout and accessibility, and content. This included making a stronger connection between the physical activity and workplace safety components of the program, broadening content to apply to individuals in different vocational fields, and reducing the number of participant assessments. Engaging stakeholders in the development of health promotion programs is critical to ensure the unique issues of the population are addressed and facilitate engagement in the program. Feedback provided by stakeholders improved the program and provided insight on barriers for adoption of the program. Copyright © 2017 Elsevier Ltd. All rights reserved.

Active Families in the Great Outdoors: A Program to Promote Family Outdoor Physical Activity

ERIC Educational Resources Information Center

Flynn, Jennifer I.; Bassett, David R.; Fouts, Hillary N.; Thompson, Dixie L.; Coe, Dawn P.

2017-01-01

This study evaluated a 4-week program to increase the time families spent engaging in outdoor activity. Parents were provided strategies to increase family outdoor activity and locations to be active. Sixteen families completed the program. Duration and number of family outdoor activity bouts per week, type of activities, locations, and family…

Using health promotion guidelines for persons with disabilities to develop and evaluate a physical activity program for individuals with multiple sclerosis: A feasibility study.

PubMed

Dixon-Ibarra, Alicia; Nery-Hurwit, Mara; Driver, Simon; MacDonald, Megan

2017-04-01

The Health Education for Persons with Multiple Sclerosis (HEMS) program was developed in response to the need for interventions aimed at increasing physical activity for individuals with Multiple Sclerosis (MS). It was developed and evaluated using Drum and colleagues (2009) guidelines for implementing health promotion programs for individuals with disabilities. The purpose of this feasibility study is to describe the development, implementation, and evaluation of the HEMS program. Thirteen individuals with MS completed the 8-week health education program. A mixed method approach for evaluation was implemented (i.e., survey and focus groups). Process and resource feasibility demonstrated that over half of the participants attended at least 80% of the weekly sessions. Focus group data provided valuable feedback for future iterations of the program including critiques on the delivery, content, and group support provided. Outcome evaluation showed increases in self-efficacy (survey), improvements in theoretical constructs (focus groups), and increased physical activity (focus groups). Results show that health promotion programs for persons with MS can improve physical activity and related constructs. Next steps will be to revise, implement, and reevaluate the HEMS program in a larger randomized control trial. Published by Elsevier Ltd.

Evaluation of an occupational rehabilitation program.

PubMed

Goodman, Glenn; Browning, Margaret; Campbell, Sims; Hudak, Huison

2005-01-01

The purpose of this study was to report the findings of a program evaluation for an occupational rehabilitation program in the Midwest. An ex-post facto chart review was performed on 50 charts using demographic data, results from tests of performance and pain measures, and data from patient satisfaction questionnaires to find evidence of excellence in the program, and to identify areas for improvement. Over 97% of the participants actually completed the program and 76% returned to work within 3 months after program completion. Ninety-two percent indicated overall satisfaction with the program, and all aspects of the program were rated with a mean score of 4.25 or above on a 1 to 5 Likert scale. Evaluation of perceived pain scales of the participants indicate no discernable relationship between intensity of pain and successful return to work. The program showed a high completion rate, a high return to work rate, and high levels of patient satisfaction. Suggestions for improvement include an increase in use of real and simulated work activities, better documentation of pain measures, better programs to address psychosocial issues, lengthening the program, and increased communication with case managers and professionals outside of the work program.

Flight program language requirements. Volume 2: Requirements and evaluations

NASA Technical Reports Server (NTRS)

1972-01-01

The efforts and results are summarized for a study to establish requirements for a flight programming language for future onboard computer applications. Several different languages were available as potential candidates for future NASA flight programming efforts. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of detailed language requirements was synthesized from these activities. The details of program language requirements and of the language evaluations are described.

Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

PubMed

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

"Cooking and Active Leisure" TAS Program, Spain: a Program Impact Pathways (PIP) analysis.

PubMed

Roura, Elena; Pareja, Sara Lucía; Milá, Raimon; Cinca, Núria

2014-09-01

The "Cooking and Active Leisure" Tu y Alícia por la Salud (CAL-TAS) Program is a school-based pilot that addresses healthy lifestyle needs of Spanish secondary school students with initiatives that research has proven to improve dietary and physical activity behaviors. The objectives were to perform a Program Impact Pathways (PIP) analysis to describe key activities and processes of the CAL-TAS Program, identify Critical Quality Control Points (CCPs), and identify a suite of common indicators of healthy lifestyles to be applied across participant schools. The CAL-TAS Program designers and implementation team developed this PIP analysis through an iterative process and presented the results for feedback at the seven-country Healthy Lifestyles Program Evaluation Workshop held in Granada, Spain, 13-14 September 2013, under the auspices of the Mondelēz International Foundation. The team identified three PIP CCPs: teachers' motivation and training, changes in students' knowledge of healthy lifestyles, and changes in students' healthy lifestyle behavior. The selected indicators of the program's impact on healthy lifestyles are adequacy of food intake, level of knowledge of healthy lifestyles gained, and adequacy of physical activity level according to World Health Organization recommendations. A clear definition of impact indicators, as well as collection of accurate data on healthy lifestyle behaviors and knowledge, is essential to understanding the effectiveness of this program before it can be scaled up. CAL-TAS is an effective secondary school-based program encouraging healthy lifestyles. The PIP analysis was instrumental in identifying CCPs to sustain and improve the quality of the program. The team hopes to sustain and improve the program through these program evaluation recommendations.

Language Program Evaluation

ERIC Educational Resources Information Center

Norris, John M.

2016-01-01

Language program evaluation is a pragmatic mode of inquiry that illuminates the complex nature of language-related interventions of various kinds, the factors that foster or constrain them, and the consequences that ensue. Program evaluation enables a variety of evidence-based decisions and actions, from designing programs and implementing…

Organizational Structures that Support Internal Program Evaluation

ERIC Educational Resources Information Center

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

Modern & Classical Languages: K-12 Program EValuation 1988-89.

ERIC Educational Resources Information Center

Martinez, Margaret Perea

This evaluation of the modern and classical languages programs, K-12, in the Albuquerque (New Mexico) public school system provides general information on the program's history, philosophy, recognition, curriculum development, teachers, and activities. Specific information is offered on the different program components, namely, the elementary…

Active Aging Promotion: Results from the Vital Aging Program

PubMed Central

Caprara, Mariagiovanna; Molina, María Ángeles; Schettini, Rocío; Santacreu, Marta; Orosa, Teresa; Mendoza-Núñez, Víctor Manuel; Rojas, Macarena; Fernández-Ballesteros, Rocío

2013-01-01

Active aging is one of the terms in the semantic network of aging well, together with others such as successful, productive, competent aging. All allude to the new paradigm in gerontology, whereby aging is considered from a positive perspective. Most authors in the field agree active aging is a multidimensional concept, embracing health, physical and cognitive fitness, positive affect and control, social relationships and engagement. This paper describes Vital Aging, an individual active aging promotion program implemented through three modalities: Life, Multimedia, and e-Learning. The program was developed on the basis of extensive evidence about individual determinants of active aging. The different versions of Vital Aging are described, and four evaluation studies (both formative and summative) are reported. Formative evaluation reflected participants' satisfaction and expected changes; summative evaluations yielded some quite encouraging results using quasi-experimental designs: those who took part in the programs increased their physical exercise, significantly improved their diet, reported better memory, had better emotional balance, and enjoyed more cultural, intellectual, affective, and social activities than they did before the course, thus increasing their social relationships. These results are discussed in the context of the common literature within the field and, also, taking into account the limitations of the evaluations accomplished. PMID:23476644

42 CFR 485.729 - Condition of participation: Program evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... participation: Program evaluation. The organization has procedures that provide for a systematic evaluation of... with others. (a) Standard: Clinical-record review. A sample of active and closed clinical records is...

42 CFR 485.729 - Condition of participation: Program evaluation.

Code of Federal Regulations, 2011 CFR

2011-10-01

... participation: Program evaluation. The organization has procedures that provide for a systematic evaluation of... with others. (a) Standard: Clinical-record review. A sample of active and closed clinical records is...

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

ERIC Educational Resources Information Center

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

Stepping Stones to Evaluating Your Own School Literacy Program

ERIC Educational Resources Information Center

Levesque, Jeri; Carnahan, Danielle

2005-01-01

Stepping Stones to Literacy is a tool for elementary school improvement teams to evaluate and strengthen their reading programs. Each Stepping Stone is a guided activity to stimulate reflection and guide systematic inquiry. It is a collaborative, active research approach to evaluation (Levesque & Hinton 2001). The goal is to eliminate the gap…

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 2002

EPA Science Inventory

This report details the Fiscal Year 2002 activities of the Superfund Innovative Technology Evaluation (SITE) Program. The Program focused on the remediation needs of the hazardous waste remediation community through demonstration and evaluation of innovative technologies for reme...

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 2001

EPA Science Inventory

This report details the fiscal year 2001 activities of the Superfund Innovative Technology Evaluation (SITE) Program. The Program focuses on the remediation needs of the hazardous waste remediation community through demonstration and evaluation of innovative technologies for re...

Home activity programs in families with children presenting with global developmental delays: evaluation and parental perceptions.

PubMed

Tétreault, Sylvie; Parrot, Ann; Trahan, Johanne

2003-09-01

The present study presents a descriptive evaluation of home activity programs (HAP) in families living with a child diagnosed with global developmental delay (GDD) and investigates parental perceptions about the use of HAPs. Forty-one families were selected from an initial pool of 95. Application of the HAP--delivered by an occupational therapist, physical therapist or speech therapist--was evaluated via a telephone survey. Data about parental perceptions of the HAP was collected. The results indicate a high degree of compliance with the program; 31 families were still using the HAP after 7 months. The degree of compliance is dependent on the degree of support given by the therapist and on the size of the family and many parents who maintained high compliance seemed to be those most vulnerable to stress. When giving out HAPs, therapists should be aware of the great demands they place on mothers.

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

ERIC Educational Resources Information Center

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Evaluation of a program to increase evidence-based practice change.

PubMed

Larrabee, June H; Sions, Jacqueline; Fanning, Mary; Withrow, Mary Lynne; Ferretti, Andrea

2007-06-01

The study evaluated a nursing research program designed to achieve systematic evidence-based practice change. Specifically, change in nurse attitudes about use of research and research conduct, practice change projects, and nurse participation in research-related activities were evaluated. Evidence indicates that successful evidence-based practice change in an organization requires senior leadership support and a systematic program for practice change. Evaluation of program effectiveness provides evidence about opportunities for further improvement. Quantitative evaluation used a pretest-posttest design. The site was an academic medical center in rural West Virginia. Participants were registered nurses from all inpatients units, perioperative services, and emergency departments. Surveys used Alcock et al's Staff Nurses and Research Activities scale. Descriptive evaluation included the number of nurses who attended the workshop, practice change projects, scholarly products disseminated, and outcome of a Magnet review. First, knowledge about the availability of support services increased between 1999 and 2002 and was associated with higher attitude scores about research and research utilization. Second, registered nurses who reported participating in research-related activities had more positive scores on all attitudes than registered nurses who reported not participating. Nurse leaders may improve participation and attitudes about research and research utilization by internally marketing the support available for research-related activities.

The effect of before school physical activity on child development: A study protocol to evaluate the Build Our Kids Success (BOKS) Program.

PubMed

Pojednic, Rachele; Peabody, Stephanie; Carson, Shelley; Kennedy, Mary; Bevans, Katherine; Phillips, Edward M

2016-07-01

Most childhood physical activity interventions focus on reducing childhood obesity with varying success, indicating that body mass index (BMI) may be a limited marker of health in children. To better understand overall childhood health and wellbeing, this study is investigating BOKS (Build Our Kids Success), an established ongoing before-school physical activity program, to evaluate students' physical health, mental health, cognitive capacity, and academic performance. The study is a non-randomized controlled trial with 26 elementary and middle schools in 3 Massachusetts communities, including first through eighth grade (aged 5-14) students, their parents, and teachers. Data collection is occurring during the 2015-2016 school year. Physical fitness is being assessed via 400m run and anthropometrics via height and weight measures (BMI). Psychosocial outcomes are being assessed via student, parent, and teacher survey and include nutrition, daily activities, emotional and relationship scales, bullying and victimization, vitality and energy, student engagement, stress, positive affect, self-efficacy and life satisfaction. Academic performance is reported by grades. Statistical methods include a psychometric evaluation of study measures, Pearson correlations, Student's t-tests, ANOVA/ANCOVA and multivariate linear regression including multilevel modeling analyses to account for the hierarchical organization of the data. This study is investigating a before school physical activity program on parameters of physical health, mental health, cognitive capacity, and academic performance by employing a novel triad approach, correlating the input of the child, parent, and teacher. Outcomes will evaluate the effectiveness of a before school physical activity program in elementary and middle schools and potentially provide valuable information for schools looking to institute innovative physical activity programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Traffic Control Device Evaluation Program : FY 2017

DOT National Transportation Integrated Search

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Evaluation and Strategic Planning for the GLOBE Program

NASA Astrophysics Data System (ADS)

Geary, E. E.; Williams, V. L.

2010-12-01

The Global Learning and Observations to Benefit the Environment (GLOBE) Program is an international environmental education program. It unites educators, students and scientists worldwide to collaborate on inquiry based investigations of the environment and Earth system science. Evaluation of the GLOBE program has been challenging because of its broad reach, diffuse models of implementation, and multiple stakeholders. In an effort to guide current evaluation efforts, a logic model was developed that provides a visual display of how the GLOBE program operates. Using standard elements of inputs, activities, outputs, customers and outcomes, this model describes how the program operates to achieve its goals. The template used to develop this particular logic model aligns the GLOBE program operations with its program strategy, thus ensuring that what the program is doing supports the achievement of long-term, intermediate and annual goals. It also provides a foundation for the development of key programmatic metrics that can be used to gauge progress toward the achievement of strategic goals.

Evaluating Afterschool Programs

ERIC Educational Resources Information Center

Little, Priscilla M.

2014-01-01

Well-implemented afterschool programs can promote a range of positive learning and developmental outcomes. However, not all research and evaluation studies have shown the benefits of participation, in part because programs and their evaluation were out of sync. This chapter provides practical guidance on how to foster that alignment between…

Maximizing the Impact of Program Evaluation: A Discrepancy-Based Process for Educational Program Evaluation.

ERIC Educational Resources Information Center

Cantor, Jeffrey A.

This paper describes a formative/summative process for educational program evaluation, which is appropriate for higher education programs and is based on M. Provus' Discrepancy Evaluation Model and the principles of instructional design. The Discrepancy Based Methodology for Educational Program Evaluation facilitates systematic and detailed…

Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

PubMed

MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

2006-01-01

The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

MLS student active learning within a "cloud" technology program.

PubMed

Tille, Patricia M; Hall, Heather

2011-01-01

In November 2009, the MLS program in a large public university serving a geographically large, sparsely populated state instituted an initiative for the integration of technology enhanced teaching and learning within the curriculum. This paper is intended to provide an introduction to the system requirements and sample instructional exercises used to create an active learning technology-based classroom. Discussion includes the following: 1.) define active learning and the essential components, 2.) summarize teaching methods, technology and exercises utilized within a "cloud" technology program, 3.) describe a "cloud" enhanced classroom and programming 4.) identify active learning tools and exercises that can be implemented into laboratory science programs, and 5.) describe the evaluation and assessment of curriculum changes and student outcomes. The integration of technology in the MLS program is a continual process and is intended to provide student-driven active learning experiences.

Evaluation of the childhood obesity prevention program Kids--'Go for your life'.

PubMed

de Silva-Sanigorski, Andrea; Prosser, Lauren; Carpenter, Lauren; Honisett, Suzy; Gibbs, Lisa; Moodie, Marj; Sheppard, Lauren; Swinburn, Boyd; Waters, Elizabeth

2010-05-28

Kids--'Go for your life' (K-GFYL) is an award-based health promotion program being implemented across Victoria, Australia. The program aims to reduce the risk of childhood obesity by improving the socio-cultural, policy and physical environments in children's care and educational settings. Membership of the K-GFYL program is open to all primary and pre-schools and early childhood services across the State. Once in the program, member schools and services are centrally supported to undertake the health promotion (intervention) activities. Once the K-GFYL program 'criteria' are reached the school/service is assessed and 'awarded'. This paper describes the design of the evaluation of the statewide K-GFYL intervention program. The evaluation is mixed method and cross sectional and aims to: 1) Determine if K-GFYL award status is associated with more health promoting environments in schools/services compared to those who are members only; 2) Determine if children attending K-GFYL award schools/services have higher levels of healthy eating and physical activity-related behaviors compared to those who are members only; 3) Examine the barriers to implementing and achieving the K-GFYL award; and 4) Determine the economic cost of implementing K-GFYL in primary schools. Parent surveys will capture information about the home environment and child dietary and physical activity-related behaviors. Environmental questionnaires in early childhood settings and schools will capture information on the physical activity and nutrition environment and current health promotion activities. Lunchbox surveys and a set of open-ended questions for kindergarten parents will provide additional data. Resource use associated with the intervention activities will be collected from primary schools for cost analysis. The K-GFYL award program is a community-wide intervention that requires a comprehensive, multi-level evaluation. The evaluation design is constrained by the lack of a non-K-GFYL control

Teaching Program Evaluation on Interactive Television.

ERIC Educational Resources Information Center

McNeil, Keith; Steinhauser, Jim; Newman, Isadore

This paper describes a five-session course entitled "Program Evaluation," which was taught via interactive television in the summer of 2002 to 68 doctoral and master's students in 5 of 6 locations throughout New Mexico. Students received a 4-hour lecture and then participated in off-line activities directed by the instructor. Problems in distance…

EPO Program and Product Evaluation Throughout the Development Lifecycle

NASA Astrophysics Data System (ADS)

Kaiser, C.; Butcher, G. J.

2013-12-01

stages during development allows for modifications and improvements to the product before time and money have been wasted going down the wrong path. Depending on the product and the stage of development, there are several evaluation tools to employ: surveys, observations, expert analysis, heuristic evaluations, feedback forms, diary studies, use case testing and interviews. In the case of developing the 'Sensors, Circuits, and Satellites' product, surveys were collected from teachers and students who participated in the lesson or activity. Audio recordings were also made of the teachers as they completed each activity to collect direct quotes, questions, concerns, and feedback. Facilitators completed feedback forms to capture quotes and observations of the students working through the activities and engaging with the product. All of these data provided valuable insight into the participants' experiences and effectiveness of the product. A complement of tools and techniques is the best approach to evaluating EPO products and programs. These will vary based on application, but can easily be implemented at key points in the development lifecycle to produce feedback and data used to assess and meet EPO goals and objectives.

The Evaluation Handbook: Guidelines for Evaluating Dropout Prevention Programs.

ERIC Educational Resources Information Center

Smink, Jay; Stank, Peg

This manual, developed in an effort to take the mysticism out of program evaluation, discusses six phases of the program evaluation process. The introduction discusses reasons for evaluation, process and outcome evaluation, the purpose of the handbook, the evaluation process, and the Sequoia United School District Dropout Prevention Program. Phase…

Evaluation of a statewide dissemination and implementation of physical activity intervention in afterschool programs: a nonrandomized trial.

PubMed

Beets, Michael W; Glenn Weaver, R; Turner-McGrievy, Gabrielle; Saunders, Ruth P; Webster, Collin A; Moore, Justin B; Brazendale, Keith; Chandler, Jessica

2017-12-01

In 2015, YMCA-operated afterschool programs (ASPs) across South Carolina pledged to achieve the national standard that calls for every child to accumulate 30 min/day of moderate-to-vigorous physical activity (MVPA) during program time. This study shares the first-year findings related to the dissemination, implementation, and outcomes associated with the statewide intervention to achieve the MVPA Standard. Twenty ASPs were sampled from all YMCA-operated ASPs (N = 97) and visited at baseline (spring 2015) and first-year follow-up (spring 2016). Programs were provided standardized professional development training to increase the MVPA children accumulated while attending ASPs. The training focused on extending the scheduled time for activity opportunities and modifying commonly played games to increase MVPA. The RE-AIM framework was used to evaluate the statewide intervention. Accelerometer-derived MVPA was the primary outcome. Implementation was evaluated via direct observation. Intent-to-treat (ITT) and as-treated comparisons were conducted in summer 2016. Reach/adoption was variable, with attendance at trainings ranging from 0 to 100% across ASPs. Effectiveness of the intervention using ITT models indicated no changes from baseline in the percentage of programs meeting the MVPA standard for boys or girls. Implementation levels also varied and were related to increases in both boys' and girls' MVPA for moderate and high implementers. Findings indicate improvements in MVPA can be made from attending the trainings and implementing some or all of the training components. Additional work is necessary to identify ways to ensure staff attend trainings to implement strategies and to identify which specific factors contributed to increases in MVPA.

Increasing the use of evaluation data collection in an EPO program

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Mixed method evaluation of a community-based physical activity program using the RE-AIM framework: practical application in a real-world setting.

PubMed

Koorts, Harriet; Gillison, Fiona

2015-11-06

Communities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. A single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. Inconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. This research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.

UWALK: the development of a multi-strategy, community-wide physical activity program.

PubMed

Jennings, Cally A; Berry, Tanya R; Carson, Valerie; Culos-Reed, S Nicole; Duncan, Mitch J; Loitz, Christina C; McCormack, Gavin R; McHugh, Tara-Leigh F; Spence, John C; Vallance, Jeff K; Mummery, W Kerry

2017-03-01

UWALK is a multi-strategy, multi-sector, theory-informed, community-wide approach using e and mHealth to promote physical activity in Alberta, Canada. The aim of UWALK is to promote physical activity, primarily via the accumulation of steps and flights of stairs, through a single over-arching brand. This paper describes the development of the UWALK program. A social ecological model and the social cognitive theory guided the development of key strategies, including the marketing and communication activities, establishing partnerships with key stakeholders, and e and mHealth programs. The program promotes the use of physical activity monitoring devices to self-monitor physical activity. This includes pedometers, electronic devices, and smartphone applications. In addition to entering physical activity data manually, the e and mHealth program provides the function for objective data to be automatically uploaded from select electronic devices (Fitbit®, Garmin and the smartphone application Moves) The RE-AIM framework is used to guide the evaluation of UWALK. Funding for the program commenced in February 2013. The UWALK brand was introduced on April 12, 2013 with the official launch, including the UWALK website on September 20, 2013. This paper describes the development and evaluation framework of a physical activity promotion program. This program has the potential for population level dissemination and uptake of an ecologically valid physical activity promotion program that is evidence-based and theoretically framed.

Evaluating Evaluations: The Case of Parent Involvement Programs

ERIC Educational Resources Information Center

Mattingly, Doreen J.; Prislin, Radmila; McKenzie, Thomas L.; Rodriguez, James L.; Kayzar, Brenda

2002-01-01

This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

An Evaluation of DOE-EM Public Participation Programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bradbury, Judith A.; Branch, Kristi M.; Malone, Elizabeth L.

This report evaluates the scope and effectiveness of the public participation pr ograms, including Site-Specific Advisory Boards (SSABs), at seven U.S. Departmen t of Energy (DOE) sites: Fernald, Hanford, Los Alamos, Nevada, Oak Ridge, Paduc ah, and Savannah River. The primary purpose of the study is to assist both DOE Field and Headquarters managers in reviewing and understanding lessons learned o ver the past decade concerning public participation programs administered by the DOE Office of Environmental Management (EM). The evaluation provides a snapsh ot of selected EM public participation programs at a particular point of time. It is based onmore » interviews and site visits conducted between January and June 200 2- a time of change within the program. The study focuses on public participati on programs that incorporate a variety of activities and address a wide range of individual site activities and decisions. It uses the Acceptability Diamond as an evaluative framework to answer questions about stakeholders' experiences wit h, and assessment of, DOE-EM's public participation programs. The Acceptability Diamond, which was developed by researchers from the Pacific Northwest National Laboratory in previous research, identifies four program dimensions - substanti ve issues, decision-making process, relationships, and accountability - that det ermine the effectiveness of an agency's interactions with local communities. Es sentially, a public participation program may be deemed effective to the extent that it provides for open disclosure and addresses all four acceptability dimens ions in ways that are appropriate and effective for a particular community and s ituation. This framework provides a guide for agencies to 1) set objectives, 2) design public participation and oversight programs, and 3) set criteria for eva luating program effectiveness. In the current study, where the framework is use d as a means of assessing program effectiveness, the focus is on

Issues Surrounding the Evaluation of Teacher Internship Programs

NASA Astrophysics Data System (ADS)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Effectiveness of School-Initiated Physical Activity Program on Secondary School Students' Physical Activity Participation

ERIC Educational Resources Information Center

Gråstén, Arto; Yli-Piipari, Sami; Watt, Anthony; Jaakkola, Timo; Liukkonen, Jarmo

2015-01-01

Background: The promotion of physical activity and health has become a universal challenge. The Sotkamo Physical Activity as Civil Skill Program was implemented to increase students' physical activity by promoting supportive psychological and physical school environment. The aim of this study was to evaluate the effectiveness of the…

Differential Programming Needs of College Students Preferring Web-Based Versus In-Person Physical Activity Programs.

PubMed

Goldstein, Stephanie P; Forman, Evan M; Butryn, Meghan L; Herbert, James D

2017-09-21

College students report several barriers to exercise, highlighting a need for university-based programs that address these challenges. In contrast to in-person interventions, several web-based programs have been developed to enhance program engagement by increasing ease of access and lowering the necessary level of commitment to participate. Unfortunately, web-based programs continue to struggle with engagement and less-than-ideal outcomes. One explanation for this discrepancy is that different intervention modalities may attract students with distinctive activity patterns, motivators, barriers, and program needs. However, no studies have formally evaluated intervention modality preference (e.g., web-based or in-person) among college students. The current study sought to examine the relationship between intervention modality preference and physical activity programming needs. Undergraduate students (n = 157) enrolled in psychology courses at an urban university were asked to complete an online survey regarding current activity patterns and physical activity program preferences. Participants preferring web-based physical activity programs exercised less (p = .05), were less confident in their abilities to exercise (p = .01), were less likely to endorse the maintenance stage of change (p < .01) and perceived more barriers to exercising (p < .01) than those who preferred in-person programming. Findings suggest that students preferring web-based programming may require programs that enhance self-efficacy by fostering goal-setting and problem-solving skills. A user-centered design approach may enhance the engagement (and therefore effectiveness) of physical activity promotion programs for college students.

Measuring Success: Evaluating Educational Programs

ERIC Educational Resources Information Center

Fisher, Yael

2010-01-01

This paper reveals a new evaluation model, which enables educational program and project managers to evaluate their programs with a simple and easy to understand approach. The "index of success model" is comprised of five parameters that enable to focus on and evaluate both the implementation and results of an educational program. The…

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Spiral-Interactive Program Evaluation Model.

ERIC Educational Resources Information Center

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Information Management Strategies for Program Tracking and Formative Evaluation

NASA Astrophysics Data System (ADS)

Siegfried, D.; Detrick, L.; Valaitis, S.; Johnson, A.; Thomas, S. H.; Fauver, A.

2013-05-01

The Institute for Broadening Participation (IBP) has developed information management systems to facilitate programmatic formative evaluation, tracking and outreach activities. Nearly a decade of design solutions and technical implementations in support of IBP's professional development and mentoring programs for students (including the "Pathways to Ocean Science," "Minorities Striving and Pursuing Higher Degrees of Success" in Earth System Science, and "Pathways to Engineering") has provided IBP with a toolbox of proven strategies for addressing program engagement and participant tracking, outreach, and a variety of other information management needs. In this session, IBP will use case-specific examples to share general design strategies for program participant and activities data collection in REUs and other program types. The cases will illustrate an approach that begins with a review of program logic, objectives, expected outcomes, constraints and requirements, which then informs a comprehensive system design. When implemented, such information systems improve administrative efficiency through streamlined data collection processes and easy-to-use data capture forms, and a corresponding set of reporting tools provides access to data that is crucial for ongoing program improvement. IBP presents this information in response to collaborations with administrators of Research Experience for Undergraduates (REU) programs as well as longer duration programs, who have expressed the need for more comprehensive and easy to use information systems. Recently IBP has also worked with the directors of NSF and NASA funded programs seeking assistance in addressing their formative evaluation needs including system design, information collection, and reporting efforts.

Development and Evaluation of a Basic Physical and Sports Activity Program for Preschool Children in Nursery Schools in Iran: an Interventional Study

PubMed Central

Kordi, Ramin; Nourian, Ruhollah; Ghayour, Mahboubeh; Kordi, Mahboubeh; Younesian, Ali

2012-01-01

Objective The objectives of this study were a) to develop a physical activity program for nursery schools, and b) to evaluate the effects of this program on fundamental movement skills of preschool age children in Iran. Methods In this quasi-experimental study 147 children from five nursery schools in five different cities in Iran were enrolled. A physical activity program was developed for nursery children. Trained nursery physical activity instructors conducted the program for 10 weeks for all subjects. The levels of gross motor development of all subjects were measured before intervention and after 10 weeks physical activity program employing the Test of Gross Motor Development-edition 2 (TGMD-2). Findings The participants in this study had a mean (SD) age of 4.95 (0.83) years. At the end of the study, scores of subjects at all components of TGMD-2 (including locomotor, object control, sum of standard scores and gross motor quotient) were significantly improved compared to the baseline scores (P<0.001). Based on descriptive rating of the "Gross Motor Quotient" in the base line, 11.5% of subjects were superior/very superior (GMQ >120) and after 10 weeks intervention this rate was increased to 49.7% of all subjects. Conclusion It seems that the developed physical activity program conducted by trained nursery physical activity instructors could be an effective and practical way of increasing levels of fundamental movement skills of preschool children in Iran. PMID:23400235

THE SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM; ANNUAL REPORT TO CONGRESS, FY 1998

EPA Science Inventory

This document summarizes the accomplishments and activities of the Superfund Innovative Technology Evaluation (SITE) Program for 1998. General information on the SITE program is presented. In addition, cost savings effected by the SITE program were estimated and are presented. ...

Program Theory Evaluation: Logic Analysis

ERIC Educational Resources Information Center

Brousselle, Astrid; Champagne, Francois

2011-01-01

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge.…

Evaluating an employee wellness program.

PubMed

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Evaluation of a faculty development program aimed at increasing residents' active learning in lectures.

PubMed

Desselle, Bonnie C; English, Robin; Hescock, George; Hauser, Andrea; Roy, Melissa; Yang, Tong; Chauvin, Sheila W

2012-12-01

Active engagement in the learning process is important to enhance learners' knowledge acquisition and retention and the development of their thinking skills. This study evaluated whether a 1-hour faculty development workshop increased the use of active teaching strategies and enhanced residents' active learning and thinking. Faculty teaching in a pediatrics residency participated in a 1-hour workshop (intervention) approximately 1 month before a scheduled lecture. Participants' responses to a preworkshop/postworkshop questionnaire targeted self-efficacy (confidence) for facilitating active learning and thinking and providing feedback about workshop quality. Trained observers assessed each lecture (3-month baseline phase and 3-month intervention phase) using an 8-item scale for use of active learning strategies and a 7-item scale for residents' engagement in active learning. Observers also assessed lecturer-resident interactions and the extent to which residents were asked to justify their answers. Responses to the workshop questionnaire (n  =  32/34; 94%) demonstrated effectiveness and increased confidence. Faculty in the intervention phase demonstrated increased use of interactive teaching strategies for 6 items, with 5 reaching statistical significance (P ≤ .01). Residents' active learning behaviors in lectures were higher in the intervention arm for all 7 items, with 5 reaching statistical significance. Faculty in the intervention group demonstrated increased use of higher-order questioning (P  =  .02) and solicited justifications for answers (P  =  .01). A 1-hour faculty development program increased faculty use of active learning strategies and residents' engagement in active learning during resident core curriculum lectures.

Right timing in formative program evaluation.

PubMed

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluating Active Parental Consent Procedures for School Programming: Addressing the Sensitive Topic of Suicide Prevention

ERIC Educational Resources Information Center

Totura, Christine M. Wienke; Kutash, Krista; Labouliere, Christa D.; Karver, Marc S.

2017-01-01

Background: Suicide is the second leading cause of death for adolescents. Whereas school-based prevention programs are effective, obtaining active consent for youth participation in public health programming concerning sensitive topics is challenging. We explored several active consent procedures for improving participation rates. Methods: Five…

Physical Activity Intensity, Lesson Context, and Teacher Interactions during an Unstructured Afterschool Physical Activity Program

ERIC Educational Resources Information Center

Behrens, Timothy K.; Miller, Daniel J.; Schuna, John M.; Liebert, Mina L.

2015-01-01

Background: Afterschool programs are promising arenas to improve youth physical activity (PA) levels. During the school year for 2012-2013, 5 elementary schools from a low-socioeconomic status (SES) school district in southern Colorado participated in evaluation of the afterschool program entitled Keep It Moving! (KIM). Methods: In this…

42 CFR 491.11 - Program evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 5 2010-10-01 2010-10-01 false Program evaluation. 491.11 Section 491.11 Public... Certification; and FQHCs Conditions for Coverage § 491.11 Program evaluation. (a) The clinic or center carries out, or arranges for, an annual evaluation of its total program. (b) The evaluation includes review of...

Evaluation of Nosocomial Infection Control Programs in health services 1

PubMed Central

Menegueti, Mayra Gonçalves; Canini, Silvia Rita Marin da Silva; Bellissimo-Rodrigues, Fernando; Laus, Ana Maria

2015-01-01

OBJECTIVES: to evaluate the Nosocomial Infection Control Programs in hospital institutions regarding structure and process indicators. METHOD: this is a descriptive, exploratory and quantitative study conducted in 2013. The study population comprised 13 Nosocomial Infection Control Programs of health services in a Brazilian city of the state of São Paulo. Public domain instruments available in the Manual of Evaluation Indicators of Nosocomial Infection Control Practices were used. RESULTS: The indicators with the highest average compliance were "Evaluation of the Structure of the Nosocomial Infection Control Programs" (75%) and "Evaluation of the Epidemiological Surveillance System of Nosocomial Infection" (82%) and those with the lowest mean compliance scores were "Evaluation of Operational Guidelines" (58.97%) and "Evaluation of Activities of Control and Prevention of Nosocomial Infection" (60.29%). CONCLUSION: The use of indicators identified that, despite having produced knowledge about prevention and control of nosocomial infections, there is still a large gap between the practice and the recommendations. PMID:25806637

Qualitative evaluation of a physical activity-based chronic disease prevention program in a low-income, rural South African setting.

PubMed

Draper, Catherine E; Nemutandani, Simon M; Grimsrud, Anna T; Rudolph, Michael; Kolbe-Alexander, Tracy L; de Kock, Lauren; Lambert, Estelle V

2010-01-01

Chronic diseases, an increasing global concern, are prevalent in the low-income communities of South Africa, where rural health systems bear the double burden of infectious and chronic diseases. The Discovery Healthy Lifestyle Programme (DHLP) is a physical activity-based chronic disease prevention program that has been implemented in a low-income, rural setting in South Africa. The DHLP consists of both school- and primary healthcare clinic-based interventions for learners (Healthnutz) and adults (Live it Up), facilitated by teachers, nurses and community volunteers. The aim of this evaluation was to qualitatively assess the process by which the DHLP was implemented, identifying enabling factors and barriers. Data were collected in target communities at schools and clinics from semi-structured focus groups of program leaders and members, teachers and community members (n = 45), situational analyses of the school physical activity environment, informal community observations and informal interviews with program coordinators. The target communities faced socioeconomic and health inequalities and remained under-resourced and under-served. In spite of these and other challenges, the DHLP was well received by community members and stakeholders. It was valued by respondents for its health and psychosocial outcomes, evidenced by increased knowledge and awareness of the importance of physical activity and healthy lifestyles, and positively altered perceptions of physical activity. Program implementers believed the Live it Up component was growing, and this suggested the sustainability of the program. There were, however, some concerns about the fidelity of the Healthnutz intervention, due to timetabling difficulties. Despite this, teachers were positive about the program and its value for their learners, staff and school. The community characteristics of being under-resourced and under-served appeared to positively influence DHLP implementation. Local government

Personal Benefits of a Health Evaluation and Enhancement Program

NASA Technical Reports Server (NTRS)

Heinzelmann, F.; Durbeck, D. C.

1970-01-01

A study was made of the benefits reported by participants in a health evaluation and enhancement program dealing with physical activity. Program benefits were identified and defined in regard to three major areas: program effects on work; program effects on health; and program effects on habits and behavior. A strong positive and consistent relationship was found between reported benefits in each of these areas and measures of improvement in cardiovascular functioning based on treadmill performance. Significant differences in these measures of improvement were also found between participants who reported program benefits and those persons who did not. These findings provide a meaningful profile of the pattern of benefits generated by this kind of health program.

Promoting physical activity and quality of life in Vitoria, Brazil: evaluation of the Exercise Orientation Service (EOS) program.

PubMed

Reis, Rodrigo S; Hino, Adriano Akira F; Cruz, Danielle K; da Silva Filho, Lourival Espiridião; Malta, Deborah C; Domingues, Marlos R; Hallal, Pedro C

2014-01-01

The purpose of this study was to evaluate associations between exposure to the Exercise Orientation Service (EOS) program and physical activity (PA) and quality of life (QoL) in adults from Vitoria, Brazil. A phone survey was conducted with 2023 randomly selected participants (≥ 18 years) to measure awareness about the program, participation in the program, PA levels, and QoL. The associations were tested using Poisson and Linear regression models. 31.5% reported awareness about the program, 1.5% reported current participation, and 5.8% reported previous participation. Participation was higher among women (2.1%), older subjects (2.8%), and those reporting morbidities (2.4%). Awareness was higher among middle-aged persons (36.0%) and highly educated participants (37.1%). Current participation (PR = 2.22; 95% CI = 1.65-2.99) and awareness (PR = 1.15; 95% CI = 1.02-1.30) were associated with leisure-time PA (LTPA). Exposure to the program was not associated with QoL but was consistently associated with sufficient levels of LTPA among adults from Vitoria, Brazil.

The Houston Community College Eligible Legalized Alien Program. Evaluation Program. Evaluation Report.

ERIC Educational Resources Information Center

Seaman, Don F.; Cuellar, Sylvia

The Houston Community College (Texas) program (TOTAL ACCESS) designed in response to the Immigration Reform and Control Act of 1986, is described and evaluated. The program offers classes to eligible aliens (97% Hispanic Americans from Mexico, El Salvador, and Guatemala) wishing to pursue the educational program required for legalization. Program…

Evaluating Dermatology Residency Program Websites.

PubMed

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

The ACTIVATE study: results from a group-randomized controlled trial comparing a traditional worksite health promotion program with an activated consumer program.

PubMed

Terry, Paul E; Fowles, Jinnet Briggs; Xi, Min; Harvey, Lisa

2011-01-01

PURPOSE. This study compares a traditional worksite-based health promotion program with an activated consumer program and a control program DESIGN. Group randomized controlled trial with 18-month intervention. SETTING. Two large Midwestern companies. SUBJECTS. Three hundred and twenty employees (51% response). INTERVENTION. The traditional health promotion intervention offered population-level campaigns on physical activity, nutrition, and stress management. The activated consumer intervention included population-level campaigns for evaluating health information, choosing a health benefits plan, and understanding the risks of not taking medications as prescribed. The personal development intervention (control group) offered information on hobbies. The interventions also offered individual-level coaching for high risk individuals in both active intervention groups. MEASURES. Health risk status, general health status, consumer activation, productivity, and the ability to evaluate health information. ANALYSIS. Multivariate analyses controlled for baseline differences among the study groups. RESULTS. At the population level, compared with baseline performance, the traditional health promotion intervention improved health risk status, consumer activation, and the ability to recognize reliable health websites. Compared with baseline performance, the activated consumer intervention improved consumer activation, productivity, and the ability to recognize reliable health websites. At the population level, however, only the activated consumer intervention improved any outcome more than the control group did; that outcome was consumer activation. At the individual level for high risk individuals, both traditional health coaching and activated consumer coaching positively affected health risk status and consumer activation. In addition, both coaching interventions improved participant ability to recognize a reliable health website. Consumer activation coaching also

Evaluation of Turkish Education Programs

ERIC Educational Resources Information Center

Durmuscelebi, Mustafa

2010-01-01

The aim of this study is to evaluate the new Turkish education program that has been being implemented since 2005 gradually in light of teacher suggestions. The study has been done in scanning model. In this study which has been conducted with the purpose of evaluating the newly prepared Turkish education programs, the program has been tried to be…

General Criteria for Evaluating Social Programs.

ERIC Educational Resources Information Center

Shipman, Stephanie

1989-01-01

A framework of general evaluation criteria for ensuring the comprehensiveness of program reviews and appropriate and fair comparison of children's programs is outlined. It has two components: (1) descriptive; and (2) evaluative. The framework was developed by researchers at the General Accounting Office for evaluation of federal programs. (TJH)

Staff Development Program Evaluation.

ERIC Educational Resources Information Center

Ashur, Nina E.; And Others

An evaluation of the staff development program at College of the Canyons (California) was conducted in 1991 to provide information applicable to program improvement. Questionnaires were distributed to all faculty, classified staff, and flexible calendar program committee and staff development advisory committee members, resulting in response rates…

Critical evaluation of international health programs: Reframing global health and evaluation.

PubMed

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-04-01

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Integrating Program Theory and Systems-Based Procedures in Program Evaluation: A Dynamic Approach to Evaluate Educational Programs

ERIC Educational Resources Information Center

Grammatikopoulos, Vasilis

2012-01-01

The current study attempts to integrate parts of program theory and systems-based procedures in educational program evaluation. The educational program that was implemented, called the "Early Steps" project, proposed that physical education can contribute to various educational goals apart from the usual motor skills improvement. Basic…

Purposive Facebook Recruitment Endows Cost-Effective Nutrition Education Program Evaluation

PubMed Central

Wamboldt, Patricia

2013-01-01

Background Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. Objective The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. Methods English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Results Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

PubMed

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Research and Evaluation in Operational Competency-Based Teacher Education Programs.

ERIC Educational Resources Information Center

Dickson, George E., Ed.

1975-01-01

This is a collection of papers presented at a 1974 conference on research and evaluation in operational competency-based teacher education (CBTE) programs. Two conceptual models for research and evaluation of CBTE activities were presented at the conference and the presentations of these models are the first two chapters of this collection: "A…

Using Youth Participatory Evaluation to Improve a Bullying Prevention Program

ERIC Educational Resources Information Center

Duke, Adrienne M.; Sollie, Donna L.; Silva, Kelcie

2016-01-01

We conducted a youth participatory evaluation of a bullying prevention curriculum before the curriculum was implemented in communities. We partnered with youths from a young women leaders' program to reduce the number of lessons in an existing curriculum and determine which activities were likely to have the greatest impact. To evaluate the…

Evaluating an interdisciplinary undergraduate training program in health promotion research.

PubMed

Misra, Shalini; Harvey, Richard H; Stokols, Daniel; Pine, Kathleen H; Fuqua, Juliana; Shokair, Said M; Whiteley, John M

2009-04-01

The University of California at Irvine Interdisciplinary Summer Undergraduate Research Experience (ID-SURE) program had three objectives: (1) designing an interdisciplinary health promotion training curriculum for undergraduate research fellows; (2) developing measures for evaluating and assessing program-related educational processes and products; and (3) comparing these educational process and product measures between groups of students who did or did not receive the training. A total of 101 students participated in the ID-SURE program during 2005, 2006, and 2007. A longitudinal research design was employed whereby students' interdisciplinary attitudes and behaviors were assessed at the beginning and end of the training program. The interdisciplinary and intellectual qualities of students' academic and research products were assessed at the conclusion of the training activities. In addition, ID-SURE participants' interdisciplinary attitudes, behaviors, and research products were compared to those of 70 participants in another fellowship program that did not have an interdisciplinary training component. Exposing undergraduate research fellows to the interdisciplinary curriculum led to increased participation in, and positive attitudes about, interdisciplinary classroom and laboratory activities. Products, such as the integrative and interdisciplinary quality of student research projects, showed no differences when compared to those of undergraduates who were not exposed to the interdisciplinary curriculum. However, undergraduates exposed to the training engaged in more interdisciplinary behaviors at the end of the program than students who were not trained in interdisciplinary research techniques. The findings from this study offer evidence for the efficacy of the ID-SURE program for training undergraduate students in transdisciplinary concepts, methods, and skills that are needed for effective scientific collaboration. Additionally, this study makes two important

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

Physical Activity Intensity, Lesson Context, and Teacher Interactions During an Unstructured Afterschool Physical Activity Program.

PubMed

Behrens, Timothy K; Miller, Daniel J; Schuna, John M; Liebert, Mina L

2015-12-01

Afterschool programs are promising arenas to improve youth physical activity (PA) levels. During the school year for 2012-2013, 5 elementary schools from a low-socioeconomic status (SES) school district in southern Colorado participated in evaluation of the afterschool program entitled Keep It Moving! (KIM). In this cross-sectional analysis we sought to evaluate the relationships among participant PA, teacher interaction, and lesson context during an unstructured afterschool PA program. Participants were third-fifth grade students enrolled in the KIM program at the 5 participating elementary schools and were assessed utilizing accelerometers and direct observation with the System for Observing Fitness Instruction Time (SOFIT). Program participants wore the accelerometer 37.1 ± 5.4 min session(-1). Approximately half of the time was spent in light PA (LPA) and 15.7 ± 5.3 min session(-1) in moderate to vigorous PA (MVPA). Game play was positively associated with LPA and negatively associated with MVPA. When teachers did not promote PA with students there was a positive association with sedentary activity (SA) and a negative association with MVPA. Lesson context and teacher interactions may be important factors associated with PA intensity of afterschool PA programming. Future research should address whether structured PA curricula may improve quality of afterschool PA programming. © 2015, American School Health Association.

How To Design a Program Evaluation. CSE Program Evaluation Kit, Volume 3. Second Edition.

ERIC Educational Resources Information Center

Fitz-Gibbon, Carol Taylor; Morris, Lynn Lyons

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

An Inservice Program for Elementary Teachers: Components, Instructional Procedures, and Evaluation.

ERIC Educational Resources Information Center

Horak, Willis J.; And Others

A description and evaluation of a year-long science in-service program for elementary teachers is provided. Consisting of three components, the program was designed to expand teachers' understandings of physics and chemistry concepts and processes and to encourage more science teaching and science activities in their classrooms. The on-campus…

Enhancing medical-surgical nursing practice: using practice tests and clinical examples to promote active learning and program evaluation.

PubMed

DuHamel, Martha B; Hirnle, Constance; Karvonen, Colleen; Sayre, Cindy; Wyant, Sheryl; Colobong Smith, Nancy; Keener, Sheila; Barrett, Shannon; Whitney, Joanne D

2011-10-01

In a 14-week medical-surgical nursing review course, two teaching strategies are used to promote active learning and assess the transfer of knowledge to nursing practice. Practice tests and clinical examples provide opportunities for participants to engage in self-assessment and reflective learning and enhance their nursing knowledge, skills, and practice. These strategies also contribute to program evaluation and are adaptable to a variety of course formats, including traditional classroom, web conference, and online self-study. Copyright 2011, SLACK Incorporated.

An Evaluation Program for the Eckerd Foundation Therapeutic Wilderness Camping Program: An Evaluation of an Atypical Alternative Education Program.

ERIC Educational Resources Information Center

Griffin, William H.; Carter, James D.

The strategy used in evaluating an out-of-doors resident camping program for emotionally disturbed children is outlined. This strategy calls for examining the following elements in the program: (1) program goals and objectives; (2) collection and processing program data; (3) camper progress assessment; (4) program audit; (5) assessment of past…

Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

The NASA-USPHS Health Evaluation and Enhancement Program

NASA Technical Reports Server (NTRS)

Durbeck, D. C.; Heinzelmann, F.; Moxley, R. T., III; Schacther, J.; Payne, G. H.; Limoncelli, D. D.; Fox, S. M., III; Arnoldi, L. B.

1972-01-01

An exercise program was initiated to assess the feasibility of an on the job health evaluation and enhancement program, as well as to identify the factors which influenced volunteering, adherence, and effectiveness of the program. The program was utilized by 237 of the 998 eligible Federal employees, with a mean attendance of 1.3 days per week. Those who volunteered perceived a need for increased physical activity, felt they had sufficient time to participate, and derived subjective as well as objective benefits. Significant improvements were found in heart rate response to the standard exercise test, body weight, skinfold measurements, and triglycerides. A consistent relationship was found between subjectively reported effects of the program on work, health habits, and behavior, and improvement in cardiovascular function, based on treadmill performance. Numerous personal and programmatic factors influencing volunteering and participation were identified.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Program Fighter - An Evaluation.

ERIC Educational Resources Information Center

Hull, David G.; Fowler, Wallace T.

Described is a computer program for the sizing of subsonic and supersonic fighters which has been adapted for use in an aerospace engineering design course. Following a description of the program, an evaluation of its use in the university is presented. It is concluded that computer programs for the conceptual design of aerospace vehicles can play…

Toy Control Program evaluation.

PubMed

Stewart, H A; Ormond, C; Seeger, B R

1991-08-01

The Toy Control Program for the Apple IIe microcomputer is a software and hardware package developed for the training of single-switch scanning skills. The specially designed scanning programs provide on screen visual feedback and activate a battery-powered toy to reinforce performance. This study examined whether the training of preschool subjects in single-switch scanning skills with the Toy Control Program would result in increased task completion scores and increased levels of attention to task, as compared with conditions of toy activation only and microcomputer programs with screen reinforcement only. The results showed that the subjects paid significantly more attention to the toys as reinforcers (p less than .01). No significant difference was found for the performance results of the three conditions. These findings support the use of a program like the Toy Control Program, which integrates the instructional capabilities of a computer with the reinforcement potential of a toy and the creativity of a therapist.

Feedback Improvement in Automatic Program Evaluation Systems

ERIC Educational Resources Information Center

Skupas, Bronius

2010-01-01

Automatic program evaluation is a way to assess source program files. These techniques are used in learning management environments, programming exams and contest systems. However, use of automated program evaluation encounters problems: some evaluations are not clear for the students and the system messages do not show reasons for lost points.…

Active for Life After Cancer: a randomized trial examining a lifestyle physical activity program for prostate cancer patients.

PubMed

Carmack Taylor, Cindy L; Demoor, Carl; Smith, Murray A; Dunn, Andrea L; Basen-Engquist, Karen; Nielsen, Ingrid; Pettaway, Curtis; Sellin, Rena; Massey, Pamela; Gritz, Ellen R

2006-10-01

Active for Life After Cancer is a randomized trial evaluating the efficacy of a 6-month group-based lifestyle physical activity program (Lifestyle) for prostate cancer patients to improve quality of life (QOL) including physical and emotional functioning compared to a group-based Educational Support Program and a Standard Care Program (no group). A total of 134 prostate cancer patients receiving continuous androgen-ablation were randomly assigned to one of the three study conditions. Results indicated no significant improvements in QOL at 6 or 12 months. Both group-based programs were positively received and yielded good attendance and retention. Lifestyle participants demonstrated significant improvements in most theoretical mediators proposed by the Transtheoretical Model and Social Cognitive Theory to affect physical activity. Despite these improvements, no significant changes were found for most physical activity measures. Results suggest a lifestyle program focusing on cognitive-behavioral skills training alone is insufficient for promoting routine physical activity in these patients.

Integrating quantitative and qualitative evaluation methods to compare two teacher inservice training programs

NASA Astrophysics Data System (ADS)

Lawrenz, Frances; McCreath, Heather

Qualitative and quantitative evaluation procedures were used to compare two physical-science teacher inservice training programs. The two programs followed the master teacher training model espoused by NSF but used different types of master teachers and types of activities. The two evaluation procedures produced different results and together they provided a much clearer picture of the strengths and weaknesses of the two programs. Using only one approach or the other would have substantially altered the conclusions.

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

PubMed

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Guidelines for the Evaluation of Bilingual Education Programs.

ERIC Educational Resources Information Center

Cardoza, Desdemona

Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…

Evaluation of NASA space grant consortia programs

NASA Technical Reports Server (NTRS)

Eisenberg, Martin A.

1990-01-01

The meaningful evaluation of the NASA Space Grant Consortium and Fellowship Programs must overcome unusual difficulties: (1) the program, in its infancy, is undergoing dynamic change; (2) the several state consortia and universities have widely divergent parochial goals that defy a uniform evaluative process; and (3) the pilot-sized consortium programs require that the evaluative process be economical in human costs less the process of evaluation comprise the effectiveness of the programs they are meant to assess. This paper represents an attempt to assess the context in which evaluation is to be conducted, the goals and limitations inherent to the evaluation, and to recommend appropriate guidelines for evaluation.

Human Research Program Science Management: Overview of Research and Development Activities

NASA Technical Reports Server (NTRS)

Charles, John B.

2007-01-01

An overview of research and development activities of NASA's Human Research Science Management Program is presented. The topics include: 1) Human Research Program Goals; 2) Elements and Projects within HRP; 3) Development and Maintenance of Priorities; 4) Acquisition and Evaluation of Research and Technology Proposals; and 5) Annual Reviews

Planning Evaluation through the Program Life Cycle

ERIC Educational Resources Information Center

Scheirer, Mary Ann; Mark, Melvin M.; Brooks, Ariana; Grob, George F.; Chapel, Thomas J.; Geisz, Mary; McKaughan, Molly; Leviton, Laura

2012-01-01

Linking evaluation methods to the several phases of a program's life cycle can provide evaluation planners and funders with guidance about what types of evaluation are most appropriate over the trajectory of social and educational programs and other interventions. If methods are matched to the needs of program phases, evaluation can and should…

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

Evaluation of a student participatory, low-intensity program to improve school wellness environment and students' eating and activity behaviors.

PubMed

Hoelscher, Deanna M; Moag-Stahlberg, Alicia; Ellis, Karen; Vandewater, Elizabeth A; Malkani, Raja

2016-05-13

Most schools have not fully implemented wellness policies, and those that have rarely incorporate meaningful student participation. The aim of the Fuel Up to Play 60 (FUTP60) program is to help schools implement wellness policies by engaging students in activities to improve access to healthful, good tasting food and drinks, and increase the number and type of opportunities for students to be physically active. The aim of this paper is to present initial student-level results from an implementation of FUTP60 in 72 schools, grades 6-9. The study used a non-controlled pretest/posttest with serial cross-sectional data. School process data and student-level data were collected in fall 2009 (pre-intervention) and spring 2010 (post-intervention). School wellness practices were captured during a baseline needs assessment survey. Validated self-administered questionnaires assessing dietary and physical activity (PA) behaviors were administered to students in grades 6-9 in the 72 pilot schools. Mixed-effects logistic regression controlling for clustering of schools and demographics was used to calculate odds ratios and confidence intervals to evaluate changes pre- and post- intervention. All 72 schools implemented FUTP60 during the 2009-2010 school year. Action strategies most frequently chosen by the schools included increasing breakfast participation and new activities before and after school. Positive and significant changes in students' behaviors (n = 32,482 at pretest and 29,839 at post-test) were noted for dairy, whole grains, fruit, and vegetable consumption and PA levels pre- and post-intervention (OR 1.05 to 1.27). Students aware of the program at post-test were significantly more likely to report healthier eating and PA behaviors than students unaware of the program (OR 1.1 to 1.34). FUTP60 pilot findings indicate that a low intensity program focused on wellness policy implementation is associated with small positive changes in student behaviors, especially

Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program: Sharing a Program Model from Design and Development through Evaluation

ERIC Educational Resources Information Center

Young, Shawna; Uy, Ana; Bell, Joyce

2017-01-01

The Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program at California State University, Stanislaus provides support for student engagement in these areas from idea conception through dissemination. Through assistantships, mini-grants, the Student Research Competition, and travel grants, the Program is designed to…

Evaluation of otolaryngology residency program websites.

PubMed

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

Two Feathers Endowment Scholarship Program: Program Evaluation

ERIC Educational Resources Information Center

Pierce, Alexandra

2004-01-01

The Saint Paul Foundation contracted with the Wilder Research Center to conduct an evaluation of their Two Feathers Scholarship Program. The Two Feathers Scholarship Program is funded through the Two Feathers Endowment, which is one part of the Foundation's SpectrumTrust. SpectrumTrust is a unique partnership between communities of color and The…

Maryland Community Colleges 1980 Program Evaluations.

ERIC Educational Resources Information Center

Maryland State Board for Community Colleges, Annapolis.

This report contains qualitative evaluations of 48 programs throughout the Maryland community college system, as well as a statewide evaluation of Teacher Education transfer programs. A summary of the Teacher Education programs is presented first, in which the purpose and role of teacher education in the community college, enrollment trends,…

Program Evaluation at Foothill College.

ERIC Educational Resources Information Center

Lowe, Irel D.

Evaluation systems were designed for the assessment of the instructional and non-instructional programs at Foothill College (California) to determine whether the objectives of the programs were being met and to ascertain the direct and indirect costs of the programs. For the instructional programs, criteria for determining effectiveness, revenue…

Exercise Level and Energy Expenditure in the Take 10![R] In-Class Physical Activity Program.

ERIC Educational Resources Information Center

Stewart, James A.; Dennison, David A.; Kohl, Harold W., III; Doyle, J. Andrew

2004-01-01

This study evaluated the effectiveness of an innovative, classroom-based physical activity prevention program designed to integrate academic curriculum elements along with a physical activity program in providing moderate-to-vigorous intensity physical activity. A convenience sample of three public school classrooms (one first, third, and fifth…

Library Programs. Evaluating Federally Funded Public Library Programs.

ERIC Educational Resources Information Center

Office of Educational Research and Improvement (ED), Washington, DC.

Following an introduction by Betty J. Turock, nine reports examine key issues in library evaluation: (1) "Output Measures and the Evaluation Process" (Nancy A. Van House) describes measurement as a concept to be understood in the larger context of planning and evaluation; (2) "Adapting Output Measures to Program Evaluation"…

Intensive Summer Institute: Program Evaluation. 1991. NFLRC Research Notes.

ERIC Educational Resources Information Center

Ross, Steven

This report evaluates a 6-week intensive summer program for language teachers at the University of Hawaii. Thirty-two high school or college teachers and teacher trainees of Chinese, Indonesian, Japanese, and Spanish participated. Participants were led by master teachers who provided exemplary teaching, organized language-specific activities,…

Using Art For Health Promotion: Evaluating an In-School Program Through Student Perspectives.

PubMed

McKay, Fiona H; McKenzie, Hayley

2017-09-01

The value of incorporating arts-based approaches into health promotion programs has long been recognized as useful in affecting change. Such approaches have been used in many schools across Australia and have been found to promote general well-being and mental health. Despite these positive findings, few programs have used or evaluated an integrated arts-based approach to achieve health and well-being goals. This article presents the findings of an evaluation of an integrated arts-based program focused on creativity and improving well-being in students. The findings of this evaluation suggest that students who took part in the program were more interested in art and music at the end of the program and had gained an overall increase in awareness and mindfulness and a positivity toward leisure activities. This evaluation provides some evidence to suggest that this type of program is a promising way to promote well-being in schools.

Testing the DMAA's recommendations for disease management program evaluation.

PubMed

Serxner, Seth; Mattke, Soeren; Zakowski, Sarah; Gold, Daniel

2008-10-01

The objective of this study was to compare and contrast findings regarding the financial savings projections of the disease management (DM) programs of 2 large employers based on different evaluation methods. In particular, this research tests the impact of differences in assumptions on the underlying growth rate of group health costs, exclusions of high-cost conditions and claims, and the length of the baseline period for determined health care costs. A pre-post study design was used. The data for this research came from 2 large employers in the consumer goods industry with comprehensive Health and Productivity Management programs. It contained medical and prescription drug claims and health plan enrollment data as well as program activity data from 2001 to 2005, covering an average yearly sample size of 201,037 members with 12 consecutive months of enrollment. Analyses were done on group-level averages using nominal cost data and were run to reflect the impact of a DM-only intervention. While the trend estimate and length of baseline had the largest effects on estimated program impact, the use of exclusions had an important effect as well. These findings demonstrate the importance of developing and instituting a standardized evaluation methodology. Without increasing consistency in the way evaluators develop their methodologies, it will remain difficult to be able to compare one evaluation to another, or to have faith in the results at hand.

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

NASA Astrophysics Data System (ADS)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in

How To: Evaluate Education Programs

ERIC Educational Resources Information Center

Fink, Arlene; Kosecoff, Jacqueline

This book presents a compilation of 28 issues of the newsletter, "How To Evaluate Education Programs" from the first one published in September 1977 through the issue of December 1979 on the topic of evaluating educational programs. The subject is covered in the following chapters: (1) How to Choose a Test; (2) How to Rate and Compare…

Multidimensional Implementation Evaluation of a Residential Treatment Program for Adolescent Substance Abuse

ERIC Educational Resources Information Center

Faw, Leyla; Hogue, Aaron; Liddle, Howard A.

2005-01-01

The authors applied contemporary methods from the evaluation literature to measure implementation in a residential treatment program for adolescent substance abuse. A logic model containing two main components was measured. Program structure (adherence to the intended framework of service delivery) was measured using data from daily activity logs…

[Resident evaluation of general surgery training programs].

PubMed

Espinoza G, Ricardo; Danilla E, Stefan; Valdés G, Fabio; San Francisco R, Ignacio; Llanos L, Osvaldo

2009-07-01

The profile of the general surgeon has changed, aiming to incorporate new skills and to develop new specialties. To assess the quality of postgraduate General Surgery training programs given by Chilean universities, the satisfaction of students and their preferences after finishing the training period. A survey with multiple choice and Likert type questions was designed and applied to 77 surgery residents, corresponding to 59% of all residents of general surgery specialization programs of Chilean universities. Fifty five per cent of residents financed with their own resources the specialization program. Thirty nine percent disagreed partially or totally with the objectives and rotations of programs. The opportunity to perform surgical interventions and the support by teachers was well evaluated. However, 23% revealed teacher maltreatment. Fifty six percent performed research activities, 73% expected to continue training in a derived specialty and 69% was satisfied with the training program. Residents considered that the quality and dedication of professors and financing of programs are issues that must be improved. The opportunity to perform surgical interventions, obtaining a salary for their work and teacher support is considered of utmost importance.

The Evaluation and Research of Multi-Project Programs: Program Component Analysis.

ERIC Educational Resources Information Center

Baker, Eva L.

1977-01-01

It is difficult to base evaluations on concepts irrelevant to state policy making. Evaluation of a multiproject program requires both time and differentiation of method. Data from the California Early Childhood Program illustrate process variables for program component analysis, and research questions for intraprogram comparison. (CP)

Program Evaluation: Two Management-Oriented Samples

ERIC Educational Resources Information Center

Alford, Kenneth Ray

2010-01-01

Two Management-Oriented Samples details two examples of the management-oriented approach to program evaluation. Kenneth Alford, a doctorate candidate at the University of the Cumberlands, details two separate program evaluations conducted in his school district and seeks to compare and contrast the two evaluations based upon the characteristics of…

Logic Models: A Tool for Designing and Monitoring Program Evaluations. REL 2014-007

ERIC Educational Resources Information Center

Lawton, Brian; Brandon, Paul R.; Cicchinelli, Louis; Kekahio, Wendy

2014-01-01

introduction to logic models as a tool for designing program evaluations defines the major components of education programs--resources, activities, outputs, and short-, mid-, and long-term outcomes--and uses an example to demonstrate the relationships among them. This quick…

Evaluating Federal Education Programs.

ERIC Educational Resources Information Center

Baker, Eva L., Ed.

A series of papers was developed by the authors as part of their deliberations as members of the National Research Council's Committee of Program Evaluation in Education. The papers provide a broad range of present evaluative thinking. The conflict between preferences in evaluation methodology comes through in these papers. The selections include:…

Guidelines "PEP," Peer Evaluation Program. A Systematic Approach for Evaluating Educational Programs, 1973-1974.

ERIC Educational Resources Information Center

Grotsky, Jeffery N.; And Others

The Peer Evaluation Program (PEP) has been instituted by the Division of Special Education, Pennsylvania State Department of Education, to allow intermediate units an opportunity to continuously improve their programs. The advantages of the PEP system are: (1) it is a self-improvememt system of program development; (2) PEP allows local autonomy as…

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

PubMed

Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

2017-02-01

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

1999 commuter assistance program evaluation manual

DOT National Transportation Integrated Search

2001-01-01

This manual was developed to assist Florida's Commuter Assistance Programs (CAP) to measure and evaluate their performance. It provides information necessary for a CAP to create and implement its own evaluation program. It discusses performance measu...

Online evaluation programs: benefits and limitations.

PubMed

Burhansstipanov, Linda; Clark, Richard E; Watanabe-Galloway, Shinobu; Petereit, Daniel G; Eschiti, Valerie; Krebs, Linda U; Pingatore, Noel L

2012-04-01

Patient navigation programs are increasing throughout the USA, yet some evaluation measures are too vague to determine what and how navigation functions. Through collaborative efforts an online evaluation program was developed. The goal of this evaluation program is to make data entry accurate, simple, and efficient. This comprehensive program includes major components on staff, mentoring, committees, partnerships, grants/studies, products, dissemination, patient navigation, and reports. Pull down menus, radio buttons, and check boxes are incorporated whenever possible. Although the program has limitations, the benefits of having access to current, up-to-date program data 24/7 are worth overcoming the challenges. Of major benefit is the ability of the staff to tailor summary reports to provide anonymous feedback in a timely manner to community partners and participants. The tailored data are useful for the partners to generate summaries for inclusion in new grant applications.

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Practical strategies for nursing education program evaluation.

PubMed

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Theory and models for planning and evaluating institutional influenza prevention and control programs.

PubMed

Russell, Margaret L; Thurston, Wilfreda E; Henderson, Elizabeth A

2003-10-01

Low rates of staff influenza vaccine coverage occur in many health care facilities. Many programs do not offer vaccination to physicians or to volunteers, and some programs do not measure coverage or do so only for a subset of staff. The use of theory in planning and evaluation may prevent these problems and lead to more effective programs. We discuss the use of theory in the planning and evaluation of health programs and demonstrate how it can be used for the evaluation and planning of a hospital or nursing home influenza control program. The application of theory required explicit statement of the goals of the program and examination of the assumptions underlying potential program activities. This indicated that staff should probably be considered as employees, volunteers, physicians, and contractors of the facility. It also directed attention to evidence-based strategies for increasing vaccination rates. The application of a program planning model to a problem of institutional influenza prevention may prevent planners from excluding important target populations and failing to monitor the important indicators of program success.

Identifying Strategies Programs Adopt to Meet Healthy Eating and Physical Activity Standards in Afterschool Programs

ERIC Educational Resources Information Center

Weaver, Robert G.; Moore, Justin B.; Turner-McGrievy, Brie; Saunders, Ruth; Beighle, Aaron; Khan, M. Mahmud; Chandler, Jessica; Brazendale, Keith; Randell, Allison; Webster, Collin; Beets, Michael W.

2017-01-01

Background: The YMCA of USA has adopted Healthy Eating and Physical Activity (HEPA) Standards for its afterschool programs (ASPs). Little is known about strategies YMCA ASPs are implementing to achieve Standards and these strategies' effectiveness. Aims: (1) Identify strategies implemented in YMCA ASPs and (2) evaluate the relationship between…

Development and Implementation of a Mental Health Work Rehabilitation Program: Results of a Developmental Evaluation.

PubMed

Sylvain, Chantal; Durand, Marie-José; Velasquez Sanchez, Astrid; Lessard, Nathalie; Maillette, Pascale

2018-05-23

Purpose Long-term work disability due to common mental disorders (CMDs) is a growing problem. Yet optimal interventions remain unclear and little is known about implementation challenges in everyday practice. This study aimed to support and evaluate, in real time, the development and implementation of a work rehabilitation program (WRP) designed to promote post-CMD return-to-work (RTW). Methods A 2-year developmental evaluation was performed using a participatory approach. At program outset, the researchers held five work meetings to revise the program's logic model and discuss its underlying change theory with clinicians. Data collection tools used throughout the study period were structured charts of activities conducted with workers (n = 41); in-depth interviews with program clinicians and managers (n = 9); and participant observation during work meetings. Quantitative data were analyzed using descriptive statistics. Qualitative data underwent thematic analysis using a processual approach. Results Three types of activity were developed and implemented: individual and group interventions targeting workers, and joint activities targeting partners (physicians, employers, others). While worker-targeted activities were generally implemented as planned, joint activities were sporadic. Analysis of the implementation process revealed five challenges faced by clinicians. Determinants included clinicians, host organization, sociopolitical context and resources provided by the evaluation. Conclusion The program studied is original in that it is based on the best available scientific knowledge, yet adapted to contextual particularities. The identified implementation challenges highlight the need for greater importance to be placed on the external, non-program context to ensure sustainable implementation in everyday practice.

Program evaluation of Protovation Camp

NASA Astrophysics Data System (ADS)

Healy, Laurel Lynell Martin

The purpose of this program evaluation was to determine the extent to which Protovation Camp utilized the combined resources of multiple institutions to impact student learning in science, technology, engineering, and math. The partnership consisted of multiple institutions: the university, providing graduate students to facilitate inquiry-based lessons; the science center, allowing the use of their facilities and resources; and the elementary school, contributing rising third through fifth grade campers. All of these components were examined. The mixed-methods approach used post hoc quantitative data for campers, which consisted of pre-test and post-test scores on the Test of Science-Related Attitudes (TOSRA), the Draw-A-Scientist Test, and content tests based on the camp activities. Additionally, TOSRA scores and current survey results for the graduate students were used along with qualitative data collected from plusdelta charts to determine the impact of participation in Protovation Camp on teachers and students. Results of the program evaluation indicated that when students were taught inquiry-based lessons that ignite wonder, both their attitudes toward science and their knowledge about science improved. An implication for teacher preparation programs was that practicing inquiry-based lessons on actual students (campers) was an important component for teachers (graduate students) as they prepare to positively impact student learning in their own classrooms. Immediate feedback from the campers in the form of pre-test and post-test scores and from peers on plusdelta charts allowed the graduate students the opportunity to make needed adjustments to improve effectiveness before using the lesson with a new set of campers or later in their own classrooms. Keywords. Teacher preparation, Inquiry-based instruction, STEM instructions, University and museum partnerships

Comparative Effectiveness of After-School Programs to Increase Physical Activity

PubMed Central

Gesell, Sabina B.; Sommer, Evan C.; Lambert, E. Warren; Vides de Andrade, Ana Regina; Davis, Lauren; Beech, Bettina M.; Mitchell, Stephanie J.; Neloms, Stevon; Ryan, Colleen K.

2013-01-01

Background. We conducted a comparative effectiveness analysis to evaluate the difference in the amount of physical activity children engaged in when enrolled in a physical activity-enhanced after-school program based in a community recreation center versus a standard school-based after-school program. Methods. The study was a natural experiment with 54 elementary school children attending the community ASP and 37 attending the school-based ASP. Accelerometry was used to measure physical activity. Data were collected at baseline, 6 weeks, and 12 weeks, with 91% retention. Results. At baseline, 43% of the multiethnic sample was overweight/obese, and the mean age was 7.9 years (SD = 1.7). Linear latent growth models suggested that the average difference between the two groups of children at Week 12 was 14.7 percentage points in moderate-vigorous physical activity (P < .001). Cost analysis suggested that children attending traditional school-based ASPs—at an average cost of $17.67 per day—would need an additional daily investment of $1.59 per child for 12 weeks to increase their moderate-vigorous physical activity by a model-implied 14.7 percentage points. Conclusions. A low-cost, alternative after-school program featuring adult-led physical activities in a community recreation center was associated with increased physical activity compared to standard-of-care school-based after-school program. PMID:23984052

LEA Title VII Program Evaluations. Panel Presentations.

ERIC Educational Resources Information Center

Balu, Raj

These panel presentations focus on LEA Title VII Program Evaluations. Raj Balu, an administrator of bilingual programs in Chicago presents information regarding the bilingual education program in the Chicago public schools, as well as information on Title VII programs and what kind of evaluation is being done. Jesus Salazar, who is currently…

The Cost-Income Compenent of Program Evaluation.

ERIC Educational Resources Information Center

Miner, Norris

Cost-income studies are designed to serve two functions in instructional program evaluation. First, they act as the indicator of the economic value of a program. This economic value in conjunction with the other educational values needed in program evaluation allow for the most realistic appraisal of program worth. Second, if the studies show a…

Evaluating a Development Program.

ERIC Educational Resources Information Center

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Trust Territory of the Pacific Islands Adult Basic Education Program. Evaluation Report, Fiscal Year 1979.

ERIC Educational Resources Information Center

McCune, Donald A.

The Adult Basic Education (ABE) program conducted by the Trust Territory of the Pacific Islands was evaluated. Data were collected via staff interviews and record reviews during site visits at ABE facilities located in five of six district comprising the Trust Territory. Focus of the evaluation activities was on program administration,…

Texas Nutrition Education and Training Program. Final Evaluation Report for Federal Fiscal Year 1994.

ERIC Educational Resources Information Center

Ahmad, Mahassen

This report presents federally mandated evaluations and needs assessments conducted by the Texas Nutrition Education and Training (NET) program during Federal Fiscal Year 1994. General program performance of NET reflected an increase in the number of children in Texas and expansion in NET program activities. Needs assessment data collected from…

Physical Activity for Campus Employees: A University Worksite Wellness Program.

PubMed

Butler, Carling E; Clark, B Ruth; Burlis, Tamara L; Castillo, Jacqueline C; Racette, Susan B

2015-04-01

Workplaces provide ideal environments for wellness programming. The purpose of this study was to explore exercise self-efficacy among university employees and the effects of a worksite wellness program on physical activity, cardiorespiratory fitness, and cardiovascular disease (CVD) risk factors. Participants included 121 university employees (85% female). The worksite wellness program included cardiovascular health assessments, personal health reports, 8 weeks of pedometer-based walking and tracking activities, and weekly wellness sessions. Daily step count was assessed at baseline, Week 4, and Week 8. Exercise self-efficacy and CVD risk factors were evaluated at baseline and follow-up. Daily step count increased from 6566 ± 258 (LSM ± SE) at baseline to 8605 ± 356 at Week 4 and 9107 ± 388 at Week 8 (P < .0001). Steps increased among normal weight, overweight, and obese subgroups. Exercise self-efficacy correlated with baseline steps (P < .05). Small improvements were observed in cardiorespiratory fitness, body mass index, blood pressure, blood glucose, total cholesterol, and triglycerides (all P < .01). A worksite wellness program was effective for improving physical activity, cardiorespiratory fitness, and CVD risk factors among university employees. Exercise barriers and outcome expectations were identified and have implications for future worksite wellness programming.

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Workforce Training Program Evaluations.

ERIC Educational Resources Information Center

Washington State Workforce Training and Education Coordinating Board, Olympia.

Three evaluations analyzed program characteristics and participant results in work force education and coordination in Washington State. The Employment Security Department's evaluation of Job Training Partnership Act Titles II and III looked for an association between participant characteristics and the type of training they receive and between…

Criteria for Evaluating Advancement Programs.

ERIC Educational Resources Information Center

Heemann, Warren, Ed.

Criteria for evaluating college and university advancement programs are presented, based on the efforts of professional area trustees and advisory committees of the Council for Advancement and Support of Education (CASE). The criteria can be useful in three ways: as the basis of internal audits of advancement programs or program components; as the…

Evaluation Study of the Exploratory Visit: An Innovative Outreach Activity of the ILGWU's Friendly Visiting Program

ERIC Educational Resources Information Center

Wright, Holly; And Others

1977-01-01

The exploratory visit to recent retirees, an outreach component of the International Ladies Garment Workers Union Friendly Visiting Program, was evaluated. A post-test only control group effect study revealed exploratory visits were effective in establishing a link between the program and the retiree. (Author)

Using a Mixed-Methods RE-AIM Framework to Evaluate Community Health Programs for Older Latinas.

PubMed

Schwingel, Andiara; Gálvez, Patricia; Linares, Deborah; Sebastião, Emerson

2017-06-01

This study used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate a promotora-led community health program designed for Latinas ages 50 and older that sought to improve physical activity, nutrition, and stress management. A mixed-methods evaluation approach was administered at participant and organizational levels with a focus on the efficacy, adoption, implementation, and maintenance components of the RE-AIM theoretical model. The program was shown to be effective at improving participants' eating behaviors, increasing their physical activity levels, and lowering their depressive symptoms. Promotoras felt motivated and sufficiently prepared to deliver the program. Some implementation challenges were reported. More child care opportunities and an increased focus on mental well-being were suggested. The promotora delivery model has promise for program sustainability with both promotoras and participants alike expressing interest in leading future programs.

Lunar Extravehicular Activity Program

NASA Technical Reports Server (NTRS)

Heartsill, Amy Ellison

2006-01-01

Extravehicular Activity (EVA) has proven an invaluable tool for space exploration since the inception of the space program. There are situations in which the best means to evaluate, observe, explore and potentially troubleshoot space systems are accomplished by direct human intervention. EVA provides this unique capability. There are many aspects of the technology required to enable a "miniature spaceship" to support individuals in a hostile environment in order to accomplish these tasks. This includes not only the space suit assembly itself, but the tools, design interfaces of equipment on which EVA must work and the specific vehicles required to support transfer of humans between habitation areas and the external world. This lunar mission program will require EVA support in three primary areas. The first of these areas include Orbital stage EVA or micro-gravity EVA which includes both Low Earth Orbit (LEO), transfer and Lunar Orbit EVA. The second area is Lunar Lander EVA capability, which is lunar surface EVA and carries slightly different requirements from micro-gravity EVA. The third and final area is Lunar Habitat based surface EVA, which is the final system supporting a long-term presence on the moon.

An economic evaluation of public programs for internationalization: the case of the Diagnostic Program in Spain.

PubMed

Cansino, José M; Lopez-Melendo, Jaime; Pablo-Romero, María del P; Sánchez-Braza, Antonio

2013-12-01

This paper evaluates the Diagnostic Program in Spain which is a publicly funded program to promote internationalization of companies located in Andalusia (south of Spain). The methodology used is the propensity score-matching. The treatment group consists of companies which participated in the Program until 2008. The control group has companies which planned to participate in the Program but had not done so up to that date. The response variable measures the ratio of export to total sales for each company. Four covariates have been taken into account: activity, location, sales and number of employees. The analysis leads to the conclusion that the companies that participated in the Program improved their ratio of exports to total sales by about 10 percentage points. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluation of a Dual Bilingual Program: English-Spanish and English-Southeast Asian Languages.

ERIC Educational Resources Information Center

Wheeler, George; And Others

An external evaluation of the Title VII Bilingual Education Program was designed to: (1) gather a subjective assessment from personnel working with the program; (2) observe classroom teaching and activities utilized in bilingual instruction; and (3) measure differences in levels of achievement. The instructional personnel appear to accept the…

Program Evaluation: The Board Game--An Interactive Learning Tool for Evaluators

ERIC Educational Resources Information Center

Febey, Karen; Coyne, Molly

2007-01-01

The field of program evaluation lacks interactive teaching tools. To address this pedagogical issue, the authors developed a collaborative learning technique called Program Evaluation: The Board Game. The authors present the game and its development in this practitioner-oriented article. The evaluation board game is an adaptable teaching tool…

NATIONAL EVALUATION OF THE WEATHERIZATION ASSISTANCE PROGRAM DURING THE ARRA PERIOD: PROGRAM YEARS 2009-2011

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tonn, Bruce Edward; Rose, Erin M; Schmoyer, Richard L

This report describes the third major evaluation of the Program, encompassing program years 2009 to 2011. In this report, this period of time is referred to as the ARRA Period. This is a special period of time for the Program because the American Recovery and Reinvestment Act (ARRA) of 2009 has allocated $5 billion of funding for the Program. In normal program years, WAP s annual appropriation is in the range of $200-250 million, supporting the weatherization of approximately 100,000 homes. With the addition of ARRA funding during these program years, the expectation is that weatherization activity will exceed 300,000more » homes per year. In addition to saving energy and reducing low-income energy bills, expanded WAP funding is expected to stimulate the economy by providing new jobs in the weatherization field and allowing low-income households to spend more money on goods and services by spending less on energy.« less

Evaluation of the Florida coordinated school health program pilot schools project.

PubMed

Weiler, Robert M; Pigg, R Morgan; McDermott, Robert J

2003-01-01

The Florida Department of Education, with CDC funding, designed the Florida Coordinated School Health Program Pilot Schools Project (PSP) to encourage innovative approaches to promote coordinated school health programs (CSHP) in Florida schools. Each of eight pilot schools received $15,000 in project funding, three years of technical assistance including on-site and off-site assistance, a project office resource center, mailings of resource materials, needs assessment and evaluation assistance, and three PSP Summer Institutes. Project evaluators created a context evaluation, approaching each school independently as a "case study" to measure the school's progress in meeting goals established at baseline. Data were collected using the How Healthy is Your School? needs assessment instrument, a School Health Portfolio constructed by each school team, a Pilot Schools Project Team Member Survey instrument, midcourse team interviews, final team interviews, and performance indicator data obtained from pilot and control schools. The PSP posed two fundamental questions: "Can financial resources, professional training, and technical assistance enable individual schools to create and sustain a coordinated school health program?" and "What outcomes reasonably can one expect from a coordinated school health program, assuming programs receive adequate support over time?" First, activities at the eight schools confirmed that a coordinated school health programs can be established and sustained. Program strength and sustainability depend on long-term resources, qualified personnel, and administrative support. Second, though coordinated school health programs may improve school performance indicators, the PSP yielded insufficient evidence to support that belief. Future projects should include robust measurement and evaluation designs, thereby producing conclusive evidence about the influence of a coordinated school health program on such outcomes.

Evaluation Project of a Postvention Program.

ERIC Educational Resources Information Center

Simon, Robert; And Others

A student suicide or parasuicide increases the risk that potentially suicidal teenagers see suicide as an enviable option. The "copycat effect" can be reduced by a postvention program. This proposed evaluative research project will provide an implementation and impact evaluation of a school's postvention program following a suicide or…

Multiple Activities Program: An Evaluation. ESEA Title I, September 1971 to August 1972.

ERIC Educational Resources Information Center

Texley, Lloyd C.; And Others

The multiple activities funded under Title I of the 1965 Elementary Secondary Education Act had two purposes. First, they supplemented the instructional program for educationally disadvantaged children by developing a curriculum and techniques which would raise their achievement level commensurate with their ability. Second, they supported this…

The Use of Multiple Evaluation Approaches in Program Evaluation

ERIC Educational Resources Information Center

Bledsoe, Katrina L.; Graham, James A.

2005-01-01

The authors discuss the use of multiple evaluation approaches in conducting program evaluations. Specifically, they illustrate four evaluation approaches (theory-driven, consumer-based, empowerment, and inclusive evaluation) and briefly discuss a fifth (use-focused evaluation) as a side effect of the use of the others. The authors also address the…

Evaluation of a Bullying Prevention Program

ERIC Educational Resources Information Center

Hallford, Abby; Borntrager, Cameo; Davis, Joanne L.

2006-01-01

In order to address the federal "No Child Left Behind Act", the state of Oklahoma required that all public schools address the problem of bullying. Although numerous anti-bullying programs exist, few have been evaluated to determine their effectiveness. The present study evaluated the effectiveness of one such program,…

Evaluation of the Brownfields Program

EPA Pesticide Factsheets

The Evaluation of 2003-2008 Brownfields Assessment, Revolving Loan Fund, and Cleanup Grants is the first national program evaluation of the outcomes, efficiencies, and economic benefits produced by Brownfields grants.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

ERIC Educational Resources Information Center

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Impact of activities in self-esteem of patients in a pulmonary rehabilitation program

PubMed Central

de Oliveira, Juliana Nascimento; Tavares, Cecilia Melo Rosa; Squassoni, Selma Denis; Machado, Nadine Cristina; Cordoni, Priscila Kessar; Bortolassi, Luciene Costa; Lapa, Mônica Silveira; Fiss, Elie

2015-01-01

Objective To evaluate self-esteem and self-image of respiratory diseases patients in a Pulmonary Rehabilitation Program, who participated in socialization and physical fitness activities, and of patients who participated only in physical fitness sessions. Methods A descriptive cross-sectional exploratory study. Out of a total of 60 patients analyzed, all enrolled in the Pulmonary Rehabilitation Program, 42 participated in at least one of the proposed activities, 10 did not participate in any activity and 8 were excluded (7 were discharged and 1 died). Results When the two groups were compared, despite the fact that both demonstrated low self-esteem and self-image, the difference between them was relevant (p<0.05) regarding self-esteem, indicating that those who participated in the proposed socialization activities had better self-esteem than the individuals who only did the physical fitness sessions. Regarding self-image, the difference between the groups was not relevant (p>0.05). Conclusion The Pulmonary Rehabilitation Program patients evaluated presented low self-esteem and self-image; however, those carrying out some socialization activity proposed had better self-esteem as compared to the individuals who did only the physical fitness sessions. PMID:25993068

Cost Analysis for Educational Program Evaluation.

ERIC Educational Resources Information Center

Haller, Emil J.

Concerned with the problem of determining program costs as part of the evaluation process, this article helps the practitioner arrive at useful conceptions of the term "cost" and procedures for assessing the costs of an educational program. Its purpose is to help design costing procedures for evaluation situations that are commonly encountered. An…

Evaluation tools for undergraduate program planning in times of financial austerity.

PubMed

O'Palka, J; Harris, P R

1990-05-01

This article describes the administration and outcome of two evaluation tools developed by faculty of the dietetic program for ongoing assessment of a Plan IV dietetic education program over a 4-year period. Interns and internship directors were asked to evaluate the level of skills and knowledge base of interns compared with their internship classmates. Interns were also asked to rate the effectiveness of undergraduate course assignments and activities for internship preparation. As a result of the surveys, the home economics core course work was deleted, credits were shifted from food science to nutrient metabolism courses, and credits in clinical nutrition were increased. Projects in clinical nutrition and food systems management were modified. The surveys justified program requirements and utilization of resources, and provided an additional, effective measure of faculty competence.

Apollo Photograph Evaluation (APE) programming manual

NASA Technical Reports Server (NTRS)

Kim, I. J.

1974-01-01

This document describes the programming techniques used to implement the equations of the Apollo Photograph Evaluation (APE) program on the UNIVAC 1108 computer and contains detailed descriptions of the program structure, a User's Guide section to provide the necessary information for proper operation of the program, and information for the assessment of the program's adaptability to future problems.

45 CFR 2516.820 - What types of internal evaluation activities are required of programs?

Code of Federal Regulations, 2011 CFR

2011-10-01

... required to: (a) Continuously assess management effectiveness, the quality of services provided, and the... evaluation methods, such as community advisory councils, participant advisory councils, peer reviews, quality... following data: (1) The total number of participants in each program and basic demographic characteristics...

'Physical activity at home (PAAH)', evaluation of a group versus home based physical activity program in community dwelling middle aged adults: rationale and study design.

PubMed

Freene, Nicole; Waddington, Gordon; Chesworth, Wendy; Davey, Rachel; Goss, John

2011-11-24

It is well recognised that the adoption and longer term adherence to physical activity by adults to reduce the risk of chronic disease is a challenge. Interventions, such as group and home based physical activity programs, have been widely reported upon. However few studies have directly compared these interventions over the longer term to determine their adherence and effectiveness. Participant preference for home based or group interventions is important. Some evidence suggests that home based physical activity programs are preferred by middle aged adults and provide better long term physical activity adherence. Physiotherapists may also be useful in increasing physical activity adherence, with limited research on their impact. 'Physical Activity at Home' is a 2 year pragmatic randomised control trial, with a non-randomised comparison to group exercise. Middle-aged adults not interested in, or unable to attend, a group exercise program will be targeted. Sedentary community dwelling 50-65 year olds with no serious medical conditions or functional impairments will be recruited via two mail outs using the Australian federal electoral roll. The first mail out will invite participants to a 6 month community group exercise program. The second mail out will be sent to those not interested in the group exercise program inviting them to take part in a home based intervention. Eligible home based participants will be randomised into a 6 month physiotherapy-led home based physical activity program or usual care. Outcome measures will be taken at baseline, 6, 12, 18 and 24 months. The primary outcome is physical activity adherence via exercise diaries. Secondary outcomes include the Active Australia Survey, accelerometry, aerobic capacity (step test), quality of life (SF-12v2), blood pressure, waist circumference, waist-to-hip ratio and body mass index. Costs will be recorded prospectively and qualitative data will be collected. The planned 18 month follow-up post

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

ERIC Educational Resources Information Center

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Status report: Data management program algorithm evaluation activity at Marshall Space Flight Center

NASA Technical Reports Server (NTRS)

Jayroe, R. R., Jr.

1977-01-01

An algorithm evaluation activity was initiated to study the problems associated with image processing by assessing the independent and interdependent effects of registration, compression, and classification techniques on LANDSAT data for several discipline applications. The objective of the activity was to make recommendations on selected applicable image processing algorithms in terms of accuracy, cost, and timeliness or to propose alternative ways of processing the data. As a means of accomplishing this objective, an Image Coding Panel was established. The conduct of the algorithm evaluation is described.

Activity computer program for calculating ion irradiation activation

NASA Astrophysics Data System (ADS)

Palmer, Ben; Connolly, Brian; Read, Mark

2017-07-01

A computer program, Activity, was developed to predict the activity and gamma lines of materials irradiated with an ion beam. It uses the TENDL (Koning and Rochman, 2012) [1] proton reaction cross section database, the Stopping and Range of Ions in Matter (SRIM) (Biersack et al., 2010) code, a Nuclear Data Services (NDS) radioactive decay database (Sonzogni, 2006) [2] and an ENDF gamma decay database (Herman and Chadwick, 2006) [3]. An extended version of Bateman's equation is used to calculate the activity at time t, and this equation is solved analytically, with the option to also solve by numeric inverse Laplace Transform as a failsafe. The program outputs the expected activity and gamma lines of the activated material.

The Role of Evaluation and Plans for Evaluating the Current Testing Program.

ERIC Educational Resources Information Center

Winters, Lynn

The Palos Verdes Peninsula Unified School District Office of Program Evaluation and Research is responsible for providing information for program development and improvement; providing test information to special programs coordinators; and acting as a clearinghouse for all information concerning tests, evaluation methodology, and educational…

Physical activity for campus employees: a university worksite wellness program

PubMed Central

Butler, Carling E.; Clark, B. Ruth; Burlis, Tamara L.; Castillo, Jacqueline C.; Racette, Susan B.

2014-01-01

Background Workplaces provide ideal environments for wellness programming. The purpose of this study was to explore exercise self-efficacy among university employees and the effects of a worksite wellness program on physical activity, cardiorespiratory fitness, and CVD risk factors. Methods Participants included 121 university employees (85% female). The worksite wellness program included cardiovascular health assessments, personal health reports, 8 weeks of pedometer-based walking and tracking activities, and weekly wellness sessions. Daily step count was assessed at baseline, week 4, and week 8. Exercise self-efficacy and CVD risk factors were evaluated at baseline and follow-up. Results Daily step count increased from 6566 ± 258 (LSM ± SE) at baseline to 8605 ± 356 at week 4 and 9107 ± 388 at week 8 (P < .0001). Steps increased among normal weight, overweight, and obese sub-groups. Exercise self-efficacy correlated with baseline steps (P < .05). Small improvements were observed in cardiorespiratory fitness, BMI, blood pressure, blood glucose, total cholesterol, and triglycerides (all P < .01). Conclusions A worksite wellness program was effective for increasing physical activity, cardiorespiratory fitness, and CVD risk factors among university employees. Exercise barriers and outcome expectations were identified and have implications for future worksite wellness programming. PMID:24905703

Study protocol: translating and implementing psychosocial interventions in aged home care the lifestyle engagement activity program (LEAP) for life

PubMed Central

2013-01-01

Background Tailored psychosocial activity-based interventions have been shown to improve mood, behaviour and quality of life for nursing home residents. Occupational therapist delivered activity programs have shown benefits when delivered in home care settings for people with dementia. The primary aim of this study is to evaluate the effect of LEAP (Lifestyle Engagement Activity Program) for Life, a training and practice change program on the engagement of home care clients by care workers. Secondary aims are to evaluate the impact of the program on changes in client mood and behaviour. Methods/design The 12 month LEAP program has three components: 1) engaging site management and care staff in the program; 2) employing a LEAP champion one day a week to support program activities; 3) delivering an evidence-based training program to care staff. Specifically, case managers will be trained and supported to set meaningful social or recreational goals with clients and incorporate these into care plans. Care workers will be trained in and encouraged to practise good communication, promote client independence and choice, and tailor meaningful activities using Montessori principles, reminiscence, music, physical activity and play. LEAP Champions will be given information about theories of organisational change and trained in interpersonal skills required for their role. LEAP will be evaluated in five home care sites including two that service ethnic minority groups. A quasi experimental design will be used with evaluation data collected four times: 6-months prior to program commencement; at the start of the program; and then after 6 and 12 months. Mixed effect models will enable comparison of change in outcomes for the periods before and during the program. The primary outcome measure is client engagement. Secondary outcomes for clients are satisfaction with care, dysphoria/depression, loneliness, apathy and agitation; and work satisfaction for care workers. A process

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

PubMed

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

A Beginner's Sequence of Programming Activities.

ERIC Educational Resources Information Center

Slesnick, Twila

1984-01-01

Presents various programing activities using the BASIC and LOGO programing languages. Activities are included in separate sections with a title indicating the nature of the activities and the "tools" (commands) needed. For example, "Old-fashioned drawing" requires several tools (PRINT, LIST, RUN, GOTO) to make drawings using…

22 CFR 146.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false Education programs or activities. 146.400... IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 146.400 Education programs or activities...

49 CFR 25.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 1 2011-10-01 2011-10-01 false Education programs or activities. 25.400 Section... IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 25.400 Education programs or activities...

22 CFR 146.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Education programs or activities. 146.400... IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 146.400 Education programs or activities...

49 CFR 25.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 1 2010-10-01 2010-10-01 false Education programs or activities. 25.400 Section... IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 25.400 Education programs or activities...

Program Theory and Quality Matter: Changing the Course of Extension Program Evaluation

ERIC Educational Resources Information Center

Arnold, Mary E.; Cater, Melissa

2016-01-01

As internal evaluators for the 4-H program in two states, we simultaneously yet independently began to change the way we approached our evaluation practices, turning from evaluation capacity building (ECB) efforts that prepared educators to define and measure program outcomes to strategies that engage educators in defining and measuring program…

Evaluating Federal Social Programs: An Uncertain Act.

ERIC Educational Resources Information Center

Levitan, Sar A.; Wurzburg, Gregory K.

This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

28 CFR 54.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 2 2011-07-01 2011-07-01 false Education programs or activities. 54.400... SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 54.400 Education programs or activities...

22 CFR 229.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false Education programs or activities. 229.400... SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 229.400 Education programs or activities...

22 CFR 229.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Education programs or activities. 229.400... SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 229.400 Education programs or activities...

10 CFR 1042.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Education programs or activities. 1042.400 Section 1042... EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 1042.400 Education programs or activities. (a...

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

The CEMHaVi program: control, evaluation, and modification of lifestyles in obese youth.

PubMed

Vanhelst, Jérémy; Marchand, Frédéric; Fardy, Paul; Zunquin, Gautier; Loeuille, Guy-André; Renaut, Hervé; Mikulovic, Jacques; Hurdiel, Rémy; Béghin, Laurent; Theunynck, Denis

2010-01-01

Obesity in children has increased in recent years. Many studies with differing methodologies have been undertaken to treat obesity. The Control, Evaluation, and Modification of Lifestyles in Obese Youth (CEMHaVi) program is a unique 2-year health-wellness program of physical activity and health education for obese youth. Findings of this study represent results at 1-year follow-up. The purpose of this study was to evaluate the effects of the CEMHaVi program. Physician-referred subjects (N = 26) participated in the study, 14 girls (13.4 +/- 2.9 years) and 12 boys (12.3 +/- 2.8 years). Measurements included height, weight, body mass index (BMI), academic performance, sleep habits, and health knowledge. The intervention consisted of a unique program of physical activity, including a variety of games specifically selected to be enjoyable, maintain interest, and motivate subjects to adhere. Activity sessions were offered once per week, 2 hours each session, for 12 months. A health education program was offered once every 3 months for 2 hours per session. Health knowledge, academic performance, self-esteem, and sleep were assessed before and after the intervention. Means were calculated at baseline and following intervention and were compared by paired t tests. Findings suggest significant improvements in academic performance (P < .001), quality and quantity of sleep (P < .05), and obesity (P < .05). The program reduced BMI and improved health knowledge, sleep, and academic performance in obese children. The feasibility of a beneficial lifestyle intervention program is encouraging in addressing obesity and related issues in young boys and girls.

Programs and promotions: approaches by 25 Active Living by Design partnerships.

PubMed

Claus, Julie M; Dessauer, Mark; Brennan, Laura K

2012-11-01

From 2003 to 2008, a total of 25 community partnerships funded through Active Living by Design (ALbD) implemented physical activity programs and promotions as part of integrated approaches complementing policy and environment changes. This paper reviews the partnerships' efforts with respect to promotions and programs, the breadth and depth of these types of approaches, challenges, successes, and lessons learned. Through a mixed-methods approach, including interviews, focus groups, and web-based tracking, multiple sources of data were collected and analyzed from 2006 to 2010. Evaluators summarized quantitative data by counts or means and qualitative results using systematic coding procedures to identify themes, ideas, and concepts. All 25 community partnerships were engaged in programs and promotions of varying degrees throughout the initiative. Programs were categorized as community walking and biking programs, school programs, afterschool programs, and worksite programs, among others. Promotional strategies were categorized as social marketing campaigns, media, events, and communications. The most common programs included Safe Routes to School, walking clubs, and Bike/Walk to School Day. Media efforts were undertaken by all 25 partnerships, totaling 2659 TV, newspaper, and radio hits. Programs and promotions can be resource-intensive and have limited population impact when offered in isolation; however, these strategies help connect people to their environments (e.g., increase awareness of facilities, provide social support for use of facilities) in order to improve physical activity behaviors. Copyright © 2012 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Evaluating the Functional Utility of Congregate Day Treatment Activities for Adults with Severe Disabilities.

ERIC Educational Resources Information Center

Reid, Dennis H.; Parsons, Marsha B.; Green, Carolyn W.

2001-01-01

Observations in 100 congregated community and institutional day-program sites for individuals with severe disabilities indicated that approximately half of consumer time was spent in purposeful activity, 75 percent of which was age-appropriate. In 20 percent of the sites most activity was age-inappropriate. Recommended program evaluation and…

Strategies for Evaluating a Freshman Studies Program.

ERIC Educational Resources Information Center

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Cognitive stimulation in healthy older adults: a cognitive stimulation program using leisure activities compared to a conventional cognitive stimulation program.

PubMed

Grimaud, Élisabeth; Taconnat, Laurence; Clarys, David

2017-06-01

The aim of this study was to compare two methods of cognitive stimulation for the cognitive functions. The first method used an usual approach, the second used leisure activities in order to assess their benefits on cognitive functions (speed of processing; working memory capacity and executive functions) and psychoaffective measures (memory span and self esteem). 67 participants over 60 years old took part in the experiment. They were divided into three groups: 1 group followed a program of conventional cognitive stimulation, 1 group a program of cognitive stimulation using leisure activities and 1 control group. The different measures have been evaluated before and after the training program. Results show that the cognitive stimulation program using leisure activities is as effective on memory span, updating and memory self-perception as the program using conventional cognitive stimulation, and more effective on self-esteem than the conventional program. There is no difference between the two stimulated groups and the control group on speed of processing. Neither of the two cognitive stimulation programs provides a benefit over shifting and inhibition. These results indicate that it seems to be possible to enhance working memory and to observe far transfer benefits over self-perception (self-esteem and memory self-perception) when using leisure activities as a tool for cognitive stimulation.

Faculty Development at One Midwestern Dental School: A Program Evaluation.

PubMed

Gadbury-Amyot, Cynthia C; Smith, Deborah B; Overman, Pamela R; Bunce, Larry

2015-10-01

Most dental school faculty members arrive on campus with a wealth of clinical experience but little to no teacher training. For the past two decades, there has been a call for schools to educate their faculty on a wide variety of topics including educational methodology and cutting-edge educational techniques through faculty development programs. Drawing on theories of general program evaluation as well as evaluation specific to educational programming, the aim of this study was to investigate outcomes of the Faculty Development Program at the University of Missouri-Kansas City School of Dentistry between 2007 and 2014. A mixed-methods research design gathered quantitative data via email survey sent to all eligible teaching faculty members; it received an overall response rate of 54% (N=51). Qualitative data came from open-ended survey questions and a focus group with seven volunteer faculty participants. The survey data suggested that the stated outcomes of faculty development were being met for all stakeholder groups with varying degrees of success. Focus group results indicated a need for a more formal new faculty orientation and better communication with all about the specific charge of faculty development within the school. Evaluation of faculty development activities in academic dental institutions is a necessary component of the ongoing improvement of dental education. Suggestions for future evaluations include the idea of collaborating with other dental schools to increase sample sizes, which would increase participants' perception of the level of confidentiality and make statistical analyses more robust.

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

MRM Evaluation Research Program

NASA Technical Reports Server (NTRS)

Taylor, James C.

1998-01-01

This is an interim report on the current output of the MRM evaluation research program. During 1998 this research program has used new and existing data to create an important tool for the development and improvement of "maintenance resource management" (MRM). Thousands of surveys completed by participants in airline MRM training and/or behavior change programs have, for the first time, been consolidated into a panel of "MRM Attitudes and Opinion Profiles." These profiles can be used to compare the attitudes about decision making and communication in any given company at any stage in its MRM program with attitudes of a large sample of like employees during a similar period in their MRM involvement. This panel of comparison profiles for attitudes and opinions is a tool to help audit the effectiveness of a maintenance human factors program. The profile panel is the first of several tools envisioned for applying the information accumulating in MRM databases produced as one of the program's long range objectives.

A physical activity program to mobilize older people: a practical and sustainable approach.

PubMed

Jancey, Jonine M; Clarke, Ann; Howat, Peter A; Lee, Andy H; Shilton, Trevor; Fisher, John

2008-04-01

Despite the documented benefits of physical activity, it remains difficult to motivate older adults to start and maintain regular physical activity. This study tested an innovative intervention for mobilizing older adults into a neighborhood-based walking program. Researchers recruited a total of 260 healthy but insufficiently active adults aged 65 to 74 years and randomly selected from the Australian electoral roll from 30 Perth metropolitan neighborhoods. Social cognitive theory guided the design of the program. Researchers collected both qualitative and quantitative data to inform the development, together with ongoing process evaluation. A total of 65% of participants completed the program. Their mean weekly walking time for recreation increased by about 100 min, and 80% of participants reported that they would continue to walk twice per week upon program completion. This practical program is potentially effective and sustainable with respect to mobilizing physically inactive older people.

Evaluating Voucher Programs: The Milwaukee Parental Choice Program

ERIC Educational Resources Information Center

Witte, John F.

2016-01-01

This paper is the first summary of two studies and 10 years of evaluating the Milwaukee Parental Choice (voucher) Program (MPCP). This paper discusses school voucher evaluations in general terms and how these studies are carried out. The paper outlines the types of studies completed in "Study I" and "Study II" and the results…

Handbook of evaluation of utility DSM programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hirst, E.; Reed, J.; Bronfman, B.

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough tomore » highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.« less

Human Services Program Evaluation: "How to Improve Your Accountability and Program Effectiveness"

ERIC Educational Resources Information Center

Barrett, Thomas; Sorensen, James

2015-01-01

The term "outcome evaluation" has become one of the most popular terms among human service providers and those whose job it is to evaluate the impact of human service programs. In the public sector alone, there are over a hundred instruments in use to evaluate the impact of state human service programs. Most states, many providers, and…

Testing of a Program Evaluation Model: Final Report.

ERIC Educational Resources Information Center

Nagler, Phyllis J.; Marson, Arthur A.

A program evaluation model developed by Moraine Park Technical Institute (MPTI) is described in this report. Following background material, the four main evaluation criteria employed in the model are identified as program quality, program relevance to community needs, program impact on MPTI, and the transition and growth of MPTI graduates in the…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

ERIC Educational Resources Information Center

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

The Nursing Leadership Institute program evaluation: a critique

PubMed Central

Havaei, Farinaz; MacPhee, Maura

2015-01-01

A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses’ union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? PMID:29355180

Validation of a proposal for evaluating hospital infection control programs.

PubMed

Silva, Cristiane Pavanello Rodrigues; Lacerda, Rúbia Aparecida

2011-02-01

To validate the construct and discriminant properties of a hospital infection prevention and control program. The program consisted of four indicators: technical-operational structure; operational prevention and control guidelines; epidemiological surveillance system; and prevention and control activities. These indicators, with previously validated content, were applied to 50 healthcare institutions in the city of São Paulo, Southeastern Brazil, in 2009. Descriptive statistics were used to characterize the hospitals and indicator scores, and Cronbach's α coefficient was used to evaluate the internal consistency. The discriminant validity was analyzed by comparing indicator scores between groups of hospitals: with versus without quality certification. The construct validity analysis was based on exploratory factor analysis with a tetrachoric correlation matrix. The indicators for the technical-operational structure and epidemiological surveillance presented almost 100% conformity in the whole sample. The indicators for the operational prevention and control guidelines and the prevention and control activities presented internal consistency ranging from 0.67 to 0.80. The discriminant validity of these indicators indicated higher and statistically significant mean conformity scores among the group of institutions with healthcare certification or accreditation processes. In the construct validation, two dimensions were identified for the operational prevention and control guidelines: recommendations for preventing hospital infection and recommendations for standardizing prophylaxis procedures, with good correlation between the analysis units that formed the guidelines. The same was found for the prevention and control activities: interfaces with treatment units and support units were identified. Validation of the measurement properties of the hospital infection prevention and control program indicators made it possible to develop a tool for evaluating these programs

A Final Report for the Evaluation of the Achieve3000 Programs

ERIC Educational Resources Information Center

Shannon, Lisa; Grant, Billie-Jo

2015-01-01

Achieve3000 publishes a number of online literacy programs that differentiate lessons and activities based on student performance. Magnolia Consulting--an independent, third party evaluation firm--assessed Achieve3000 Solutions' impact on student learning during the 2014-15 school year. The researchers used a randomized control trial, where…

5 CFR 339.205 - Medical evaluation programs.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 5 Administrative Personnel 1 2013-01-01 2013-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

5 CFR 339.205 - Medical evaluation programs.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 5 Administrative Personnel 1 2014-01-01 2014-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

5 CFR 339.205 - Medical evaluation programs.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 5 Administrative Personnel 1 2011-01-01 2011-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

Second NBL measurement evaluation program meeting: A summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

Spaletto, M.I.; Clapper, M.; Tolbert, M.E.M.

New Brunswick Laboratory (NBL), the US government`s nuclear materials measurements and reference materials laboratory, administers interlaboratory measurement evaluation programs to evaluate the quality and adequacy of safeguards measurements. The NBL Measurement Evaluation Program covers several types of safeguards analytical measurements. The Safeguards Measurement Evaluation (SME) program distributes test materials destructive measurements of uranium for both elemental concentration and isotopic abundances, and of plutonium for isotopic abundances. The Calorimetry Exchange (CalEx) Program tests the quality of nondestructive measurements of plutonium isotopic abundances by gamma spectroscopy and plutonium concentration by calorimetry. In May 1997, more than 30 representatives from the Department ofmore » Energy (DOE), its contractor laboratories, and Nuclear Regulatory Commission licensees met at NBL in Argonne, Illinois, for the annual meeting of the Measurement Evaluation Program. The summary which follows details key points that were discussed or presented at the meeting.« less

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Curated Collections for Educators: Five Key Papers about Program Evaluation.

PubMed

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Curated Collections for Educators: Five Key Papers about Program Evaluation

PubMed Central

Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-01-01

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

Activity-Centric Approach to Distributed Programming

NASA Technical Reports Server (NTRS)

Levy, Renato; Satapathy, Goutam; Lang, Jun

2004-01-01

The first phase of an effort to develop a NASA version of the Cybele software system has been completed. To give meaning to even a highly abbreviated summary of the modifications to be embodied in the NASA version, it is necessary to present the following background information on Cybele: Cybele is a proprietary software infrastructure for use by programmers in developing agent-based application programs [complex application programs that contain autonomous, interacting components (agents)]. Cybele provides support for event handling from multiple sources, multithreading, concurrency control, migration, and load balancing. A Cybele agent follows a programming paradigm, called activity-centric programming, that enables an abstraction over system-level thread mechanisms. Activity centric programming relieves application programmers of the complex tasks of thread management, concurrency control, and event management. In order to provide such functionality, activity-centric programming demands support of other layers of software. This concludes the background information. In the first phase of the present development, a new architecture for Cybele was defined. In this architecture, Cybele follows a modular service-based approach to coupling of the programming and service layers of software architecture. In a service-based approach, the functionalities supported by activity-centric programming are apportioned, according to their characteristics, among several groups called services. A well-defined interface among all such services serves as a path that facilitates the maintenance and enhancement of such services without adverse effect on the whole software framework. The activity-centric application-program interface (API) is part of a kernel. The kernel API calls the services by use of their published interface. This approach makes it possible for any application code written exclusively under the API to be portable for any configuration of Cybele.

Miramar College Program Evaluation: Aviation Maintenance.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in aviation maintenance. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent…

Evaluating Math Drill and Practice Programs.

ERIC Educational Resources Information Center

Schnorr, Janice M.; Semmel, Dorothy S.

1986-01-01

General guidelines for a process evaluation of software for a specific subject and grade include: (1) Specify instructional objectives and list desired software program characteristics; (2) Access and review descriptions of programs (information sources for math programs are listed); (3) Preview software; and (4) Compare and make purchase…

Qualitative evaluation: A critical and interpretative complementary approach to improve health programs and services

PubMed Central

Tayabas, Luz María Tejada; León, Teresita Castillo; ESPINO, JOEL MONARREZ

2014-01-01

This short essay aims at commenting on the origin, development, rationale, and main characteristics of qualitative evaluation (QE), emphasizing the value of this methodological tool to evaluate health programs and services. During the past decades, different approaches have come to light proposing complementary alternatives to appraise the performance of public health programs, mainly focusing on the implementation process involved rather than on measuring the impact of such actions. QE is an alternative tool that can be used to illustrate and understand the process faced when executing health programs. It can also lead to useful suggestions to modify its implementation from the stakeholders’ perspectives, as it uses a qualitative approach that considers participants as reflective subjects, generators of meanings. This implies that beneficiaries become involved in an active manner in the evaluated phenomena with the aim of improving the health programs or services that they receive. With this work we want to encourage evaluators in the field of public health to consider the use of QE as a complementary tool for program evaluation to be able to identify areas of opportunity to improve programs’ implementation processes from the perspective of intended beneficiaries. PMID:25152220

["StigMa" - Evaluation of a Psychological Therapy Program for Stigma-Management].

PubMed

Schenner, Manuela; Kohlbauer, Daniela; Meise, Ullrich; Haller, Christina; Pixner-Huber, Martina; Stürz, Kristina; Günther, Verena

2018-01-01

The project "Stigma Management - StigMa" aims on the evaluation of an adaptive therapy program for patients with psychiatric illness to help them in managing internalized stigma and self-stigmatization. The patients for this pilot-study were recruited in day-hospitals of pro mente tirol . 26 patients participated in 11 group sessions, following 6 modules: "Education", "Activation of Resources", "Social Network", "Self-Esteem", "Social competence in public places" and "My personal stigma management". The control group consisted of 20 patients who did not participate in StigMa. Pre-post-evaluation was done by the Internalized Stigma of Mental Illness-Scale 1. No significant interaction effects could be observed, although in the treatment group, the burden of perceived discrimination was significantly less pronounced after training than before it. The program, however, was evaluated as being extremely positive by the participants. The program StigMa will be adapted in accordance with the suggestions of the participants and reevaluated taking into consideration methodological optimization. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluation of a rural chronic disease self-management program.

PubMed

Stone, Genevieve R; Packer, Tanya L

2010-01-01

Internationally, the prevalence of long-term health conditions is at epidemic proportions. Australia is no exception. The Australian Government's 'Better Health Initiative' has 5 key strategies to build better health care, one of which is the adoption of self-management and self-management support. Self-management allows people to manage their condition and the consequences it brings to their lives in partnership with their health providers. The purpose of this article was to report both the process and patient outcomes following the introduction of the Stanford Chronic Disease Self-Management Program (CDSMP) into an existing service in an Australian rural setting. Implementation processes were evaluated using semi-structured interviews conducted with managers, lay and health professional course leaders and participants about positive and negative aspects of providing the CDSMP. Participant outcomes were evaluated using a modified pre-test, post-test design to evaluate changes in activity participation and self-management knowledge and skills. Both negative and positive aspects of providing the program were represented by two key themes: (1) program content and quality; and (2) logistics of delivery. Throughout the interviews, managers and leaders, and course participants offered recommendations that were thematically grouped into 3 categories: (1) enhancing quality; (2) improving the logistics; and (3) providing resources. Comparison of activity levels with a community sample indicated that participants had significantly decreased participation levels. Scores on the Health Education Impact Questionnaire v2 (heiQ - RETRO) demonstrated statistically better scores at post-test on the domains of 'self monitoring', 'insight' and 'health service navigation' with a trend towards significance on 3 other domains. Future implementation of CDSMPs in rural areas will be encouraged by these patient outcomes, and informed by the qualitative findings from managers, leaders and

40 CFR 5.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 1 2011-07-01 2011-07-01 false Education programs or activities. 5.400... BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 5.400 Education programs or...

14 CFR 1253.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 5 2011-01-01 2010-01-01 true Education programs or activities. 1253.400... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 1253.400 Education programs...

43 CFR 41.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 43 Public Lands: Interior 1 2011-10-01 2011-10-01 false Education programs or activities. 41.400... BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 41.400 Education programs or...

14 CFR 1253.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 5 2010-01-01 2010-01-01 false Education programs or activities. 1253.400... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 1253.400 Education programs...

7 CFR 3405.22 - Evaluation of program.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

7 CFR 3405.22 - Evaluation of program.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 15 2012-01-01 2012-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

7 CFR 3405.22 - Evaluation of program.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 15 2013-01-01 2013-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

7 CFR 3405.22 - Evaluation of program.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 15 2014-01-01 2014-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

Miramar College Program Evaluation: Criminal Justice.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in criminal justice. The report first outlines the information gathered in an interview with the program chairperson, conducted to determine program objectives and goals and how they were determined,…

Miramar College Program Evaluation: Fire Science.

ERIC Educational Resources Information Center

Moriyama, Bruce; Brumley, Leslie

Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in fire sciences. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent to…

Evaluating the High School Lunar Research Projects Program

NASA Astrophysics Data System (ADS)

Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.

2012-12-01

The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA's Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA's and NLSI's objective to train the next generation of scientists, CLSE's High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 140 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research. Three instruments have been developed or modified to evaluate the extent to which the High School Lunar Research Projects meets its objectives. These three instruments measure changes in student views of the nature of science, attitudes towards science and science careers, and knowledge of lunar science. Exit surveys for teachers, students, and mentors were also developed to elicit general feedback about the program and its impact. The nature of science

A Pilot Evaluation of an Art Therapy Program for Refugee Youth from Burma

ERIC Educational Resources Information Center

Kowitt, Sarah Dorothy; Emmerling, Dane; Gavarkavich, Diane; Mershon, Claire-Helene; Linton, Kristin; Rubesin, Hillary; Agnew-Brune, Christine; Eng, Eugenia

2016-01-01

Art therapy is a promising form of therapy to address mental health concerns for refugee youth. This article describes the development and implementation of a pilot evaluation of an art therapy program for refugee adolescents from Burma currently living in the United States. Evaluation activities were based on the Centers for Disease Control and…

45 CFR 86.31 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 1 2011-10-01 2011-10-01 false Education programs or activities. 86.31 Section 86... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 86.31 Education programs or...

6 CFR 17.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 6 Domestic Security 1 2011-01-01 2011-01-01 false Education programs or activities. 17.400 Section... ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 17.400 Education programs or...

31 CFR 28.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 31 Money and Finance: Treasury 1 2011-07-01 2011-07-01 false Education programs or activities. 28... NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 28.400 Education programs or...

45 CFR 618.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Education programs or activities. 618.400 Section... NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 618.400 Education programs or...

31 CFR 28.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 31 Money and Finance: Treasury 1 2010-07-01 2010-07-01 false Education programs or activities. 28... NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 28.400 Education programs or...

6 CFR 17.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 6 Domestic Security 1 2010-01-01 2010-01-01 false Education programs or activities. 17.400 Section... ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 17.400 Education programs or...

Exergaming for health: a community-based pediatric weight management program using active video gaming.

PubMed

Christison, Amy; Khan, Huma Ali

2012-04-01

To evaluate the efficacy and feasibility of a multifaceted, community-based weight intervention program for children using exergaming technology (activity-promoting video gaming). This is a prospective observational pilot study. Forty-eight children, between the ages of 8 and 16 years, who are overweight or obese, enrolled in Exergaming for Health, a multidisciplinary weight management program, which used active video gaming. Primary outcome measures were change in body mass index (BMI) z scores. Most children (n = 40, 83%) completed the program and participated in outcome evaluations. The average BMI change was -0.48 kg/m(2) (SD = 0.93), P < .002 (BMI z-score change was -0.072, SD = 0.14, P < .0001). The average Global Self-Worth score improved, screen time and soda intake reduced, and exercise hours per week increased. The Exergaming for Health program may be an effective weight management intervention that is feasible with high participation rates. A larger randomized controlled trial is needed to confirm these results.

Creating an Information Literacy Badges Program in Blackboard: A Formative Program Evaluation

ERIC Educational Resources Information Center

Tunon, Johanna; Ramirez, Laura Lucio; Ryckman, Brian; Campbell, Loy; Mlinar, Courtney

2015-01-01

A formative program evaluation using Stufflebeam's (2010) Context, Input, Process, Product (CIPP) model was conducted to assess the use of digital badges for tracking basic library instructional skills across academic programs at Nova Southeastern University. Based on the evaluation of pilot library modules and Blackboard Learn's badges…

The Educational Predicament Confronting Taiwan's Gifted Programs: An Evaluation of Current Practices and Future Challenges

ERIC Educational Resources Information Center

Kao, Chen-yao

2012-01-01

This study examines the current problems affecting Taiwan's gifted education through a large-scale gifted program evaluation. Fifty-one gifted classes at 15 elementary schools and 62 gifted classes at 18 junior high schools were evaluated. The primary activities included in this biennial evaluation were document review, observation of…

A framework for evaluating national space activity

NASA Astrophysics Data System (ADS)

Wood, Danielle; Weigel, Annalisa

2012-04-01

Space technology and resources are used around the world to address societal challenges. Space provides valuable satellite services, unique scientific discoveries, surprising technology applications and new economic opportunities. Many developing countries formally recognize the advantages of space resources and pursue national level activity to harness them. There is limited data or documentation on the space activities of developing countries. Meanwhile, traditional approaches to summarize national space activity do not necessarily capture the types of activity that developing countries pursue in space. This is especially true if they do not have a formal national space program or office. Developing countries pursue national space activity through activities of many types—from national satellite programs to commercial use of satellite services to involvement with international space institutions. This research aims to understand and analyze these trends. This paper introduces two analytical frameworks for evaluating space activity at the national level. The frameworks are specifically designed to capture the activity of countries that have traditionally been less involved in space. They take a broad view of space related activity across multiple societal sectors and disciplines. The discussion explains the approach for using the frameworks as well as illustrative examples of how they can be applied as part of a research process. The first framework is called the Mission and Management Ladders. This framework considers specific space projects within countries and ranks them on "Ladders" that measure technical challenge and managerial autonomy. This first method is at a micro level of analysis. The second framework is called the Space Participation Metric (SPM). The SPM can be used to assign a Space Participation score to countries based on their involvement in various space related activities. This second method uses a macro level of analysis. The authors

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

New Teacher Induction: A Program Evaluation

ERIC Educational Resources Information Center

Hunter, J. Warren

2016-01-01

The purpose of this qualitative program evaluation was to examine the impact a two-year new teacher induction program had on teachers' feelings of support, satisfaction, and self-efficacy. The program purports that higher feelings of support, satisfaction, and self-efficacy in teachers will lead to lower teacher attrition. In turn, research shows…

An Introduction to "My Environmental Education Evaluation Resource Assistant" (MEERA), a Web-Based Resource for Self-Directed Learning about Environmental Education Program Evaluation

ERIC Educational Resources Information Center

Zint, Michaela

2010-01-01

My Environmental Education Evaluation Resource Assistant or "MEERA" is a web-site designed to support environmental educators' program evaluation activities. MEERA has several characteristics that set it apart from other self-directed learning evaluation resources. Readers are encouraged to explore the site and to reflect on the role that…

Evaluation of a training program for nurse supervisors who monitor nurses in an alternative-to-discipline program.

PubMed

Cadiz, David; Truxillo, Donald; OʼNeill, Chris

2012-01-01

Nurse alternative-to-discipline programs aim to protect the public from the harm of impaired practice and to support nurses in early recovery from substance use disorders. Supervisor observation of work behavior is one key monitoring activity that protects the public. We evaluate a supervisory training called "Fit to Perform" for nurse managers to help them monitor and manage nurses enrolled in an alternative-to-discipline program. We observed significant mean changes in knowledge, training utility, self-efficacy, and substance abuse stigma. The results suggest that the training positively affects knowledge about substance use disorders, confidence to supervise nurses enrolled in an alternative-to-discipline program, and reduces stigma, which may create a supportive workplace for nurses in recovery.

Framework for a National Testing and Evaluation Program ...

EPA Pesticide Factsheets

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

A leadership development program for surgeons: First-year participant evaluation.

PubMed

Pradarelli, Jason C; Jaffe, Gregory A; Lemak, Christy Harris; Mulholland, Michael W; Dimick, Justin B

2016-08-01

In a dynamic health care system, strong leadership has never been more important for surgeons. Little is known about how to design and conduct effectively a leadership program specifically for surgeons. We sought to evaluate critically a Leadership Development Program for practicing surgeons by exploring how the program's strengths and weaknesses affected the surgeons' development as physician-leaders. At a large academic institution, we conducted semistructured interviews with 21 surgical faculty members who applied voluntarily, were selected, and completed a newly created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons' evaluations of the program on their development as physician-leaders. After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and knowledge in business and leadership. Surgeons felt "more confident about stepping up as a leader" and more aware of "how others view me and my interactions." They described a stronger grasp on "giving feedback" as well as a better understanding of "business/organizational issues." Overall, surgeon-participants reported positive impacts of the program on their day-to-day work activities and general career perspective as well as on their long-term career development plans. Surgeons also recommended areas where the program could potentially be improved. These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to equip surgeons better for important leadership roles in a complex health care environment. Copyright © 2016 Elsevier Inc. All rights reserved.

A Leadership Development Program for Surgeons: First-Year Participant Evaluation

PubMed Central

Pradarelli, Jason C.; Jaffe, Gregory A.; Lemak, Christy Harris; Mulholland, Michael W.; Dimick, Justin B.

2016-01-01

Structured Abstract Background In a dynamic healthcare system, strong leadership has never been more important for surgeons. Little is known about how to effectively design and conduct a leadership program specifically for surgeons. We sought to critically evaluate a Leadership Development Program for practicing surgeons by exploring the strengths and weaknesses of program components on surgeons’ development as physician-leaders. Methods At a large academic institution, we conducted semi-structured interviews with 21 surgical faculty members who voluntarily applied, were selected, and completed a newly-created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons’ evaluations of the program on their development as physician-leaders. Results After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and business and leadership knowledge. Surgeons felt “more confident about stepping up as a leader” and more aware about “how others view me and my interactions.” They described a stronger grasp on “giving feedback” as well as “business/organizational issues.” Overall, surgeon participants reported positive impacts of the program on their day-to-day work activities, general career perspective, as well as their long-term career development plans. Surgeons also recommended areas for potential improvement for the program. Conclusions These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to better equip surgeons for important leadership roles in a complex healthcare environment. PMID:27138180

Advancing Evaluation of Character Building Programs

ERIC Educational Resources Information Center

Urban, Jennifer Brown; Trochim, William M.

2017-01-01

This article presents how character development practitioners, researchers, and funders might think about evaluation, how evaluation fits into their work, and what needs to happen in order to sustain evaluative practices. A broader view of evaluation is presented whereby evaluation is not just seen as something that is applied at a program level,…

Lazy evaluation of FP programs: A data-flow approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wei, Y.H.; Gaudiot, J.L.

1988-12-31

This paper presents a lazy evaluation system for the list-based functional language, Backus` FP in data-driven environment. A superset language of FP, called DFP (Demand-driven FP), is introduced. FP eager programs are transformed into DFP lazy programs which contain the notions of demands. The data-driven execution of DFP programs has the same effects of lazy evaluation. DFP lazy programs have the property of always evaluating a sufficient and necessary result. The infinite sequence generator is used to demonstrate the eager-lazy program transformation and the execution of the lazy programs.

A multidimensional evaluation of a nursing information-literacy program.

PubMed Central

Fox, L M; Richter, J M; White, N E

1996-01-01

The goal of an information-literacy program is to develop student skills in locating, evaluating, and applying information for use in critical thinking and problem solving. This paper describes a multidimensional evaluation process for determining nursing students' growth in cognitive and affective domains. Results indicate improvement in student skills as a result of a nursing information-literacy program. Multidimensional evaluation produces a well-rounded picture of student progress based on formal measurement as well as informal feedback. Developing new educational programs can be a time-consuming challenge. It is important, when expending so much effort, to ensure that the goals of the new program are achieved and benefits to students demonstrated. A multidimensional approach to evaluation can help to accomplish those ends. In 1988, The University of Northern Colorado School of Nursing began working with a librarian to integrate an information-literacy component, entitled Pathways to Information Literacy, into the curriculum. This article describes the program and discusses how a multidimensional evaluation process was used to assess program effectiveness. The evaluation process not only helped to measure the effectiveness of the program but also allowed the instructors to use several different approaches to evaluation. PMID:8826621

Evaluating Mentoring Programs. P/PV Brief

ERIC Educational Resources Information Center

Grossman, Jean Baldwin

2009-01-01

This methodological brief is designed to provide both program operators and researchers with practical advice about how to assess a program's implementation and impact. Adapted from an article that first appeared in "The Handbook of Youth Mentoring" (DuBois and Karcher, ed. 2005), the brief focuses on the evaluation of mentoring programs, but the…

Extracurricular Physical Activity Programs in California Private Secondary Schools.

PubMed

Kahan, David; McKenzie, Thomas L

2017-12-01

Interscholastic, intramural, and club physical activity (PA) programs can be important contributors to student PA accrual at schools. Few studies have assessed factors related to the provision of these extracurricular PA programs, especially in private schools. We used a 16-item questionnaire to assess the associations and influences of selected factors relative to extracurricular PA program policies and practices in 450 private California secondary schools. Associations were evaluated using contingency table analyses (i.e., chi-squared, effect size, and post-hoc analyses). Six factors were associated with schools providing extracurricular PA programs: school location, level, enrollment, and religious classification and whether the physical education (PE) program met state PE time standards and was taught by PE specialists. Both static factors (e.g., school location, level, enrollment, and religious affiliation) and modifiable factors (e.g., meeting PE standards and employing specialists) affect the provision of extracurricular PA programs. As education is state-mandated, additional study is recommended to assess the generalizability of these findings to other states and to public schools.

Evaluation of the Good Start Program: a healthy eating and physical activity intervention for Maori and Pacific Islander children living in Queensland, Australia.

PubMed

Mihrshahi, Seema; Vaughan, Lisa; Fa'avale, Nicola; De Silva Weliange, Shreenika; Manu-Sione, Inez; Schubert, Lisa

2017-01-13

Reducing the prevalence of obesity and chronic disease are important priorities. Maori and Pacific Islander communities living in Australia have higher rates of obesity and chronic disease than the wider Australian population. This study aims to assess the effectiveness of the Good Start program, which aims to improve knowledge, attitudes and practices related to healthy eating and physical activity amongst Maori and Pacific Islander communities living in Queensland. The intervention was delivered to children aged 6-19 years (N = 375) in schools by multicultural health workers. Class activities focused on one message each term related to healthy eating and physical activity using methods such as cooking sessions and cultural dance. The evaluation approach was a quantitative uncontrolled pre-post design. Data were collected each term pre- and post-intervention using a short questionnaire. There were significant increases in knowledge of correct servings of fruit and vegetables, knowledge of sugar and caffeine content of common sugar-sweetened drinks, recognition of the consequences of marketing and upsizing, and the importance of controlling portion size (all P < 0.05). There was also increases in knowledge of physical activity recommendations (P < 0.001), as well as the importance of physical activity for preventing heart disease (P < 0.001) and improving self-esteem (P < 0.001). In terms of attitudes, there were significant improvements in some attitudes to vegetables (P = 0.02), and sugar-sweetened drinks (P < 0.05). In terms of practices and behaviours, although the reported intake of vegetables increased significantly (P < 0.001), the proportion of children eating discretionary foods regularly did not change significantly, suggesting that modifying the program with an increased emphasis on reducing intake of junk food may be beneficial. The study has shown that the Good Start Program was effective in engaging children from Maori

Competency and an active learning program in undergraduate nursing education.

PubMed

Shin, Hyunsook; Sok, Sohyune; Hyun, Kyung Sun; Kim, Mi Ja

2015-03-01

To evaluate the effect of an active learning program on competency of senior students. Active learning strategies have been used to help students achieve desired nursing competency, but their effectiveness has not been systematically examined. A descriptive, cross-sectional comparative design was used. Two cohort group comparisons using t-test were made: one in an active learning group and the other in a traditional learning group. A total of 147 senior nursing students near graduation participated in this study: 73 in 2010 and 74 in 2013. The active learning program incorporated high-fidelity simulation, situation-based case studies, standardized patients, audio-video playback, reflective activities and technology such as a SmartPad-based program. The overall scores of the nursing competency in the active group were significantly higher than those in the traditional group. Of five overall subdomains, the scores of the special and general clinical performance competency, critical thinking and human understanding were significantly higher in the active group than in the traditional group. Importance-performance analysis showed that all five subdomains of the active group clustered in the high importance and high performance quadrant, indicating significantly better achievements. In contrast, the students in the traditional group showed scattered patterns in three quadrants, excluding the low importance and low performance quadrants. This pattern indicates that the traditional learning method did not yield the high performance in most important areas. The findings of this study suggest that an active learning strategy is useful for helping undergraduate students to gain competency. © 2014 John Wiley & Sons Ltd.

An Evaluation of Knowledge Transfer from Microworld Programming to Conventional Programming

ERIC Educational Resources Information Center

Xinogalos, Stelios

2012-01-01

Programming microworlds are being used for introducing students to programming for many years. Although many professors and school teachers report positive results from using programming microwords, these results are usually based on anecdotal evidence rather than rigorous empirical evaluation. A question that has not been answered yet with…

Building capacity in local government for integrated planning to increase physical activity: evaluation of the VicHealth MetroACTIVE program.

PubMed

Thomas, M M; Hodge, W; Smith, B J

2009-12-01

Integrated planning is a holistic approach to addressing the needs of local communities built on partnerships between those responsible for development, environmental quality and service provision. This study investigated the extent and key influences on the use of integrated planning to promote physical activity among six metropolitan councils in Melbourne Australia, which took part in the MetroACTIVE Project funded by the Victorian Health Promotion Foundation from 2005 to 2007. The evaluation entailed interviews conducted at the mid-term (N = 67) and completion (N = 50) of the project, and the review of relevant documents. Respondents included elected councillors, chief executive officers, officers from different council divisions and the project staff employed in each council. Three councils showed evidence of integrated planning for physical activity, whereas the remainder focused on the delivery of community participation programs. Leadership from senior management and an organizational culture that supported collaboration across council departments were prerequisites for integrated planning. Employment of a dedicated project officer with skills for engaging management and building partnerships within the organization was important. Barriers to integrated planning were a complex organization structure, high demands on the council due to a growing residential population and a poor climate among staff. Overall, integrated planning was found to be a viable approach for developing a coordinated approach to this issue involving the range of council services and functions. Ongoing strategies are needed to facilitate senior management commitment and organizational capacity for integrated planning, with leadership provided by departments responsible for infrastructure or corporate planning.

State Education Department: Security over Pupil Evaluation Program and Program Evaluation Test Materials Needs Improvement. Report 91-S-2.

ERIC Educational Resources Information Center

New York State Office of the Comptroller, Albany.

Findings of an audit of the New York State Education Department's procedures to maintain security over Pupil Evaluation Program (PEP) and Program Evaluation Test (PET) examination materials are presented in this report. The audit sought to determine whether the department's security procedures adequately prevented unauthorized access to exam…

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Increasing Physical Activity in Preschool: A Pilot Study to Evaluate Animal Trackers

ERIC Educational Resources Information Center

Williams, Christine L.; Carter, Betty Jean; Kibbe, Debra L.; Dennison, David

2009-01-01

Objective: This report describes a pilot study to evaluate Animal Trackers (AT), a preschool program designed to (1) increase structured physical activity (PA) during the preschool day; (2) increase practice of gross motor skills; (3) provide teachers with an easy-to-use PA program regardless of teacher experience; and (4) implement a teacher…

Parental perception on the efficacy of a physical activity program for preschoolers.

PubMed

Bellows, Laura; Silvernail, Sara; Caldwell, Lisa; Bryant, Angela; Kennedy, Cathy; Davies, Patricia; Anderson, Jennifer

2011-04-01

Childhood obesity is among the leading health concerns in the United States. The relationship between unmet physical activity needs in young children is of particular interest as the trend in childhood obesity continues to rise and unmet physical activity needs are identified. The preschool years are an influential time in promoting healthful lifestyle habits and early childhood interventions may help establish lifelong healthful behaviors which could help prevent obesity later in life. The Food Friends®: Get Movin' with Mighty Moves® is a preschool physical activity program which aims to improve children's gross motor skills and physical activity levels. The home environment and parental modeling are critical factors related to child physical activity in this population. The parent component, Mighty Moves®: Fun Ways to Keep Families Active and Healthy, was designed to address barriers in the home environment that lead to unmet physical activity needs in preschoolers and their families. The program and materials were designed based on Social Marketing tenets and Social Learning Theory principles. Four Colorado Head Start centers were assigned to an experimental group as part of the Mighty Moves® group randomized trial. Quantitative and qualitative evaluation methods were used to determine what messages and materials reached and motivated the target audience to increase physical activity levels. Results of the study indicated the program's materials helped families and children to be more physically active. Additionally, materials and material dissemination were revised to enhance program goals.

Advantages of Gardening as a Form of Physical Activity in an After-School Program

ERIC Educational Resources Information Center

Phelps, Joshua; Hermann, Janice R.; Parker, Stephany P.; Denney, Barbara

2010-01-01

Children who normally abstain from physical activity may view gardening as a viable non-competitive alternative. The study reported here evaluated the effect of an Oklahoma Cooperative Extension Service after-school gardening program on self-reported physical activity level of children in 3rd through 5th grade using the ACTIVITY self-report…

Physical activity opportunities in afterschool programs

PubMed Central

Weaver, R. Glenn; Beets, Michael W.; Huberty, Jennifer; Freedman, Darcy; Turner-Mcgrievy, Gabrielle; Ward, Diane

2015-01-01

Afterschool programs (ASPs) have potential to provide children moderate-to-vigorous physical activity (MVPA). The availability and types (e.g., free play or organized activities) of physical activity opportunities, their structure (e.g., presence of lines, elimination games), and staff behaviors (e.g., encouragement, engaged) can influence children’s MVPA. This study explored these factors in 20 ASPs serving over 1,700 elementary-age children. The occurrence, types and structure of physical activity opportunities, and staff behaviors were collected via the System for Observing Staff Promotion of Physical Activity and Nutrition (SOSPAN). A total of 4,660 SOSPAN scans were completed across 63 complete program days (1733 during physical activity opportunities). Physical activity opportunities were observed on 60 program days across all 20 sites, with 73% of those opportunities classified as free play. ASPs scheduled an average of 66.3 minutes (range 15-150min) of physical activity opportunities daily. Games played included basketball, tag, soccer and football. Staff rarely engaged in physical activity promotion behaviors, and the structure of organized games discouraged MVPA. For example, staff verbally promoted physical activity in just 6.1% of scans, while organized games were more likely to involve lines and elimination. Professional development training may enhance staffs’ physical activity promotion and the structure of activity opportunities. PMID:25586132

EVALUATION OF E.S.E.A. PROGRAMS AND SERVICES FOR THE EDUCATIONALLY DISADVANTAGED, 1966-67.

ERIC Educational Resources Information Center

Sacramento City Unified School District, CA.

Along with general information on the 1966-67 Title I compensatory education programs in the Sacramento City Unified School District and on the instruments used in evaluation the effectiveness of these programs, this report contains descriptions of individual activities: (1) language arts development and reading remediation (also information on…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Evaluation of an Interdisciplinary, Physically Active Lifestyle Course Model

ERIC Educational Resources Information Center

Fede, Marybeth H.

2009-01-01

The purpose of this study was to evaluate a fit for life program at a university and to use the findings from an extensive literature review, consultations with formative and summative committees, and data collection to develop an interdisciplinary, physically active lifestyle (IPAL) course model. To address the 5 research questions examined in…

32 CFR 196.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 32 National Defense 2 2011-07-01 2011-07-01 false Education programs or activities. 196.400... (CONTINUED) MISCELLANEOUS NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

32 CFR 196.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 32 National Defense 2 2010-07-01 2010-07-01 false Education programs or activities. 196.400... (CONTINUED) MISCELLANEOUS NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

Evaluating Social Programs at the State and Local Level. The JTPA Evaluation Design Project.

ERIC Educational Resources Information Center

Blalock, Ann Bonar, Ed.; And Others

This book on evaluating social programs is an outcome of the Job Training Partnership Act (JTPA) Evaluation Design Project, which produced a set of 10 guides for the evaluation of state and local JTPA programs. This book distills ideas from these guides and applies them to a larger context. Part 1 presents a general approach to program evaluation…

Some Methods for Evaluating Program Implementation.

ERIC Educational Resources Information Center

Hardy, Roy A.

An approach to evaluating program implementation is described. This approach includes the development of a project description which includes a structure matrix, sampling from the structure matrix, and preparing an implementation evaluation plan. The implementation evaluation plan should include: (1) verification of implementation of planned…

Program Evaluation: A Review and Synthesis.

ERIC Educational Resources Information Center

Webber, Charles F.

This paper reviews models of program evaluation. Major topics and issues found in the evaluation literature include quantitative versus qualitative approaches, identification and involvement of stakeholders, formulation of research questions, collection of data, analysis and interpretation of data, reporting of results, evaluation utilization, and…

Assessment of Learning and Program Evaluation in Health Professions Education Programs

ERIC Educational Resources Information Center

Moore, Donald E., Jr.

2018-01-01

This chapter proposes approaches for assessing learners and evaluating courses and curriculum that could be used by directors of health professions education (HPE) programs to determine the effectiveness and impact of their programs.

Evaluating the effectiveness of psychosocial resilience training for heart health, and the added value of promoting physical activity: a cluster randomized trial of the READY program.

PubMed

Burton, Nicola W; Pakenham, Kenneth I; Brown, Wendy J

2009-11-23

Depression and poor social support are significant risk factors for coronary heart disease (CHD), and stress and anxiety can trigger coronary events. People experiencing such psychosocial difficulties are more likely to be physically inactive, which is also an independent risk factor for CHD. Resilience training can target these risk factors, but there is little research evaluating the effectiveness of such programs. This paper describes the design and measures of a study to evaluate a resilience training program (READY) to promote psychosocial well-being for heart health, and the added value of integrating physical activity promotion. In a cluster randomized trial, 95 participants will be allocated to either a waitlist or one of two intervention conditions. Both intervention conditions will receive a 10 x 2.5 hour group resilience training program (READY) over 13 weeks. The program targets five protective factors identified from empirical evidence and analyzed as mediating variables: positive emotions, cognitive flexibility, social support, life meaning, and active coping. Resilience enhancement strategies reflect the six core Acceptance and Commitment Therapy processes (values, mindfulness, defusion, acceptance, self-as-context, committed action) and Cognitive Behavior Therapy strategies such as relaxation training and social support building skills. Sessions include psychoeducation, discussions, experiential exercises, and home assignments. One intervention condition will include an additional session and ongoing content promoting physical activity. Measurement will occur at baseline, two weeks post intervention, and at eight weeks follow-up, and will include questionnaires, pedometer step logs, and physical and hematological measures. Primary outcome measures will include self-reported indicators of psychosocial well-being and depression. Secondary outcome measures will include self-reported indicators of stress, anxiety and physical activity, and objective

Title I, ESEA Program Evaluation, 1967-68. Program Research and Development.

ERIC Educational Resources Information Center

Jacobs, James N., Ed.; Felix, Joseph L., Ed.

This report comprises a Title I ESEA Program evaluation for 1967-68 in Cincinnati Public Schools. To make greater concentration of services possible, lesser target schools were phased out of the 1967-68 program. The five projects comprising the 1967-68 program were: Elementary School remediation and enrichment; Secondary School remediation and…

Building on a YMCA's health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_.

PubMed

Bush, Paula Louise; García Bengoechea, Enrique

2016-08-01

School-based physical activity programs are only effective for increasing adolescents' school-based physical activity. To increase out-of-school-time physical activity, complementary community programs are warranted. Partnerships between universities and community organizations may help build the capacity of these organizations to provide sustainable programs. To understand capacity building processes and outcomes, we partnered with a YMCA to build on their adolescent physical activity promotion capacity. Together, we designed and implemented means to evaluate the YMCA teen program to inform program planning. For this qualitative case study, emails and interviews and meetings transcripts were collected over 2.5 years and analyzed using inductive and deductive thematic analysis. Findings illustrate that the YMCA's workforce and organizational development capacities (e.g., evaluation and health promotion capacity and competence) were increased through our partnership, resource allocation, and leadership. We responded to YMCA partners' perceived needs, yet guided them beyond those needs, successfully combining our complementary objectives, knowledge, and skills to generate an integrated program vision, rationale, and evaluation results. This provided YMCA partners with validation, reminders, and awareness. In turn, this contributed to programming and evaluation practice changes. In light of extant capacity building literature, we discuss how our partnership increased the YMCA's capacity to promote healthy adolescent programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

13 CFR 113.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Education programs or activities... ADMINISTRATOR Nondiscrimination on the Basis of Sex in Education Programs or Activities Receiving Federal Financial Assistance Discrimination on the Basis of Sex in Education Programs Or Activities Prohibited § 113...

45 CFR 2555.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 4 2011-10-01 2011-10-01 false Education programs or activities. 2555.400 Section... COMMUNITY SERVICE NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

24 CFR 3.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 24 Housing and Urban Development 1 2011-04-01 2011-04-01 false Education programs or activities. 3... Urban Development NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

28 CFR 54.400 - Education programs or activities.

Code of Federal Regulations, 2013 CFR

2013-07-01

... SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 54.400 Education programs or activities... basis of sex, be excluded from participation in, be denied the benefits of, or be subjected to...

13 CFR 113.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Education programs or activities... ADMINISTRATOR Nondiscrimination on the Basis of Sex in Education Programs or Activities Receiving Federal Financial Assistance Discrimination on the Basis of Sex in Education Programs Or Activities Prohibited § 113...

45 CFR 2555.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Education programs or activities. 2555.400 Section... COMMUNITY SERVICE NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

24 CFR 3.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 1 2010-04-01 2010-04-01 false Education programs or activities. 3... Urban Development NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities...

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

Preventing Dating Violence in Public Schools: An Evaluation of an Interagency Collaborative Program for Youth

ERIC Educational Resources Information Center

Lowe, Laura A.; Jones, Chris D.; Banks, Leon

2007-01-01

Many communities offer programs aimed at improving teen dating skills and knowledge about violence and sexual behavior. This research study evaluates one such program, operated by an interagency collaborative. Each of four participating community agencies provided one hour of curriculum during one week of health class. Lecture, group activities,…

45 CFR 2516.820 - What types of internal evaluation activities are required of programs?

Code of Federal Regulations, 2010 CFR

2010-10-01

... required to: (a) Continuously assess management effectiveness, the quality of services provided, and the satisfaction of both participants and service recipients. Internal evaluations should seek frequent feedback... 45 Public Welfare 4 2010-10-01 2010-10-01 false What types of internal evaluation activities are...

Trends toward the Future in Physical Activity Programming

ERIC Educational Resources Information Center

Charles, John M.; Charles, P. Kelly

2016-01-01

In the wake of multiple activity program eliminations and frequent downgrading of activity programs nationwide, the question to be addressed is how we can draw upon our interdisciplinary, intergenerational, and intercultural understandings of human movement to construct physical activity programs for the future that might withstand the test of…

Program evaluation of an Integrated Basic Science Medical Curriculum in Shiraz Medical School, Using CIPP Evaluation Model

PubMed Central

ROOHOLAMINI, AZADEH; AMINI, MITRA; BAZRAFKAN, LEILA; DEHGHANI, MOHAMMAD REZA; ESMAEILZADEH, ZOHREH; NABEIEI, PARISA; REZAEE, RITA; KOJURI, JAVAD

2017-01-01

Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by stablishing the horizontal basic science integration model and Early Clinical Exposure (ECE) for undergraduate medical education. The purpose of this study was to provide the required data for the program evaluation of this curriculum for undergraduate medical students, using CIPP program evaluation model. Methods: This study is an analytic descriptive and triangulation mixed method study which was carried out in Shiraz Medical School in 2012, based on the views of professors of basic sciences courses and first and second year medical students. The study evaluated the quality of the relationship between basic sciences and clinical courses and the method of presenting such courses based on the Context, Input, Process and Product (CIPP) model. The tools for collecting data, both quantitatively and qualitatively, were some questionnaires, content analysis of portfolios, semi- structured interview and brain storming sessions. For quantitative data analysis, SPSS software, version 14, was used. Results: In the context evaluation by modified DREEM questionnaire, 77.75%of the students believed that this educational system encourages them to actively participate in classes. Course schedule and atmosphere of class were reported suitable by 87.81% and 83.86% of students. In input domain that was measured by a researcher made questionnaire, the facilities for education were acceptable except for shortage of cadavers. In process evaluation, the quality of integrated modules presentation and Early Clinical Exposure (ECE) was good from the students’ viewpoint. In product evaluation, students’ brain storming, students’ portfolio and semi-structured interview with faculties were done, showing some positive aspects of integration and some areas that need

Evaluation Results of the CDC/ASPH Institute for HIV Prevention Leadership: A Capacity-building Educational Program for HIV Prevention Program Managers

PubMed Central

Richter, Donna L.; Dauner, Kim Nichols; Lindley, Lisa L.; Reininger, Belinda M.; Oglesby, Willie H.; Prince, Mary S.; Thompson-Robinson, Melva; Jones, Rhondette; Potts, Linda H.

2011-01-01

Objective The goal of this research was to evaluate changes over time in the capacity of participants of the CDC/ASPH Institute for HIV Prevention Leadership (Institute), a capacity-building program for HIV prevention program managers in minority-based, community-based organizations, Capacity was defined as the application of new skills and knowledge to participants’ jobs and confidence in using those new skills and knowledge to strategically manage and apply “best practices” to their HIV prevention activities. Methods This is a longitudinal study involving measuring scholar capacity at three points in time; pre-Institute, post-Institute, and 6 months’ post-Institute. Only responses from participants who completed all three surveys are included in this final analysis of the data (N = 94). Results Results indicate that participants from 3 years of the institute (2002–2004) increased their capacity in HIV prevention programming and strategic planning and management. Significant changes were seen in the frequency and self-efficacy with which participants conduct several HIV prevention programming activities. Participants also reported conducting strategic planning activities at more appropriate intervals and were significantly more confident in conducting these activities. Conclusion The Institute has positively and significantly increased the capacity of participants to conduct more effective HIV prevention programs on a national level. PMID:17159470

Agent-based modeling as a tool for program design and evaluation.

PubMed

Lawlor, Jennifer A; McGirr, Sara

2017-12-01

Recently, systems thinking and systems science approaches have gained popularity in the field of evaluation; however, there has been relatively little exploration of how evaluators could use quantitative tools to assist in the implementation of systems approaches therein. The purpose of this paper is to explore potential uses of one such quantitative tool, agent-based modeling, in evaluation practice. To this end, we define agent-based modeling and offer potential uses for it in typical evaluation activities, including: engaging stakeholders, selecting an intervention, modeling program theory, setting performance targets, and interpreting evaluation results. We provide demonstrative examples from published agent-based modeling efforts both inside and outside the field of evaluation for each of the evaluative activities discussed. We further describe potential pitfalls of this tool and offer cautions for evaluators who may chose to implement it in their practice. Finally, the article concludes with a discussion of the future of agent-based modeling in evaluation practice and a call for more formal exploration of this tool as well as other approaches to simulation modeling in the field. Copyright © 2017 Elsevier Ltd. All rights reserved.

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

PubMed

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and

A Strategy for Program Evaluation.

ERIC Educational Resources Information Center

Leinhardt, Gaea

This paper proposes a strategy for in-house evaluations in the context of an educational research and development facility. The obstacles in conducting an evaluation of colleagues' programs are discussed; these fall into two categories. First, there is a set of problems that relate to conflicts inherent in judging the work of a colleague without…

45 CFR 86.31 - Education programs or activities.

Code of Federal Regulations, 2014 CFR

2014-10-01

... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 86.31 Education programs or activities. (a) General. Except as provided elsewhere in this part, no person shall, on the basis of sex, be...

45 CFR 86.31 - Education programs or activities.

Code of Federal Regulations, 2012 CFR

2012-10-01

... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 86.31 Education programs or activities. (a) General. Except as provided elsewhere in this part, no person shall, on the basis of sex, be...

45 CFR 86.31 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-10-01

... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 86.31 Education programs or activities. (a) General. Except as provided elsewhere in this part, no person shall, on the basis of sex, be...

Physical activity opportunities in afterschool programs.

PubMed

Weaver, R Glenn; Beets, Michael W; Huberty, Jennifer; Freedman, Darcy; Turner-Mcgrievy, Gabrielle; Ward, Diane

2015-05-01

Afterschool programs (ASPs) have potential to provide children moderate to vigorous physical activity (MVPA). The availability and types (e.g., free play or organized activities) of physical activity opportunities, their structure (e.g., presence of lines, elimination games), and staff behaviors (e.g., encouragement, engaged) can influence children's MVPA. This study explored these factors in 20 ASPs serving over 1,700 elementary-age children. The occurrence, types, and structure of physical activity opportunities, and staff behaviors were collected via the SOSPAN (System for Observing Staff Promotion of Physical Activity and Nutrition). A total of 4,660 SOSPAN scans were completed across 63 complete program days (1,733 during physical activity opportunities). Physical activity opportunities were observed on 60 program days across all 20 sites, with 73% of those opportunities classified as free play. ASPs scheduled an average of 66.3 minutes (range 15-150 minutes) of physical activity opportunities daily. Games played included basketball, tag, soccer, and football. Staff rarely engaged in physical activity promotion behaviors, and the structure of organized games discouraged MVPA. For example, staff verbally promoted physical activity in just 6.1% of scans, while organized games were more likely to involve lines and elimination. Professional development training may enhance staffs' physical activity promotion and the structure of activity opportunities. © 2015 Society for Public Health Education.

Evaluation in STEM Online Graduate Degree Programs in Agricultural Sciences and Engineering

ERIC Educational Resources Information Center

Downs, Holly A.

2014-01-01

Demands for online graduate degrees have increased pressure on universities to launch web degrees quickly and, at times, without attending to their quality. Scarce research exists identifying what evaluation activities are being done by science, technology, engineering, and mathematics (STEM) online graduate degree programs that are accustomed to…

Active Fire Mapping Program

MedlinePlus

Active Fire Mapping Program Current Large Incidents (Home) New Large Incidents Fire Detection Maps MODIS Satellite Imagery VIIRS Satellite Imagery Fire Detection GIS Data Fire Data in Google Earth ...

Evaluating the Georgia Master Naturalist Program

ERIC Educational Resources Information Center

Hildreth, Lauren; Mengak, Michael T.

2016-01-01

We evaluated the Georgia Master Naturalist Program using an online survey. Survey participation was voluntary, and the survey addressed areas such as satisfaction, volunteerism, and future training. The program received high scores from survey respondents. They appreciated training on native plants, environmental awareness, and ecological…

Identifying Strategies Programs Adopt to Meet Healthy Eating and Physical Activity Standards in Afterschool Programs.

PubMed

Weaver, Robert G; Moore, Justin B; Turner-McGrievy, Brie; Saunders, Ruth; Beighle, Aaron; Khan, M Mahmud; Chandler, Jessica; Brazendale, Keith; Randell, Allison; Webster, Collin; Beets, Michael W

2017-08-01

The YMCA of USA has adopted Healthy Eating and Physical Activity (HEPA) Standards for its afterschool programs (ASPs). Little is known about strategies YMCA ASPs are implementing to achieve Standards and these strategies' effectiveness. (1) Identify strategies implemented in YMCA ASPs and (2) evaluate the relationship between strategy implementation and meeting Standards. HEPA was measured via accelerometer (moderate-to-vigorous-physical-activity [MVPA]) and direct observation (snacks served) in 20 ASPs. Strategies were identified and mapped onto a capacity building framework ( Strategies To Enhance Practice [STEPs]). Mixed-effects regression estimated increases in HEPA outcomes as implementation increased. Model-implied estimates were calculated for high (i.e., highest implementation score achieved), moderate (median implementation score across programs), and low (lowest implementation score achieved) implementation for both HEPA separately. Programs implemented a variety of strategies identified in STEPs. For every 1-point increase in implementation score 1.45% (95% confidence interval = 0.33% to 2.55%, p ≤ .001) more girls accumulated 30 min/day of MVPA and fruits and/or vegetables were served on 0.11 more days (95% confidence interval = 0.11-0.45, p ≤ .01). Relationships between implementation and other HEPA outcomes did not reach statistical significance. Still regression estimates indicated that desserts are served on 1.94 fewer days (i.e., 0.40 vs. 2.34) in the highest implementing program than the lowest implementing program and water is served 0.73 more days (i.e., 2.37 vs. 1.64). Adopting HEPA Standards at the national level does not lead to changes in routine practice in all programs. Practical strategies that programs could adopt to more fully comply with the HEPA Standards are identified.

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

NASA Technical Reports Server (NTRS)

Benbenek, Daniel; Soloff, Jason; Lieb, Erica

2010-01-01

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

The PLUNGE randomized controlled trial: evaluation of a games-based physical activity professional learning program in primary school physical education.

PubMed

Miller, Andrew; Christensen, Erin M; Eather, Narelle; Sproule, John; Annis-Brown, Laura; Lubans, David Revalds

2015-05-01

To evaluate the efficacy of the Professional Learning for Understanding Games Education (PLUNGE) program on fundamental movement skills (FMS), in-class physical activity and perceived sporting competence. A cluster-randomized controlled trial involving one year six class each from seven primary schools (n=168; mean age=11.2 years, SD=1.0) in the Hunter Region, NSW, Australia. In September (2013) participants were randomized by school into the PLUNGE intervention (n=97 students) or the 7-week wait-list control (n=71) condition. PLUNGE involved the use of Game Centered curriculum delivered via an in-class teacher mentoring program. Students were assessed at baseline and 8-week follow-up for three object control FMS (Test of Gross Motor Development 2), in-class physical activity (pedometer steps/min) and perceived sporting competence (Self-perception Profile for Children). Linear mixed models revealed significant group-by-time intervention effects (all p<0.05) for object control competency (effect size: d=0.9), and in-class pedometer steps/min (d=1.0). No significant intervention effects (p>0.05) were observed for perceived sporting competence. The PLUNGE intervention simultaneously improved object control FMS proficiency and in-class PA in stage three students. Copyright © 2015 Elsevier Inc. All rights reserved.

A prospective evaluation of first people's health promotion program design in the goulburn-murray rivers region.

PubMed

Doyle, Joyce; Atkinson-Briggs, Sharon; Atkinson, Petah; Firebrace, Bradley; Calleja, Julie; Reilly, Rachel; Cargo, Margaret; Riley, Therese; Crumpen, Tui; Rowley, Kevin

2016-11-10

Aboriginal Community Controlled Organisations (ACCOs) provide community-focussed and culturally safe services for First Peoples in Australia, including crisis intervention and health promotion activities, in a holistic manner. The ecological model of health promotion goes some way towards describing the complexity of such health programs. The aims of this project were to: 1) identify the aims and purpose of existing health promotion programs conducted by an alliance of ACCOs in northern Victoria, Australia; and 2) evaluate the extent to which these programs are consistent with an ecological model of health promotion, addressing both individual and environmental determinants of health. The project arose from a long history of collaborative research. Three ACCOs and a university formed the Health Promotion Alliance to evaluate their health promotion programs. Local community members were trained in, and contributed to developing culturally sensitive methods for, data collection. Information on the aims and design of 88 health promotion activities making up 12 different programs across the ACCOs was systematically and prospectively collected. There was a wide range of activities addressing environmental and social determinants of health, as well as physical activity, nutrition and weight loss. The design of the great majority of activities had a minimal Western influence and were designed within a local Aboriginal cultural framework. The most common focus of the activities was social connectedness (76 %). Physical activity was represented in two thirds of the activities, and nutrition, weight loss and culture were each a focus of about half of the activities. A modified coding procedure designed to assess the ecological nature of these programs showed that they recruited from multiple settings; targeted a range of individual, social and environmental determinants; and used numerous and innovative strategies to achieve change. First Peoples' health promotion in the

Innovative strategies for nursing education program evaluation.

PubMed

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Evaluation of a volunteer-led in-home exercise program for home-bound older adults.

PubMed

Stolee, Paul; Zaza, Christine; Schuehlein, Sheila

2012-01-01

Exercise programs have been found to have substantial benefits for older persons, but implementing these programs with frail homebound seniors is challenging. The project team aimed to evaluate an in-home exercise program for older adults--the Victorian Order of Nurses' for Canada's SMART (Seniors Maintaining Active Roles Together)® (VON SMART®) In-Home Exercise Program- in which the exercises are led by trained volunteers. The majority of volunteers were females who exercise regularly. Over half of the volunteers were 60 years of age or older, and over half had had prior health or fitness training. Volunteers reported receiving multiple benefits from performing their role as an exercise leader. From January to August, 2009, a total of 59 volunteers, seven Site Coordinators, and 33 home-bound older (mean age: 80 years; SD: 8.8) clients from eight VON sites and one partner organization participated in the evaluation. Data collection included pre-post quantitative measures of participants' physical function, satisfaction surveys of participants, follow up semi-structured interviews of participants, feedback surveys of volunteers and site coordinators, and a focus group interview of site coordinators. The Chair Stand test (p<0.001), the Reaching Forward test (p=0.028), the Activities Balance Confidence Scale (p=0.02), as well as measures of activities of daily living (ADL) inside the home (p=0.001) and outside the home (p=0.009) showed significant improvement. This evaluation showed that the exercises improved participants' strength, flexibility, balance, and ability to perform ADL. This study provides additional evidence of the benefits of in-home exercise for frail seniors, and supports a role for volunteers in delivering these programs. The volunteers reported receiving social benefits of meeting new people, being able to see the difference they helped make in others, as well as personal physical benefits from exercising more.

A translational research evaluation of the Stay Active and Independent for Life (SAIL) community-based fall prevention exercise and education program.

PubMed

York, Sally C; Shumway-Cook, Anne; Silver, Ilene F; Morrison, A Clare

2011-11-01

Falls in older adults are the leading cause of injury hospitalizations and fatalities in the United States; primary risk factors are muscle weakness, impaired mobility, and balance deficits. This article describes the 12-month translational research evaluation of the Stay Active and Independent for Life (SAIL) community-based public health, public domain fall prevention exercise and education program. Recruitment reached the target goal by 154%; 331 adults (mean age = 74.6) attended more than one class (mean classes attended = 24.8, SD = 26.6, range = 1-120) at nine community sites in one county in the 12-month period; 173 completed health and demographic forms, 132 completed program surveys, and 91 completed baseline and follow-up physical function tests. Physical function test results showed significant improvements in strength, balance, and mobility in those who were below normal limits at baseline, and in those who attended classes twice a week or more for more than 2 months. Survey results found that 93% of respondents reported improved performance of daily activities; 92% reported improved strength, balance, fitness, or flexibility; and 80% found the SAIL information guide education component helpful.

Cyber-Evaluation: Evaluating a Distance Learning Program.

ERIC Educational Resources Information Center

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Evaluation of a community health representative program among the Cree of northern Quebec.

PubMed

Lavallée, C; James, C A; Robinson, E J

1991-01-01

The James Bay Cree Community Health Representative (CHR) program was implemented in 1984 to train persons from the Cree population of northern Quebec to act as health care advocates and educators, as intermediaries between the Cree population, health services and local organizations, and as participants in assessing health needs. A formative evaluation was initiated which included quantitative analysis of the daily tasks of CHRs and a qualitative component based on documentary research, observation and semi-structured interviews. The evaluation revealed that CHRs actively participated in the ongoing community health programs mainly through health education; the people interviewed showed a high level of satisfaction. However, direct supervision, sufficient continuing education for the CHRs and better integration into health care teams are long-term goals which need to be emphasized in the program.

Ethical Development through Student Activities Programming.

ERIC Educational Resources Information Center

Brock, Carol S.

1991-01-01

Student activities programing, viewed as essential to the college experience, is defended by outlining some of the values and growth opportunities it provides for students. Several specific programing strategies useful as catalysts in values development are described, including values clarification exercises, multicultural programing, and…

Cancer Therapy Evaluation Program | Office of Cancer Genomics

Cancer.gov

The Cancer Therapy Evaluation Program (CTEP) seeks to improve the lives of cancer patients by finding better treatments, control mechanisms, and cures for cancer. CTEP funds a national program of cancer research, sponsoring clinical trials to evaluate new anti-cancer agents.

The SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION program - Technology Profiles

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) program was created to evaluate new and promising treatment technologies for cleanup at hazardous waste sites. The mission of the SITE program is to encourage the development and routine use of innovative treatment technologie...

18 CFR 1317.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 18 Conservation of Power and Water Resources 2 2011-04-01 2011-04-01 false Education programs or... NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 1317.400 Education programs...

18 CFR 1317.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 18 Conservation of Power and Water Resources 2 2010-04-01 2010-04-01 false Education programs or... NONDISCRIMINATION ON THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 1317.400 Education programs...

WQEP - a computer spreadsheet program to evaluate water quality data

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liddle, R.G.

1996-12-31

A flexible spreadsheet Water Quality Evaluation Program (WQEP) has been developed for mining companies, consultants, and regulators to interpret the results of water quality sampling. In order properly to evaluate hydrologic data, unit conversions and chemical calculations are done, quality control checks are needed, and a complete and up-to-date listing of water quality standards is necessary. This process is time consuming and tends not to be done for every sample. This program speeds the process by allowing the input of up to 115 chemical parameters from one sample. WQEP compares concentrations with EPA primary and secondary drinking water MCLs ormore » MCLG, EPA warmwater and Coldwater acute and chronic aquatic life criteria, irrigation criteria, livestock criteria, EPA human health criteria, and several other categories of criteria. The spreadsheet allows the input of State or local water standards of interest. Water quality checks include: anion/cations, TDS{sub m}/TDS{sub c} (where m=measured and c=calculated), EC{sub m}/EC{sub c}, EC{sub m}/ion sums, TDS{sub c}/EC ratio, TDS{sub m}/EC, EC vs. alkalinity, two hardness values, and EC vs. {Sigma} cations. WQEP computes the dissolved transport index of 23 parameters, computes ratios of 26 species for trend analysis, calculates non-carbonate alkalinity to adjust the bicarbonate concentration, and calculates 35 interpretive formulas (pE, SAR, S.I., unionized ammonia, ionized sulfide HS-, pK{sub x} values, etc.). Fingerprinting is conducted by automatic generation of stiff diagrams and ion histograms. Mass loading calculations, mass balance calculations, conversions of concentrations, ionic strength, and the activity coefficient and chemical activity of 33 parameters is calculated. This program allows a speedy and thorough evaluation of water quality data from metal mines, coal mining, and natural surface water systems and has been tested against hand calculations.« less

41 CFR 101-4.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 41 Public Contracts and Property Management 2 2011-07-01 2007-07-01 true Education programs or... EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 101-4.400 Education programs or activities. (a...

41 CFR 101-4.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 41 Public Contracts and Property Management 2 2010-07-01 2010-07-01 true Education programs or... EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 101-4.400 Education programs or activities. (a...

Behavioral patterns of environmental performance evaluation programs.

PubMed

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluative Thinking in Practice: The National Asthma Control Program.

PubMed

Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

Wait watchers: the application of a waiting list active management program in ambulatory care.

PubMed

de Belvis, Antonio Giulio; Marino, Marta; Avolio, Maria; Pelone, Ferruccio; Basso, Danila; Dei Tos, Gian Antonio; Cinquetti, Sandro; Ricciardi, Walter

2013-04-01

This study describes and evaluates the application of a waiting list management program in ambulatory care. Waiting list active management survey (telephone call and further contact); before and after controlled trial. Local Health Trust in Veneto Region (North-East of Italy) in 2008-09. Five hundred and one people on a 554 waiting list for C Class ambulatory care diagnostic and/or clinical investigations (electrocardiography plus cardiology ambulatory consultation, eye ambulatory consultation, carotid vessels Eco-color-Doppler, legs Eco-color-Doppler or colonoscopy, respectively). Active list management program consisting of a telephonic interview on 21 items to evaluate socioeconomic features, self-perceived health status, social support, referral physician, accessibility and patients' satisfaction. A controlled before-and-after study was performed to evaluate anonymously the overall impact on patients' self-perceived quality of care. The rate of patients with deteriorating healthcare conditions; rate of dropout; interviewed degree of satisfaction about the initiative; overall impact on citizens' perceived quality of care. 95.4% patients evaluated the initiative as useful. After the intervention, patients more likely to have been targeted with the program showed a statistically significant increase in self-reported quality of care. Positive impact of the program on some dimensions of ambulatory care quality (health status, satisfaction, willingness to remain in the queue), thus confirming the outstanding value of 'not to leave people alone' and 'not to leave them feeling themselves alone' in healthcare delivery.

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

PubMed

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Satellite power system: Concept development and evaluation program. Volume 3: Power transmission and reception. Technical summary and assessment

NASA Technical Reports Server (NTRS)

Dietz, R. H.; Arndt, G. D.; Seyl, J. W.; Leopold, L.; Kelley, J. S.

1981-01-01

Efforts in the DOE/NASA concept development and evaluation program are discussed for the solar power satellite power transmission and reception system. A technical summary is provided together with a summary of system assessment activities. System options and system definition drivers are described. Major system assessment activities were in support of the reference system definition, solid state system studies, critical technology supporting investigations, and various system and subsystem tradeoffs. These activities are described together with reference system updates and alternative concepts for each of the subsystem areas. Conclusions reached as a result of the numerous analytical and experimental evaluations are presented. Remaining issues for a possible follow-on program are identified.

The Integration of a Family Systems Approach for Understanding Youth Obesity, Physical Activity, and Dietary Programs

PubMed Central

Wilson, Dawn K.; St. George, Sara M.; Lawman, Hannah; Segal, Michelle; Fairchild, Amanda

2012-01-01

Rates of overweight in youth have reached epidemic proportions and are associated with adverse health outcomes. Family-based programs have been widely used to treat overweight in youth. However, few programs incorporate a theoretical framework for studying a family systems approach in relation to youth health behavior change. Therefore, this review provides a family systems theory framework for evaluating family-level variables in weight loss, physical activity, and dietary approaches in youth. Studies were reviewed and effect sizes were calculated for interventions that manipulated the family system, including components that targeted parenting styles, parenting skills, or family functioning, or which had novel approaches for including the family. Twenty-one weight loss interventions were identified, and 25 interventions related to physical activity and/or diet were identified. Overall, family-based treatment programs that incorporated training for authoritative parenting styles, parenting skills, or child management, and family functioning had positive effects on youth weight loss. Programs to improve physical activity and dietary behaviors that targeted the family system also demonstrated improvements in youth health behaviors; however, direct effects of parent-targeted programming is not clear. Both treatment and prevention programs would benefit from evaluating family functioning and parenting styles as possible mediators of intervention outcomes. Recommendations are provided to guide the development of future family-based obesity prevention and treatment programs for youth. PMID:20689989

15 CFR 8a.400 - Education programs or activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 15 Commerce and Foreign Trade 1 2011-01-01 2011-01-01 false Education programs or activities. 8a... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 8a.400 Education programs or...

15 CFR 8a.400 - Education programs or activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 1 2010-01-01 2010-01-01 false Education programs or activities. 8a... THE BASIS OF SEX IN EDUCATION PROGRAMS OR ACTIVITIES RECEIVING FEDERAL FINANCIAL ASSISTANCE Discrimination on the Basis of Sex in Education Programs or Activities Prohibited § 8a.400 Education programs or...

Evaluating Youth Development Programs: Progress and Promise

PubMed Central

Brooks-Gunn, Jeanne

2016-01-01

Advances in theories of adolescent development and positive youth development have greatly increased our understanding of how programs and practices with adolescents can impede or enhance their development. In this paper the authors reflect on the progress in research on youth development programs in the last two decades, since possibly the first review of empirical evaluations by Roth, Brooks-Gunn, Murray, and Foster (1998). The authors use the terms Version 1.0, 2.0 and 3.0 to refer to changes in youth development research and programs over time. They argue that advances in theory and descriptive accounts of youth development programs (Version 2.0) need to be coupled with progress in definitions of youth development programs, measurement of inputs and outputs that incorporate an understanding of programs as contexts for development, and stronger design and evaluation of programs (Version 3.0). The authors also advocate for an integration of prevention and promotion research, and for use of the term youth development rather than positive youth development. PMID:28077922

Evaluation of a Cardiovascular Education Pilot Program.

ERIC Educational Resources Information Center

Fang, Wei Li

1980-01-01

A Virginia elementary-secondary school blood pressure education program is described and evaluated. Evidence presented indicates that participants' cardiovascular knowledge levels increased significantly as a result of program participation. (JMF)

An Evaluation of the Bordertown Dormitory Program.

ERIC Educational Resources Information Center

Bass, Willard P.; And Others

The Bordertown Dormitory Program, providing Navajo students with experience in attending schools in off-reservation communities with non-Indian children, was evaluated in terms of the success of students; adequacy of dormitory and school facilities and programs; attitudes of students, parents, school personnel, and townspeople toward the program;…

Social Actions Education Evaluation Program.

DTIC Science & Technology

1986-04-01

ID-R1EE ?36 SOCIAL . ACTIONS EDUCATION EVALUATION P*OMRA(U) AIR v CONMAN AND STAFF COLL NAXUELL SF3 AL J L SKIDMORE APR 96 RCSC-S6-2215 UNCLRSSIFIED F...34 : AND STAFF COLLEGE -: [ -. STUDENT REPORT- TC SOCIAL ACTIONS EDUCATION - 1 $-EVALUATION PROGRAM D=TLC Lliii! MAIOR OANL.SIMMAND-35 IAP3 36 0- MAOR...must be included with any reproduced or adapted portions of this -_ document. 7-. Pk ~REPORT NUMBER 86-2315 TIT LE SOCIAL ACTIONS EDUCATION EVALUATION

Evaluation of the healthy schools program: Part I. Interim progress.

PubMed

Beam, Margaret; Ehrlich, Ginny; Donze Black, Jessica; Block, Audrey; Leviton, Laura C

2012-01-01

Federal and state policies identify schools as a setting to prevent childhood obesity, but schools need better health-promoting strategies. The objective of this study was to evaluate interim progress in schools receiving hands-on training from the Healthy Schools Program, the nation's largest school-based program aimed at preventing childhood obesity. The 4-year program targets schools with predominantly low-income, African American, or Hispanic students. In 2010 we assessed schools that enrolled in the 2007-2008 and 2008-2009 school years. School representatives completed an inventory of 8 content areas: policy and systems, school meals, competitive foods and beverages, health education, physical education, physical activity outside of physical education, before- and after-school programs, and school employee wellness. Schools' baseline inventory was compared by t test with the most recent inventory available. Schools made significant changes in all content areas, and effect sizes were moderate to large. Participating schools improved environmental policies and practices to prevent childhood obesity. The program is a resource to implement recent federal and state policies.

Summary of Pellet Technology Program Activities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gebhart, III, Gerald E.; Baylor, Larry R.; Bell, Gary L.

This report summarizes the activities and budget information of ORNL’s pellet technology program from the start of FY2014 through FY2017. Cost summaries are broken down by year and spending category. Milestone activities are outlined and described by year and further described in the project narrative. The project narrative outlines the main pellet injection technology advances enabled by the pellet technology program. A list of published research products is included, along with biographies of personnel involved. This document was prepared in support of the April 24, 2018, review of the pellet technology program at ORNL.

Impact of a workplace physical activity tracking program on biometric health outcomes.

PubMed

Yu, Jiani; Abraham, Jean M; Dowd, Bryan; Higuera, Lucas F; Nyman, John A

2017-12-01

Wellness programs are a popular strategy utilized by large U.S. employers. As mobile health applications and wearable tracking devices increase in prevalence, many employers now offer physical activity tracking applications. This longitudinal study evaluates the impact of engagement with a web-based, physical activity tracking program on changes in individuals' biometric outcomes in an employer population. The study population includes active employees and adult dependents continuously enrolled in an eligible health plan and who have completed at least two biometric screenings (n=36,882 person-years with 11,436 unique persons) between 2011 and 2014. Using difference-in-differences (DID) regression, we estimate the effect of participation in the physical activity tracking application on BMI, total cholesterol, and blood pressure. Participation was significantly associated with a reduction of 0.275 in BMI in the post-period, relative to the comparison group, representing a 1% change from baseline BMI. The program did not have a statistically significant impact on cholesterol or blood pressure. Sensitivity checks revealed slightly larger BMI reductions among participants with higher intensity of tracking activity and in the period following the employer's shift to an outcomes-based incentive design. Results are broadly consistent with the existing literature on changes in biometric outcomes from workplace initiatives promoting increased physical activity. Employers should have modest expectations about the potential health benefits of such programs, given current designs and implementation in real-world settings. Copyright © 2017 Elsevier Inc. All rights reserved.

76 FR 62813 - Pilot Program To Evaluate Proposed Proprietary Name Submissions; Public Meeting on Pilot Program...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-10-11

...] Pilot Program To Evaluate Proposed Proprietary Name Submissions; Public Meeting on Pilot Program Results... voluntary pilot program that enabled participating pharmaceutical firms to evaluate proposed proprietary... public meeting at the end of fiscal year 2011 to discuss the results of the pilot program, but the Agency...

Creating a Minnesota Statewide SNAP-Ed Program Evaluation

ERIC Educational Resources Information Center

Gold, Abby; Barno, Trina Adler; Sherman, Shelley; Lovett, Kathleen; Hurtado, G. Ali

2013-01-01

Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

A Comparison of Linear and Systems Thinking Approaches for Program Evaluation Illustrated Using the Indiana Interdisciplinary GK-12

ERIC Educational Resources Information Center

Dyehouse, Melissa; Bennett, Deborah; Harbor, Jon; Childress, Amy; Dark, Melissa

2009-01-01

Logic models are based on linear relationships between program resources, activities, and outcomes, and have been used widely to support both program development and evaluation. While useful in describing some programs, the linear nature of the logic model makes it difficult to capture the complex relationships within larger, multifaceted…

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

40 CFR 51.353 - Network type and program evaluation.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 2 2011-07-01 2011-07-01 false Network type and program evaluation. 51... Requirements § 51.353 Network type and program evaluation. Basic and enhanced I/M programs can be centralized.... (a) Presumptive equivalency. A decentralized network consisting of stations that only perform...

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

Program Review/Evaluation Policy and Procedures.

ERIC Educational Resources Information Center

Colorado Northwestern Community Coll., Rangely.

At Colorado Northwestern Community College (CNCC), all educational programs, as well as student services and support functions, are formally reviewed/evaluated in depth at least once every five years. This nine-part outline, providing a step-by-step description of the program review process at CNCC, includes the following sections: (1) the value…

Economic evaluation of area-wide pest management program to control asian tiger mosquito in New Jersey

USDA-ARS?s Scientific Manuscript database

Area-wide pest management (AWPM) is recommended to control urban mosquitoes, such as Aedes albopictus, which limit outdoor activities. While several evaluations of effectiveness exist, information on costs is lacking. Economic evaluation of such a program is important to help inform policy makers an...

Alberta: evaluation of nursing retention and recruitment programs.

PubMed

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Afterschool Alliance Backgrounder: Formal Evaluations of Afterschool Programs.

ERIC Educational Resources Information Center

Afterschool Alliance, Washington, DC.

Noting that various types of evaluations of after-school programming conducted over the last several years have provided useful information to providers and to policymakers, this report summarizes the lessons learned from independent evaluations of after-school programs. The following overall findings are supported with a delineation of findings…

Program Evaluation: Where Instruction and School Business Meet

ERIC Educational Resources Information Center

Ayers, Steven V.

2011-01-01

In this article, the author talks about program evaluation, a strategy commonly used by instructional leaders that can help school business officials improve their budget process. As districts struggle to develop budgets in these challenging economic times, school business officials might consider turning to program evaluation for help. Program…

Foreign Language K-12. Program Evaluation 1991-92.

ERIC Educational Resources Information Center

Wadden, Jerry M.

The Des Moines (Iowa) Public Schools foreign language program for K-12 is described and evaluated. The evaluation report focuses on six areas, including: (1) school district mission and philosophy of foreign language instruction; (2) context (state policies and standards, foreign language program overview and enrollment, fiber-optic communication…

Data Collection Methods for Evaluating Museum Programs and Exhibitions

ERIC Educational Resources Information Center

Nelson, Amy Crack; Cohn, Sarah

2015-01-01

Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

Custodians/Security Program Evaluation.

ERIC Educational Resources Information Center

Ennis, Bob

The Custodians/Security Department is a support service of the Des Moines (Iowa) Independent Community School District. Responsibilities of the department do not stop with the care of the facility, but extend to providing a clean, safe environment for all who use school facilities. Program evaluation in the 1993-94 school year reveals a total…

Health promotion in schools: a multi-method evaluation of an Australian School Youth Health Nurse Program.

PubMed

Banfield, Michelle; McGorm, Kelly; Sargent, Ginny

2015-01-01

Health promotion provides a key opportunity to empower young people to make informed choices regarding key health-related behaviours such as tobacco and alcohol use, sexual practices, dietary choices and physical activity. This paper describes the evaluation of a pilot School Youth Health Nurse (SYHN) Program, which aims to integrate a Registered Nurse into school communities to deliver health promotion through group education and individual sessions. The evaluation was guided by the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework. The objectives were to explore: 1) whether the Program was accessible to the high school students; 2) the impacts of the Program on key stakeholders; 3) which factors affected adoption of the Program; 4) whether implementation was consistent with the Program intent; and 5) the long-term sustainability of the Program. Research included retrospective analysis of Program records, administration of a survey of student experiences and interviews with 38 stakeholders. This evaluation provided evidence that the SYHN Program is reaching students in need, is effective, has been adopted successfully in schools, is being implemented as intended and could be maintained with sustained funding. The nurses deliver an accessible and acceptable primary health care service, focused on health promotion, prevention and early intervention. After some initial uncertainty about the scope and nature of the role, the nurses are a respected source of health information in the schools, consulted on curriculum development and contributing to whole-of-school health activities. Findings demonstrate that the SYHN model is feasible and acceptable to the students and schools involved in the pilot. The Program provides health promotion and accessible primary health care in the school setting, consistent with the Health Promoting Schools framework.

36 CFR 1211.400 - Education programs or activities.