Sample records for program evaluation program

  1. Effective Practices for Evaluating Education and Public Outreach Programs

    NASA Astrophysics Data System (ADS)

    Wilkerson, S.

    2013-12-01

    Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

  2. Guidelines for the Evaluation of Bilingual Education Programs.

    ERIC Educational Resources Information Center

    Cardoza, Desdemona

    Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…

  3. Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

    PubMed

    MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

    2006-01-01

    The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

  4. Non-formal educator use of evaluation results.

    PubMed

    Baughman, Sarah; Boyd, Heather H; Franz, Nancy K

    2012-08-01

    Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.

  5. A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

    ERIC Educational Resources Information Center

    Teller, Romney P.

    2011-01-01

    The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

  6. A Culturally Responsive Evaluation Approach Applied to the Talent Development School-to-Career Intervention Program

    ERIC Educational Resources Information Center

    Manswell-Butty, Jo-Anne L.; Reid, Malva Daniel; LaPoint, Velma

    2004-01-01

    Program evaluation has long been used to reveal program characteristics, merits, and challenges. While providing information about program effectiveness, evaluations can also ensure understanding of program outcomes, efficiency, and quality. Furthermore, evaluations can analyze and examine a program's political and social environment as well as…

  7. An Evaluation Program for the Eckerd Foundation Therapeutic Wilderness Camping Program: An Evaluation of an Atypical Alternative Education Program.

    ERIC Educational Resources Information Center

    Griffin, William H.; Carter, James D.

    The strategy used in evaluating an out-of-doors resident camping program for emotionally disturbed children is outlined. This strategy calls for examining the following elements in the program: (1) program goals and objectives; (2) collection and processing program data; (3) camper progress assessment; (4) program audit; (5) assessment of past…

  8. Leisure Today. Leisure Programming: The State of the Art.

    ERIC Educational Resources Information Center

    Busser, James A.; And Others

    1993-01-01

    Nine articles examine current topics in leisure programing, including program design and evaluation, program design through imagery, keys to quality leisure programing, programing with style, total quality program planning, evaluation of leisure programs, programing for older adults, and the intergenerational entrepreneurship demonstration…

  9. Curated Collections for Educators: Five Key Papers about Program Evaluation.

    PubMed

    Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

    2017-05-04

    The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

  10. Curated Collections for Educators: Five Key Papers about Program Evaluation

    PubMed Central

    Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

    2017-01-01

    The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

  11. Use of program logic models in the Southern Rural Access Program evaluation.

    PubMed

    Pathman, Donald; Thaker, Samruddhi; Ricketts, Thomas C; Albright, Jennifer B

    2003-01-01

    The Southern Rural Access Program (SRAP) evaluation team used program logic models to clarify grantees' activities, objectives, and timelines. This information was used to benchmark data from grantees' progress reports to assess the program's successes. This article presents a brief background on the use of program logic models--essentially charts or diagrams specifying a program's planned activities, objectives, and goals--for evaluating and managing a program. It discusses the structure of the logic models chosen for the SRAP and how the model concept was introduced to the grantees to promote acceptance and use of the models. The article describes how the models helped clarify the program's objectives and helped lead agencies plan and manage the many program initiatives and subcontractors in their states. Models also provided a framework for grantees to report their progress to the National Program Office and evaluators and promoted the evaluators' visibility and acceptance by the grantees. Program logics, however, increased grantees' reporting requirements and demanded substantial time of the evaluators. Program logic models, on balance, proved their merit in the SRAP through their contributions to its management and evaluation and by providing a better understanding of the program's initiatives, successes, and potential impact.

  12. Maximizing the Impact of Program Evaluation: A Discrepancy-Based Process for Educational Program Evaluation.

    ERIC Educational Resources Information Center

    Cantor, Jeffrey A.

    This paper describes a formative/summative process for educational program evaluation, which is appropriate for higher education programs and is based on M. Provus' Discrepancy Evaluation Model and the principles of instructional design. The Discrepancy Based Methodology for Educational Program Evaluation facilitates systematic and detailed…

  13. Program Fair Evaluation--Summative Appraisal of Instructional Sequences with Dissimilar Objectives.

    ERIC Educational Resources Information Center

    Popham, W. James

    A comparative evaluation involving two instructional programs is given, although the approach can easily serve to compare more than two programs. The steps involved in conducting a program fair evaluation of two instructional programs are: (1) Identify objectives (a) common to both programs, (b) unique to one program, and (c) unique to the other…

  14. The State of Evaluation in Internal Medicine Residency

    PubMed Central

    Holmboe, Eric; Beasley, Brent W.

    2008-01-01

    Background There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations. Objective To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation. Design Nationwide survey. Participants All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM). Measurements Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods. Results The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods. Conclusions Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high. PMID:18612734

  15. Using Evaluation to Guide and Validate Improvements to the Utah Master Naturalist Program

    ERIC Educational Resources Information Center

    Larese-Casanova, Mark

    2015-01-01

    Integrating evaluation into an Extension program offers multiple opportunities to understand program success through achieving program goals and objectives, delivering programming using the most effective techniques, and refining program audiences. It is less common that evaluation is used to guide and validate the effectiveness of program…

  16. Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

    PubMed

    Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

    2014-03-01

    Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

  17. Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

    PubMed Central

    Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

    2013-01-01

    Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

  18. Feedback Improvement in Automatic Program Evaluation Systems

    ERIC Educational Resources Information Center

    Skupas, Bronius

    2010-01-01

    Automatic program evaluation is a way to assess source program files. These techniques are used in learning management environments, programming exams and contest systems. However, use of automated program evaluation encounters problems: some evaluations are not clear for the students and the system messages do not show reasons for lost points.…

  19. Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

    PubMed

    Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

    2014-03-01

    There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

  20. Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

    PubMed

    Chen, Huey T

    2016-12-01

    Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

  1. The Spiral-Interactive Program Evaluation Model.

    ERIC Educational Resources Information Center

    Khaleel, Ibrahim Adamu

    1988-01-01

    Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

  2. The Evaluation Handbook: Guidelines for Evaluating Dropout Prevention Programs.

    ERIC Educational Resources Information Center

    Smink, Jay; Stank, Peg

    This manual, developed in an effort to take the mysticism out of program evaluation, discusses six phases of the program evaluation process. The introduction discusses reasons for evaluation, process and outcome evaluation, the purpose of the handbook, the evaluation process, and the Sequoia United School District Dropout Prevention Program. Phase…

  3. The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

    ERIC Educational Resources Information Center

    Daivs, Gregory

    2012-01-01

    Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

  4. 76 FR 62813 - Pilot Program To Evaluate Proposed Proprietary Name Submissions; Public Meeting on Pilot Program...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-10-11

    ...] Pilot Program To Evaluate Proposed Proprietary Name Submissions; Public Meeting on Pilot Program Results... voluntary pilot program that enabled participating pharmaceutical firms to evaluate proposed proprietary... public meeting at the end of fiscal year 2011 to discuss the results of the pilot program, but the Agency...

  5. A systematic review of evaluated suicide prevention programs targeting indigenous youth.

    PubMed

    Harlow, Alyssa F; Bohanna, India; Clough, Alan

    2014-01-01

    Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

  6. Evaluation of Career Guidance Programs: Models, Methods, and Microcomputers. Information Series No. 317.

    ERIC Educational Resources Information Center

    Crites, John O.

    Evaluating the effectiveness of career guidance programs is a complex process, and few comprehensive models for evaluating such programs exist. Evaluation of career guidance programs has been hampered by the myth that program outcomes are uniform and monolithic. Findings from studies of attribute treatment interactions have revealed only a few…

  7. Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

    ERIC Educational Resources Information Center

    Roberts, Erica Blue; Butler, James; Green, Kerry M.

    2018-01-01

    Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

  8. Evaluating Evaluations: The Case of Parent Involvement Programs

    ERIC Educational Resources Information Center

    Mattingly, Doreen J.; Prislin, Radmila; McKenzie, Thomas L.; Rodriguez, James L.; Kayzar, Brenda

    2002-01-01

    This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

  9. FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

    DOT National Transportation Integrated Search

    2018-02-01

    This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

  10. Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

    ERIC Educational Resources Information Center

    Heath, Robert W.; And Others

    Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

  11. Integrating Program Theory and Systems-Based Procedures in Program Evaluation: A Dynamic Approach to Evaluate Educational Programs

    ERIC Educational Resources Information Center

    Grammatikopoulos, Vasilis

    2012-01-01

    The current study attempts to integrate parts of program theory and systems-based procedures in educational program evaluation. The educational program that was implemented, called the "Early Steps" project, proposed that physical education can contribute to various educational goals apart from the usual motor skills improvement. Basic…

  12. Lessons from the trenches: meeting evaluation challenges in school health education.

    PubMed

    Young, Michael; Denny, George; Donnelly, Joseph

    2012-11-01

    Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.

  13. Right timing in formative program evaluation.

    PubMed

    Hall, Jori; Freeman, Melissa; Roulston, Kathy

    2014-08-01

    Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

  14. Lazy evaluation of FP programs: A data-flow approach

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Wei, Y.H.; Gaudiot, J.L.

    1988-12-31

    This paper presents a lazy evaluation system for the list-based functional language, Backus` FP in data-driven environment. A superset language of FP, called DFP (Demand-driven FP), is introduced. FP eager programs are transformed into DFP lazy programs which contain the notions of demands. The data-driven execution of DFP programs has the same effects of lazy evaluation. DFP lazy programs have the property of always evaluating a sufficient and necessary result. The infinite sequence generator is used to demonstrate the eager-lazy program transformation and the execution of the lazy programs.

  15. Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

    PubMed

    Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

    2017-02-01

    As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

  16. Evaluation of programs to improve complementary feeding in infants and young children.

    PubMed

    Frongillo, Edward A

    2017-10-01

    Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

  17. Moving the Needle on Program Quality: An Examination of the Organizational Characteristics That Drive Improvement in Expanded Learning Programs

    ERIC Educational Resources Information Center

    McCormick, Silvana

    2017-01-01

    Program evaluation can play a critical role in supporting high quality implementation of social programs to help them achieve their goal of social impact. Evaluation scholars have developed a wide range of strategies to help build programs' internal evaluation capacity in an effort to support meaningful use of evaluation. However, the evaluation…

  18. Educational Evaluation: Key Characteristics. ACER Research Series No. 102.

    ERIC Educational Resources Information Center

    Maling-Keepes, Jillian

    A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…

  19. 42 CFR 491.11 - Program evaluation.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 42 Public Health 5 2010-10-01 2010-10-01 false Program evaluation. 491.11 Section 491.11 Public... Certification; and FQHCs Conditions for Coverage § 491.11 Program evaluation. (a) The clinic or center carries out, or arranges for, an annual evaluation of its total program. (b) The evaluation includes review of...

  20. Evaluating Educational Programs. ERIC Digest Series Number EA 54.

    ERIC Educational Resources Information Center

    Beswick, Richard

    In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

  1. A Bereavement Support Program for Survivors of Cancer Deaths: A Description and Evaluation.

    ERIC Educational Resources Information Center

    Souter, Susan J.; Moore, Timothy E.

    1990-01-01

    Describes bereavement support program for survivors of cancer deaths developed by Riverdale Hospital in Toronto, Ontario. Presents detailed program evaluation which asked bereaved survivors who were program participants for one year to evaluate program aspects and facilitation of their grief by volunteers. Recommendations for expansion and…

  2. Title V Delinquency Prevention Program. Community Self-Evaluation Workbook.

    ERIC Educational Resources Information Center

    Caliber Associates, Fairfax, VA.

    This workbook is designed to help communities and program administrators assess the success of their Title V delinquency prevention programs, but it may serve as an evaluation tool for other prevention efforts as well. It provides information and resource aids on program planning, conducting evaluations, tracking programs, describing activities,…

  3. The Evaluation and Research of Multi-Project Programs: Program Component Analysis.

    ERIC Educational Resources Information Center

    Baker, Eva L.

    1977-01-01

    It is difficult to base evaluations on concepts irrelevant to state policy making. Evaluation of a multiproject program requires both time and differentiation of method. Data from the California Early Childhood Program illustrate process variables for program component analysis, and research questions for intraprogram comparison. (CP)

  4. LEA Title VII Program Evaluations. Panel Presentations.

    ERIC Educational Resources Information Center

    Balu, Raj

    These panel presentations focus on LEA Title VII Program Evaluations. Raj Balu, an administrator of bilingual programs in Chicago presents information regarding the bilingual education program in the Chicago public schools, as well as information on Title VII programs and what kind of evaluation is being done. Jesus Salazar, who is currently…

  5. Program Implementers' Evaluation of the Project P.A.T.H.S.: Findings Based on Different Datasets over Time

    PubMed Central

    Shek, Daniel T. L.; Ma, Cecilia M. S.

    2012-01-01

    This paper integrates the evaluation findings based on program implementers in nine datasets collected from 2005 to 2009 (244 schools and 7,926 implementers). Using consolidated data with schools as the unit of analysis, results showed that program implementers generally had positive perceptions of the program, themselves, and benefits of the program, with more than four-fifths of the implementers regarding the program as beneficial to the program participants. The subjective outcome evaluation instrument was found to be internally consistent. Multiple regression analyses revealed that perceived qualities of the program and program implementers predicted perceived effectiveness of the program. In conjunction with evaluation findings based on other sources, the present study provides support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes) in Hong Kong. PMID:22629224

  6. Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

    ERIC Educational Resources Information Center

    Maher, Charles A.

    1981-01-01

    Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

  7. Evaluation of Environmental Education in Schools.

    ERIC Educational Resources Information Center

    Connect, 1984

    1984-01-01

    This newsletter discusses the evaluation of environmental education (EE) in schools, highlighting an introductory chapter of a proposed Unesco-United Nations environmental program guide on evaluating such programs. The benefits of evaluating an EE program (including program improvement, growth in student learning, better environment, and program…

  8. Development, implementation, and evaluation of a multi-addiction prevention program for primary school students in Hong Kong: the B.E.S.T. Teen Program.

    PubMed

    Shek, Daniel T L; Yu, Lu; Leung, Hildie; Wu, Florence K Y; Law, Moon Y M

    Based on the evaluation findings of the B.E.S.T. Teen Program which aimed at promoting behavioral, emotional, social, and thinking competencies in primary school students, it is argued in this paper that promotion of psychosocial competence to prevent addiction in primary school students is a promising strategy. A total of 382 Primary 5 (Grade 5) and 297 Primary 6 (Grade 6) students from five primary schools in Hong Kong participated in the program. Different evaluation strategies were adopted to evaluate the program. First, objective outcome evaluation adopting a non-equivalent group pretest-posttest experimental-control group design was conducted to examine change in the students. Second, to gauge students' perceptions of the program, subjective outcome evaluation was conducted. The evaluation findings basically converged to tentatively suggest that young adolescents benefited from participating in the program. Implications on the development, implementation, and evaluation of addiction prevention programs for teenagers are discussed.

  9. Evaluating adolescent pregnancy programs: rethinking our priorities.

    PubMed

    Stahler, G J; DuCette, J P

    1991-01-01

    Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

  10. Planning Evaluation through the Program Life Cycle

    ERIC Educational Resources Information Center

    Scheirer, Mary Ann; Mark, Melvin M.; Brooks, Ariana; Grob, George F.; Chapel, Thomas J.; Geisz, Mary; McKaughan, Molly; Leviton, Laura

    2012-01-01

    Linking evaluation methods to the several phases of a program's life cycle can provide evaluation planners and funders with guidance about what types of evaluation are most appropriate over the trajectory of social and educational programs and other interventions. If methods are matched to the needs of program phases, evaluation can and should…

  11. The Evaluator's Role in Recommending Program Closure: A Model for Decision Making and Professional Responsibility

    ERIC Educational Resources Information Center

    Eddy, Rebecca M.; Berry, Tiffany

    2009-01-01

    Evaluators face challenges when programs consistently fail to meet expectations for performance or improvement and consequently, evaluators may recommend that closing a program is the most prudent course of action. However, the evaluation literature provides little guidance regarding when an evaluator might recommend program closure. Given…

  12. The Cost-Income Compenent of Program Evaluation.

    ERIC Educational Resources Information Center

    Miner, Norris

    Cost-income studies are designed to serve two functions in instructional program evaluation. First, they act as the indicator of the economic value of a program. This economic value in conjunction with the other educational values needed in program evaluation allow for the most realistic appraisal of program worth. Second, if the studies show a…

  13. Program Theory Evaluation: Logic Analysis

    ERIC Educational Resources Information Center

    Brousselle, Astrid; Champagne, Francois

    2011-01-01

    Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge.…

  14. Better Crunching: Recommendations for Multivariate Data Analysis Approaches for Program Impact Evaluations

    ERIC Educational Resources Information Center

    Braverman, Marc T.

    2016-01-01

    Extension program evaluations often present opportunities to analyze data in multiple ways. This article suggests that program evaluations can involve more sophisticated data analysis approaches than are often used. On the basis of a hypothetical program scenario and corresponding data set, two approaches to testing for evidence of program impact…

  15. Testing of a Program Evaluation Model: Final Report.

    ERIC Educational Resources Information Center

    Nagler, Phyllis J.; Marson, Arthur A.

    A program evaluation model developed by Moraine Park Technical Institute (MPTI) is described in this report. Following background material, the four main evaluation criteria employed in the model are identified as program quality, program relevance to community needs, program impact on MPTI, and the transition and growth of MPTI graduates in the…

  16. The Houston Community College Eligible Legalized Alien Program. Evaluation Program. Evaluation Report.

    ERIC Educational Resources Information Center

    Seaman, Don F.; Cuellar, Sylvia

    The Houston Community College (Texas) program (TOTAL ACCESS) designed in response to the Immigration Reform and Control Act of 1986, is described and evaluated. The program offers classes to eligible aliens (97% Hispanic Americans from Mexico, El Salvador, and Guatemala) wishing to pursue the educational program required for legalization. Program…

  17. Critical evaluation of international health programs: Reframing global health and evaluation.

    PubMed

    Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

    2018-04-01

    Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

  18. General Criteria for Evaluating Social Programs.

    ERIC Educational Resources Information Center

    Shipman, Stephanie

    1989-01-01

    A framework of general evaluation criteria for ensuring the comprehensiveness of program reviews and appropriate and fair comparison of children's programs is outlined. It has two components: (1) descriptive; and (2) evaluative. The framework was developed by researchers at the General Accounting Office for evaluation of federal programs. (TJH)

  19. 29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

  20. 29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

  1. 29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

  2. 29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

  3. Program Evaluation Interest and Skills of School Counselors

    ERIC Educational Resources Information Center

    Astramovich, Randall L.

    2017-01-01

    School counselors participated in a study examining their program evaluation interest and skills. Findings suggest that school counselors understand the importance of program evaluation, yet they may lack the skills and confidence to successfully engage in program evaluation activities. Professional development training may be an important method…

  4. 29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

  5. Evaluating Continuing Education Needs and Program Effectiveness Using a Survey of Virginia's SHARP Logger Program Participants

    ERIC Educational Resources Information Center

    Barrett, Scott M.; Bolding, M. Chad; Munsell, John F.

    2012-01-01

    Virginia's SHARP logger program is a Cooperative Extension program currently providing training to over 1,500 loggers, foresters, and others. We conducted a mail survey of SHARP loggers to characterize program participants, assess programming needs, and evaluate program effectiveness. Results indicate a diverse group of participants in terms of…

  6. INSREC: Computational System for Quantitative Analysis of Radiation Effects Covering All Radiation Field

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Dong Hoon Shin; Young Wook Lee; Young Ho Cho

    2006-07-01

    In the nuclear energy field, there are so many difficult things that even people who are working in this field are not much familiar with, such as, Dose evaluation, Dose management, etc. Thus, so many efforts have been done to achieve the knowledge and data for understanding. Although some data had been achieved, the applications of these data to necessary cases were more difficult job. Moreover, the type of Dose evaluation program until now was 'Console type' which is not easy enough to use for the beginners. To overcome the above causes of difficulties, the window-based integrated program and databasemore » management were developed in our research lab. The program, called as INSREC, consists of four sub-programs as follow; INSREC-NOM, INSREC-ACT, INSREC-MED, and INSREC-EXI. In ICONE 11 conference, INSREC-program(ICONE-36203) which can evaluates on/off-site dose of nuclear power plant in normal operation was introduced. Upgraded INSREC-program which will be presented in ICONE 14 conference has three additional codes comparing with pre-presented INSREC-program. Those subprograms can evaluate on/off-site Dose of nuclear power plant in accident cases. And they also have the functions of 'Dose evaluation and management' in the hospital and provide the 'Expert system' based on knowledge related to nuclear energy/radiation field. The INSREC-NOM, one of subprograms, is composed of 'Source term evaluation program', 'Atmospheric diffusion factor evaluation program', 'Off-site dose evaluation program', and 'On-site database program'. The INSREC-ACT is composed of 'On/Off-site dose evaluation program' and 'Result analysis program' and the INSREC-MED is composed of 'Workers/patients dose database program' and 'Dose evaluation program for treatment room'. The final one, INSREC-EXI, is composed of 'Database searching program based on artificial intelligence', 'Instruction program,' and 'FAQ/Q and A boards'. Each program was developed by using of Visual C++, Microsoft Access mainly. To verify the reliability, some suitable programs were selected such as AZAP and Stardose programs for the comparison. The AZAP program was selected for the on/off-site dose evaluation during the normal operation of nuclear reactor and Stardose program was used for the on/off-site dose evaluation in accident. The MCNP code was used for the dose evaluation and management in the hospital. Each comparison result was acceptable in errors analysis. According to the reliable verification results, it was concluded that INSREC program had an acceptable reliability for dose calculation and could give many proper dada for the sites. To serve the INSREC to people, the proper server system was constructed. We gave chances for the people (user) to utilize the INSREC through network connected to server system. The reactions were pretty much good enough to be satisfied. For the future work, many efforts will be given to improve the better user-interface and more necessary data will be provided to more people through database supplement and management. (authors)« less

  7. The Mother and Infant Home Visiting Program Evaluation: Early Findings on the Maternal, Infant, and Early Childhood Home Visiting Program. A Report to Congress. OPRE Report 2015-11

    ERIC Educational Resources Information Center

    Michalopoulos, Charles; Lee, Helen; Duggan, Anne; Lundquist, Erika; Tso, Ada; Crowne, Sarah Shea; Burrell, Lori; Somers, Jennifer; Filene, Jill H.; Knox, Virginia

    2015-01-01

    "The Mother and Infant Home Visiting Program Evaluation: Early Findings on the Maternal, Infant, and Early Childhood Home Visiting Program--A Report to Congress" presents the first findings from the Mother and Infant Home Visiting Program Evaluation (MIHOPE), the legislatively mandated national evaluation of the Maternal, Infant, and…

  8. Developing Your Evaluation Plans: A Critical Component of Public Health Program Infrastructure.

    PubMed

    Lavinghouze, S Rene; Snyder, Kimberly

    A program's infrastructure is often cited as critical to public health success. The Component Model of Infrastructure (CMI) identifies evaluation as essential under the core component of engaged data. An evaluation plan is a written document that describes how to monitor and evaluate a program, as well as how to use evaluation results for program improvement and decision making. The evaluation plan clarifies how to describe what the program did, how it worked, and why outcomes matter. We use the Centers for Disease Control and Prevention's (CDC) "Framework for Program Evaluation in Public Health" as a guide for developing an evaluation plan. Just as using a roadmap facilitates progress on a long journey, a well-written evaluation plan can clarify the direction your evaluation takes and facilitate achievement of the evaluation's objectives.

  9. Measuring Success: Evaluating Educational Programs

    ERIC Educational Resources Information Center

    Fisher, Yael

    2010-01-01

    This paper reveals a new evaluation model, which enables educational program and project managers to evaluate their programs with a simple and easy to understand approach. The "index of success model" is comprised of five parameters that enable to focus on and evaluate both the implementation and results of an educational program. The…

  10. The Role of Evaluation and Plans for Evaluating the Current Testing Program.

    ERIC Educational Resources Information Center

    Winters, Lynn

    The Palos Verdes Peninsula Unified School District Office of Program Evaluation and Research is responsible for providing information for program development and improvement; providing test information to special programs coordinators; and acting as a clearinghouse for all information concerning tests, evaluation methodology, and educational…

  11. Tools for Formative Evaluation: Gathering the Information Necessary for Program Improvement

    ERIC Educational Resources Information Center

    Jayaratne, K. S. U.

    2016-01-01

    New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

  12. Evaluating Faculty Development and Clinical Training Programs in Substance Abuse: A Guide Book.

    ERIC Educational Resources Information Center

    Klitzner, Michael; Stewart, Kathryn

    Intended to provide an overview of program evaluation as it applies to the evaluation of faculty development and clinical training programs in substance abuse for health and mental health professional schools, this guide enables program developers and other faculty to work as partners with evaluators in the development of evaluation designs that…

  13. The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

    ERIC Educational Resources Information Center

    Buttram, Joan L.; Covert, Robert W.

    The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

  14. Learning From Small-Scale Experimental Evaluations of After School Programs. Snapshot Number 8

    ERIC Educational Resources Information Center

    Harvard Family Research Project, Harvard University, 2006

    2006-01-01

    The Harvard Family Research Project (HFRP) Out-of-School Time Program Evaluation Database contains profiles of out-of-school time (OST) program evaluations. Its purpose is to provide accessible information about previous and current evaluations to support the development of high quality evaluations and programs in the OST field. Types of Programs…

  15. Evaluation of a Demonstration Program for Postsecondary Hospitality Education.

    ERIC Educational Resources Information Center

    Weis, Susan F.

    A three-phase program evaluation effort employing comparison groups and a pre-post test design indicate formative guidelines for programs revision and summative results indicative of the effectiveness of a demonstration associate degree program for hospitality education. Program effectiveness is defined in terms of the program's enrollment of…

  16. Process Evaluation for a Prison-based Substance Abuse Program.

    ERIC Educational Resources Information Center

    Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

    2000-01-01

    Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

  17. Evaluation of the Radiography Program at Caldwell Community College and Technical Institute--Summer, 1982.

    ERIC Educational Resources Information Center

    Pipes, V. David

    As part of a periodic evaluation of the occupational programs at Caldwell Community College and Technical Institute (CCC&TI), a study of the radiography program was conducted to collect information to facilitate planning, aid in program improvement, and meet accountability demands. The specific objectives of the program evaluation were to…

  18. Is Evaluative Research on Youth Suicide Programs Theory-Driven? The Canadian Experience.

    ERIC Educational Resources Information Center

    Breton, Jean-Jacques; Boyer, Richard; Bilodeau, Henriette; Raymond, Sylvaine; Joubert, Natacha; Nantel, Marie-Andree

    2002-01-01

    A review found that only 15 Canadian youth suicide programs were evaluated over the last decade. Descriptions of the programs were incomplete and theoretical bases for programs were not presented. Only two programs led to a reduction in suicidal behavior. Suggests that future evaluative research needs to place greater emphasis on content and…

  19. Guidelines "PEP," Peer Evaluation Program. A Systematic Approach for Evaluating Educational Programs, 1973-1974.

    ERIC Educational Resources Information Center

    Grotsky, Jeffery N.; And Others

    The Peer Evaluation Program (PEP) has been instituted by the Division of Special Education, Pennsylvania State Department of Education, to allow intermediate units an opportunity to continuously improve their programs. The advantages of the PEP system are: (1) it is a self-improvememt system of program development; (2) PEP allows local autonomy as…

  20. Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

    ERIC Educational Resources Information Center

    Hawkins, J. David; Nederhood, Britt

    This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

  1. Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

    PubMed

    Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

    2016-06-01

    Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

  2. A novel resident-as-teacher training program to improve and evaluate obstetrics and gynecology resident teaching skills.

    PubMed

    Ricciotti, Hope A; Dodge, Laura E; Head, Julia; Atkins, K Meredith; Hacker, Michele R

    2012-01-01

    Residents play a significant role in teaching, but formal training, feedback, and evaluation are needed. Our aims were to assess resident teaching skills in the resident-as-teacher program, quantify correlations of faculty evaluations with resident self-evaluations, compare resident-as-teacher evaluations with clinical evaluations, and evaluate the resident-as-teacher program. The resident-as-teacher training program is a simulated, videotaped teaching encounter with a trained medical student and standardized teaching evaluation tool. Evaluations from the resident-as-teacher training program were compared to evaluations of resident teaching done by faculty, residents, and medical students from the clinical setting. Faculty evaluation of resident teaching skills in the resident-as-teacher program showed a mean total score of 4.5 ± 0.5 with statistically significant correlations between faculty assessment and resident self-evaluations (r = 0.47; p < 0.001). However, resident self-evaluation of teaching skill was lower than faculty evaluation (mean difference: 0.4; 95% CI 0.3-0.6). When compared to the clinical setting, resident-as-teacher evaluations were significantly correlated with faculty and resident evaluations, but not medical student evaluations. Evaluations from both the resident-as-teacher program and the clinical setting improved with duration of residency. The resident-as-teacher program provides a method to train, give feedback, and evaluate resident teaching.

  3. Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

    ERIC Educational Resources Information Center

    Bhola, H. S.

    Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

  4. From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

    NASA Astrophysics Data System (ADS)

    Shebby, S.

    2015-12-01

    Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

  5. A review of elementary school-based substance use prevention programs: identifying program attributes.

    PubMed

    Hopfer, S; Davis, D; Kam, J A; Shin, Y; Elek, E; Hecht, M L

    2010-01-01

    This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary school-based substance use prevention programs were reviewed. The study selection criteria included searching for program evaluations from 1980 to 2008. Among 27 evaluation studies that examined program effects on substance use, 56% (n = 15) found significant decreases. In addition, programs most often demonstrated effects on increasing negative substance use attitudes, increasing knowledge, decreasing perceptions of prevalence rates (i.e., descriptive norms), and improving resistance skills. These results have implications for the appropriateness and value of introducing substance use prevention programs to youth in elementary school.

  6. Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

    ERIC Educational Resources Information Center

    Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

    2011-01-01

    This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

  7. Program Theory and Quality Matter: Changing the Course of Extension Program Evaluation

    ERIC Educational Resources Information Center

    Arnold, Mary E.; Cater, Melissa

    2016-01-01

    As internal evaluators for the 4-H program in two states, we simultaneously yet independently began to change the way we approached our evaluation practices, turning from evaluation capacity building (ECB) efforts that prepared educators to define and measure program outcomes to strategies that engage educators in defining and measuring program…

  8. Program Evaluation of Community College Learning Assistance Centers: What Do LAC Directors Think?

    ERIC Educational Resources Information Center

    Franklin, Doug; Blankenberger, Bob

    2016-01-01

    Objective: This study seeks to determine the nature of current program evaluation practices for learning assistance centers (LACs), the practices being used for program evaluation, and whether LAC directors believe their practices are appropriate for evaluating program effectiveness. Method: We conducted a survey (n = 61) of community college LAC…

  9. Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

    NASA Astrophysics Data System (ADS)

    Moin, Laura

    2009-10-01

    The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

  10. Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

    PubMed

    Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

    2017-02-01

    Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  11. Non-Formal Educator Use of Evaluation Results

    ERIC Educational Resources Information Center

    Baughman, Sarah; Boyd, Heather H.; Franz, Nancy K.

    2012-01-01

    Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational…

  12. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM: PROGRESS AND ACCOMPLISHMENTS - FISCAL YEAR 1991

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) program was the first major program for demonstrating and evaluating full-scale innovative treatment technologies at hazardous waste sites. Having concluded its fifth year, the SITE program is recognized as a leading advocate ...

  13. Evaluating a Small-Group Counseling Program--A Model for Program Planning and Improvement in the Elementary Setting

    ERIC Educational Resources Information Center

    Bostick, Dee; Anderson, Ron

    2009-01-01

    School counselors are under increasing pressure to evaluate their programs in a manner consistent with teachers and other educators. A small-group counseling intervention was used by a school counselor as part of a three-level program planning initiative that illustrated best research practices to evaluate program outcomes. Forty-nine third-grade…

  14. Evaluation of a peer assessment approach for enhancing the organizational capacity of state injury prevention programs.

    PubMed

    Hunter, Wanda M; Schmidt, Ellen R; Zakocs, Ronda

    2005-01-01

    To conduct a formative and pilot impact evaluation of the State Technical Assessment Team (STAT) program, a visitation-based (visitatie) peer assessment program designed to enhance the organizational capacity of state health department injury prevention programs. The formative evaluation was based on observational, record review, and key informant interview data collected during the implementation of the first 7 STAT visits. Pilot impact data were derived from semi-structured interviews with state injury prevention personnel one year after the visit. Formative evaluation identified 6 significant implementation problems in the first visits that were addressed by the program planners, resulting in improvements to the STAT assessment protocol. Impact evaluation revealed that after one year, the 7 state injury prevention programs had acted on 81% of the recommendations received during their STAT visits. All programs reported gains in visibility and credibility within the state health department and increased collaboration and cooperation with other units and agencies. Other significant program advancements were also reported. Specific program standards and review procedures are important to the success of peer assessment programs such as STAT. Early impact evaluation suggests that peer assessment protocols using the visitatie model can lead to gains in organizational capacity.

  15. An Evaluation of the Right Choices Program to Determine Effectiveness in Delivering Constructive Interventions and Providing an Early Support Program in Order to Modify Behavior of First-Time Student Offenders Who Commit Drug and Violent Acts

    ERIC Educational Resources Information Center

    Barnes, Lisa B.

    2010-01-01

    The purpose of the study was to perform a program evaluation of the Right Choices Program to determine the program's effectiveness in delivering constructive interventions that modify student behavior once students have left the program and have returned to their regular learning environment. This mixed-method evaluation consisted of an…

  16. Evaluation of NASA space grant consortia programs

    NASA Technical Reports Server (NTRS)

    Eisenberg, Martin A.

    1990-01-01

    The meaningful evaluation of the NASA Space Grant Consortium and Fellowship Programs must overcome unusual difficulties: (1) the program, in its infancy, is undergoing dynamic change; (2) the several state consortia and universities have widely divergent parochial goals that defy a uniform evaluative process; and (3) the pilot-sized consortium programs require that the evaluative process be economical in human costs less the process of evaluation comprise the effectiveness of the programs they are meant to assess. This paper represents an attempt to assess the context in which evaluation is to be conducted, the goals and limitations inherent to the evaluation, and to recommend appropriate guidelines for evaluation.

  17. Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

    PubMed

    Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

    2015-04-01

    In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

  18. Design and Operation of the Transformed National Healthy Start Evaluation.

    PubMed

    Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K

    2017-12-01

    Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.

  19. Housing First and Photovoice: Transforming Lives, Communities, and Systems

    PubMed Central

    Barile, John P.; Ogawa, Terry Yasuko; Peralta, Nelson; Bugg, Reumell; Lau, John; Lamberton, Thomas; Hall, Corazon; Mori, Victor

    2018-01-01

    This article presents findings from a community-based participatory evaluation of a Housing First program on the Island of O’ahu. In this study, clients in a Housing First program used Photovoice to evaluate the program and to advocate for progressive housing policies. Written together by members of the Housing First Photovoice group, this collaborative article describes the outcomes from both the Housing First program and the Photovoice project and demonstrates the ways in which participatory program evaluations can interact with client-driven programs like Housing First to produce a cumulative, transformative impact. Findings suggest that community psychologists hoping to re-engage with community mental health systems through enacting transformative change should consider taking a community-based participatory approach to program evaluation because increased client voice in community mental health programs and their evaluations can have far-reaching, transformative impacts for research, practice, and policy. PMID:29323410

  20. Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

    PubMed

    Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

    2015-01-01

    US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

  1. Language Program Evaluation

    ERIC Educational Resources Information Center

    Norris, John M.

    2016-01-01

    Language program evaluation is a pragmatic mode of inquiry that illuminates the complex nature of language-related interventions of various kinds, the factors that foster or constrain them, and the consequences that ensue. Program evaluation enables a variety of evidence-based decisions and actions, from designing programs and implementing…

  2. Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Not Available

    1992-12-31

    The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

  3. State Education Department: Security over Pupil Evaluation Program and Program Evaluation Test Materials Needs Improvement. Report 91-S-2.

    ERIC Educational Resources Information Center

    New York State Office of the Comptroller, Albany.

    Findings of an audit of the New York State Education Department's procedures to maintain security over Pupil Evaluation Program (PEP) and Program Evaluation Test (PET) examination materials are presented in this report. The audit sought to determine whether the department's security procedures adequately prevented unauthorized access to exam…

  4. Austin Independent School District Office of Program Evaluation Agenda 1998-99. Publication Number 98.01.

    ERIC Educational Resources Information Center

    Austin Independent School District, TX. Office of Program Evaluation.

    The Office of Program Evaluation (OPE) of the Austin Independent School District (Texas) (AISD) is charged with evaluating federally, locally, and state funded programs in the AISD. OPE staff carry out mandated reporting for federal and state grants and are increasingly involved in formative evaluations designed for program improvement and…

  5. How To Design a Program Evaluation. CSE Program Evaluation Kit, Volume 3. Second Edition.

    ERIC Educational Resources Information Center

    Fitz-Gibbon, Carol Taylor; Morris, Lynn Lyons

    The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

  6. Integrating Data Mining in Program Evaluation of K-12 Online Education

    ERIC Educational Resources Information Center

    Hung, Jui-Long; Hsu, Yu-Chang; Rice, Kerry

    2012-01-01

    This study investigated an innovative approach of program evaluation through analyses of student learning logs, demographic data, and end-of-course evaluation surveys in an online K-12 supplemental program. The results support the development of a program evaluation model for decision making on teaching and learning at the K-12 level. A case study…

  7. 45 CFR 2516.850 - What will the Corporation do to evaluate the overall success of the service-learning program?

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... overall success of the service-learning program? 2516.850 Section 2516.850 Public Welfare Regulations...-LEARNING PROGRAMS Evaluation Requirements § 2516.850 What will the Corporation do to evaluate the overall success of the service-learning program? (a) The Corporation will conduct independent evaluations. These...

  8. 45 CFR 2516.850 - What will the Corporation do to evaluate the overall success of the service-learning program?

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... overall success of the service-learning program? 2516.850 Section 2516.850 Public Welfare Regulations...-LEARNING PROGRAMS Evaluation Requirements § 2516.850 What will the Corporation do to evaluate the overall success of the service-learning program? (a) The Corporation will conduct independent evaluations. These...

  9. National Weatherization Assistance Program Characterization - Describing the Pre-ARRA Progam

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Bensch, Ingo; Keene, Ashleigh; Cowan, Claire

    2014-09-01

    This report characterizes the Department of Energy s Weatherization Assistance Program (WAP) as it was administered in Program Year 2008. WAP has supported energy efficiency improvements to the homes of low-income households in the United States since 1976. The program provides grants, guidance, and other support to grantees: weatherization programs administered by each of the 50 states, the District of Columbia and some Native American tribes. Although there have been studies of some grantee-administered weatherization programs, the overall effectiveness of the national weatherization program has not been formally evaluated since Program Year 1989. Since that time, the program has evolvedmore » significantly, with an increased focus on baseload electric usage, continued evolution of diagnostic tools, new guidelines and best practices for heating-related measures, and adjustments in program rules. More recently, the program has also adjusted to large, temporary funding increases and changes in federal rules spurred by the American Recovery and Reinvestment Act (ARRA). Because the Weatherization Assistance Program of today is dramatically different from the one evaluated in 1989, DOE determined to undertake a new comprehensive evaluation of the national program. This new national evaluation is managed by Oak Ridge National Laboratory (ORNL). Under a competitive solicitation process, ORNL selected APPRISE, Inc., Blasnik & Associates, Dalhoff Associates and the Energy Center of Wisconsin to conduct the evaluation. The national evaluation comprises two independent evaluations. The first evaluation of which this report is a part focuses on Program Year 2008 (PY08). The second evaluation focuses on the ARRA-funded years of 2009 through 2011. This report, together with its companion the Eligible Population Study addresses specific program characterization goals established for the greater evaluation. The Energy Center led grantee and subgrantee data collection efforts, administering surveys to 51 grantees and 851 of the approximately 900 subgrantees that were slated to receive DOE weatherization funds in PY08. In all, seven different data collection instruments were used to gather the needed data two instruments for grantees and five for subgrantees. See Table 1 for a list of these survey instruments. These surveys were used to determine, among other things: Structure and funding of weatherization programs Training and staff development of service providers How weatherization services are delivered Clients served« less

  10. Evaluating Social Programs at the State and Local Level. The JTPA Evaluation Design Project.

    ERIC Educational Resources Information Center

    Blalock, Ann Bonar, Ed.; And Others

    This book on evaluating social programs is an outcome of the Job Training Partnership Act (JTPA) Evaluation Design Project, which produced a set of 10 guides for the evaluation of state and local JTPA programs. This book distills ideas from these guides and applies them to a larger context. Part 1 presents a general approach to program evaluation…

  11. Apollo Photograph Evaluation (APE) programming manual

    NASA Technical Reports Server (NTRS)

    Kim, I. J.

    1974-01-01

    This document describes the programming techniques used to implement the equations of the Apollo Photograph Evaluation (APE) program on the UNIVAC 1108 computer and contains detailed descriptions of the program structure, a User's Guide section to provide the necessary information for proper operation of the program, and information for the assessment of the program's adaptability to future problems.

  12. State Guidelines for School Athletic Programs.

    ERIC Educational Resources Information Center

    California State Dept. of Education, Sacramento.

    The guidelines presented here are designed to assist school personnel in developing, administering, and evaluating school athletic programs in California. Topics include: (1) the basic philosophy for school athletic programs; (2) procedures for evaluating school athletic programs; (3) the three-phase school athletic program; (4) resources to…

  13. Adult Literacy Education: Program Evaluation and Learner Assessment. Information Series No. 338.

    ERIC Educational Resources Information Center

    Lytle, Susan L.; Wolfe, Marcie

    Adult literacy programs need reliable information about program quality and effectiveness for accountability, improvement of practice, and expansion of knowledge. Evaluation and assessment reflect fundamental beliefs about adult learners, concepts of literacy, and educational settings. Resources for planning program evaluations include surveys,…

  14. Resident Evaluation and Remediation: A Comprehensive Approach

    PubMed Central

    Wu, Jim S.; Siewert, Bettina; Boiselle, Phillip M.

    2010-01-01

    Background A comprehensive evaluation and remediation program is an essential component of any residency program. The evaluation system should identify problems accurately and early and allow residents with problems to be assigned to a remediation program that effectively deals with them. Elements of a proactive remediation program include a process for outlining deficiencies, providing resources for improvement, communicating clear goals for acceptable performance, and reevaluating performance against these goals. Intervention In recognition of the importance of early detection and prompt remediation of the struggling resident, we sought to develop a multifaceted approach to resident evaluation with the aim of early identification and prompt remediation of difficulties. This article describes our comprehensive evaluation program and remediation program, which uses resources within our radiology department and institutional graduate medical education office. Discussion An effective evaluation system should identify problems accurately and early, whereas a proactive remediation program should effectively deal with issues once they are identified. PMID:21975628

  15. Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program.

    PubMed

    Hallinan, Christine M

    2010-01-01

    In this paper, program logic will be used to 'map out' the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.

  16. Program review: resource evaluation, reservoir confirmation, and exploration technology

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Ward, S.H.

    1978-05-01

    The details of the program review are reported. A summary of the recommendations, means for their implementation, and a six year program of expenditures which would accomplish the objectives of the recommendations are presented. Included in appendices are the following: DOE/DGE consortia participants; program managers contacted for opinion; communications received from program managers; participants, program review panel; and program strategy for resource evaluation and reservoir confirmation. (MHR)

  17. Flight program language requirements. Volume 2: Requirements and evaluations

    NASA Technical Reports Server (NTRS)

    1972-01-01

    The efforts and results are summarized for a study to establish requirements for a flight programming language for future onboard computer applications. Several different languages were available as potential candidates for future NASA flight programming efforts. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of detailed language requirements was synthesized from these activities. The details of program language requirements and of the language evaluations are described.

  18. The Nursing Leadership Institute program evaluation: a critique

    PubMed Central

    Havaei, Farinaz; MacPhee, Maura

    2015-01-01

    A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses’ union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? PMID:29355180

  19. A responsive evaluation of an Aboriginal nursing education access program.

    PubMed

    Curran, Vernon; Solberg, Shirley; LeFort, Sandra; Fleet, Lisa; Hollett, Ann

    2008-01-01

    Nursing education access programs have been introduced in a number of countries to address the shortage of healthcare providers of Aboriginal descent. An evaluation study of a nursing education access program in Labrador, Canada, was undertaken using a Responsive Evaluation approach. Interviews and focus groups with program stakeholders were conducted. Program effectiveness was influenced by culturally relevant curriculum, experiential and authentic learning opportunities, academic and social support, and the need for partnership building between stakeholders. The authors report key findings resulting from the Responsive Evaluation.

  20. An overview of the effectiveness and efficiency of HIV prevention programs.

    PubMed Central

    Holtgrave, D R; Qualls, N L; Curran, J W; Valdiserri, R O; Guinan, M E; Parra, W C

    1995-01-01

    Because of the enormity of the HIV-AIDS epidemic and the urgency for preventing transmission, HIV prevention programs are a high priority for careful and timely evaluations. Information on program effectiveness and efficiency is needed for decision-making about future HIV prevention priorities. General characteristics of successful HIV prevention programs, programs empirically evaluated and found to change (or not change) high-risk behaviors or in need of further empirical study, and economic evaluations of certain programs are described and summarized with attention limited to programs that have a behavioral basis. HIV prevention programs have an impact on averting or reducing risk behaviors, particularly when they are delivered with sufficient resources, intensity, and cultural competency and are based on a firm foundation of behavioral and social science theory and past research. Economic evaluations have found that some of these behaviorally based programs yield net economic benefits to society, and others are likely cost-effective (even if not cost-saving) relative to other health programs. Still, specific improvements should be made in certain HIV prevention programs. PMID:7630989

  1. Program Evaluation at Foothill College.

    ERIC Educational Resources Information Center

    Lowe, Irel D.

    Evaluation systems were designed for the assessment of the instructional and non-instructional programs at Foothill College (California) to determine whether the objectives of the programs were being met and to ascertain the direct and indirect costs of the programs. For the instructional programs, criteria for determining effectiveness, revenue…

  2. 7 CFR 225.15 - Management responsibilities of sponsors.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... forms. Application forms or descriptive materials given to households about applying for free meals must... evaluate, fund, or determine benefits for their programs, and with auditors for program reviews and law... programs to help them evaluate, fund, or determine benefits for their programs; auditors for program...

  3. Documenting Progress and Demonstrating Results: Evaluating Local Out-of-School Time Programs.

    ERIC Educational Resources Information Center

    Little, Priscilla; DuPree, Sharon; Deich, Sharon

    A collaborative publication between Harvard Family Research Project and The Finance Project, this brief offers guidance in documenting progress and demonstrating results in local out-of-school-time programs. Following introductory remarks providing a rationale for program evaluation, discussing principles of program evaluation, and clarifying key…

  4. What Do We Know about School-Based Management?

    ERIC Educational Resources Information Center

    Patrinos, Harry Anthony; Fasih, Tazeen; Barrera, Felipe; Garcia-Moreno, Vicente A.; Bentaouet-Kattan, Raja; Baksh, Shaista; Wickramasekera, Inosha

    2007-01-01

    Impact evaluations of school-based management (SBM) programs, or any other kind of program, are important because they can demonstrate whether or not the program has accomplished its objectives. Furthermore, these evaluations can identify ways to improve the design of the program. These evaluations can also make successful interventions…

  5. 40 CFR 51.353 - Network type and program evaluation.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 2 2011-07-01 2011-07-01 false Network type and program evaluation. 51... Requirements § 51.353 Network type and program evaluation. Basic and enhanced I/M programs can be centralized.... (a) Presumptive equivalency. A decentralized network consisting of stations that only perform...

  6. Creating an Information Literacy Badges Program in Blackboard: A Formative Program Evaluation

    ERIC Educational Resources Information Center

    Tunon, Johanna; Ramirez, Laura Lucio; Ryckman, Brian; Campbell, Loy; Mlinar, Courtney

    2015-01-01

    A formative program evaluation using Stufflebeam's (2010) Context, Input, Process, Product (CIPP) model was conducted to assess the use of digital badges for tracking basic library instructional skills across academic programs at Nova Southeastern University. Based on the evaluation of pilot library modules and Blackboard Learn's badges…

  7. 29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 29 Labor 9 2012-07-01 2012-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

  8. 29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 29 Labor 9 2014-07-01 2014-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

  9. 29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 29 Labor 9 2013-07-01 2013-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

  10. 29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 29 Labor 9 2011-07-01 2011-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

  11. Home-Start between Childhood and Maturity: A Programme Evaluation.

    ERIC Educational Resources Information Center

    Terpstra, Linda; van Dijke, Anke

    A crucial question for evaluating nationally or internationally implemented programs is whether local adaptations detract from program quality and effectiveness. An evaluation examined the program successes and challenges encountered in the first 5 years of Home-Start in the Netherlands, a home-based family support program for families with young…

  12. Maryland Community Colleges 1980 Program Evaluations.

    ERIC Educational Resources Information Center

    Maryland State Board for Community Colleges, Annapolis.

    This report contains qualitative evaluations of 48 programs throughout the Maryland community college system, as well as a statewide evaluation of Teacher Education transfer programs. A summary of the Teacher Education programs is presented first, in which the purpose and role of teacher education in the community college, enrollment trends,…

  13. 29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 29 Labor 9 2010-07-01 2010-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

  14. Masonry Program Standards.

    ERIC Educational Resources Information Center

    Georgia Univ., Athens. Dept. of Vocational Education.

    This publication contains statewide standards for the masonry program in Georgia. The standards are divided into 12 categories: foundations (philosophy, purpose, goals, program objectives, availability, evaluation); admissions (admission requirements, provisional admission requirements, recruitment, evaluation and planning); program structure…

  15. Evaluating Educational Programs.

    ERIC Educational Resources Information Center

    Ball, Samuel

    The activities of Educational Testing Service (ETS) in evaluating educational programs are described. Program evaluations are categorized as needs assessment, formative evaluation, or summative evaluation. Three classic efforts which illustrate the range of ETS' participation are the Pennsylvania Goals Study (1965), the Coleman Report--Equality of…

  16. Evaluating an employee wellness program.

    PubMed

    Mukhopadhyay, Sankar; Wendel, Jeanne

    2013-12-01

    What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

  17. Intern evaluation strategies in family medicine residency education: what is-and is not-being done.

    PubMed

    Yates, Jennifer E

    2013-06-01

    Family medicine interns often have deficiencies that are not initially appreciated. By recognizing those growth opportunities early, programs may be able to better meet their interns' training needs. This study provides a needs assessment to ascertain what evaluation tools are being utilized by residency programs to assess their incoming interns. A questionnaire was sent to all US family medicine residency program coordinators (439 programs) via Survey Monkey© inquiring about whether intern evaluation is performed and, if so, what strategies are used. A mixed mode methodology was used: mailing with incentive, email prompts, and telephone calls. Of 439 programs, 220 (50%) responded to the survey. Most respondents (145, 66%) think intern evaluation is needed. However, only 79 (36%) programs are actually doing intern evaluations-only 14 (6.4%) extensively. Most programs are performing simulations (81, 45%) and assessing knowledge/comfort levels (79, 36%); less than one third are considering personality/learning styles, and almost no programs are evaluating skills such as typing (three, 1.4%) and math (one, 0.5%). Many programs use evaluations to guide future planning, help with early identification of challenging learners, and to match training to the residents' needs. Several programs expressed concern about how they would use the information once obtained. The majority of respondents agreed that a baseline intern evaluation is useful; few are actually doing it. This area is not well-described in the literature; residency programs could benefit from information sharing. The next step is to encourage interest in and implementation of such strategies.

  18. Evaluation of the Academic Occupational Program of the County of Leduc, From September, 1981 to June, 1984. Executive Summary.

    ERIC Educational Resources Information Center

    Nyberg, V. R.

    The paper reports results of an academic occupational program intended for educable mentally handicapped and learning disabled secondary students in Leduc, Alberta. An introduction reviews history of the program and the evaluation process. The evaluation plan, based on R. Stake's model for program evaluation, is described, and sources of data…

  19. Human Services Program Evaluation: "How to Improve Your Accountability and Program Effectiveness"

    ERIC Educational Resources Information Center

    Barrett, Thomas; Sorensen, James

    2015-01-01

    The term "outcome evaluation" has become one of the most popular terms among human service providers and those whose job it is to evaluate the impact of human service programs. In the public sector alone, there are over a hundred instruments in use to evaluate the impact of state human service programs. Most states, many providers, and…

  20. A multidimensional evaluation of a nursing information-literacy program.

    PubMed Central

    Fox, L M; Richter, J M; White, N E

    1996-01-01

    The goal of an information-literacy program is to develop student skills in locating, evaluating, and applying information for use in critical thinking and problem solving. This paper describes a multidimensional evaluation process for determining nursing students' growth in cognitive and affective domains. Results indicate improvement in student skills as a result of a nursing information-literacy program. Multidimensional evaluation produces a well-rounded picture of student progress based on formal measurement as well as informal feedback. Developing new educational programs can be a time-consuming challenge. It is important, when expending so much effort, to ensure that the goals of the new program are achieved and benefits to students demonstrated. A multidimensional approach to evaluation can help to accomplish those ends. In 1988, The University of Northern Colorado School of Nursing began working with a librarian to integrate an information-literacy component, entitled Pathways to Information Literacy, into the curriculum. This article describes the program and discusses how a multidimensional evaluation process was used to assess program effectiveness. The evaluation process not only helped to measure the effectiveness of the program but also allowed the instructors to use several different approaches to evaluation. PMID:8826621

  1. Toward building a typology for the evaluation of services in family support programs.

    PubMed

    Manalo, V; Meezan, W

    2000-01-01

    This article briefly reviews the history, philosophy, practice principles, and foci of family support programs, examines the typologies currently in use to classify these programs, and discusses the difficulties these classifications pose for program evaluators. The authors introduce a new typology that deconstructs family support programs into their component services and discuss the potential of this typology for evaluation of family support services.

  2. An Empirical Evaluation of the Florida Tax Credit Scholarship Program. School Choice Issues in the State

    ERIC Educational Resources Information Center

    Forster, Greg; D'Andrea, Christian

    2009-01-01

    This study examines the Florida Tax Credit Scholarship program, one of the nation's largest school choice programs. It is the first ever completed empirical evaluation of a tax-credit scholarship program, a type of program that creates school choice through the tax code. Earlier reports, including a recent one on the Florida program, have not…

  3. Motivation for Evaluation: A roadmap for Improving Program Efficacy

    NASA Astrophysics Data System (ADS)

    Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

    2016-12-01

    Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.

  4. 23 CFR 637.207 - Quality assurance program.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... independent assurance (IA) program consisting of the following: (1) Acceptance program. (i) Each STD's... quality control samples. (C) The quality control sampling and testing is evaluated by an IA program. (iii... appropriate. See 23 CFR 635.413(e) for specific requirements. (2) The IA program shall evaluate the qualified...

  5. An Evaluation of Knowledge Transfer from Microworld Programming to Conventional Programming

    ERIC Educational Resources Information Center

    Xinogalos, Stelios

    2012-01-01

    Programming microworlds are being used for introducing students to programming for many years. Although many professors and school teachers report positive results from using programming microwords, these results are usually based on anecdotal evidence rather than rigorous empirical evaluation. A question that has not been answered yet with…

  6. Constructing and Verifying Program Theory Using Source Documentation

    ERIC Educational Resources Information Center

    Renger, Ralph

    2010-01-01

    Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such…

  7. The Stanford Medical Youth Science Program: Educational and Science-Related Outcomes

    ERIC Educational Resources Information Center

    Crump, Casey; Ned, Judith; Winkleby, Marilyn A.

    2015-01-01

    Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer…

  8. Strategies for Evaluating Complex Environmental Education Programs

    NASA Astrophysics Data System (ADS)

    Williams, V.

    2011-12-01

    Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

  9. Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

    PubMed

    Hardré, Patricia L; Slater, Janis; Nanny, Mark

    2010-11-01

    This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

  10. Solar energy program evaluation: an introduction

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    deLeon, P.

    The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the rolemore » and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)« less

  11. Evaluation readiness: improved evaluation planning using a data inventory framework.

    PubMed

    Cohen, A B; Hall, K C; Cohodes, D R

    1985-01-01

    Factors intrinsic to many programs, such as ambiguously stated objectives, inadequately defined performance measures, and incomplete or unreliable databases, often conspire to limit the evaluability of these programs. Current evaluation planning approaches are somewhat constrained in their ability to overcome these obstacles and to achieve full preparedness for evaluation. In this paper, the concept of evaluation readiness is introduced as a complement to other evaluation planning approaches, most notably that of evaluability assessment. The basic products of evaluation readiness--the formal program definition and the data inventory framework--are described, along with a guide for assuring more timely and appropriate evaluation response capability to support the decision making needs of program managers. The utility of evaluation readiness for program planning, as well as for effective management, is also discussed.

  12. Overview of a pharmacist anticoagulation certificate program.

    PubMed

    Kirk, Julienne K; Edwards, Rebecca; Brewer, Andrew; Miller, Cathey; Bray, Bryan; Groce, James B

    2017-07-01

    To describe the design of an ongoing anticoagulation certificate program and annual renewal update for pharmacists. Components of the anticoagulation certificate program include home study, pre- and posttest, live sessions, case discussions with evaluation and presentation, an implementation plan, and survey information (program evaluation and use in practice). Clinical reasoning skills were assessed through case work-up and evaluation prior to live presentation. An annual renewal program requires pharmacists to complete home study and case evaluations. A total of 361 pharmacists completed the anticoagulation certificate program between 2002 and 2015. Most (62%) practiced in ambulatory care and 38% in inpatient care settings (8% in both). In the past four years, 71% were working in or starting anticoagulation clinics in ambulatory and inpatient settings. In their evaluations of the program, an average of 90% of participants agreed or strongly agreed the lecture material was relevant and objectives were met. Pharmacists are able to apply knowledge and skills in management of anticoagulation. This structured practice-based continuing education program was intended to enhance pharmacy practice and has achieved that goal. The certificate program in anticoagulation was relevant to pharmacists who attended the program. Copyright © 2017. Published by Elsevier Inc.

  13. The opportunities and challenges of multi-site evaluations: lessons from the jail diversion and trauma recovery national cross-site evaluation.

    PubMed

    Stainbrook, Kristin; Penney, Darby; Elwyn, Laura

    2015-06-01

    Multi-site evaluations, particularly of federally funded service programs, pose a special set of challenges for program evaluation. Not only are there contextual differences related to project location, there are often relatively few programmatic requirements, which results in variations in program models, target populations and services. The Jail Diversion and Trauma Recovery-Priority to Veterans (JDTR) National Cross-Site Evaluation was tasked with conducting a multi-site evaluation of thirteen grantee programs that varied along multiple domains. This article describes the use of a mixed methods evaluation design to understand the jail diversion programs and client outcomes for veterans with trauma, mental health and/or substance use problems. We discuss the challenges encountered in evaluating diverse programs, the benefits of the evaluation in the face of these challenges, and offer lessons learned for other evaluators undertaking this type of evaluation. Copyright © 2015 Elsevier Ltd. All rights reserved.

  14. Comparative Evaluation of Financing Programs: Insights From California’s Experience

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Deason, Jeff

    Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less

  15. A combined impact-process evaluation of a program promoting active transport to school: understanding the factors that shaped program effectiveness.

    PubMed

    Crawford, S; Garrard, J

    2013-01-01

    This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts.

  16. A Combined Impact-Process Evaluation of a Program Promoting Active Transport to School: Understanding the Factors That Shaped Program Effectiveness

    PubMed Central

    Crawford, S.; Garrard, J.

    2013-01-01

    This mixed methods study was a comprehensive impact-process evaluation of the Ride2School program in metropolitan and regional areas in Victoria, Australia. The program aimed to promote transport to school for primary school children. Qualitative and quantitative data were collected at baseline and followup from two primary schools involved in the pilot phase of the program and two matched comparison schools, and a further 13 primary schools that participated in the implementation phase of the program. Classroom surveys, structured and unstructured observations, and interviews with Ride2School program staff were used to evaluate the pilot program. For the 13 schools in the second phase of the program, parents and students completed questionnaires at baseline (N = 889) and followup (N = 761). Based on the quantitative data, there was little evidence of an overall increase in active transport to school across participating schools, although impacts varied among individual schools. Qualitative data in the form of observations, interviews, and focus group discussions with students, school staff, and program staff provided insight into the reasons for variable program impacts. This paper highlights the benefits of undertaking a mixed methods approach to evaluating active transport to school programs that enables both measurement and understanding of program impacts. PMID:23606865

  17. The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

    PubMed

    Logan, Robert A; Kreps, Gary L

    2014-12-01

    This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

  18. Tailored program evaluation: Past, present, future.

    PubMed

    Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

    2006-11-01

    This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

  19. The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

    NASA Astrophysics Data System (ADS)

    Luera, Gail Rose

    As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.

  20. An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

    PubMed

    Rorrer, Audrey S

    2016-04-01

    This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

  1. Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

    PubMed

    Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

    2011-06-01

    This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

  2. Outcomes and lessons learned from evaluating TRICARE's disease management programs.

    PubMed

    Dall, Timothy M; Askarinam Wagner, Rachel C; Zhang, Yiduo; Yang, Wenya; Arday, David R; Gantt, Cynthia J

    2010-06-01

    To share outcomes and lessons learned from an evaluation of disease management (DM) programs for asthma, congestive heart failure (CHF), and diabetes for TRICARE patients. Multiyear evaluation of participants in voluntary, opt-out DM programs. Patient-centered programs, administered by 3 regional contractors, provide phone-based consultations with a care manager, educational materials, and newsletters. The study sample consisted of 23,793 asthma, 4092 CHF, and 29,604 diabetes patients with at least 6 months' tenure in the program. Medical claims were analyzed to quantify program effect on healthcare utilization, medical costs, and clinical outcomes. Multivariate regression analysis with an historical control group was used to predict patient outcomes in the absence of DM. The difference between actual and predicted DM patient outcomes was attributed to the program. A patient survey collected data on program satisfaction and perceived usefulness of program information and services. Modest improvements in patient outcomes included reduced inpatient days and medical costs, and (with few exceptions) increased percentages of patients receiving appropriate medications and tests. Annual per patient reductions in medical costs were $453, $371, and $783 for asthma, CHF, and diabetes program participants, respectively. The estimated return on investment was $1.26 per $1.00 spent on DM services. Findings suggest that the DM programs more than pay for themselves, in addition to improving patient health and quality of life. Lessons learned in program design, implementation, effectiveness, and evaluation may benefit employers contemplating DM, DM providers, and evaluators of DM programs.

  3. Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

    PubMed

    Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

    2016-03-01

    Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  4. Evaluating a physician leadership development program - a mixed methods approach.

    PubMed

    Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

    2016-05-16

    Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

  5. Program Evaluation in Gifted Education. Essential Readings in Gifted Education Series

    ERIC Educational Resources Information Center

    Callahan, Carolyn M., Ed.; Reis, Sally M., Ed.

    2004-01-01

    The readings in this ready-reference report on specific program evaluations, offer critical guidance in the development and utilization of instruments for assessing gifted and talented programs, and are designed to stimulate the discussion of issues surrounding the evaluation of gifted programs. Key features include: (1) Carolyn M. Callahan's…

  6. A Program Evaluation Tool for Dual Enrollment Transition Programs

    ERIC Educational Resources Information Center

    Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

    2012-01-01

    This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

  7. EVALUATION OF THE WEIGHT-BASED COLLECTION PROJECT IN FARMINGTON, MINNESOTA: A MITE PROGRAM EVALUATION

    EPA Science Inventory

    This project evaluates a test program of a totally automated weight-based refuse disposal rate system. his test program was conducted by the City of Farmington, Minnesota between 1991 and 1993. he intent of the program was to test a mechanism which would automatically assess a fe...

  8. Applying the Concept of Trustworthiness to the Evaluation of a Clinical Program.

    ERIC Educational Resources Information Center

    Barzansky, Barbara; And Others

    An attending tutor program designed to increase faculty-student contact within an Obstetrics and Gynecology clerkship was evaluated. Sessions were observed, written documents were reviewed, and faculty and students were interviewed in order to determine if the program was meeting its goals. Based on the evaluation data, the program was…

  9. Evaluation of a Community-Based Aging Intervention Program

    ERIC Educational Resources Information Center

    Hsu, Hui-Chuan; Wang, Chun-Hou; Chen, Yi-Chun; Chang, Ming-Chen; Wang, Jean

    2010-01-01

    This study evaluated the outcome and process of a community-based aging intervention program for the elderly in Taiwan. The program included education on nutrition and dietary behavior and on physical activities. Outcome and process evaluations were conducted. The program may have had some effects on decreasing some dietary behavioral problems and…

  10. Assessment and Evaluation of the Utah Master Naturalist Program: Implications for Targeting Audiences

    ERIC Educational Resources Information Center

    Larese-Casanova, Mark

    2011-01-01

    The Utah Master Naturalist Program trains citizens who provide education, outreach, and service to promote citizen stewardship of natural resources within their communities. In 2007-2008, the Watersheds module of the program was evaluated for program success, and participant knowledge was assessed. Assessment and evaluation results indicated that…

  11. Some Measures of Evaluation and Effectiveness in Social Work Practice.

    ERIC Educational Resources Information Center

    Kapoor, J. M.

    Measures of accountability and evaluation of social work program efforts are examined. Evaluation of program effort refers to an assessment of the amount and kinds of program activities considered necessary for the accomplishment of program goals within a particular stage of development. It refers not only to staff time, activity, and commitment,…

  12. Formative Evaluation of the Canada Student Loans Program. Final Report

    ERIC Educational Resources Information Center

    Human Resources and Skills Development Canada, 2004

    2004-01-01

    The "Formative Evaluation of the Canada Student Loans Program" was undertaken to assess issues of program relevance, design and delivery and for the purposes of examining the early impacts of changes made to the program since 1998. The evaluation also reviewed the Performance Measurement Strategy contained in the July 2002 Results-Based…

  13. Evaluation of a Research Mentorship Program in Community Care

    ERIC Educational Resources Information Center

    Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

    2008-01-01

    This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

  14. Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness☆

    PubMed Central

    Sobelson, Robyn K.; Young, Andrea C.

    2017-01-01

    The Centers for Public Health Preparedness (CPHP) program was a five-year cooperative agreement funded by the Centers for Disease Control and Prevention (CDC). The program was initiated in 2004 to strengthen terrorism and emergency preparedness by linking academic expertise to state and local health agency needs. The purposes of the evaluation study were to identify the results achieved by the Centers and inform program planning for future programs. The evaluation was summative and retrospective in its design and focused on the aggregate outcomes of the CPHP program. The evaluation results indicated progress was achieved on program goals related to development of new training products, training members of the public health workforce, and expansion of partnerships between accredited schools of public health and state and local public health departments. Evaluation results, as well as methodological insights gleaned during the planning and conduct of the CPHP evaluation, were used to inform the design of the next iteration of the CPHP Program, the Preparedness and Emergency Response Learning Centers (PERLC). PMID:23380597

  15. Report of the Evaluation of the Race/Human Relations Program. Student and Staff Program and Long Range Goals. Baseline Year 1982-83. Evaluation Services Department Report No. 348.

    ERIC Educational Resources Information Center

    Tomblin, Elizabeth A.; And Others

    In response to a 1982 Superior Court order, a centrally developed, sequential program for improving race/human relations in the San Diego City Schools was developed and field tested or implemented during the 1982-83 school year. This systematic evaluation reports on the student program, "Conflict"; the staff program; and baseline data…

  16. An Interprofessional Program Evaluation Case Study: Utilizing Multiple Measures To Assess What Matters. AIR 1997 Annual Forum Paper.

    ERIC Educational Resources Information Center

    Delaney, Anne Marie

    This paper reviews the first two years of a model program-evaluation case study which is intended to show: (1) how program evaluation can contribute to academic and professional degree programs; (2) how qualitative and quantitative techniques can be used to produce reliable measures for evaluation studies; and (3) how the role of the institutional…

  17. Exploring the Suitability of an English for Health Sciences Program: Model and Report of a Self-Evaluation Process

    ERIC Educational Resources Information Center

    Ferrer, Erica; Pérez, Yuddy

    2017-01-01

    Program evaluation is a process of carefully collecting information in order to make informed decisions to strengthen specific components of a given program. The type of evaluation an institution decides to undertake depends on the purpose as well as on the information the institution wants to find out about its program. Self-evaluation represents…

  18. Evaluation of the Washington, D.C. Parking Enforcement Program

    DOT National Transportation Integrated Search

    1982-09-01

    This report documents the evaluation of the Washington, DC, parking enforcement program. This comprehensive program is operated by the District of Columbia, Department of Transportation (DC DOT). The program has resulted in the successful integration...

  19. Assessment of Learning and Program Evaluation in Health Professions Education Programs

    ERIC Educational Resources Information Center

    Moore, Donald E., Jr.

    2018-01-01

    This chapter proposes approaches for assessing learners and evaluating courses and curriculum that could be used by directors of health professions education (HPE) programs to determine the effectiveness and impact of their programs.

  20. An Examination of the Indiana State University Aerospace Administration Program

    NASA Technical Reports Server (NTRS)

    Schwab, Gregory L.

    2005-01-01

    Declining enrollments in the Indiana State University (ISU) aerospace administration program prompted this case study. which evaluates the program in comparison with parallel programs at other universities, industry standards, and an independent audit. Survey instruments were administered to graduates, faculty, and employers for their views on competencies of an excellent aerospace administration program Results show the deficiency of the ISU program. Graduates, faculty, and employers rated all competencies-from moderate to considerable importance-similarly for an excellent program. Recommendations for program improvement were made, and suggestions for further research include studies to evaluate the effectiveness of a revised aerospace administration program.

  1. Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

    PubMed Central

    Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

    2015-01-01

    Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271

  2. Methods for evaluating a mature substance abuse prevention/early intervention program.

    PubMed

    Becker, L R; Hall, M; Fisher, D A; Miller, T R

    2000-05-01

    The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

  3. Using Art For Health Promotion: Evaluating an In-School Program Through Student Perspectives.

    PubMed

    McKay, Fiona H; McKenzie, Hayley

    2017-09-01

    The value of incorporating arts-based approaches into health promotion programs has long been recognized as useful in affecting change. Such approaches have been used in many schools across Australia and have been found to promote general well-being and mental health. Despite these positive findings, few programs have used or evaluated an integrated arts-based approach to achieve health and well-being goals. This article presents the findings of an evaluation of an integrated arts-based program focused on creativity and improving well-being in students. The findings of this evaluation suggest that students who took part in the program were more interested in art and music at the end of the program and had gained an overall increase in awareness and mindfulness and a positivity toward leisure activities. This evaluation provides some evidence to suggest that this type of program is a promising way to promote well-being in schools.

  4. Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

    PubMed Central

    Van der Wees, Philip J; Hendriks, Erik JM; Custers, Jan WH; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

    2007-01-01

    Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program. PMID:18036215

  5. Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

    PubMed

    Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

    2007-11-23

    Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program.

  6. An Evaluation of a Mixed-Gender Sexual Assault Prevention Program

    ERIC Educational Resources Information Center

    Bradley, April R.; Yeater, Elizabeth A.; O'Donohue, William

    2009-01-01

    This study evaluated the short-term effectiveness of a mixed-gender sexual assault prevention program developed for college students. Program participants (n = 177) were compared to non-program participants (n = 132) prior to the program and during a 2-week follow-up period on measures of rape myths, victim empathy, perceived negative consequences…

  7. Title I, ESEA Program Evaluation, 1967-68. Program Research and Development.

    ERIC Educational Resources Information Center

    Jacobs, James N., Ed.; Felix, Joseph L., Ed.

    This report comprises a Title I ESEA Program evaluation for 1967-68 in Cincinnati Public Schools. To make greater concentration of services possible, lesser target schools were phased out of the 1967-68 program. The five projects comprising the 1967-68 program were: Elementary School remediation and enrichment; Secondary School remediation and…

  8. The Positive Alternative Credit Experience (PACE) Program a Quantitative Comparative Study

    ERIC Educational Resources Information Center

    Warren, Rebecca Anne

    2011-01-01

    The purpose of this quantitative comparative study was to evaluate the Positive Alternative Credit Experience (PACE) Program using an objectives-oriented approach to a formative program evaluation. The PACE Program was a semester-long high school alternative education program designed to serve students at-risk for academic failure or dropping out…

  9. Theory and models for planning and evaluating institutional influenza prevention and control programs.

    PubMed

    Russell, Margaret L; Thurston, Wilfreda E; Henderson, Elizabeth A

    2003-10-01

    Low rates of staff influenza vaccine coverage occur in many health care facilities. Many programs do not offer vaccination to physicians or to volunteers, and some programs do not measure coverage or do so only for a subset of staff. The use of theory in planning and evaluation may prevent these problems and lead to more effective programs. We discuss the use of theory in the planning and evaluation of health programs and demonstrate how it can be used for the evaluation and planning of a hospital or nursing home influenza control program. The application of theory required explicit statement of the goals of the program and examination of the assumptions underlying potential program activities. This indicated that staff should probably be considered as employees, volunteers, physicians, and contractors of the facility. It also directed attention to evidence-based strategies for increasing vaccination rates. The application of a program planning model to a problem of institutional influenza prevention may prevent planners from excluding important target populations and failing to monitor the important indicators of program success.

  10. Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting.

    PubMed

    Smith, Katherine; Firth, Kimberly; Smeeding, Sandra; Wolever, Ruth; Kaufman, Joanna; Delgado, Roxana; Bellanti, Dawn; Xenakis, Lea

    2016-01-01

    Research suggests that the development of mind-body skills can improve individual and family resilience, particularly related to the stresses of illness, trauma, and caregiving. To operationalize the research evidence that mind-body skills help with health and recovery, Samueli Institute, in partnership with experts in mind-body programming, created a set of guidelines for developing and evaluating mind-body programs for service members, veterans, and their families. The Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting outline key strategies and issues to consider when developing, implementing, and evaluating a mind-body focused family empowerment approach in a military healthcare setting. Although these guidelines were developed specifically for a military setting, most of the same principles can be applied to the development of programs in the civilian setting as well. The guidelines particularly address issues unique to mind-body programs, such as choosing evidence-based modalities, licensure and credentialing, safety and contraindications, and choosing evaluation measures that capture the holistic nature of these types of programs. The guidelines are practical, practice-based guidelines, developed by experts in the fields of program development and evaluation, mind-body therapies, patient- and family-centered care, as well as, experts in military and veteran's health systems. They provide a flexible framework to create mind-body family empowerment programs and describe important issues that program developers and evaluators are encouraged to address to ensure the development of the most impactful, successful, evidence-supported programs possible. Copyright © 2016 Elsevier Inc. All rights reserved.

  11. Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

    PubMed

    Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

    2018-06-01

    Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

  12. Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

    PubMed

    Colantonio, A

    1989-01-01

    Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

  13. Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

    PubMed Central

    Colantonio, A.

    1989-01-01

    Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

  14. Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

    PubMed

    Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

    2016-11-01

    A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

  15. Evaluating an English Language Teacher Education Program through Peacock's Model

    ERIC Educational Resources Information Center

    Coskun, Abdullah; Daloglu, Aysegul

    2010-01-01

    The main aim of this study is to draw attention to the importance of program evaluation for teacher education programs and to reveal the pre-service English teacher education program components that are in need of improvement or maintenance both from teachers' and students' perspectives by using Peacock's (2009) recent evaluation model in a…

  16. Using a Crystal Ball Instead of a Rear-View Mirror: Helping State Legislators Assess the Future Impacts of Major Federal Legislation

    ERIC Educational Resources Information Center

    Alter, Joel; Patterson, John

    2006-01-01

    Typically, program evaluation agencies in the legislative branch of state government examine programs that have already been implemented. These evaluations often consider whether a program achieved the legislature's original goals or complied with statutory requirements. Program evaluations frequently determine whether executive branch agencies…

  17. Participants' perceptions of the 1997-1998 Missouri State Parks Passport Program

    Treesearch

    Yi-Jin Ye; Jaclyn Card

    2002-01-01

    Service quality is increasingly important to park managers. Recreation and park evaluation measures the implementation and outcome of programs for decision-making. Decisions based on evaluations are often concerned with improving the quality of the program for participants. The purpose of the study was to evaluate the Missouri State Parks Passport Program (MSPPP) by...

  18. Evaluation of Turkish Education Programs

    ERIC Educational Resources Information Center

    Durmuscelebi, Mustafa

    2010-01-01

    The aim of this study is to evaluate the new Turkish education program that has been being implemented since 2005 gradually in light of teacher suggestions. The study has been done in scanning model. In this study which has been conducted with the purpose of evaluating the newly prepared Turkish education programs, the program has been tried to be…

  19. An Evaluation of On-Line, Interactive Tutorials Designed to Teach Practice Concepts

    ERIC Educational Resources Information Center

    Seabury, Brett A.

    2005-01-01

    This paper presents an evaluation of two on-line-based programs designed to teach practice skills. One program teaches crisis intervention and the other teaches suicide assessment. The evaluation of the use of these programs compares outcomes for two groups of students, one using the interactive program outside a class context and the other using…

  20. Evaluation of Selected New York City Umbrella Programs, 1974-1975 School Year.

    ERIC Educational Resources Information Center

    Fordham Univ., Bronx, NY. Inst. for Research and Evaluation.

    An evaluation of twelve different New York City Umbrella Programs coordinated in New York City public schools during the 1974-1975 school year is contained in this document. This report presents a description and evaluation of these programs, together with the major findings. The programs were implemented in the following areas: (1) tutoring in…

  1. Implementing and Evaluating a Rural Community-Based Sexual Abstinence Program: Challenges and Solutions

    ERIC Educational Resources Information Center

    Stauss, Kimberly; Boyas, Javier; Murphy-Erby, Yvette

    2012-01-01

    Informing both program evaluation and practice research, this paper describes lessons learned during the planning, implementation, and pilot phases of an abstinence education program based in a rural community in a southern state in the USA. Although a number of challenges can emerge in successfully implementing and evaluating such a program in a…

  2. 45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 45 Public Welfare 4 2012-10-01 2012-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

  3. 45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 45 Public Welfare 4 2011-10-01 2011-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

  4. 45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 45 Public Welfare 4 2013-10-01 2013-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

  5. 45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 45 Public Welfare 4 2014-10-01 2014-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

  6. Alternative Designs for Evaluating Workplace Literacy Programs. Conference Proceedings and Commissioned Papers at the "Design Guidance for Evaluating Workplace Literacy Programs" Work Group Conference (Washington, D.C. April 13, 1993).

    ERIC Educational Resources Information Center

    Research Triangle Inst., Research Triangle Park, NC.

    This document contains the five papers presented at a meeting at which key issues in evaluating workplace literacy programs were discussed. In "Key Components of Workplace Liteacy Projects and Definitions of Project 'Modules,'" Judith A. Alamprese describes the context for evaluating the National Extension Program, components of workplace literacy…

  7. Multimethod Strategy for Assessing Program Fidelity: The National Evaluation of the Revised G.R.E.A.T. Program

    ERIC Educational Resources Information Center

    Esbensen, Finn-Aage; Matsuda, Kristy N.; Taylor, Terrance J.; Peterson, Dana

    2011-01-01

    This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

  8. Phoenix Rising: use of a participatory approach to evaluate a federally funded HIV, hepatitis and substance abuse prevention program.

    PubMed

    Dryden, Eileen; Hyde, Justeen; Livny, Ayala; Tula, Monique

    2010-11-01

    This paper highlights the value of utilizing a participatory evaluation approach when working with community agencies receiving federal funding for prevention and intervention services. Drawing from our experience as evaluators of a SAMHSA-funded substance abuse, HIV and Hepatitis prevention program targeting homeless young adults, we describe the importance of and strategies for creating a participatory evaluation partnership with program implementers. By participatory evaluation we mean the active involvement of program implementers in defining the evaluation, developing instruments, collecting data, discussing findings, and disseminating results. There are a number of challenges faced when using this approach with federally funded programs that require the use of standardized measurement tools and data collection procedures. Strategies we used to strike a balance between federal requirements and local needs are presented. By increasing the understanding of and participation in the evaluation process, program implementers have greater support for data collection requirements and are appreciably more interested in learning from the evaluation data. This approach has helped to build the capacity of a program and stimulated new possibilities for learning, growing, and ultimately improving the services offered to those the program strives to reach. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

  9. Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

    PubMed

    Jaafaripooyan, Ebrahim

    2014-09-01

    Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

  10. [Evaluation of a program to promote network building between disciplinary agencies and informal community organizations: trial in a community comprehensive support center].

    PubMed

    Murayama, Hiroshi; Kojima, Tomoko; Tomaru, Meiko; Narabu, Harumi; Tachibana, Reiko; Yamaguchi, Takuhiro; Murashima, Sachiyo

    2010-10-01

    To examine the effectiveness of a program promoting network building between disciplinary agencies and informal community organizations (IGOs) comprising community residents, by implemention with staff of a community comprehensive support center (CJCSG). The program was implemented for nine staff of a GGSG in Setagaya Ward, Tokyo for a year. For process evaluation, items were assessed concerning the contents of the program such as satisfaction and understandability, participants' goal attainment level at each period of the program, and program satisfaction as a whole. Outcome evaluation included measurement of participants' self-efficacy regarding network building with ICOs before and after the program, using interviews of the members who completed the program. Eight out of the nine participants completed the program. All positively evaluated the contents of the program and their own goal attainment at each period of the program. After its completion, they felt highly satisfied. Moreover, there was an improvement in the cognition of the participants, including self-efficacy on network building with IGOs and the atmosphere in the GGSG with regard to network building. The efficacy of this program could be confirmed as demonstrated by the staff of the CCSC, although a more detailed assessment of validity and effectiveness will be necessary in the future.

  11. The Software Line-up: What Reviewers Look for When Evaluating Software.

    ERIC Educational Resources Information Center

    ELECTRONIC Learning, 1982

    1982-01-01

    Contains a check list to aid teachers in evaluating software used in computer-assisted instruction on microcomputers. The evaluation form contains three sections: program description, program evaluation, and overall evaluation. A brief description of a software evaluation program in use at the Granite School District in Utah is included. (JJD)

  12. Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

    ERIC Educational Resources Information Center

    Donaldson, Stewart I.

    2005-01-01

    Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

  13. Practical strategies for nursing education program evaluation.

    PubMed

    Lewallen, Lynne Porter

    2015-01-01

    Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

  14. EVALUE : a computer program for evaluating investments in forest products industries

    Treesearch

    Peter J. Ince; Philip H. Steele

    1980-01-01

    EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

  15. Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

    ERIC Educational Resources Information Center

    Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

    2016-01-01

    An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

  16. Evaluation of the impact of the drug evaluation and classification program on enforcement and adjudication

    DOT National Transportation Integrated Search

    1992-12-01

    This study examined the effect of the Drug Evaluation and Classification (DEC) Program on impaired driving (DWI) enforcement and adjudication. Drug Recognition Experts (DREs) in DEC programs evaluate suspects when drugs other than alcohol are suspect...

  17. Evaluation of a Postdischarge Call System Using the Logic Model.

    PubMed

    Frye, Timothy C; Poe, Terri L; Wilson, Marisa L; Milligan, Gary

    2018-02-01

    This mixed-method study was conducted to evaluate a postdischarge call program for congestive heart failure patients at a major teaching hospital in the southeastern United States. The program was implemented based on the premise that it would improve patient outcomes and overall quality of life, but it had never been evaluated for effectiveness. The Logic Model was used to evaluate the input of key staff members to determine whether the outputs and results of the program matched the expectations of the organization. Interviews, online surveys, reviews of existing patient outcome data, and reviews of publicly available program marketing materials were used to ascertain current program output. After analyzing both qualitative and quantitative data from the evaluation, recommendations were made to the organization to improve the effectiveness of the program.

  18. Using Curriculum-Based Measurements for Program Evaluation: Expanding Roles for School Psychologists

    ERIC Educational Resources Information Center

    Tusing, Mary E.; Breikjern, Nicholle A.

    2017-01-01

    Educators increasingly need to evaluate schoolwide reform efforts; however, complex program evaluations often are not feasible in schools. Through a case example, we provide a heuristic for program evaluation that is easily replicated in schools. Criterion-referenced interpretations of schoolwide screening data were used to evaluate outcomes…

  19. Using Evaluation and Research Theory to Improve Programs in Applied Settings: An Interview with Thomas D. Cook.

    ERIC Educational Resources Information Center

    Buescher, Thomas M.

    1986-01-01

    An interview with T. Cook, author of works on the use of research and evaluation theory and design, touches on such topics as practical evaluation, planning programs with evaluation or research design, and evaluation of programs for gifted students. (CL)

  20. Modification and Adaptation of the Program Evaluation Standards in Saudi Arabia

    ERIC Educational Resources Information Center

    Alyami, Mohammed

    2013-01-01

    The Joint Committee on Standards for Educational Evaluation's Program Evaluation Standards is probably the most recognized and applied set of evaluation standards globally. The most recent edition of The Program Evaluation Standards includes five categories and 30 standards. The five categories are Utility, Feasibility, Propriety, Accuracy, and…

  1. Evaluation Strategies in Financial Education: Evaluation with Imperfect Instruments

    ERIC Educational Resources Information Center

    Robinson, Lauren; Dudensing, Rebekka; Granovsky, Nancy L.

    2016-01-01

    Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

  2. Library Programs. Evaluating Federally Funded Public Library Programs.

    ERIC Educational Resources Information Center

    Office of Educational Research and Improvement (ED), Washington, DC.

    Following an introduction by Betty J. Turock, nine reports examine key issues in library evaluation: (1) "Output Measures and the Evaluation Process" (Nancy A. Van House) describes measurement as a concept to be understood in the larger context of planning and evaluation; (2) "Adapting Output Measures to Program Evaluation"…

  3. Responsive Meta-Evaluation: A Participatory Approach to Enhancing Evaluation Quality

    ERIC Educational Resources Information Center

    Sturges, Keith M.; Howley, Caitlin

    2017-01-01

    In an era of ever-deepening budget cuts and a concomitant demand for substantiated programs, many organizations have elected to conduct internal program evaluations. Internal evaluations offer advantages (e.g., enhanced evaluator program knowledge and ease of data collection) but may confront important challenges, including credibility threats,…

  4. Evaluation of the clinical implementation of a large-scale online e-learning program on venous blood specimen collection guideline practices.

    PubMed

    Willman, Britta; Grankvist, Kjell; Bölenius, Karin

    2018-05-11

    When performed erroneously, the venous blood specimen collection (VBSC) practice steps patient identification, test request management and test tube labeling are at high risk to jeopardize patient safety. VBSC educational programs with the intention to minimize risk of harm to patients are therefore needed. In this study, we evaluate the efficiency of a large-scale online e-learning program on personnel's adherence to VBSC practices and their experience of the e-learning program. An interprofessional team transformed an implemented traditional VBSC education program to an online e-learning program developed to stimulate reflection with focus on the high-risk practice steps. We used questionnaires to evaluate the effect of the e-learning program on personnel's self-reported adherence to VBSC practices compared to questionnaire surveys before and after introduction of the traditional education program. We used content analysis to evaluate the participants free text experience of the VBSC e-learning program. Adherence to the VBSC guideline high-risk practice steps generally increased following the implementation of a traditional educational program followed by an e-learning program. We however found a negative trend over years regarding participation rates and the practice to always send/sign the request form following the introduction of an electronic request system. The participants were in general content with the VBSC e-learning program. Properly designed e-learning programs on VBSC practices supersedes traditional educational programs in usefulness and functionality. Inclusion of questionnaires in the e-learning program is necessary for follow-up of VBSC participant's practices and educational program efficiency.

  5. Strategies for Evaluating a Freshman Studies Program.

    ERIC Educational Resources Information Center

    Ketkar, Kusum; Bennett, Shelby D.

    1989-01-01

    The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

  6. 1999 commuter assistance program evaluation manual

    DOT National Transportation Integrated Search

    2001-01-01

    This manual was developed to assist Florida's Commuter Assistance Programs (CAP) to measure and evaluate their performance. It provides information necessary for a CAP to create and implement its own evaluation program. It discusses performance measu...

  7. Case Study Evaluation of the Boston Area Carpooling Program

    DOT National Transportation Integrated Search

    1976-05-01

    The report evaluates a carpooling program in operation in the Boston, Massachusetts area from August, 1973 through August, 1974. The program, entitled the WBZ/ALA Commuter Computer Campaign, was the first program in the nation to promote and organize...

  8. A systematic review of school-based suicide prevention programs.

    PubMed

    Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

    2013-10-01

    Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

  9. An Evaluative Overview of the Gloria Floyd Community School Academic Excellence Program.

    ERIC Educational Resources Information Center

    Dade County Public Schools, Miami, FL. Office of Educational Accountability.

    The Gloria Floyd Academic Excellence Program (AEP) was designed as a school-based enrichment program for average and above-average students in grades one through six. The evaluation of this program involved discussions with the school administrator and program teacher, as well as a questionnaire-survey of AEP students, their parents, and regular…

  10. An Outcome Evaluation of the Success for Kids Program. Technical Report

    ERIC Educational Resources Information Center

    Maestas, Nicole; Gaillot, Sarah

    2010-01-01

    This report presents results from a multisite, quantitative evaluation of the international Success for Kids (SFK) after-school program. The program seeks to build resilience in children by teaching them to access inner resources and build positive connections with others. The SFK program is unlike most after-school programs both in its focus on…

  11. A Value-Added Approach to Selecting the Best Master of Business Administration (MBA) Program

    ERIC Educational Resources Information Center

    Fisher, Dorothy M.; Kiang, Melody; Fisher, Steven A.

    2007-01-01

    Although numerous studies rank master of business administration (MBA) programs, prospective students' selection of the best MBA program is a formidable task. In this study, the authors used a linear-programming-based model called data envelopment analysis (DEA) to evaluate MBA programs. The DEA model connects costs to benefits to evaluate the…

  12. Evaluation of the CAPE and CORE Programs for Sensory-Impaired Multi-Handicapped Children in the Province of Alberta. Final Report.

    ERIC Educational Resources Information Center

    Rutland Consulting Group Ltd.

    The report presents summaries of evaluations of the Coordinated Assessment and Program Planning for Education (CAPE) Program and the Coordinated Rehabilitation and Education (CORE) program for multi-handicapped sensory impaired and/or communication and behavior disordered children and their families in Alberta, Canada. Each program is evaluated…

  13. Program Evaluation of a Competency-Based Online Model in Higher Education

    ERIC Educational Resources Information Center

    DiGiacomo, Karen

    2017-01-01

    In order to serve its nontraditional students, a university piloted a competency-based program as alternative method for its students to earn college credit. The purpose of this mixed-methods study was to conduct a summative program evaluation to determine if the program was successful in order to make decisions about program revision and…

  14. Factors Influencing Participant Perceptions of Program Impact: Lessons from a Virtual Fieldtrip for Middle-School Students

    ERIC Educational Resources Information Center

    Adedokun, Omolola A.; Parker, Loran C.; Loizzo, Jamie; Burgess, Wilella D.; Robinson, J. Paul

    2011-01-01

    Participant perceptions of program effectiveness and impact are undoubtedly a popular focus of Extension program evaluations. However, the effects of participants' characteristics and contextual variables on program perceptions and how the resulting data can be used for program improvement are less explored in evaluation studies. Using data from…

  15. Pierce County Indian Education Program, Educational Service District #121, Tacoma, Washington. 1976-77 Final Evaluation Report.

    ERIC Educational Resources Information Center

    Nelson, Steve; Clark, Robey

    Comparing program objectives with program outcomes, 4 program components targeted at 1,100 American Indian students in 9 school districts in Pierce County, Washington were evaluated. Program objectives operationalized by an 11-member staff including 9 specialists and 1 coordinator were to develop: (1) basic skills via tutoring services for…

  16. First Year Evaluation of the Mathematics Pilot Programs, Grades K-8, [and] Appendices. Evaluation Department Report No. 381.

    ERIC Educational Resources Information Center

    Tomblin, Elizabeth A.; And Others

    The San Diego Board of Education requested that pilot programs be conducted with commercially developed (Grades K-8) mathematics textbooks and programs in order to determine which of the programs/texts were superior, and whether a district-developed program could successfully compete with commercially produced materials. The pilot program…

  17. Programs for the Prevention of Youth Depression: Evaluation of Efficacy, Effectiveness, and Readiness for Dissemination

    PubMed Central

    Brunwasser, Steven M.; Garber, Judy

    2015-01-01

    Objective To evaluate the current state of evidence of the effectiveness of depression prevention programs for youth, assess the degree to which current evidence supports broad implementation, and outline additional steps needed to close the gap between effectiveness and dissemination. Method We used the Society for Prevention Research’s Standards of Evidence (Flay et al., 2005) to evaluate the degree to which existing depression prevention programs have established intervention efficacy, effectiveness, and readiness for dissemination. We reviewed all depression prevention programs for youth that have been evaluated in at least two published, randomized controlled trials in which the intervention was compared to a no-intervention control group. A total of 37 studies evaluating 11 different programs were reviewed with regard to depressive symptoms and diagnoses post intervention and at follow-up (at least 6 months). Results Eight programs demonstrated significant main effects on depressive symptoms relative to controls in multiple RCTs; five programs had at least one trial with significant main effects present at least one year post-intervention. Two programs demonstrated efficacy for both depressive symptoms and depressive episodes across multiple independent trials. Regarding effectiveness, six programs had at least one study showing significant effects when delivered by endogenous service providers; four programs had significant effects in studies conducted independently of the program developers. Conclusions Several programs have demonstrated promise in terms of efficacy, but no depression prevention program for children or adolescents as yet has garnered sufficient evidence of effectiveness under real-world conditions to warrant widespread dissemination at this time. PMID:25933173

  18. Formative process evaluation for implementing a social marketing intervention to increase walking among African Americans in the Positive Action for Today's Health trial.

    PubMed

    Coulon, Sandra M; Wilson, Dawn K; Griffin, Sarah; St George, Sara M; Alia, Kassandra A; Trumpeter, Nevelyn N; Wandersman, Abraham K; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

    2012-12-01

    Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today's Health trial. We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities.

  19. Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

    PubMed

    Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

    2016-10-01

    Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  20. Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

    PubMed

    Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

    2012-07-01

    Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

  1. Online evaluation programs: benefits and limitations.

    PubMed

    Burhansstipanov, Linda; Clark, Richard E; Watanabe-Galloway, Shinobu; Petereit, Daniel G; Eschiti, Valerie; Krebs, Linda U; Pingatore, Noel L

    2012-04-01

    Patient navigation programs are increasing throughout the USA, yet some evaluation measures are too vague to determine what and how navigation functions. Through collaborative efforts an online evaluation program was developed. The goal of this evaluation program is to make data entry accurate, simple, and efficient. This comprehensive program includes major components on staff, mentoring, committees, partnerships, grants/studies, products, dissemination, patient navigation, and reports. Pull down menus, radio buttons, and check boxes are incorporated whenever possible. Although the program has limitations, the benefits of having access to current, up-to-date program data 24/7 are worth overcoming the challenges. Of major benefit is the ability of the staff to tailor summary reports to provide anonymous feedback in a timely manner to community partners and participants. The tailored data are useful for the partners to generate summaries for inclusion in new grant applications.

  2. Are You Making an Impact? Evaluating the Population Health Impact of Community Benefit Programs.

    PubMed

    Rains, Catherine M; Todd, Greta; Kozma, Nicole; Goodman, Melody S

    The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years. Such health care entities are challenged to evaluate the effectiveness of community benefit programs addressing the health needs identified. In an effort to determine the population health impact of community benefit programs in 1 hospital outreach department, researchers and staff conducted an impact evaluation to develop priority areas and overarching goals along with program- and department-level objectives. The longitudinal impact evaluation study design consists of retrospective and prospective secondary data analyses. As an urban pediatric hospital, St Louis Children's Hospital provides an array of community benefit programs to the surrounding community. Hospital staff and researchers came together to form an evaluation team. Data from program evaluation and administrative data for analysis were provided by hospital staff. Impact scores were calculated by scoring objectives as met or unmet and averaged across goals to create impact scores that measure how closely programs meet the overarching departmental mission and goals. Over the 4-year period, there is an increasing trend in program-specific impact scores across all programs except one, Healthy Kids Express Asthma, which had a slight decrease in year 4 only. Current work in measuring and assessing the population health impact of community benefit programs is mostly focused on quantifying dollars invested into community benefit work rather than measuring the quality and impact of services. This article provides a methodology for measuring population health impact of community benefit programs that can be used to evaluate the effort of hospitals in providing community benefit. This is particularly relevant in our changing health care climate, as hospitals are being asked to justify community benefit and make meaningful contributions to population health. The Patient Protection and Affordable Care Act includes a change to the IRS 990 Schedule H, requiring nonprofit hospitals to submit a community health needs assessment every 3 years, and requires evaluation of program effectiveness; yet, it does not require any quantification of the impact of community benefit programs. The IRS Schedule H 990 policies could be strengthened by requiring an impact evaluation such as outlined in this article. As hospitals are being asked to justify community benefit and make meaningful contributions to population health, impact evaluations can be utilized to demonstrate the cumulative community benefit of programs and assess population health impact of community benefit programs.

  3. Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill

    Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase frommore » $3.1 billion in 2008 to $$7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources often with multiple program administrators and intended to meet multiple purposes.« less

  4. An Overview of the National Nutrition Education and Training Program Evaluation.

    ERIC Educational Resources Information Center

    St. Pierre, Robert G.; Rezmovic, Victor

    1982-01-01

    Presents the organizing framework used in evaluating the National Nutrition Education and Training Program (NET) and summarizes the descriptive, evaluative, and meta-evaluative findings. Concludes that positive effects on children's nutrition-related knowledge have resulted from different nutrition education programs. (DC)

  5. Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

    NASA Astrophysics Data System (ADS)

    Warburton, J.; Crowley, S.; Larson, A.

    2012-12-01

    PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

  6. Purposive Facebook Recruitment Endows Cost-Effective Nutrition Education Program Evaluation

    PubMed Central

    Wamboldt, Patricia

    2013-01-01

    Background Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. Objective The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. Methods English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Results Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. Conclusions With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy. PMID:23948573

  7. Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

    PubMed

    Lohse, Barbara; Wamboldt, Patricia

    2013-08-15

    Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy.

  8. Care management program evaluation: constituents, conflicts, and moves toward standardization.

    PubMed

    Long, D Adam; Perry, Theodore L; Pelletier, Kenneth R; Lehman, Gregg O

    2006-06-01

    Care management program evaluations bring together constituents from finance, medicine, and social sciences. The differing assumptions and scientific philosophies that these constituents bring to the task often lead to frustrations and even contentions. Given the forms and variations of care management programs, the difficulty associated with program outcomes measurement should not be surprising. It is no wonder then that methods for clinical and economic evaluations of program efficacy continue to be debated and have yet to be standardized. We describe these somewhat hidden processes, examine where the industry stands, and provide recommendations for steps to standardize evaluation methodology.

  9. Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

    PubMed

    Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

    2015-01-01

    Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

  10. Jump start: a targeted substance abuse prevention program.

    PubMed

    Harrington, N G; Donohew, L

    1997-10-01

    A substance abuse prevention and life skills program for economically disadvantaged, high sensation seeking African American teens was developed and tested in Cincinnati, Ohio. Formative research was conducted to determine program content and format. Over two implementations, 289 individuals in the target population were recruited as participants for the field test of the program. For the first implementation, participants were randomly selected from the city's summer youth employment program. For the second, a media campaign was designed to recruit participants. Process evaluation indicated that participants evaluated the program extremely positively. Outcome evaluation indicated that significant pretest differences between high and low sensation seekers were neutralized for liquor and marijuana in both years of the program and for attitude toward drugs in the first year of the program. These results suggest that sensation seeking is a useful message design and audience-targeting variable for substance abuse prevention program design. Implications and recommendations for future research are discussed.

  11. Program evaluation of FHWA pedestrian and bicycle safety activities.

    DOT National Transportation Integrated Search

    2011-03-01

    "Introduction : FHWAs Office of Highway Safety (HSA) initiated a program evaluation by Booz Allen Hamilton to assess the overall effectiveness of the Agencys Pedestrian and Bicycle Safety Program. The evaluation covers pedestrian and bicycle sa...

  12. Staff Development Program Evaluation.

    ERIC Educational Resources Information Center

    Ashur, Nina E.; And Others

    An evaluation of the staff development program at College of the Canyons (California) was conducted in 1991 to provide information applicable to program improvement. Questionnaires were distributed to all faculty, classified staff, and flexible calendar program committee and staff development advisory committee members, resulting in response rates…

  13. The Compubus Evaluation.

    ERIC Educational Resources Information Center

    Klimko, Ivan P.

    The Computer Bus Program (Compubus Program) of the Modesto City Schools (California) was evaluated to determine the effectiveness of the computer literacy program for fourth, fifth, and sixth grade students at eight elementary compensatory education schools. The program provided instruction on computer vocabulary, knowledge, and applications in a…

  14. THE SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM; ANNUAL REPORT TO CONGRESS, FY 1998

    EPA Science Inventory

    This document summarizes the accomplishments and activities of the Superfund Innovative Technology Evaluation (SITE) Program for 1998. General information on the SITE program is presented. In addition, cost savings effected by the SITE program were estimated and are presented. ...

  15. 40 CFR 501.16 - Requirements for compliance evaluation programs.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 29 2010-07-01 2010-07-01 false Requirements for compliance evaluation programs. 501.16 Section 501.16 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) SEWAGE SLUDGE STATE SLUDGE MANAGEMENT PROGRAM REGULATIONS Development and Submission of State Programs...

  16. Second NBL measurement evaluation program meeting: A summary

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Spaletto, M.I.; Clapper, M.; Tolbert, M.E.M.

    New Brunswick Laboratory (NBL), the US government`s nuclear materials measurements and reference materials laboratory, administers interlaboratory measurement evaluation programs to evaluate the quality and adequacy of safeguards measurements. The NBL Measurement Evaluation Program covers several types of safeguards analytical measurements. The Safeguards Measurement Evaluation (SME) program distributes test materials destructive measurements of uranium for both elemental concentration and isotopic abundances, and of plutonium for isotopic abundances. The Calorimetry Exchange (CalEx) Program tests the quality of nondestructive measurements of plutonium isotopic abundances by gamma spectroscopy and plutonium concentration by calorimetry. In May 1997, more than 30 representatives from the Department ofmore » Energy (DOE), its contractor laboratories, and Nuclear Regulatory Commission licensees met at NBL in Argonne, Illinois, for the annual meeting of the Measurement Evaluation Program. The summary which follows details key points that were discussed or presented at the meeting.« less

  17. Reading/Writing and Mathematics Instruction. CIPP Planning/Evaluation Report 95-018. Focus on Program Evaluation.

    ERIC Educational Resources Information Center

    Des Moines Public Schools, IA. Dept. of Information Management.

    The Chapter 1 reading, writing, and mathematics instruction programs of the Des Moines (Iowa) public schools were evaluated for the 1993-94 school year. These programs provided supplemental instruction for about 2,968 students in 1993-94 through six components: (1) schoolwide projects; (2) the Reading Recovery Program; (3) the Reading/Writing Lab…

  18. Qualitative Evaluation of Emotional Intelligence In-Service Program for Secondary School Teachers

    ERIC Educational Resources Information Center

    Fer, Seval

    2004-01-01

    This paper is an attempt to evaluate the Emotional Intelligence (EQ) In-Service Program on the basis of experiences of 20 secondary school teachers who attended the program in a private school in Turkey. A phenomenological approach, with a focus group method was used. The first objective of this study was to evaluate EQ program on the basis of…

  19. Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report. NCEE 2009-4047

    ERIC Educational Resources Information Center

    Bernstein, Lawrence; Rappaport, Catherine Dun; Olsho, Lauren; Hunt, Dana; Levin, Marjorie

    2009-01-01

    This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and…

  20. Evaluation of the Cosmetology Program at Caldwell Community College and Technical Institute--Fall, 1981.

    ERIC Educational Resources Information Center

    Pipes, V. David

    In fall 1981, the cosmetology program at Caldwell Community College and Technical Institute (CCC&TI) was evaluated as part of a process to create a model for the periodic evaluation of all occupational programs at the school. In addition to collecting information for planning and program improvement, the study sought to assess the achievement of…

  1. Process Evaluation of a School-Based Weight Gain Prevention Program: The Dutch Obesity Intervention in Teenagers (DOiT)

    ERIC Educational Resources Information Center

    Singh, A. S.; Chinapaw, M. J. M.; Brug, J.; van Mechelen, W.

    2009-01-01

    Health promotion programs benefit from an accompanying process evaluation since it can provide more insight in the strengths and weaknesses of a program. A process evaluation was conducted to assess the reach, implementation, satisfaction and maintenance of a school-based program aimed at the prevention of excessive weight gain among Dutch…

  2. Assessment of the Teaching Behavior of the Instructors of an Out-of-School Program

    ERIC Educational Resources Information Center

    Rodríguez-Naveiras, Elena; Borges, África

    2015-01-01

    Out-of-school programs for students with high abilities are especially relevant when their needs are not covered in formal education. The evaluation of these programs is essential and it can be carried out from different evaluative approaches. The evaluation of the behavior of the people who implement the programs is an important aspect in the…

  3. A Program Evaluation of a Special Education Day School for Students with Emotional and Behavioral Disabilities

    ERIC Educational Resources Information Center

    Klein-Lombardo, Lucinda

    2012-01-01

    The purpose of this study was the program evaluation of a special education day school compared to a set of best practice standards for school programs for students with emotional and behavioral disorders. This evaluation will enable the organization to make decisions about which aspects of the program to continue, strengthen, or discontinue. …

  4. Governor's Educator Excellence Grant (GEEG) Program: Year One Evaluation Report. Policy Evaluation Report

    ERIC Educational Resources Information Center

    Springer, Matthew G.; Podgursky, Michael J.; Lewis, Jessica L.; Ehlert, Mark W.; Gardner, Catherine G.; Ghoshdastidar, Bonnie; Lopez, Omar S.; Patterson, Christine H.; Taylor, Lori L.

    2007-01-01

    This report presents findings stemming from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide performance incentive programs in Texas. In the fall of 2006, the GEEG program made available non-competitive, three-year grants to 99 schools ranging from $60,000 to $220,000 per year. Grants…

  5. Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

    PubMed Central

    2013-01-01

    Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

  6. Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

    PubMed

    Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

    2016-06-01

    Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  7. Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

    PubMed Central

    Cole, Donald C.; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

    2016-01-01

    Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners’ meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. PMID:27003730

  8. When Unintended Consequences Become the Main Effect: Evaluating the Development of a Foster Parent Training Program.

    ERIC Educational Resources Information Center

    Loesch-Griffin, Deborah A.; Ringstaff, Cathy

    A program of education, training, and support provided to foster parents in a California county through a nonprofit agency is evaluated. The evaluators' experience indicates that: (1) evaluations are gaining in popularity; (2) role shifts by evaluators are sometimes difficult to perceive; (3) program staff are unlikely to use evaluative feedback…

  9. Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

    NASA Astrophysics Data System (ADS)

    McCay, D.; Fiorenza, P.; Lautz, L.

    2017-12-01

    More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

  10. Program Evaluation: The Board Game--An Interactive Learning Tool for Evaluators

    ERIC Educational Resources Information Center

    Febey, Karen; Coyne, Molly

    2007-01-01

    The field of program evaluation lacks interactive teaching tools. To address this pedagogical issue, the authors developed a collaborative learning technique called Program Evaluation: The Board Game. The authors present the game and its development in this practitioner-oriented article. The evaluation board game is an adaptable teaching tool…

  11. An evaluation toolkit for Florida's Commuter Assistance Programs (CAP) : a companion to the 1999 CAP evaluation manual

    DOT National Transportation Integrated Search

    2001-01-01

    This manual is a companion piece to the Commuter Assistance Program Evaluation Manual that was developed to assist Florida's Commuter Assistance Programs (CAP) in their efforts to measure and evaluate their performance. This manual is intended to pro...

  12. Conflict of Interest in the Evaluation and Dissemination of “Model” School-based Drug and Violence Prevention Programs

    PubMed Central

    Gorman, Dennis M.; Conde, Eugenia

    2010-01-01

    Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been that of financial relationships between investigators and research sponsors. The potential for conflicts of interest to arise in the evaluation of drug prevention programs was raised by Moskowitz in this journal in 1993, but to date there has been no attempt made to estimate the scope of this problem. The present study addressed this issue using a sample of “model” school-based drug and violence prevention interventions by first, identifying the types or relationships that exist between program developers and program distributors, and, second, by assessing how many of the evaluations of these programs published in peer-reviewed journals had been conducted by the developers of the programs compared to independent evaluation teams. The data presented indicate that there are relatively few published evaluations that do not involve program developers and that there are few instances in which there is complete separation between the program developer and program distributor. Using the open systems model of the Institute of Medicine Committee on Research Integrity as a framework, it is argued that the culture and norms of the program developer and those of the program evaluator are fundamentally distinct and therefore failure to separate these roles produces high potential for conflict of interest to arise. PMID:17945143

  13. Bystander programs addressing sexual violence on college campuses: A systematic review and meta-analysis of program outcomes and delivery methods.

    PubMed

    Jouriles, Ernest N; Krauss, Alison; Vu, Nicole L; Banyard, Victoria L; McDonald, Renee

    2018-02-06

    This systematic review and meta-analysis evaluates the effectiveness of bystander programs that address sexual violence on college campuses. Program effects on student attitudes/beliefs and bystander behavior were examined. Durability of program outcomes and the influence of program-delivery methods (e.g., facilitator-led programs vs. video, online or poster campaign programs) and program-parameters (e.g., program length) were also evaluated. Twenty-four studies met criteria for inclusion in the meta-analysis, and 207 separate results from these studies were coded. Students who participated in a bystander program, compared to those who had not, had more pro-social attitudes/beliefs about sexual violence and intervening to prevent it, and engaged in more bystander behavior. Program effects diminished over time, but meaningful changes persisted for at least three months following program delivery. Longer programs had greater effects than shorter programs on attitudes/beliefs. Bystander programs can be a valuable addition to colleges' violence prevention efforts.

  14. An Evaluation of the Implementation Fidelity and Outcomes of the Olweus Bullying Prevention Program in Three Elementary Schools in Virginia

    ERIC Educational Resources Information Center

    Wood, Barbara F.

    2013-01-01

    Bullying continues to be a major concern in schools today. Many schools have implemented some type of bullying prevention program. The Olweus Bullying Prevention Program is one of these programs. Evaluation of the Olweus Bullying Prevention Program is typically done through the administration of the Olweus Bullying Questionnaire to students and…

  15. Evaluation of the Meaning of Life Program in Israel

    ERIC Educational Resources Information Center

    Kasler, Jonathan; White, Gwyne W.; Elias, Maurice J.

    2013-01-01

    During the 2009-2010 academic year, 10 schools participated in the Meaning of Life educational program, an adaption of the popular U.S. Laws of Life program. The program sought to encourage each participant to develop a personal approach to finding meaning in life. To evaluate the success of the program, we conducted a study to compare measures of…

  16. Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

    PubMed

    Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

    2015-02-01

    Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

  17. 48 CFR 919.7013 - Reports.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... BUSINESS PROGRAMS The Department of Energy Mentor-Protege Program 919.7013 Reports. (a) Prior to performing an evaluation of a Mentor's performance under its Mentor-Protege Agreement for use in award fee evaluations, the Mentor-Protege Program Manager must consult with the cognizant DOE technical program manager...

  18. The Case for Evaluating Student Outcomes and Equity Gaps to Improve Pathways and Programs of Study

    ERIC Educational Resources Information Center

    Bragg, Debra D.

    2017-01-01

    When linked to program review and improvement, program evaluation can help practitioners to ensure that career-technical education (CTE) and science, technology, engineering, and mathematics (STEM) programs offer equitable access and outcomes for underserved student groups.

  19. Building for the Future: Community College Leadership Development Program Evaluation

    ERIC Educational Resources Information Center

    Bresso, Michele

    2012-01-01

    This qualitative descriptive study examines and evaluates an internal, grow-your-own, community college leadership development program. Participants in a community college leadership development program self-reported their leadership knowledge, attitudes, and practices (KAP) before, during, and after participation in the program. Study…

  20. Barriers to Evaluation

    ERIC Educational Resources Information Center

    Charley, Lois

    2007-01-01

    According to the Department of Health and Human Services, "good program evaluations assess programs performance, measure impacts on families and communities, and document program successes." With this information, programs are able to direct limited resources to where they are most needed and most effective in their communities. This article is…

  1. Worker Education Program 1994-97. Final Evaluation Report.

    ERIC Educational Resources Information Center

    Larson, Katherine E.

    An evaluation examined the efficacy of the program structure, implementation, and outcomes of the Worker Education Program (WEP), a partnership of Northeastern Illinois University; Union of Needletrades, Industrial, and Textile Employees; and 14 employers. WEP's greatest strengths were its conceptual design, program structures, relevant…

  2. A Discrepancy-Based Methodology for Nuclear Training Program Evaluation.

    ERIC Educational Resources Information Center

    Cantor, Jeffrey A.

    1991-01-01

    A three-phase comprehensive process for commercial nuclear power training program evaluation is presented. The discrepancy-based methodology was developed after the Three Mile Island nuclear reactor accident. It facilitates analysis of program components to identify discrepancies among program specifications, actual outcomes, and industry…

  3. The effects of stakeholder involvement on perceptions of an evaluation's credibility.

    PubMed

    Jacobson, Miriam R; Azzam, Tarek

    2018-06-01

    This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

  4. Continuous Evaluation in Ethics Education: A Case Study.

    PubMed

    McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

    2018-04-01

    A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

  5. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM TECHNOLOGY PROFILES: SIXTH EDITION

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment and monitoring and measurement technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment techn...

  6. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM - TECHNOLOGY PROFILES - SEVENTH EDITION

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment and monitoring and measurement technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment techn...

  7. Evaluating the Effectiveness of the 2000-2001 NASA CONNECT(TM) Program

    NASA Technical Reports Server (NTRS)

    Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

    2002-01-01

    This report contains the results of the evaluation conducted for the 2000-2001 NASA CONNECT(TM) program conducted in March 2001. The analysis is based on the results collected from 154 surveys collected from educators registered for the program. Respondents indicated that the objectives for each program were met; the programs were aligned with the national (mathematics, science, and technology) standards; the programs were developmentally (grade level) appropriate; and the programs in the 2000-2001 NASA CONNECT(TM) series enhanced/enriched the teaching of mathematics, science, and technology.

  8. ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

    PubMed Central

    Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

    2016-01-01

    This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

  9. ["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

    PubMed

    Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

    2015-04-01

    The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

  10. Integrating design science theory and methods to improve the development and evaluation of health communication programs.

    PubMed

    Neuhauser, Linda; Kreps, Gary L

    2014-12-01

    Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

  11. Using GIS to evaluate a fire safety program in North Carolina.

    PubMed

    Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

    2013-10-01

    Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

  12. Development and Evaluation of a Peer Support Program for Parents Facing Perinatal Loss.

    PubMed

    Diamond, Rachel M; Roose, Rosmarie E

    2016-01-01

    The purpose of this program evaluation was to understand the perspectives of peer parents and parents receiving support within a peer support program for perinatal bereavement at a midsized hospital within the midwestern United States. To document participants' perceptions of the program, a focus group was conducted with peer parents, and surveys were completed by both peer parents and parents receiving support. In this article we review our model of a peer support program for perinatal bereavement and report on parents' evaluation of the program. Recommendations through which other organizations can develop peer support programs for parents who have experienced a perinatal loss are provided. © 2016 AWHONN, the Association of Women’s Health, Obstetric and Neonatal Nurses.

  13. Implementing a centralized institutional peer tutoring program.

    PubMed

    Gaughf, Natalie White; Foster, Penni Smith

    2016-01-01

    Peer tutoring has been found to be beneficial to both students and peer tutors in health sciences education programs. This article describes the implementation of a centralized, institutional peer tutoring program at the University of Mississippi Medical Center, an academic health science center in the U.S. The Program: This multispecialty peer tutoring program paired students experiencing academic difficulties with peer tutors who showed prior academic success, professionalism and effective communication skills. The program allowed students and peer tutors to coordinate their own tutoring services. Evaluations by both students and peer tutors showed satisfaction with the program. Recommendations for developing and implementing an effective peer tutoring program are presented, including utilization of an online system, consistent program policy with high professionalism expectations, funding, program evaluation and data tracking.

  14. Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

    PubMed

    van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

    2017-09-01

    Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

  15. Toward More Successful Biomedical Informatics Education Programs and Ecosystems in the Arab World.

    PubMed

    Wageih, Mohamed A; Marcano-Cedeño, Alexis; Gómez, Enrique J; Mantas, John

    2015-01-01

    Biomedical & Health Informatics (BMHI) is relatively new in Arab States. However, several programs/ tracks are running, with high promises of expansion. Programs are evaluated by national authorities, not by a specialized body/association. This does not always mean that the program is of an international standard. One of the possible ways of ensuring the quality of these programs is to be evaluated by international agencies. The International Medical Informatics Association (IMIA) has the expertise in the evaluation BMHI education programs. Accredited programs staffs will have the opportunities for Internationalization and to be engaged with other top-notch organizations, which will have great impacts on the overall implementations of the BMHI in the Arab World. The goal of this document is to show to Arab Universities (pilot: Egypt) how to apply for IMIA Accreditation for their programs.

  16. Promoting organ donation through an entertainment-education TV program in Korea: Open Your Eyes.

    PubMed

    Byoung Kwan Lee; Hyun Soon Park; Choi, Myung-Il; Cheon Soo Kim

    2010-01-01

    The purpose of this study is to investigate the effects of the characteristics of the program, Open Your Eyes, an entertainment-education TV program in Korea, on parasocial interaction and behavioral intention for organ donation. The results indicated that affective evaluation positively affected parasocial interaction with the program but cognitive evaluation negatively affected involvement with beneficiaries in the program. Also, it was found that cognitive evaluation of Open Your Eyes had a significant positive effect on behavioral intention. In addition, a significant positive effect of program engagement on the behavioral intention was found. Thus, the results indicate that individuals who feel program engagement of Open Your Eyes will be more likely to proceed with organ donation. However, no direct effect of involvement with the beneficiary and program hosts was found.

  17. Primary prevention research: a preliminary review of program outcome studies.

    PubMed

    Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

    1980-07-01

    This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

  18. Achievement Testing of Disadvantaged and Minority Students for Educational Program Evaluation.

    ERIC Educational Resources Information Center

    Wargo, Michael J., Ed.; Green, Donald Ross, Ed.

    The following papers were delivered: Introductory Remarks, John W. Evans; An Evaluator's Perspective, Michael J. Wargo; Problems of Achievement Tests in Program Evaluation, Donald Ross Green; Diverse Human Populations and Problems in Educational Program Evaluation via Achievement Testing, Edmund W. Gordon; Critical Issues in Achievement Testing of…

  19. Evaluating Federal Social Programs: An Uncertain Act.

    ERIC Educational Resources Information Center

    Levitan, Sar A.; Wurzburg, Gregory K.

    This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

  20. Issues Involved in the Evaluation of Gifted Programmes.

    ERIC Educational Resources Information Center

    Ali, A. Sidiq

    2001-01-01

    This article discusses the purpose of gifted program evaluation and identifies some of the pertinent issues involved in evaluating gifted programs. The gifted program delivered by the Peel District Board of Education in Ontario, Canada, is used to illustrate key evaluation considerations, including gifted identification procedures and gifted…

  1. Improve the Quality of Teaching in Your Schools.

    ERIC Educational Resources Information Center

    Greene, Brenda Z.

    1985-01-01

    Teacher quality can be improved through teacher evaluation, intervention programs, incentives or rewards, and counseling. In the Toledo, Ohio, peer evaluation program, evaluation and staff development go hand in hand. The program was developed through a collaborative and cooperative process and uses teacher consultants to evaluate and supervise…

  2. Program Evaluation: Two Management-Oriented Samples

    ERIC Educational Resources Information Center

    Alford, Kenneth Ray

    2010-01-01

    Two Management-Oriented Samples details two examples of the management-oriented approach to program evaluation. Kenneth Alford, a doctorate candidate at the University of the Cumberlands, details two separate program evaluations conducted in his school district and seeks to compare and contrast the two evaluations based upon the characteristics of…

  3. Evaluation Processes Used to Assess the Effectiveness of Vocational-Technical Programs.

    ERIC Educational Resources Information Center

    Bruhns, Arthur E.

    Evaluation is quantitative or qualitative, the criteria determined by or given to the student. The criteria show how close he has come to the program's objectives and the ranking of individual performance. Vocational education programs susceptible to evaluation are listed and relevant evaluative techniques discussed. Graduate interviews concerning…

  4. The Implementation of Program Evaluation Recommendations in Wisconsin Technical Colleges.

    ERIC Educational Resources Information Center

    Ruhland, Sheila K.

    Implementation of program evaluation recommendations should persuade people that the rewards of an evaluation outweigh the reasons for resistance. A study was undertaken with the following purposes: identify facilitators and barriers to the implementation of program evaluation; determine the proportion of recommendations made in each of the nine…

  5. Practical Considerations in Evaluating Patient/Consumer Health Education Programs.

    ERIC Educational Resources Information Center

    Bryant, Nancy H.

    This report contains brief descriptions of seven evaluative efforts and outcomes of health education programs, some considerations of problems encountered in evaluating the programs, and detailed descriptions of two case studies: (1) a process evaluation of preoperative teaching and (2) a retrospective study of visiting nurse association use by…

  6. Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

    ERIC Educational Resources Information Center

    Fetterman, David; Bowman, Cassie

    2002-01-01

    Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

  7. Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

    PubMed

    Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

    2014-06-01

    Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

  8. Forest Fire Prevention Programs and Their Evaluation In U.S. Forest Service Region 8

    Treesearch

    G. Richard Wetherill

    1982-01-01

    A telephone survey of all national forest ranger districts in Region 8 obtained data describing the status of forest fire prevention program evaluation. Out of the 396 programs being conducted on the 105 districts in the South, only one program had undergone any sort of systematic evaluation. Survey data indicate that ranger district prevention personnel are aware of...

  9. A Search for and Evaluation of Computer-Assisted Instructional Programs in Music for Use at Liberty Baptist College: Societal Factors Affecting Education.

    ERIC Educational Resources Information Center

    Reitenour, Steve

    The current use of high technology in music instruction was surveyed, and music-related computer programs appropriate for Liberty Baptist College were recommended. Information on 59 programs was gathered and submitted to a panel of three music instructors, who selected 10 programs for further evaluation. A Courseware Evaluation Sheet was used to…

  10. Evaluations of reproductive health programs in humanitarian settings: a systematic review

    PubMed Central

    2015-01-01

    Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and the results must be shared. The papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality. PMID:25685183

  11. Correlates of quality educational programs.

    PubMed

    Chester, Deborah R; Tracy, Jessamyn A; Earp, Emily; Chauhan, Reetu

    2002-06-01

    Preliminary evaluation findings are presented that explore relationships between educational program quality and program characteristics such as program type, security level, aftercare, teacher certification, facility size, and private versus public provider. Several program characteristics are found to be related to measurements of educational program quality. Among the major quality characteristics are proportion of program teachers that are professionally certified, smaller sized facilities versus larger facilities, level of aftercare services, and provider sources, with private for-profit providers being the lowest performing and public providers being the highest performing. The article closes with description of the Juvenile Justice Educational Enhancement Program's continuing evaluation of correlates to educational program quality through the continued development of a comprehensive database.

  12. A cognitive-behavioral program for parents of children with chronic musculoskeletal pain; A feasibility study.

    PubMed

    Wiertz, C; Goossens, M; Spek, E M; Verbunt, J A

    2017-10-01

    The purpose of the study is to evaluate the feasibility of a newly developed parent program for parents of children with non-specific chronic musculoskeletal pain. This program is part of the child's interdisciplinary outpatient pain rehabilitation treatment. The goal of the parent program is to change parent's thoughts/behaviour regarding pain with the ultimate intention to further improve their child's functioning. There were two main objectives in the study: First, to evaluate the feasibility of the parent program. Second, to evaluate changing in parental behavioral factors pre- and posttreatment. Participants were parents of adolescents, who underwent a interdisciplinary outpatient pain program for non-specific chronic musculoskeletal pain. Parents participated in a parent program as part of their child's treatment. Adolescents reported their level of disability, pain intensity, fear of pain and pain catastrophizing by filling out questionnaires. Parents reported catastrophic thinking about their child's pain, fear of pain and disabilities of their child. In addition, they evaluated the parent program. Sixty five parents (36 mothers and 29 fathers) of 44 adolescents filled in the baseline questionnaires. Result showed significant and clinically relevant improvements for both parents as well for adolescents. Parents were positive about the content of the parent program, they evaluated the program as supportive and informative. Adding a parent program to a interdisciplinary outpatient pain program for adolescent with chronic musculoskeletal pain, seems to be feasible in daily life of the parents and results in positive behavioural changes for both parents and adolescents. A parent program, designed to change cognition and behaviour of parents of children with chronic musculoskeletal pain is feasible. © 2017 European Pain Federation - EFIC®.

  13. Miramar College Program Evaluation: Aviation Maintenance.

    ERIC Educational Resources Information Center

    Moriyama, Bruce; Brumley, Leslie

    Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in aviation maintenance. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent…

  14. Modern & Classical Languages: K-12 Program EValuation 1988-89.

    ERIC Educational Resources Information Center

    Martinez, Margaret Perea

    This evaluation of the modern and classical languages programs, K-12, in the Albuquerque (New Mexico) public school system provides general information on the program's history, philosophy, recognition, curriculum development, teachers, and activities. Specific information is offered on the different program components, namely, the elementary…

  15. Evaluation of drug interaction microcomputer software: comparative study.

    PubMed

    Poirier, T I; Giudici, R

    1991-01-01

    Twelve drug interaction microcomputer software programs were evaluated and compared using general and specific criteria. This article summarizes and compares the features, ratings, advantages, and disadvantages of each program. Features of an ideal drug interaction program are noted. Recommended programs based on three price ranges are suggested.

  16. Evaluating Math Drill and Practice Programs.

    ERIC Educational Resources Information Center

    Schnorr, Janice M.; Semmel, Dorothy S.

    1986-01-01

    General guidelines for a process evaluation of software for a specific subject and grade include: (1) Specify instructional objectives and list desired software program characteristics; (2) Access and review descriptions of programs (information sources for math programs are listed); (3) Preview software; and (4) Compare and make purchase…

  17. Cancer Therapy Evaluation Program | Office of Cancer Genomics

    Cancer.gov

    The Cancer Therapy Evaluation Program (CTEP) seeks to improve the lives of cancer patients by finding better treatments, control mechanisms, and cures for cancer. CTEP funds a national program of cancer research, sponsoring clinical trials to evaluate new anti-cancer agents.

  18. 5 CFR 339.205 - Medical evaluation programs.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... 5 Administrative Personnel 1 2013-01-01 2013-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

  19. 5 CFR 339.205 - Medical evaluation programs.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... 5 Administrative Personnel 1 2014-01-01 2014-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

  20. The SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION program - Technology Profiles

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) program was created to evaluate new and promising treatment technologies for cleanup at hazardous waste sites. The mission of the SITE program is to encourage the development and routine use of innovative treatment technologie...

  1. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM - TECHNOLOGY PROFILES 4th Edition

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment technologies. As a result, the SI...

  2. 5 CFR 339.205 - Medical evaluation programs.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 5 Administrative Personnel 1 2011-01-01 2011-01-01 false Medical evaluation programs. 339.205 Section 339.205 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS MEDICAL QUALIFICATION DETERMINATIONS Physical and Medical Qualifications § 339.205 Medical evaluation programs. Agencies...

  3. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 2002

    EPA Science Inventory

    This report details the Fiscal Year 2002 activities of the Superfund Innovative Technology Evaluation (SITE) Program. The Program focused on the remediation needs of the hazardous waste remediation community through demonstration and evaluation of innovative technologies for reme...

  4. SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 2001

    EPA Science Inventory

    This report details the fiscal year 2001 activities of the Superfund Innovative Technology Evaluation (SITE) Program. The Program focuses on the remediation needs of the hazardous waste remediation community through demonstration and evaluation of innovative technologies for re...

  5. Impact of a provider training program on the treatment of children with autism spectrum disorder at psychosocial care units in Brazil.

    PubMed

    Silva, Luciana C; Teixeira, Maria C T V; Ribeiro, Edith L; Paula, Cristiane S

    2017-12-18

    To develop, implement, and verify the impact of a training program for health care providers working with children with autism spectrum disorder (ASD) in psychosocial care centers for children and adolescents (Centro de Atenção Psicossocial à Infância e à Adolescência - CAPSi) in São Paulo, Brazil. This quasi-experimental study was conducted with 14 professionals from four CAPSi units. The training program consisted of six phases: 1) pre-intervention observation; 2) meeting with staff to assess the main needs of the training program; 3) developing materials for training and evaluation; 4) meetings to discuss program implementation; 5) a final meeting for case discussion and evaluation; and 6) distance supervision. Three measures were used to evaluate the training program: i) the Knowledge, Attitudes, and Practices (KAP) questionnaire; ii) videos containing questions designed to assess program comprehension; and iii) a satisfaction survey. Thirteen videos were produced to as visual aids for use during the training program, and a further 26 videos were developed to evaluate it. The program was well evaluated by the participants. The video responses and KAP questionnaire scores suggest that staff knowledge and attitudes improved after training. The positive findings of this study suggest that the tested training program is feasible for use with multidisciplinary teams working in the CAPSi environment.

  6. Using an Evaluability Assessment To Select Methods for Evaluating State Technology Development Programs: The Case of the Georgia Research Alliance.

    ERIC Educational Resources Information Center

    Youtie, Jan; Bozeman, Barry; Shapira, Philip

    1999-01-01

    Describes an evaluability assessment of the Georgia Research Alliance (GRA), a technology development program. Presents the steps involved in conducting an evaluability assessment, including development of an understanding of the program and its stakeholders. Analyzes and compares different methods by which the GRA could be evaluated. (SLD)

  7. Indian Economic Development: An Evaluation of EDA's Selected Indian Reservation Program. Volume II: Individual Reservation Reports, Appendices.

    ERIC Educational Resources Information Center

    Boise Cascade Center for Community Development, ID.

    As the appendices to an evaluation of the Economic Development Administration's (EDA) Selected Indian Reservation Program, this portion of the evaluation report presents individualized evaluations of each of the 16 reservations originally selected for the program in 1967. Each reservation evaluation is presented in terms of the following format:…

  8. Data Collection Methods for Evaluating Museum Programs and Exhibitions

    ERIC Educational Resources Information Center

    Nelson, Amy Crack; Cohn, Sarah

    2015-01-01

    Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

  9. The La Salle University FIPSE Grant: A Review and Evaluation of the Alcohol and Other Drug Program, 1 September 88 through 30 September 90.

    ERIC Educational Resources Information Center

    Chapman, Robert J.

    This report presents descriptive and evaluative information on the Alcohol and Other Drug Program (A & D Program) developed at Pennsylvania's La Salle University and supported by the Fund for the Improvement of Postsecondary Education. The program includes an alcohol awareness project, a peer education program, a resident educator with A &…

  10. Mass Balance, Beneficial Use Products, and Cost Comparisons of Four Sediment Treatment Technologies Near Commercialization

    DTIC Science & Technology

    2011-03-01

    Superfund Innovative Technology Evaluation Program (SITE) • Assessment and Remediation of Contaminated Sediment Program (ARCS) • Contaminated Sediment...Agency (USEPA). 1994. Assessment and Remediation of Contaminated Sediments (ARCS) Program Remediation Guidance Document. EPA/905/R-94/003. Chicago, IL...conducted under one of the four following programs: • Superfund Innovative Technology Evaluation (SITE) Program • Assessment and Remediation of

  11. Abriendo Puertas/Opening Doors Parenting Program: Summary Report of Program Implementation and Impacts. Publication #2014-24

    ERIC Educational Resources Information Center

    Moore, Kristin A.; Caal, Selma; Lawner, Elizabeth K.; Rojas, Angela; Walker, Karen

    2014-01-01

    Child Trends conducted a random assignment evaluation of the Abriendo Puertas/Opening Doors program, one of the largest programs in the United States working with low-income Latino parents of children ages zero to five. Since it began in 2007, the program has served over 30,000 parents/families in 34 states. The evaluation study examined the…

  12. An Evaluation of the Cost Effectiveness of Alternative Compensatory Reading Programs, Volume IV: Cost Analysis of Summer Programs. Final Report.

    ERIC Educational Resources Information Center

    Al-Salam, Nabeel; Flynn, Donald L.

    This report describes the results of a study of the cost and cost effectiveness of 27 summer reading programs, carried through as part of a large-scale evaluation of compensatory reading programs. Three other reports describe cost and cost-effectiveness studies of programs during the regular school year. On an instructional-hour basis, the total…

  13. 2012 Wind Program Peer Review Report

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Zayas, Jose; Higgins, Mark

    2012-06-01

    This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

  14. What Matters for Excellence in PhD Programs? Latent Constructs of Doctoral Program Quality Used by Early Career Social Scientists

    ERIC Educational Resources Information Center

    Morrison, Emory; Rudd, Elizabeth; Zumeta, William; Nerad, Maresi

    2011-01-01

    This paper unpacks how social science doctorate-holders come to evaluate overall excellence in their PhD training programs based on their domain-specific assessments of aspects of their programs. Latent class analysis reveals that social scientists 6-10 years beyond their PhD evaluate the quality of their doctoral program with one of two…

  15. Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity.

    PubMed

    Kozica, S L; Lombard, C B; Harrison, C L; Teede, H J

    2016-11-24

    The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs. A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor. Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m 2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required. Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up. Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].

  16. Health promotion in young adults at a university in Korea: A cross-sectional study of 625 participants in a university.

    PubMed

    Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

    2017-02-01

    Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program.A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test.The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants' overall evaluation score (83% rated "excellent" or "good") and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events.In conclusion, the university-wide health promotion program was effective in improving university members' health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs.

  17. Health promotion in young adults at a university in Korea

    PubMed Central

    Joh, Hee-Kyung; Kim, Hyun-Ji; Kim, Young-Oh; Lee, Jae-Young; Cho, BeLong; Lim, Chun Soo; Jung, Sung-Eun

    2017-01-01

    Abstract Young adulthood is a critical developmental period for establishing life-long health behaviors. However, too little attention has been paid to young adult health promotion. The purpose of this study was to describe the processes of development and implementation involved in a collaborative university-wide health promotion program and to evaluate the achievements of the program. A 3-day university-wide health promotion program was developed and implemented in the nation's largest public university in South Korea in September 2013. Its objectives were to heighten health awareness, to promote healthy behaviors, especially active lifestyle and healthy diet, and to disseminate health knowledge, skills, and access to health resources among young people. The program comprised 14 health lectures, 12 events, and 25 booths. To monitor and evaluate the program, a cross-sectional postevent survey was conducted. A convenience sample of 625 university members who participated in the program was used. The statistics were analyzed with a general linear model and paired t test. The program evaluation demonstrated that this university-wide program effectively provided opportunities for students to access health information, knowledge, skills, self-confidence, and available health services and resources. Participants positively evaluated most of the processes of the program activities and services. Participants’ overall evaluation score (83% rated “excellent” or “good”) and reparticipation intention (86%) were high. The majority of participants reported increased awareness of health (80%) and the need for a university health promotion program (87%) after the program. Most of the evaluation scores were similarly high for health lectures and booths/events. In conclusion, the university-wide health promotion program was effective in improving university members’ health awareness and providing opportunities for students to access various health information and resources. We believe that our results would be useful for sharing information on the planning and implementation of future university health promotion programs. PMID:28207551

  18. Employee Perceptions of Workplace Health Promotion Programs: Comparison of a Tailored, Semi-Tailored, and Standardized Approach.

    PubMed

    Street, Tamara D; Lacey, Sarah J

    2018-04-28

    In the design of workplace health promotion programs (WHPPs), employee perceptions represent an integral variable which is predicted to translate into rate of user engagement (i.e., participation) and program loyalty. This study evaluated employee perceptions of three workplace health programs promoting nutritional consumption and physical activity. Programs included: (1) an individually tailored consultation with an exercise physiologist and dietitian; (2) a semi-tailored 12-week SMS health message program; and (3) a standardized group workshop delivered by an expert. Participating employees from a transport company completed program evaluation surveys rating the overall program, affect, and utility of: consultations ( n = 19); SMS program ( n = 234); and workshops ( n = 86). Overall, participants’ affect and utility evaluations were positive for all programs, with the greatest satisfaction being reported in the tailored individual consultation and standardized group workshop conditions. Furthermore, mode of delivery and the physical presence of an expert health practitioner was more influential than the degree to which the information was tailored to the individual. Thus, the synergy in ratings between individually tailored consultations and standardized group workshops indicates that low-cost delivery health programs may be as appealing to employees as tailored, and comparatively high-cost, program options.

  19. Evaluation of an occupational rehabilitation program.

    PubMed

    Goodman, Glenn; Browning, Margaret; Campbell, Sims; Hudak, Huison

    2005-01-01

    The purpose of this study was to report the findings of a program evaluation for an occupational rehabilitation program in the Midwest. An ex-post facto chart review was performed on 50 charts using demographic data, results from tests of performance and pain measures, and data from patient satisfaction questionnaires to find evidence of excellence in the program, and to identify areas for improvement. Over 97% of the participants actually completed the program and 76% returned to work within 3 months after program completion. Ninety-two percent indicated overall satisfaction with the program, and all aspects of the program were rated with a mean score of 4.25 or above on a 1 to 5 Likert scale. Evaluation of perceived pain scales of the participants indicate no discernable relationship between intensity of pain and successful return to work. The program showed a high completion rate, a high return to work rate, and high levels of patient satisfaction. Suggestions for improvement include an increase in use of real and simulated work activities, better documentation of pain measures, better programs to address psychosocial issues, lengthening the program, and increased communication with case managers and professionals outside of the work program.

  20. Competency-based goals, objectives, and linked evaluations for rheumatology training programs: a standardized template of learning activities from the Carolinas Fellows Collaborative.

    PubMed

    Criscione-Schreiber, Lisa G; Bolster, Marcy B; Jonas, Beth L; O'Rourke, Kenneth S

    2013-06-01

    American Council on Graduate Medical Education program requirements mandate that rheumatology training programs have written goals, objectives, and performance evaluations for each learning activity. Since learning activities are similar across rheumatology programs, we aimed to create competency-based goals and objectives (CBGO) and evaluations that would be generalizable nationally. Through an established collaboration of the 4 training programs' directors in North Carolina and South Carolina, we collaboratively composed CBGO and evaluations for each learning activity for rheumatology training programs. CBGO and linked evaluations were written using appropriate verbs based on Bloom's taxonomy. Draft documents were peer reviewed by faculty at the 4 institutions and by members of the American College of Rheumatology (ACR) Clinician Scholar Educator Group. We completed templates of CBGO for core and elective rotations and conferences. Templates detail progressive fellow performance improvement appropriate to educational level. Specific CBGO are mirrored in learning activity evaluations. Templates are easily modified to fit individual program attributes, have been successfully implemented by our 4 programs, and have proven their value in 4 residency review committee reviews. We propose adoption of these template CBGO by the ACR, with access available to all rheumatology training programs. Evaluation forms that exactly reflect stated objectives ensure that trainees are assessed using standardized measures and that trainees are aware of the learning expectations. The objectives mirrored in the evaluations closely align with the proposed milestones for internal medicine training, and will therefore be a useful starting point for creating these milestones in rheumatology. Copyright © 2013 by the American College of Rheumatology.

  1. Formative Process Evaluation for Implementing a Social Marketing Intervention to Increase Walking Among African Americans in the Positive Action for Today’s Health Trial

    PubMed Central

    Wilson, Dawn K.; Griffin, Sarah; St. George, Sara M.; Alia, Kassandra A.; Trumpeter, Nevelyn N.; Wandersman, Abraham K.; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

    2012-01-01

    Objectives. Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today’s Health trial. Methods: We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Results: Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Conclusions: Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities. PMID:23078486

  2. Conceptual framework for development of comprehensive e-health evaluation tool.

    PubMed

    Khoja, Shariq; Durrani, Hammad; Scott, Richard E; Sajwani, Afroz; Piryani, Usha

    2013-01-01

    The main objective of this study was to develop an e-health evaluation tool based on a conceptual framework including relevant theories for evaluating use of technology in health programs. This article presents the development of an evaluation framework for e-health programs. The study was divided into three stages: Stage 1 involved a detailed literature search of different theories and concepts on evaluation of e-health, Stage 2 plotted e-health theories to identify relevant themes, and Stage 3 developed a matrix of evaluation themes and stages of e-health programs. The framework identifies and defines different stages of e-health programs and then applies evaluation theories to each of these stages for development of the evaluation tool. This framework builds on existing theories of health and technology evaluation and presents a conceptual framework for developing an e-health evaluation tool to examine and measure different factors that play a definite role in the success of e-health programs. The framework on the horizontal axis divides e-health into different stages of program implementation, while the vertical axis identifies different themes and areas of consideration for e-health evaluation. The framework helps understand various aspects of e-health programs and their impact that require evaluation at different stages of the life cycle. The study led to the development of a new and comprehensive e-health evaluation tool, named the Khoja-Durrani-Scott Framework for e-Health Evaluation.

  3. Program Evaluation of Math Factual Operations for Understanding

    ERIC Educational Resources Information Center

    Rouse, Julie A.

    2013-01-01

    Deficiencies in mathematics standardized test scores prompted school district policymakers to consider implementing a program designed to increase students' basic multiplication fact skills. This study was an evaluation of the Math Factual Operations for Understanding program. The program, marketed with a martial arts theme, was intended to…

  4. A Case Study of the Impact of a Sytematic Evaluation Process in a Graduate Medical Education Residency Program

    ERIC Educational Resources Information Center

    Kromrei, Heidi T.

    2014-01-01

    The Accreditation Council for Graduate Medical Education has charged institutions that sponsor accredited Graduate Medical Education programs (residency and fellowship specialty programs) with overseeing implementation of mandatory annual program evaluation efforts to ensure compliance with regulatory requirements. Physicians receive scant, if…

  5. UNICEF and UNAIDS Evaluations of HIV/AIDS Programmes in Sub-Saharan Africa.

    ERIC Educational Resources Information Center

    Morell, Jonathan A., Ed.

    2002-01-01

    Describes 14 evaluations of HIV and AIDS programs undertaken in sub-Saharan Africa over the last decade. These programs demonstrate the importance of enhancing program quality and providing national coverage, rooting programs in community, empowering young people, and developing partnerships to combat HIV and AIDS. (SLD)

  6. Cognitive Restructuring through Dreams and Imagery: Descriptive Analysis of a Women's Prison-Based Program

    ERIC Educational Resources Information Center

    DeHart, Dana

    2010-01-01

    This report describes process and outcome evaluation of an innovative program based in a women's maximum-security correctional facility. Methodology included review of program materials, unobtrusive observation of group process, participant evaluation forms, focus groups, and individual interviews with current and former program participants.…

  7. Helping Leaders Take Effective Action: A Program Evaluation.

    ERIC Educational Resources Information Center

    Young, Dianne P.; Dixon, Nancy M.

    In 1991 the Center for Creative Leadership (CCL) launched its LeaderLab program, with the goal of helping executives take more effective action in their leadership situations. This publication presents findings of a program evaluation that explored whether program participants took more effective action in their leadership situations. Data were…

  8. Student Perspectives: Evaluating a Higher Education Administration Program

    ERIC Educational Resources Information Center

    Roberts, Jalynn; Gentry, Debra; Townsend, Amy

    2011-01-01

    The purpose of this mixed-method study was to evaluate a Higher Education Administration doctoral program, to understand student perceptions of program quality, to improve both student satisfaction and retention to degree completion, and to plan for the future. Findings from survey data and focus group interviews indicated program strengths to…

  9. Final Evaluation Report. 1976-1977. Title I Migrant Program. Publication Number: 76.59.

    ERIC Educational Resources Information Center

    Austin Independent School District, TX. Office of Research and Evaluation.

    The final evaluation of the Elementary and Secondary Education Act Title I Migrant Program in the Austin, Texas Independent School District is reported. The program consisted of instructional, student recruitment, parental involvement, health services, and clothing components. The instructional component included programs for pre-kindergarten…

  10. Assessing the Value of the Enviroscape Watershed Learning Module

    ERIC Educational Resources Information Center

    Edwards, Warren Patrick

    2013-01-01

    Scope and Method of Study: The researcher's evaluation of the West Atlanta Watershed Alliance's (WAWA) programs highlighted that few if any of the offered educational programs included a program evaluation, especially the most promising, the Enviroscape® Watershed learning module. The education programs that were customized and developed by the…

  11. Improving Literacy Achievement for English Learners in Transitional Bilingual Programs.

    ERIC Educational Resources Information Center

    Saunders, William M.

    1999-01-01

    Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)

  12. Oasis Connections: Results from an Evaluation Study

    ERIC Educational Resources Information Center

    Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

    2012-01-01

    Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

  13. Miramar College Program Evaluation: Criminal Justice.

    ERIC Educational Resources Information Center

    Moriyama, Bruce; Brumley, Leslie

    Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in criminal justice. The report first outlines the information gathered in an interview with the program chairperson, conducted to determine program objectives and goals and how they were determined,…

  14. Miramar College Program Evaluation: Fire Science.

    ERIC Educational Resources Information Center

    Moriyama, Bruce; Brumley, Leslie

    Qualitative and quantitative data are presented in this evaluation of the curricular, personnel, and financial status of Miramar College's program in fire sciences. The report first provides the results of an interview with the program chairperson, which sought information on program objectives and goals and their determination, the extent to…

  15. Prevention Initiative Program. Final Evaluation Report Fiscal 1994.

    ERIC Educational Resources Information Center

    O'Neill, Patricia; Borger, Jeanne

    This report provides an evaluation of the Prevention Initiative Program's second-funded year in the Chicago Public Schools. The program's purpose was to reduce school failure by providing health and social services to young families, improving parenting skills, and assisting young mothers to complete high school. The program served pregnant or…

  16. SPECS 2. Component Two: Program Budgeting and Cost Accounting.

    ERIC Educational Resources Information Center

    DuVall, Lloyd A.

    The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. Component…

  17. METRO Achievement Program: Summer 1988. External Evaluation Report.

    ERIC Educational Resources Information Center

    Thompson, Denise R.

    This document comprises an evaluation of the 1988 METRO Achievement Program, a summer educational program to help develop the academic potential of primarily Black and Hispanic girls entering the seventh and eighth grades in Chicago. The 5-week program included the following components: (1) mathematics, science, and communication skills classes;…

  18. New Teacher Induction: A Program Evaluation

    ERIC Educational Resources Information Center

    Hunter, J. Warren

    2016-01-01

    The purpose of this qualitative program evaluation was to examine the impact a two-year new teacher induction program had on teachers' feelings of support, satisfaction, and self-efficacy. The program purports that higher feelings of support, satisfaction, and self-efficacy in teachers will lead to lower teacher attrition. In turn, research shows…

  19. Evaluation of a Group-Based Trauma Recovery Program in Gaza: Students' Subjective Experiences

    ERIC Educational Resources Information Center

    Barron, Ian; Abdullah, Ghassan

    2012-01-01

    Internationally, evaluation of group-based trauma recovery programs has relied upon normative outcome measures, with no studies systematically analyzing children's subjective experience for program development. In contrast, the current study explored children's experience of a Gazan recovery program "in their own words." Twenty-four…

  20. ADDENDUM TO SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM TECHNOLOGY PROFILES, TENTH EDITION, VOLUME 1 - DEMONSTRATION PROGRAM

    EPA Science Inventory

    The Superfund Innovative Technology Evaluation (SITE) Program, now in its thirteenth year, is an integral part of EPA's research into alternative cleanup methods for hazardous waste sites around the nation. The SITE Program was created to encourage the development and routine us...

  1. THE SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM: PROGRESS AND ACCOMPLISHMENTS - FISCAL YEAR 1990 A FOURTH REPORT TO CONGRESS

    EPA Science Inventory

    The SITE Program was the first major program for demonstrating and evaluating fullscale innovative treatment technologies at hazardous waste sites. Having concluded its fourth year, the SITE Program is recognized as a leading advocate of innovative technology development and comm...

  2. Criteria for Evaluating Advancement Programs.

    ERIC Educational Resources Information Center

    Heemann, Warren, Ed.

    Criteria for evaluating college and university advancement programs are presented, based on the efforts of professional area trustees and advisory committees of the Council for Advancement and Support of Education (CASE). The criteria can be useful in three ways: as the basis of internal audits of advancement programs or program components; as the…

  3. Evaluation of the Self-Directed Personal Services Program Operated through Enable.

    ERIC Educational Resources Information Center

    Walker, Pam; And Others

    This report evaluates a self-directed personal service (SDPS) program operated through the larger Enable Program for people with disabilities in Onondaga County, New York. First, it contrasts characteristics of traditional personal assistance services (such as low pay, agency-determined, limited types/levels of support, and program management…

  4. 76 FR 37371 - Agency Information Collection: Comment Request for National Gap Analysis Program Evaluation

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-06-27

    ... Gap Analysis Program (GAP). The information collected will provide information for the Program's... DEPARTMENT OF THE INTERIOR U.S. Geological Survey [USGS--GX10RB0000SDP00] Agency Information Collection: Comment Request for National Gap Analysis Program Evaluation AGENCY: United States Geological...

  5. Re-Employment Training: Evaluation of the Oakland University RECAP/JETS Program.

    ERIC Educational Resources Information Center

    Ramey, Luellen

    This document provides a description and evaluation of the RECAP (Re-employment Career Planning)/JETS (Job, Education/Training, Selection) program, a cooperative re-employment training program for displaced automobile industry workers in Michigan. Following the brief introduction, program development and pre-training preparation are discussed,…

  6. Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

    ERIC Educational Resources Information Center

    Greci, Dana

    2016-01-01

    Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

  7. An Evaluation of the Bordertown Dormitory Program.

    ERIC Educational Resources Information Center

    Bass, Willard P.; And Others

    The Bordertown Dormitory Program, providing Navajo students with experience in attending schools in off-reservation communities with non-Indian children, was evaluated in terms of the success of students; adequacy of dormitory and school facilities and programs; attitudes of students, parents, school personnel, and townspeople toward the program;…

  8. Evaluating disease management program effectiveness: an introduction to time-series analysis.

    PubMed

    Linden, Ariel; Adams, John L; Roberts, Nancy

    2003-01-01

    Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

  9. Evaluating the Effectiveness of the 2001-2002 NASA "Why?" Files Program

    NASA Technical Reports Server (NTRS)

    Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

    2002-01-01

    This report contains the results of the evaluation conducted for the 2001-2002 NASA 'Why?' Files program that was conducted in March 2002. The analysis is based on the results of 139 surveys collected from educators registered for the program. Respondents indicated that (1) the programs in the series are aligned with the national mathematics, science, and technology standards; (2) the programs are developmentally (grade level) appropriate; and (3) the programs enhance and enrich the teaching and learning of mathematics, science, and technology.

  10. Evaluation of a clinical medical librarianship program at a university Health Sciences Library.

    PubMed Central

    Schnall, J G; Wilson, J W

    1976-01-01

    An evaluation of the clinical medical librarianship program at the University of Washington Health Sciences Library was undertaken to determine the benefits of the program to patient care and to the education of the recipients of the service. Results of a questionnaire reflected overwhelming acceptance of the clinical medical librarianship program. Guidelines for the establishment of a limited clinical medical librarianship program are described. A statistical cost analysis of the program is included. PMID:938773

  11. EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

    EPA Science Inventory

    This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

  12. 7 CFR 3405.22 - Evaluation of program.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 7 Agriculture 15 2011-01-01 2011-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

  13. 7 CFR 3405.22 - Evaluation of program.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... 7 Agriculture 15 2012-01-01 2012-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

  14. 7 CFR 3405.22 - Evaluation of program.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... 7 Agriculture 15 2013-01-01 2013-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

  15. 7 CFR 3405.22 - Evaluation of program.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... 7 Agriculture 15 2014-01-01 2014-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) NATIONAL INSTITUTE OF FOOD AND AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM Supplementary Information § 3405.22 Evaluation of...

  16. Evaluation of a PhD Program: Paving the Way.

    ERIC Educational Resources Information Center

    Germain, Carol P.; And Others

    1994-01-01

    During the evolution of an evaluation process for the University of Pennsylvania's doctoral program in nursing, a task force developed criteria and sources for program evaluation and surveyed students, alumni, and faculty to write a self-study report for external reviewers. (JOW)

  17. Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

    PubMed

    Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

    2014-01-01

    Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

  18. Using the RE-AIM framework to evaluate physical activity public health programs in México.

    PubMed

    Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

    2015-02-19

    Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

  19. Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations.

    PubMed

    Wasserman, Deborah L

    2010-05-01

    This paper offers a framework for using a systems orientation and "foundational theory" to enhance theory-driven evaluations and logic models. The framework guides the process of identifying and explaining operative relationships and perspectives within human service program systems. Self-Determination Theory exemplifies how a foundational theory can be used to support the framework in a wide range of program evaluations. Two examples illustrate how applications of the framework have improved the evaluators' abilities to observe and explain program effect. In both exemplars improvements involved addressing and organizing into a single logic model heretofore seemingly disparate evaluation issues regarding valuing (by whose values); the role of organizational and program context; and evaluation anxiety and utilization. Copyright 2009 Elsevier Ltd. All rights reserved.

  20. Reducing Gridlock on the Grid: Utility Trends in Managing Peak Electric Load through Residential Demand Response

    NASA Astrophysics Data System (ADS)

    McDonald, Betsy

    Utilities across the United States are piloting residential demand response programs to help manage peak electric demand. Using publicly available program evaluations, this thesis analyzes nine such programs to uncover and synthesize the range of program offerings, goals, enrollment strategies, and customer experiences. This review reveals that program participation, components, and results differ based on a variety of factors, including geographic characteristics, program goals, and implementation strategies. The diversity of program designs and evaluation findings suggests an underlying tension between the need to generate cost-effective program impacts and the desire to increase accessibility so that program benefits are not exclusive to certain segments of the population. For more significant and impactful engagement, program goals may need to shift. State level policy support could help shift program goals toward increasing program accessibility. Future research should explore creative strategies that target existing barriers and allow for more inclusive deployment.

  1. Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

    ERIC Educational Resources Information Center

    Grant, Kelly J.

    2016-01-01

    The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

  2. Use of Bennett's Hierarchical Model in the Evaluation of the Extension Education Program for Cacao Farmers in the Northeast Region of the Dominican Republic. Summary of Research 54.

    ERIC Educational Resources Information Center

    De los Santos, Saturnino; Norland, Emmalou Van Tilburg

    A study evaluated the cacao farmer training program in the Dominican Republic by testing hypothesized relationships among reactions, knowledge and skills, attitudes, aspirations, and some selected demographic characteristics of farmers who attended programs. Bennett's hierarchical model of program evaluation was used as the framework of the study.…

  3. Evaluation of a Cardiovascular Education Pilot Program.

    ERIC Educational Resources Information Center

    Fang, Wei Li

    1980-01-01

    A Virginia elementary-secondary school blood pressure education program is described and evaluated. Evidence presented indicates that participants' cardiovascular knowledge levels increased significantly as a result of program participation. (JMF)

  4. From Schools to Community Learning Centers: A Program Evaluation of a School Reform Process

    ERIC Educational Resources Information Center

    Magolda, Peter; Ebben, Kelsey

    2007-01-01

    This manuscript reports on a program evaluation of a school reform initiative conducted in an Ohio city. The paper describes, interprets, and evaluates this reform process aimed at transforming schools into community learning centers. The manuscript also describes and analyzes the initiative's program evaluation process. Elliot Eisner's [(1998).…

  5. Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

    Treesearch

    Susan Charnley; Bruce Engelbert

    2005-01-01

    This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation...

  6. Formative Evaluation in a Cognitive Developmental Program for Young Children.

    ERIC Educational Resources Information Center

    Willis, Sherry L.; And Others

    The Cognitive Developmental Early Childhood program at Pennsylvania State University has formulated a program, curriculum, and evaluation system guided by Piagetian theory. The evaluation system described in this paper is a result of an intensive examination of the purposes and types of evaluation systems for their compatibility with the Piagetian…

  7. The Do's and Don'ts in Regard to the Evaluation of Bilingual Programs.

    ERIC Educational Resources Information Center

    Rodriquez-Brown, Flora V.

    The difficulties in evaluating bilingual education appear to have prevented success in all but a few evaluation attempts, but better and more meaningful evaluation is neccessary in order to identify the strengths and weaknesses of bilingual programs. Many bilingual programs are undergoing constant modification, adequate assessment instruments have…

  8. Evaluating Federal Social Programs: Finding out What Works and What Does Not

    ERIC Educational Resources Information Center

    Muhlhausen, David B.

    2012-01-01

    Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

  9. What Have We Learned about the Politics of Program Evaluation?

    ERIC Educational Resources Information Center

    Chelimsky, Eleanor

    The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

  10. Adapting the Empowerment Evaluation Model: A Mental Health Drop-In Center Case Example

    ERIC Educational Resources Information Center

    Sullins, Carolyn D.

    2003-01-01

    Empowerment evaluation involves a program's stakeholders in designing and implementing an evaluation of their own program, thus contributing to the program's improvement and self-determination (Fetterman, 1994, 1996). It appeared to be an appropriate approach for evaluating a mental health drop-in center, which had congruent goals of collaboration…

  11. Formative Evaluation of the Adult Learning, Literacy and Essential Skills Program. Final Report

    ERIC Educational Resources Information Center

    Human Resources and Skills Development Canada, 2010

    2010-01-01

    This report presents the results of the formative evaluation of the Adult Learning, Literacy and Essential Skills Program (ALLESP). Data collection related to this evaluation took place between November 2008 and May 2009. The evaluation resulted in the following four recommendations: (1) It is recommended that Program objectives and activities…

  12. Evaluation of ridesharing programs in Michigan

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Kulp, G.; Tsao, H.J.; Webber, R.E.

    1982-10-01

    The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

  13. Formative evaluation of an Inspection Certificate Program (ICP) pilot in Toronto.

    PubMed

    Dwyer, J J; Komorowski, C; Ruf, F

    1999-01-01

    The inspection certificate program consists of food establishments voluntarily posting a certificate to inform patrons that inspection reports can be accessed from operators or the public health department. A three-month pilot program was evaluated for program improvement purposes. Only 65% of the selected operators were willing to participate, which suggests a challenge to fully implementing the program. Thirty-nine randomly selected restaurant operators participated. Most operators posted the certificate at the front entrance, and patrons indicated that reports were clear. Operators were supportive of the program. Some operators reported that the program was good for business and offered suggestions to improve it. A total of 583 requests for reports were made which suggests that the program empowered patrons to request reports, mostly from operators. Most patron evaluation forms came from a few operators that had no deficiencies, which limits generalizability.

  14. Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

    PubMed Central

    Pound, Catherine M.; Moreau, Katherine A.; Ward, Natalie; Eady, Kaylee; Writer, Hilary

    2015-01-01

    Background Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE) program. Methods We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes. PMID:26059213

  15. A statewide nurse training program for a hospital based infant abusive head trauma prevention program.

    PubMed

    Nocera, Maryalice; Shanahan, Meghan; Murphy, Robert A; Sullivan, Kelly M; Barr, Marilyn; Price, Julie; Zolotor, Adam

    2016-01-01

    Successful implementation of universal patient education programs requires training large numbers of nursing staff in new content and procedures and maintaining fidelity to program standards. In preparation for statewide adoption of a hospital based universal education program, nursing staff at 85 hospitals and 1 birthing center in North Carolina received standardized training. This article describes the training program and reports findings from the process, outcome and impact evaluations of this training. Evaluation strategies were designed to query nurse satisfaction with training and course content; determine if training conveyed new information, and assess if nurses applied lessons from the training sessions to deliver the program as designed. Trainings were conducted during April 2008-February 2010. Evaluations were received from 4358 attendees. Information was obtained about training type, participants' perceptions of newness and usefulness of information and how the program compared to other education materials. Program fidelity data were collected using telephone surveys about compliance to delivery of teaching points and teaching behaviors. Results demonstrate high levels of satisfaction and perceptions of program utility as well as adherence to program model. These findings support the feasibility of implementing a universal patient education programs with strong uptake utilizing large scale systematic training programs. Copyright © 2015 Elsevier Ltd. All rights reserved.

  16. Evaluative Thinking in Practice: The National Asthma Control Program.

    PubMed

    Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

    2018-01-01

    Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

  17. Economic evaluation of preventive dental programs: what can they tell us?

    PubMed

    Morgan, Mike; Mariño, Rodrigo; Wright, Clive; Bailey, Denise; Hopcraft, Matthew

    2012-10-01

    The role of public health program planners is to determine the effectiveness of public health programs, what recommendations should be made, what future initiatives should be taken, and what policies should be developed. At a basic level, to choose between competing alternatives, two characteristics of an intervention must be considered; these are its outcome and its cost. Based on cost and outcome, planners must select the option that offers the most advantages. Economic evaluation is commonly adopted by decision makers in the health sector to investigate the effectiveness of public health programs and to help plan future initiatives. Economic evaluation assists decision makers who must weigh the information it provides in the context of many and often competing options. In this way, an economic evaluation is an aid to decision making rather than the decision itself. Economic evaluation is becoming essential for informed decision making, with potential implications for public health policy and practice and for clinical practice too. While economic evaluations are commonly used in decision-making processes about health programs, few examples exist in the oral health literature. In the case of preventive oral health programs, economic analysis is often difficult, largely because it makes demands on epidemiological and demographic data that are hard to meet. This study will address the concepts and tools required to conduct economic evaluations of prevention programs. The emphasis will be on oral health and preventive dental programs, although the concepts presented could be useful for other public health programs by practitioners and managers with the aim of producing effective and efficient oral health programs. © 2012 John Wiley & Sons A/S.

  18. Rational drug therapy education in clinical phase carried out by task-based learning

    PubMed Central

    Bilge, S. Sırrı; Akyüz, Bahar; Ağrı, Arzu Erdal; Özlem, Mıdık

    2017-01-01

    Objectives: Irrational drug use results in drug interactions, treatment noncompliance, and drug resistance. Rational pharmacotherapy education is being implemented in many faculties of medicine. Our aim is to introduce rational pharmacotherapy education by clinicians and to evaluate task-based rational drug therapy education in the clinical context. Methods: The Kirkpatrick's evaluation model was used for the evaluation of the program. The participants evaluated the program in terms of constituents of the program, utilization, and contribution to learning. Voluntary participants responded to the evaluation forms after the educational program. Data are evaluated using both quantitative and qualitative tools. SPSS (version 21) used for quantitative data for determining mean and standard deviation values. Descriptive qualitative analysis approach is used for the analysis of open-ended questions. Results: It was revealed that the program and its components have been favorable. A total 95.9% of the students consider the education to be beneficial. Simulated patients practice and personal drug choice/problem-based learning sessions were appreciated by the students in particular. 93.9% of the students stated that all students of medicine should undergo this educational program. Among the five presentations contained in the program, “The Principles of Prescribing” received the highest points (9 ± 1.00) from participating students in general evaluation of the educational program. Conclusion: This study was carried out to improve task-based rational drug therapy education. According to feedback from the students concerning content, method, resource, assessment, and program design; some important changes, especially in number of facilitators and indications, are made in rational pharmacotherapy education in clinical task-based learning program. PMID:28458432

  19. External quality-assurance programs managed by the U.S. Geological Survey in support of the National Atmospheric Deposition Program/National Trends Network

    USGS Publications Warehouse

    Latysh, Natalie E.; Wetherbee, Gregory A.

    2005-01-01

    The U.S. Geological Survey, Branch of Quality Systems, operates the external quality-assurance programs for the National Atmospheric Deposition Program/National Trends Network (NADP/NTN). Beginning in 1978, six different programs have been implemented?the intersite-comparison program, the blind-audit program, the sample-handling evaluation program, the field-audit program, the interlaboratory-comparison program, and the collocated-sampler program. Each program was designed to measure error contributed by specific components in the data-collection process. The intersite-comparison program, which was discontinued in 2004, was designed to assess the accuracy and reliability of field pH and specific-conductance measurements made by site operators. The blind-audit and sample-handling evaluation programs, which also were discontinued in 2002 and 2004, respectively, assessed contamination that may result from sampling equipment and routine handling and processing of the wet-deposition samples. The field-audit program assesses the effects of sample handling, processing, and field exposure. The interlaboratory-comparison program evaluates bias and precision of analytical results produced by the contract laboratory for NADP, the Illinois State Water Survey, Central Analytical Laboratory, and compares its performance with the performance of international laboratories. The collocated-sampler program assesses the overall precision of wet-deposition data collected by NADP/NTN. This report documents historical operations and the operating procedures for each of these external quality-assurance programs. USGS quality-assurance information allows NADP/NTN data users to discern between actual environmental trends and inherent measurement variability.

  20. Evaluation and Strategic Planning for the GLOBE Program

    NASA Astrophysics Data System (ADS)

    Geary, E. E.; Williams, V. L.

    2010-12-01

    The Global Learning and Observations to Benefit the Environment (GLOBE) Program is an international environmental education program. It unites educators, students and scientists worldwide to collaborate on inquiry based investigations of the environment and Earth system science. Evaluation of the GLOBE program has been challenging because of its broad reach, diffuse models of implementation, and multiple stakeholders. In an effort to guide current evaluation efforts, a logic model was developed that provides a visual display of how the GLOBE program operates. Using standard elements of inputs, activities, outputs, customers and outcomes, this model describes how the program operates to achieve its goals. The template used to develop this particular logic model aligns the GLOBE program operations with its program strategy, thus ensuring that what the program is doing supports the achievement of long-term, intermediate and annual goals. It also provides a foundation for the development of key programmatic metrics that can be used to gauge progress toward the achievement of strategic goals.

  1. Measuring Success in Obesity Prevention: A Synthesis of Health Promotion Switzerland's Long-Term Monitoring and Evaluation Strategy

    PubMed Central

    Ackermann, Günter; Kirschner, Michael; Guggenbühl, Lisa; Abel, Bettina; Klohn, Axel; Mattig, Thomas

    2015-01-01

    Aims Since 2007, Health Promotion Switzerland has implemented a national priority program for a healthy body weight. This article provides insight into the methodological challenges and results of the program evaluation. Methods Evaluation of the long-term program required targeted monitoring and evaluation projects addressing different outcome levels. The evaluation was carried out according to the Swiss Model for Outcome Classification (SMOC), a model designed to classify the effects of health promotion and prevention efforts. Results The results presented in this article emphasize both content and methods. The national program successfully achieved outcomes on many different levels within complex societal structures. The evaluation system built around the SMOC enabled assessment of program progress and the development of key indicators. However, it is not possible to determine definitively to what extent the national program helped stabilize the prevalence of obesity in Switzerland. Conclusion The model has shown its utility in providing a basis for evaluation and monitoring of the national program. Continuous analysis of data from evaluation and monitoring has made it possible to check the plausibility of suspected causal relationships as well as to establish an overall perspective and assessment of effectiveness supported by a growing body of evidence. PMID:25765161

  2. Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program

    PubMed Central

    Jaafaripooyan, Ebrahim

    2014-01-01

    Background: Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods: A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Results: Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion: Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs. PMID:25279381

  3. Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

    PubMed

    Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

    2008-10-01

    To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

  4. Collaborative evaluation of a high school prevention curriculum: How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement.

    PubMed

    Orsini, Muhsin Michael; Wyrick, David L; Milroy, Jeffrey J

    2012-11-01

    Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome variables that can be used for program improvement. Throughout this project there were many examples of client learning from evaluator and evaluator learning from client. This article presents convincing evidence that collaborative evaluation can improve the design, implementation, and findings of the randomized control trial. Throughout this paper, we discuss many examples of good science, good evaluation, and other practical benefits of practicing collaborative evaluation. Ultimately, the authors created the term pre-formative evaluation to describe the period prior to data collection and before program implementation, when collaborative evaluation can inform program improvement. Copyright © 2012 Elsevier Ltd. All rights reserved.

  5. Measuring the Impact of Employment-Related Social Programs. A Primer on the Evaluation of Employment and Training, Vocational Education, Vocational Rehabilitation, and Other Job-Oriented Programs.

    ERIC Educational Resources Information Center

    Borus, Michael E.

    An approach and methodology for the systematic measurement of the impact of employment-related social programs is presented in this primer. Chapter 1 focuses on evaluation as the third step (the first two being planning and operation) in the process of program implementation. Chapter 2 examines the impacts of social programs. Topics include…

  6. Development of a multilayer interference simulation program for MSS systems

    NASA Technical Reports Server (NTRS)

    Izadian, Jamal S.

    1993-01-01

    This paper discusses the development of a multilayer interference analysis and simulation program which is used to evaluate interference between non-geostationary and geostationary satellites. In addition to evaluating interference, this program can be used in the development of sharing criteria and coordination among various Mobile Satellite Services (MSS) systems. A C++/Windows implementation of this program, called Globalstar Interference Simulation Program (GISP), has been developed.

  7. The National Cross-Site Evaluation of High-Risk Youth Programs. Preventing Substance Abuse: Major Findings from the National Cross-Site Evaluation of High-Risk Youth Programs. Monograph Series.

    ERIC Educational Resources Information Center

    Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Herman, Jack

    This multiple-site study assessed 48 prevention programs for high-risk youth funded by the Center for Substance Abuse Prevention, identifying program characteristics associated with strong substance abuse prevention outcomes. Data analysis indicated that substance abuse programs reduced rates of substance use, and the positive effects of program…

  8. Evaluation of Project P.A.T.H.S. (Secondary 1 Program) by the Program Participants: Findings Based on the Full Implementation Phase

    ERIC Educational Resources Information Center

    Shek, Daniel T. L.; Sun, Rachel C. F.

    2008-01-01

    A total of 207 schools (N = 33,693 students) participated in the Secondary 1 Program of Project P.A.T.H.S. in the Full Implementation Phase (2006-07). Participants responded to a Subjective Outcome Evaluation Form (Form A) to assess their views of the program, instructors, and perceived effectiveness after program completion. Utilizing the…

  9. ENVIRONMENTAL, ECONOMIC AND ENERGY IMPACTS OF MATERIAL RECOVERY FACILITIES - A MITE PROGRAM EVALUATION

    EPA Science Inventory

    This report documents an evaluation of the environmental, economic, and energy impacts of material recovery facilities (MRFS) conducted under the Municipal Solid Waste Innovative Technology Evaluation (MITE) Program. he MITE Program is sponsored by the U.S. Environmental Protecti...

  10. Evaluating Afterschool Programs

    ERIC Educational Resources Information Center

    Little, Priscilla M.

    2014-01-01

    Well-implemented afterschool programs can promote a range of positive learning and developmental outcomes. However, not all research and evaluation studies have shown the benefits of participation, in part because programs and their evaluation were out of sync. This chapter provides practical guidance on how to foster that alignment between…

  11. Evaluation of Career Development Programs from an Action Perspective.

    ERIC Educational Resources Information Center

    Young, Richard A.; Valach, Ladislav

    1994-01-01

    Presents action-theoretical approach to evaluation of career development programs based on constructionist epistemology. Propositions from action-theoretical perspective center around career and action as related, interpretative constructs. Propositions give rise to implications for evaluation of career programs that address ongoing nature of…

  12. Do adolescents perceive police officers as credible instructors of substance abuse prevention programs?

    PubMed

    Hammond, Augustine; Sloboda, Zili; Tonkin, Peggy; Stephens, Richard; Teasdale, Brent; Grey, Scott F; Williams, Joseph

    2008-08-01

    Although program recipients' attitudes toward instructors are crucial to program outcomes, they have not been adequately examined in the substance abuse prevention literature. This study uses survey data to explore attitudes toward instructors of prevention programming held by students from a national longitudinal evaluation of a school-based substance abuse prevention program delivered by Drug Abuse Resistance Education (D.A.R.E.) officers. Our analyses indicated that students who had police officers as instructors evaluated program instructors significantly higher than students who had non-police officers as instructors. The evaluation of police instructors varied according to students' sociodemographic characteristics. Implications for future research and practice are considered.

  13. Evaluation of the three-dimensional parabolic flow computer program SHIP

    NASA Technical Reports Server (NTRS)

    Pan, Y. S.

    1978-01-01

    The three-dimensional parabolic flow program SHIP designed for predicting supersonic combustor flow fields is evaluated to determine its capabilities. The mathematical foundation and numerical procedure are reviewed; simplifications are pointed out and commented upon. The program is then evaluated numerically by applying it to several subsonic and supersonic, turbulent, reacting and nonreacting flow problems. Computational results are compared with available experimental or other analytical data. Good agreements are obtained when the simplifications on which the program is based are justified. Limitations of the program and the needs for improvement and extension are pointed out. The present three dimensional parabolic flow program appears to be potentially useful for the development of supersonic combustors.

  14. Do State Pre-K Programs Improve Children's Pre-Literacy and Math Learning? Evaluation Science Brief

    ERIC Educational Resources Information Center

    National Forum on Early Childhood Program Evaluation, 2008

    2008-01-01

    "Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "An Effectiveness-Based Evaluation of Five State Pre-Kindergarten Programs" (V. C. Wong, T. D. Cook, W. S. Barnett, and K. Jung.) States have high aspirations for…

  15. Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

    PubMed

    McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

    2012-10-01

    To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.

  16. Measuring infrastructure: A key step in program evaluation and planning

    PubMed Central

    Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

    2016-01-01

    State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

  17. Measuring infrastructure: A key step in program evaluation and planning.

    PubMed

    Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

    2016-06-01

    State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

  18. Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

    PubMed

    Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

    2018-05-30

    A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design in evaluating the training program, the training program is expected to be efficiently and rapidly implemented into and adjusted to care practice and medical education.

  19. Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

    PubMed

    Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

    2016-08-01

    Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

  20. Investigating the criteria and processes used in the selection, implementation, and evaluation of STEM within K-12 education

    NASA Astrophysics Data System (ADS)

    Delp, Matthew J.

    This study utilized survey research to investigate how school districts within K-12 education select, implement, and evaluate Science, Technology, Engineering, and Mathematics (STEM) programs. Thirty school districts within the Math and Science Collaborative located in Western Pennsylvania participated in this research. In addition to characterizing the STEM programs of the participating school districts, this study also analyzed the alignment of these programs to the components of comprehensive STEM programs and critical approaches to substantiate STEM program implementation as stated in the literature (Augustine, 2005; Bybee, 2010a, 2010b; Carnevale et al., 2011; DeJarnette, 2010; Epstein & Miller, 2011b; Gardner et al., 1983; Hossain & Robinson, 2011, 2012; Kuenzi, 2008). Findings suggest that the primary goal for school districts, as it relates to STEM program implementation, is to influence students' interest and pursuit of STEM-related careers and degrees. In order to achieve this goal, results of this study indicate the focus of STEM program implementation occurs with the greatest frequency at the middle school (grades seven and eight) level, are developed as an adaptation to the curriculum, and are very diverse from one school district to the next. In addition, findings suggest that although school districts maintain they aim to promote careers and degrees in STEM, districts rely on traditional methods of evaluating STEM program implementation (i.e. standardized test scores) and do not track the longitudinal impact their STEM programs as they related to degrees and careers in STEM. Furthermore, results indicate district STEM programs are not aligned to the characteristics of comprehensive STEM programs as defined by the literature. In order to address the misalignment of school district goals and evaluation processes involved in STEM program implementation and the absence of the characteristics commensurate with comprehensive STEM programs, this study has created a framework to guide school districts in STEM program selection, implementation, and evaluation.

  1. Evaluation of a Life Skills Program for Women Inmates in Michigan.

    ERIC Educational Resources Information Center

    Schram, Pamela J.; Morash, Merry

    2002-01-01

    Describes and evaluates a life skills program that focuses on addressing the special needs of female inmates. Analyses of pre- and post-test scores of program participants compared emotional empathy, self-esteem, coping resources, problem solving, parenting stress, employability, and well-being. Results suggest tat the program does address some of…

  2. Evaluating the BK 21 Program. Research Brief

    ERIC Educational Resources Information Center

    Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.

    2008-01-01

    The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…

  3. Chapter I Mathematics Program, 1983-84. Report of Evaluation.

    ERIC Educational Resources Information Center

    Tompkins, John F.

    This report provides an evaluation of the Chapter I mathematics program for 1,020 first through eighth grade students in the Des Moines Independent Community School District. Included is a description of the program, information on program budget and expenditures, and narrative accounts of the attainment of 17 performance and process objectives.…

  4. Listening for the Squeaky Wheel: Designing Distance Writing Program Assessment

    ERIC Educational Resources Information Center

    Tucker, Virginia M.

    2012-01-01

    Distance writing programs still struggle with assessment strategies that can evaluate student writing as well as their ability to communicate about that writing with peers at a distance. This article uses Kim, Smith and Maeng's 2008 distance education program assessment scheme to evaluate a single distance writing program at Old Dominion…

  5. Supplemental Literacy Instruction for Students with Down Syndrome: A Program Evaluation

    ERIC Educational Resources Information Center

    Regan, Lisa Michelle

    2013-01-01

    The study utilizes an inductive, qualitative approach to program evaluation to understand the nature of an afterschool literacy tutoring program for students with Down syndrome. Two research questions guide this study: (a) What are the curricular and instructional elements of the Let's Read Now (LRN) literacy tutoring program for students…

  6. Evaluating Mentoring Programs. P/PV Brief

    ERIC Educational Resources Information Center

    Grossman, Jean Baldwin

    2009-01-01

    This methodological brief is designed to provide both program operators and researchers with practical advice about how to assess a program's implementation and impact. Adapted from an article that first appeared in "The Handbook of Youth Mentoring" (DuBois and Karcher, ed. 2005), the brief focuses on the evaluation of mentoring programs, but the…

  7. Pennsylvania's Family Literacy Programs: Results of a Statewide Evaluation, 1999-2000.

    ERIC Educational Resources Information Center

    Van Horn, Barbara; Kassab, Cathy; Grinder, Elisabeth

    Pennsylvania's family literacy programs were subjected to a statewide evaluation in 1999-2000. Data were collected through focus groups with parents, a survey of staff in community agencies and organizations, and analyses of program data and the findings of selected assessments administered to adults and children involved in the program.…

  8. Lifeskills Program Evaluation at Mammoth Heights Elementary School

    ERIC Educational Resources Information Center

    Tanner, Emma Moss

    2016-01-01

    This study is a program evaluation of the Life Skills Program at Mammoth Heights Elementary in the Douglas County School District. The overall goal of the Life Skills Program is to increase students' independent and daily living skills through the teaching of communication, social-emotional skills and academic skills. Students in the Life Skills…

  9. The 1977 Rankings of Programs for an In-Depth Evaluation. Research Note.

    ERIC Educational Resources Information Center

    Baratta, Mary Kathryne

    Placement, unit cost, retention and attraction data for all programs at Moraine Valley Community College for which information was available were used to determine which programs needed in-depth evaluation. Four of the 24 associate degree programs (secretarial science, radiologic technology, power machine technology, and industrial supervision)…

  10. A Review of Elementary School-Based Substance Use Prevention Programs: Identifying Program Attributes

    ERIC Educational Resources Information Center

    Hopfer, S.; Davis, D.; Kam, J. A.; Shin, Y.; Elek, E.; Hecht, M. L.

    2010-01-01

    This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary…

  11. California's Past Programs to Support School and District Improvement: A Synthesis of Evaluation Studies

    ERIC Educational Resources Information Center

    California Collaborative on District Reform, 2017

    2017-01-01

    This document synthesizes the findings from the evaluations of four statewide programs designed to provide support for underperforming schools and districts in California as part of the state accountability system: (1) Immediate Intervention/Underperforming Schools Program (II/USP); (2) High Priority Schools Grant (HPSG) Program; (3) School…

  12. Effects of the Saluda Prevention Program: A Review of Controlled Evaluation Studies

    ERIC Educational Resources Information Center

    Espada-Sánchez, José P.; Hernández-Serrano, Olga

    2015-01-01

    The objective of the present study is to review the evidence on the effectiveness concerning the Saluda program, a school-based substance use prevention protocol used amongst adolescents. We provide a description of the program content and the results from nine controlled trials evaluating the program effectiveness. Participants were Spanish…

  13. Financial Awareness Education with Apprentices in the Australian Construction Industry: Program Evaluation

    ERIC Educational Resources Information Center

    Du Plessis, Karin; Green, Emma

    2013-01-01

    A financial awareness education program was implemented with construction industry apprentices in Victoria, Australia. The program included face-to-face delivery of education around a range of financial management issues that apprentices face as they begin their apprenticeship. The paper reports on an evaluation of the program, which included…

  14. Evaluation of the Olweus Bullying Prevention Program in Nine Urban Schools: Effective Practices and next Steps

    ERIC Educational Resources Information Center

    Black, Sally; Washington, Ericka

    2008-01-01

    The Olweus Bullying Prevention Program (BPP) is an internationally recognized school-based bullying prevention program. This project sought to evaluate pilot implementation of the program in one urban district using fidelity of implementation, bullying incident density (BID), student surveys, and serious incident reports as process and outcome…

  15. 45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to Public Welfare (Continued) CORPORATION FOR NATIONAL AND COMMUNITY SERVICE SCHOOL-BASED SERVICE-LEARNING... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

  16. Two Feathers Endowment Scholarship Program: Program Evaluation

    ERIC Educational Resources Information Center

    Pierce, Alexandra

    2004-01-01

    The Saint Paul Foundation contracted with the Wilder Research Center to conduct an evaluation of their Two Feathers Scholarship Program. The Two Feathers Scholarship Program is funded through the Two Feathers Endowment, which is one part of the Foundation's SpectrumTrust. SpectrumTrust is a unique partnership between communities of color and The…

  17. An Outcome Evaluation of the Spirituality for Kids Program. Technical Report

    ERIC Educational Resources Information Center

    Maestas, Nicole; Gaillot, Sarah

    2008-01-01

    This report presents results from a multisite, quantitative evaluation of the international Spirituality for Kids (SFK) after-school program. Despite its name, SFK is a nonreligious program that seeks to build resilience in children by teaching them to access inner resources and build positive connections with others. The SFK program is unlike…

  18. A Microcomputer Program for Evaluating Pumping Test Results for Confined Aquifers.

    ERIC Educational Resources Information Center

    Smith, Stephen M.

    1986-01-01

    Describes an interactive, self-prompting BASIC program that can be incorporated in introductory and intermediate hydrology courses. Exlains how the program can be used to evaluate pumping test data and also to calculate transmissivity and storativity values of confined aquifers. The program is written for the IBM PC. (ML)

  19. Program Fighter - An Evaluation.

    ERIC Educational Resources Information Center

    Hull, David G.; Fowler, Wallace T.

    Described is a computer program for the sizing of subsonic and supersonic fighters which has been adapted for use in an aerospace engineering design course. Following a description of the program, an evaluation of its use in the university is presented. It is concluded that computer programs for the conceptual design of aerospace vehicles can play…

  20. Toward More Precise Definition and Evaluation of Televised Educational Programming

    ERIC Educational Resources Information Center

    Aversa Fran; Morrison, Gary R.

    1978-01-01

    An operational definition of public television programming and its implications for development and production agencies is sorely needed. This article explores some of the components of such a definition and examines the differences in several types of educational programming in terms of specific design and evaluation variables of the program.…

  1. Personal Benefits of a Health Evaluation and Enhancement Program

    NASA Technical Reports Server (NTRS)

    Heinzelmann, F.; Durbeck, D. C.

    1970-01-01

    A study was made of the benefits reported by participants in a health evaluation and enhancement program dealing with physical activity. Program benefits were identified and defined in regard to three major areas: program effects on work; program effects on health; and program effects on habits and behavior. A strong positive and consistent relationship was found between reported benefits in each of these areas and measures of improvement in cardiovascular functioning based on treadmill performance. Significant differences in these measures of improvement were also found between participants who reported program benefits and those persons who did not. These findings provide a meaningful profile of the pattern of benefits generated by this kind of health program.

  2. "I've Lost My Husband, My House and I Need a New Knee...Why Should I Smile?": Action Research Evaluation of a Group Cognitive Behavioural Therapy Program for Older Adults with Depression

    ERIC Educational Resources Information Center

    Richardson, Lisa; Reid, Corinne

    2006-01-01

    The current paper details an action research approach to developing and evaluating a group cognitive-behavioural therapy (CBT) program for older adults (65+ years) experiencing depression. This approach allowed the development of a novel program and for each component of the program to be evaluated and modified in an iterative, developmental…

  3. The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia. Impact Evaluation Series No. 29. Policy Research Working Paper 4836

    ERIC Educational Resources Information Center

    Barrera-Osorio, Felipe; Linden, Leigh L.

    2009-01-01

    This paper presents the evaluation of the program Computers for Education. The program aims to integrate computers, donated by the private sector, into the teaching of language in public schools. The authors conduct a two-year randomized evaluation of the program using a sample of 97 schools and 5,201 children. Overall, the program seems to have…

  4. Creating a Minnesota Statewide SNAP-Ed Program Evaluation

    ERIC Educational Resources Information Center

    Gold, Abby; Barno, Trina Adler; Sherman, Shelley; Lovett, Kathleen; Hurtado, G. Ali

    2013-01-01

    Systematic evaluation is an essential tool for understanding program effectiveness. This article describes the pilot test of a statewide evaluation tool for the Supplemental Nutrition Assistance Program-Education (SNAP-Ed). A computer algorithm helped Community Nutrition Educators (CNEs) build surveys specific to their varied educational settings…

  5. Planning, Implementation, and Evaluation of AIDS Education Programs for Dentists.

    ERIC Educational Resources Information Center

    Gerbert, Barbara; And Others

    1991-01-01

    An office-based continuing education program on acquired immune deficiency syndrome (AIDS) for dentists is described, including needs assessment, model development, local piloting, national implementation with 119 dentists, and evaluation phases. Program evaluation indicated an improvement in risk perception, knowledge, and practice resulted, but…

  6. Evaluation Project of a Postvention Program.

    ERIC Educational Resources Information Center

    Simon, Robert; And Others

    A student suicide or parasuicide increases the risk that potentially suicidal teenagers see suicide as an enviable option. The "copycat effect" can be reduced by a postvention program. This proposed evaluative research project will provide an implementation and impact evaluation of a school's postvention program following a suicide or…

  7. Evaluation of Prevention Programs: A Basic Guide for Practitioners.

    ERIC Educational Resources Information Center

    Moberg, D. Paul

    This guide is intended for professionals, laypersons, funding agents and others involved in planning and delivering local prevention services. Chapter 1 defines prevention, and differentiates between prevention strategies and programs targeted toward individuals or to general populations. Program evaluation and evaluation research are defined and…

  8. Critical Measurement Issues in Translational Research

    ERIC Educational Resources Information Center

    Glasgow, Russell E.

    2009-01-01

    This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

  9. Space Storable Rocket Technology program (SSRT). Option 1 program

    NASA Astrophysics Data System (ADS)

    Chazen, Melvin L.; Mueller, Thomas; Rust, Thomas

    1993-08-01

    The Space Storable Rocket Technology (SSRT) Option 1 Program was initiated in October 1991 after completion of the Basic Program. The program was restructured in mid-July 1992 to incorporate a Rhenium Technology Task and reduce the scope of the LO2-N2H4 engine development. The program was also extended to late February 1993 to allow for the Rhenium Technology Task completion. The Option 1 Program was devoted to evaluation of two new injector elements, evaluation of two different methods of thermal protection of the injector, evaluation of high temperature material properties of rhenium and evaluation of methods of joining the rhenium thrust chamber to the columbium injector and nozzle extension. In addition, critical experiments were conducted (Funded by Option 2) to evaluate mechanisms to understand the effects of GO2 injection into the chamber, helium injection into the main LO2, effect of the splash plate and effect of decreasing the aspect ratio of the 120-slot (-13a) element. The performance and thermal models were used to further correlate the test results with analyses. The results of the work accomplished are summarized.

  10. Space Storable Rocket Technology program (SSRT). Option 1 program

    NASA Technical Reports Server (NTRS)

    Chazen, Melvin L.; Mueller, Thomas; Rust, Thomas

    1993-01-01

    The Space Storable Rocket Technology (SSRT) Option 1 Program was initiated in October 1991 after completion of the Basic Program. The program was restructured in mid-July 1992 to incorporate a Rhenium Technology Task and reduce the scope of the LO2-N2H4 engine development. The program was also extended to late February 1993 to allow for the Rhenium Technology Task completion. The Option 1 Program was devoted to evaluation of two new injector elements, evaluation of two different methods of thermal protection of the injector, evaluation of high temperature material properties of rhenium and evaluation of methods of joining the rhenium thrust chamber to the columbium injector and nozzle extension. In addition, critical experiments were conducted (Funded by Option 2) to evaluate mechanisms to understand the effects of GO2 injection into the chamber, helium injection into the main LO2, effect of the splash plate and effect of decreasing the aspect ratio of the 120-slot (-13a) element. The performance and thermal models were used to further correlate the test results with analyses. The results of the work accomplished are summarized.

  11. Evaluating the effectiveness of the Safety Investment Program (SIP) policies for Oregon.

    DOT National Transportation Integrated Search

    2009-10-01

    The Safety Investment Program (SIP) was originally called the Statewide Transportation Improvement Program - : Safety Investment Program (STIP-SIP). The concept of the program was first discussed in October 1997 and the : program was adopted by the O...

  12. Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

    NASA Technical Reports Server (NTRS)

    Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

    1985-01-01

    The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

  13. Basis And Application Of The CARES/LIFE Computer Program

    NASA Technical Reports Server (NTRS)

    Nemeth, Noel N.; Janosik, Lesley A.; Gyekenyesi, John P.; Powers, Lynn M.

    1996-01-01

    Report discusses physical and mathematical basis of Ceramics Analysis and Reliability Evaluation of Structures LIFE prediction (CARES/LIFE) computer program, described in "Program for Evaluation of Reliability of Ceramic Parts" (LEW-16018).

  14. Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic.

    PubMed

    Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B

    2018-03-01

    The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies.

  15. Federal Programs in PUHSS: An Evaluation Report.

    ERIC Educational Resources Information Center

    Phoenix Union High School District, AZ.

    The programs described in this report, including the South Mountain High School Reading Program, the Carl Hayden High School Reading Program, the Phoenix Union High School Reading Program, the South Mountain High School Saturation Guidance and Counseling Program (SGCP), the Work Incentive Program (WIN), the Phoenix Union High School Star Reach…

  16. How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

    PubMed

    Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

    2017-07-01

    In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P < .01). Larger programs were more likely to teach (P = .04) and evaluate (P = .02) community-based research. Experiential learning and classroom-based didactics were the most frequent teaching methodologies. Many programs used multiple teaching methodologies for all competencies. Observation was the most frequent evaluation technique used; portfolio review and written reflection were also commonly reported. Our findings show a strong emphasis on community pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

  17. A pharmacy leadership action study.

    PubMed

    Louie, Clifton; Mertz, Elizabeth; Penfil, Brett; O'Neil, Edward

    2009-01-01

    To report on the creation of a leadership development program targeted exclusively at pharmacists working in management in the professional community. Large staff-model health maintenance organization (HMO) in California between 2004 and 2008. The Pharmacy Leadership Institute (PLI; a joint effort of the School of Pharmacy and the Center for the Health Professions at the University of California, San Francisco) tested a program in a large staff-model HMO with hundreds of pharmacists in leadership roles. This program included learning seminars, psychometric assessments, leadership goals, intersession activities, coaching/mentoring, and leadership projects. Not applicable. PLI collected survey data in order to evaluate the effectiveness of the institute's leadership development program. In addition, an external evaluator was hired to conduct interviews with the pharmacy directors of the organization which chose to pilot the program. The evaluations from the participants indicate that the leadership development program met many but not all of its initial objectives. Consistent with action research methodology, the faculty of the institute met to redesign some sections of the program in order to meet the established goals. Adjustments were made to different components of the program over the next 4 years. Evaluation data show that these revisions were successful. In addition, follow-up evaluations with participants showed a lasting impact of the program on both individual leadership skills and organizational outcomes. Given the positive outcomes indicated by the evaluation data used in this study, the work of PLI indicates that broader leadership skills can be identified and enhanced within a group of pharmacy managers.

  18. Do Early Childhood Programs Have Lasting Effects on Children? Evaluation Science Brief

    ERIC Educational Resources Information Center

    National Forum on Early Childhood Program Evaluation, 2008

    2008-01-01

    "Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "Early Intervention in Low Birthweight Premature Infants: Results at 18 Years of Age for the Infant Health and Development Program (IHDP)" (M.C. McCormick, J.…

  19. The Development and Implementation of a Model for Evaluating Clinical Specialty Education Programs.

    ERIC Educational Resources Information Center

    McLean, James E.; And Others

    A new method for evaluating cancer education programs, using an external/internal evaluation team is outlined. The internal program staff are required to collect the data, arrange for a site visit, provide access to personnel, and make available other information requested by the evaluators. The external team consists of a dentist with oncological…

  20. Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

    ERIC Educational Resources Information Center

    Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

    2013-01-01

    Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

  1. Redesigning and Aligning Assessment and Evaluation for a Federally Funded Math and Science Teacher Educational Program

    ERIC Educational Resources Information Center

    Hardre, Patricia L.; Slater, Janis; Nanny, Mark

    2010-01-01

    This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

  2. School Community Education Program in New York City 1988-89. Volume II. OREA Evaluation Section Report.

    ERIC Educational Resources Information Center

    Guerrero, Frank; Abbott, Lori

    This second volume of a four-volume evaluation of the 1988-89 New York City School Community Education Program (also known as the Umbrella Program) comprises reports evaluating nine innovative elementary school projects on social, ethnical, and environmental studies, four of which included staff development workshops. Evaluation sources included…

  3. Mandarins and Lemons--The Executive Investment in Program Evaluation.

    ERIC Educational Resources Information Center

    MacDonald, Barry

    The author contends that within executive government, which already has all the information it needs to make decisions, program evaluation is seen as a symbolic rather than a substantive enterprise. If it is assumed that program evaluation is an end of policy, not a means, the reasons for government investment in evaluation include: (1) no choice;…

  4. Formative Evaluation of the No-Fee Teacher Education Program from the Students' Standpoint

    ERIC Educational Resources Information Center

    Han, Yumei; Hu, Meizhong; Li, Ling

    2013-01-01

    This exploratory case study applied a formative evaluation framework to evaluate the no-fee teacher education program at Southwest University. The study focused on the students' perspective and their perceptions of the program, both intrinsic and extrinsic. A self-evaluation checklist and a questionnaire were the instruments used to collect data.…

  5. Curriculum and Evaluation Guide for Safety Education Programs. Research and Evaluation Report Series No. 40.00.

    ERIC Educational Resources Information Center

    Lowry, Carlee S.

    Designed to assist Bureau of Indian Affairs school officials in the identification of safety education program needs, this evaluation guide focuses upon the basic operational components in a safety education program. The means for establishing an evaluation design for safety education are presented via a flexible model appropriate for most…

  6. Insourcing, Not Capacity Building, a Better Model for Sustained Program Evaluation

    ERIC Educational Resources Information Center

    Miller, Thomas I.; Kobayashi, Michelle M.; Noble, Paula M.

    2006-01-01

    Community-based organizations (CBOs), typically small and underfunded with transient staff members, are told by funders to care for clients and verify program value. To assist CBOs with evaluations that speak to program effectiveness, many funders wish to expand the evaluation capacity of CBO staff members so that evaluation will occur as long as…

  7. Evaluating Dermatology Residency Program Websites.

    PubMed

    Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

    2016-03-16

    Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms to improve their websites and provide adequate content to attract the top residents for their respective programs.

  8. Evaluating theory-based evaluation: information, norms, and adherence.

    PubMed

    Jacobs, W Jake; Sisco, Melissa; Hill, Dawn; Malter, Frederic; Figueredo, Aurelio José

    2012-08-01

    Programmatic social interventions attempt to produce appropriate social-norm-guided behavior in an open environment. A marriage of applicable psychological theory, appropriate program evaluation theory, and outcome of evaluations of specific social interventions assures the acquisition of cumulative theory and the production of successful social interventions--the marriage permits us to advance knowledge by making use of both success and failures. We briefly review well-established principles within the field of program evaluation, well-established processes involved in changing social norms and social-norm adherence, the outcome of several program evaluations focusing on smoking prevention, pro-environmental behavior, and rape prevention and, using the principle of learning from our failures, examine why these programs often do not perform as expected. Finally, we discuss the promise of learning from our collective experiences to develop a cumulative science of program evaluation and to improve the performance of extant and future interventions. Copyright © 2012. Published by Elsevier Ltd.

  9. Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

    PubMed

    Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

    2013-04-01

    Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

  10. Employee Perceptions of Workplace Health Promotion Programs: Comparison of a Tailored, Semi-Tailored, and Standardized Approach

    PubMed Central

    Street, Tamara D.; Lacey, Sarah J.

    2018-01-01

    In the design of workplace health promotion programs (WHPPs), employee perceptions represent an integral variable which is predicted to translate into rate of user engagement (i.e., participation) and program loyalty. This study evaluated employee perceptions of three workplace health programs promoting nutritional consumption and physical activity. Programs included: (1) an individually tailored consultation with an exercise physiologist and dietitian; (2) a semi-tailored 12-week SMS health message program; and (3) a standardized group workshop delivered by an expert. Participating employees from a transport company completed program evaluation surveys rating the overall program, affect, and utility of: consultations (n = 19); SMS program (n = 234); and workshops (n = 86). Overall, participants’ affect and utility evaluations were positive for all programs, with the greatest satisfaction being reported in the tailored individual consultation and standardized group workshop conditions. Furthermore, mode of delivery and the physical presence of an expert health practitioner was more influential than the degree to which the information was tailored to the individual. Thus, the synergy in ratings between individually tailored consultations and standardized group workshops indicates that low-cost delivery health programs may be as appealing to employees as tailored, and comparatively high-cost, program options. PMID:29710785

  11. Moving forward: using the experience of the CDCs' Colorectal Cancer Screening Demonstration Program to guide future colorectal cancer programming efforts.

    PubMed

    Seeff, Laura C; DeGroff, Amy; Joseph, Djenaba A; Royalty, Janet; Tangka, Florence K L; Nadel, Marion R; Plescia, Marcus

    2013-08-01

    The Centers for Disease Control and Prevention (CDC) established and supported a 4-year Colorectal Cancer Screening Demonstration Program (CRCSDP) from 2005 to 2009 for low-income, under- or uninsured men and women aged 50-64 at 5 sites in the United States. A multiple methods evaluation was conducted including 1) a longitudinal, comparative case study of program implementation, 2) the collection and analysis of client-level screening and diagnostic services outcome data, and 3) the collection and analysis of program- and patient-level cost data. Several themes emerged from the results reported in the series of articles in this Supplement. These included the benefit of building on an existing infrastructure, strengths and weakness of both the 2 most frequently used screening tests (colonoscopy and fecal occult blood tests), variability in costs of maintaining this screening program, and the importance of measuring the quality of screening tests. Population-level evaluation questions could not be answered because of the small size of the participating population and the limited time frame of the evaluation. The comprehensive evaluation of the program determined overall feasibility of this effort. Critical lessons learned through the implementation and evaluation of the CDC's CRCSDP led to the development of a larger population-based program, the CDC's Colorectal Cancer Control Program (CRCCP). © 2013 American Cancer Society.

  12. Evaluacion de que consister y por que se lleva acabo? (Evaluation: What Does it Consist of, and for What Purpose?).

    ERIC Educational Resources Information Center

    Austin Independent School District, TX. Office of Research and Evaluation.

    A guide is presented for the evaluation of the bilingual programs in the Austin, Texas, Independent School District. The reasons for an evaluation and a definition of program objectives and evaluation instruments are given. The program components, objectives and evaluation instruments for each grade level (K-4) are listed. The components involved…

  13. Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

    ERIC Educational Resources Information Center

    Johnson, Kelli; Weiss, Iris R.

    2011-01-01

    In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

  14. 78 FR 66905 - Agency Information Collection Activities; Comment Request; Evaluating the Retired Mentors for...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2013-11-07

    ...; Comment Request; Evaluating the Retired Mentors for Teachers Program AGENCY: Institute of Education... considered public records. Title of Collection: Evaluating the Retired Mentors for Teachers Program. OMB... study of the Retired Mentors for New Teachers program for probationary teachers developed by the Aurora...

  15. Guidance and Counseling Program K-12. Report of Evaluation.

    ERIC Educational Resources Information Center

    Roberts, Joan; Weslander, Darrell L.

    This evaluation of the Des Moines school guidance program provides an introductory history of guidance and counseling services in the district. General results of the evaluation focus on changing counselor roles, and problems caused by lack of specific program guidelines. Counselor profiles and interviews are presented, with an analysis of…

  16. Interpreting Outcomes: Using Focus Groups in Evaluation Research

    ERIC Educational Resources Information Center

    Ansay, Sylvia J.; Perkins, Daniel F.; Nelson, John

    2004-01-01

    Although focus groups continue to gain popularity in marketing and social science research, their use in program evaluation has been limited. Here we demonstrate how focus groups can benefit evaluators, program staff, policy makers and administrators by providing an in-depth understanding of program effectiveness from the perspective of…

  17. Planning Educational Programs: An Evaluation Report for the Occupational Exploration Program.

    ERIC Educational Resources Information Center

    Altschuld, James W.; Pritz, Sandra

    The evaluation report is one of seven produced for the Occupational Exploration Program (OEP), a series of simulated occupational experiences designed for junior high school students. Describing the pilot testing of the simulation dealing with education, the report contains sections describing the simulation context, evaluation procedures,…

  18. E-Basics: Online Basic Training in Program Evaluation

    ERIC Educational Resources Information Center

    Silliman, Ben

    2016-01-01

    E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

  19. Afterschool Alliance Backgrounder: Formal Evaluations of Afterschool Programs.

    ERIC Educational Resources Information Center

    Afterschool Alliance, Washington, DC.

    Noting that various types of evaluations of after-school programming conducted over the last several years have provided useful information to providers and to policymakers, this report summarizes the lessons learned from independent evaluations of after-school programs. The following overall findings are supported with a delineation of findings…

  20. Program Evaluation: Where Instruction and School Business Meet

    ERIC Educational Resources Information Center

    Ayers, Steven V.

    2011-01-01

    In this article, the author talks about program evaluation, a strategy commonly used by instructional leaders that can help school business officials improve their budget process. As districts struggle to develop budgets in these challenging economic times, school business officials might consider turning to program evaluation for help. Program…

  1. Manipulator system man-machine interface evaluation program. [technology assessment

    NASA Technical Reports Server (NTRS)

    Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

    1974-01-01

    Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

  2. Evaluation of a Bullying Prevention Program

    ERIC Educational Resources Information Center

    Hallford, Abby; Borntrager, Cameo; Davis, Joanne L.

    2006-01-01

    In order to address the federal "No Child Left Behind Act", the state of Oklahoma required that all public schools address the problem of bullying. Although numerous anti-bullying programs exist, few have been evaluated to determine their effectiveness. The present study evaluated the effectiveness of one such program,…

  3. Interrupted Time Series Analysis: A Research Technique for Evaluating Social Programs for the Elderly

    ERIC Educational Resources Information Center

    Calsyn, Robert J.; And Others

    1977-01-01

    After arguing that treatment programs for the elderly need to be evaluated with better research designs, the authors illustrate how interrupted time series analysis can be used to evaluate programs for the elderly when random assignment to experimental and control groups is not possible. (Author)

  4. The Logic of Evaluation.

    ERIC Educational Resources Information Center

    Welty, Gordon A.

    The logic of the evaluation of educational and other action programs is discussed from a methodological viewpoint. However, no attempt is made to develop methods of evaluating programs. In Part I, the structure of an educational program is viewed as a system with three components--inputs, transformation of inputs into outputs, and outputs. Part II…

  5. Foreign Language K-12. Program Evaluation 1991-92.

    ERIC Educational Resources Information Center

    Wadden, Jerry M.

    The Des Moines (Iowa) Public Schools foreign language program for K-12 is described and evaluated. The evaluation report focuses on six areas, including: (1) school district mission and philosophy of foreign language instruction; (2) context (state policies and standards, foreign language program overview and enrollment, fiber-optic communication…

  6. 10 CFR 26.419 - Suitability and fitness evaluations.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... 10 Energy 1 2014-01-01 2014-01-01 false Suitability and fitness evaluations. 26.419 Section 26.419 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS FFD Program for Construction § 26.419 Suitability and fitness evaluations. Licensees and other entities who implement FFD programs under this...

  7. 10 CFR 26.419 - Suitability and fitness evaluations.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... 10 Energy 1 2013-01-01 2013-01-01 false Suitability and fitness evaluations. 26.419 Section 26.419 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS FFD Program for Construction § 26.419 Suitability and fitness evaluations. Licensees and other entities who implement FFD programs under this...

  8. 10 CFR 26.419 - Suitability and fitness evaluations.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... 10 Energy 1 2012-01-01 2012-01-01 false Suitability and fitness evaluations. 26.419 Section 26.419 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS FFD Program for Construction § 26.419 Suitability and fitness evaluations. Licensees and other entities who implement FFD programs under this...

  9. Evaluating Injury Prevention Programs: The Oklahoma City Smoke Alarm Project.

    ERIC Educational Resources Information Center

    Mallonee, Sue

    2000-01-01

    Illustrates how evaluating the Oklahoma City Smoke Alarm Project increased its success in reducing residential fire-related injuries and deaths. The program distributed and tested smoke alarms in residential dwellings and offered educational materials on fire prevention and safety. Evaluation provided sound data on program processes and outcomes,…

  10. 10 CFR 26.419 - Suitability and fitness evaluations.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 10 Energy 1 2011-01-01 2011-01-01 false Suitability and fitness evaluations. 26.419 Section 26.419 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS FFD Program for Construction § 26.419 Suitability and fitness evaluations. Licensees and other entities who implement FFD programs under this...

  11. 10 CFR 26.419 - Suitability and fitness evaluations.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 10 Energy 1 2010-01-01 2010-01-01 false Suitability and fitness evaluations. 26.419 Section 26.419 Energy NUCLEAR REGULATORY COMMISSION FITNESS FOR DUTY PROGRAMS FFD Program for Construction § 26.419 Suitability and fitness evaluations. Licensees and other entities who implement FFD programs under this...

  12. Student Assistance Program in Pennsylvania. Evaluation Final Report.

    ERIC Educational Resources Information Center

    Fertman, Carl I.; Schlesinger, Jo; Fichter, Cele; Tarasevich, Susan; Zhang, Xiaoyan; Wald, Holly

    This report contains the second year evaluation of the Student Assistance Program (SAP) in Pennsylvania. These school-based and school-linked programs address barriers to learning for youth at risk for social and emotional problems, drug and alcohol use and abuse, and depression. Second year evaluation focused on identifying essential components…

  13. Evaluating Teacher Preparation Using Graduates' Observational Ratings

    ERIC Educational Resources Information Center

    Ronfeldt, Matthew; Campbell, Shanyce L.

    2016-01-01

    Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

  14. Cost Analysis for Educational Program Evaluation.

    ERIC Educational Resources Information Center

    Haller, Emil J.

    Concerned with the problem of determining program costs as part of the evaluation process, this article helps the practitioner arrive at useful conceptions of the term "cost" and procedures for assessing the costs of an educational program. Its purpose is to help design costing procedures for evaluation situations that are commonly encountered. An…

  15. 77 FR 30045 - 30-Day Notice of Proposed Information Collection: English Language Evaluation Surveys

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-05-21

    ...] 30-Day Notice of Proposed Information Collection: English Language Evaluation Surveys ACTION: Notice... clearance will allow ECA/P/V, as part of the English Language Evaluation, to conduct surveys of participants in the ETA Program, E-Teacher Scholarship program, and the English Language Specialist Program...

  16. Prevalence of Evaluation Method Courses in Education Leader Doctoral Preparation

    ERIC Educational Resources Information Center

    Shepperson, Tara L.

    2013-01-01

    This exploratory study investigated the prevalence of single evaluation methods courses in doctoral education leadership programs. Analysis of websites of 132 leading U.S. university programs found 62 evaluation methods courses in 54 programs. Content analysis of 49 course catalog descriptions resulted in five categories: survey, planning and…

  17. Evaluating Extension Based Leadership Development Programs in the Southern United States

    ERIC Educational Resources Information Center

    Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

    2016-01-01

    The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

  18. A Model for Evaluating Development Programs. Miscellaneous Report.

    ERIC Educational Resources Information Center

    Burton, John E., Jr.; Rogers, David L.

    Taking the position that the Classical Experimental Evaluation (CEE) Model does not do justice to the process of acquiring information necessary for decision making re planning, programming, implementing, and recycling program activities, this paper presents the Inductive, System-Process (ISP) evaluation model as an alternative to be used in…

  19. Theory-Based Stakeholder Evaluation

    ERIC Educational Resources Information Center

    Hansen, Morten Balle; Vedung, Evert

    2010-01-01

    This article introduces a new approach to program theory evaluation called theory-based stakeholder evaluation or the TSE model for short. Most theory-based approaches are program theory driven and some are stakeholder oriented as well. Practically, all of the latter fuse the program perceptions of the various stakeholder groups into one unitary…

  20. Student Services Program Planning and Evaluation: Responsibility, Procedures, Instrument, and Guidelines.

    ERIC Educational Resources Information Center

    Repp, Charles A.; Brach, Ronald C.

    The manual provides a rationale, procedural guidelines, time-schedules, instruments, and supporting documentation for student services program evaluation at SUNY Agricultural and Technical College, Delhi. Six procedural guidelines include: (1) all programs and services should be evaluated at least once every four years, with provision for annual…

Some links on this page may take you to non-federal websites. Their policies may differ from this site.
Top