Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

78 FR 42795 - Submission for OMB review; 30-Day Comment Request: Evaluation of the Brain Disorders in the...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-17

...; 30-Day Comment Request: Evaluation of the Brain Disorders in the Developing World Program of the John... Collection: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty... outcomes of the Brain Disorders in the Developing World extramural research program administered by the...

The Evaluation Handbook: Guidelines for Evaluating Dropout Prevention Programs.

ERIC Educational Resources Information Center

Smink, Jay; Stank, Peg

This manual, developed in an effort to take the mysticism out of program evaluation, discusses six phases of the program evaluation process. The introduction discusses reasons for evaluation, process and outcome evaluation, the purpose of the handbook, the evaluation process, and the Sequoia United School District Dropout Prevention Program. Phase…

Developing Your Evaluation Plans: A Critical Component of Public Health Program Infrastructure.

PubMed

Lavinghouze, S Rene; Snyder, Kimberly

A program's infrastructure is often cited as critical to public health success. The Component Model of Infrastructure (CMI) identifies evaluation as essential under the core component of engaged data. An evaluation plan is a written document that describes how to monitor and evaluate a program, as well as how to use evaluation results for program improvement and decision making. The evaluation plan clarifies how to describe what the program did, how it worked, and why outcomes matter. We use the Centers for Disease Control and Prevention's (CDC) "Framework for Program Evaluation in Public Health" as a guide for developing an evaluation plan. Just as using a roadmap facilitates progress on a long journey, a well-written evaluation plan can clarify the direction your evaluation takes and facilitate achievement of the evaluation's objectives.

Alternative Education: Evaluation and Implementation of EBCE.

ERIC Educational Resources Information Center

Shively, Joe E.; Sanders, Jack

Increasing student disenchantment with traditional schooling prompted the development of an alternative educational program: Experience-Based Career Education (EBCE). During three years of development, evaluation provided student, parent, and employer data on program impact and effectiveness. Stakeholders' involvement in program development and…

Evaluation of Career Development Programs from an Action Perspective.

ERIC Educational Resources Information Center

Young, Richard A.; Valach, Ladislav

1994-01-01

Presents action-theoretical approach to evaluation of career development programs based on constructionist epistemology. Propositions from action-theoretical perspective center around career and action as related, interpretative constructs. Propositions give rise to implications for evaluation of career programs that address ongoing nature of…

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

PubMed

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

PubMed Central

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Using Faculty-Developed Exit Examinations to Evaluate Academic Programs.

ERIC Educational Resources Information Center

Banta, Trudy W.; Schneider, Janet A.

1988-01-01

Four dozen departments at the University of Tennessee, Knoxville, are using faculty-developed exit examinations for majors as one component of a comprehensive program evaluation process. The experience of 11 program faculties in developing and using such examinations are summarized. (Author/MLW)

Design, development, and evaluation of truck and bus driver wellness programs

DOT National Transportation Integrated Search

2000-06-01

In May 1997, the Federal Motor Carrier Safety Administration (FMCSA) began a research project to design, develop, and evaluate a model truck and bus driver wellness program. This wellness program was developed to provide a resource for addressing tru...

A Culturally Responsive Evaluation Approach Applied to the Talent Development School-to-Career Intervention Program

ERIC Educational Resources Information Center

Manswell-Butty, Jo-Anne L.; Reid, Malva Daniel; LaPoint, Velma

2004-01-01

Program evaluation has long been used to reveal program characteristics, merits, and challenges. While providing information about program effectiveness, evaluations can also ensure understanding of program outcomes, efficiency, and quality. Furthermore, evaluations can analyze and examine a program's political and social environment as well as…

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Evaluating Extension Based Leadership Development Programs in the Southern United States

ERIC Educational Resources Information Center

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

Report of the Evaluation of the Race/Human Relations Program. Student and Staff Program and Long Range Goals. Baseline Year 1982-83. Evaluation Services Department Report No. 348.

ERIC Educational Resources Information Center

Tomblin, Elizabeth A.; And Others

In response to a 1982 Superior Court order, a centrally developed, sequential program for improving race/human relations in the San Diego City Schools was developed and field tested or implemented during the 1982-83 school year. This systematic evaluation reports on the student program, "Conflict"; the staff program; and baseline data…

Do less effective teachers choose professional development does it matter?

PubMed

Barrett, Nathan; Butler, J S; Toma, Eugenia F

2012-10-01

In an ongoing effort to improve teacher quality, most states require continuing education or professional development for their in-service teachers. Studies evaluating the effectiveness of various professional development programs have assumed a normal distribution of quality of teachers participating in the programs. Because participation in many professional development programs is either targeted or voluntary, this article suggests past evaluations of the effectiveness of professional development may be subject to selection bias and policy recommendations may be premature. This article presents an empirical framework for evaluating professional development programs where treatment is potentially nonrandom, and explicitly accounts for the teacher's prior effectiveness in the classroom as a factor that may influence participation in professional development. This article controls for the influence of selection bias on professional development outcomes by generating a matched sample based on propensity scores and then estimating the program's effect. In applying this framework to the professional development program examined in this article, less effective teachers are found to be more likely to participate in the program, and correcting for this selection leads to different conclusions regarding the program's effectiveness than when ignoring teacher selection patterns.

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

PubMed

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing education are needed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Educational Evaluation: Key Characteristics. ACER Research Series No. 102.

ERIC Educational Resources Information Center

Maling-Keepes, Jillian

A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…

Comparative Evaluation of Financing Programs: Insights From California’s Experience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deason, Jeff

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less

5 CFR 362.405 - Development, evaluation, promotion, and certification.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 5 Administrative Personnel 1 2013-01-01 2013-01-01 false Development, evaluation, promotion, and certification. 362.405 Section 362.405 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS PATHWAYS PROGRAMS Presidential Management Fellows Program § 362.405 Development, evaluation...

5 CFR 362.405 - Development, evaluation, promotion, and certification.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 5 Administrative Personnel 1 2014-01-01 2014-01-01 false Development, evaluation, promotion, and certification. 362.405 Section 362.405 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS PATHWAYS PROGRAMS Presidential Management Fellows Program § 362.405 Development, evaluation...

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

Conflict of Interest in the Evaluation and Dissemination of “Model” School-based Drug and Violence Prevention Programs

PubMed Central

Gorman, Dennis M.; Conde, Eugenia

2010-01-01

Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been that of financial relationships between investigators and research sponsors. The potential for conflicts of interest to arise in the evaluation of drug prevention programs was raised by Moskowitz in this journal in 1993, but to date there has been no attempt made to estimate the scope of this problem. The present study addressed this issue using a sample of “model” school-based drug and violence prevention interventions by first, identifying the types or relationships that exist between program developers and program distributors, and, second, by assessing how many of the evaluations of these programs published in peer-reviewed journals had been conducted by the developers of the programs compared to independent evaluation teams. The data presented indicate that there are relatively few published evaluations that do not involve program developers and that there are few instances in which there is complete separation between the program developer and program distributor. Using the open systems model of the Institute of Medicine Committee on Research Integrity as a framework, it is argued that the culture and norms of the program developer and those of the program evaluator are fundamentally distinct and therefore failure to separate these roles produces high potential for conflict of interest to arise. PMID:17945143

Evaluation of National Institute for Learning Development and Discovery Educational Therapy Program

ERIC Educational Resources Information Center

Frimpong, Prince Christopher

2014-01-01

In Maryland, some Christian schools have enrolled students with learning disabilities (LDs) but do not have any interventional programs at the school to help them succeed academically. The purpose of this qualitative program evaluation was to evaluate the National Institute for Learning Development (NILD) and Discovery Therapy Educational Program…

Development, implementation, and evaluation of a multi-addiction prevention program for primary school students in Hong Kong: the B.E.S.T. Teen Program.

PubMed

Shek, Daniel T L; Yu, Lu; Leung, Hildie; Wu, Florence K Y; Law, Moon Y M

Based on the evaluation findings of the B.E.S.T. Teen Program which aimed at promoting behavioral, emotional, social, and thinking competencies in primary school students, it is argued in this paper that promotion of psychosocial competence to prevent addiction in primary school students is a promising strategy. A total of 382 Primary 5 (Grade 5) and 297 Primary 6 (Grade 6) students from five primary schools in Hong Kong participated in the program. Different evaluation strategies were adopted to evaluate the program. First, objective outcome evaluation adopting a non-equivalent group pretest-posttest experimental-control group design was conducted to examine change in the students. Second, to gauge students' perceptions of the program, subjective outcome evaluation was conducted. The evaluation findings basically converged to tentatively suggest that young adolescents benefited from participating in the program. Implications on the development, implementation, and evaluation of addiction prevention programs for teenagers are discussed.

Local Government Leadership Education: Measuring the Impact of Leadership Skill Development on Public Officials

ERIC Educational Resources Information Center

Davis, Gregory A.; Lucente, Joe

2012-01-01

Many Extension leadership development programs have been evaluated for effectiveness. Little literature exists focusing on the evaluation of leadership development programs involving elected and appointed local officials. This article describes an annual program involving elected and appointed local officials and shares quantitative and…

Academic Library Development Program: A Self Study.

ERIC Educational Resources Information Center

Carnegie-Mellon Univ., Pittsburgh, PA. University Libraries.

Results of a 4-month library self-evaluation program conducted by staff members at Carnegie-Mellon University Libraries are reported in this document. The study was conducted using the Academic Library Development Program (ALDP), a self-improvement strategy for libraries to evaluate and develop their performance. The study team consisting of four…

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

PubMed

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

First Year Evaluation of the Mathematics Pilot Programs, Grades K-8, [and] Appendices. Evaluation Department Report No. 381.

ERIC Educational Resources Information Center

Tomblin, Elizabeth A.; And Others

The San Diego Board of Education requested that pilot programs be conducted with commercially developed (Grades K-8) mathematics textbooks and programs in order to determine which of the programs/texts were superior, and whether a district-developed program could successfully compete with commercially produced materials. The pilot program…

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child who has been... 34 Education 2 2010-07-01 2010-07-01 false Procedures for IFSP development, review, and evaluation... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Program and Service Components of a Statewide System of...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2011 CFR

2011-07-01

... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child who has been... 34 Education 2 2011-07-01 2010-07-01 true Procedures for IFSP development, review, and evaluation... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Program and Service Components of a Statewide System of...

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

General Criteria for Evaluating Social Programs.

ERIC Educational Resources Information Center

Shipman, Stephanie

1989-01-01

A framework of general evaluation criteria for ensuring the comprehensiveness of program reviews and appropriate and fair comparison of children's programs is outlined. It has two components: (1) descriptive; and (2) evaluative. The framework was developed by researchers at the General Accounting Office for evaluation of federal programs. (TJH)

Program Evaluation Interest and Skills of School Counselors

ERIC Educational Resources Information Center

Astramovich, Randall L.

2017-01-01

School counselors participated in a study examining their program evaluation interest and skills. Findings suggest that school counselors understand the importance of program evaluation, yet they may lack the skills and confidence to successfully engage in program evaluation activities. Professional development training may be an important method…

78 FR 19723 - Proposed Collection; 60-Day Comment Request; Evaluation of the Brain Disorders in the Developing...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-02

... Comment Request; Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty...: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty International Center... Information Collection: This study seeks to evaluate the management, effectiveness, and outcomes of the Brain...

Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

PubMed Central

Pound, Catherine M.; Moreau, Katherine A.; Ward, Natalie; Eady, Kaylee; Writer, Hilary

2015-01-01

Background Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE) program. Methods We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes. PMID:26059213

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

The Role of Evaluation and Plans for Evaluating the Current Testing Program.

ERIC Educational Resources Information Center

Winters, Lynn

The Palos Verdes Peninsula Unified School District Office of Program Evaluation and Research is responsible for providing information for program development and improvement; providing test information to special programs coordinators; and acting as a clearinghouse for all information concerning tests, evaluation methodology, and educational…

Tools for Formative Evaluation: Gathering the Information Necessary for Program Improvement

ERIC Educational Resources Information Center

Jayaratne, K. S. U.

2016-01-01

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Guidelines for Development and Evaluation of Young Farmer and Adult Programs in Agriculture/Agribusiness

ERIC Educational Resources Information Center

Bundy, Clarence E.

1974-01-01

Guidelines developed at a national seminar establish goals and action steps for developing, expanding, and/or evaluating agriculture/agribusiness programs. America's role as a major food and fiber source for the world demands educated farmers. The guidelines apply to all levels of the agriculture education program. (AG)

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

Development and Evaluation of Innovative Peer-Led Physical Activity Programs for Mental Health Service Users

PubMed Central

Graham, Candida R.; Larstone, Roseann; Griffiths, Brenda; de Leeuw, Sarah; Anderson, Lesley; Powell-Hellyer, Stephanie; Long, Nansi

2017-01-01

Abstract Mental health service users (MHSUs) have elevated rates of cardiometabolic disturbance. Improvements occur with physical activity (PA) programs. We report the development and evaluation of three innovative peer-developed and peer-led PA programs: 1) walking; 2) fitness; and 3) yoga. Qualitative evaluation with 33 MHSUs in British Columbia, Canada, occurred. These programs yielded improvements for participants, highlighted by powerful narratives of health improvement, and improved social connections. The feasibility and acceptability of innovative peer-developed and peer-led programs were shown. Analyses revealed concepts related to engagement and change. Relating core categories, we theorize effective engagement of MHSUs requires accessibility on three levels (geographic, cost, and program flexibility) and health behavior change occurs within co-constituent relationships (to self, to peers, and to the wider community). This study highlights the benefits of peer involvement in developing and implementing PA programs and provides a theoretical framework of understanding engagement and behavior change in health programs for MHSUs. PMID:28953007

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

ERIC Educational Resources Information Center

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY 1995

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program was established more than nine years ago to encourage the development and implementation of innovative treatment technologies for hazardous waste site remediation. Development of this program was in direct response to ...

Learning From Small-Scale Experimental Evaluations of After School Programs. Snapshot Number 8

ERIC Educational Resources Information Center

Harvard Family Research Project, Harvard University, 2006

2006-01-01

The Harvard Family Research Project (HFRP) Out-of-School Time Program Evaluation Database contains profiles of out-of-school time (OST) program evaluations. Its purpose is to provide accessible information about previous and current evaluations to support the development of high quality evaluations and programs in the OST field. Types of Programs…

"I've Lost My Husband, My House and I Need a New Knee...Why Should I Smile?": Action Research Evaluation of a Group Cognitive Behavioural Therapy Program for Older Adults with Depression

ERIC Educational Resources Information Center

Richardson, Lisa; Reid, Corinne

2006-01-01

The current paper details an action research approach to developing and evaluating a group cognitive-behavioural therapy (CBT) program for older adults (65+ years) experiencing depression. This approach allowed the development of a novel program and for each component of the program to be evaluated and modified in an iterative, developmental…

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

A participatory evaluation model for Healthier Communities: developing indicators for New Mexico.

PubMed Central

Wallerstein, N

2000-01-01

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline findings. The evaluation model shows the links between process, community-level system impacts, and population health changes. PMID:10968754

A Bereavement Support Program for Survivors of Cancer Deaths: A Description and Evaluation.

ERIC Educational Resources Information Center

Souter, Susan J.; Moore, Timothy E.

1990-01-01

Describes bereavement support program for survivors of cancer deaths developed by Riverdale Hospital in Toronto, Ontario. Presents detailed program evaluation which asked bereaved survivors who were program participants for one year to evaluate program aspects and facilitation of their grief by volunteers. Recommendations for expansion and…

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

PubMed

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

ERIC Educational Resources Information Center

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Moving the Needle on Program Quality: An Examination of the Organizational Characteristics That Drive Improvement in Expanded Learning Programs

ERIC Educational Resources Information Center

McCormick, Silvana

2017-01-01

Program evaluation can play a critical role in supporting high quality implementation of social programs to help them achieve their goal of social impact. Evaluation scholars have developed a wide range of strategies to help build programs' internal evaluation capacity in an effort to support meaningful use of evaluation. However, the evaluation…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Outcome Evaluation: Student Development Program, Special Studies Division, Cleveland State University.

ERIC Educational Resources Information Center

Pasch, Marvin

Techniques and procedures used to evaluate the outcomes of the student development program, and to use the evaluation results, are presented. Specific evaluation questions are posed that address overall outcomes, not individual student outcomes, and quantitative measures are suggested to accompany the questions. The measures include statistical…

Defining, illustrating and reflecting on logic analysis with an example from a professional development program.

PubMed

Tremblay, Marie-Claude; Brousselle, Astrid; Richard, Lucie; Beaudet, Nicole

2013-10-01

Program designers and evaluators should make a point of testing the validity of a program's intervention theory before investing either in implementation or in any type of evaluation. In this context, logic analysis can be a particularly useful option, since it can be used to test the plausibility of a program's intervention theory using scientific knowledge. Professional development in public health is one field among several that would truly benefit from logic analysis, as it appears to be generally lacking in theorization and evaluation. This article presents the application of this analysis method to an innovative public health professional development program, the Health Promotion Laboratory. More specifically, this paper aims to (1) define the logic analysis approach and differentiate it from similar evaluative methods; (2) illustrate the application of this method by a concrete example (logic analysis of a professional development program); and (3) reflect on the requirements of each phase of logic analysis, as well as on the advantages and disadvantages of such an evaluation method. Using logic analysis to evaluate the Health Promotion Laboratory showed that, generally speaking, the program's intervention theory appeared to have been well designed. By testing and critically discussing logic analysis, this article also contributes to further improving and clarifying the method. Copyright © 2013 Elsevier Ltd. All rights reserved.

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

ERIC Educational Resources Information Center

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Development and Evaluation of a Parent-Engagement Curriculum to Connect Latino Families and Schools

ERIC Educational Resources Information Center

Hurtado, Ghaffar A.; Olson, Kathleen A.; de Davila, Silvia Alvarez; Campoverde, Victoria

2018-01-01

Parent-school engagement is a contributor to student achievement, but few relevant programs exist for immigrant Latino families. This article describes the design, pilot implementation, and evaluation of a parent-engagement Extension program, developed and implemented in Spanish. The purpose of the program is to help parents develop and/or…

Evaluation of a District-wide Inservice Professional Development Program for Teaching Science: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

1999-01-01

Nationwide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. Discusses a formative evaluation of the implementation of the Collier Chautauqua Program (CCP) which focuses on teacher enhancement resulting from participation in…

Evaluation of a District-Wide Inservice Professional Development Program for Science Teachers: Challenges Faced and Lessons Learned.

ERIC Educational Resources Information Center

Dass, Pradeep Maxwell

Nation-wide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. The Collier Chautauqua Program (CCP) implemented the Iowa Chautauqua model at the district level in Collier County, Florida. A formative evaluation of the…

Evaluation of the Professional Development Program on Web Based Content Development

ERIC Educational Resources Information Center

Yurdakul, Bünyamin; Uslu, Öner; Çakar, Esra; Yildiz, Derya G.

2014-01-01

The aim of this study is to evaluate the professional development program on web based content development (WBCD) designed by the Ministry of National Education (MoNE). Based on the theoretical CIPP model by Stufflebeam and Guskey's levels of evaluation, the study was carried out as a case study. The study group consisted of the courses that…

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

NASA Technical Reports Server (NTRS)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Testing of a Program Evaluation Model: Final Report.

ERIC Educational Resources Information Center

Nagler, Phyllis J.; Marson, Arthur A.

A program evaluation model developed by Moraine Park Technical Institute (MPTI) is described in this report. Following background material, the four main evaluation criteria employed in the model are identified as program quality, program relevance to community needs, program impact on MPTI, and the transition and growth of MPTI graduates in the…

Strategies for Evaluating a Freshman Studies Program.

ERIC Educational Resources Information Center

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

1999 commuter assistance program evaluation manual

DOT National Transportation Integrated Search

2001-01-01

This manual was developed to assist Florida's Commuter Assistance Programs (CAP) to measure and evaluate their performance. It provides information necessary for a CAP to create and implement its own evaluation program. It discusses performance measu...

Using health promotion guidelines for persons with disabilities to develop and evaluate a physical activity program for individuals with multiple sclerosis: A feasibility study.

PubMed

Dixon-Ibarra, Alicia; Nery-Hurwit, Mara; Driver, Simon; MacDonald, Megan

2017-04-01

The Health Education for Persons with Multiple Sclerosis (HEMS) program was developed in response to the need for interventions aimed at increasing physical activity for individuals with Multiple Sclerosis (MS). It was developed and evaluated using Drum and colleagues (2009) guidelines for implementing health promotion programs for individuals with disabilities. The purpose of this feasibility study is to describe the development, implementation, and evaluation of the HEMS program. Thirteen individuals with MS completed the 8-week health education program. A mixed method approach for evaluation was implemented (i.e., survey and focus groups). Process and resource feasibility demonstrated that over half of the participants attended at least 80% of the weekly sessions. Focus group data provided valuable feedback for future iterations of the program including critiques on the delivery, content, and group support provided. Outcome evaluation showed increases in self-efficacy (survey), improvements in theoretical constructs (focus groups), and increased physical activity (focus groups). Results show that health promotion programs for persons with MS can improve physical activity and related constructs. Next steps will be to revise, implement, and reevaluate the HEMS program in a larger randomized control trial. Published by Elsevier Ltd.

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Examples of Sports-Based Youth Development Programs

ERIC Educational Resources Information Center

Berlin, Richard A.; Dworkin, Aaron; Eames, Ned; Menconi, Arn; Perkins, Daniel F.

2007-01-01

The authors provide examples of sports-based youth development programs and offer information about program mission and vision, program design and content, evaluation results, and program sustainability. The four sports-based youth development programs presented are Harlem RBI, Tenacity, Snowsports Outreach Society, and Hoops & Leaders…

Administration 101: Evaluation of a Professional Development Program.

ERIC Educational Resources Information Center

Chiriboga, Cristina

2003-01-01

Evaluates a community college leadership development program provided by the Association of California Community College Administrators (ACCCA). A total of 129 participants answered questionnaires regarding the effectiveness of the program. Responses were then coded and analyzed in terms of apparent patterns or themes. Outlines some benefits of…

Development and Evaluation of a Peer Mentorship Program for Aboriginal University Students

ERIC Educational Resources Information Center

Rawana, Jennine S.; Sieukaran, Daniella D.; Nguyen, Hien T.; Pitawanakwat, Randy

2015-01-01

Although Aboriginal students encounter educational challenges, few post-secondary mentorship programs that facilitate positive educational and mental health outcomes within this population are described in the literature. This study describes the development and evaluation of a mentorship program for Aboriginal university students. Program…

A Research Program on the Potential for Effects of Engineered Nanomaterials on Biological Systems

EPA Science Inventory

The US Environmental Protection Agency (EPA), Office of Research and Development, has developed a research program to evaluate the potential implications of engineered nanomaterials for human health and the environment. Among the major themes of the program are evaluating the in...

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

Program management model study

NASA Technical Reports Server (NTRS)

Connelly, J. J.; Russell, J. E.; Seline, J. R.; Sumner, N. R., Jr.

1972-01-01

Two models, a system performance model and a program assessment model, have been developed to assist NASA management in the evaluation of development alternatives for the Earth Observations Program. Two computer models were developed and demonstrated on the Goddard Space Flight Center Computer Facility. Procedures have been outlined to guide the user of the models through specific evaluation processes, and the preparation of inputs describing earth observation needs and earth observation technology. These models are intended to assist NASA in increasing the effectiveness of the overall Earth Observation Program by providing a broader view of system and program development alternatives.

Evaluation Report of the Fall River Middle School Research and Development Center Title VII Program, 1973-1974.

ERIC Educational Resources Information Center

Heuristics, Inc., Dedham, MA.

This report presents the evaluation of the 1973-1974 Fall River Middle School Research and Development Center, a project funded by ESEA Title VII as a model demonstration bilingual program beginning in 1972-1973. The evaluation focused on the assessment of the degree of accomplishment of product objectives for each component of the program. The…

Integrating Data Mining in Program Evaluation of K-12 Online Education

ERIC Educational Resources Information Center

Hung, Jui-Long; Hsu, Yu-Chang; Rice, Kerry

2012-01-01

This study investigated an innovative approach of program evaluation through analyses of student learning logs, demographic data, and end-of-course evaluation surveys in an online K-12 supplemental program. The results support the development of a program evaluation model for decision making on teaching and learning at the K-12 level. A case study…

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

An Approach to Evaluation of Rural Development Act Title V Programs. Northeast Regional Center for Rural Development Publication 11, February 1976.

ERIC Educational Resources Information Center

Miller, Robert W.

Presenting suggestions for conceptualizing Rural Development Act Title V program evaluations, this paper focuses upon a five-level program outcomes model which encompasses a causal sequence of anticipated shortrun, intermediate, and longrun outcomes. Examples of possible Title V measurement foci are presented for each of five outcome levels as…

Tai Chi: moving for better balance -- development of a community-based falls prevention program.

PubMed

Li, Fuzhong; Harmer, Peter; Mack, Karin A; Sleet, David; Fisher, K John; Kohn, Melvin A; Millet, Lisa M; Xu, Junheng; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-05-01

This study was designed to develop an evidence- and community based falls prevention program -- Tai Chi: Moving for Better Balance. A mixed qualitative and quantitative approach was used to develop a package of materials for program implementation and evaluation. The developmental work was conducted in 2 communities in the Pacific Northwest. Participants included a panel of experts, senior service program managers or activity coordinators, and older adults. Outcome measures involved program feasibility and satisfaction. Through an iterative process, a program package was developed. The package contained an implementation plan and class training materials (ie, instructor's manual, videotape, and user's guidebook). Pilot testing of program materials showed that the content was appropriate for the targeted users (community-living older adults) and providers (local senior service organizations). A feasibility survey indicated interest and support from users and providers for program implementation. A 2-week pilot evaluation showed that the program implementation was feasible and evidenced good class attendance, high participant satisfaction, and interest in continuing Tai Chi. The package of materials developed in this study provides a solid foundation for larger scale implementation and evaluation of the program in community settings.

Tailoring an educational program on the AHRQ Patient Safety Indicators to meet stakeholder needs: lessons learned in the VA.

PubMed

Shin, Marlena H; Rivard, Peter E; Shwartz, Michael; Borzecki, Ann; Yaksic, Enzo; Stolzmann, Kelly; Zubkoff, Lisa; Rosen, Amy K

2018-02-14

Given that patient safety measures are increasingly used for public reporting and pay-for performance, it is important for stakeholders to understand how to use these measures for improvement. The Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicators (PSIs) are one particularly visible set of measures that are now used primarily for public reporting and pay-for-performance among both private sector and Veterans Health Administration (VA) hospitals. This trend generates a strong need for stakeholders to understand how to interpret and use the PSIs for quality improvement (QI). The goal of this study was to develop an educational program and tailor it to stakeholders' needs. In this paper, we share what we learned from this program development process. Our study population included key VA stakeholders involved in reviewing performance reports and prioritizing and initiating quality/safety initiatives. A pre-program formative evaluation through telephone interviews and web-based surveys assessed stakeholders' educational needs/interests. Findings from the formative evaluation led to development and implementation of a cyberseminar-based program, which we tailored to stakeholders' needs/interests. A post-program survey evaluated program participants' perceptions about the PSI educational program. Interview data confirmed that the concepts we had developed for the interviews could be used for the survey. Survey results informed us on what program delivery mode and content topics were of high interest. Six cyberseminars were developed-three of which focused on two content areas that were noted of greatest interest: learning how to use PSIs for monitoring trends and understanding how to interpret PSIs. We also used snapshots of VA PSI reports so that participants could directly apply learnings. Although initial interest in the program was high, actual attendance was low. However, post-program survey results indicated that perceptions about the program were positive. Conducting a formative evaluation was a highly important process in program development. The useful information that we collected through the interviews and surveys allowed us to tailor the program to stakeholders' needs and interests. Our experiences, particularly with the formative evaluation process, yielded valuable lessons that can guide others when developing and implementing similar educational programs.

Evaluation development for a physical activity positive youth development program for girls.

PubMed

Ullrich-French, Sarah; Cole, Amy N; Montgomery, Anna K

2016-04-01

Girls on the Run (GOTR) is an after school program for girls in third through fifth grade which utilizes a physical activity based positive youth development curriculum that culminates with completing a 5K run. Unfortunately, there is little empirical data documenting GOTR participant changes that align with the curriculum and describe the evaluation process. Therefore, this study presents an evaluation of GOTR consisting of three main processes: curriculum content analysis and stakeholder focus groups (N=11) to identify key outcomes of the program; community-based participatory research to collaborate with program personnel to further identify important outcomes; and the design and pilot testing of an instrument (N=104) for assessing changes in the theoretically grounded outcomes over time. Findings demonstrated a positive collaborative process that led to important information to be used for an impact evaluation of Girls on the Run and for future evaluation development efforts for physical activity based positive youth development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and evaluation of a learner-centered educational summer camp program on soft skills for baccalaureate nursing students.

PubMed

Lau, Ying; Wang, Wenru

2014-01-01

The objectives were to develop a learner-centered educational camp program for nursing students and to evaluate 4 areas of soft skills, communication ability, clinical interaction, interpersonal relationships, and social problem solving, before and after the program. The results showed that the summer camp program was effective in improving nursing students' soft skills.

Development and Evaluation of the Efficiency of In-Service Training Program with the Theme of Peace Education

ERIC Educational Resources Information Center

Basaran, Semra Demir; Karakurt, Sevgi Özden

2017-01-01

In this article, an in-service training program was developed and evaluated to improve the peace education competencies of primary school teachers. This program, named as In-Service Training Program with the Theme of Peace Education for Primary Teachers (BEHEP), was based on the system approach. The implementation was completed in 28 hours with…

Indicators of Program Quality, Measures of Performance & Standards. Adult Basic Education and ESL Programs in NJ. Summary Report.

ERIC Educational Resources Information Center

Merkel-Keller, Claudia; Streeter-Scrupski, Sandra

In 1992, adult education staff and adult literacy volunteer organizations developed 8 indicators of program quality to be used for evaluating adult basic education and English as a Second Language (ESL) programs in New Jersey. Performance standards were developed to match the standards. An evaluation was conducted to determine how the indicators…

Situated Research Design and Methodological Choices in Formative Program Evaluation

ERIC Educational Resources Information Center

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Career Development in Language Education Programs

ERIC Educational Resources Information Center

Shawer, Saad Fathy; Alkahtani, Saad Ali

2013-01-01

This study assesses the influence of a two-year language program evaluation on program directors and faculty career development. The study makes use of mixed-paradigms (positivism and qualitative interpretive), mixed-strategies (survey research and qualitative evaluation), one-way analysis of variance (ANOVA) and a post-hoc test of multiple…

CAI Programs and Macros for Formative Curriculum Evaluation.

ERIC Educational Resources Information Center

Dasenbrock, David; Teates, Thomas

This technical memo is designed for persons who are interested in research with and development of curriculum material. Detailed information regarding computer programs, and program documentation used in the development and evaluation of ISCS curriculum materials is provided. The memo includes supplemental information to ISCS Technical Report I…

Evaluating a Development Program.

ERIC Educational Resources Information Center

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

When Unintended Consequences Become the Main Effect: Evaluating the Development of a Foster Parent Training Program.

ERIC Educational Resources Information Center

Loesch-Griffin, Deborah A.; Ringstaff, Cathy

A program of education, training, and support provided to foster parents in a California county through a nonprofit agency is evaluated. The evaluators' experience indicates that: (1) evaluations are gaining in popularity; (2) role shifts by evaluators are sometimes difficult to perceive; (3) program staff are unlikely to use evaluative feedback…

Guidelines "PEP," Peer Evaluation Program. A Systematic Approach for Evaluating Educational Programs, 1973-1974.

ERIC Educational Resources Information Center

Grotsky, Jeffery N.; And Others

The Peer Evaluation Program (PEP) has been instituted by the Division of Special Education, Pennsylvania State Department of Education, to allow intermediate units an opportunity to continuously improve their programs. The advantages of the PEP system are: (1) it is a self-improvememt system of program development; (2) PEP allows local autonomy as…

Handbook for Evaluating Drug and Alcohol Prevention Programs: Staff/Team Evaluation of Prevention Programs (STEPP).

ERIC Educational Resources Information Center

Hawkins, J. David; Nederhood, Britt

This handbook was developed for the purpose of providing drug and alcohol prevention program managers with a comprehensive yet easy-to-use tool to help their evaluation efforts. The handbook emphasizes program staff members working together as a team. It provides instruments and activities for determining program effectiveness, as well as…

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

NASA Astrophysics Data System (ADS)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

An evaluation toolkit for Florida's Commuter Assistance Programs (CAP) : a companion to the 1999 CAP evaluation manual

DOT National Transportation Integrated Search

2001-01-01

This manual is a companion piece to the Commuter Assistance Program Evaluation Manual that was developed to assist Florida's Commuter Assistance Programs (CAP) in their efforts to measure and evaluate their performance. This manual is intended to pro...

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM TECHNOLOGY PROFILES: SIXTH EDITION

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment and monitoring and measurement technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment techn...

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM - TECHNOLOGY PROFILES - SEVENTH EDITION

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment and monitoring and measurement technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment techn...

The development of a streamlined, coordinated and sustainable evaluation methodology for a diverse chronic disease management program.

PubMed

Berlowitz, David J; Graco, Marnie

2010-05-01

The Northern Alliance Hospital Admission Risk Program-Chronic Disease Management comprises 13 services delivering care to those with chronic disease and older people with complex care needs, who are frequent hospital users. To develop and implement a system-wide approach to the evaluation of this existing program. The Northern Clinical Research Centre audited all existing, routinely collected administrative data within the program and then met with each service to develop service specific outcome measures. The evaluators then developed and implemented a system-wide evaluation approach to measure performance in terms of: client profile; access and entry; service efficiency; client outcomes; and hospital demand. Data are collected electronically and more than 80% are derived from existing, administrative datasets, minimising staff and client burden. Additional data include client outcomes and a health related quality of life measure. The preliminary twelve month data suggest that clients have the equivalent of 'fair' or 'poor' self-reported health status (n = 862) and the average health utility scores are significantly (P < 0.05) worse than population control data. These analyses reveal, for the first time, that the Northern Alliance Hospital Admission Risk Program-Chronic Disease Management program is targeting appropriate clients. This methodology will enable many prospective assessments to be performed including; client outcome evaluation, service model comparisons, and cost-utility analyses. This evaluation approach demonstrates the feasibility of a highly coordinated 'whole of system' evaluation. Such an approach may ultimately contribute to the development of evidence-based policy.

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

ERIC Educational Resources Information Center

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

A multidimensional evaluation of a nursing information-literacy program.

PubMed Central

Fox, L M; Richter, J M; White, N E

1996-01-01

The goal of an information-literacy program is to develop student skills in locating, evaluating, and applying information for use in critical thinking and problem solving. This paper describes a multidimensional evaluation process for determining nursing students' growth in cognitive and affective domains. Results indicate improvement in student skills as a result of a nursing information-literacy program. Multidimensional evaluation produces a well-rounded picture of student progress based on formal measurement as well as informal feedback. Developing new educational programs can be a time-consuming challenge. It is important, when expending so much effort, to ensure that the goals of the new program are achieved and benefits to students demonstrated. A multidimensional approach to evaluation can help to accomplish those ends. In 1988, The University of Northern Colorado School of Nursing began working with a librarian to integrate an information-literacy component, entitled Pathways to Information Literacy, into the curriculum. This article describes the program and discusses how a multidimensional evaluation process was used to assess program effectiveness. The evaluation process not only helped to measure the effectiveness of the program but also allowed the instructors to use several different approaches to evaluation. PMID:8826621

Engaging partners to initiate evaluation efforts: tactics used and lessons learned from the prevention research centers program.

PubMed

Wright, Demia Sundra; Anderson, Lynda A; Brownson, Ross C; Gwaltney, Margaret K; Scherer, Jennifer; Cross, Alan W; Goodman, Robert M; Schwartz, Randy; Sims, Tom; White, Carol R

2008-01-01

The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.

DOE research and development report. Progress report, October 1980-September 1981

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bingham, Carleton D.

The DOE New Brunswick Laboratory (NBL) is the US Government's Nuclear Materials Standards and Measurement Laboratory. NBL is assigned the mission to provide and maintain, as an essential part of federal statutory responsibilities related to national and international safeguards of nuclear materials for USA defense and energy programs, an ongoing capability for: the development, preparation, certification, and distribution of reference materials for the calibration and standardization of nuclear materials measurements; the development, improvement, and evaluation of nuclear materials measurement technology; the assessment and evaluation of the practice and application of nuclear materials measurement technology; expert and reliable specialized nuclear materialsmore » measurement services for the government; and technology exchange and training in nuclear materials measurement and standards. Progress reports for this fiscal year are presented under the following sections: (1) development or evaluation of measurement technology (elemental assay of uranium plutonium; isotope composition); (2) standards and reference materials (NBL standards and reference materials; NBS reference materials); and (3) evaluation programs (safeguards analytical laboratory evaluation; general analytical evaluation program; other evaluation programs).« less

The SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION program - Technology Profiles

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) program was created to evaluate new and promising treatment technologies for cleanup at hazardous waste sites. The mission of the SITE program is to encourage the development and routine use of innovative treatment technologie...

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM - TECHNOLOGY PROFILES 4th Edition

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program evaluates new and promising treatment technologies for cleanup of hazardous waste sites. The program was created to encourage the development and routine use of innovative treatment technologies. As a result, the SI...

Curriculum Development and Evaluation for a Cancer Education Program.

ERIC Educational Resources Information Center

Deslauriers, Marc P.

1980-01-01

The Mid-America Cancer Center Program has developed a comprehensive approach for evaluating the cancer education curriculum at the University of Kansas Medical Center. The project included a review of all cancer-related teaching objectives and the development of an interdepartmental oncology curriculum. (JMD)

Identification and feasibility test of specialized rural pedestrian safety training. Volume 1, Program development and evaluation

DOT National Transportation Integrated Search

1981-03-01

This report describes the development and evaluation of a K-12 pedestrian safety curriculum for suburban and rural schools. The three program curriculum, called PEDSAFE, was developed to combat pedestrian accidents which victimize suburban/rural chil...

A Guide for Evaluating Consumer Education Programs and Materials.

ERIC Educational Resources Information Center

Lucht, Linda Lou, Ed.

The booklet was developed by the Committee on Criteria for Consumer Education Programs and Materials of the American Home Economics Association as a guide for the evaluation of consumer education programs and materials and for the development of such materials. A series of rating scales are presented, with discussion and explanation, in five…

24 CFR 576.401 - Evaluation of program participant eligibility and needs.

Code of Federal Regulations, 2014 CFR

2014-04-01

...) Supplemental Nutrition Assistance Program (7 CFR parts 271-283); (iii) Women, Infants and Children (WIC) (7 CFR... 24 Housing and Urban Development 3 2014-04-01 2013-04-01 true Evaluation of program participant eligibility and needs. 576.401 Section 576.401 Housing and Urban Development Regulations Relating to Housing...

24 CFR 576.401 - Evaluation of program participant eligibility and needs.

Code of Federal Regulations, 2012 CFR

2012-04-01

...) Supplemental Nutrition Assistance Program (7 CFR parts 271-283); (iii) Women, Infants and Children (WIC) (7 CFR... 24 Housing and Urban Development 3 2012-04-01 2012-04-01 false Evaluation of program participant eligibility and needs. 576.401 Section 576.401 Housing and Urban Development Regulations Relating to Housing...

24 CFR 576.401 - Evaluation of program participant eligibility and needs.

Code of Federal Regulations, 2013 CFR

2013-04-01

...) Supplemental Nutrition Assistance Program (7 CFR parts 271-283); (iii) Women, Infants and Children (WIC) (7 CFR... 24 Housing and Urban Development 3 2013-04-01 2013-04-01 false Evaluation of program participant eligibility and needs. 576.401 Section 576.401 Housing and Urban Development Regulations Relating to Housing...

A Text-Computer Assisted Instruction Program as a Viable Alternative for Continuing Education in Laboratory Medicine.

ERIC Educational Resources Information Center

Bruce, A. Wayne

1986-01-01

Describes reasons for developing combined text and computer assisted instruction (CAI) teaching programs for delivery of continuing education to laboratory professionals, and mechanisms used for developing a CAI program on method evaluation in the clinical laboratory. Results of an evaluation of the software's cost effectiveness and instructional…

Who Am I? Self-Exploration Series 1. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Miller, Sandra; And Others

This courseware evaluation rates the Who Am I? program developed by Instructional Enterprises. (This program--not contained in this document--is an interactive guidance course including four inventories students use to learn more about themselves.) Part A describes the program in terms of subject area (personal development) and hardware…

Peer Tutoring: A Guide to Program Design. Research and Development Series No. 260.

ERIC Educational Resources Information Center

Ashley, William L.; And Others

This publication presents guidelines for planning, implementing, and evaluating a peer tutoring program within a vocational setting. Chapter 1 discusses benefits of peer tutoring and presents a compilation of guidelines, suggestions, and examples for planning, developing, and evaluating a peer tutoring program. Tasks in each area--program…

The Evaluation of Vocational Programming in Secondary School Settings: A Suggested Protocol

ERIC Educational Resources Information Center

George, Jennifer C.; Seruya, Francine M.

2018-01-01

The primary purpose of this project was to determine if a therapist-created protocol to develop a prevocational program provided sufficient information for a practitioner to implement a vocational program within another high school setting. The developed protocol was evaluated on feasibility and efficacy for replication within another setting by…

State Programs for Migrant Children. Kansas Annual Evaluation Report, 1971.

ERIC Educational Resources Information Center

Ahlstrom, Clyde J., Comp.

Ten individual reports from the 1971 summer migrant educational programs in Kansas are summarized and evaluated. The goals of these programs were to (1) help children develop oral language and expression; (2) provide arts and crafts for personal expression; (3) provide swimming and other types of recreation for physical development and…

Widening Our Evaluative Lenses of Formal, Facilitated, and Spontaneous Academic Development

ERIC Educational Resources Information Center

Hoessler, Carolyn; Godden, Lorraine; Hoessler, Brian

2015-01-01

As conceptions of academic development expand to encompass a more diverse and flexible set of supports, traditional approaches to evaluation, including impact studies of formal programming, become insufficient. A program may appear ineffective when evaluation ignores additional supports that interact to counteract implementation or alternatively…

Program Evaluation in Gifted Education. Essential Readings in Gifted Education Series

ERIC Educational Resources Information Center

Callahan, Carolyn M., Ed.; Reis, Sally M., Ed.

2004-01-01

The readings in this ready-reference report on specific program evaluations, offer critical guidance in the development and utilization of instruments for assessing gifted and talented programs, and are designed to stimulate the discussion of issues surrounding the evaluation of gifted programs. Key features include: (1) Carolyn M. Callahan's…

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

Some Measures of Evaluation and Effectiveness in Social Work Practice.

ERIC Educational Resources Information Center

Kapoor, J. M.

Measures of accountability and evaluation of social work program efforts are examined. Evaluation of program effort refers to an assessment of the amount and kinds of program activities considered necessary for the accomplishment of program goals within a particular stage of development. It refers not only to staff time, activity, and commitment,…

Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness☆

PubMed Central

Sobelson, Robyn K.; Young, Andrea C.

2017-01-01

The Centers for Public Health Preparedness (CPHP) program was a five-year cooperative agreement funded by the Centers for Disease Control and Prevention (CDC). The program was initiated in 2004 to strengthen terrorism and emergency preparedness by linking academic expertise to state and local health agency needs. The purposes of the evaluation study were to identify the results achieved by the Centers and inform program planning for future programs. The evaluation was summative and retrospective in its design and focused on the aggregate outcomes of the CPHP program. The evaluation results indicated progress was achieved on program goals related to development of new training products, training members of the public health workforce, and expansion of partnerships between accredited schools of public health and state and local public health departments. Evaluation results, as well as methodological insights gleaned during the planning and conduct of the CPHP evaluation, were used to inform the design of the next iteration of the CPHP Program, the Preparedness and Emergency Response Learning Centers (PERLC). PMID:23380597

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Research training of students in minority and international settings: lessons learned from cancer epidemiology education in special populations.

PubMed

Soliman, Amr S; Mullan, Patricia B; Chamberlain, Robert M

2010-06-01

This article describes the development and evaluation of an NCI-sponsored short-term summer cancer research education program. The study questions examined: the feasibility of conducting a cancer education program in special populations at multiple US and international field sites for masters students; the merit and worth that students and faculty attribute to the program; and students' scholarly and cancer-related career outcomes. Developing a new curriculum, increasing the pool of mentors, utilizing and increasing the number of field sites, and program dissemination were also evaluated. Evidence of the program's success included students' completion of field experiences at multiple sites and their subsequent 70% project-related publication rate, with 79% of trainees reporting themselves as likely to pursue future cancer-related careers. Evaluation-guided future plans for the program include implementing faculty development to further enhance the program outcomes.

Evaluation and Strategic Planning for the GLOBE Program

NASA Astrophysics Data System (ADS)

Geary, E. E.; Williams, V. L.

2010-12-01

The Global Learning and Observations to Benefit the Environment (GLOBE) Program is an international environmental education program. It unites educators, students and scientists worldwide to collaborate on inquiry based investigations of the environment and Earth system science. Evaluation of the GLOBE program has been challenging because of its broad reach, diffuse models of implementation, and multiple stakeholders. In an effort to guide current evaluation efforts, a logic model was developed that provides a visual display of how the GLOBE program operates. Using standard elements of inputs, activities, outputs, customers and outcomes, this model describes how the program operates to achieve its goals. The template used to develop this particular logic model aligns the GLOBE program operations with its program strategy, thus ensuring that what the program is doing supports the achievement of long-term, intermediate and annual goals. It also provides a foundation for the development of key programmatic metrics that can be used to gauge progress toward the achievement of strategic goals.

State Guidelines for School Athletic Programs.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento.

The guidelines presented here are designed to assist school personnel in developing, administering, and evaluating school athletic programs in California. Topics include: (1) the basic philosophy for school athletic programs; (2) procedures for evaluating school athletic programs; (3) the three-phase school athletic program; (4) resources to…

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

EPA Science Inventory

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Evaluation of a PhD Program: Paving the Way.

ERIC Educational Resources Information Center

Germain, Carol P.; And Others

1994-01-01

During the evolution of an evaluation process for the University of Pennsylvania's doctoral program in nursing, a task force developed criteria and sources for program evaluation and surveyed students, alumni, and faculty to write a self-study report for external reviewers. (JOW)

Faculty-led faculty development: evaluation and reflections on a distributed educational leadership model.

PubMed

Elzubeir, Margaret

2011-01-01

This report describes and explores the impact of a series of faculty-led faculty development programs underpinned by principles of distributed educational leadership. We aimed to prepare faculty for their roles as facilitators and assessors in a newly implemented problem-based (PBL) graduate entry medical program. We asked participants attending a series of faculty development programs to evaluate workshops attended using an in-house designed survey. Overall descriptive statistics for all workshops and qualitative feedback for PBL workshops alone were examined. It was concluded that clinical faculty who are not specialized in medical education can offer high-quality, well-accepted training for their peers. Faculty development, underpinned by a distributed leadership approach which supports learning organization tenets, imaginative, flexible and democratic approaches to developing and nurturing expertise at all levels of the organization, is likely to lead to improvements in medical education. Despite the limitations of the survey approach to evaluation of faculty development programs, the information provided is useful both as a basis for decision making and program improvement.

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

PubMed

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Conceptual Soundness, Metric Development, Benchmarking, and Targeting for PATH Subprogram Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mosey. G.; Doris, E.; Coggeshall, C.

The objective of this study is to evaluate the conceptual soundness of the U.S. Department of Housing and Urban Development (HUD) Partnership for Advancing Technology in Housing (PATH) program's revised goals and establish and apply a framework to identify and recommend metrics that are the most useful for measuring PATH's progress. This report provides an evaluative review of PATH's revised goals, outlines a structured method for identifying and selecting metrics, proposes metrics and benchmarks for a sampling of individual PATH programs, and discusses other metrics that potentially could be developed that may add value to the evaluation process. The frameworkmore » and individual program metrics can be used for ongoing management improvement efforts and to inform broader program-level metrics for government reporting requirements.« less

Development and Evaluation of a Peer Support Program for Parents Facing Perinatal Loss.

PubMed

Diamond, Rachel M; Roose, Rosmarie E

2016-01-01

The purpose of this program evaluation was to understand the perspectives of peer parents and parents receiving support within a peer support program for perinatal bereavement at a midsized hospital within the midwestern United States. To document participants' perceptions of the program, a focus group was conducted with peer parents, and surveys were completed by both peer parents and parents receiving support. In this article we review our model of a peer support program for perinatal bereavement and report on parents' evaluation of the program. Recommendations through which other organizations can develop peer support programs for parents who have experienced a perinatal loss are provided. © 2016 AWHONN, the Association of Women’s Health, Obstetric and Neonatal Nurses.

Development of the Joint Committee Standards for Evaluations of Educational Programs, Projects, and Materials.

ERIC Educational Resources Information Center

Diamond, Esther E.

The growing demand for program evaluation in the 1970s gave rise to a need for a comprehensive, carefully developed, objective set of guiding principles for the evaluation process, from initial planning to final report. The Joint Committee on Standards for Education Evaluation was established to meet this need. This broad-based group, representing…

Impact of a provider training program on the treatment of children with autism spectrum disorder at psychosocial care units in Brazil.

PubMed

Silva, Luciana C; Teixeira, Maria C T V; Ribeiro, Edith L; Paula, Cristiane S

2017-12-18

To develop, implement, and verify the impact of a training program for health care providers working with children with autism spectrum disorder (ASD) in psychosocial care centers for children and adolescents (Centro de Atenção Psicossocial à Infância e à Adolescência - CAPSi) in São Paulo, Brazil. This quasi-experimental study was conducted with 14 professionals from four CAPSi units. The training program consisted of six phases: 1) pre-intervention observation; 2) meeting with staff to assess the main needs of the training program; 3) developing materials for training and evaluation; 4) meetings to discuss program implementation; 5) a final meeting for case discussion and evaluation; and 6) distance supervision. Three measures were used to evaluate the training program: i) the Knowledge, Attitudes, and Practices (KAP) questionnaire; ii) videos containing questions designed to assess program comprehension; and iii) a satisfaction survey. Thirteen videos were produced to as visual aids for use during the training program, and a further 26 videos were developed to evaluate it. The program was well evaluated by the participants. The video responses and KAP questionnaire scores suggest that staff knowledge and attitudes improved after training. The positive findings of this study suggest that the tested training program is feasible for use with multidisciplinary teams working in the CAPSi environment.

Evaluation: Review of the Past, Preview of the Future.

ERIC Educational Resources Information Center

Smith, M. F.

1994-01-01

This paper summarized contributors' ideas about evaluation as a field and where it is going. Topics discussed were qualitative versus quantitative debate; evaluation's purpose; professionalization; program failure; program development; evaluators as advocates; evaluation knowledge; evaluation expansion; and methodology and design. (SLD)

A Critical Appraisal of and Recommendations for Faculty Development

PubMed Central

Guglielmo, B. Joseph; Edwards, David J.; Franks, Andrea S.; Naughton, Cynthia A.; Schonder, Kristine S.; Stamm, Pamela L.; Thornton, Phillip; Popovich, Nicholas G.

2011-01-01

The 2009-2010 American Association of Colleges of Pharmacy (AACP) Council of Faculties Faculty Affairs Committee reviewed published literature assessing the scope and outcomes of faculty development for tenure and promotion. Relevant articles were identified via a PubMed search, review of pharmacy education journals, and identification of position papers from major healthcare professions academic organizations. While programs intended to enhance faculty development were described by some healthcare professions, relatively little specific to pharmacy has been published and none of the healthcare professions have adequately evaluated the impact of various faculty-development programs on associated outcomes. The paucity of published information strongly suggests a lack of outcomes-oriented faculty-development programs in colleges and schools of pharmacy. Substantial steps are required toward the development and scholarly evaluation of faculty-development programs. As these programs are developed and assessed, evaluations must encompass all faculty subgroups, including tenure- and nontenure track faculty members, volunteer faculty members, women, and underrepresented minorities. This paper proposes AACP, college and school, and department-level recommendations intended to ensure faculty success in achieving tenure and promotion. PMID:21931460

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Expert opinions on good practice in evaluation of health promotion and primary prevention measures related to children and adolescents in Germany.

PubMed

Korber, Katharina; Becker, Christian

2017-10-02

Determining what constitutes "good practice" in the measurement of the costs and effects of health promotion and disease prevention measures is of particular importance. The aim of this paper was to gather expert knowledge on (economic) evaluations of health promotion and prevention measures for children and adolescents, especially on the practical importance, the determinants of project success, meaningful parameters for evaluations, and supporting factors, but also on problems in their implementation. This information is targeted at people responsible for the development of primary prevention or health promotion programs. Partially structured open interviews were conducted by two interviewers and transcribed, paraphrased, and summarized for further use. Eight experts took part in the interviews. The interviewed experts saw evaluation as a useful tool to establish the effects of prevention programs, to inform program improvement and further development, and to provide arguments to decision making. The respondents' thought that determinants of a program's success were effectiveness with evidence of causality, cost benefit relation, target-group reach and sustainability. It was considered important that hard and soft factors were included in an evaluation; costs were mentioned only by one expert. According to the experts, obstacles to evaluation were lacking resources, additional labor requirements, and the evaluators' unfamiliarity with a program's contents. It was recommended to consider evaluation design before a program is launched, to co-operate with people involved in a program and to make use of existing structures. While in in this study only a partial view of expert knowledge is represented, it could show important points to consider when developing evaluations of prevention programs. By considering these points, researchers could further advance towards a more comprehensive approach of evaluation targeting measures in children and adolescents.

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

PubMed

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

ERIC Educational Resources Information Center

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

Evaluation of an Organizational Development Program for Social Service Agencies. Final Report 77-2.

ERIC Educational Resources Information Center

Olmstead, Joseph A.

This report describes and evaluates an agency development program designed to aid administrators and supervisors of local social services to achieve effective agency performance. The program was conducted for a period of one year within four local agencies; two additional agencies were used as control groups. Assistance was provided through…

Development and Pilot Evaluation of a Psychosocial Intervention Program for Patients with Age-Related Macular Degeneration

ERIC Educational Resources Information Center

Birk, Tanja; Hickl, Susanne; Wahl, Hans-Werner; Miller, Daniel; Kammerer, Annette; Holz, Frank; Becker, Stefanie; Volcker, Hans E.

2004-01-01

Purpose: The psychosocial needs of patients suffering from severe visual loss associated with advanced age-related macular degeneration (ARMD) are generally ignored in the clinical routine. The aim of this study was to develop and evaluate a psychosocial intervention program for ARMD patients. This intervention program was based on six modules…

Development of a Logic Model to Guide Evaluations of the ASCA National Model for School Counseling Programs

ERIC Educational Resources Information Center

Martin, Ian; Carey, John

2014-01-01

A logic model was developed based on an analysis of the 2012 American School Counselor Association (ASCA) National Model in order to provide direction for program evaluation initiatives. The logic model identified three outcomes (increased student achievement/gap reduction, increased school counseling program resources, and systemic change and…

University of Connecticut School of Allied Health Professions: Program Evaluation for the 1979-1980 Academic Year.

ERIC Educational Resources Information Center

Rovezzi-Carroll, Susan

The vocational curricular evaluation model (MCC) developed by the Division of Planning and Development at the Metropolitan Community College Administration Center is used to evaluate the University of Connecticut's School of Allied Health Professions. The three undergraduate programs focused on are physical therapy, clinical dietetics and medical…

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation summary for DMA program.

DOT National Transportation Integrated Search

2017-07-04

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Application (DMA) connected vehicle applications and Active Transportation and Demand management (ATDM)...

Development and Implementation of a Web-based Evaluation System for an Internal Medicine Residency Program.

ERIC Educational Resources Information Center

Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.

2001-01-01

Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…

Training and Utilizing Teaching Aides for Trainable Mentally Retarded Children. Evaluation Report.

ERIC Educational Resources Information Center

Joiner, Lee M.

Evaluated was a program utilizing aides to assist in the instruction of 40 trainable mentally retarded children in the areas of self help skills, arts and crafts, motor development, and language development. Evaluation was by an external observer for the purpose of providing program planning information. Approximately 70 questions were formulated…

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation report for ATDM program.

DOT National Transportation Integrated Search

2017-07-16

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Applications (DMA) and the Active Transportation and Demand Management (ATDM) strategies. Specifically,...

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation summary for ATDM program.

DOT National Transportation Integrated Search

2017-07-04

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of Dynamic Mobility Application (DMA) connected vehicle applications and Active Transportation and Dynamic management (ATDM...

Improving Human Services: Methods for Systematic Planning, Evaluation, and Staff Development.

ERIC Educational Resources Information Center

Jones, G. Brian; And Others

This monograph speaks to the basic problems confronting human services programs, and offers suggestions for improving guidance services. Specific concerns addressed are: (1) the need for more systematic program planning and evaluation; (2) an approach to effective planning and evaluation; (3) development of staff skills for use in the…

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation report for DMA program.

DOT National Transportation Integrated Search

2017-02-02

The primary objective of this project is to develop multiple simulation testbeds/transportation models to evaluate the impacts of DMA connected vehicle applications and the active and dynamic transportation management (ATDM) strategies. The outputs (...

The Evaluation of a Clinical Development Unit Leadership Preparation Program by Focus Group Interviews--Part I: Positive Aspects. Part II: Negative Aspects.

ERIC Educational Resources Information Center

Greenwood, Jennifer; Parsons, Myra

2002-01-01

Focus group evaluations of a training program for nurses leading clinical development units focused on research-based practice found that leadership and strategic skills were developed. However, participants had insufficient time to assimilate knowledge or develop mentoring relationships and needed more help developing research-receptive culture…

EPO Program and Product Evaluation Throughout the Development Lifecycle

NASA Astrophysics Data System (ADS)

Kaiser, C.; Butcher, G. J.

2013-12-01

Evaluation of successful education and public outreach (EPO) programs and products is becoming increasingly important for the continued development of such efforts. This presentation will detail the tools and techniques used to evaluate two EPO efforts- 1) NASA's REEL Science Communications Contest and Video Production Workshop, and 2) the 'Sensors, Circuits, and Satellites' product. A primary challenge with evaluating any EPO product geared towards children and students is the limitation on collecting information from minors. With regards to the REEL Science Contest, over 120 students participated in producing and entering 48 contest entries but because of the Office of Budget and Management (OBM) regulations that restrict collecting feedback from more than nine individuals, we were only able to collect evaluation data from a small subset of this group. The five winning students who participated in the final workshop took part in the evaluation. The benefit of a small group size is that it allowed for more in-depth one-on-one interviews with each student. The feedback collected from this evaluation offered valuable insight into what worked well along with areas of improvement for futures contests and workshops. The REEL Science video contest had another evaluation opportunity since NASA scientists, communications experts, and producers also participated in the program and worked directly with the students. A survey was administered for this audience in an effort to gauge the perceived value and success of the program from the perspective of the originating institution. We found that if a program is well received, the program is more likely to receive future support. Additionally, this component of the program evaluation provided useful feedback and lessons learned to help optimize the role of the internal audience for similar programs in the future. Implementing formative evaluation is key to developing a successful EPO product development. Collecting data at key stages during development allows for modifications and improvements to the product before time and money have been wasted going down the wrong path. Depending on the product and the stage of development, there are several evaluation tools to employ: surveys, observations, expert analysis, heuristic evaluations, feedback forms, diary studies, use case testing and interviews. In the case of developing the 'Sensors, Circuits, and Satellites' product, surveys were collected from teachers and students who participated in the lesson or activity. Audio recordings were also made of the teachers as they completed each activity to collect direct quotes, questions, concerns, and feedback. Facilitators completed feedback forms to capture quotes and observations of the students working through the activities and engaging with the product. All of these data provided valuable insight into the participants' experiences and effectiveness of the product. A complement of tools and techniques is the best approach to evaluating EPO products and programs. These will vary based on application, but can easily be implemented at key points in the development lifecycle to produce feedback and data used to assess and meet EPO goals and objectives.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

Evaluation of an international faculty development program for developing countries in Asia: the Seoul Intensive Course for Medical Educators.

PubMed

Kim, Do-Hwan; Yoon, Hyun Bae; Sung, Minsun; Yoo, Dong-Mi; Hwang, Jinyoung; Kim, Eun Jung; Lee, Seunghee; Shin, Jwa-Seop

2015-12-18

The issue of collaboration in medical education is becoming prominent. Some faculty development programs have suggested an approach for promoting collaboration on a global level. However, non-English-speaking developing countries in Asia, especially in Southeast Asia, do not take advantage of them due to their unique context, such as language and culture. To address these issues, Seoul National University College of Medicine initiated a 6-week international faculty development program called the "Seoul Intensive Course for Medical Educators" for 16 fellows from five Asian countries (Cambodia, Laos, Mongolia, Myanmar, and Vietnam). The aim of this study is to report the evaluation results of the outcome of the program and discuss better ways of collaborating with developing countries. Three levels of collaboration-intraorganizational, intranational, and international-were central initiatives of the program. Prior to setting up the program details, we first established four design principles, following which the contents, materials, and facilitators were determined to maintain consistency with the design principles. The evaluation of the program was done with Kirkpatrick's four-level model. Most of the evaluation data for level 1 were collected by two questionnaires, the post-module survey and the post-program survey. Portfolios and progress reports were mainly used to collect outcome data for levels 2 and 3, respectively. The reaction was generally positive throughout the program and there was a significant correlation between satisfaction and relevance to one's job or needs. Despite the fellows' propensity for overestimating themselves, both the evaluators and fellows reported that there was significant improvement in learning. Opinions on the impact or urgency of the topics were slightly different from country to country; however, the answers regarding feasibility were fairly similar. Moreover, we could observe from the post-program progress reports that the transfer of learning was actively in progress, mainly for topics that were highly feasible. These results show that the program was successful in terms of its effectiveness. Consistent and timely support is essential for the sustainable development of the medical education systems in these countries. Further understanding of the underlying factors on transfer (level 3) could improve the effectiveness of faculty development programs for developing countries.

Some Evaluative Comments Based on a Review of the Curriculum Development Processes Operating in the Stanford Program on International and Cross Cultural Education. [and] A Review of the Curriculum. Development Processes Operating in the Stanford Program on International and Cross-Cultural Education.

ERIC Educational Resources Information Center

Kennedy, Kerry J.

The processes of instructional materials development and dissemination used in four Stanford Program on International and Cross Cultural Education (SPICE) projects dealing with Latin America, Africa, China, and Japan are described, and evaluative comments based on a review of the curriculum development process are made. The major purpose of the…

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

An Assessment System for Competence Based Education: The Educational Development, Dissemination, and Evaluation Training Program.

ERIC Educational Resources Information Center

Hood, Paul D.; Blackwell, Laird

This manual provides a description of the development and a guide to the use of the assessment resources developed in connection with the Far West Development, Dissemination, and Evaluation (DD&E) Functional Competence Training Program. The document concentrates on a user-oriented description of the content, validation, and use of the final…

Measuring the Impacts of a Volunteer-Based Community Development Program in Developing Volunteers' Leadership Skills

ERIC Educational Resources Information Center

Meier, Amy; Singletary, Loretta; Hill, George

2012-01-01

This article summarizes the results of an evaluation of the impacts of a community development program to develop leadership skills in its adult volunteers. The evaluation featured 20 questions about leadership skills learned as a result of volunteer experiences. Data analysis strategies beyond a simple means ranking resulted in evidence…

The Stanford Medical Youth Science Program: Educational and Science-Related Outcomes

ERIC Educational Resources Information Center

Crump, Casey; Ned, Judith; Winkleby, Marilyn A.

2015-01-01

Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer…

A pharmacy leadership action study.

PubMed

Louie, Clifton; Mertz, Elizabeth; Penfil, Brett; O'Neil, Edward

2009-01-01

To report on the creation of a leadership development program targeted exclusively at pharmacists working in management in the professional community. Large staff-model health maintenance organization (HMO) in California between 2004 and 2008. The Pharmacy Leadership Institute (PLI; a joint effort of the School of Pharmacy and the Center for the Health Professions at the University of California, San Francisco) tested a program in a large staff-model HMO with hundreds of pharmacists in leadership roles. This program included learning seminars, psychometric assessments, leadership goals, intersession activities, coaching/mentoring, and leadership projects. Not applicable. PLI collected survey data in order to evaluate the effectiveness of the institute's leadership development program. In addition, an external evaluator was hired to conduct interviews with the pharmacy directors of the organization which chose to pilot the program. The evaluations from the participants indicate that the leadership development program met many but not all of its initial objectives. Consistent with action research methodology, the faculty of the institute met to redesign some sections of the program in order to meet the established goals. Adjustments were made to different components of the program over the next 4 years. Evaluation data show that these revisions were successful. In addition, follow-up evaluations with participants showed a lasting impact of the program on both individual leadership skills and organizational outcomes. Given the positive outcomes indicated by the evaluation data used in this study, the work of PLI indicates that broader leadership skills can be identified and enhanced within a group of pharmacy managers.

Planning, Implementation, and Evaluation of AIDS Education Programs for Dentists.

ERIC Educational Resources Information Center

Gerbert, Barbara; And Others

1991-01-01

An office-based continuing education program on acquired immune deficiency syndrome (AIDS) for dentists is described, including needs assessment, model development, local piloting, national implementation with 119 dentists, and evaluation phases. Program evaluation indicated an improvement in risk perception, knowledge, and practice resulted, but…

Factor Analysis of the HEW National Strategy for Youth Development Model's Community Program Impact Scales.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW (Health, Education, and Welfare) National Strategy for Youth Development Model proposed a community-based program to promote positive youth development and to prevent delinquency through a sequence of youth needs assessments, needs-targeted programs, and program impact evaluation. HEW Community Program Impact Scales data obtained…

Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

Institute for Home Economics Teachers on Initiating, Developing, and Evaluating Programs at the Post High School Level to Prepare Food Service Supervisors and Assistants to Directors of Child Care Services: Volume I: A Post High School Program in Home Economics (May 1, 1966-June 30, 1967). Final Report.

ERIC Educational Resources Information Center

Georgia Univ., Athens. Coll. of Education.

The institute was designed to provide information and develop some ability in initiating, developing, and evaluating programs for training workers as food service supervisors in post-high school level programs. Organizational details, student and faculty qualifications, a job description and analysis of the food service supervisor occupation are…

Satellite Power System (SPS) FY 79 program summary

NASA Technical Reports Server (NTRS)

1980-01-01

The Satellite Power System (SPS) program a joint effort to develop an initial understanding of the technical feasibility, the economic practicality, and the social and environmental acceptability of the SPS concept is discussed. This is being accomplished through implementation of the Concept Development and Evaluation Program Plan which is scheduled for completion by the end of FY 1980. This Program Summary not only covers FY 1979 but includes work completed in FY 1977 and FY 1978 in order to give a comprehensive picture of the DOE involvement in the SPS concept development and evaluation process.

40 CFR 501.16 - Requirements for compliance evaluation programs.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 29 2010-07-01 2010-07-01 false Requirements for compliance evaluation programs. 501.16 Section 501.16 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) SEWAGE SLUDGE STATE SLUDGE MANAGEMENT PROGRAM REGULATIONS Development and Submission of State Programs...

Development and implementation of a peer mentoring program for early career gerontological faculty.

PubMed

Bryant, Ashley Leak; Aizer Brody, Abraham; Perez, Adriana; Shillam, Casey; Edelman, Linda S; Bond, Stewart M; Foster, Victoria; Siegel, Elena O

2015-05-01

The Hartford Gerontological Nursing Leaders (HGNL) formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), in conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), developed and executed a peer mentoring program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of HGNL members. The purpose of this article is to describe key strategies used to develop and execute the peer mentoring program and to present formative program evaluation. The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. © 2015 Sigma Theta Tau International.

Do Early Childhood Programs Have Lasting Effects on Children? Evaluation Science Brief

ERIC Educational Resources Information Center

National Forum on Early Childhood Program Evaluation, 2008

2008-01-01

"Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "Early Intervention in Low Birthweight Premature Infants: Results at 18 Years of Age for the Infant Health and Development Program (IHDP)" (M.C. McCormick, J.…

The Development and Implementation of a Model for Evaluating Clinical Specialty Education Programs.

ERIC Educational Resources Information Center

McLean, James E.; And Others

A new method for evaluating cancer education programs, using an external/internal evaluation team is outlined. The internal program staff are required to collect the data, arrange for a site visit, provide access to personnel, and make available other information requested by the evaluators. The external team consists of a dentist with oncological…

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

ERIC Educational Resources Information Center

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Redesigning and Aligning Assessment and Evaluation for a Federally Funded Math and Science Teacher Educational Program

ERIC Educational Resources Information Center

Hardre, Patricia L.; Slater, Janis; Nanny, Mark

2010-01-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

School Community Education Program in New York City 1988-89. Volume II. OREA Evaluation Section Report.

ERIC Educational Resources Information Center

Guerrero, Frank; Abbott, Lori

This second volume of a four-volume evaluation of the 1988-89 New York City School Community Education Program (also known as the Umbrella Program) comprises reports evaluating nine innovative elementary school projects on social, ethnical, and environmental studies, four of which included staff development workshops. Evaluation sources included…

Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children. Report from the Social and Character Development Research Program. NCER 2011-2001

ERIC Educational Resources Information Center

Ruby, Allen; Doolittle, Emily

2010-01-01

The Institute of Education Sciences (IES) and the Division of Violence Prevention in the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention (CDC) collaborated to conduct a rigorous impact evaluation of programs aimed at improving students' behavior. For this evaluation, such programs were termed Social…

5 CFR 362.204 - Development, evaluation, promotion, and certification.

Code of Federal Regulations, 2010 CFR

2010-01-01

... be placed, with full-time management and/or technical responsibilities consistent with the Fellow's... certification. 362.204 Section 362.204 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT CIVIL SERVICE REGULATIONS PRESIDENTIAL MANAGEMENT FELLOWS PROGRAM Program Administration § 362.204 Development, evaluation...

Program Development and External Assessment.

ERIC Educational Resources Information Center

Minnis, D. L.

Although the development of new models is essential to the improvement of teacher preparation programs, the California system of accreditation of teacher education programs seems to hinder innovative program development and evaluation. External assessment in California is based on a discrepancy model which works best when applied to static…

Behavioral patterns of environmental performance evaluation programs.

PubMed

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Procedures for Trade and Industrial Program Development.

ERIC Educational Resources Information Center

Campbell, Clifton P.

The instructional systems development (ISD) approach for the development and accomplishment of vocational training programs provides a methodology for gathering and analyzing job information, developing instructional materials in a variety of media, conducting instruction, and evaluating and improving the effectiveness of training programs. This…

Evaluating the benefits of government funded R & D aimed at the private sector

NASA Technical Reports Server (NTRS)

Greenberg, J. S.

1977-01-01

Federal funding of technological research and development is discussed with regard to the procedures for an economic analysis with the goals of (1) determining when the public sector should invest in a research and development program, (2) evaluating the likelihood of private sector participation in terms of public sector participation, and (3) considering the major factors in the formulation of a research and development program in terms of defining initiatives. Public sector investments are evaluated, noting procedures for determining whether benefits exceed costs. The role of the public sector research and development planning is described, considering the procedure for private sector implementation decisions and a methodology for evaluating the possibility of private sector commercialization. The economic value of the public sector research and development program is presented with attention given to a specific case of NASA-sponsored research and development aimed toward the commercialization of new public communications services.

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

PubMed Central

KOJURI, JAVAD; AMINI, MITRA; KARIMIAN, ZAHRA; DEHGHANI, MOHAMMAD REZA; SABER, MAHBOOBEH; BAZRAFCAN, LEILA; EBRAHIMI, SEDIGHEH; REZAEE, RITA

2015-01-01

Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396). Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusions: Our faculty development program  have a significant positive effect on medical university teaching staff members’ competencies. Further research is needed to investigate whether the faculty development program actually results in improved teaching performance. PMID:25587548

78 FR 66905 - Agency Information Collection Activities; Comment Request; Evaluating the Retired Mentors for...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-07

...; Comment Request; Evaluating the Retired Mentors for Teachers Program AGENCY: Institute of Education... considered public records. Title of Collection: Evaluating the Retired Mentors for Teachers Program. OMB... study of the Retired Mentors for New Teachers program for probationary teachers developed by the Aurora...

E-Basics: Online Basic Training in Program Evaluation

ERIC Educational Resources Information Center

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Program Evaluation: Where Instruction and School Business Meet

ERIC Educational Resources Information Center

Ayers, Steven V.

2011-01-01

In this article, the author talks about program evaluation, a strategy commonly used by instructional leaders that can help school business officials improve their budget process. As districts struggle to develop budgets in these challenging economic times, school business officials might consider turning to program evaluation for help. Program…

The Logic of Evaluation.

ERIC Educational Resources Information Center

Welty, Gordon A.

The logic of the evaluation of educational and other action programs is discussed from a methodological viewpoint. However, no attempt is made to develop methods of evaluating programs. In Part I, the structure of an educational program is viewed as a system with three components--inputs, transformation of inputs into outputs, and outputs. Part II…

A Model for Evaluating Development Programs. Miscellaneous Report.

ERIC Educational Resources Information Center

Burton, John E., Jr.; Rogers, David L.

Taking the position that the Classical Experimental Evaluation (CEE) Model does not do justice to the process of acquiring information necessary for decision making re planning, programming, implementing, and recycling program activities, this paper presents the Inductive, System-Process (ISP) evaluation model as an alternative to be used in…

Edgewood Independent School District, Title VII Bilingual Education Program. Final Evaluation Report, 1970-71.

ERIC Educational Resources Information Center

Edgewood Independent School District, San Antonio, TX.

The 1970-71 evaluation of the Title VII bilingual education program in the Edgewood Independent School District in San Antonio, Texas, is presented in this report. The report discusses the program with regard to (1) curriculum development, (2) staff development, (3) community involvement, and (4) the pre- and post-tests given to the students. The…

Evaluation of the Library Aide Program, 1967-68. Research and Development Report, Volume II, Number 8.

ERIC Educational Resources Information Center

Ireland, Vera M.

As an integral part of the library improvement program of the Atlanta Public School System, the library aide program, funded under Title I of the Elementary and Secondary Education Act, was developed to relieve librarians of routine clerical and nonprofessional duties. In order to evaluate the inservice training and library aide activities,…

Development, Implementation, and Evaluation of a Comprehensive Course on Suicide in a Master's of Social Work Program

ERIC Educational Resources Information Center

Almeida, Joanna; O'Brien, Kimberly H. M.; Gironda, Christina M.; Gross, Emma B.

2017-01-01

Most master of social work (MSW) programs provide minimal education or training on suicide prevention, intervention, and postvention despite that the majority of social workers encounter suicidal clients during their professional careers. This study describes the development, implementation, and evaluation of a course on suicide in an MSW program.…

Evaluating the Impact of the "Teaching as a Chemistry Laboratory Graduate Teaching Assistant" Program on Cognitive and Psychomotor Verbal Interactions in the Laboratory

ERIC Educational Resources Information Center

Flaherty, A.; O'Dwyer, A.; Mannix-McNamara, P.; Leahy, J. J.

2017-01-01

Designing and evaluating teacher development programs for graduate teaching assistants (GTAs) who teach in the laboratory is a prominent feature of chemistry education research. However, few studies have investigated the impact of a GTA teacher development program on the verbal interactions between participating GTAs and students in the…

The Results of a Randomized Control Trial Evaluation of the SPARK Literacy Program

ERIC Educational Resources Information Center

Jones, Curtis J.; Christian, Michael; Rice, Andrew

2016-01-01

The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the…

An Evaluation of the Employee Training and Development Process for Nicolet Area Technical College's Basic Education Program.

ERIC Educational Resources Information Center

Karl, Luis C.

The adult basic education (ABE) program at Nicolet Area Technical College (NATC) evaluated its training and development (T&D) process for new basic education instructors. The study gathered monitoring and screening criteria that addressed valuable components for use in an instrument for validating effectiveness of the ABE program (T&D)…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

The Common Sociology between Teacher Evaluation and Teacher Development.

ERIC Educational Resources Information Center

Crow, Nedra; Peterson, Ken

The purpose of this study was to explore the sociological forces which have been identified in teacher development and to inquire into their role in teacher evaluation. To that end, a series of teacher development intervention programs and teacher interviews were conducted. This report describes the programs and interviews and highlights the most…

Evaluator's Guide for Microcomputer-Based Instructional Packages. Developed by MicroSIFT, a Project of the Computer Technology Program. Sixth Revision.

ERIC Educational Resources Information Center

Northwest Regional Educational Lab., Portland, OR.

This guide developed by MicroSIFT, a clearinghouse for microcomputer-based educational software and courseware, provides background information and forms to aid teachers and other educators in evaluating available microcomputer courseware. The evaluation process comprises six stages: (1) sifting, which screens out those programs that are not…

Evaluation of Federal Social Programs: An Uncertain Impact. Occasional Paper 1992-2.

ERIC Educational Resources Information Center

Levitan, Sar A.

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

A Discrepancy-Based Methodology for Nuclear Training Program Evaluation.

ERIC Educational Resources Information Center

Cantor, Jeffrey A.

1991-01-01

A three-phase comprehensive process for commercial nuclear power training program evaluation is presented. The discrepancy-based methodology was developed after the Three Mile Island nuclear reactor accident. It facilitates analysis of program components to identify discrepancies among program specifications, actual outcomes, and industry…

Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

PubMed

MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

2006-01-01

The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

Development, Implementation, and Evaluation of a Professional Skills Development Program: The Case of Concordia University's GradProSkills

ERIC Educational Resources Information Center

Venkatesh, Vivek; Rabah, Jihan; Lamoureux-Scholes, Laurie; Pelczer, Ildiko; Urbaniak, Kathryn; Martin, Frédérica

2014-01-01

The Graduate and Professional Skills (GradProSkills) program is an initiative developed and run by Concordia University's School of Graduate Studies and the university's Office of the Vice-President, Research and Graduate Studies. This paper presents a case study in which we describe the development, implementation, and evaluative components of…

Evaluating Youth Development Programs: Progress and Promise

ERIC Educational Resources Information Center

Roth, Jodie L.; Brooks-Gunn, Jeanne

2016-01-01

Advances in theories of adolescent development and positive youth development have greatly increased our understanding of how programs and practices with adolescents can impede or enhance their development. In this article the authors reflect on the progress in research on youth development programs in the last two decades, since possibly the…

An Evaluation of a Mixed-Gender Sexual Assault Prevention Program

ERIC Educational Resources Information Center

Bradley, April R.; Yeater, Elizabeth A.; O'Donohue, William

2009-01-01

This study evaluated the short-term effectiveness of a mixed-gender sexual assault prevention program developed for college students. Program participants (n = 177) were compared to non-program participants (n = 132) prior to the program and during a 2-week follow-up period on measures of rape myths, victim empathy, perceived negative consequences…

Title I, ESEA Program Evaluation, 1967-68. Program Research and Development.

ERIC Educational Resources Information Center

Jacobs, James N., Ed.; Felix, Joseph L., Ed.

This report comprises a Title I ESEA Program evaluation for 1967-68 in Cincinnati Public Schools. To make greater concentration of services possible, lesser target schools were phased out of the 1967-68 program. The five projects comprising the 1967-68 program were: Elementary School remediation and enrichment; Secondary School remediation and…

EPA'S SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION (SITE) PROGRAM

EPA Science Inventory

In 1986, the U.S. Environmental Protection Agen- cy`s Offices of Solid Waste and Emergency Response (OSWER), and the Office of Research and Develop- ment (ORD) established a technology research, dem- onstration, and evaluation program to promote the development and use of alterna...

Development and evaluation of a pedestrian safety training program for elementary school bus riders

DOT National Transportation Integrated Search

1994-12-01

The objective of this study was to develop and evaluate a comprehensive pedestrian safety program for elementary (kindergarten through grade 6) school bus riders. Existing materials, crash data and state laws/regulations on school bus pedestrian safe...

Evolution of a multilevel framework for health program evaluation.

PubMed

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

What Works? Common Practices in High Functioning Afterschool Programs across the Nation in Math, Reading, Science, Arts, Technology, and Homework--A Study by the National Partnership. The Afterschool Program Assessment Guide. CRESST Report 768

ERIC Educational Resources Information Center

Huang, Denise; Cho, Jamie; Mostafavi, Sima; Nam, Hannah H.; Oh, Christine; Harven, Aletha; Leon, Seth

2010-01-01

In an effort to identify and incorporate exemplary practices into existing and future afterschool programs, the U.S. Department of Education commissioned a large-scale evaluation of the 21st Century Community Learning Center (CCLC) program. The purpose of this evaluation project was to develop resources and professional development that addresses…

A potential role of anti-poverty programs in health promotion

PubMed Central

Silverman, Kenneth; Holtyn, August F.; Jarvis, Brantley

2016-01-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. PMID:27235603

A potential role of anti-poverty programs in health promotion.

PubMed

Silverman, Kenneth; Holtyn, August F; Jarvis, Brantley P

2016-11-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Modern & Classical Languages: K-12 Program EValuation 1988-89.

ERIC Educational Resources Information Center

Martinez, Margaret Perea

This evaluation of the modern and classical languages programs, K-12, in the Albuquerque (New Mexico) public school system provides general information on the program's history, philosophy, recognition, curriculum development, teachers, and activities. Specific information is offered on the different program components, namely, the elementary…

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

PubMed

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

Development of a Teen-Friendly Health Education Program on Facebook: Lessons Learned.

PubMed

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E

2016-01-01

Facebook is the most popular online platform among adolescents and can be an effective medium to deliver health education. Although Korean American (KA) adolescents are at risk of obesity, a culturally tailored health education program is not available for them. Thus, our research team developed a health education program for KA adolescents on Facebook called "Healthy Teens." The aim of this study was to discuss important lessons learned through the program development process. This program includes culturally tailored learning modules about healthy eating and physical activity. The program was developed on the basis of the social cognitive theory, and the online program was developed by applying Web usability principles for adolescents. Upon completion, the usability of the program was assessed using heuristic evaluation. The findings from the heuristic evaluation showed that the Healthy Teens program was usable for KA adolescents. The findings from this study will assist researchers who are planning to build similar Facebook-based health education programs. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

PubMed

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.

The Superfund Innovative Technology Evaluation Program SUMMARY AND CLOSURE REPORT

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program promoted the development, commercialization, and implementation of innovative hazardous waste treatment technologies for 20 years. SITE offered a mechanism for conducting joint technology demonstration and evaluation ...

Program Evaluation Grant. Final Report.

ERIC Educational Resources Information Center

Quadco Rehabilitation Center, Inc., Stryker, OH.

The purpose of the project was to increase the effectiveness and efficiency of those rehabilitation facilities which were utilized by the Ohio Rehabilitation Services Commission (RSC) through the development, installation, and utilization of a program evaluation system and a management information system. The two systems were developed and…

INTEGRATION OF SPATIAL DATA: METHODS EVALUATION WITH REGARD TO DATA ISSUES AND ASSESSMENT QUESTIONS

EPA Science Inventory

EPA's Regional Vulnerability Assessment (REVA) Program is developing and demonstrating approaches to assess current and future environmental vulnerabilities at a regional scale. An initial effort within this research program has been to develop and evaluate methods to synthesize ...

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

PubMed

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Evaluation of Supplemental Nutrition Assistance Program Education: Application of Behavioral Theory and Survey Validation

ERIC Educational Resources Information Center

Wyker, Brett A.; Jordan, Patricia; Quigley, Danielle L.

2012-01-01

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

Evaluating Inclusive Educational Practices for Students with Severe Disabilities Using the Program Quality Measurement Tool

ERIC Educational Resources Information Center

Cushing, Lisa S.; Carter, Erik W.; Clark, Nitasha; Wallis, Terry; Kennedy, Craig H.

2009-01-01

Recent legislative and school reform efforts require schools to evaluate and improve educational practices for students with severe disabilities. The authors developed the "Program Quality Measurement Tool" (PQMT) to enable administrators and educators to evaluate the educational programming provided to students with severe disabilities against…

Evaluation of the Tennessee Nutrition Education and Training Program. 1981 Final Report.

ERIC Educational Resources Information Center

Banta, Trudy W.; And Others

The Tennessee Nutrition Education and Training (NET) program is part of a U.S. Department of Agriculture effort to develop a coordinated nutrition education program for children from preschool through grade 12. For this second-year evaluation, researchers associated with the University of Tennessee collected data for the evaluation of program…

Evaluation of the Integrated Services Pilot Program from Western Australia

ERIC Educational Resources Information Center

Hancock, Peter; Cooper, Trudi; Bahn, Susanne

2009-01-01

Independent evaluation of refugee-focused programs in developed nations is increasingly a mandatory requirement of funding bodies and government agencies. This paper presents an evaluation of the Integrated Services Centre (ISC) Pilot Project that was conducted in Australia in 2007 and early 2008. The purpose of the ISC program was to provide…

Summative Evaluation of the Foreign Credential Recognition Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2010

2010-01-01

A summative evaluation of the Foreign Credential Recognition Program (FCRP) funded by Human Resources and Skills Development Canada (HRSDC) was conducted during the spring, summer and fall of 2008. The main objective of the evaluation was to measure the relevance, impacts, and cost-effectiveness of the program. Given the timing of the evaluation…

Healing by Creating: Patient Evaluations of Art-Making Program

ERIC Educational Resources Information Center

Heiney, Sue P.; Darr-Hope, Heidi; Meriwether, Marian P.; Adams, Swann Arp

2017-01-01

The benefits of using art in health care, especially with cancer patients, have been described anecdotally. However, few manuscripts include a conceptual framework to describe the evaluation of patient programs. This paper describes patients' evaluation of a healing arts program developed within a hospital for cancer patients that used art-making,…

Development Process and Outcome Evaluation of a Program for Raising Awareness of Indirect and Relational Aggression in Elementary Schools: A Preliminary Study

ERIC Educational Resources Information Center

Verlaan, Pierrette; Turmel, France

2010-01-01

The development process of a program for raising awareness of indirect and relational aggression in elementary school children and teachers is described and a preliminary outcome evaluation of the program was conducted. The 188 participants were derived from 8 fourth- through sixth-grade elementary classes in two lower-middle-class schools from…

The Reality of Evaluating Community-Based Sport and Physical Activity Programs to Enhance the Development of Underserved Youth: Challenges and Potential Strategies

ERIC Educational Resources Information Center

Whitley, Meredith A.; Forneris, Tanya; Barker, Bryce

2014-01-01

In recent years, underserved communities have received much attention within the field of positive youth development (PYD). While there are an increasing number of opportunities for underserved youth to join PYD-based programs, there is growing concern surrounding the lack of critical evaluation of these programs (Kidd, 2008). Unfortunately, there…

Hui Malama O Ke Kai: A Positive Prevention-Based Youth Development Program Based on Native Hawaiian Values and Activities

ERIC Educational Resources Information Center

Hishinuma, Earl S.; Chang, Janice Y.; Sy, Angela; Greaney, Malia F.; Morris, Katherine A.; Scronce, Ami C.; Rehuher, Davis; Nishimura, Stephanie T.

2009-01-01

Evaluation of after-school programs that are culturally and place-based and promote positive youth development among minority and indigenous youths has not been widely published. The present evaluation is the first of its kind of an after-school, youth-risk prevention program called Hui Malama O Ke Kai (HMK), that emphasizes Native Hawaiian values…

Program Evaluation Report for Sulphur Springs Independent School District Project STYLE (Students and Teachers Yearning to Learn Effectively) 2004-2005

ERIC Educational Resources Information Center

Combs, Julie P.; Jackson, Sherion H.

2005-01-01

The purpose of this paper is to present findings from a program evaluation conducted to examine the effectiveness of the Schools Attuned program in a north Texas school district. Schools Attuned was developed by a professor of pediatrics, Dr. Mel Levine (2002), as a professional development model to train teachers to identify cognitive and…

[Evaluation of the implementation of reproductive health services in Maringá, Paraná State, Brazil].

PubMed

Nagahama, Elizabeth Eriko Ishida

2009-01-01

The aim of this study was to develop a tool to evaluate the implementation of a contraceptive program in health services and apply it to the 23 public health services in Maringá, Paraná State, Brazil. A theoretical-logical model was developed, corresponding to a 'target image' for the family planning program. Using the Delphi technique and consensus conference, six experts validated the program's target image, which included three dimensions and 60 evaluation criteria. A data collection instrument was prepared, in addition to a spreadsheet to evaluate the degree of the family planning program's implementation, constituting the Questionnaire for the Evaluation of Reproductive Health Services. The vast majority of the primary health units (91.3%) received an 'intermediate' score on implementation of the family planning program, while 8.7% were classified as 'incipient' and none were scored as 'advanced'. The 'advanced' degree of implementation in the structural dimension contrasted with the organizational and patient care dimensions. The instrument can be useful for evaluating reproductive health programs and is applicable to the health services planning and management processes.

Program Evaluation of Services for the Homeless: Challenges and Strategies.

ERIC Educational Resources Information Center

Mercier, Celine; And Others

1992-01-01

Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)

Some Methods for Evaluating Program Implementation.

ERIC Educational Resources Information Center

Hardy, Roy A.

An approach to evaluating program implementation is described. This approach includes the development of a project description which includes a structure matrix, sampling from the structure matrix, and preparing an implementation evaluation plan. The implementation evaluation plan should include: (1) verification of implementation of planned…

A GUIDE FOR SELF-EVALUATION OF STATE SUPERVISORY PROGRAMS IN VOCATIONAL EDUCATION IN AGRICULTURE.

ERIC Educational Resources Information Center

LINSON, MARVIN G.

THE PURPOSE OF THE STUDY WAS TO DEVELOP A GUIDE FOR THE SELF-EVALUATION OF STATE SUPERVISORY PROGRAMS OF VOCATIONAL EDUCATION IN AGRICULTURE AND TO DESIGN AN INSTRUMENT TO ASSIST IN THIS EVALUATION. TWO NATIONAL JURIES OF EXPERTS IN EDUCATIONAL SUPERVISION ASSISTED IN REFINING A SET OF STATEMENTS, DEVELOPED TO SERVE AS INDICATORS OF SUCCESSFUL…

Development of pressure containment and damage tolerance technology for composite fuselage structures in large transport aircraft

NASA Technical Reports Server (NTRS)

Smith, P. J.; Thomson, L. W.; Wilson, R. D.

1986-01-01

NASA sponsored composites research and development programs were set in place to develop the critical engineering technologies in large transport aircraft structures. This NASA-Boeing program focused on the critical issues of damage tolerance and pressure containment generic to the fuselage structure of large pressurized aircraft. Skin-stringer and honeycomb sandwich composite fuselage shell designs were evaluated to resolve these issues. Analyses were developed to model the structural response of the fuselage shell designs, and a development test program evaluated the selected design configurations to appropriate load conditions.

Space station common module power system network topology and hardware development

NASA Technical Reports Server (NTRS)

Landis, D. M.

1985-01-01

Candidate power system newtork topologies for the space station common module are defined and developed and the necessary hardware for test and evaluation is provided. Martin Marietta's approach to performing the proposed program is presented. Performance of the tasks described will assure systematic development and evaluation of program results, and will provide the necessary management tools, visibility, and control techniques for performance assessment. The plan is submitted in accordance with the data requirements given and includes a comprehensive task logic flow diagram, time phased manpower requirements, a program milestone schedule, and detailed descriptions of each program task.

The vehicle design evaluation program - A computer-aided design procedure for transport aircraft

NASA Technical Reports Server (NTRS)

Oman, B. H.; Kruse, G. S.; Schrader, O. E.

1977-01-01

The vehicle design evaluation program is described. This program is a computer-aided design procedure that provides a vehicle synthesis capability for vehicle sizing, external load analysis, structural analysis, and cost evaluation. The vehicle sizing subprogram provides geometry, weight, and balance data for aircraft using JP, hydrogen, or methane fuels. The structural synthesis subprogram uses a multistation analysis for aerodynamic surfaces and fuselages to develop theoretical weights and geometric dimensions. The parts definition subprogram uses the geometric data from the structural analysis and develops the predicted fabrication dimensions, parts material raw stock buy requirements, and predicted actual weights. The cost analysis subprogram uses detail part data in conjunction with standard hours, realization factors, labor rates, and material data to develop the manufacturing costs. The program is used to evaluate overall design effects on subsonic commercial type aircraft due to parameter variations.

UNICEF and UNAIDS Evaluations of HIV/AIDS Programmes in Sub-Saharan Africa.

ERIC Educational Resources Information Center

Morell, Jonathan A., Ed.

2002-01-01

Describes 14 evaluations of HIV and AIDS programs undertaken in sub-Saharan Africa over the last decade. These programs demonstrate the importance of enhancing program quality and providing national coverage, rooting programs in community, empowering young people, and developing partnerships to combat HIV and AIDS. (SLD)

Assessing the Value of the Enviroscape Watershed Learning Module

ERIC Educational Resources Information Center

Edwards, Warren Patrick

2013-01-01

Scope and Method of Study: The researcher's evaluation of the West Atlanta Watershed Alliance's (WAWA) programs highlighted that few if any of the offered educational programs included a program evaluation, especially the most promising, the Enviroscape® Watershed learning module. The education programs that were customized and developed by the…

Improving Literacy Achievement for English Learners in Transitional Bilingual Programs.

ERIC Educational Resources Information Center

Saunders, William M.

1999-01-01

Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)

Oasis Connections: Results from an Evaluation Study

ERIC Educational Resources Information Center

Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-01-01

Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

SPECS 2. Component Two: Program Budgeting and Cost Accounting.

ERIC Educational Resources Information Center

DuVall, Lloyd A.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. Component…

METRO Achievement Program: Summer 1988. External Evaluation Report.

ERIC Educational Resources Information Center

Thompson, Denise R.

This document comprises an evaluation of the 1988 METRO Achievement Program, a summer educational program to help develop the academic potential of primarily Black and Hispanic girls entering the seventh and eighth grades in Chicago. The 5-week program included the following components: (1) mathematics, science, and communication skills classes;…

Evaluation of a Group-Based Trauma Recovery Program in Gaza: Students' Subjective Experiences

ERIC Educational Resources Information Center

Barron, Ian; Abdullah, Ghassan

2012-01-01

Internationally, evaluation of group-based trauma recovery programs has relied upon normative outcome measures, with no studies systematically analyzing children's subjective experience for program development. In contrast, the current study explored children's experience of a Gazan recovery program "in their own words." Twenty-four…

ADDENDUM TO SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM TECHNOLOGY PROFILES, TENTH EDITION, VOLUME 1 - DEMONSTRATION PROGRAM

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program, now in its thirteenth year, is an integral part of EPA's research into alternative cleanup methods for hazardous waste sites around the nation. The SITE Program was created to encourage the development and routine us...

THE SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM: PROGRESS AND ACCOMPLISHMENTS - FISCAL YEAR 1990 A FOURTH REPORT TO CONGRESS

EPA Science Inventory

The SITE Program was the first major program for demonstrating and evaluating fullscale innovative treatment technologies at hazardous waste sites. Having concluded its fourth year, the SITE Program is recognized as a leading advocate of innovative technology development and comm...

Re-Employment Training: Evaluation of the Oakland University RECAP/JETS Program.

ERIC Educational Resources Information Center

Ramey, Luellen

This document provides a description and evaluation of the RECAP (Re-employment Career Planning)/JETS (Job, Education/Training, Selection) program, a cooperative re-employment training program for displaced automobile industry workers in Michigan. Following the brief introduction, program development and pre-training preparation are discussed,…

Development and Implementation of a Peer Mentoring Program for Early Career Gerontological Faculty

PubMed Central

Bryant, Ashley Leak; Brody, Ab; Perez, Adriana; Shillam, Casey; Edelman, Linda S.; Bond, Stewart M.; Foster, Victoria; Siegel, Elena

2016-01-01

Purpose In conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), the Hartford Gerontological Nursing Leaders (HGNL) developed and executed a program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of the HGNL. The purpose of this article is to describe key strategies used to develop and execute the mentoring program and to present the formative and summative program evaluation. Design The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. Findings An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Conclusions Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Clinical Relevance Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. PMID:25808927

The use of concept mapping for scale development and validation in evaluation.

PubMed

Rosas, Scott R; Camphausen, Lauren C

2007-05-01

Evaluators often make key decisions about what content to include when designing new scales. However, without clear conceptual grounding, there is a risk these decisions may compromise the scale's validity. Techniques such as concept mapping are available to evaluators for the specification of conceptual frameworks, but have not been used as a fully integrated part of scale development. As part of a multi-site evaluation of family support programs, we integrated concept mapping with traditional scale-development processes to strengthen the creation of a scale for inclusion in an evaluation instrument. Using concept mapping, we engaged staff and managers in the development of a framework of intended benefits of program participation and used the information to systematically select the scale's content. The psychometric characteristics of the scale were then formally assessed using a sample of program participants. The implications of the approach for supporting construct validity, inclusion of staff and managers, and theory-driven evaluation are discussed.

Advancing Evaluation of Character Building Programs

ERIC Educational Resources Information Center

Urban, Jennifer Brown; Trochim, William M.

2017-01-01

This article presents how character development practitioners, researchers, and funders might think about evaluation, how evaluation fits into their work, and what needs to happen in order to sustain evaluative practices. A broader view of evaluation is presented whereby evaluation is not just seen as something that is applied at a program level,…

Pierce County Indian Education Program, Educational Service District #121, Tacoma, Washington. 1976-77 Final Evaluation Report.

ERIC Educational Resources Information Center

Nelson, Steve; Clark, Robey

Comparing program objectives with program outcomes, 4 program components targeted at 1,100 American Indian students in 9 school districts in Pierce County, Washington were evaluated. Program objectives operationalized by an 11-member staff including 9 specialists and 1 coordinator were to develop: (1) basic skills via tutoring services for…

A Faculty Development Program for Nurse Educators Learning to Teach Online

ERIC Educational Resources Information Center

Lee, Debra; Paulus, Trena M.; Loboda, Iryna; Phipps, Gina; Wyatt, Tami H.; Myers, Carole R.; Mixer, Sandra J.

2010-01-01

As the College of Nursing at the University of Tennessee, Knoxville prepared to move their graduate programs online, a nursing faculty grass-roots movement led to the implementation of a faculty development program. This instructional design portfolio describes the design, development, implementation, and evaluation of this program, with the goal…

The University of North Carolina Medical Center pharmacy resident leadership certificate program.

PubMed

Lyons, Kayley; Griggs, Danielle; Lebovic, Rachel; Roth, Mary E; South, David A; Hatfield, Chad

2017-03-15

The development and implementation of a certificate program for pharmacy residents are described. University of North Carolina (UNC) Medical Center met the call for increased efforts in the area of pharmacy residency leadership training through the design, implementation, and evaluation of a leadership certificate program. The purpose of the UNC certificate program is to develop leaders who will serve others, improve their communities, and advance the profession. The program is designed to (1) foster self-awareness, social awareness, and altruism, (2) provide transferable and individualized leadership experiences, (3) enrich other residency components through integration of leadership development opportunities, and (4) create role models for departmental leadership. A team of preceptors and residents implemented the certificate program by integrating program components into the existing pharmacy residency infrastructure. The certificate program includes required and flexible components to allow residents to set and achieve their determined leadership development goals. Overall, residents are satisfied with the program and perceive it as worthwhile. During the first 3 years since implementation of the certification initiative, program facilitators improved the feasibility of, participant engagement in, and sustainability of the program. Future directions include an effectiveness evaluation and a "scale-up" to other institutions. The need for a pharmacy residency leadership certificate was met by designing, implementing, and evaluating such a program at UNC. Through its first 3 years, the program was feasible, sustainable, and valued by program participants. Copyright © 2017 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

Santa Fe Community College Staff Development Programs, Policies and Procedures.

ERIC Educational Resources Information Center

Santa Fe Community Coll., NM.

This collection of materials describes various aspects of Santa Fe Community College's (SFCC's) faculty and staff development program. Part 1 explains the philosophy that underpins staff development at SFCC; the planning, programming, information dissemination, and evaluation phases of staff development; and the use of professional development…

Assessment of village health worker training program in Tuguegarao, Philippine.

PubMed

Kim, Jung Min; Koh, Kwang Wook; Oak, Chul Ho; Jung, Woo Hyuk; Kim, Sung Hyun; Park, Dae Hee

2009-11-01

This study was performed to evaluate the effectiveness of 'village health worker training program' which aimed to build community participatory health promotion capacity of community leaders in villages of low developed country and to develop methods for further development of the program. The intervention group were 134 community leaders from 25 barangays (village). Control group were 149 form 4 barangays. Intervention group participated 3-day training program. Questionnaire was developed based on 'Health Promotion Capacity Checklist' which assessed capacity in 4 feathers; 'knowledge', 'skill', 'commitment', and 'resource'. Each feather was assessed in 4 point rating scale. Capacity scores between intervention group and control group were examined to identify changes between the pre- and post-intervention periods. A qualitative evaluation of the program was conducted to assess the appropriateness of the program. The program was conducted in Tuguegarao city, Philippine in January, 2009. The result showed significant increases in the total health promotion capacity and each feather of health promotion capacities between pre and post assessment of intervention group. But there was no significant change in that of control group. Participants marked high level of satisfaction for preparedness, selection of main subjects and education method. Qualitative evaluation revealed that training program facilitated community participatory health promotion capacity of participants. This study suggested that the Village health worker training program is effective for building health promotion capacity of community leaders and it can be a main method for helping low developed countries with further development.

A leadership development program for surgeons: First-year participant evaluation.

PubMed

Pradarelli, Jason C; Jaffe, Gregory A; Lemak, Christy Harris; Mulholland, Michael W; Dimick, Justin B

2016-08-01

In a dynamic health care system, strong leadership has never been more important for surgeons. Little is known about how to design and conduct effectively a leadership program specifically for surgeons. We sought to evaluate critically a Leadership Development Program for practicing surgeons by exploring how the program's strengths and weaknesses affected the surgeons' development as physician-leaders. At a large academic institution, we conducted semistructured interviews with 21 surgical faculty members who applied voluntarily, were selected, and completed a newly created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons' evaluations of the program on their development as physician-leaders. After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and knowledge in business and leadership. Surgeons felt "more confident about stepping up as a leader" and more aware of "how others view me and my interactions." They described a stronger grasp on "giving feedback" as well as a better understanding of "business/organizational issues." Overall, surgeon-participants reported positive impacts of the program on their day-to-day work activities and general career perspective as well as on their long-term career development plans. Surgeons also recommended areas where the program could potentially be improved. These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to equip surgeons better for important leadership roles in a complex health care environment. Copyright © 2016 Elsevier Inc. All rights reserved.

A Leadership Development Program for Surgeons: First-Year Participant Evaluation

PubMed Central

Pradarelli, Jason C.; Jaffe, Gregory A.; Lemak, Christy Harris; Mulholland, Michael W.; Dimick, Justin B.

2016-01-01

Structured Abstract Background In a dynamic healthcare system, strong leadership has never been more important for surgeons. Little is known about how to effectively design and conduct a leadership program specifically for surgeons. We sought to critically evaluate a Leadership Development Program for practicing surgeons by exploring the strengths and weaknesses of program components on surgeons’ development as physician-leaders. Methods At a large academic institution, we conducted semi-structured interviews with 21 surgical faculty members who voluntarily applied, were selected, and completed a newly-created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons’ evaluations of the program on their development as physician-leaders. Results After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and business and leadership knowledge. Surgeons felt “more confident about stepping up as a leader” and more aware about “how others view me and my interactions.” They described a stronger grasp on “giving feedback” as well as “business/organizational issues.” Overall, surgeon participants reported positive impacts of the program on their day-to-day work activities, general career perspective, as well as their long-term career development plans. Surgeons also recommended areas for potential improvement for the program. Conclusions These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to better equip surgeons for important leadership roles in a complex healthcare environment. PMID:27138180

Safe Patient Handling and Mobility: Development and Implementation of a Large-Scale Education Program.

PubMed

Lee, Corinne; Knight, Suzanne W; Smith, Sharon L; Nagle, Dorothy J; DeVries, Lori

This article addresses the development, implementation, and evaluation of an education program for safe patient handling and mobility at a large academic medical center. The ultimate goal of the program was to increase safety during patient mobility/transfer and reduce nursing staff injury from lifting/pulling. This comprehensive program was designed on the basis of the principles of prework, application, and support at the point of care. A combination of online learning, demonstration, skill evaluation, and coaching at the point of care was used to achieve the goal. Specific roles and responsibilities were developed to facilitate implementation. It took 17 master trainers, 88 certified trainers, 176 unit-based trainers, and 98 coaches to put 3706 nurses and nursing assistants through the program. Evaluations indicated both an increase in knowledge about safe patient handling and an increased ability to safely mobilize patients. The challenge now is sustainability of safe patient-handling practices and the growth and development of trainers and coaches.

Conceptualizing Youth Empowerment within Tobacco Control

ERIC Educational Resources Information Center

Holden, Debra J.; Messeri, Peter; Evans, W. Douglas; Crankshaw, Erik; Ben-Davies, Maureen

2004-01-01

This article presents a conceptual framework that was developed to guide a national evaluation of the American Legacy Foundation's (Legacy) Statewide Youth Movement Against Tobacco Use (SYMATU) program. This program was designed to develop youth-led, youth-directed initiatives within local communities. Two evaluation studies were designed and…

Resource Sharing and Public Education. Project Evaluation Report.

ERIC Educational Resources Information Center

Leton, Donald A.

Two exemplary projects developed to maximize student options through the sharing of facilities, programs, and options were evaluated. The Remedial-Developmental Program developed a communications network between McKinley and Roosevelt High Schools and Kapiolani Community College to share student information and use it for individual student…

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM ANNUAL REPORT TO CONGRESS FY2000

EPA Science Inventory

The Superfund Innovative Technology Evaluation Program promotes the development, commercialization, and implementation of innovative hazardous waste treatment technologies. SITE offers a mechanism for conducting joint demonstration and evaluation projects at hazardous waste site...

Evaluation through research of a three-track career ladder program for registered nurses.

PubMed

Korman, Carol; Eliades, Aris Beoglos

2010-01-01

A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.

In-Service Training and Development Programs for Accountants in Business and Industry.

ERIC Educational Resources Information Center

Adams, Hobart Warren

A survey was made of inservice training and development for accountants in 53 selected business firms varying in products, sales volume, and employees. Program philosophy and objectives, qualifications and selection of trainees and instructors, program content, instructional programs, and evaluation procedures were examined. Inservice programs,…

Developing, implementing, and evaluating a condom promotion program targeting sexually active adolescents.

PubMed

Alstead, M; Campsmith, M; Halley, C S; Hartfield, K; Goldbaum, G; Wood, R W

1999-12-01

This article describes the development, implementation, and evaluation of the Condom Campaign, a 1995 HIV prevention program promoting condom use among sexually active adolescents in three King County, Washington, urban communities. This program employed three main strategies: (a) mobilizing all levels of the target communities to support and guide program development and implementation; (b) creating and implementing a mass media campaign targeting sexually active teenagers that promoted correct condom use and favorable attitudes toward condoms; and (c) recruiting public agencies, community organizations, and businesses to distribute condoms from bins and vending machines. We evaluated the program through a series of cross-sectional interviews conducted in the three communities chosen for their elevated levels of adolescent sexual risk behavior. Overall, 73% of target youth reported exposure to the Condom Campaign; exposure did not differ by age, gender, race, or level of sexual experience. Levels of sexual activity remained stable throughout the media campaign.

Evaluation of the New Mexico ignition interlock program.

DOT National Transportation Integrated Search

2010-11-01

This Evaluation of the New Mexico Ignition Interlock Program begins by summarizing the development of : alcohol ignition interlock devices, laws, and programs during the past 22 years. It then reviews the laws that : were written in New Mexico from 1...

Library staff development course.

PubMed Central

Eaton, E K

1981-01-01

The Moody Medical Library at the University of Texas Medical Branch plans, presents, and evaluates regularly a staff development program for its employees, including librarians and clerical and technical staff. The program's purpose is to provide continuing education for the library staff while concurrently: (1) providing information concerning specific library services and programs; (2) illustrating the interrelationship of the departments and divisions within the library; (3) developing a sense of teamwork and loyalty; and (4) developing job pride. Staff member volunteers teach the various courses. An integral part of the program is an evaluation of the efficacy of its various components using a form developed specifically for this purpose. Participants give the majority of courses an effectiveness rating of 90% or above. PMID:7248595

Development of an Experiment High Performance Nozzle Research Program

NASA Technical Reports Server (NTRS)

2004-01-01

As proposed in the above OAI/NASA Glenn Research Center (GRC) Co-Operative Agreement the objective of the work was to provide consultation and assistance to the NASA GRC GTX Rocket Based Combined Cycle (RBCC) Program Team in planning and developing requirements, scale model concepts, and plans for an experimental nozzle research program. The GTX was one of the launch vehicle concepts being studied as a possible future replacement for the aging NASA Space Shuttle, and was one RBCC element in the ongoing NASA Access to Space R&D Program (Reference 1). The ultimate program objective was the development of an appropriate experimental research program to evaluate and validate proposed nozzle concepts, and thereby result in the optimization of a high performance nozzle for the GTX launch vehicle. Included in this task were the identification of appropriate existing test facilities, development of requirements for new non-existent test rigs and fixtures, develop scale nozzle model concepts, and propose corresponding test plans. Also included were the evaluation of originally proposed and alternate nozzle designs (in-house and contractor), evaluation of Computational Fluid Dynamics (CFD) study results, and make recommendations for geometric changes to result in improved nozzle thrust coefficient performance (Cfg).

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

PubMed

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were summarized using descriptive statistics. An inductive approach was used to identify themes in the qualitative data related to the evaluation questions. The findings demonstrated the program was implemented as intended, and that there was a need for the program, with six clients on the 10-month pilot. The findings also indicated achievement of program-level outcomes and progress toward system-level outcomes. Clients/families and healthcare providers were satisfied with the program and perceived it to be meeting its objectives. The program model was also perceived to be transferrable to other First Nations communities. The results demonstrate how a rural First Nations community can build capacity and develop a palliative care program tailored to their unique culture and context that builds upon and is integrated into existing services. The Wiisokotaatiwin Program allowed community members to receive their palliative care at home, improved client experience and enhanced service integration. This article provides a First Nations specific model for a palliative care program that overcomes jurisdictional issues at the local level, and a methodology for developing and evaluating community-based palliative care programs in rural First Nations communities. The article demonstrates how local, federal and provincial healthcare providers and organizations collaborated to build capacity, fund and deliver community-based palliative care. The described process of developing the program has applicability in other First Nations (Indigenous) communities and for healthcare decisionmakers.

Faculty Development at One Midwestern Dental School: A Program Evaluation.

PubMed

Gadbury-Amyot, Cynthia C; Smith, Deborah B; Overman, Pamela R; Bunce, Larry

2015-10-01

Most dental school faculty members arrive on campus with a wealth of clinical experience but little to no teacher training. For the past two decades, there has been a call for schools to educate their faculty on a wide variety of topics including educational methodology and cutting-edge educational techniques through faculty development programs. Drawing on theories of general program evaluation as well as evaluation specific to educational programming, the aim of this study was to investigate outcomes of the Faculty Development Program at the University of Missouri-Kansas City School of Dentistry between 2007 and 2014. A mixed-methods research design gathered quantitative data via email survey sent to all eligible teaching faculty members; it received an overall response rate of 54% (N=51). Qualitative data came from open-ended survey questions and a focus group with seven volunteer faculty participants. The survey data suggested that the stated outcomes of faculty development were being met for all stakeholder groups with varying degrees of success. Focus group results indicated a need for a more formal new faculty orientation and better communication with all about the specific charge of faculty development within the school. Evaluation of faculty development activities in academic dental institutions is a necessary component of the ongoing improvement of dental education. Suggestions for future evaluations include the idea of collaborating with other dental schools to increase sample sizes, which would increase participants' perception of the level of confidentiality and make statistical analyses more robust.

The Critical Role of a Well-Articulated, Coherent Design in Professional Development: An Evaluation of a State-Wide Two-Week Program for Mathematics and Science Teachers

ERIC Educational Resources Information Center

Saderholm, Jon; Ronau, Robert N.; Rakes, Christopher R.; Bush, Sarah B.; Mohr-Schroeder, Margaret

2017-01-01

This evaluation study examined a state-wide professional development program composed of two institutes, one for mathematics teachers and one for science teachers, each spanning two weeks. The program was designed to help teachers transform their practice to align with Common Core State Standards for Mathematics and Next Generation Science…

[Development of a program theory as a basis for the evaluation of a dementia special care unit].

PubMed

Adlbrecht, Laura; Bartholomeyczik, Sabine; Mayer, Hanna

2018-06-01

Background: An existing dementia special care unit should be evaluated. In order to build a sound foundation of the evaluation a deep theoretical understanding of the implemented intervention is needed, which has not been explicated yet. One possibility to achieve this is the development of a program theory. Aim: The aim is to present a method to develop a program theory for the existing living and care concept of the dementia special care unit, which is used in a larger project to evaluate the concept theory-drivenly. Method: The evaluation is embedded in the framework of van Belle et al. (2010) and an action model and a change model (Chen, 2015) is created. For the specification of the change model the contribution analysis (Mayne, 2011) is applied. Data were collected in workshops with the developers and the nurses of the dementia special care unit and a literature research concerning interventions and outcomes was carried out. The results were synthesized in a consens workshop. Results: The action model describes the interventions of the dementia special care unit, the implementers, the organization and the context. The change model compromises the mechanisms through which interventions achieve outcomes. Conclusions: The results of the program theory can be employed to choose data collection methods and instruments for the evaluation. On the basis of the results of the evaluation the program theory can be refined and adapted.

Regional Interstate Planning Project Program . . . Vol. IX. California Program Evaluation Improvement Project. Seminar Report.

ERIC Educational Resources Information Center

Dearmin, Evalyn, Ed.; And Others

Program evaluation strategies and techniques based on materials developed by the California Evaluation Improvement Project were discussed at this meeting of the Regional Interstate Planning Project (RIPP). RIPP members represent the State Departments of Education of ten western states, and have met periodically over the past nine years to discuss…

Developing and Using a Logic Model for Evaluation and Assessment of University Student Affairs Programming: A Case Study

ERIC Educational Resources Information Center

Cooper, Jeff

2009-01-01

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

Programmed Instruction Manual for a New Solar and Energy Conservation Laboratory. Final Evaluation Report.

ERIC Educational Resources Information Center

State Univ. of New York, Farmingdale. Agricultural and Technical Coll.

A programmed instruction course was developed, consisting of fifteen experiments encompassing eleven separate pieces of equipment operational in a solar and energy conservation lab. The programmed instruction manual for the lab was evaluated and revised during a workshop. This evaluation indicated that both the lab and manual are valuable tools…

"I Am Not a Big Man": Evaluation of the Issue Investigation Program

ERIC Educational Resources Information Center

Cincera, Jan; Simonova, Petra

2017-01-01

The article evaluates a Czech environmental education program focused on developing competence in issue investigation. In the evaluation, a simple quasi-experimental design with experimental (N = 200) and control groups was used. The results suggest that the program had a greater impact on girls than on boys, and that it increased their internal…

Pedagogical Ethical Dilemmas in a Responsive Evaluation of a Leadership Program for Youth

ERIC Educational Resources Information Center

Freeman, Melissa; Preissle, Judith

2010-01-01

How do responsive evaluators provide input to program planners when competing ethical principles point to different choices of effective feedback? A team of three evaluators used participant observation, individual and focus group interviews, and analysis of documents to provide input on the development and outcome of a summer program for high…

A computer program incorporating fatigue and fracture criteria in the preliminary design of transport aircraft: An evaluation

NASA Technical Reports Server (NTRS)

Berger, P. E.; Thornton, E. A.

1976-01-01

The APAS program a multistation structural synthesis procedure developed to evaluate material, geometry, and configuration with various design criteria usually considered for the primary structure of transport aircraft is described and evaluated. Recommendations to improve accuracy and extend the capabilities of the APAS program are given. Flow diagrams are included.

A Mixed Methods Approach to Understanding School Counseling Program Evaluation: High School Counselors' Methods and Perceptions

ERIC Educational Resources Information Center

Aucoin, Jennifer Mangrum

2013-01-01

The purpose of this mixed methods concurrent triangulation study was to examine the program evaluation practices of high school counselors. A total of 294 high school counselors in Texas were assessed using a mixed methods concurrent triangulation design. A researcher-developed survey, the School Counseling Program Evaluation Questionnaire…

Building an Evaluation Framework for a Competency-Based Graduate Program at the University Of Southern Mississippi

ERIC Educational Resources Information Center

Gaudet, Cyndi H.; Annulis, Heather M.; Kmiec, John J., Jr.

2008-01-01

This article describes an ongoing project to build a comprehensive evaluation framework for the competency-based Master of Science in Workforce Training and Development (MSWTD) program at The University of Southern Mississippi (USM). First, it discusses some trends and issues in evaluating the performance of higher education programs in the United…

Evaluation of the Leadership Institute: A Program to Build Individual and Organizational Capacity through Emotional Intelligence

ERIC Educational Resources Information Center

Chen, Claire Yueh-Ti; King, Jeff; Cochran, Graham R.; Argabright, Karen J.

2014-01-01

The purpose of the study reported here was to evaluate the impact of Leadership Institute, a program designed to strengthen leadership capacity through developing individuals' emotional intelligence (EQ). A pre-and posttest approach was used to collect data from two workshops with identical EQ content, program structure, and evaluation.…

Evaluation of solar cells and arrays for potential solar power satellite applications

NASA Technical Reports Server (NTRS)

Almgren, D. W.; Csigi, K.; Gaudet, A. D.

1978-01-01

Proposed solar array designs and manufacturing methods are evaluated to identify options which show the greatest promise of leading up to the develpment of a cost-effective SPS solar cell array design. The key program elements which have to be accomplished as part of an SPS solar cell array development program are defined. The issues focussed on are: (1) definition of one or more designs of a candidate SPS solar array module, using results from current system studies; (2) development of the necessary manufacturing requirements for the candidate SPS solar cell arrays and an assessment of the market size, timing, and industry infrastructure needed to produce the arrays for the SPS program; (3) evaluation of current DOE, NASA and DOD photovoltaic programs to determine the impacts of recent advances in solar cell materials, array designs and manufacturing technology on the candidate SPS solar cell arrays; and (4) definition of key program elements for the development of the most promising solar cell arrays for the SPS program.

The Charlotte-Mecklenburg Teacher Career Development Program.

ERIC Educational Resources Information Center

Schlechty, Phillip C.; And Others

1985-01-01

Effective training, evaluation, and incentives are key aspects of this school system's six-level career ladder program for teacher development. The three-pronged committee structure for planning and communication and the program's ownership by everyone involved have been vital to its successful planning and development. (DCS)

Urban Rail Supporting Technology Program Fiscal Year 1975 - Year End Summary

DOT National Transportation Integrated Search

1975-12-01

The Urban Rail Supporting Technology Program is described for the 1975 fiscal year period. Important areas include program management, technical support and applications engineering, facilities development, test and evaluation, and technology develop...

Curated Collections for Educators: Five Key Papers about Program Evaluation.

PubMed

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Curated Collections for Educators: Five Key Papers about Program Evaluation

PubMed Central

Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-01-01

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

An Evaluation of Project Gifted 1971-1972.

ERIC Educational Resources Information Center

Renzulli, Joseph S.

Evaluated was Project Gifted, a tri-city (Cranston, East Providence, and Warwick, Rhode Island) program which focused on the training of gifted children in grades 4-6 in the creative thinking process. Project goals were identification of gifted students, development of differential experiences, and development of innovative programs. Cranston's…

Computer software management, evaluation, and dissemination

NASA Technical Reports Server (NTRS)

1983-01-01

The activities of the Computer Software Management and Information Center involving the collection, processing, and distribution of software developed under the auspices of NASA and certain other federal agencies are reported. Program checkout and evaluation, inventory control, customer services and marketing, dissemination, program maintenance, and special development tasks are discussed.

Standardized Evaluation for Multi-National Development Programs.

ERIC Educational Resources Information Center

Farrell, W. Timothy

This paper takes the position that standardized evaluation formats and procedures for multi-national development programs are not only desirable but possible in diverse settings. The key is the localization of standard systems, which involves not only the technical manipulation of items and scales, but also the contextual interpretation of…

The Development and Validation of the Inquiry Science Observation Coding Sheet

ERIC Educational Resources Information Center

Brandon, P. R.; Taum, A. K. H.; Young, D. B.; Pottenger, F. M., III

2008-01-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this…

Analysis, modeling, and simulation (AMS) testbed development and evaluation to support dynamic mobility applications (DMA) and active transportation and demand management (ATDM) programs — evaluation report for ATDM program. [supporting datasets - Pasadena Testbed

DOT National Transportation Integrated Search

2017-07-26

This zip file contains POSTDATA.ATT (.ATT); Print to File (.PRN); Portable Document Format (.PDF); and document (.DOCX) files of data to support FHWA-JPO-16-385, Analysis, modeling, and simulation (AMS) testbed development and evaluation to support d...

Analysis, Modeling, and Simulation (AMS) Testbed Development and Evaluation to Support Dynamic Mobility Applications (DMA) and Active Transportation and Demand Management (ATDM) Programs : Evaluation Report for the San Diego Testbed : Draft Report. [supporting datasets - San Diego

DOT National Transportation Integrated Search

2016-06-26

The datasets in this zip file are in support of Intelligent Transportation Systems Joint Program Office (ITS JPO) report FHWA-JPO-16-385, "Analysis, Modeling, and Simulation (AMS) Testbed Development and Evaluation to Support Dynamic Mobility Applica...

Evaluation of a Web-Based Professional Development Program (Project ACE) for Teachers of Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Rakap, Salih; Jones, Hazel A.; Emery, Alice Kaye

2015-01-01

This article describes the development, implementation, and second-year evaluation of Project Autism Competencies for Endorsement (ACE), a web-based professional development (PD) program that is designed to train teachers currently working in the field to meet the unique and diverse needs of children with autism spectrum disorders (ASDs). A…

Assessing Change in the Teaching Practice of Faculty in a Faculty Development Program for Primary Care Physicians: Toward a Mixed Method Evaluation Approach.

ERIC Educational Resources Information Center

Pinheiro, Sandro O.; Rohrer, Jonathan D.; Heimann, C. F. Larry

This paper describes a mixed method evaluation study that was developed to assess faculty teaching behavior change in a faculty development fellowship program for community-based hospital faculty. Principles of adult learning were taught to faculty participants over the fellowship period. These included instruction in teaching methods, group…

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

Evaluating the BK 21 Program. Research Brief

ERIC Educational Resources Information Center

Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.

2008-01-01

The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…

Toward More Precise Definition and Evaluation of Televised Educational Programming

ERIC Educational Resources Information Center

Aversa Fran; Morrison, Gary R.

1978-01-01

An operational definition of public television programming and its implications for development and production agencies is sorely needed. This article explores some of the components of such a definition and examines the differences in several types of educational programming in terms of specific design and evaluation variables of the program.…

Early Childhood Development through an Integrated Program: Evidence from the Philippines. Impact Evaluation Series No. 2. World Bank Policy Research Working Paper 3922-IE

ERIC Educational Resources Information Center

Armecin, Graeme; Behrman, Jere R.; Ghuman, Sharon; Gultiano, Socorro; King, Elizabeth M.; Lee, Nanette

2006-01-01

More attention and resources have been devoted in recent years to early childhood development (ECD) in low- and middle-income countries. Rigorous studies on the effectiveness of ECD-related programs for improving children's development in various dimensions in the developing world are scant. The authors evaluate an important ECD initiative of the…

Development and feasibility of an evidence-informed self-management education program in pediatric concussion rehabilitation.

PubMed

Hunt, Anne W; De Feo, Luciano; Macintyre, Jennifer; Greenspoon, Dayna; Dick, Talia; Mah, Katherine; Paniccia, Melissa; Provvidenza, Christine; Reed, Nick

2016-08-17

Concussion is a considerable public health problem in youth. However, identifying, understanding and implementing best evidence informed recovery guidelines may be challenging for families given the vast amount of information available in the public domains (e.g. Internet). The objective of this study was to develop, implement and evaluate the feasibility of an evidence-informed self-management education program for concussion recovery in youth. Synthesis of best evidence, principles of knowledge translation and exchange, and expert opinion were integrated within a self-management program framework to develop a comprehensive curriculum. The program was implemented and evaluated in a children's rehabilitation hospital within a universal health care system. A retrospective secondary analysis of anonymous data from a program evaluation survey was used to evaluate program feasibility, to identify features of importance to program participants and to assess changes in participants' knowledge. The program, "Concussion & You" includes a comprehensive, evidence informed, population specific curriculum that teaches participants practical strategies for management of return to school and play, sleep, nutrition, relaxation and energy conservation. A 'wheel of health' is used to facilitate participants' self-management action plan. Results from eighty-seven participant surveys indicate that the program is feasible and participant knowledge increased in all areas of the program with the highest changes reported in knowledge about sleep hygiene, rest and energy conservation. Findings indicate that "Concussion & You" is a feasible program that is acceptable to youth and their families, and fills a health system service gap.

A case study of the Physics Enhancement Project for Two Year Colleges, its effects and outcomes on the teaching of undergraduate physics at two year colleges

NASA Astrophysics Data System (ADS)

Leif, Todd Robert

This dissertation reports on a naturalistic evaluation study of a series of NSF grant projects collectively known as PEPTYC -- Physics Enhancement Project for Two Year College Physics Instructors. The project encompassed seven different cycles of professional development occurring during the 1990's via May Institutes, held at Texas A&M University. Follow-up meetings were held at American Association of Physics Teachers - Texas Section Meetings. The research was conducted post hoc. The research evaluated the characteristics of effective professional development under an evaluation frame work designed by D.L. Kirkpatrick (1959) and adapted by the researcher to address issues that are pertinent to the professional development of faculty. This framework was adapted to be viewed through an educator's eye in an effort to ascertain the long term affects of the program and determine how the program affected the participants' attitudes, pedagogical knowledge, and instructional practices. The PEPTYC program philosophy was based on the premise, supported by research, that professional development programs addressing specific teaching practices are more successful than generic programs. Furthermore, professional development is more effective in helping teachers use alternative approaches when teachers are engaged in active learning experiences rather than passively listening to lectures or presentations. The naturalistic study was based on surveys and semi-structured interviews with 14 individuals who participated in PEPTYC workshops, as well as presenters of the PEPTYC program. The interviews were analyzed to describe how the PEPTYC project influenced the participants long after they had completed their training. This project can inform the development of similar evaluation studies of other professional development programs.

Evaluation of the Meaning of Life Program in Israel

ERIC Educational Resources Information Center

Kasler, Jonathan; White, Gwyne W.; Elias, Maurice J.

2013-01-01

During the 2009-2010 academic year, 10 schools participated in the Meaning of Life educational program, an adaption of the popular U.S. Laws of Life program. The program sought to encourage each participant to develop a personal approach to finding meaning in life. To evaluate the success of the program, we conducted a study to compare measures of…

Guide Lines for Evaluation of Continuing Education Programs in Mental Health.

ERIC Educational Resources Information Center

Miller, Norma; And Others

Suggestions for program administrators and training program directors to develop comprehensive plans based on principles of community involvement, education, administration and finance, and the disciplines being taught are broadly outlined. Three accompanying charts illustrate approach to evaluation planning. (NF)

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2014 CFR

2014-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2012 CFR

2012-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2013 CFR

2013-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2011 CFR

2011-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

Roadmap for creating an accelerated three-year medical education program

PubMed Central

Leong, Shou Ling; Cangiarella, Joan; Fancher, Tonya; Dodson, Lisa; Grochowski, Colleen; Harnik, Vicky; Hustedde, Carol; Jones, Betsy; Kelly, Christina; Macerollo, Allison; Reboli, Annette C.; Rosenfeld, Melvin; Rundell, Kristen; Thompson, Tina; Whyte, Robert; Pusic, Martin

2017-01-01

ABSTRACT Medical education is undergoing significant transformation. Many medical schools are moving away from the concept of seat time to competency-based education and introducing flexibility in the curriculum that allows individualization. In response to rising student debt and the anticipated physician shortage, 35% of US medical schools are considering the development of accelerated pathways. The roadmap described in this paper is grounded in the experiences of the Consortium of Accelerated Medical Pathway Programs (CAMPP) members in the development, implementation, and evaluation of one type of accelerated pathway: the three-year MD program. Strategies include developing a mission that guides curricular development – meeting regulatory requirements, attaining institutional buy-in and resources necessary to support the programs, including student assessment and mentoring – and program evaluation. Accelerated programs offer opportunities to innovate and integrate a mission benefitting students and the public. Abbreviations: CAMPP: Consortium of accelerated medical pathway programs; GME: Graduate medical education; LCME: Liaison committee on medical education; NRMP: National residency matching program; UME: Undergraduate medical education PMID:29117817

Program theory-driven evaluation science in a youth development context.

PubMed

Deane, Kelsey L; Harré, Niki

2014-08-01

Program theory-driven evaluation science (PTDES) provides a useful framework for uncovering the mechanisms responsible for positive change resulting from participation in youth development (YD) programs. Yet it is difficult to find examples of PTDES that capture the complexity of such experiences. This article offers a much-needed example of PTDES applied to Project K, a youth development program with adventure, service-learning and mentoring components. Findings from eight program staff focus groups, 351 youth participants' comments, four key program documents, and results from six previous Project K research projects were integrated to produce a theory of change for the program. A direct logic analysis was then conducted to assess the plausibility of the proposed theory against relevant research literature. This demonstrated that Project K incorporates many of the best practice principles discussed in the literature that covers the three components of the program. The contributions of this theory-building process to organizational learning and development are discussed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Roadmap for creating an accelerated three-year medical education program.

PubMed

Leong, Shou Ling; Cangiarella, Joan; Fancher, Tonya; Dodson, Lisa; Grochowski, Colleen; Harnik, Vicky; Hustedde, Carol; Jones, Betsy; Kelly, Christina; Macerollo, Allison; Reboli, Annette C; Rosenfeld, Melvin; Rundell, Kristen; Thompson, Tina; Whyte, Robert; Pusic, Martin

2017-01-01

Medical education is undergoing significant transformation. Many medical schools are moving away from the concept of seat time to competency-based education and introducing flexibility in the curriculum that allows individualization. In response to rising student debt and the anticipated physician shortage, 35% of US medical schools are considering the development of accelerated pathways. The roadmap described in this paper is grounded in the experiences of the Consortium of Accelerated Medical Pathway Programs (CAMPP) members in the development, implementation, and evaluation of one type of accelerated pathway: the three-year MD program. Strategies include developing a mission that guides curricular development - meeting regulatory requirements, attaining institutional buy-in and resources necessary to support the programs, including student assessment and mentoring - and program evaluation. Accelerated programs offer opportunities to innovate and integrate a mission benefitting students and the public. CAMPP: Consortium of accelerated medical pathway programs; GME: Graduate medical education; LCME: Liaison committee on medical education; NRMP: National residency matching program; UME: Undergraduate medical education.

The Evolution of Cartography Graduate Programs and the Development of New Graduate Programs in Cartography: An Assessment of Models.

ERIC Educational Resources Information Center

Steinke, Theodore R.

This paper traces the historical development of cartography graduate programs, establishes an evolutionary model, and evaluates the model to determine if it has some utility today for the development of programs capable of producing highly skilled cartographers. Cartography is defined to include traditional cartography, computer cartography,…

The Development of a Comprehensive Student Basic Skills Assessment Program at St. Louis Community College's Florissant Valley Campus.

ERIC Educational Resources Information Center

Webb, Mel

A comprehensive student basic skills assessment program was developed at St. Louis Community College (SLCC) at Florissant Valley to appraise student readiness to take courses, gather information for counseling and advising, diagnose student problems, and evaluate program efficiency and effectiveness. The steps taken in developing the program were:…

Training Evaluation as an Integral Component of Training for Performance.

ERIC Educational Resources Information Center

Lapp, H. J., Jr.

A training evaluation system should address four major areas: reaction, learning, behavior, and results. The training evaluation system at GPU Nuclear Corporation addresses each of these areas through practical approaches such as course and program evaluation. GPU's program evaluation instrument uses a Likert-type scale to assess task development,…

Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature

PubMed Central

Lauricella, Michela; Valdez, Jessica K.; Okamoto, Scott K.; Helm, Susana; Zaremba, Colleen

2016-01-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern U.S. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the “ground up.” This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs. PMID:26733384

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature.

PubMed

Lauricella, Michela; Valdez, Jessica K; Okamoto, Scott K; Helm, Susana; Zaremba, Colleen

2016-02-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican-American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern US. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the "ground up." This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs.

Children's Programs: A Comparative Evaluation Framework and Five Illustrations. Briefing Report to the Ranking Minority Member, Select Committee on Children, Youth, and Families, House of Representatives.

ERIC Educational Resources Information Center

General Accounting Office, Washington, DC. Program Evaluation and Methodology Div.

This general program evaluation framework provides a wide range of criteria that can be applied in the evaluation of diverse federal progams. The framework was developed from a literature search on program evaluation methods and their use, the experiences of the United States Government Accounting Office (GAO), and consideration of the types of…

Developing Mathematical Processes (DMP). Field Test Evaluation, 1973-1974.

ERIC Educational Resources Information Center

Schall, William; And Others

The Developing Mathematical Processes (DMP) program was field-tested in the kindergarten and first three grades of one parochial and five public schools. DMP is an activity-based program developed around a comprehensive list of behavioral objectives. The program is concerned with the development of intuitive geometric concepts as well as…

Air Force Phillips Laboratory Battery Program overview

NASA Technical Reports Server (NTRS)

House, Shaun

1992-01-01

Battery development and testing efforts at Phillips Laboratory fall into three main categories: nickel hydrogen, sodium sulfur, and solid state batteries. Nickel hydrogen work is broken down into a Low Earth Orbit (LEO) Life Test Program, a LEO Pulse Test Program, and a Hydrogen Embrittlement Investigation. Sodium sulfur work is broken down into a Geosynchronous Earth Orbit (GEO) Battery Flight Test and a Hot Launch Evaluation. Solid state polymer battery work consists of a GEO Battery Development Program, a Pulse Power Battery Small Business Innovation Research (SBIR), and an in-house evaluation of current generation laboratory cells. An overview of the program is presented.

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2014 CFR

2014-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2014-07-01 2013-07-01 true Procedures for IFSP development, review, and evaluation...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2013 CFR

2013-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2013-07-01 2013-07-01 false Procedures for IFSP development, review, and evaluation...

34 CFR 303.342 - Procedures for IFSP development, review, and evaluation.

Code of Federal Regulations, 2012 CFR

2012-07-01

... PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES Child Find, Evaluations and Assessments, and... development, review, and evaluation. (a) Meeting to develop initial IFSP—timelines. For a child referred to... 34 Education 2 2012-07-01 2012-07-01 false Procedures for IFSP development, review, and evaluation...

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

PubMed

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Historical context for the creation of the Office of Adolescent Health and the Teen Pregnancy Prevention Program.

PubMed

Kappeler, Evelyn M; Farb, Amy Feldman

2014-03-01

In Fiscal Year 2010, Federal funds were dedicated to support evidence-based approaches to effectively target teen pregnancy prevention and resulted in the establishment of the Office of Adolescent Health (OAH) and the Teen Pregnancy Prevention (TPP) Program. Through the tiered TPP Program, OAH supports replication and evaluation of programs using models whose effectiveness has been demonstrated through rigorous evaluation and the development and testing of promising or innovative pregnancy prevention strategies and approaches. This article documents the creation of OAH and the development of the TPP Program, the identification of a TPP evidence base, current program and evaluation efforts at OAH, and government coordination and partnerships related to reducing teen pregnancy. This article is of interest to those working to improve the health and wellbeing of adolescents. Published by Elsevier Inc.

The effectiveness of workshops on management evaluation of traffic safety programs.

DOT National Transportation Integrated Search

1977-01-01

Nine management evaluation workshops based on The Evaluation of Highway Traffic Safety Programs' A Manual for Managers were held in various cities throughout the United States by the Office of Manpower Development (NHTSA). The analysis reported here ...

15 CFR 2301.17 - Evaluation criteria for construction and planning applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... PUBLIC TELECOMMUNICATIONS FACILITIES PROGRAM Evaluation and Selection Process § 2301.17 Evaluation... significant diversity in the ownership of, operation of, and participation in public telecommunications... attitudes of diverse listeners by promoting the development of more effective programming strategies...

Evaluating Federal Education Programs.

ERIC Educational Resources Information Center

Baker, Eva L., Ed.

A series of papers was developed by the authors as part of their deliberations as members of the National Research Council's Committee of Program Evaluation in Education. The papers provide a broad range of present evaluative thinking. The conflict between preferences in evaluation methodology comes through in these papers. The selections include:…

Evaluating Community College Personnel: A Research Report.

ERIC Educational Resources Information Center

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

The Development of MUMPS-Based Rehabilitation Psychology Computer Applications.

ERIC Educational Resources Information Center

Dutro, Kenneth R.

The use of computer assisted programs in career exploration and occupational information is well documented. Various phases of the vocational counseling process, i.e., diagnostic evaluation, program planning, career exploration, case management, and program evaluation, offer similarly promising opportunities for computerization. Using the…

Evaluating International Research Ethics Capacity Development: An Empirical Approach

PubMed Central

Ali, Joseph; Kass, Nancy E.; Sewankambo, Nelson K.; White, Tara D.; Hyder, Adnan A.

2014-01-01

The US National Institutes of health, Fogarty International Center (NIH-FIC) has, for the past 13 years, been a leading funder of international research ethics education for resource-limited settings. Nearly half of the NIH-FIC funding in this area has gone to training programs that train individuals from sub-Saharan Africa. Identifying the impact of training investments, as well as the potential predictors of post-training success, can support curricular decision-making, help establish funding priorities, and recognize the ultimate outcomes of trainees and training programs. Comprehensive evaluation frameworks and targeted evaluation tools for bioethics training programs generally, and for international research ethics programs in particular, are largely absent from published literature. This paper shares an original conceptual framework, data collection tool, and detailed methods for evaluating the inputs, processes, outputs, and outcomes of research ethics training programs serving individuals in resource-limited settings. This paper is part of a collection of papers analyzing the Fogarty International Center’s International Research Ethics Education and Curriculum Development program. PMID:24782071

Implementing Impact Evaluations of Malaria Control Interventions: Process, Lessons Learned, and Recommendations

PubMed Central

Hershey, Christine L.; Bhattarai, Achuyt; Florey, Lia S.; McElroy, Peter D.; Nielsen, Carrie F.; Yé, Yazoume; Eckert, Erin; Franca-Koh, Ana Cláudia; Shargie, Estifanos; Komatsu, Ryuichi; Smithson, Paul; Thwing, Julie; Mihigo, Jules; Herrera, Samantha; Taylor, Cameron; Shah, Jui; Mouzin, Eric; Yoon, Steven S.; Salgado, S. René

2017-01-01

Abstract. As funding for malaria control increased considerably over the past 10 years resulting in the expanded coverage of malaria control interventions, so did the need to measure the impact of these investments on malaria morbidity and mortality. Members of the Roll Back Malaria (RBM) Partnership undertook impact evaluations of malaria control programs at a time when there was little guidance in terms of the process for conducting an impact evaluation of a national-level malaria control program. The President’s Malaria Initiative (PMI), as a member of the RBM Partnership, has provided financial and technical support for impact evaluations in 13 countries to date. On the basis of these experiences, PMI and its partners have developed a streamlined process for conducting the evaluations with a set of lessons learned and recommendations. Chief among these are: to ensure country ownership and involvement in the evaluations; to engage stakeholders throughout the process; to coordinate evaluations among interested partners to avoid duplication of efforts; to tailor the evaluation to the particular country context; to develop a standard methodology for the evaluations and a streamlined process for completion within a reasonable time; and to develop tailored dissemination products on the evaluation for a broad range of stakeholders. These key lessons learned and resulting recommendations will guide future impact evaluations of malaria control programs and other health programs. PMID:28990921

A standards-based formative evaluation of a national professional development program for science teachers

NASA Astrophysics Data System (ADS)

Raphael, Carol Greco

2002-09-01

The 1996 National Science Education Standards provided educators and policy makers with a major impetus for constructive change in science education. The Standards not only specified what science content should be taught, but also provided organization for future science curricula. A major theme that pervades the Standards is that the classroom teacher is the most important component of classroom change and that reform efforts should be directed at improving the teaching of science through professional development for science teachers. In response to the National Science Education Standards, the Science Teachers Organization (pseudonym) prepared a professional development program for science teachers that was intended to acquaint teachers with the Standards and bring about reform of science teaching by changing teachers' instructional strategies and procedures. This program, named Preparing Schools for Science (PSS), was designed for use in all of the 50 states, but was first introduced in a southwestern state referred to as Utopia in this dissertation. Using the Provus Method of Discrepancy Evaluation, a design and installation audit of the Preparing Schools for Science Program was performed. Suggestions for program improvement, as well as a complete evaluation design for the PSS Program, were presented. Specific program modifications suggested by the research included an improved organization of personnel to monitor and supervise the program, more sustained professional development workshops, a stronger network of support for teachers. Five major implications for future professional development programs emerge from this research. (1) A needs analysis should be conducted before a program is designed in order to ensure that the program meet the needs of those for whom it is intended. (2) The length and type of training are the most important factors in ensuring that teachers have sufficient time to incorporate and learn how to use new ideas. (3) Additional personnel are needed to conduct the training and follow-up with the Points of Contact (POCs) in the Program. (4) Financial support for the Key Leaders who serve as trainers of the points of contact is needed to provide the means for the key leaders to fully implement the program and maintain contact with the POCs. (5) The program should have a thorough and well-planned evaluation design, and data collection should be done in a timely fashion by a skilled evaluator.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

Fuel Cell Transit Bus Coordination and Evaluation Plan California Fuel Cell Transit Evaluation Team, DRAFT

DOT National Transportation Integrated Search

2003-10-29

The objective of the DOE/NREL evaluation program is to provide comprehensive, unbiased evaluation results of advanced technology vehicle development and operations, evaluation of hydrogen infrastructure development and operation, and descriptions of ...

Solar energy program evaluation: an introduction

DOE Office of Scientific and Technical Information (OSTI.GOV)

deLeon, P.

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the rolemore » and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)« less

Evaluation of a Sexual Assault Risk Reduction and Self-Defense Program: A Prospective Analysis of a Revised Protocol

ERIC Educational Resources Information Center

Orchowski, Lindsay M.; Gidycz, Christine A.; Raffle, Holly

2008-01-01

The current study extends the development and evaluation of an existing and previously evaluated sexual assault risk reduction program with a self-defense component for college women (N = 300). The program protocol was revised to address psychological barriers to responding assertively to risky dating situations, and a placebo-control group was…

Intervention mapping protocol for developing a theory-based diabetes self-management education program.

PubMed

Song, Misoon; Choi, Suyoung; Kim, Se-An; Seo, Kyoungsan; Lee, Soo Jin

2015-01-01

Development of behavior theory-based health promotion programs is encouraged with the paradigm shift from contents to behavior outcomes. This article describes the development process of the diabetes self-management program for older Koreans (DSME-OK) using intervention mapping (IM) protocol. The IM protocol includes needs assessment, defining goals and objectives, identifying theory and determinants, developing a matrix to form change objectives, selecting strategies and methods, structuring the program, and planning for evaluation and pilot testing. The DSME-OK adopted seven behavior objectives developed by the American Association of Diabetes Educators as behavioral outcomes. The program applied an information-motivation-behavioral skills model, and interventions were targeted to 3 determinants to change health behaviors. Specific methods were selected to achieve each objective guided by IM protocol. As the final step, program evaluation was planned including a pilot test. The DSME-OK was structured as the 3 determinants of the IMB model were intervened to achieve behavior objectives in each session. The program has 12 weekly 90-min sessions tailored for older adults. Using the IM protocol in developing a theory-based self-management program was beneficial in terms of providing a systematic guide to developing theory-based and behavior outcome-focused health education programs.

Technology Proliferation: Acquisition Strategies and Opportunities for an Uncertain Future

DTIC Science & Technology

2018-04-20

The large programs of record characteristic of federal acquisition consist of rigorous research, development, testing, and evaluation (RDT&E...and evaluation (IOT&E) activities drive the program toward the decision to enter full rate production (FRP). Finally, in the sustainment phase, the...the new feature by a full release at a later date, or halt the development altogether. As stated by the Director of Operational Test and Evaluation

Vehicle systems and payload requirements evaluation. [computer programs for identifying launch vehicle system requirements

NASA Technical Reports Server (NTRS)

Rea, F. G.; Pittenger, J. L.; Conlon, R. J.; Allen, J. D.

1975-01-01

Techniques developed for identifying launch vehicle system requirements for NASA automated space missions are discussed. Emphasis is placed on development of computer programs and investigation of astrionics for OSS missions and Scout. The Earth Orbit Mission Program - 1 which performs linear error analysis of launch vehicle dispersions for both vehicle and navigation system factors is described along with the Interactive Graphic Orbit Selection program which allows the user to select orbits which satisfy mission requirements and to evaluate the necessary injection accuracy.

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Theory-Based Evaluation Meets Ambiguity: The Role of Janus Variables

ERIC Educational Resources Information Center

Dahler-Larsen, Peter

2018-01-01

As theory-based evaluation (TBE) engages in situations where multiple stakeholders help develop complex program theory about dynamic phenomena in politically contested settings, it becomes difficult to develop and use program theory without ambiguity. The purpose of this article is to explore ambiguity as a fruitful perspective that helps TBE face…

The Design, Implementation, and Formative Evaluation of a Classroom Aide Professional Development Training Program

ERIC Educational Resources Information Center

Dulfer, Katherine J.

2013-01-01

This dissertation focused on the process of designing, implementing, and formatively evaluating an eight week Classroom Aide Professional Development Training Program (CAPD-TP) on behavior management and academic instruction within the context of a New Jersey state approved private special education school for students with behavioral and/or…

Standards & Criteria for the Development and Evaluation of a Comprehensive Employee Assistance Program.

ERIC Educational Resources Information Center

Health Resources and Services Administration, Rockville, MD. Bureau of Health Care Delivery and Assistance.

This document was designed for use by persons or agencies interested in both establishing and evaluating employee assistance programs (EAP) for federal employees. It contains essential elements, standards, and assessment criteria which have been developed to assist in the planning and implementation of services, and to provide a framework for…

An Evaluation Model for Competency Based Teacher Preparatory Programs.

ERIC Educational Resources Information Center

Denton, Jon J.

This discussion describes an evaluation model designed to complement a curriculum development project, the primary goal of which is to structure a performance based program for preservice teachers. Data collected from the implementation of this four-phase model can be used to make decisions for developing and changing performance objectives and…

More than a Conversation: Using Cogenerative Dialogues in the Professional Development of High School Chemistry Teachers

ERIC Educational Resources Information Center

Martin, Sonya N.; Scantlebury, Kathryn

2009-01-01

This paper focuses on content-based and pedagogical instructors' use of cogenerative dialogues to improve instructional practice and to evaluate program effectiveness in a professional development program for high school chemistry teachers. We share our research findings from using cogenerative dialogues as an evaluative tool for general…

Development of a Design for Evaluation of the Podiatric Medicine Training Grant Program. Final Report and Executive Summary.

ERIC Educational Resources Information Center

American Association of Colleges of Podiatric Medicine, Washington, DC.

Information is presented on an evaluation design for a federal program, the Podiatric Medicine Training Grant Program. The program supports the clinical training of third- and fourth-year podiatric medical students in underserved areas. Background information is provided on: the supply and distribution of health professionals and podiatrists in…

An evaluation of the nursing success program: reading comprehension, graduation rates, and diversity.

PubMed

Symes, Lene; Tart, Kathryn; Travis, Lucille

2005-01-01

The Nursing Success Program was developed to enhance retention of baccalaureate nursing students. Reading comprehension scores are used to identify students who are at risk for failure and direct them into the retention program that addresses their skill deficits. To evaluate the program, the authors assessed reading comprehension, graduation rates, and ethnic diversity.

An Analysis of Evaluation Plans in a Federally Funded Leadership Preparation Program: Implications for the Improvement of Practice

ERIC Educational Resources Information Center

Sanzo, Karen L.

2012-01-01

This study is a content analysis of selected federally funded leadership preparation program evaluation proposals for the 2008, 2009, and 2010 School Leadership Program grants. The United States Department of Education (USDE) began awarding funding in 2002 to develop and implement preparation programs for aspiring and current assistant principals…

Early Childhood Language-Centered Intervention Program. O.E.E. Evaluation Report, 1980-1981.

ERIC Educational Resources Information Center

Tobias, Robert; Lavin, Claire

This report evaluates the Early Childhood Language-Centered Intervention Program in New York City Public Schools. The program was designed to promote the development of preschool handicapped students in a variety of areas. The program objective proposed that the target students would show statistically significant improvement at the .05 level in…

The Evaluation of a North Carolina Truancy Intervention Program: Is It Culturally Sensitive?

ERIC Educational Resources Information Center

Carson, Deborah

2013-01-01

Truancy issues are longstanding and the desires to develop programs that are effective have been just as enduring. More striking is the lack of evidence of a truancy program evaluation process that includes collaboration with the clients that it serves. Truancy intervention programs have a wide range of effects on participants from multiple ethnic…

The Floating Lab Research Project: An Approach to Evaluating Field Programs.

ERIC Educational Resources Information Center

Brody, Michael J.

This report explains an evaluative study of the conceptual and affective development of students associated with the Floating Lab Program, an experiential field project sponsored by the University of New Hampshire and the Maine Sea Grant Program. The field program involved an opportunity for students to have hands-on experiences aboard a 65-foot…

A Formative-Summative Evaluation Design for a State-Sponsored Program of Educational Experimentation.

ERIC Educational Resources Information Center

Kniefel, Tanya M.

An evaluation design created to provide information for a multiple-project program of educational experimentation is presented. Project SEED (State Experimentation in Educational Development) became an official education effort in North Carolina on July 1, 1971. Model for the program was that of the State's ESEA Title III program with certain…

The National Evaluation of School Nutrition Programs. Final Report - Executive Summary.

ERIC Educational Resources Information Center

Radzikowski, Jack

This is a summary of the final report of a study (begun in 1979) of the National School Lunch, School Breakfast, and Special Milk Programs. The major objectives of the evaluation were to (1) identify existing information on the school nutrition programs; (2) identify determinants of participation in the programs and develop statistical models for…

A Comparison of Linear and Systems Thinking Approaches for Program Evaluation Illustrated Using the Indiana Interdisciplinary GK-12

ERIC Educational Resources Information Center

Dyehouse, Melissa; Bennett, Deborah; Harbor, Jon; Childress, Amy; Dark, Melissa

2009-01-01

Logic models are based on linear relationships between program resources, activities, and outcomes, and have been used widely to support both program development and evaluation. While useful in describing some programs, the linear nature of the logic model makes it difficult to capture the complex relationships within larger, multifaceted…

Language Development Component, Secondary Developmental Reading Program. Final Evaluation Report.

ERIC Educational Resources Information Center

Beck, Donald; Chamberlain, Ed

This report evaluates the Secondary Developmental Reading Program, a component of the Ohio Disadvantaged Pupil Program Fund (DPPF), in terms of the 1982-83 program objectives. Twelve project reading teachers worked in eight Columbus senior high schools with 843 pupils scoring at or below the 36th percentile in reading achievement. A pilot project…

Social Capital Development within a Novice District-Grown Principal Preparation Program: A Case Study of the DCPS Patterson Fellowship

ERIC Educational Resources Information Center

Hansen, Allison

2016-01-01

In the last decade district-managed principal preparation programs have become common as a means for school leadership preparation (Leithwood, Seashore-Lewis, Anderson, & Wahlstrom, 2004; Turnbull, Riley, & MacFarlane, 2015), but evaluations of these programs are relatively rare. This dissertation evaluates one such program, the Mary Jane…

The La Salle University FIPSE Grant: A Review and Evaluation of the Alcohol and Other Drug Program, 1 September 88 through 30 September 90.

ERIC Educational Resources Information Center

Chapman, Robert J.

This report presents descriptive and evaluative information on the Alcohol and Other Drug Program (A & D Program) developed at Pennsylvania's La Salle University and supported by the Fund for the Improvement of Postsecondary Education. The program includes an alcohol awareness project, a peer education program, a resident educator with A &…

2012 Wind Program Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zayas, Jose; Higgins, Mark

2012-06-01

This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

Promoting Success: A Professional Development Coaching Program for Interns in Medicine.

PubMed

Palamara, Kerri; Kauffman, Carol; Stone, Valerie E; Bazari, Hasan; Donelan, Karen

2015-12-01

Residency is an intense period. Challenges, including burnout, arise as new physicians develop their professional identities. Residency programs provide remediation, but emotional support for interns is often limited. Professional development coaching of interns, regardless of their performance, has not been reported. Design, implement, and evaluate a program to support intern professional development through positive psychology coaching. We implemented a professional development coaching program in a large residency program. The program included curriculum development, coach-intern interactions, and evaluative metrics. A total of 72 internal medicine interns and 26 internal medicine faculty participated in the first year. Interns and coaches were expected to meet quarterly; expected time commitments per year were 9 hours (per individual coached) for coaches, 5 1/2 hours for each individual coachee, and 70 hours for the director of the coaching program. Coaches and interns were asked to complete 2 surveys in the first year and to participate in qualitative interviews. Eighty-two percent of interns met with their coaches 3 or more times. Coaches and their interns assessed the program in multiple dimensions (participation, program and professional activities, burnout, coping, and coach-intern communication). Most of the interns (94%) rated the coaching program as good or excellent, and 96% would recommend this program to other residency programs. The experience of burnout was lower in this cohort compared with a prior cohort. There is early evidence that a coaching program of interactions with faculty trained in positive psychology may advance intern development and partially address burnout.

WAVAI Curriculum Guide for Instruction in Wisconsin High Schools. 1975 Revision. Bulletin No. 5011.

ERIC Educational Resources Information Center

Wisconsin State Dept. of Public Instruction, Madison. Bureau for Career and Manpower Development.

This guide is designed to aid the development of vocational education programs in agriculture in local school districts. Major program objectives, good learning conditions, program evaluation, suggested teaching methods, and Wisconsin's philosophy and procedures in developing occupational experience programs in vocational agriculture/agribusiness…

Advisory Committee Evaluation of Vocational Education Programs.

ERIC Educational Resources Information Center

Orr, William T., Jr.

1985-01-01

Program advisory committees in vocational education have traditionally been charged with the responsibility of evaluating programs for the purpose of keeping them up to date with business and industry practices and current technology. Rapid technological development and accountability requirements have led to state mandates that the advisory…

Curriculum Development and Evaluation: Research and Development Program on Preschool Disadvantaged Children. Final Report. (Volume II of III Volumes).

ERIC Educational Resources Information Center

Bereiter, Carl; And Others

Seven studies were undertaken to further extend the development and testing of an academically-oriented preschool program for disadvantaged children. The studies investigated (1) Curricula Development and Testing in Bereiter-Engelmann Program, (2) Dual Kindergarten, (3) Follow-Up Data on the Achievement of Disadvantaged Children Who Participated…

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Senior Citizens Can Be Physically Fit: Hints for a Successfully Developed Program.

ERIC Educational Resources Information Center

Sandlin, Betty; Sutherland, Mary S.

Suggestions are given in this paper for developing a physical fitness program for senior citizens. Discussed in detail are surveying community interest, program planning and implementation, and program evaluation. It is pointed out that fitness programs can modify many of the physical and mental changes of aging. It is emphasized that the program…

Resident Evaluation and Remediation: A Comprehensive Approach

PubMed Central

Wu, Jim S.; Siewert, Bettina; Boiselle, Phillip M.

2010-01-01

Background A comprehensive evaluation and remediation program is an essential component of any residency program. The evaluation system should identify problems accurately and early and allow residents with problems to be assigned to a remediation program that effectively deals with them. Elements of a proactive remediation program include a process for outlining deficiencies, providing resources for improvement, communicating clear goals for acceptable performance, and reevaluating performance against these goals. Intervention In recognition of the importance of early detection and prompt remediation of the struggling resident, we sought to develop a multifaceted approach to resident evaluation with the aim of early identification and prompt remediation of difficulties. This article describes our comprehensive evaluation program and remediation program, which uses resources within our radiology department and institutional graduate medical education office. Discussion An effective evaluation system should identify problems accurately and early, whereas a proactive remediation program should effectively deal with issues once they are identified. PMID:21975628

77 FR 38071 - Council on Graduate Medical Education; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-26

... graduate medical education, evaluation of teaching programs especially in terms of meeting community needs...' development of performance measures and methods of longitudinal evaluation specific to the training programs...

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

PubMed

Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-06-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

PubMed Central

Cole, Donald C.; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-01-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners’ meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. PMID:27003730

Development and implementation of a comprehensive quality assurance program at a community endoscopy facility.

PubMed

Hilsden, Robert Jay; Rostom, Alaa; Dubé, Catherine; Pontifex, Darlene; McGregor, S Elizabeth; Bridges, Ronald J

2011-10-01

Quality assurance (QA) is a process that includes the systematic evaluation of a service, institution of improvements and ongoing evaluation to ensure that effective changes were made. QA is a fundamental component of any organized colorectal cancer screening program. However, it should play an equally important role in opportunistic screening. Establishing the processes and procedures for a comprehensive QA program can be a daunting proposition for an endoscopy unit. The present article describes the steps taken to establish a QA program at the Forzani & MacPhail Colon Cancer Screening Centre (Calgary, Alberta) - a colorectal cancer screening centre and nonhospital endoscopy unit that is dedicated to providing colorectal cancer screening-related colonoscopies. Lessons drawn from the authors' experience may help others develop their own initiatives. The Global Rating Scale, a quality assessment and improvement tool developed for the gastrointestinal endoscopy services of the United Kingdom's National Health Service, was used as the framework to develop the QA program. QA activities include monitoring the patient experience through surveys, creating endoscopist report cards on colonoscopy performance, tracking and evaluating adverse events and monitoring wait times.

A natural history of behavioral health program evaluation in Arizona.

PubMed

Braun, S H; Irving, D

1984-01-01

This article examines the history of behavioral health program evaluation efforts in the state of Arizona during the years 1974-1982. Program Evaluation in Arizona has been carried out in an environment where planning, monitoring, contracting, appropriations, and evaluation have been inter-related--sometimes loosely, sometimes closely. Here we trace the year-by-year evolution of the evaluation system and its connections with the other parts of the environment. This history illustrates the gradual development of an evaluation system in an organizational context, including the sidetracks and setbacks .

Development and evaluation of a leadership training program for public health emergency response: results from a Chinese study.

PubMed

Wang, Chongjian; Wei, Sheng; Xiang, Hao; Wu, Jing; Xu, Yihua; Liu, Li; Nie, Shaofa

2008-10-30

Since the 9/11 attack and severe acute respiratory syndrome (SARS), the development of qualified and able public health leaders has become a new urgency in building the infrastructure needed to address public health emergencies. Although previous studies have reported that the training of individual leaders is an important approach, the systemic and scientific training model need further improvement and development. The purpose of this study was to develop, deliver, and evaluate a participatory leadership training program for emergency response. Forty-one public health leaders (N = 41) from five provinces completed the entire emergency preparedness training program in China. The program was evaluated by anonymous questionnaires and semi-structured interviews held prior to training, immediately post-training and 12-month after training (Follow-up). The emergency preparedness training resulted in positive shifts in knowledge, self-assessment of skills for public health leaders. More than ninety-five percent of participants reported that the training model was scientific and feasible. Moreover, the response of participants in the program to the avian influenza outbreak, as well as the planned evaluations for this leadership training program, further demonstrated both the successful approaches and methods and the positive impact of this integrated leadership training initiative. The emergency preparedness training program met its aims and objectives satisfactorily, and improved the emergency capability of public health leaders. This suggests that the leadership training model was effective and feasible in improving the emergency preparedness capability.

Evaluation in New Jersey Education: A Survey of Present Practices and Recommendations for Future Action.

ERIC Educational Resources Information Center

Pinkowski, Francis; And Others

Current evaluation activities in the New Jersey school system are surveyed, and recommendations for future evaluation efforts are made. The current activities and future developments of school (or school district), statewide, and project (or program) evaluation are discussed individually. The following program objectives are suggested: to raise…

Program Impact Evaluations: An Introduction for Managers of Title VII Projects. A Draft Guidebook.

ERIC Educational Resources Information Center

Bissell, Joan S.

Intended to assist administrators in the planning, management, and utilization of evaluation, this guidebook is designed as an introduction and supplement to other evaluation materials for bilingual education programs being developed under federal sponsorship, including evaluation models for Title VII projects. General information is provided on…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

Planning for the Evaluation of Special Educational Programs: A Resource Guide.

ERIC Educational Resources Information Center

Meierhenry, Wesley C.

Developed along with a tape-slide package, the guide covers evaluation of special educational programs. Robert McIntyre discusses evaluation for decision making; Victor Baldwin considers sources of help and how to use them; and Helmut Hofmann treats objectives as guidelines for action, data collection, and budget planning and evaluation. Wesley…

A Product Evaluation of the Selective Abandonment Process for School Budgeting

ERIC Educational Resources Information Center

Loofe, Christopher M.

2016-01-01

The purpose of this study is to evaluate the degree to which the Selective Abandonment budget process objectives were achieved by analyzing stakeholder perceptions. Use of this evaluation may enable the district to become more effective, efficient, and more fiscally responsible when developing future program budgeting plans. Program evaluation was…

Ensuring youth's right to participation and promotion of youth leadership in the development of sexual and reproductive health policies and programs.

PubMed

Villa-Torres, Laura; Svanemyr, Joar

2015-01-01

The purpose of this article was to reflect on the concepts of adolescence and youth, summarize models and frameworks developed to conceptualize youth participation, and assess research that has attempted to evaluate the implementation and impact of youth participation in the field of sexual and reproductive health and rights (SRHR). We searched and critically reviewed relevant published reports and "gray literature" from the period 2000-2013. "Young people" are commonly defined as those between the ages of 10 and 24 years, but what it means to be a young person varies largely across cultures and depends on a range of socioeconomic factors. Several conceptual frameworks have been developed to better understand youth participation, and some frameworks are designed to monitor youth development programs that have youth participation as a key component. Although none of them are SRHR specific, they have the potential to be adapted and applied also for adolescents' SRHR programs. The most monitored and evaluated intervention type is peer education programs, but the effectiveness of the approach is questioned. There are few attempts to systematically evaluate youth participation, and clear indicators and better methodologies still need to be developed. More research and documentation as well as the adoption of innovative practices for involving youth in sexual and reproductive health programs are needed. Participation is a right and should not only be evaluated in terms of effectiveness and impact. Youth participation in program and policy development should still be a priority. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

1992 UPDATE OF U.S. EPA'S SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION (SITE) EMERGING TECHNOLOGY PROGRAM

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Emerging Technology Program (ETP) has encouraged and financially supported further development of bench- and pilot-scale testing and evaluation of innovative technologies suitable for use at hazardous waste sites for five year...

Evaluation of a continuing professional development training program for physicians and physician assistants in hospitals in Laos based on the Kirkpatrick model

PubMed Central

2016-01-01

Purpose: Medical professionals from Korea and Laos have been working together to develop a continuing professional development training program covering the major clinical fields of primary care. This study aimed to evaluate the effectiveness of the program from 2013 to 2014 using the Kirkpatrick model. Methods: A questionnaire was used to evaluate the reaction of the trainees, and the trainers assessed the level of trainees’ performance at the beginning and the end of each clinical section. The transfer (behavioral change) of the trainees was evaluated through the review of medical records written by the trainees before and after the training program. Results: The trainees were satisfied with the training program, for which the average score was 4.48 out of 5.0. The average score of the trainees’ performance at the beginning was 2.39 out of 5.0, and rose to 3.88 at the end of each section. The average score of the medical records written before the training was 2.92 out of 5.0, and it rose to 3.34 after the training. The number of patient visits to the district hospitals increased. Conclusion: The continuing professional development training program, which was planned and implemented with the full engagement and responsibility of Lao health professionals, proved to be effective. PMID:27246494

Assumptions, conjectures, and other miracles: The application of evaluative thinking to theory of change models in community development.

PubMed

Archibald, Thomas; Sharrock, Guy; Buckley, Jane; Cook, Natalie

2016-12-01

Unexamined and unjustified assumptions are the Achilles' heel of development programs. In this paper, we describe an evaluation capacity building (ECB) approach designed to help community development practitioners work more effectively with assumptions through the intentional infusion of evaluative thinking (ET) into the program planning, monitoring, and evaluation process. We focus specifically on one component of our ET promotion approach involving the creation and analysis of theory of change (ToC) models. We describe our recent efforts to pilot this ET ECB approach with Catholic Relief Services (CRS) in Ethiopia and Zambia. The use of ToC models, plus the addition of ET, is a way to encourage individual and organizational learning and adaptive management that supports more reflective and responsive programming. Copyright © 2016 Elsevier Ltd. All rights reserved.

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

42 CFR 56.504 - Grant evaluation and award.

Code of Federal Regulations, 2011 CFR

2011-10-01

... HEALTH SERVICES Grants for Planning and Developing Migrant Health Programs § 56.504 Grant evaluation and... services or reimbursement programs or projects. (b) The Secretary shall award no more than one grant under...

42 CFR 56.504 - Grant evaluation and award.

Code of Federal Regulations, 2010 CFR

2010-10-01

... HEALTH SERVICES Grants for Planning and Developing Migrant Health Programs § 56.504 Grant evaluation and... services or reimbursement programs or projects. (b) The Secretary shall award no more than one grant under...

Conversational Skills Instruction for Communication Apprehension and Avoidance: Evaluation of a Treatment Program.

ERIC Educational Resources Information Center

Glaser, Susan R.; And Others

1983-01-01

Describes and evaluates a conversational skills program designed to teach apprehensive communicators how to develop comfortable and effective social behavior in a variety of interpersonal contexts. (PD)

Ceramic automotive Stirling engine program

NASA Technical Reports Server (NTRS)

1986-01-01

The Ceramic Automotive Stirling Engine Program evaluated the application of advanced ceramic materials to an automotive Stirling engine. The objective of the program was to evaluate the technical feasibility of utilizing advanced ceramics to increase peak engine operating temperature, and to evaluate the performance benefits of such an increase. Manufacturing cost estimates were also developed for various ceramic engine components and compared with conventional metallic engine component costs.

A Supplement to the Component Four Implementation Booklet. Broad Goal Definition in Emerald School District. SPECS: School Planning, Evaluation, and Communication System.

ERIC Educational Resources Information Center

Nagle, John M.; Walker, Harold E.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. This…

Evaluation of Revised Second Grade, MANS Blue Level. Evaluation Report 8-B-2. Extended Pilot Trial of the Comprehensive School Mathematics Program.

ERIC Educational Resources Information Center

Dougherty, Knowles

The Comprehensive School Mathematics Program (CSMP) is a program of CEMREL, Inc., one of the national educational laboratories, and was funded by the National Institute of Education (NIE). Its major purpose is the development of curriculum materials for kindergarten through grade 6. This document is an extension of "Evaluation Report…

48 CFR 719.273-6 - Application process.

Code of Federal Regulations, 2010 CFR

2010-10-01

... SOCIOECONOMIC PROGRAMS SMALL BUSINESS PROGRAMS The U.S. Agency for International Development (USAID) Mentor-Protégé Program 719.273-6 Application process. Entities interested in becoming a Mentor firm must... the Mentor-Protégé Agreement and shall be evaluated for approval. Evaluations will consider the nature...

Multiple Year Extension Program Outcomes & Impacts through Evaluation

ERIC Educational Resources Information Center

Hachfeld, Gary A.; Bau, David B.; Holcomb, C. Robert; Craig, J. William

2013-01-01

Dwindling public funding as well as greater competition for grant dollars create a challenge for Extension. For Extension to remain a financially viable organization, educators have to be able to produce substantive, measurable program outcomes and impacts. Evaluative data can inform program development and delivery, and helps administrators…

Evaluation of the Veterans' Cost-of-Instruction Program. Final Report.

ERIC Educational Resources Information Center

French, Arthur M.; And Others

Objectives of the Veterans' Cost-of-Instruction Program (VCIP) evaluation were: (1) to develop profiles describing institutional services for veterans, the Office of Veterans' Affairs (OVA), and demographic characteristics; (2) to identify differences and similarities in institutions' veteran assistance programs; (3) to describe the degree to…

Improving Mandatory Tutoring: A Mixed-Methods Program Evaluation

ERIC Educational Resources Information Center

Baggett, Brooks

2009-01-01

In recent years, the local school leadership in a suburban southern U.S. high school adopted innovative academic intervention programs to assist underperforming students but did not develop formal methods to evaluate program effectiveness. This gap in the professional practice continued with the inception of mandatory tutoring (MT), an…

Title III ESEA - Evaluation Special Education. Final Report.

ERIC Educational Resources Information Center

District of Columbia Public Schools, Washington, DC.

Presented are evaluation reports on four special education programs in the District of Columbia Public Schools: a daily program for the development of linguistic and conceptual ability in 12 aphasic children, emphasizing language reception and expression; a complete instructional program for some 18 multiply handicapped, hearing impaired rubella…

A CAI (Computer-Assisted Instruction) Course on Constructing PLANIT lessons: Development, Content, and Evaluation

DTIC Science & Technology

1980-06-01

courseware package on how to program lessons for an automated system. Since PLANIT (Programming Language for Interactive Teaching) is the student/author...assisted instruction (CAI), how to program PLANIT lessons, and to evaluate the effectiveness of the package for select Army users. The resultant courseware

CIVITAS: An International Civic Education Exchange Program. Evaluation Report.

ERIC Educational Resources Information Center

Cabello, Beverly

This evaluation report documents the CIVITAS program's progress toward its five stated goals: (1) acquaint educators from Eastern and Central Europe with exemplary curricular and teacher training programs in civic education developed in the United States; (2) assist educators from Eastern and Central Europe in adapting and implementing effective…

Reading Outside Micrometers. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Sommer, Sandra; And Others

This courseware evaluation rates the Reading Outside Micrometers program developed by EMC Publishing Company. (The program--not contained in this document--uses high resolution graphics to illustrate the micrometer's components, functions, and practical applications.) Part A describes the program in terms of subject area and equipment requirements…

Reading Vernier Calipers. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Goldstine, James; And Others

This courseware evaluation rates the Reading Vernier Calipers program developed by EMC Publishing Company. (The program--not contained in this document--uses high resolution graphics to illustrate the micrometer and describe its components, functions, and practical applications.) Part A describes the program in terms of subject area (technical…

A Review of Findings from Two-Way Bilingual Education Evaluation Reports.

ERIC Educational Resources Information Center

Mahrer, Cindy; Christian, Donna

A review of 35 reports evaluating 27 two-way bilingual education programs is reported. All programs represented meet basic criteria for language of instruction, student characteristics, and emphasis on developing bilingualism. The review examined program characteristics and student outcomes, when available. Results are summarized in the following…

Charting the Impact of Federal Spending for Education Research: A Bibliometric Approach

ERIC Educational Resources Information Center

Milesi, Carolina; Brown, Kevin L.; Hawkley, Louise; Dropkin, Eric; Schneider, Barbara L.

2014-01-01

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

Evaluating a Nutrition Education Program for Pregnant Teen-Agers: Cognitive vs. Behavioral Outcomes.

ERIC Educational Resources Information Center

Perkin, Judy

1983-01-01

A manual on nutrition during pregnancy and lactation was developed and used with pregnant teenagers. Evaluation of the program showed that, while participants' knowledge of nutrition improved, their eating habits did not. The need for behavioral assessment of nutrition education programs is pointed out. (Author/PP)

Child Services Demonstration Center Evaluation. Summary Report. (ESEA VI-G).

ERIC Educational Resources Information Center

Colorado State Dept. of Education, Denver.

Presented is the final report of Colorado's Child Services Demonstration Project, designed to develop, implement, and evaluate a team staffing program to aid children with specific learning disabilities. The program is described in terms of rationale, replication, children served, staff activities (educational diagnosis, prescriptive programing,…

7 CFR 1486.209 - How are program applications evaluated and approved?

Code of Federal Regulations, 2011 CFR

2011-01-01

... or new uses. Examples include food service development, market research on potential for consumer... MARKETS PROGRAM Eligibility, Applications, and Funding § 1486.209 How are program applications evaluated... affecting the level of U.S. exports and market share for the agricultural commodity/product; (4) The degree...

Industrial Education, General Programs. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Turner, Gordon; And Others

This courseware evaluation rates a set of 25 industrial education general software programs developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include measurement drill, fraction drill, loan and interest cost analysis, assault vehicle speeds, sun's rays, Ohm's law, concrete calculations, roof…

Wood Programs. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Kaylor, Robert; And Others

This courseware evaluation rates the Wood Programs software developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include understanding board feet, wood characteristics, wood safety drill, wood dimensions, wood moisture, operating the table saw, radial arm, measurement drill, fraction drill, and…

Microcomputer Applications in Vocational Education: Home Economics. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Sarle, Ruth; And Others

This courseware evaluation rates the "Microcomputer Applications in Vocational Education: Home Economics" program developed by the Illinois State Board of Education. (This series of programs--not contained in this document--includes interior decorating estimating, pounds away program, decision analysis, fiber care, clothing figure…

Labor Market Assessments: An Essential Data Element for Program Development and Evaluation.

ERIC Educational Resources Information Center

Friedel, Janice N.

The Eastern Iowa Community College District (EICCD) has conducted labor market assessments in 17 occupations related to its programs. These assessments are an integral component of the EICCD program evaluation process. These assessments provide valuable information in the specific occupational areas regarding (1) characteristics of the local…

Evaluation of Children's After-School Programs in Taiwan: FAHP Approach

ERIC Educational Resources Information Center

Lee, Amy H. I.; Yang, Chih-Neng; Lin, Chun-Yu

2012-01-01

The need of after-school programs has become urgent for school-age children in many industrialized countries due to social structure changes. This research develops a hierarchical framework to evaluate after-school programs from two distinct aspects--service quality from parents' perspectives and marketing strategy from operators'…

EVALUATION OF THE IMPLEMENTATION OF OPERATIONS AND MAINTENANCE PROGRAMS IN NEW JERSEY SCHOOLS

EPA Science Inventory

The Asbestos Hazard Emergency Response Act (AHERA) required all schools to develop and implement an asbestos management plan (AMP). The key component of the AMP is the operations and maintenance (O&M) program. A study was conducted to evaluate the implementation of O&M programs a...

Health Promotion of Faculty and Staff: The School Nurse's Role

ERIC Educational Resources Information Center

Ryan, Kelly M.

2008-01-01

Health promotion of school faculty and staff is an important part of a coordinated school health program. The lack of evaluation of health promotion programs and inconsistent results highlighting the efficacy and benefits of programs adds to employers' perceptions of inconsistent benefits. More studies evaluating effectiveness and development of…

[Development and Evaluation of a Self-Reflection Program for Intensive Care Unit Nurses Who Have Experienced the Death of Pediatric Patients].

PubMed

Kang, Hyun Ju; Bang, Kyung Sook

2017-06-01

This study aims to develop a self-reflection program for nurses who have experienced the death of pediatric patients in the intensive care unit and to evaluate its effectiveness. The self-reflection program was developed by means of the following four steps: establishment of the goal through investigation of an initial request, drawing up the program, preliminary research, and implementation and improvement of the program. The study employed a methodological triangulation to evaluate the effectiveness of the program. Participants were 38 nurses who had experienced the death of pediatric patients (experimental group=15, control group=23); they were recruited using convenience sampling. The self-reflection program was provided over 6 weeks (6 sessions). Data were collected from April to August, 2014 and analyzed using t-tests and content analysis. The quantitative results showed that changes in personal growth (t=-6.33, p<.001) and burnout scores (z=-2.76, p=.005) were better in the experimental group compared to the control group. The qualitative results exhibited two themes, namely "personal growth" and "professional growth", and ten sub-themes. The self-reflection program developed by this study was effective in helping nurses who had experienced the death of pediatric patients to achieve personal growth through self-reflection, and it was confirmed that the program can be applied in a realistic clinical nursing setting. Furthermore, it can be recommended as an intervention program for clinical nurses. © 2017 Korean Society of Nursing Science

Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program.

PubMed

Hallinan, Christine M

2010-01-01

In this paper, program logic will be used to 'map out' the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.

The Maps in Medicine program: An evaluation of the development and implementation of life sciences curriculum

NASA Astrophysics Data System (ADS)

O'Malley, Jennifer

There has been a downward trend in both science proficiency and interest in science in the United States, especially among minority students and students of a disadvantaged background. This has led to a downturn in the number of individuals within these groups considering a career in the sciences or a related field. Studies have identified many potential causes for this problem including the current structure of science curriculum, lack of teacher preparedness, and the lack of quality education and support for those students currently underrepresented in the sciences. Among the solutions to this problem include redesigning the science curriculum, offering high-quality professional development opportunities to teachers, and creating programs to give support to individuals currently underrepresented in the sciences, so that they may have a better chance of pursuing and obtaining a science career. The Maps in Medicine program (MiM) has been designed to incorporate all of the aforementioned solutions and apply them to the current science education problem. The Maps in Medicine (MiM) program was established at the University of Missouri -- Columbia, and is funded by the Howard Hughes Medical Institute. Newly developed MiM curricula and student activities are intended to promote positive attitude changes in those students who are currently underrepresented in Science, Technology, Engineering and Mathematics (STEM) fields, with the program also providing professional development to high school science teachers. It was important to determine if the MiM program's solution to the science education problem has been successful, and so the program evaluation piece was integral. A mixed-methods approach was used to evaluate the MiM program. Formative evaluation results indicated a positive response from teachers and students regarding curriculum and professional development, and student activities. These results have also lead to the identification of appropriate improvements for the program, and will assist with the program's overall goal of national dissemination of MiM curriculum.

The Project P.A.T.H.S. in Hong Kong: Work Done and Lessons Learned in a Decade.

PubMed

Shek, Daniel T L; Wu, Florence K Y

2016-02-01

The Project Positive Adolescent Training through Holistic Social Programs is a positive youth development program initiated and financially supported by The Hong Kong Jockey Club Charities Trust. Since 2005, the project has gone through several phases, including the initial phase (2005-2012), school-based extension phase (2009-2016), and community-based extension phase (2013-2017). In the initial phase, with the involvement of academics from 5 universities in Hong Kong, the research team developed youth enhancement programs for junior secondary school students (20 hours per grade), trained the program implementers (20 hours per grade), assisted in the implementation in more than 250 schools, and evaluated the program using multiple evaluation strategies, including a 5-year longitudinal experimental study. In the school-based extension phase, the project was implemented for another cycle (2009-2010 and 2011-2012 school years) and a 6-year longitudinal study was conducted to understand the psychosocial development of Chinese adolescents in Hong Kong. In the community-based extension phase, the programs were administered by social workers in the community settings. Generally speaking, different evaluation findings showed that the programs in Project Positive Adolescent Training through Holistic Social Programs promoted positive development and reduced risk behavior in Chinese adolescents in Hong Kong. Positive youth development attributes and family functioning also have positive contributions to adolescent developmental outcomes over time. Copyright © 2016 North American Society for Pediatric and Adolescent Gynecology. Published by Elsevier Inc. All rights reserved.

Development and Evaluation of Educational Programs in Electromechanical Technology. Final Report.

ERIC Educational Resources Information Center

Roney, M. W.

The encompassing objective of this project was to assist two-year colleges in establishing electromechanical technican (EMT) training programs by developing the necessary planning and instructional materials and by providing direct program planning assistance. The research effort of the project was to develop and test an integrated systems of…

Human Research Program Science Management: Overview of Research and Development Activities

NASA Technical Reports Server (NTRS)

Charles, John B.

2007-01-01

An overview of research and development activities of NASA's Human Research Science Management Program is presented. The topics include: 1) Human Research Program Goals; 2) Elements and Projects within HRP; 3) Development and Maintenance of Priorities; 4) Acquisition and Evaluation of Research and Technology Proposals; and 5) Annual Reviews

Mathematics Teachers' Professional Development Program--Needs and Expectations

ERIC Educational Resources Information Center

Levi-Keren, Michal; Patkin, Dorit

2016-01-01

This paper presents the major findings and recommendations from a formative evaluation of the first of a 2-year in-service training program. This program was designed for the professional development of math teachers. It was developed following an educational reform, which was meant to enhance the teachers' ability to generate changes in their…

Youth Sport Programs: An Avenue to Foster Positive Youth Development

ERIC Educational Resources Information Center

Fraser-Thomas, Jessica L.; Cote, Jean; Deakin, Janice

2005-01-01

Concern about the growth in adolescent problem behaviours (e.g. delinquency, drug use) has led to increased interest in positive youth development, and a surge in funding for "after school programs." We evaluate the potential of youth sport programs to foster positive development, while decreasing the risk of problem behaviours.…

An Evaluation of the 4-H "Health Rocks" Program: Implications for Program Improvement

ERIC Educational Resources Information Center

Self, Carlton; Morgan, A. Christian; Fuhrman, Nicholas E.; Navarro, Maria

2013-01-01

The National 4-H Council developed the Health Rocks substance abuse educational program to prevent youth from engaging in risky behaviors. The program was presented in 2010 to more than 8,000 middle school youth in Georgia. A post-then-pre evaluation was conducted with youth who completed 10 hours of instruction to determine if changes in youth…

Getting Teachers in on the Act: Evaluation of a Theater- and Classroom-Based Youth Violence Prevention Program

ERIC Educational Resources Information Center

Zucker, Marla; Spinazzola, Joseph; Pollack, Amie Alley; Pepe, Lauren; Barry, Stephanie; Zhang, Lynda; van der Kolk, Bessel

2010-01-01

This study replicated and extended our previous evaluation of Urban Improv (UI), a theater-based youth violence prevention (YVP) program developed for urban youth. It assessed the replicability of positive program impacts when implemented by nonprogram originators, as well as the utility of a comprehensive version of the UI program that included a…

eMINTS Program Evaluation Report: An Investigation of Program Fidelity and Its Impact on Teacher Mastery and Student Achievement

ERIC Educational Resources Information Center

Martin, Wendy; Strother, Scott; Weatherholt, Tara; Dechaume, Merav

2008-01-01

The eMINTS professional development programs are designed to help teachers learn how to integrate technology into their teaching, using instructional strategies that promote inquiry-based learning and encourage collaboration and community building among students and teachers. The eMINTS programs considered in this evaluation include: (1) eMINTS…

Evaluation of a High-Engagement Teaching Program for STEM Graduate Students: Outcomes of the Future Academic Scholars in Teaching (FAST) Fellowship Program

ERIC Educational Resources Information Center

Prevost, Luanna B.; Vergara, Claudia E.; Urban-Lurain, Mark; Campa, Henry, III.

2018-01-01

Higher education institutions prepare future faculty members for multiple roles, including teaching. However, teaching professional development programs for graduate students vary widely. We present evaluation data from a high engagement program for STEM doctoral students. We analyzed the impact on three cohorts of participants over three academic…

Moving beyond Smile Sheets: A Case Study on the Evaluation and Iterative Improvement of an Online Faculty Development Program

ERIC Educational Resources Information Center

Chen, Ken-Zen; Lowenthal, Patrick R.; Bauer, Christine; Heaps, Allan; Nielsen, Crystal

2017-01-01

Institutions of higher education are struggling to meet the growing demand for online courses and programs, partly because many faculty lack experience teaching online. The eCampus Quality Instruction Program (eQIP) is an online faculty development program developed to train faculty to design and teach fully online courses. The purpose of this…

A Process Evaluation of Project Developmental Continuity. Interim Report IV, Volume 2: Development of the Implementation and Cost Studies.

ERIC Educational Resources Information Center

Smith, Allen G.; And Others

This interim report describes the development of program implementation and cost studies for Year II of the process evaluation of Project Developmental Continuity (PDC), a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and primary school experiences. Specific areas focused…

Research on Synthetic Training: Device Evaluation and Training Program Development.

ERIC Educational Resources Information Center

Caro, Paul W.; And Others

Two studies were conducted to evaluate a fixed-wing instrument procedures training device and to develop a training program for use with it. In the first, a group of trainees who received synthetic instrument flight training with the new device were compared with a control group who did not. Men trained with the device performed more…

Comparison of Outcomes for Youth Apprenticeship Projects and Youth Career Development Projects. Supplementary Report.

ERIC Educational Resources Information Center

Richards, James M., Jr.; And Others

The New Youth Initiatives in Apprenticeship Program (YAP) was compared with the Youth Career Development Program (YCD). Data for 1979 and 1980 came from an evaluation of YAP projects by CSR, Incorporated, and an evaluation of the YCD projects by the Educational Testing Service. A multiple regression approach was used to compare student…

Employment Assistance Planning Programs for Welfare Recipients: An Evaluation and the Development of a Screening Measure.

ERIC Educational Resources Information Center

Peterson, Gary W.; And Others

A project was conducted to develop an assessment instrument for use in identifying welfare recipients who are potentially employable and to evaluate the effectiveness of Florida's three existing pilot employment assistance planning programs (termed PAPAs after the Public Assistance Productivity Act). Data on the employment status of 98 individuals…

Joven Noble: Evaluation of a Culturally Focused Youth Development Program

ERIC Educational Resources Information Center

Tello, Jerry; Cervantes, Richard C.; Cordova, David; Santos, Susana M.

2010-01-01

The purpose of this study was to describe and evaluate a promising program model, the Joven Nobel curriculum, for Latino male adolescents that promotes positive youth development and addresses prevention of a number of risk-related sexual behaviors within a cultural context. A quasi-experimental design was used that included a pre- and posttest…

Report of Assessment and Development--INCE's Department of Correspondence Instruction.

ERIC Educational Resources Information Center

Wedemeyer, Charles A.

An evaluation of INCE's Department of Correspondence Instruction, Caracas, Venezuela, was carried out to evaluate the present program, suggest ways in which the present program can be expanded, and advise the staff in the use of media and technology. The six chapters of the report are as follows: 1. Introduction; 2. Background to Development; 3.…

Development, Implementation, and Evaluation of Leadership/Management Training Within Army Battalions: Volume I: Summary of Findings.

ERIC Educational Resources Information Center

Fry, John P.; Cliborn, Robert E.

The report describes the development and evaluation of an in-unit, leadership/management training program (based on experimental training methodology for providing Army leaders with behavioral skills and techniques) implemented within three battalion-sized combat units at Fort Bliss, Texas, in 1974. The program was organized around workshops…

A Preliminary Evaluation of Instructional Effectiveness of Online Training Implemented at a Government Agency in Thailand

ERIC Educational Resources Information Center

Supanakorn-Davila, Supawan; Bolliger, Doris U.

2012-01-01

Online training has become popular in the professional development of government employees in Thailand. One large government agency developed an online program to provide training to its employees across the country using two systems: an Internet and Intranet-based system. With the new program implemented, the evaluation of the instructional…

Evaluation of a Classwide Teaching Program for Developing Preschool Life Skills

ERIC Educational Resources Information Center

Hanley, Gregory P.; Heal, Nicole A.; Tiger, Jeffrey H.; Ingvarsson, Einar T.

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 years and 5 years. Classroom observations were…

An example of international drug politics--the development and distribution of substance prevention programs directed at adolescents.

PubMed

Lilja, John; Giota, Joanna; Hamilton, David; Larsson, Sam

2007-01-01

Many substance use prevention programs directed at adolescents exist that have been developed by researchers in the United States and are intended to be used in school settings. Some of the problems associated with such programs are reviewed, including their accessibility, ease of use, copyright status, evaluation options, program scales, and ratings, together with an overall consideration of the factors and processes posited to be associated with substance use and non-use (posited "at-risk" and "protective" mechanisms). The authors contend that there is a great need to: (a) develop substance use prevention programs which are commercially available but are not protected by copyright, (b) assess empirically each component in a program separately, and (c) encourage funding bodies to be more active in supporting the production of manuals and evaluation instruments for substance use prevention programs directed at adolescents. We need more and better process evaluations that are also sensitive to both endogenous and exogenous forces in order to know the processes by which a successful prevention program achieves its effects, is prevented from doing so and which processes are irrelevant. A social competence framework might be used as both a goal and as a theoretical base to achieve a better understanding of the processes by which substance use prevention programs reach their effects.

A longitudinal evaluation of the preservice training and retention of kinship and nonkinship foster/adoptive families one and a half years after training.

PubMed

Christenson, Brian L; McMurtry, Jerry

2009-01-01

A comprehensive evaluation of the Parent Resources for Information Development and Education (PRIDE) foster/adopt preservice training and resource family development program was conducted one and a half years after training. Results indicate PRIDE is an effective training, family development, and retention program whose lessons stay with the participants well after they have completed the program. Knowledge tests were administered to participants before PRIDE training, at graduation from training, and 18 months after the completion of training. This is the subsequent study to the Christenson and McMurtry (2007) publication titled "A Comparative Evaluation of Preservice Training of Kinship and Non-Kinship Foster/Adoptive Families."

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

PubMed

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

ADEA/AAL Institute for Allied Health Educators: Program Evaluation.

PubMed

Gadbury-Amyot, Cynthia C; Overman, Pamela R; Grzesikowski, Tami; Tucker-Lively, Felicia; Weinstein, George; Haden, N Karl

2015-05-01

Revised accreditation standards for dental and dental hygiene education programs have increased emphasis on faculty development that can improve teaching and learning, foster curricular change including use of teaching and learning technologies, and enhance retention and satisfaction of faculty. The American Dental Education Association (ADEA) and Academy for Academic Leadership (AAL) established the Institute for Allied Health Educators (IAHE) in 2007 to address faculty development needs for allied dental and allied health educators. In 2009, it was transitioned to an online program, which resulted in increased enrollment and diversity of participants. After seven years, a comprehensive program evaluation was warranted. The authors developed an online questionnaire based on Kirkpatrick's four-level model of training evaluation; for this study, levels one (satisfaction), two (knowledge and skill acquisition), and three (behavior change) were examined. Of the 400 program participants invited to take part in the study, a 38% response rate was achieved, with the majority indicating full-time faculty status. Nearly all (95-97%) of the respondents agreed or strongly agreed the program contributed to their teaching effectiveness, and 88-96% agreed or strongly agreed it enhanced their knowledge of educational concepts and strategies. In addition, 83% agreed or strongly agreed the program helped them develop new skills and confidence with technology, with 69% agreeing or strongly agreeing that it helped them incorporate technology into their own educational setting. Nearly 90% were highly positive or positive in their overall assessment of the program; 95% indicated they would recommend it to a colleague; and 80% agreed or strongly agreed they had discussed what they learned with faculty colleagues at their home institutions who had not attended the program. Positive findings from this evaluation provide evidence that the IAHE has been able to meet its goals.

A Lesson in Carefully Managing Resources: A Case Study from an Evaluation of a Music Education Program

ERIC Educational Resources Information Center

Hobson, Kristin A.; Burkhardt, Jason T.

2012-01-01

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

Evaluating Human Resources, Programs, and Organizations. Professional Practices in Adult Education and Human Resource Development Series.

ERIC Educational Resources Information Center

Burnham, Byron R.

This book is intended for the practitioner of evaluation or for the student about to do his or her first formal evaluation. Chapter 1 sets the role of evaluating within the context of an organization and discusses a critical role of evaluation: changing people, programs, and organizations. Chapter 2 discusses personnel appraisals from an…

Critical evaluation of international health programs: Reframing global health and evaluation.

PubMed

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-04-01

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Flight program language requirements. Volume 3: Appendices

NASA Technical Reports Server (NTRS)

1972-01-01

Government-sponsored study and development efforts were directed toward design and implementation of high level programming languages suitable for future aerospace applications. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of language requirements was synthesized from these activities.

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 30 Mineral Resources 2 2010-07-01 2010-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 30 Mineral Resources 2 2014-07-01 2014-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 30 Mineral Resources 2 2013-07-01 2013-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 30 Mineral Resources 2 2012-07-01 2012-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 30 Mineral Resources 2 2011-07-01 2011-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

Louisiana Standards for Programs Serving Four-Year-Old Children: Bulletin.

ERIC Educational Resources Information Center

Picard, Cecil J.

As part of Louisiana's efforts to expand and improve the quality of its early childhood programs, a committee of educators from across the state collaborated to develop standards for programs serving 4-year-olds. This guide presents program standards to assist the ongoing development, evaluation, and improvement of early childhood center-based…

Emblems of Quality in Higher Education. Developing and Sustaining High-Quality Programs.

ERIC Educational Resources Information Center

Haworth, Jennifer Grant; Conrad, Clifton F.

This book proposes an "engagement" theory of program quality to evaluate and improve higher education programs at all degree levels. Based on interviews with 781 participants in a national study of Masters degree programs, it focuses on the interactive roles of students, faculty, and administrators in developing high-quality programs…

Vocational Agriculture/Agribusiness. Wisconsin Association of Vocational Agriculture Instructors Curriculum Guide for Wisconsin High Schools. Revised.

ERIC Educational Resources Information Center

Wisconsin Association of Vocational Agriculture Instructors, Madison.

This guide is designed to aid the development of vocational education programs in agriculture in local school districts. Major program objectives, conditions conducive to learning, program evaluation, suggestions for using the guide, curriculum models, and Wisconsin's philosophy and procedures in developing occupational experience programs in…

Online Doctor of Pharmacy Program for Pharmacy Practitioners: Development and Evaluation of Six Pilot Courses.

ERIC Educational Resources Information Center

O'Neil, Christine K.; Poirier, Therese I.

2000-01-01

The first six courses of this online program successfully increased participants' knowledge and perceived preparedness to provide pharmaceutical care. This success provided the stimulus for the development of the entire online Doctor of Pharmacy program. Participants felt that the online program facilitated more active and enhanced learning and…

Curbing Teen Dating Violence: Evidence from a School Prevention Program. RB-9194-CDC

ERIC Educational Resources Information Center

Jaycox, Lisa H.; McCaffrey, Daniel F.; Weidmer Ocampo, Beverly; Marshall, Grant N.; Collins, Rebecca L.; Hickman, Laura J.; Quigley, Denise D.

2006-01-01

This research brief summarizes a survey about the effectiveness of programs from Break the Cycle, a nonprofit organization dedicated to developing and fielding dating-violence prevention programs. The study evaluated "Ending Violence," a three-class-session prevention program. Developed by a Los Angeles-based nonprofit group called Break…

Strategies for Evaluating Complex Environmental Education Programs

NASA Astrophysics Data System (ADS)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

NASA Astrophysics Data System (ADS)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in its vision, mission, goals and activities. In addition to the documentation of evaluative process, the case study also provides insight on the establishment of mutually supportive principal investigator and evaluator partnerships as necessary foundations for building effective teams. The study addresses frequently asked questions (FAQ's) on the formation and sustenance of partnerships among visionaries and evaluators and the impact of this partnership on the achievement of program outcomes.

Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use.

PubMed

Campbell, Rebecca; Townsend, Stephanie M; Shaw, Jessica; Karim, Nidal; Markowitz, Jenifer

2015-10-01

In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and Implementation of Science and Technology Ethics Education Program for Prospective Science Teachers

ERIC Educational Resources Information Center

Rhee, Hyang-yon; Choi, Kyunghee

2014-01-01

The purposes of this study were (1) to develop a science and technology (ST) ethics education program for prospective science teachers, (2) to examine the effect of the program on the perceptions of the participants, in terms of their ethics and education concerns, and (3) to evaluate the impact of the program design. The program utilized…

A Problem Based Learning Project Analyzing Rubrics Used to Evaluate Elementary STEM Immersion Programs

NASA Astrophysics Data System (ADS)

Pearson, Roxanne N.

In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.

Evaluation Influence: The Evaluation Event and Capital Flow in International Development.

PubMed

Bell, David A

2017-12-01

Assessing program effectiveness in human development is central to informing foreign aid policy-making and organizational learning. Foreign aid effectiveness discussions have increasingly given attention to the devaluing effects of aid flow volatility. This study reveals that the external evaluation event influences actor behavior, serving as a volatility-constraining tool. A case study of a multidonor aid development mechanism served examining the influence of an evaluation event when considering anticipatory effects. The qualitative component used text and focus group data combined with individual interview data (organizations n = 10, including 26 individuals). Quantitative data included financial information on all 75 capital investments. The integrated theory of influence and model of alternative mechanisms used these components to identify the linkage between the evaluation event and capital flow volatility. Aid approved in the year of the midterm evaluation was disbursed by the mechanism with low capital volatility. Anticipating the evaluation event influenced behavior resulting in an empirical record that program outcomes were enhanced and the mechanism was an improved organization. Formative evaluations in a development program can trigger activity as an interim process. That activity provides for a more robust assessment of ultimate consequence of interest. Anticipating an evaluation can stimulate donor reality testing. The findings inform and strengthen future research on the influence of anticipating an evaluation. Closely examining activities before, during, and shortly after the evaluation event can aid development of other systematic methods to improve understanding this phenomenon, as well as improve donor effectiveness strategies.

Design Exception In-Service Monitoring Program Development

DOT National Transportation Integrated Search

2017-05-01

This study evaluates various possible program designs for in-service monitoring of design exceptions (DEs) for the Georgia Department of Transportation. The study recommends a multitier stepwise approach to the evaluation of DEs. Specifically, the pr...

Evaluation of an individualized sanctioning program for DWI offenders

DOT National Transportation Integrated Search

1998-12-01

Evaluates two different approaches to sentencing Driving While Intoxicated (DWI) offenders in Georgia. One approach (called the "Todd Program" after the judge who developed it) imposed individually-tailored combinations of traditional and alternative...

Satellite Power System (SPS) concept development and evaluation program plan, July 1977 - August 1980

NASA Technical Reports Server (NTRS)

1978-01-01

An overview of the program to evaluate the solar satellite power system concept is presented. Environmental, health, and safety factors are examined along with economic, international, and institutional issues.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

75 FR 38082 - Solicitation of Applications for the Research and Evaluation Program: FY 2010 Triple Bottom Line...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-01

...Pursuant to the Research and Evaluation program, the Economic Development Administration (EDA) seeks applications to research, develop, and disseminate metrics to enable policymakers and practitioners to more effectively understand how to assess the triple bottom line (economic, environmental, and social impacts) of various economic development activities. EDA's mission is to lead the Federal economic development agenda by promoting innovation and competitiveness, preparing American regions for growth and success in the worldwide economy. Through its Research and Evaluation program, EDA works towards fulfilling its mission by funding research and technical assistance projects to promote competitiveness and innovation in distressed rural and urban regions throughout the United States and its territories. By working in conjunction with its research partners, EDA will help States, local governments, and community-based organizations to achieve their highest economic potential.

Electricity from biomass: A development strategy

NASA Astrophysics Data System (ADS)

1992-04-01

The purpose of this document is to review the current status of biomass power technology and to evaluate the future directions for development that could significantly enhance the contribution of biomass power to U.S. production of electricity. This document reviews the basic principles of biomass electric systems, the previous contributions of industry and the National Biomass Energy Programs to technology development, and the options for future technology development. It discusses the market for biomass electric technology and future needs for electric power production to help establish a market-oriented development strategy. It projects trends in the performance and cost of the technology and examines the changing dynamics of the power generation market place to evaluate specific opportunities for biomass power development. In a separate document, the Biomass Power Program Five Year R&D Plan, the details of schedules, funding, and roles of participating R&D organizations within the R&D program funded by the U.S. Department of Energy (DOE) are presented. In evaluating the future directions for research and development, two cases are examined.

Data Availability in Appliance Standards and Labeling Program Development and Evaluation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Romankiewicz, John; Khanna, Nina; Vine, Edward

2013-05-01

In this report, we describe the necessary data inputs for both standards development and program evaluation and perform an initial assessment of the availability and uncertainty of those data inputs in China. For standards development, we find that China and its standards and labeling program administrators currently has access to the basic market and technical data needed for conducting market and technology assessment and technological and economic analyses. Some data, such as shipments data, is readily available from the China Energy Label product registration database while the availability of other data, including average unit energy consumption, prices and design options,more » needs improvement. Unlike some other countries such as the United States, most of the necessary data for conducting standards development analyses are not publicly available or compiled in a consolidated data source. In addition, improved data on design and efficiency options as well as cost data (e.g., manufacturing costs, mark-ups, production and product use-phase costs) – key inputs to several technoeconomic analyses – are particularly in need given China’s unconsolidated manufacturing industry. For program evaluation, we find that while China can conduct simple savings evaluations on its incentive programs with the data it currently has available from the Ministry of Finance – the program administrator, the savings estimates produced by such an evaluation will carry high uncertainty. As such, China could benefit from an increase in surveying and metering in the next one to three years to decrease the uncertainty surrounding key data points such as unit energy savings and free ridership.« less

Creating a Research-Rich Curriculum at Miami University

NASA Astrophysics Data System (ADS)

Rauckhorst, William H.

2007-10-01

Miami University has attempted in recent years to build upon a collection of individual student research participation opportunities at the University, and develop a comprehensive ``research-rich'' undergraduate curriculum. A major step in this direction was the creation of the Undergraduate Summer Scholars (USS) program. This program provides 10-week summer research experiences with faculty mentors for 100 juniors or seniors each year. The USS Program is not limited to science and engineering areas, as approximately 30 academic departments participate annually. Development of the USS program at Miami was motivated by the University's prior experience with student research appointments funded by the National Science Foundation, the Howard Hughes Medical Institute, and other sponsoring agencies. The University's evaluation of these earlier student research experiences provided evidence that such experiences were at least as significant in a student's education as formal course work. A second important step in Miami's effort was obtaining a grant from the National Science Foundation's Comprehensive Reform of Undergraduate Education program. This funding enabled the University to enhance the Undergraduate Summer Scholars (USS) Program and evaluate student intellectual growth within the program. Two outcomes of this NSF-funded project are noteworthy: first, the USS program now is firmly established within the University's offerings; second, the evaluation ndicated profound student intellectual growth as a result of mentored research experiences. We will describe the development of the Undergraduate Summer Scholars Program, our evaluation of the Program, and ongoing efforts to extend the benefits of research experience to more students by incorporating research components within traditional coursework.

Organization and use of a Software/Hardware Avionics Research Program (SHARP)

NASA Technical Reports Server (NTRS)

Karmarkar, J. S.; Kareemi, M. N.

1975-01-01

The organization and use is described of the software/hardware avionics research program (SHARP) developed to duplicate the automatic portion of the STOLAND simulator system, on a general-purpose computer system (i.e., IBM 360). The program's uses are: (1) to conduct comparative evaluation studies of current and proposed airborne and ground system concepts via single run or Monte Carlo simulation techniques, and (2) to provide a software tool for efficient algorithm evaluation and development for the STOLAND avionics computer.

Designing faculty development to support the evaluation of resident competency in the intrinsic CanMEDS roles: practical outcomes of an assessment of program director needs.

PubMed

Puddester, Derek; MacDonald, Colla J; Clements, Debbie; Gaffney, Jane; Wiesenfeld, Lorne

2015-06-05

The Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada mandate that faculty members demonstrate they are evaluating residents on all CanMEDS (Canadian Medical Education Directions for Specialists) roles as part of the accreditation process. Postgraduate Medical Education at the University of Ottawa initiated a 5-year project to develop and implement a comprehensive system to assess the full spectrum of CanMEDS roles. This paper presents the findings from a needs assessment with Program Directors, in order to determine how postgraduate medical faculty can be motivated and supported to evaluate residents on the intrinsic CanMEDS roles. Semi-structured individual interviews were conducted with 60 Postgraduate Program Directors in the Faculty of Medicine. Transcribed interviews were analyzed using qualitative analysis. Once the researchers were satisfied the identified themes reflected the views of the participants, the data was assigned to categories to provide rich, detailed, and comprehensive information that would indicate what faculty need in order to effectively evaluate their residents on the intrinsic roles. Findings indicated faculty members need faculty development and shared point of care resources to support them with how to not only evaluate, but also teach, the intrinsic roles. Program Directors expressed the need to collaborate and share resources across departments and national specialty programs. Based on our findings, we designed and delivered workshops with companion eBooks to teach and evaluate residents at the point of care (Developing the Professional, Health Advocate and Scholar). Identifying stakeholder needs is essential for designing effective faculty development. By sharing resources, faculties can prevent 'reinventing the wheel' and collaborate to meet the Colleges' accreditation requirements more efficiently.

A comparative evaluation of preservice training of kinship and nonkinship foster/adoptive families.

PubMed

Christenson, Brian; McMurtry, Jerry

2007-01-01

In 2003, Idaho selected the Foster PRIDE/ Adopt PRIDE preservice training and resource family development program. PRIDE participants (n = 228) completed a pre and posttest survey based on the PRIDE training competencies in 2004-2005. Results indicate that PRIDE is an effective training and resource family development program. Providing and evaluating foster/ adoptive parent preservice training programs can assist child welfare programs in making a positive difference in the lives of families and children involved in the child welfare system while increased cost-savings by retaining foster/adoptive families over time.

Promoting Success: A Professional Development Coaching Program for Interns in Medicine

PubMed Central

Palamara, Kerri; Kauffman, Carol; Stone, Valerie E.; Bazari, Hasan; Donelan, Karen

2015-01-01

Background Residency is an intense period. Challenges, including burnout, arise as new physicians develop their professional identities. Residency programs provide remediation, but emotional support for interns is often limited. Professional development coaching of interns, regardless of their performance, has not been reported. Objective Design, implement, and evaluate a program to support intern professional development through positive psychology coaching. Methods We implemented a professional development coaching program in a large residency program. The program included curriculum development, coach-intern interactions, and evaluative metrics. A total of 72 internal medicine interns and 26 internal medicine faculty participated in the first year. Interns and coaches were expected to meet quarterly; expected time commitments per year were 9 hours (per individual coached) for coaches, 5 1/2 hours for each individual coachee, and 70 hours for the director of the coaching program. Coaches and interns were asked to complete 2 surveys in the first year and to participate in qualitative interviews. Results Eighty-two percent of interns met with their coaches 3 or more times. Coaches and their interns assessed the program in multiple dimensions (participation, program and professional activities, burnout, coping, and coach-intern communication). Most of the interns (94%) rated the coaching program as good or excellent, and 96% would recommend this program to other residency programs. The experience of burnout was lower in this cohort compared with a prior cohort. Conclusions There is early evidence that a coaching program of interactions with faculty trained in positive psychology may advance intern development and partially address burnout. PMID:26692977

A Guidebook for Evaluating Programs for the Gifted in Virginia School Divisions. A Cooperative Project.

ERIC Educational Resources Information Center

Pulaski County Schools, VA.

This guidebook aims to provide clear, non-technical descriptions of procedures for evaluating the effectiveness of local gifted education programs in Virginia. The procedures were developed with both external and internal evaluations in mind. The evaluation process is described in four phases: planning, collecting the data, interpreting the data…

Innovations in Protective Services. Final Evaluation Report, September 1, 1982 through August 31, 1983.

ERIC Educational Resources Information Center

Texas State Dept. of Human Resources, Austin.

This evaluation report describes programs funded by the Texas Department of Human Resources to develop and implement child abuse and neglect services. Yearly evaluation reports and other related information are included for each of the seven programs funded. In addition to this basic information, the evaluation of the Special Investigative…

Translation Training in the Jordanian Context: Curriculum Evaluation in Translator Education

ERIC Educational Resources Information Center

Mahasneh, Anjad

2013-01-01

This study aims at drawing a clear picture of translator training in Jordan through the evaluation of translation programs at the Master's level. The framework of the Context, Input, Process, and Product components of the CIPP evaluation model developed by Daniel Stufflebeam in 1971 was used to evaluate the three translation Master's programs at…

Researcher development program of the primary health care research, evaluation and development strategy.

PubMed

McIntyre, Ellen; Brun, Lyn; Cameron, Helen

2011-01-01

The Research Development Program (RDP) was initiated in 2004 under the Primary Health Care Research, Evaluation and Development (PHCRED) Strategy to increase the number and range of people with knowledge and skills in primary health care research and evaluation. RDP Fellows were invited to participate in an online survey about the effect the program had on their research knowledge, attitudes and practice. The response rate was 42% (105/248). Most were female (88%) with 66% aged between 31 and 50 years. Over two-thirds (72%) were health practitioners. Activities undertaken during the RDP ranged from literature reviews, developing a research question, preparing ethics submissions, attending and presenting at conferences and seminars, preparing papers and reports, and submitting grant applications. Despite the fact that only 52% agreed that the RDP time was adequate, 94% agreed that the RDP was a valuable experience, with 89% expressing interest in undertaking further research. These results indicate that this program has had a positive effect on the RDP Fellows in terms of their knowledge about research, their attitude to research, and the way they use research in their work.

Comparative Analysis of the Religious Orientation and Spiritual and Character Development of Christian Student-Athletes at a Christian University and a Secular University: An Exploratory Study

ERIC Educational Resources Information Center

Schultz, Donald Glen

2009-01-01

Program evaluation is an essential part of the ongoing success of any organization. Program evaluations can be done for entire organizations or for any entity within that organization. Christian university athletic programs need to be evaluated frequently to assess whether the organization is fulfilling its goals and objectives. This study…

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Statistical Process Control in the Practice of Program Evaluation.

ERIC Educational Resources Information Center

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Academic Planning through Program Review: Can It Work?

ERIC Educational Resources Information Center

Fernandez, Thomas V.; Raab, Marjorie K.

Nassau Community College (NCC) is currently working with a program evaluation model in which faculty from one department serve as peer evaluation consultants to direct the self-evaluations of other departments. The four functional objectives initially motivating the development of NCC's plan directed that: real decisions about academic programs…

77 FR 39490 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-07-03

... DEPARTMENT OF EDUCATION Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy Development; Evaluation of the Carol M. White Physical Education Program SUMMARY: The Carol M. White Physical Education Program (PEP) supports a variety of projects that encourage fitness...

Use of a structured template to facilitate practice-based learning and improvement projects.

PubMed

McClain, Elizabeth K; Babbott, Stewart F; Tsue, Terance T; Girod, Douglas A; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-06-01

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008-2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level.

Use of a Structured Template to Facilitate Practice-Based Learning and Improvement Projects

PubMed Central

McClain, Elizabeth K.; Babbott, Stewart F.; Tsue, Terance T.; Girod, Douglas A.; Clements, Debora; Gilmer, Lisa; Persons, Diane; Unruh, Greg

2012-01-01

Background The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to meet and demonstrate outcomes across 6 competencies. Measuring residents' competency in practice-based learning and improvement (PBLI) is particularly challenging. Purpose We developed an educational tool to meet ACGME requirements for PBLI. The PBLI template helped programs document quality improvement (QI) projects and supported increased scholarly activity surrounding PBLI learning. Methods We reviewed program requirements for 43 residency and fellowship programs and identified specific PBLI requirements for QI activities. We also examined ACGME Program Information Form responses on PBLI core competency questions surrounding QI projects for program sites visited in 2008–2009. Data were integrated by a multidisciplinary committee to develop a peer-protected PBLI template guiding programs through process, documentation, and evaluation of QI projects. All steps were reviewed and approved through our GME Committee structure. Results An electronic template, companion checklist, and evaluation form were developed using identified project characteristics to guide programs through the PBLI process and facilitate documentation and evaluation of the process. During a 24 month period, 27 programs have completed PBLI projects, and 15 have reviewed the template with their education committees, but have not initiated projects using the template. Discussion The development of the tool generated program leaders' support because the tool enhanced the ability to meet program-specific objectives. The peer-protected status of this document for confidentiality and from discovery has been beneficial for program usage. The document aggregates data on PBLI and QI initiatives, offers opportunities to increase scholarship in QI, and meets the ACGME goal of linking measures to outcomes important to meeting accreditation requirements at the program and institutional level. PMID:23730444

ENVIRONMENTAL MONITORING AND ASSESSMENT PROGRAM - AGROECOSYSTEM PILOT FIELD PROGRAM PLAN - 1993

EPA Science Inventory

The Agroecosystem Resource Group (ARG) of the Environmental Monitoring and Assessment Program (EMAP) has developed a five-year (1991-1995) strategy for the development, evaluation, and implementation of a suite of indicators for monitoring agroecosystem status and trends on a reg...

75 FR 7608 - Statement of Organization, Functions and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-22

... cards; (4) provides planning, management and oversight of all interior design projects, move services... program-level HRSA components in the design and conduct of evaluations; (5) develops annual performance... training program, and the mentoring program; (2) develops, designs, and implements a comprehensive...

Toward More Effective Drug Prevention Programs.

ERIC Educational Resources Information Center

Ellickson, Phyllis L.; Robyn, Abby E.

This report discusses guidelines for developing drug prevention programs. It reflects knowledge acquired in developing and implementing Project ALERT, an adolescent drug prevention program currently being evaluated with more than 6,500 students in California and Oregon schools. The guidelines discussed are based on information about the…

Ergonomics: CTD management evaluation tool.

PubMed

Ostendorf, J S; Rogers, B; Bertsche, P K

2000-01-01

Cumulative trauma disorder (CTD) occurrences peaked in number in 1994 and although decreasing in 1995, still accounted for 62% of all illness cases reported. A CTD Management Evaluation Tool was developed to assist Occupational Safety and Health Compliance Officers (CSHOs) in program evaluation and documentation of the occupational health management component and the need for an ergonomics program. Occupational and environmental health nurses may use the tool not only to reduce and prevent CTD occurrences, but also as a benchmark for program evaluation.

Program Evaluation of a High School Science Professional Learning Community

ERIC Educational Resources Information Center

McLelland-Crawley, Rebecca

2014-01-01

Teachers may benefit more from a professional learning community (PLC) than from professional development initiatives presented in single day workshops. The purpose of this program evaluation study was to identify characteristics of an effective PLC and to determine how the members of the PLC have benefitted from the program. Fullan's educational…

The Development of an Automated Data Base for Program Research and Evaluation in Continuing Education.

ERIC Educational Resources Information Center

Taylor, William H.

The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…

Evaluation of Consumer Health Training and Education Programs.

ERIC Educational Resources Information Center

Kellogg, Muriel; And Others

PL89-749, passed in 1966, included a number of provisions for increasing participation of consumers in the improvement of the health care delivery system, including development of training programs to equip consumers for participation in the health planning process. The evaluation attempts to ascertain the direct effect of training programs on…

Marketing: Managing the Marketing Mix. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Fleming, Lian; And Others

This courseware evaluation rates the Marketing: Managing the Marketing Mix program developed by Control Data Limited. (This program--not contained in this document--is designed to introduce decisions made by marketing managers during the implementation phase of marketing.) Part A describes the program in terms of subject area (marketing, decision…

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

ERIC Educational Resources Information Center

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…