Overcoming design problems in evaluating health behavior programs.

PubMed

Flay, B R; Best, J A

1982-03-01

The increasing importance of high-quality evaluative research on health lifestyle change programs is established. Failure to ask the right evaluative research questions and problems of research design are identified as two major reasons for the dearth of well-controlled, interpretable evaluations in this area. Thirteen issues of research design that need to be considered if interpretable answers to evaluative research questions are to be obtained are identified and discussed. Solutions to these problems and design recommendations are offered.

The Design and Pilot Evaluation of an Interactive Learning Environment for Introductory Programming Influenced by Cognitive Load Theory and Constructivism

ERIC Educational Resources Information Center

Moons, Jan; De Backer, Carlos

2013-01-01

This article presents the architecture and evaluation of a novel environment for programming education. The design of this programming environment, and the way it is used in class, is based on the findings of constructivist and cognitivist learning paradigms. The environment is evaluated based on qualitative student and teacher evaluations and…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Oasis Connections: Results from an Evaluation Study

ERIC Educational Resources Information Center

Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-01-01

Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

Zero-G Workstation Design

NASA Technical Reports Server (NTRS)

Gundersen, R. T.; Bond, R. L.

1976-01-01

Zero-g workstations were designed throughout manned spaceflight, based on different criteria and requirements for different programs. The history of design of these workstations is presented along with a thorough evaluation of selected Skylab workstations (the best zero-g experience available on the subject). The results were applied to on-going and future programs, with special emphasis on the correlation of neutral body posture in zero-g to workstation design. Where selected samples of shuttle orbiter workstations are shown as currently designed and compared to experience gained during prior programs in terms of man machine interface design, the evaluations were done in a generic sense to show the methods of applying evaluative techniques.

Evaluation of Embedded System Component Utilized in Delivery Integrated Design Project Course

NASA Astrophysics Data System (ADS)

Junid, Syed Abdul Mutalib Al; Hussaini, Yusnira; Nazmie Osman, Fairul; Razak, Abdul Hadi Abdul; Idros, Mohd Faizul Md; Karimi Halim, Abdul

2018-03-01

This paper reports the evaluation of the embedded system component utilized in delivering the integrated electronic engineering design project course. The evaluation is conducted based on the report project submitted as to fulfil the assessment criteria for the integrated electronic engineering design project course named; engineering system design. Six projects were assessed in this evaluation. The evaluation covers the type of controller, programming language and the number of embedded component utilization as well. From the evaluation, the C-programming based language is the best solution preferred by the students which provide them flexibility in the programming. Moreover, the Analog to Digital converter is intensively used in the projects which include sensors in their proposed design. As a conclusion, in delivering the integrated design project course, the knowledge over the embedded system solution is very important since the high density of the knowledge acquired in accomplishing the project assigned.

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

PubMed

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.

The Spiral-Interactive Program Evaluation Model.

ERIC Educational Resources Information Center

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluation Design 1977-1978 ESEA Title VII Bilingual Program.

ERIC Educational Resources Information Center

Matuszek, Paula; And Others

A design for the evaluation of ESEA Title VII bilingual programs in the Austin Independent School District is presented. The following topics are included: (1) Evaluation Design Review Form; (2) decision questions including the actual questions addressed on three levels: the Office of Education-Level, the system-level and the project-level; (3) a…

The Interior Design Simulator. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Worts, Nancy; And Others

This courseware evaluation rates the Interior Design Simulator program developed by Orange Juice Software Systems. (This program--not contained in this document--allows the user to design a room of any shape with maximum dimensions of 14 x 26 feet.) Part A describes the program in terms of subject area (furniture arrangement) and hardware…

Maximizing the Impact of Program Evaluation: A Discrepancy-Based Process for Educational Program Evaluation.

ERIC Educational Resources Information Center

Cantor, Jeffrey A.

This paper describes a formative/summative process for educational program evaluation, which is appropriate for higher education programs and is based on M. Provus' Discrepancy Evaluation Model and the principles of instructional design. The Discrepancy Based Methodology for Educational Program Evaluation facilitates systematic and detailed…

Assessing Operation Purple: A Program Evaluation of a Summer Camp for Military Youth

DTIC Science & Technology

2012-01-01

However, it should be noted that the four FOCUS studies employed evaluation designs with no control or comparison group . Furthermore, despite...evaluation design was more robust than other military youth program evaluations that do not have a control or comparison group (Beardslee, Lester, et al...Operation Purple: A Program Evaluation of a Summer Camp for Military Youth camp group ); the remaining group formed the no-camp, or control , group . We

A computer program incorporating fatigue and fracture criteria in the preliminary design of transport aircraft: An evaluation

NASA Technical Reports Server (NTRS)

Berger, P. E.; Thornton, E. A.

1976-01-01

The APAS program a multistation structural synthesis procedure developed to evaluate material, geometry, and configuration with various design criteria usually considered for the primary structure of transport aircraft is described and evaluated. Recommendations to improve accuracy and extend the capabilities of the APAS program are given. Flow diagrams are included.

Program Fighter - An Evaluation.

ERIC Educational Resources Information Center

Hull, David G.; Fowler, Wallace T.

Described is a computer program for the sizing of subsonic and supersonic fighters which has been adapted for use in an aerospace engineering design course. Following a description of the program, an evaluation of its use in the university is presented. It is concluded that computer programs for the conceptual design of aerospace vehicles can play…

Design, development, and evaluation of truck and bus driver wellness programs

DOT National Transportation Integrated Search

2000-06-01

In May 1997, the Federal Motor Carrier Safety Administration (FMCSA) began a research project to design, develop, and evaluate a model truck and bus driver wellness program. This wellness program was developed to provide a resource for addressing tru...

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

A Drawing and Multi-Representational Computer Environment for Beginners' Learning of Programming Using C: Design and Pilot Formative Evaluation

ERIC Educational Resources Information Center

Kordaki, Maria

2010-01-01

This paper presents both the design and the pilot formative evaluation study of a computer-based problem-solving environment (named LECGO: Learning Environment for programming using C using Geometrical Objects) for the learning of computer programming using C by beginners. In its design, constructivist and social learning theories were taken into…

The vehicle design evaluation program - A computer-aided design procedure for transport aircraft

NASA Technical Reports Server (NTRS)

Oman, B. H.; Kruse, G. S.; Schrader, O. E.

1977-01-01

The vehicle design evaluation program is described. This program is a computer-aided design procedure that provides a vehicle synthesis capability for vehicle sizing, external load analysis, structural analysis, and cost evaluation. The vehicle sizing subprogram provides geometry, weight, and balance data for aircraft using JP, hydrogen, or methane fuels. The structural synthesis subprogram uses a multistation analysis for aerodynamic surfaces and fuselages to develop theoretical weights and geometric dimensions. The parts definition subprogram uses the geometric data from the structural analysis and develops the predicted fabrication dimensions, parts material raw stock buy requirements, and predicted actual weights. The cost analysis subprogram uses detail part data in conjunction with standard hours, realization factors, labor rates, and material data to develop the manufacturing costs. The program is used to evaluate overall design effects on subsonic commercial type aircraft due to parameter variations.

Logic Models: A Tool for Designing and Monitoring Program Evaluations. REL 2014-007

ERIC Educational Resources Information Center

Lawton, Brian; Brandon, Paul R.; Cicchinelli, Louis; Kekahio, Wendy

2014-01-01

introduction to logic models as a tool for designing program evaluations defines the major components of education programs--resources, activities, outputs, and short-, mid-, and long-term outcomes--and uses an example to demonstrate the relationships among them. This quick…

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Planning and Selecting Evaluation Designs for Leadership Training: A Toolkit for Nurse Managers and Educators.

PubMed

Dunne, Simon; Lunn, Cora; Kirwan, Marcia; Matthews, Anne; Condell, Sarah

2015-01-01

Leadership development training and education for nurses is a priority in modern health care systems. Consequently, effective evaluation of nurse leadership development programs is essential for managers and educators in health care organizations to determine the impact of such programs on staff behaviors and patient outcomes. Our team has identified a framework for the evaluation of the design and implementation of such programs. Following this, we provide practical tools for the selection of evaluation methodologies for leadership development programs for use by health care educators and program commissioners. Copyright © 2015 Elsevier Inc. All rights reserved.

Development of a Design for Evaluation of the Podiatric Medicine Training Grant Program. Final Report and Executive Summary.

ERIC Educational Resources Information Center

American Association of Colleges of Podiatric Medicine, Washington, DC.

Information is presented on an evaluation design for a federal program, the Podiatric Medicine Training Grant Program. The program supports the clinical training of third- and fourth-year podiatric medical students in underserved areas. Background information is provided on: the supply and distribution of health professionals and podiatrists in…

A Formative-Summative Evaluation Design for a State-Sponsored Program of Educational Experimentation.

ERIC Educational Resources Information Center

Kniefel, Tanya M.

An evaluation design created to provide information for a multiple-project program of educational experimentation is presented. Project SEED (State Experimentation in Educational Development) became an official education effort in North Carolina on July 1, 1971. Model for the program was that of the State's ESEA Title III program with certain…

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Jump start: a targeted substance abuse prevention program.

PubMed

Harrington, N G; Donohew, L

1997-10-01

A substance abuse prevention and life skills program for economically disadvantaged, high sensation seeking African American teens was developed and tested in Cincinnati, Ohio. Formative research was conducted to determine program content and format. Over two implementations, 289 individuals in the target population were recruited as participants for the field test of the program. For the first implementation, participants were randomly selected from the city's summer youth employment program. For the second, a media campaign was designed to recruit participants. Process evaluation indicated that participants evaluated the program extremely positively. Outcome evaluation indicated that significant pretest differences between high and low sensation seekers were neutralized for liquor and marijuana in both years of the program and for attitude toward drugs in the first year of the program. These results suggest that sensation seeking is a useful message design and audience-targeting variable for substance abuse prevention program design. Implications and recommendations for future research are discussed.

Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-12-31

The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

Situated Research Design and Methodological Choices in Formative Program Evaluation

ERIC Educational Resources Information Center

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Supporting School Leaders in Blended Learning with Blended Learning

ERIC Educational Resources Information Center

Acree, Lauren; Gibson, Theresa; Mangum, Nancy; Wolf, Mary Ann; Kellogg, Shaun; Branon, Suzanne

2017-01-01

This study provides a mixed-methods case-study design evaluation of the Leadership in Blended Learning (LBL) program. The LBL program uses blended approaches, including face-to-face and online, to prepare school leaders to implement blended learning initiatives in their schools. This evaluation found that the program designers effectively…

Design and Evaluation of the NFL PLAY 60 FITNESSGRAM® Partnership Project

ERIC Educational Resources Information Center

Welk, Gregory J.; Bai, Yang; Saint-Maurice, Pedro F.; Allums-Featherston, Kelly; Candelaria, Norma

2016-01-01

This article describes the conceptual design and evaluation strategies used in the NFL PLAY 60 FITNESSGRAM® Partnership Project, a large participatory research network focused on building effective school physical education programming. The article summarizes the unique participatory design, recruitment methods, programming strategies, and…

Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

PubMed Central

2013-01-01

Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

Evaluating Evaluations: The Case of Parent Involvement Programs

ERIC Educational Resources Information Center

Mattingly, Doreen J.; Prislin, Radmila; McKenzie, Thomas L.; Rodriguez, James L.; Kayzar, Brenda

2002-01-01

This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

From Implementation to Outcomes to Impacts: Designing a Comprehensive Program Evaluation

NASA Astrophysics Data System (ADS)

Shebby, S.

2015-12-01

Funders are often interested in learning about the impact of program activities, yet before the impacts are determined, educational evaluations should first examine program implementation and outcomes. Implementation evaluation examines how and the extent to which program activities are delivered as intended, including the extent to which activities reached the targeted participants. Outcome evaluation is comprised of a systematic examination of the effects that a program has on program participants, such as changes in knowledge, attitudes, beliefs, values, and behaviors. In this presentation, presenters will share insights on evaluating the implementation, outcomes, and impacts associated with an online science curriculum for K-2 students. The science curriculum was designed to provide students with access to science concepts and skills in an interactive and innovative environment, and teachers with embedded, aligned, and on-demand professional development. One of the most important—and challenging—steps in this evaluation was to select outcomes that were well-defined, measurable, and aligned to program activities, as well as relevant to program stakeholders. An additional challenge was to measure implementation given limited access to the classroom environment. This presentation will include a discussion of the process evaluators used to select appropriate implementation indicators and outcomes (teacher and student), design an evaluation approach, and craft data collection instruments. Although examples provided are specific to the K-2 science intervention, the best practices discussed are pertinent to all program and event evaluations. Impact evaluation goes beyond implementation and outcome evaluation to inform whether a program is working or not. It requires a comparison group to inform what outcomes would have been in the absence of the intervention. As such, this presentation will also include a discussion of impacts, including how impacts are defined and measured, and some common challenges in evaluating program impact.

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

ERIC Educational Resources Information Center

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

Strengthening a Design for Evaluating a Broad-Aimed Functional Literacy and Family Life Education Program

ERIC Educational Resources Information Center

Farmer, James A., Jr.

1974-01-01

Techniques are illustrated in this article for strengthening evaluative designs and methodologies relevant to educational programs that incorporate within their broad aims assisting in social problem-solving. (AJ)

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

PubMed

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Curriculum, Technology, and Education Reform (CTER) Online: Evaluation of an Online Master of Education Program.

ERIC Educational Resources Information Center

Levin, Sandra R.; Levin, James A.; Guell, James G.; Waddoups, Gregory L.

2002-01-01

Describes a Master of Education program at the University of Illinois, Urbana-Champaign called Curriculum, Technology, and Education Reform OnLine (CTER) that is aimed at K-12 teachers. The evaluation based on program stakeholders includes interface design; instructional design; faculty satisfaction; student attitudes; economic viability;…

Design Your Own Home. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Turner, Gordon; And Others

This courseware evaluation rates the Design Your Own Home program developed by Avant-Garde Publishing Company. (The program--not contained in this document--uses standard architectural scales and 126 shapes to allow creation of structural floorplans and sideviews.) Part A describes the program in terms of subject area and hardware requirements…

Evaluation of a Local Designated Driver and Responsible Server Program to Prevent Drinking and Driving.

ERIC Educational Resources Information Center

Simons-Morton, Bruce G.; Cummings, Sharon Snider

1997-01-01

Evaluates the impact of beverage servers' interventions at five establishments participating in the Houston Techniques for Effective Alcohol Management (TEAM) program. The intervention included server training, a designated-driver program, and "Safe Ride Home" taxi vouchers. Findings are discussed within the context of scant public and…

Title V Delinquency Prevention Program. Community Self-Evaluation Workbook.

ERIC Educational Resources Information Center

Caliber Associates, Fairfax, VA.

This workbook is designed to help communities and program administrators assess the success of their Title V delinquency prevention programs, but it may serve as an evaluation tool for other prevention efforts as well. It provides information and resource aids on program planning, conducting evaluations, tracking programs, describing activities,…

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

Evaluating Faculty Development and Clinical Training Programs in Substance Abuse: A Guide Book.

ERIC Educational Resources Information Center

Klitzner, Michael; Stewart, Kathryn

Intended to provide an overview of program evaluation as it applies to the evaluation of faculty development and clinical training programs in substance abuse for health and mental health professional schools, this guide enables program developers and other faculty to work as partners with evaluators in the development of evaluation designs that…

Solar thermal storage applications program

NASA Astrophysics Data System (ADS)

Peila, W. C.

1982-12-01

The efforts of the Storage Applications Program are reviewed. The program concentrated on the investigation of storage media and evaluation of storage methods. Extensive effort was given to experimental and analytical investigations of nitrate salts. Two tasks are the preliminary design of a 1200 MW/sub th/ system and the design, construction, operation, and evaluation of a subsystem research experiment, which utilized the same design. Some preliminary conclusions drawn from the subsystem research experiment are given.

Intervention Research and Program Evaluation in the School Setting: Issues and Alternative Research Designs

ERIC Educational Resources Information Center

de Anda, Diane

2007-01-01

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Designing Studies of Extension Program Results: A Resource for Program Leaders and Specialists. Volume II--Abstracts.

ERIC Educational Resources Information Center

Rivera, William M., Ed.; And Others

These abstracts of 42 studies of extension program results, which make up the second volume of a two-volume resource, are intended to advise state administrative program leaders and others with program evaluation responsibilities of how to design studies of cooperative extension programs. Designed to support volume I, which refers to these…

Evaluating the Healthy Start program. Design development to evaluative assessment.

PubMed

Raykovich, K S; McCormick, M C; Howell, E M; Devaney, B L

1996-09-01

The national evaluation of the federally funded Healthy Start program involved translating a design for a process and outcomes evaluation and standard maternal and infant data set, both developed prior to the national evaluation contract award, into an evaluation design and client data collection protocol that could be used to evaluate 15 diverse grantees. This article discusses the experience of creating a process and outcomes evaluation design that was both substantively and methodologically appropriate given such issues as the diversity of grantees and their community-based intervention strategies; the process of accessing secondary data sources, including vital records; the quality of client level data submissions; and the need to incorporate both qualitative and quantitative approaches into the evaluation design. The relevance of this experience for the conduct of other field studies of public health interventions is discussed.

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence.

PubMed

Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily

2017-10-01

Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.

A Multi-Stage Longitudinal Comparative Design Stage II Evaluation of the Changing Lives Program: The Life Course Interview (RDA-LCI)

ERIC Educational Resources Information Center

Arango, Lisa Lewis; Kurtines, William M.; Montgomery, Marilyn J.; Ritchie, Rachel

2008-01-01

The study reported in this article, a Multi-Stage Longitudinal Comparative Design Stage II evaluation conducted as a planned preliminary efficacy evaluation (psychometric evaluation of measures, short-term controlled outcome studies, etc.) of the Changing Lives Program (CLP), provided evidence for the reliability and validity of the qualitative…

Language Program Evaluation

ERIC Educational Resources Information Center

Norris, John M.

2016-01-01

Language program evaluation is a pragmatic mode of inquiry that illuminates the complex nature of language-related interventions of various kinds, the factors that foster or constrain them, and the consequences that ensue. Program evaluation enables a variety of evidence-based decisions and actions, from designing programs and implementing…

Permanent and separable aerospace tubing/ fitting evaluation program, volume 1

NASA Technical Reports Server (NTRS)

Ursell, C. R.; Franz, C. R.

1975-01-01

The tube fitting evaluation program was conducted to develop a standard overall test program including methods, procedures, and equipment as well as recommended test sequences for qualifying fitting/tubing assemblies. The program consisted of testing the MS flareless (separable) fitting and utilizing the results as baseline data from which all other fittings will be evaluated. Five separable designs and five permanent designs were tested in three sizes with two types of tubing materials. The basic design requirements were 4,000 psi operating pressure within the temperature range of minus 65 F to plus 450 F while also being compatible with 21-6-9 and titanium 3Al-2.5V tubing alloys.

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

When Control Groups Do Not Exist: Program Evaluation without a Net.

ERIC Educational Resources Information Center

Clark, Sheldon B.; And Others

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Design and Implementation of Performance Metrics for Evaluation of Assessments Data

ERIC Educational Resources Information Center

Ahmed, Irfan; Bhatti, Arif

2016-01-01

Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though…

No Simple Answer: Critique of the Follow Through Evaluation

ERIC Educational Resources Information Center

House, Ernest R.; And Others

1978-01-01

The evaluation by Abt Associates, Inc., of the Follow Through program, an extension of Head Start designed to improve primary education for disadvantaged children, created a controversy about the program and its assessment, which is discussed in this article. The authors see serious flaws in the evaluation design and interpretation. (MF)

Modifications of ORNL's computer programs MSF-21 and VTE-21 for the evaluation and rapid optimization of multistage flash and vertical tube evaporators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Glueckstern, P.; Wilson, J.V.; Reed, S.A.

1976-06-01

Design and cost modifications were made to ORNL's Computer Programs MSF-21 and VTE-21 originally developed for the rapid calculation and design optimization of multistage flash (MSF) and multieffect vertical tube evaporator (VTE) desalination plants. The modifications include additional design options to make possible the evaluation of desalting plants based on current technology (the original programs were based on conceptual designs applying advanced and not yet proven technological developments and design features) and new materials and equipment costs updated to mid-1975.

Market Aspects of an Interior Design Program.

ERIC Educational Resources Information Center

Gold, Judy E.

A project was conducted to evaluate a proposed interior design program in order to determine the marketability (job availability in the field of interior design and home furnishings merchandising) and the feasibility (educational requirements for entrance into the interior design and home furnishings merchandising job market) of the program. To…

Evaluation of a Classroom Program of Creative Expression Workshops for Refugee and Immigrant Children

ERIC Educational Resources Information Center

Rousseau, Cecile; Drapeau, Aline; Lacroix, Louise; Bagilishya, Deogratias; Heusch, Nicole

2005-01-01

Objective: This evaluative study assessed the effect of a creative expression program designed to prevent emotional and behavioral problems and to enhance self-esteem in immigrant and refugee children attending multiethnic schools. Method: The 12-week program involved 138 children, aged 7 to 13, registered in both integration classes designed for…

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

ERIC Educational Resources Information Center

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of…

Evaluation of solar cells and arrays for potential solar power satellite applications

NASA Technical Reports Server (NTRS)

Almgren, D. W.; Csigi, K.; Gaudet, A. D.

1978-01-01

Proposed solar array designs and manufacturing methods are evaluated to identify options which show the greatest promise of leading up to the develpment of a cost-effective SPS solar cell array design. The key program elements which have to be accomplished as part of an SPS solar cell array development program are defined. The issues focussed on are: (1) definition of one or more designs of a candidate SPS solar array module, using results from current system studies; (2) development of the necessary manufacturing requirements for the candidate SPS solar cell arrays and an assessment of the market size, timing, and industry infrastructure needed to produce the arrays for the SPS program; (3) evaluation of current DOE, NASA and DOD photovoltaic programs to determine the impacts of recent advances in solar cell materials, array designs and manufacturing technology on the candidate SPS solar cell arrays; and (4) definition of key program elements for the development of the most promising solar cell arrays for the SPS program.

Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

PubMed

van Beurden, E; Kempton, A; Sladden, T; Garner, E

1998-02-01

Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

Methods for evaluating a mature substance abuse prevention/early intervention program.

PubMed

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

The Cost-Income Compenent of Program Evaluation.

ERIC Educational Resources Information Center

Miner, Norris

Cost-income studies are designed to serve two functions in instructional program evaluation. First, they act as the indicator of the economic value of a program. This economic value in conjunction with the other educational values needed in program evaluation allow for the most realistic appraisal of program worth. Second, if the studies show a…

Program Theory Evaluation: Logic Analysis

ERIC Educational Resources Information Center

Brousselle, Astrid; Champagne, Francois

2011-01-01

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge.…

The Houston Community College Eligible Legalized Alien Program. Evaluation Program. Evaluation Report.

ERIC Educational Resources Information Center

Seaman, Don F.; Cuellar, Sylvia

The Houston Community College (Texas) program (TOTAL ACCESS) designed in response to the Immigration Reform and Control Act of 1986, is described and evaluated. The program offers classes to eligible aliens (97% Hispanic Americans from Mexico, El Salvador, and Guatemala) wishing to pursue the educational program required for legalization. Program…

Design and Implementation of a Pilot Obesity Prevention Program in a Low-Resource School: Lessons Learned and Research Recommendations

ERIC Educational Resources Information Center

Baskin, Monica L.; Zunker, Christie; Worley, Courtney B.; Dial, Brenda; Kimbrough, Linda

2009-01-01

Purpose: This paper seeks to describe the design, implementation, and lessons learned from an obesity prevention pilot program delivered in a low resource school in the USA. Design/methodology/approach: A planned program evaluation was conducted to: document explicitly the process of designing and implementing the program; and assess the…

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

PubMed

Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

2017-02-01

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Vehicle Design Evaluation Program (VDEP). A computer program for weight sizing, economic, performance and mission analysis of fuel-conservative aircraft, multibodied aircraft and large cargo aircraft using both JP and alternative fuels

NASA Technical Reports Server (NTRS)

Oman, B. H.

1977-01-01

The NASA Langley Research Center vehicle design evaluation program (VDEP-2) was expanded by (1) incorporating into the program a capability to conduct preliminary design studies on subsonic commercial transport type aircraft using both JP and such alternate fuels as hydrogen and methane;(2) incorporating an aircraft detailed mission and performance analysis capability; and (3) developing and incorporating an external loads analysis capability. The resulting computer program (VDEP-3) provides a preliminary design tool that enables the user to perform integrated sizing, structural analysis, and cost studies on subsonic commercial transport aircraft. Both versions of the VDEP-3 Program which are designated preliminary Analysis VDEP-3 and detailed Analysis VDEP utilize the same vehicle sizing subprogram which includes a detailed mission analysis capability, as well as a geometry and weight analysis for multibodied configurations.

Austin Independent School District Office of Program Evaluation Agenda 1998-99. Publication Number 98.01.

ERIC Educational Resources Information Center

Austin Independent School District, TX. Office of Program Evaluation.

The Office of Program Evaluation (OPE) of the Austin Independent School District (Texas) (AISD) is charged with evaluating federally, locally, and state funded programs in the AISD. OPE staff carry out mandated reporting for federal and state grants and are increasingly involved in formative evaluations designed for program improvement and…

What Do We Know about School-Based Management?

ERIC Educational Resources Information Center

Patrinos, Harry Anthony; Fasih, Tazeen; Barrera, Felipe; Garcia-Moreno, Vicente A.; Bentaouet-Kattan, Raja; Baksh, Shaista; Wickramasekera, Inosha

2007-01-01

Impact evaluations of school-based management (SBM) programs, or any other kind of program, are important because they can demonstrate whether or not the program has accomplished its objectives. Furthermore, these evaluations can identify ways to improve the design of the program. These evaluations can also make successful interventions…

A Design Study of a Multimedia Instructional Grammar Program with Embedded Tracking

ERIC Educational Resources Information Center

Koehler, Natalya A.; Thompson, Ann D.; Phye, Gary D.

2011-01-01

This is a design study meant to demonstrate the feasibility of integrating three rather different theoretical perspectives for future efforts in multimedia instructional design. A multimedia instructional grammar program contextualized within the teaching of English as a Second Language (ESL) was developed and evaluated. The program design was…

Using Systems Thinking in the Design, Implementation, and Evaluation of Complex Educational Innovations, with Examples from the InTeGrate Project

ERIC Educational Resources Information Center

Kastens, Kim A.; Manduca, Cathryn A.

2017-01-01

Many geoscience education initiatives now involve cross-departmental or multi-institutional programs. However, the geoscientists who lead such programs typically have little experience or training in program design, leadership, or evaluation. In this commentary, we make the case that geoscientists taking on these ambitious leadership roles can…

Applying Program Theory-Driven Approach to Design and Evaluate a Teacher Professional Development Program

ERIC Educational Resources Information Center

Lin, Su-ching; Wu, Ming-sui

2016-01-01

This study was the first year of a two-year project which applied a program theory-driven approach to evaluating the impact of teachers' professional development interventions on students' learning by using a mix of methods, qualitative inquiry, and quasi-experimental design. The current study was to show the results of using the method of…

75 FR 7608 - Statement of Organization, Functions and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-22

... cards; (4) provides planning, management and oversight of all interior design projects, move services... program-level HRSA components in the design and conduct of evaluations; (5) develops annual performance... training program, and the mentoring program; (2) develops, designs, and implements a comprehensive...

Utah Teacher Evaluation Project: The Park City Career Ladder Design. Final Report: Secretary's Discretionary Program, Planning Grant to Develop Teacher Incentive Programs.

ERIC Educational Resources Information Center

Peterson, Ken; And Others

The Park City School District (Utah) career ladder design provides a system in which teachers are positioned and paid according to successful performance and differentiation of responsibilities. It includes an evaluation system to differentiate among teachers. The career ladder design presents a number of innovations; for example, excellent…

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluation of a Demonstration Program for Postsecondary Hospitality Education.

ERIC Educational Resources Information Center

Weis, Susan F.

A three-phase program evaluation effort employing comparison groups and a pre-post test design indicate formative guidelines for programs revision and summative results indicative of the effectiveness of a demonstration associate degree program for hospitality education. Program effectiveness is defined in terms of the program's enrollment of…

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

State Guidelines for School Athletic Programs.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento.

The guidelines presented here are designed to assist school personnel in developing, administering, and evaluating school athletic programs in California. Topics include: (1) the basic philosophy for school athletic programs; (2) procedures for evaluating school athletic programs; (3) the three-phase school athletic program; (4) resources to…

Program Evaluation in Gifted Education. Essential Readings in Gifted Education Series

ERIC Educational Resources Information Center

Callahan, Carolyn M., Ed.; Reis, Sally M., Ed.

2004-01-01

The readings in this ready-reference report on specific program evaluations, offer critical guidance in the development and utilization of instruments for assessing gifted and talented programs, and are designed to stimulate the discussion of issues surrounding the evaluation of gifted programs. Key features include: (1) Carolyn M. Callahan's…

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

Applying the Concept of Trustworthiness to the Evaluation of a Clinical Program.

ERIC Educational Resources Information Center

Barzansky, Barbara; And Others

An attending tutor program designed to increase faculty-student contact within an Obstetrics and Gynecology clerkship was evaluated. Sessions were observed, written documents were reviewed, and faculty and students were interviewed in order to determine if the program was meeting its goals. Based on the evaluation data, the program was…

Formative Evaluation of the Canada Student Loans Program. Final Report

ERIC Educational Resources Information Center

Human Resources and Skills Development Canada, 2004

2004-01-01

The "Formative Evaluation of the Canada Student Loans Program" was undertaken to assess issues of program relevance, design and delivery and for the purposes of examining the early impacts of changes made to the program since 1998. The evaluation also reviewed the Performance Measurement Strategy contained in the July 2002 Results-Based…

Evaluating a complex, multi-site, community-based program to improve healthcare quality: the summative research design for the Aligning Forces for Quality initiative.

PubMed

Scanlon, Dennis P; Wolf, Laura J; Alexander, Jeffrey A; Christianson, Jon B; Greene, Jessica; Jean-Jacques, Muriel; McHugh, Megan; Shi, Yunfeng; Leitzell, Brigitt; Vanderbrink, Jocelyn M

2016-08-01

The Aligning Forces for Quality (AF4Q) initiative was the Robert Wood Johnson Foundation's (RWJF's) signature effort to increase the overall quality of healthcare in targeted communities throughout the country. In addition to sponsoring this 16-site complex program, RWJF funded an independent scientific evaluation to support objective research on the initiative's effectiveness and contributions to basic knowledge in 5 core programmatic areas. The research design, data, and challenges faced during the summative evaluation phase of this near decade-long program are discussed. A descriptive overview of the summative research design and its development for a multi-site, community-based, healthcare quality improvement initiative is provided. The summative research design employed by the evaluation team is discussed. The evaluation team's summative research design involved a data-driven assessment of the effectiveness of the AF4Q program at large, assessments of the impact of AF4Q in the specific programmatic areas, and an assessment of how the AF4Q alliances were positioned for the future at the end of the program. The AF4Q initiative was the largest privately funded community-based healthcare improvement initiative in the United States to date and was implemented at a time of rapid change in national healthcare policy. The implementation of large-scale, multi-site initiatives is becoming an increasingly common approach for addressing problems in healthcare. The summative evaluation research design for the AF4Q initiative, and the lessons learned from its approach, may be valuable to others tasked with evaluating similarly complex community-based initiatives.

Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness☆

PubMed Central

Sobelson, Robyn K.; Young, Andrea C.

2017-01-01

The Centers for Public Health Preparedness (CPHP) program was a five-year cooperative agreement funded by the Centers for Disease Control and Prevention (CDC). The program was initiated in 2004 to strengthen terrorism and emergency preparedness by linking academic expertise to state and local health agency needs. The purposes of the evaluation study were to identify the results achieved by the Centers and inform program planning for future programs. The evaluation was summative and retrospective in its design and focused on the aggregate outcomes of the CPHP program. The evaluation results indicated progress was achieved on program goals related to development of new training products, training members of the public health workforce, and expansion of partnerships between accredited schools of public health and state and local public health departments. Evaluation results, as well as methodological insights gleaned during the planning and conduct of the CPHP evaluation, were used to inform the design of the next iteration of the CPHP Program, the Preparedness and Emergency Response Learning Centers (PERLC). PMID:23380597

Conceptualizing Youth Empowerment within Tobacco Control

ERIC Educational Resources Information Center

Holden, Debra J.; Messeri, Peter; Evans, W. Douglas; Crankshaw, Erik; Ben-Davies, Maureen

2004-01-01

This article presents a conceptual framework that was developed to guide a national evaluation of the American Legacy Foundation's (Legacy) Statewide Youth Movement Against Tobacco Use (SYMATU) program. This program was designed to develop youth-led, youth-directed initiatives within local communities. Two evaluation studies were designed and…

Formative Evaluation of the ACSC Distance Learning Program: A Status Study.

ERIC Educational Resources Information Center

MacCuish, Donald A.

2001-01-01

Describes a formative evaluation of the Air Command and Staff College (ACSC) distance learning program, which offers professional military education (PME). Highlights include use of the status study methodology; curriculum development; course design; learning theories; instructional systems design; best practices; and student assessment. (LRW)

School Age Child Care: Common Issues in Program Design and Evaluation with Annotated Bibliography. Australian Early Childhood Resource Booklets No. 2.

ERIC Educational Resources Information Center

Piscitelli, Barbara

Noting an increase in demand for school-age child care offerings, with no corresponding establishment of guidelines for program development, this booklet addresses design and evaluation issues in school age child care (SACC) in Australia. The booklet is largely based on two surveys of SACC programs conducted in 1986. The issues discussed in the…

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

NURSING 911: an orientation program to improve retention of online RN-BSN students.

PubMed

Gilmore, Melanie; Lyons, Evadna M

2012-01-01

This article describes the implementation and evaluation of an eight-hour, comprehensive, face-to-face orientation program designed to improve student retention in a newly developed online RN to BSN program. A total of 179 newly enrolled RN to BSN students participated in the orientation program and evaluated the process. Student attrition decreased from 20 percent to less than 1 percent after the orientation program was extended and improved to include a technology assessment and an online practice course. A quality online program requires a well-designed orientation that includes technological assessments and hands-on, active participation by the learner. The newly improved and designed course has become effective in student retention and transition into the online learning environment.

The engineering design integration (EDIN) system. [digital computer program complex

NASA Technical Reports Server (NTRS)

Glatt, C. R.; Hirsch, G. N.; Alford, G. E.; Colquitt, W. N.; Reiners, S. J.

1974-01-01

A digital computer program complex for the evaluation of aerospace vehicle preliminary designs is described. The system consists of a Univac 1100 series computer and peripherals using the Exec 8 operating system, a set of demand access terminals of the alphanumeric and graphics types, and a library of independent computer programs. Modification of the partial run streams, data base maintenance and construction, and control of program sequencing are provided by a data manipulation program called the DLG processor. The executive control of library program execution is performed by the Univac Exec 8 operating system through a user established run stream. A combination of demand and batch operations is employed in the evaluation of preliminary designs. Applications accomplished with the EDIN system are described.

A CAD (Classroom Assessment Design) of a Computer Programming Course

ERIC Educational Resources Information Center

Hawi, Nazir S.

2012-01-01

This paper presents a CAD (classroom assessment design) of an entry-level undergraduate computer programming course "Computer Programming I". CAD has been the product of a long experience in teaching computer programming courses including teaching "Computer Programming I" 22 times. Each semester, CAD is evaluated and modified…

Data Collection Methods for Evaluating Museum Programs and Exhibitions

ERIC Educational Resources Information Center

Nelson, Amy Crack; Cohn, Sarah

2015-01-01

Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

Evaluation: Review of the Past, Preview of the Future.

ERIC Educational Resources Information Center

Smith, M. F.

1994-01-01

This paper summarized contributors' ideas about evaluation as a field and where it is going. Topics discussed were qualitative versus quantitative debate; evaluation's purpose; professionalization; program failure; program development; evaluators as advocates; evaluation knowledge; evaluation expansion; and methodology and design. (SLD)

Cost and accuracy of advanced breeding trial designs in apple

PubMed Central

Harshman, Julia M; Evans, Kate M; Hardner, Craig M

2016-01-01

Trialing advanced candidates in tree fruit crops is expensive due to the long-term nature of the planting and labor-intensive evaluations required to make selection decisions. How closely the trait evaluations approximate the true trait value needs balancing with the cost of the program. Designs of field trials of advanced apple candidates in which reduced number of locations, the number of years and the number of harvests per year were modeled to investigate the effect on the cost and accuracy in an operational breeding program. The aim was to find designs that would allow evaluation of the most additional candidates while sacrificing the least accuracy. Critical percentage difference, response to selection, and correlated response were used to examine changes in accuracy of trait evaluations. For the quality traits evaluated, accuracy and response to selection were not substantially reduced for most trial designs. Risk management influences the decision to change trial design, and some designs had greater risk associated with them. Balancing cost and accuracy with risk yields valuable insight into advanced breeding trial design. The methods outlined in this analysis would be well suited to other horticultural crop breeding programs. PMID:27019717

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Modular biowaste monitoring system

NASA Technical Reports Server (NTRS)

Fogal, G. L.

1975-01-01

The objective of the Modular Biowaste Monitoring System Program was to generate and evaluate hardware for supporting shuttle life science experimental and diagnostic programs. An initial conceptual design effort established requirements and defined an overall modular system for the collection, measurement, sampling and storage of urine and feces biowastes. This conceptual design effort was followed by the design, fabrication and performance evaluation of a flight prototype model urine collection, volume measurement and sampling capability. No operational or performance deficiencies were uncovered as a result of the performance evaluation tests.

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

PubMed

Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-06-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya

PubMed Central

Cole, Donald C.; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-01-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners’ meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. PMID:27003730

Program Evaluation at Foothill College.

ERIC Educational Resources Information Center

Lowe, Irel D.

Evaluation systems were designed for the assessment of the instructional and non-instructional programs at Foothill College (California) to determine whether the objectives of the programs were being met and to ascertain the direct and indirect costs of the programs. For the instructional programs, criteria for determining effectiveness, revenue…

Adapting the Empowerment Evaluation Model: A Mental Health Drop-In Center Case Example

ERIC Educational Resources Information Center

Sullins, Carolyn D.

2003-01-01

Empowerment evaluation involves a program's stakeholders in designing and implementing an evaluation of their own program, thus contributing to the program's improvement and self-determination (Fetterman, 1994, 1996). It appeared to be an appropriate approach for evaluating a mental health drop-in center, which had congruent goals of collaboration…

An overview of the Douglas Aircraft Company Aeroelastic Design Optimization Program (ADOP)

NASA Technical Reports Server (NTRS)

Dodd, Alan J.

1989-01-01

From a program manager's viewpoint, the history, scope and architecture of a major structural design program at Douglas Aircraft Company called Aeroelastic Design Optimization Program (ADOP) are described. ADOP was originally intended for the rapid, accurate, cost-effective evaluation of relatively small structural models at the advanced design level, resulting in improved proposal competitiveness and avoiding many costly changes later in the design cycle. Before release of the initial version in November 1987, however, the program was expanded to handle very large production-type analyses.

COMMUNITY-BASED WATERSHED MANAGEMENT: CREATING A TOOL FOR PROGRAM EVALUATION AND DESIGN

EPA Science Inventory

The criteria will be assembled into a manual to be used by community organizers, academics, managers, or policy makers in evaluating community-based watershed management initiatives and in designing new watershed management programs. The case study will also be added to the b...

Military Design Insights for Online Education Program Evaluation: A Revised Theoretical Construct

ERIC Educational Resources Information Center

Culkin, David T.

2017-01-01

This theoretical development article examines how design methodology currently applied in United States military doctrine can offer insights into the increasingly complex arena of program evaluations of online modes for adult distance education. The article presents key themes that emerge from a multidisciplinary literature review. These themes…

Design for the Evaluation of the San Francisco Home Health Services. Emergency Family Care Services Program.

ERIC Educational Resources Information Center

Remy, Linda L.

This is a design for the evaluation of emergency family care programs of the San Francisco, California Home Health Services administration. The design objectives are qiven as the promotion of the health and welfare of the family unit and the reduction of the number of out-of-home placements of children and subsequent crises. The objectives of the…

Program logic: a framework for health program design and evaluation - the Pap nurse in general practice program.

PubMed

Hallinan, Christine M

2010-01-01

In this paper, program logic will be used to 'map out' the planning, development and evaluation of the general practice Pap nurse program in the Australian general practice arena. The incorporation of program logic into the evaluative process supports a greater appreciation of the theoretical assumptions and external influences that underpin general practice Pap nurse activity. The creation of a program logic model is a conscious strategy that results an explicit understanding of the challenges ahead, the resources available and time frames for outcomes. Program logic also enables a recognition that all players in the general practice arena need to be acknowledged by policy makers, bureaucrats and program designers when addressing through policy, issues relating to equity and accessibility of health initiatives. Logic modelling allows decision makers to consider the complexities of causal associations when developing health care proposals and programs. It enables the Pap nurse in general practice program to be represented diagrammatically by linking outcomes (short, medium and long term) with both the program activities and program assumptions. The research methodology used in the evaluation of the Pap nurse in general practice program includes a descriptive study design and the incorporation of program logic, with a retrospective analysis of Australian data from 2001 to 2009. For the purposes of gaining both empirical and contextual data for this paper, a data set analysis and literature review was performed. The application of program logic as an evaluative tool for analysis of the Pap PN incentive program facilitates a greater understanding of complex general practice activity triggers, and also allows this greater understanding to be incorporated into policy to facilitate Pap PN activity, increase general practice cervical smear and ultimately decrease burden of disease.

Design and evaluation of the computer-based training program Calcularis for enhancing numerical cognition

PubMed Central

Käser, Tanja; Baschera, Gian-Marco; Kohn, Juliane; Kucian, Karin; Richtmann, Verena; Grond, Ursina; Gross, Markus; von Aster, Michael

2013-01-01

This article presents the design and a first pilot evaluation of the computer-based training program Calcularis for children with developmental dyscalculia (DD) or difficulties in learning mathematics. The program has been designed according to insights on the typical and atypical development of mathematical abilities. The learning process is supported through multimodal cues, which encode different properties of numbers. To offer optimal learning conditions, a user model completes the program and allows flexible adaptation to a child's individual learning and knowledge profile. Thirty-two children with difficulties in learning mathematics completed the 6–12-weeks computer training. The children played the game for 20 min per day for 5 days a week. The training effects were evaluated using neuropsychological tests. Generally, children benefited significantly from the training regarding number representation and arithmetic operations. Furthermore, children liked to play with the program and reported that the training improved their mathematical abilities. PMID:23935586

IEC planning: eight state-of-the-art principles.

PubMed

Middleton, J

1983-12-01

Considerable experience and research has been accumulated in the last 20 years on the ways in which information/education/communication (IEC) programs can be effectively designed, implemented, and evaluated. Possibly more effort has focused on population and family planning IEC than on any other sectoral program of development communication. Several principles have emerged which, taken together, define the state of the art in the field. These principles provide a framework of experience which can guide the development of comprehensive IEC programs. They include: policy and resource assessment; audience analysis; strategy design; message research and pretesting; participation and feedback; management; evaluation; and collaboration. The nature of the national policy base for population and family planning programs will determine the goals and approaches of the IEC program. Strong policies of limitation on popultion growth lead to equally strong and pervasive IEC efforts designed to directly affect contraceptive behavior. Assessment of existing policy is an essential aspect of the design of an effective IEC program. Policies establish the rationale and boundaries for action. Population and family planning programs are concerned with some of the most intimate human behavior. Consequently, structured and sensitive audience analysis has become an integral part of the design of IEC programs. The design of communication strategy requires clearly stated objectives. Principles of human learning are used to structure information appropriately. Message research and pretesting have become integral components of the strategy design process. Small scale research on specific objectives is necessary to establish the basis for message design. Audience participation and feedback in remaining phases of program development and implementation are important. The management of an IEC program requires a specific combination of planning, flexibility, and creativity. Evaluation of program effects--identification of the degree of change toward stated objectives -- is critical to long term assessment of the underlying strategy and the identification both of needed corrections and new directions for the future. Collaboration with and involvement of stakeholders in the design and implementation of a national IEC program significantly raises the probability that support will be forthcoming. Taken together these 8 principles can become the basic building blocks of an effective population/family planning IEC program.

The Critical Role of a Well-Articulated, Coherent Design in Professional Development: An Evaluation of a State-Wide Two-Week Program for Mathematics and Science Teachers

ERIC Educational Resources Information Center

Saderholm, Jon; Ronau, Robert N.; Rakes, Christopher R.; Bush, Sarah B.; Mohr-Schroeder, Margaret

2017-01-01

This evaluation study examined a state-wide professional development program composed of two institutes, one for mathematics teachers and one for science teachers, each spanning two weeks. The program was designed to help teachers transform their practice to align with Common Core State Standards for Mathematics and Next Generation Science…

Design Conference for the Evaluation of the Talent Search Program: Synthesis of Major Themes and Commissioned Papers Prepared for the Conference (Washington, D.C., September 30, 1992).

ERIC Educational Resources Information Center

Westat, Inc., Rockville, MD.

This report gathers papers prepared for a design conference for the evaluation of the Federal Talent Search Program, an early intervention program to identify gifted and talented financially needy students and connect them with discretionary grants for higher education. An introductory paper synthesizes major conference themes. These include: (1)…

Energy efficient engine: Low-pressure turbine subsonic cascade component development and integration program

NASA Technical Reports Server (NTRS)

Sharma, O. P.; Kopper, F. C.; Knudsen, L. K.; Yustinich, J. B.

1982-01-01

A subsonic cascade test program was conducted to provide technical data for optimizing the blade and vane airfoil designs for the Energy Efficient Engine Low-Pressure Turbine component. The program consisted of three parts. The first involved an evaluation of the low-chamber inlet guide vane. The second, was an evaluation of two candidate aerodynamic loading philosophies for the fourth blade root section. The third part consisted of an evaluation of three candidate airfoil geometries for the fourth blade mean section. The performance of each candidate airfoil was evaluated in a linear cascade configuration. The overall results of this study indicate that the aft-loaded airfoil designs resulted in lower losses which substantiated Pratt & Whitney Aircraft's design philosophy for the Energy Efficient Engine low-pressure turbine component.

Worker Education Program 1994-97. Final Evaluation Report.

ERIC Educational Resources Information Center

Larson, Katherine E.

An evaluation examined the efficacy of the program structure, implementation, and outcomes of the Worker Education Program (WEP), a partnership of Northeastern Illinois University; Union of Needletrades, Industrial, and Textile Employees; and 14 employers. WEP's greatest strengths were its conceptual design, program structures, relevant…

Planning Educational Programs: An Evaluation Report for the Occupational Exploration Program.

ERIC Educational Resources Information Center

Altschuld, James W.; Pritz, Sandra

The evaluation report is one of seven produced for the Occupational Exploration Program (OEP), a series of simulated occupational experiences designed for junior high school students. Describing the pilot testing of the simulation dealing with education, the report contains sections describing the simulation context, evaluation procedures,…

Interrupted Time Series Analysis: A Research Technique for Evaluating Social Programs for the Elderly

ERIC Educational Resources Information Center

Calsyn, Robert J.; And Others

1977-01-01

After arguing that treatment programs for the elderly need to be evaluated with better research designs, the authors illustrate how interrupted time series analysis can be used to evaluate programs for the elderly when random assignment to experimental and control groups is not possible. (Author)

Cost Analysis for Educational Program Evaluation.

ERIC Educational Resources Information Center

Haller, Emil J.

Concerned with the problem of determining program costs as part of the evaluation process, this article helps the practitioner arrive at useful conceptions of the term "cost" and procedures for assessing the costs of an educational program. Its purpose is to help design costing procedures for evaluation situations that are commonly encountered. An…

A Program Evaluation of a Leadership Academy for School Principals

ERIC Educational Resources Information Center

Wagner, Kristi E.

2014-01-01

This program evaluation focused on mid-range outcomes of a leadership academy for school principals. The mixed-methods evaluation included interviews, principals' instructional observation database, and teacher surveys. The Principal Academy program was designed to build principals' knowledge of high-yield instructional strategies (Hattie, 2009),…

7 CFR 1485.20 - Financial management, reports, evaluations and appeals.

Code of Federal Regulations, 2011 CFR

2011-01-01

.... (ii) A brand promotion evaluation is a review of the U.S. and foreign commercial entities' export... of the program to determine the effectiveness of the participant's strategy in meeting specified... program evaluation's findings and recommendations and proposed changes in program strategy or design as a...

Model-based optimal design of experiments - semidefinite and nonlinear programming formulations

PubMed Central

Duarte, Belmiro P.M.; Wong, Weng Kee; Oliveira, Nuno M.C.

2015-01-01

We use mathematical programming tools, such as Semidefinite Programming (SDP) and Nonlinear Programming (NLP)-based formulations to find optimal designs for models used in chemistry and chemical engineering. In particular, we employ local design-based setups in linear models and a Bayesian setup in nonlinear models to find optimal designs. In the latter case, Gaussian Quadrature Formulas (GQFs) are used to evaluate the optimality criterion averaged over the prior distribution for the model parameters. Mathematical programming techniques are then applied to solve the optimization problems. Because such methods require the design space be discretized, we also evaluate the impact of the discretization scheme on the generated design. We demonstrate the techniques for finding D–, A– and E–optimal designs using design problems in biochemical engineering and show the method can also be directly applied to tackle additional issues, such as heteroscedasticity in the model. Our results show that the NLP formulation produces highly efficient D–optimal designs but is computationally less efficient than that required for the SDP formulation. The efficiencies of the generated designs from the two methods are generally very close and so we recommend the SDP formulation in practice. PMID:26949279

Model-based optimal design of experiments - semidefinite and nonlinear programming formulations.

PubMed

Duarte, Belmiro P M; Wong, Weng Kee; Oliveira, Nuno M C

2016-02-15

We use mathematical programming tools, such as Semidefinite Programming (SDP) and Nonlinear Programming (NLP)-based formulations to find optimal designs for models used in chemistry and chemical engineering. In particular, we employ local design-based setups in linear models and a Bayesian setup in nonlinear models to find optimal designs. In the latter case, Gaussian Quadrature Formulas (GQFs) are used to evaluate the optimality criterion averaged over the prior distribution for the model parameters. Mathematical programming techniques are then applied to solve the optimization problems. Because such methods require the design space be discretized, we also evaluate the impact of the discretization scheme on the generated design. We demonstrate the techniques for finding D -, A - and E -optimal designs using design problems in biochemical engineering and show the method can also be directly applied to tackle additional issues, such as heteroscedasticity in the model. Our results show that the NLP formulation produces highly efficient D -optimal designs but is computationally less efficient than that required for the SDP formulation. The efficiencies of the generated designs from the two methods are generally very close and so we recommend the SDP formulation in practice.

Residential family treatment for parents with substance use disorders who are involved with child welfare: two perspectives on program design, collaboration, and sustainability.

PubMed

Hammond, Gretchen Clark; McGlone, Amanda

2013-01-01

This article discusses the service design, implementation, and evaluation findings of two residential family treatment programs: Wayside House (MN) and OnTrack (OR). Both programs specialize in family-centered services for adults with substance use disorders (SUD) who are involved with child welfare. Information on program design, services offered, and key collaborations are detailed. Implications for program sustainability are provided.

The Design, Implementation, and Formative Evaluation of a Classroom Aide Professional Development Training Program

ERIC Educational Resources Information Center

Dulfer, Katherine J.

2013-01-01

This dissertation focused on the process of designing, implementing, and formatively evaluating an eight week Classroom Aide Professional Development Training Program (CAPD-TP) on behavior management and academic instruction within the context of a New Jersey state approved private special education school for students with behavioral and/or…

Removing a Nail from the Boot Camp Coffin: An Outcome Evaluation of Minnesota's Challenge Incarceration Program

ERIC Educational Resources Information Center

Duwe, Grant; Kerschner, Deborah

2008-01-01

Using a retrospective, quasiexperimental design, this study evaluates Minnesota's Challenge Incarceration Program (CIP), examining whether it has lowered recidivism and saved money. In addition to utilizing a lengthy follow-up period and multiple measures of recidivism and participation, a multistage sampling design was employed to create a…

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

NASA Astrophysics Data System (ADS)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will provide insight into how a mixed methods approach was used to provide stakeholders with important information about progress toward program goals. Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed approaches. Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. D. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Stern, E; Stame, N; Mayne, J; Forss, K; Davis, R & Befani, B (2012) Broadening the range of designs and methods for impact evaluation. Department for International Development.

Impact Evaluation of the U.S. Department of Education's Student Mentoring Program. Final Report. NCEE 2009-4047

ERIC Educational Resources Information Center

Bernstein, Lawrence; Rappaport, Catherine Dun; Olsho, Lauren; Hunt, Dana; Levin, Marjorie

2009-01-01

This report summarizes the findings from a national evaluation of mentoring programs funded under the U.S. Department of Education's Student Mentoring Program. The impact evaluation used an experimental design in which students were randomly assigned to a treatment or control group. Thirty-two purposively selected School Mentoring Programs and…

The Positive Alternative Credit Experience (PACE) Program a Quantitative Comparative Study

ERIC Educational Resources Information Center

Warren, Rebecca Anne

2011-01-01

The purpose of this quantitative comparative study was to evaluate the Positive Alternative Credit Experience (PACE) Program using an objectives-oriented approach to a formative program evaluation. The PACE Program was a semester-long high school alternative education program designed to serve students at-risk for academic failure or dropping out…

Small, high pressure ratio compressor: Aerodynamic and mechanical design

NASA Technical Reports Server (NTRS)

Bryce, C. A.; Erwin, J. R.; Perrone, G. L.; Nelson, E. L.; Tu, R. K.; Bosco, A.

1973-01-01

The Small, High-Pressure-Ratio Compressor Program was directed toward the analysis, design, and fabrication of a centrifugal compressor providing a 6:1 pressure ratio and an airflow rate of 2.0 pounds per second. The program consists of preliminary design, detailed areodynamic design, mechanical design, and mechanical acceptance tests. The preliminary design evaluate radial- and backward-curved blades, tandem bladed impellers, impeller-and diffuser-passage boundary-layer control, and vane, pipe, and multiple-stage diffusers. Based on this evaluation, a configuration was selected for detailed aerodynamic and mechanical design. Mechanical acceptance test was performed to demonstrate that mechanical design objectives of the research package were met.

Locomotive cab design development. Volume 5 : performance evaluation tests

DOT National Transportation Integrated Search

1976-09-01

This document reports on a preiiminary evaluation o f the Buman : Factors design proposed for a line haul freight locomotive : cab . The program was conducted using a full scale hard mock-up : o f the proposed design and the evaluation was provided b...

Structuring an Internal Evaluation Process.

ERIC Educational Resources Information Center

Gordon, Sheila C.; Heinemann, Harry N.

1980-01-01

The design of an internal program evaluation system requires (1) formulation of program, operational, and institutional objectives; (2) establishment of evaluation criteria; (3) choice of data collection and evaluation techniques; (4) analysis of results; and (5) integration of the system into the mainstream of operations. (SK)

Program Evaluation of Services for the Homeless: Challenges and Strategies.

ERIC Educational Resources Information Center

Mercier, Celine; And Others

1992-01-01

Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)

Causal inferences on the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges.

PubMed

Chatterji, Madhabi

2016-12-01

This paper explores avenues for navigating evaluation design challenges posed by complex social programs (CSPs) and their environments when conducting studies that call for generalizable, causal inferences on the intervention's effectiveness. A definition is provided of a CSP drawing on examples from different fields, and an evaluation case is analyzed in depth to derive seven (7) major sources of complexity that typify CSPs, threatening assumptions of textbook-recommended experimental designs for performing impact evaluations. Theoretically-supported, alternative methodological strategies are discussed to navigate assumptions and counter the design challenges posed by the complex configurations and ecology of CSPs. Specific recommendations include: sequential refinement of the evaluation design through systems thinking, systems-informed logic modeling; and use of extended term, mixed methods (ETMM) approaches with exploratory and confirmatory phases of the evaluation. In the proposed approach, logic models are refined through direct induction and interactions with stakeholders. To better guide assumption evaluation, question-framing, and selection of appropriate methodological strategies, a multiphase evaluation design is recommended. Copyright © 2016 Elsevier Ltd. All rights reserved.

Impact Evaluation of Service Programs: Three Flexible Designs.

ERIC Educational Resources Information Center

McKillip, Jack

1979-01-01

Flexibility in evaluative research design does not necessitate the abandonment of randomly constructed comparison groups. Three designs are reviewed which provide at least the option of randomization while maintaining great flexibility. The strengths and weaknesses of the designs are discussed. (Author)

7 CFR 1709.216 - Evaluation criteria and weights.

Code of Federal Regulations, 2013 CFR

2013-01-01

... announcement. (a) Program Design. Reviewers will consider the financial viability of the applicant's revolving... less severe physical and economic challenges. (c) Program evaluation and performance measures...

7 CFR 1709.216 - Evaluation criteria and weights.

Code of Federal Regulations, 2010 CFR

2010-01-01

... announcement. (a) Program Design. Reviewers will consider the financial viability of the applicant's revolving... less severe physical and economic challenges. (c) Program evaluation and performance measures...

7 CFR 1709.216 - Evaluation criteria and weights.

Code of Federal Regulations, 2012 CFR

2012-01-01

... announcement. (a) Program Design. Reviewers will consider the financial viability of the applicant's revolving... less severe physical and economic challenges. (c) Program evaluation and performance measures...

7 CFR 1709.216 - Evaluation criteria and weights.

Code of Federal Regulations, 2011 CFR

2011-01-01

... announcement. (a) Program Design. Reviewers will consider the financial viability of the applicant's revolving... less severe physical and economic challenges. (c) Program evaluation and performance measures...

7 CFR 1709.216 - Evaluation criteria and weights.

Code of Federal Regulations, 2014 CFR

2014-01-01

... announcement. (a) Program Design. Reviewers will consider the financial viability of the applicant's revolving... less severe physical and economic challenges. (c) Program evaluation and performance measures...

Effects of a School-Based Sexuality Education Program on Peer Educators: The Teen PEP Model

ERIC Educational Resources Information Center

Jennings, J. M.; Howard, S.; Perotte, C. L.

2014-01-01

This study evaluated the impact of the Teen Prevention Education Program (Teen PEP), a peer-led sexuality education program designed to prevent unintended pregnancy and sexually transmitted infections (STIs) including HIV among high school students. The study design was a quasi-experimental, nonrandomized design conducted from May 2007 to May…

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

PubMed Central

KOJURI, JAVAD; AMINI, MITRA; KARIMIAN, ZAHRA; DEHGHANI, MOHAMMAD REZA; SABER, MAHBOOBEH; BAZRAFCAN, LEILA; EBRAHIMI, SEDIGHEH; REZAEE, RITA

2015-01-01

Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396). Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusions: Our faculty development program  have a significant positive effect on medical university teaching staff members’ competencies. Further research is needed to investigate whether the faculty development program actually results in improved teaching performance. PMID:25587548

The Validity and Precision of the Comparative Interrupted Time Series Design and the Difference-in-Difference Design in Educational Evaluation

ERIC Educational Resources Information Center

Somers, Marie-Andrée; Zhu, Pei; Jacob, Robin; Bloom, Howard

2013-01-01

In this paper, we examine the validity and precision of two nonexperimental study designs (NXDs) that can be used in educational evaluation: the comparative interrupted time series (CITS) design and the difference-in-difference (DD) design. In a CITS design, program impacts are evaluated by looking at whether the treatment group deviates from its…

Program Evaluation of Math Factual Operations for Understanding

ERIC Educational Resources Information Center

Rouse, Julie A.

2013-01-01

Deficiencies in mathematics standardized test scores prompted school district policymakers to consider implementing a program designed to increase students' basic multiplication fact skills. This study was an evaluation of the Math Factual Operations for Understanding program. The program, marketed with a martial arts theme, was intended to…

SPECS 2. Component Two: Program Budgeting and Cost Accounting.

ERIC Educational Resources Information Center

DuVall, Lloyd A.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. Component…

Using EPAS[TM] to Evaluate School-Based Intervention Programs: GEAR UP. Case Study

ERIC Educational Resources Information Center

ACT, Inc., 2007

2007-01-01

This brief examines how the ACT's EPAS[TM] (Educational Planning and Assessment System) can be used to evaluate school-based intervention programs. Specific evaluation considered is that of the federal government's Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP), an initiative designed to increase the college awareness…

Leveraging Volunteers: An Experimental Evaluation of a Tutoring Program for Struggling Readers

ERIC Educational Resources Information Center

Jacob, Robin; Armstrong, Catherine; Bowden, A. Brooks; Pan, Yilin

2016-01-01

This study evaluates the impacts and costs of the Reading Partners program, which uses community volunteers to provide one-on-one tutoring to struggling readers in under-resourced elementary schools. The evaluation uses an experimental design. Students were randomly assigned within 19 different Reading Partners sites to a program or control…

Using System Dynamics as an Evaluation Tool: Experience from a Demonstration Program

ERIC Educational Resources Information Center

Fredericks, Kimberly A.; Deegan, Michael; Carman, Joanne G.

2008-01-01

Evaluators are often faced with many challenges in the design and implementation of a program's evaluation. Because programs are entangled in complex networks of structures and stakeholders, they can be challenging to understand, and they often pose issues of competing and conflicting goals. However, by using a systems mapping approach to…

Implementation of the Career Education Incentive Act. First Interim Report on the Evaluability Assessment.

ERIC Educational Resources Information Center

Jung, Steven M.; And Others

Survey activities are reported which were designed to provide the foundation for a national evaluation of the effectiveness of programs assisted under the Career Education Incentive Act of 1977 (PL 95-207). The methodology described, called "program evaluability assessment," focuses on detailed analysis of program assumptions in order to…

75 FR 43172 - Maternal, Infant, and Early Childhood Home Visiting Program

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-23

... the evaluation results have been published in a peer-reviewed journal; or (bb) quasi-experimental... design (i.e. randomized controlled trial [RCT] or quasi-experimental design [QED]), level of attrition... a quasi-experimental design as a study design in which sample members are selected for the program...

Pre-Employment Laboratory Education. Clothing/Fashion Design Guidebook.

ERIC Educational Resources Information Center

Texas Tech Univ., Lubbock. Home Economics Instructional Materials Center.

This guidebook is designed for use in teaching students enrolled in preemployment laboratory education (PELE) clothing/fashion design programs. The first of two major sections includes an overview for teachers on planning, conducting, and evaluating a PELE clothing/fashion design program. Specific topics discussed in section 1 include (1)…

Pre-Employment Laboratory Education. Home Furnishings/Interior Design Guidebook.

ERIC Educational Resources Information Center

Texas Tech Univ., Lubbock. Home Economics Instructional Materials Center.

This guidebook is designed for use in teaching students enrolled in pre-employment laboratory education (PELE) home furnishing/interior design programs. The first of two major sections includes an overview for teachers on planning, conducting, and evaluating a home furnishings/interior design program. Specific topics discussed in section 1 include…

Development of pressure containment and damage tolerance technology for composite fuselage structures in large transport aircraft

NASA Technical Reports Server (NTRS)

Smith, P. J.; Thomson, L. W.; Wilson, R. D.

1986-01-01

NASA sponsored composites research and development programs were set in place to develop the critical engineering technologies in large transport aircraft structures. This NASA-Boeing program focused on the critical issues of damage tolerance and pressure containment generic to the fuselage structure of large pressurized aircraft. Skin-stringer and honeycomb sandwich composite fuselage shell designs were evaluated to resolve these issues. Analyses were developed to model the structural response of the fuselage shell designs, and a development test program evaluated the selected design configurations to appropriate load conditions.

Teaching Grocery Store Purchasing Skills to Students with Intellectual Disabilities Using a Computer-Based Instruction Program

ERIC Educational Resources Information Center

Hansen, David L.; Morgan, Robert L.

2008-01-01

This research evaluated effects of a multi-media computer-based instruction (CBI) program designed to teach grocery store purchasing skills to three high-school students with intellectual disabilities. A multiple baseline design across participants used measures of computer performance mastery and grocery store probes to evaluate the CBI. All…

"On the Level". Formative Evaluation: Alone vs. Lonely. Research Report 74.

ERIC Educational Resources Information Center

Agency for Instructional Television, Bloomington, IN.

A formative evaluation was conducted of the instructional television program "Alone vs. Lonely," from "On the Level," a series of 12 lessons designed to aid secondary school students in dealing with personal and social growth. The program is designed to teach that loneliness is normal and is felt by everyone, and to suggest…

Aftershocks of Chile's Earthquake for an Ongoing, Large-Scale Experimental Evaluation

ERIC Educational Resources Information Center

Moreno, Lorenzo; Trevino, Ernesto; Yoshikawa, Hirokazu; Mendive, Susana; Reyes, Joaquin; Godoy, Felipe; Del Rio, Francisca; Snow, Catherine; Leyva, Diana; Barata, Clara; Arbour, MaryCatherine; Rolla, Andrea

2011-01-01

Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

76 FR 50969 - Further Inquiry Into Four Issues in the Universal Service Lifeline/Link Up Reform and...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-17

... Commission structure the pilot program so that each individual participant tests multiple design elements (e...: designing and implementing a Lifeline/Link Up broadband pilot program to evaluate whether and how Lifeline...; control the size of the program; strengthen program administration and accountability; improve enrollment...

A Faculty Development Program for Nurse Educators Learning to Teach Online

ERIC Educational Resources Information Center

Lee, Debra; Paulus, Trena M.; Loboda, Iryna; Phipps, Gina; Wyatt, Tami H.; Myers, Carole R.; Mixer, Sandra J.

2010-01-01

As the College of Nursing at the University of Tennessee, Knoxville prepared to move their graduate programs online, a nursing faculty grass-roots movement led to the implementation of a faculty development program. This instructional design portfolio describes the design, development, implementation, and evaluation of this program, with the goal…

Evaluation of a Behavior Management Training Program for Nursing Home Caregivers.

ERIC Educational Resources Information Center

Marsiske, Michael; And Others

This study examined the effectiveness of a new skills training program designed to increase nurse aides' knowledge of behavior management. The training program, designed as five 90-minute group learning modules, was implemented in two Western Pennsylvania nursing homes over a 5-month period. Topics covered within the training program included…

A standards-based formative evaluation of a national professional development program for science teachers

NASA Astrophysics Data System (ADS)

Raphael, Carol Greco

2002-09-01

The 1996 National Science Education Standards provided educators and policy makers with a major impetus for constructive change in science education. The Standards not only specified what science content should be taught, but also provided organization for future science curricula. A major theme that pervades the Standards is that the classroom teacher is the most important component of classroom change and that reform efforts should be directed at improving the teaching of science through professional development for science teachers. In response to the National Science Education Standards, the Science Teachers Organization (pseudonym) prepared a professional development program for science teachers that was intended to acquaint teachers with the Standards and bring about reform of science teaching by changing teachers' instructional strategies and procedures. This program, named Preparing Schools for Science (PSS), was designed for use in all of the 50 states, but was first introduced in a southwestern state referred to as Utopia in this dissertation. Using the Provus Method of Discrepancy Evaluation, a design and installation audit of the Preparing Schools for Science Program was performed. Suggestions for program improvement, as well as a complete evaluation design for the PSS Program, were presented. Specific program modifications suggested by the research included an improved organization of personnel to monitor and supervise the program, more sustained professional development workshops, a stronger network of support for teachers. Five major implications for future professional development programs emerge from this research. (1) A needs analysis should be conducted before a program is designed in order to ensure that the program meet the needs of those for whom it is intended. (2) The length and type of training are the most important factors in ensuring that teachers have sufficient time to incorporate and learn how to use new ideas. (3) Additional personnel are needed to conduct the training and follow-up with the Points of Contact (POCs) in the Program. (4) Financial support for the Key Leaders who serve as trainers of the points of contact is needed to provide the means for the key leaders to fully implement the program and maintain contact with the POCs. (5) The program should have a thorough and well-planned evaluation design, and data collection should be done in a timely fashion by a skilled evaluator.

Handbook in Evaluating with Photography.

ERIC Educational Resources Information Center

Templin, Patricia A.

This handbook is intended to help educational evaluators use still photography in designing, conducting, and reporting evaluations of educational programs. It describes techniques for using a visual documentary approach to program evaluation that features data collected with a camera. The emphasis is on the aspects of educational evaluation…

DIGIMEN, optical mass memory investigations, volume 2

NASA Technical Reports Server (NTRS)

1977-01-01

The DIGIMEM phase of the Optical Mass Memory Investigation Program addressed problems related to the analysis, design, and implementation of a direct digital optical recorder/reproducer. Effort was placed on developing an operational archival mass storage system to support one or more key NASA missions. The primary activity of the DIGIMEM program phase was the design, fabrication, and test and evaluation of a breadboard digital optical recorder/reproducer. Starting with technology and subsystem perfected during the HOLOMEM program phase, a fully operational optical spot recording breadboard that met or exceeded all program goals was evaluated. A thorough evaluation of several high resolution electrophotographic recording films was performed and a preliminary data base management/end user requirements survey was completed.

An Evaluative Overview of the Gloria Floyd Community School Academic Excellence Program.

ERIC Educational Resources Information Center

Dade County Public Schools, Miami, FL. Office of Educational Accountability.

The Gloria Floyd Academic Excellence Program (AEP) was designed as a school-based enrichment program for average and above-average students in grades one through six. The evaluation of this program involved discussions with the school administrator and program teacher, as well as a questionnaire-survey of AEP students, their parents, and regular…

The Intentional Design of a SoTL Initiative

ERIC Educational Resources Information Center

Amundsen, Cheryl; Emmioglu, Esma; Hotton, Veronica; Hum, Gregory; Xin, Cindy

2016-01-01

This chapter describes a SoTL program at Simon Fraser University that focuses on the importance of analyzing the internal coherence and alignment of the program design and the thinking underpinning the design as the first steps in evaluating effectiveness or impact.

Assessing the present state and potential of Medicaid controlled substance lock-in programs.

PubMed

Roberts, Andrew W; Skinner, Asheley Cockrell

2014-05-01

Nonmedical use of prescription medications--particularly controlled substances--has risen dramatically in recent decades, resulting in alarming increases in overdose-related health care utilization, costs, and mortality. The Centers for Disease Control and Prevention estimate that 80% of abused and misused controlled substances originate as legal prescriptions. As such, policymakers and payers have the opportunity to combat nonmedical use by regulating controlled substance accessibility within legal prescribing and dispensing processes. One common policy strategy is found in Medicaid controlled substance lock-in programs. Lock-in programs identify Medicaid beneficiaries exhibiting high-risk controlled substance seeking behavior and "lock in" these patients to, typically, a single prescriber and pharmacy from which they may obtain Medicaid-covered controlled substance prescriptions. Lock-in restrictions are intended to improve care coordination between providers, reduce nonmedical use behaviors, and limit Medicaid costs stemming from nonmedical use and diversion. Peer-reviewed and gray literature have been examined to assess the current prevalence and design of Medicaid lock-in programs, as well as the current evidence base for informing appropriate program design and understanding program effectiveness. Forty-six state Medicaid agencies currently operate lock-in programs. Program design varies widely between states in terms of defining high-risk controlled substance use, the scope of actual lock-in restrictions, and length of program enrollment. Additionally, there is a remarkable dearth of peer-reviewed literature evaluating the design and effectiveness of Medicaid lock-in programs. Nearly all outcomes evidence stemmed from publicly accessible internal Medicaid program evaluations, which largely investigated cost savings to the state. Lock-in programs are highly prevalent and poised to play a meaningful role in curbing the prescription drug abuse epidemic. However, achieving these ends requires a concerted effort from the academic and policy communities to rigorously evaluate the effect of lock-in programs on patient outcomes, determine optimal program design, and explore opportunities to enhance lock-in program impact through coordination with parallel controlled substance policy efforts, namely prescription drug-monitoring programs.

Information Management Strategies for Program Tracking and Formative Evaluation

NASA Astrophysics Data System (ADS)

Siegfried, D.; Detrick, L.; Valaitis, S.; Johnson, A.; Thomas, S. H.; Fauver, A.

2013-05-01

The Institute for Broadening Participation (IBP) has developed information management systems to facilitate programmatic formative evaluation, tracking and outreach activities. Nearly a decade of design solutions and technical implementations in support of IBP's professional development and mentoring programs for students (including the "Pathways to Ocean Science," "Minorities Striving and Pursuing Higher Degrees of Success" in Earth System Science, and "Pathways to Engineering") has provided IBP with a toolbox of proven strategies for addressing program engagement and participant tracking, outreach, and a variety of other information management needs. In this session, IBP will use case-specific examples to share general design strategies for program participant and activities data collection in REUs and other program types. The cases will illustrate an approach that begins with a review of program logic, objectives, expected outcomes, constraints and requirements, which then informs a comprehensive system design. When implemented, such information systems improve administrative efficiency through streamlined data collection processes and easy-to-use data capture forms, and a corresponding set of reporting tools provides access to data that is crucial for ongoing program improvement. IBP presents this information in response to collaborations with administrators of Research Experience for Undergraduates (REU) programs as well as longer duration programs, who have expressed the need for more comprehensive and easy to use information systems. Recently IBP has also worked with the directors of NSF and NASA funded programs seeking assistance in addressing their formative evaluation needs including system design, information collection, and reporting efforts.

Is the Closet Door Still Closed in 2014? A CIPP Model Program Evaluation of Preservice Diversity Training Regarding LGBT Issues

ERIC Educational Resources Information Center

Woodruff, Joseph

2014-01-01

The purpose of this program evaluation was to examine the four components of the CIPP evaluation model (Context, Input, Process, and Product evaluations) in the diversity training program conceptualization and design delivered to College of Education K-12 preservice teachers at a large university in the southeastern United States (referred to in…

An Ex-Post Facto Examination of Relationships among the Developmental Designs Professional Development Model/Classroom Management Approach, School Leadership, Climate, Student Achievement, Attendance, and Behavior in High Poverty, Middle Grades Schools

ERIC Educational Resources Information Center

Hough, David L.; Schmitt, Vicki L.

2011-01-01

This study reports finding from an ex post facto causal-comparison study utilizing data from a multifaceted program evaluation of a professional development approach to classroom management known as Development Designs 1 and Developmental Designs 2 (DD1 & D2). Data from this program evaluation indicate that teachers implement a number of classroom…

"I Am Not a Big Man": Evaluation of the Issue Investigation Program

ERIC Educational Resources Information Center

Cincera, Jan; Simonova, Petra

2017-01-01

The article evaluates a Czech environmental education program focused on developing competence in issue investigation. In the evaluation, a simple quasi-experimental design with experimental (N = 200) and control groups was used. The results suggest that the program had a greater impact on girls than on boys, and that it increased their internal…

A Mixed Methods Approach to Understanding School Counseling Program Evaluation: High School Counselors' Methods and Perceptions

ERIC Educational Resources Information Center

Aucoin, Jennifer Mangrum

2013-01-01

The purpose of this mixed methods concurrent triangulation study was to examine the program evaluation practices of high school counselors. A total of 294 high school counselors in Texas were assessed using a mixed methods concurrent triangulation design. A researcher-developed survey, the School Counseling Program Evaluation Questionnaire…

Annual Evaluation: Elementary and Secondary Act of 1965 - Title I, Maine, FY 1970.

ERIC Educational Resources Information Center

Maine State Dept. of Education, Augusta.

This evaluation attempts to measure the extent and effectiveness of ESEA Title I programs designed to meet the needs of disadvantaged children and apprizes the public and the legislature of program outcomes. In keeping with USOE requirements for evaluating Title I programs, this document is constructed of (1) responses to USOE probes by…

Evaluation of the Leadership Institute: A Program to Build Individual and Organizational Capacity through Emotional Intelligence

ERIC Educational Resources Information Center

Chen, Claire Yueh-Ti; King, Jeff; Cochran, Graham R.; Argabright, Karen J.

2014-01-01

The purpose of the study reported here was to evaluate the impact of Leadership Institute, a program designed to strengthen leadership capacity through developing individuals' emotional intelligence (EQ). A pre-and posttest approach was used to collect data from two workshops with identical EQ content, program structure, and evaluation.…

Cancer Education Program Evaluation: A Responsive Approach to Planning an Evaluation and Initial Results.

ERIC Educational Resources Information Center

Pearsol, James A.

This paper describes evaluation planning for the Cancer Education Program (CEP) at Ohio State University (OSU). The three-year OSU CEP project was designed as a multidisciplinary cancer education program. A responsive method, which trades off some measurement precision in order to increase the usefulness of the findings, was employed in the…

Listening for the Squeaky Wheel: Designing Distance Writing Program Assessment

ERIC Educational Resources Information Center

Tucker, Virginia M.

2012-01-01

Distance writing programs still struggle with assessment strategies that can evaluate student writing as well as their ability to communicate about that writing with peers at a distance. This article uses Kim, Smith and Maeng's 2008 distance education program assessment scheme to evaluate a single distance writing program at Old Dominion…

Evaluating Mentoring Programs. P/PV Brief

ERIC Educational Resources Information Center

Grossman, Jean Baldwin

2009-01-01

This methodological brief is designed to provide both program operators and researchers with practical advice about how to assess a program's implementation and impact. Adapted from an article that first appeared in "The Handbook of Youth Mentoring" (DuBois and Karcher, ed. 2005), the brief focuses on the evaluation of mentoring programs, but the…

California's Past Programs to Support School and District Improvement: A Synthesis of Evaluation Studies

ERIC Educational Resources Information Center

California Collaborative on District Reform, 2017

2017-01-01

This document synthesizes the findings from the evaluations of four statewide programs designed to provide support for underperforming schools and districts in California as part of the state accountability system: (1) Immediate Intervention/Underperforming Schools Program (II/USP); (2) High Priority Schools Grant (HPSG) Program; (3) School…

Toward More Precise Definition and Evaluation of Televised Educational Programming

ERIC Educational Resources Information Center

Aversa Fran; Morrison, Gary R.

1978-01-01

An operational definition of public television programming and its implications for development and production agencies is sorely needed. This article explores some of the components of such a definition and examines the differences in several types of educational programming in terms of specific design and evaluation variables of the program.…

Does Implementation Follow Design? A Case Study of a Workplace Health Promotion Program Using the 4-S Program Design and the PIPE Impact Metric Evaluation Models.

PubMed

Äikäs, Antti Hermanni; Pronk, Nicolaas P; Hirvensalo, Mirja Hannele; Absetz, Pilvikki

2017-08-01

The aim of this study was to describe the content of a multiyear market-based workplace health promotion (WHP) program and to evaluate design and implementation processes in a real-world setting. Data was collected from the databases of the employer and the service provider. It was classified using the 4-S (Size, Scope, Scalability, and Sustainability) and PIPE Impact Metric (Penetration, Implementation) models. Data analysis utilized both qualitative and quantitative methods. Program design covered well the evidence-informed best practices except for clear path toward sustainability, cooperation with occupational health care, and support from middle-management supervisors. The penetration rate among participants was high (99%) and majority (81%) of services were implemented as designed. Study findings indicate that WHP market would benefit the use of evidence-based design principles and tendentious decisions to anticipate a long-term implementation process already during the planning phase.

Does Implementation Follow Design? A Case Study of a Workplace Health Promotion Program Using the 4-S Program Design and the PIPE Impact Metric Evaluation Models

PubMed Central

Äikäs, Antti Hermanni; Pronk, Nicolaas P.; Hirvensalo, Mirja Hannele; Absetz, Pilvikki

2017-01-01

Objective: The aim of this study was to describe the content of a multiyear market-based workplace health promotion (WHP) program and to evaluate design and implementation processes in a real-world setting. Methods: Data was collected from the databases of the employer and the service provider. It was classified using the 4-S (Size, Scope, Scalability, and Sustainability) and PIPE Impact Metric (Penetration, Implementation) models. Data analysis utilized both qualitative and quantitative methods. Results: Program design covered well the evidence-informed best practices except for clear path toward sustainability, cooperation with occupational health care, and support from middle-management supervisors. The penetration rate among participants was high (99%) and majority (81%) of services were implemented as designed. Conclusion: Study findings indicate that WHP market would benefit the use of evidence-based design principles and tendentious decisions to anticipate a long-term implementation process already during the planning phase. PMID:28665839

Scheduling Algorithm for Mission Planning and Logistics Evaluation (SAMPLE). Volume 3: The GREEDY algorithm

NASA Technical Reports Server (NTRS)

Dupnick, E.; Wiggins, D.

1980-01-01

The functional specifications, functional design and flow, and the program logic of the GREEDY computer program are described. The GREEDY program is a submodule of the Scheduling Algorithm for Mission Planning and Logistics Evaluation (SAMPLE) program and has been designed as a continuation of the shuttle Mission Payloads (MPLS) program. The MPLS uses input payload data to form a set of feasible payload combinations; from these, GREEDY selects a subset of combinations (a traffic model) so all payloads can be included without redundancy. The program also provides the user a tutorial option so that he can choose an alternate traffic model in case a particular traffic model is unacceptable.

RBS Career Education. Evaluation Planning Manual. Education Is Going to Work.

ERIC Educational Resources Information Center

Kershner, Keith M.

Designed for use with the Research for Better Schools career education program, this evaluation planning manual focuses on procedures and issues central to planning the evaluation of an educational program. Following a statement on the need for evaluation, nine sequential steps for evaluation planning are discussed. The first two steps, program…

Computer aided airship design

NASA Technical Reports Server (NTRS)

Davis, S. J.; Rosenstein, H.

1975-01-01

The Comprehensive Airship Sizing and Performance Computer Program (CASCOMP) is described which was developed and used in the design and evaluation of advanced lighter-than-air (LTA) craft. The program defines design details such as engine size and number, component weight buildups, required power, and the physical dimensions of airships which are designed to meet specified mission requirements. The program is used in a comparative parametric evaluation of six advanced lighter-than-air concepts. The results indicate that fully buoyant conventional airships have the lightest gross lift required when designed for speeds less than 100 knots and the partially buoyant concepts are superior above 100 knots. When compared on the basis of specific productivity, which is a measure of the direct operating cost, the partially buoyant lifting body/tilting prop-rotor concept is optimum.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

PubMed

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

The Promise and Challenge of Practice-Research Collaborations: Guiding Principles and Strategies for Initiating, Designing, and Implementing Program Evaluation Research

ERIC Educational Resources Information Center

Secret, Mary; Abell, Melissa L.; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations,…

The Boston Middle School-Corner Store Initiative: Development, Implementation, and Initial Evaluation of a Program Designed to Improve Adolescents' Beverage-Purchasing Behaviors

ERIC Educational Resources Information Center

Hoffman, Jessica A.; Morris, Vivien; Cook, John

2009-01-01

The Boston Middle School Corner Store Initiative (CSI) brought together schools, businesses, and community partners to develop, implement, and evaluate a multicomponent pilot program designed to promote healthier beverage purchasing at corner stores among 3,500 middle school students living in Boston, Massachusetts. Healthy drinks were defined for…

Evaluation of an Alcohol Risk Reduction Program (PRIME for Life) in Young Swedish Military Conscripts

ERIC Educational Resources Information Center

Hallgren, Mats A.; Kallmen, Hakan; Leifman, Hakan; Sjolund, Torbjorn; Andreasson, Sven

2009-01-01

Purpose: The purpose of this paper is to evaluate the effectiveness of the PRIME for Life risk reduction program in reducing alcohol consumption and improving knowledge and attitudes towards alcohol use in male Swedish military conscripts, aged 18 to 22 years. Design/methodology/approach: A quasi-experimental design was used in which 1,371…

An Evaluation of the Model School Division (MSD) Preschool Program for the School Year 1973-74.

ERIC Educational Resources Information Center

District of Columbia Public Schools, Washington, DC. Dept. of Research and Evaluation.

This study was designed to assess the extent to which children served by the Model Schools Division Preschool Program developed socially, intellectually, physically and emotionally during the 1973-74 school year. This evaluation was also designed to measure the appropriateness of the learning environment and the amount of services provided by the…

Can Broad Inferences Be Drawn from Lottery Analyses of School Choice Programs? An Exploration of Appropriate Sensitivity Analyses

ERIC Educational Resources Information Center

Zimmer, Ron; Engberg, John

2016-01-01

School choice programs continue to be controversial, spurring a number of researchers into evaluating them. When possible, researchers evaluate the effect of attending a school of choice using randomized designs to eliminate possible selection bias. Randomized designs are often thought of as the gold standard for research, but many circumstances…

Logic Models for Program Design, Implementation, and Evaluation: Workshop Toolkit. REL 2015-057

ERIC Educational Resources Information Center

Shakman, Karen; Rodriguez, Sheila M.

2015-01-01

The Logic Model Workshop Toolkit is designed to help practitioners learn the purpose of logic models, the different elements of a logic model, and the appropriate steps for developing and using a logic model for program evaluation. Topics covered in the sessions include an overview of logic models, the elements of a logic model, an introduction to…

Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program: Sharing a Program Model from Design and Development through Evaluation

ERIC Educational Resources Information Center

Young, Shawna; Uy, Ana; Bell, Joyce

2017-01-01

The Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program at California State University, Stanislaus provides support for student engagement in these areas from idea conception through dissemination. Through assistantships, mini-grants, the Student Research Competition, and travel grants, the Program is designed to…

The Development of a Transportable Leadership and Management Program in Higher Education.

ERIC Educational Resources Information Center

Shapiro, Joan P.; And Others

The impact of an evaluation design on the effective implementation of a training program for women in higher education leadership and management was assessed. The program was designed by the University of Pennsylvania's Higher Education Resource Services. The training program, entitled "The Next Move," was introduced at three pilot sites: a large,…

ELECTROCHEMICAL DESIGN ASSOCIATES (FORMERLY GEOKINETICS INTERNATIONAL, INC.) LEAD RECOVERY TECHNOLOGY EVALUATION ITER

EPA Science Inventory

This report presents performance and economic data from U.S. Environmental Protection Agency (EPA) Superfund Innovative Technology Evaluation (SITE) Program evaluation of Electrochemical Design Associates (EDA), formerly known as Geokinetics International Inc., Lead Recovery Tech...

Message Design Guidelines For Screen-Based Programs.

ERIC Educational Resources Information Center

Rimar, G. I.

1996-01-01

Effective message design for screen-based computer or video instructional programs requires knowledge from many disciplines. Evaluates current conventions and suggests a new set of guidelines for screen-based designers. Discusses screen layout, highlighting and cueing, text font and style, text positioning, color, and graphical user interfaces for…

Web-Based Engine for Program Curriculum Designers

ERIC Educational Resources Information Center

Hamam, H.; Loucif, S.

2009-01-01

Educational institutions pay careful attention to the design of program curricula, which represent a framework to meet institutional goals and missions. Of course, the success of any institution depends highly on the quality of its program curriculum. The development of such a curriculum and, more importantly, the evaluation of its quality are…

Health Indicators: A Tool for Program Review

ERIC Educational Resources Information Center

Abou-Sayf, Frank K.

2006-01-01

A visual tool used to evaluate instructional program performance has been designed by the University of Hawaii Community College system. The tool combines features from traffic lights, blood-chemistry test reports, and industry production control charts, and is labeled the Program Health-Indicator Chart. The tool was designed to minimize the labor…

76 FR 34246 - Automated Commercial Environment (ACE); Announcement of National Customs Automation Program Test...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-13

... CBP with authority to conduct limited test programs or procedures designed to evaluate planned... aspects of this test, including the design, conduct and implementation of the test, in order to determine... Environment (ACE); Announcement of National Customs Automation Program Test of Automated Procedures for In...

Design and demonstration of an advanced data collection/position location system

NASA Technical Reports Server (NTRS)

1977-01-01

The final report on a breadboard evaluation and demonstration program is reported concerning the applicability of MSK modulation and chirp-z transformer technology in Advanced Data Collection/Position Location (ADC/PL) systems. The program effort consisted of three phases - design, testing, and evaluation. Section 2 describes the breadboard hardware built during the design phase of the program, Section 3 describes the tests conducted on the breadboard and the results of the tests, and Section 4 presents a brief analysis and summary of the findings of the breadboard tests and develops a sample ADC/PL system which incorporates both MSK modulation and a chirp-z transformer.

EnergyWorks Final Report: A Better Buildings Neighborhood Program in the Five-County Greater Philadelphia Region

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gajewski, Katherine

2014-03-05

This report covers the grant performance period of July 1, 2010-September 30, 2013 and discusses of the program design, outcomes and best practices as they relate to the following six areas: 1. Institutional Design and Business Model; 2. Program Design and Customer Experience; 3. Driving Demand; 4. Workforce Development; 5. Financing and Incentives; 6. Data and Evaluation.

Empowerment evaluation with programs designed to prevent first-time male perpetration of sexual violence.

PubMed

Noonan, Rita K; Gibbs, Deborah

2009-01-01

This special issue captures several threads in the ongoing evolution of sexual violence prevention. The articles that follow examine an empowerment evaluation process with four promising programs dedicated to preventing first-time male perpetration of sexual violence, as well as evaluation findings. Both the evaluation approach and the programs examined shed light on how sexual violence prevention can continue to be improved in the future.

Experimental flexible pavements.

DOT National Transportation Integrated Search

1971-01-01

A program of construction and the performance evaluation of three major Virginia experimental flexible pavements is reported. The objective of the program was to evaluate the performance of pavements incorporating new or timely design concepts and to...

Conversational Skills Instruction for Communication Apprehension and Avoidance: Evaluation of a Treatment Program.

ERIC Educational Resources Information Center

Glaser, Susan R.; And Others

1983-01-01

Describes and evaluates a conversational skills program designed to teach apprehensive communicators how to develop comfortable and effective social behavior in a variety of interpersonal contexts. (PD)

Disease management interventions: what's in the black box?

PubMed

Linden, Ariel; Roberts, Nancy

2004-01-01

In discussing evaluation techniques to assess disease management (DM) program outcomes, it is often assumed that DM program interventions are premised on sound clinical judgment, an understanding of the disease process, and knowledge of the psychosocial models of behavioral change that must be used to effect those processes and ultimately improve the health outcomes that are being evaluated. This paper describes eight commonly used behavioral change models applied in the healthcare industry today. They represent programs designed to address individual, interpersonal, and community level factors as well as "packaged" comprehensive approaches. These models illustrate the breadth of approaches to consider when designing or assessing DM program interventions. Careful consideration of the type of behavioral change desired and the theories of how to effect such change should be an integral part of designing disease management program interventions.

Combining participatory action research and appreciative inquiry to design, deliver and evaluate an interdisciplinary continuing education program for a regional health workforce.

PubMed

Martyn, Julie-Anne; Scott, Jackie; van der Westhuyzen, Jasper H; Spanhake, Dale; Zanella, Sally; Martin, April; Newby, Ruth

2018-06-12

Objective. Continuing education (CE) is essential for a healthcare workforce, but in regional areas of Australia there are challenges to providing and accessing relevant, reliable and low-cost opportunities. The aim of the present study was to collaborate with the local regional healthcare workforce to design, deliver and evaluate an interdisciplinary CE (ICE) program. Methods. A participatory action research (PAR) model combined with an appreciative inquiry (AI) framework was used to design, deliver and evaluate an ICE program. A focus group of 11 health professionals developed an initial program. Evaluation data from 410 program participants were analysed using AI. Results. The ICE program addressed the CE barriers for the regional healthcare workforce because the locally derived content was delivered at a reasonable cost and in a convenient location. Program participants identified that they most valued shared experiences and opportunities enabling them to acquire and confirm relevant knowledge. Conclusion. ICE programs enhance interdisciplinary collaboration. However, attendance constraints for regional healthcare workforce include location, cost, workplace and personal factors. Through community engagement, resource sharing and cooperation, a local university and the interdisciplinary focus group members successfully designed and delivered the local education and research nexus program to address a CE problem for a regional healthcare workforce. What is known about the topic? Participation in CE is mandatory for most health professionals. However, various barriers exist for regional health workers to attending CE. Innovative programs, such as webinars and travelling workshops, address some of the issues but create others. Bringing various health workers together for the simultaneous education of multiple disciplines is beneficial. Collectively, this is called ICE. What does this paper add? Using PAR combined with AI to design an ICE program will focus attention on the enablers of the program and meet the diverse educational needs of the healthcare workforce in regional areas. Engaging regional health professionals with a local university to design and deliver CE is one way to increase access to quality, cost-effective education. What are the implications for practitioners? Regional healthcare workers' CE needs are more likely to be met when education programs are designed by them and developed for them. ICE raises awareness of the roles of multiple healthcare disciplines. Learning together strengthens healthcare networks by bolstering relationships through a greater understanding of each other's roles. Enriching communication between local health workers has the potential to enhance patient care.

Monitoring Program Quality: Who and How Should It Be Done?

ERIC Educational Resources Information Center

Scholl, Geraldine T.; And Others

Aspects of monitoring and evaluating programs for visually handicapped students are examined. The certification/accreditation program evaluation design is considered in terms of advantages and disadvantages. Roles of governmental (state and federal) and voluntary agencies are discussed. The functions of the National Accreditation Council of…

Automated Writing Evaluation Program's Effect on Student Writing Achievement

ERIC Educational Resources Information Center

Holman, Lester Donnie

2011-01-01

In an ex post facto causal-comparative research design, this study investigated the effectiveness of Automated Writing Evaluation (AWE) programs on raising the student writing achievement. Tennessee Comprehensive Assessment Program (TCAP) writing achievement scores from the 2010 administration were utilized for this study. The independent variable…

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

Texas Educator Excellence Grant (TEEG) Program: Year Three Evaluation Report. Policy Evaluation Report

ERIC Educational Resources Information Center

Springer, Matthew G.; Lewis, Jessica L.; Podgursky, Michael J.; Ehlert, Mark W.; Gronberg, Timothy J.; Hamilton, Laura S.; Jansen, Dennis W.; Stecher, Brian M.; Taylor, Lori L.; Lopez, Omar S.; Peng, Art

2009-01-01

The Texas Educator Excellence Grant (TEEG) program was state-funded and provided annual grants to schools to design and implement performance pay plans during the 2006-07 to 2009-10 school year. This report builds on the previous TEEG evaluation reports, presenting findings from three years of the TEEG program. Overall, the report discusses the…

A Review of Out-of-School Time Program Quasi-Experimental and Experimental Evaluation Results. Out-of-School Time Evaluation Snapshot.

ERIC Educational Resources Information Center

Little, Priscilla M. D.; Harris, Erin

As the amount of resources allocated to out-of-school (OST) programming and policymakers' demands for research-based results increase, there is increasing interest in rigorous research designs to examine OST program outcomes. This issue of "Out-of-School Time Evaluation Snapshots" reviews 27 quasi-experimental and experimental OST…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Evaluation of a Commercially Available Program and in Situ Training by Parents to Teach Abduction-Prevention Skills to Children

ERIC Educational Resources Information Center

Beck, Kimberly V.; Miltenberger, Raymond G.

2009-01-01

Child abduction is a serious problem; therefore, it is essential that researchers evaluate the efficacy of commercially available abduction-prevention programs. A multiple baseline design across participants (ages 6 to 8 years) was used to evaluate the effects of a training program, The Safe Side. Experimenters assessed safety responses in situ in…

Review and evaluation of online tobacco dependence treatment training programs for health care practitioners.

PubMed

Selby, Peter; Goncharenko, Karina; Barker, Megan; Fahim, Myra; Timothy, Valerie; Dragonetti, Rosa; Kemper, Katherine; Herie, Marilyn; Hays, J Taylor

2015-04-17

Training health care professionals is associated with increased capacity to deliver evidence-based smoking cessation interventions and increased quit rates among their patients. Online training programs hold promise to provide training but questions remain regarding the quality and usability of available programs. The aim was to assess the quality of English-language online courses in tobacco dependence treatment using a validated instrument. An environmental scan was conducted using the Google search engine to identify available online tobacco dependence treatment courses. The identified courses were then evaluated using the Peer Review Rubric for Online Learning, which was selected based on its ability to evaluate instructional design. It also has clear and concise criteria descriptions to ensure uniformity of evaluations by trained experts. A total of 39 courses were identified, of which 24 unique courses were assessed based on their accessibility and functionality during the period of evaluation. Overall, the course ratings indicated that 17 of 24 courses evaluated failed to meet minimal quality standards and none of the courses evaluated could be ranked as superior. However, many excelled in providing effective navigation, course rationale, and content. Many were weak in the use of instructional design elements, such as teaching effectiveness, learning strategies, instructor's role, and assessment and evaluation. Evaluation results and suggestions for improvement were shared with course administrators. Based on the courses evaluated in this review, course developers are encouraged to employ best practices in instructional design, such as cohesiveness of material, linearity of design, practice exercises, problem solving, and ongoing evaluation to improve existing courses and in the design of new online learning opportunities.

Early Childhood Language-Centered Intervention Program. O.E.E. Evaluation Report, 1980-1981.

ERIC Educational Resources Information Center

Tobias, Robert; Lavin, Claire

This report evaluates the Early Childhood Language-Centered Intervention Program in New York City Public Schools. The program was designed to promote the development of preschool handicapped students in a variety of areas. The program objective proposed that the target students would show statistically significant improvement at the .05 level in…

Improving Mathematics Teacher Education in Germany: Empirical Results from a Longitudinal Evaluation of Innovative Programs

ERIC Educational Resources Information Center

Buchholtz, Nils; Kaiser, Gabriele

2013-01-01

Innovative programs for restructuring the entry phase of mathematics teacher education programs have been implemented at various German universities within the last few years. This article reports about the design and the results of a longitudinal evaluation study of the effectiveness of two of these programs aiming to improve mathematics teacher…

The University of North Carolina Medical Center pharmacy resident leadership certificate program.

PubMed

Lyons, Kayley; Griggs, Danielle; Lebovic, Rachel; Roth, Mary E; South, David A; Hatfield, Chad

2017-03-15

The development and implementation of a certificate program for pharmacy residents are described. University of North Carolina (UNC) Medical Center met the call for increased efforts in the area of pharmacy residency leadership training through the design, implementation, and evaluation of a leadership certificate program. The purpose of the UNC certificate program is to develop leaders who will serve others, improve their communities, and advance the profession. The program is designed to (1) foster self-awareness, social awareness, and altruism, (2) provide transferable and individualized leadership experiences, (3) enrich other residency components through integration of leadership development opportunities, and (4) create role models for departmental leadership. A team of preceptors and residents implemented the certificate program by integrating program components into the existing pharmacy residency infrastructure. The certificate program includes required and flexible components to allow residents to set and achieve their determined leadership development goals. Overall, residents are satisfied with the program and perceive it as worthwhile. During the first 3 years since implementation of the certification initiative, program facilitators improved the feasibility of, participant engagement in, and sustainability of the program. Future directions include an effectiveness evaluation and a "scale-up" to other institutions. The need for a pharmacy residency leadership certificate was met by designing, implementing, and evaluating such a program at UNC. Through its first 3 years, the program was feasible, sustainable, and valued by program participants. Copyright © 2017 by the American Society of Health-System Pharmacists, Inc. All rights reserved.

76 FR 77538 - Family and Youth Services Bureau; Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-12-13

...) evaluation design, which will involve baseline surveys and two follow-up surveys. This will allow short- and... descriptive analysis of how States designed and implemented PREP programs. The study will use multiple methods... ``Design Survey'', will focus on how states designed programs, and the second round of interviews, known as...

Expert systems for space power supply - Design, analysis, and evaluation

NASA Technical Reports Server (NTRS)

Cooper, Ralph S.; Thomson, M. Kemer; Hoshor, Alan

1987-01-01

The feasibility of applying expert systems to the conceptual design, analysis, and evaluation of space power supplies in particular, and complex systems in general is evaluated. To do this, the space power supply design process and its associated knowledge base were analyzed and characterized in a form suitable for computer emulation of a human expert. The existing expert system tools and the results achieved with them were evaluated to assess their applicability to power system design. Some new concepts for combining program architectures (modular expert systems and algorithms) with information about the domain were applied to create a 'deep' system for handling the complex design problem. NOVICE, a code to solve a simplified version of a scoping study of a wide variety of power supply types for a broad range of missions, has been developed, programmed, and tested as a concrete feasibility demonstration.

77 FR 74392 - Direct Grant Programs and Definitions That Apply to Department Regulations

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-14

... criterion ``Quality of the Project Design''; 6. Authorize program offices to consider the effectiveness of... service providers is often an important factor in designing a project and submitting a high-quality... assisted in designing the applicant's evaluation plan. Formal competition requirements also inhibit the...

When (Not If) Evaluation Flexibility Is Desirable: Examples from the CPHPE Initiative.

ERIC Educational Resources Information Center

Hembroff, Larry; Perlstadt, Harry; Henry, Rebecca C.; Hogan, Andrew J.; Weissert, Carol S.; Bland, Carole J.; Harris, Dona L.; Knott, Jack H.; Starnaman, Sandra M.

1999-01-01

Two examples from the cluster evaluation of the W. K. Kellogg Foundation's Community Partnership for Health Professions Education illustrate why flexibility in evaluation design and activities is essential to collaborate with program directors and be responsive to program needs. (SLD)

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

NASA Astrophysics Data System (ADS)

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90 %, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

A CONTROLLED EVALUATION OF A HIGH SCHOOL BIOMEDICAL PIPELINE PROGRAM: DESIGN AND METHODS.

PubMed

Winkleby, Marilyn A; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90%, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

Key Design Considerations When Calculating Cost Savings for Population Health Management Programs in an Observational Setting.

PubMed

Murphy, Shannon M E; Hough, Douglas E; Sylvia, Martha L; Dunbar, Linda J; Frick, Kevin D

2018-02-08

To illustrate the impact of key quasi-experimental design elements on cost savings measurement for population health management (PHM) programs. Population health management program records and Medicaid claims and enrollment data from December 2011 through March 2016. The study uses a difference-in-difference design to compare changes in cost and utilization outcomes between program participants and propensity score-matched nonparticipants. Comparisons of measured savings are made based on (1) stable versus dynamic population enrollment and (2) all eligible versus enrolled-only participant definitions. Options for the operationalization of time are also discussed. Individual-level Medicaid administrative and claims data and PHM program records are used to match study groups on baseline risk factors and assess changes in costs and utilization. Savings estimates are statistically similar but smaller in magnitude when eliminating variability based on duration of population enrollment and when evaluating program impact on the entire target population. Measurement in calendar time, when possible, simplifies interpretability. Program evaluation design elements, including population stability and participant definitions, can influence the estimated magnitude of program savings for the payer and should be considered carefully. Time specifications can also affect interpretability and usefulness. © Health Research and Educational Trust.

The design and evaluation of a master of science program in anatomical sciences at Queen's University Canada.

PubMed

Kolomitro, Klodiana; MacKenzie, Leslie W; Wiercigroch, David; Godden, Lorraine

2018-05-15

The purpose of this study was to describe the design and evolution of a unique and successful Master of Science program in anatomical sciences at one Canadian post-secondary institution and to evaluate its long-term impact on student learning. This program prepares students to teach anatomy and design curricula in the anatomical sciences and is structured around three pillars of competency-content (disciplinary knowledge and transferable skills), pedagogy, and inquiry. Graduates of the program from the last ten years were surveyed, to better understand the knowledge, skills, and habits of mind they have adopted and implemented since completion. Interest was taken in identifying aspects of the program that students found particularly beneficial and areas that needed to be further developed. Based on the findings, this program has been a highly valuable experience for the graduates especially in helping them develop transferable skills, and grow as individuals. The hope is that other institutions that have similar programs in place or are considering developing them would benefit from this description of the program design and the sharing of the lessons learned. Anat Sci Educ. © 2018 American Association of Anatomists. © 2018 American Association of Anatomists.

Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centred Instructional Program in Indonesia

ERIC Educational Resources Information Center

Rahayu, Sri; Chandrasegaran, A. L.; Treagust, David F.; Kita, Masakazu; Ibnu, Suhadi

2011-01-01

This study was a mixed quantitative-qualitative research to evaluate the efficacy of a designed student-centred instructional (DSCI) program for teaching about acids and bases. The teaching innovation was designed based on constructivist, hands-on inquiry and context-based approaches and implemented in seven 45-min lessons with a class of 36 grade…

Computer program for design and performance analysis of navigation-aid power systems. Program documentation. Volume 1: Software requirements document

NASA Technical Reports Server (NTRS)

Goltz, G.; Kaiser, L. M.; Weiner, H.

1977-01-01

A computer program has been developed for designing and analyzing the performance of solar array/battery power systems for the U.S. Coast Guard Navigational Aids. This program is called the Design Synthesis/Performance Analysis (DSPA) Computer Program. The basic function of the Design Synthesis portion of the DSPA program is to evaluate functional and economic criteria to provide specifications for viable solar array/battery power systems. The basic function of the Performance Analysis portion of the DSPA program is to simulate the operation of solar array/battery power systems under specific loads and environmental conditions. This document establishes the software requirements for the DSPA computer program, discusses the processing that occurs within the program, and defines the necessary interfaces for operation.

Assuring data transparency through design methodologies

NASA Technical Reports Server (NTRS)

Williams, Allen

1990-01-01

This paper addresses the role of design methodologies and practices in the assurance of technology transparency. The development of several subsystems on large, long life cycle government programs was analyzed to glean those characteristics in the design, development, test, and evaluation that precluded or enabled the insertion of new technology. The programs examined were Minuteman, DSP, B1-B, and space shuttle. All these were long life cycle, technology-intensive programs. The design methodologies (or lack thereof) and design practices for each were analyzed in terms of the success or failure in incorporating evolving technology. Common elements contributing to the success or failure were extracted and compared to current methodologies being proposed by the Department of Defense and NASA. The relevance of these practices to the design and deployment of Space Station Freedom were evaluated. In particular, appropriate methodologies now being used on the core development contract were examined.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

Lessons from a pilot program to induce stove replacements in Chile: design, implementation and evaluation

NASA Astrophysics Data System (ADS)

Gómez, Walter; Chávez, Carlos; Salgado, Hugo; Vásquez, Felipe

2017-11-01

We present the design, implementation, and evaluation of a subsidy program to introduce cleaner and more efficient household wood combustion technologies. The program was conducted in the city of Temuco, one of the most polluted cities in southern Chile, as a pilot study to design a new national stove replacement initiative for pollution control. In this city, around 90% of the total emissions of suspended particulate matter is caused by households burning wood. We created a simulated market in which households could choose among different combustion technologies with an assigned subsidy. The subsidy was a relevant factor in the decision to participate, and the inability to secure credit was a significant constraint for the participation of low-income households. Due to several practical difficulties and challenges associated with the implementation of large-scale programs that encourage technological innovation at the household level, it is strongly advisable to start with a small-scale pilot that can provide useful insights into the final design of a fuller, larger-scale program.

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Workplace Literacy Program (WPL) at Chinatown Manpower Project, Inc. Final Evaluation.

ERIC Educational Resources Information Center

Friedenberg, Joan E.

This document describes the procedures for and results of the external evaluation of the workplace literacy program for underemployed garment industry workers with low English skills at Chinatown Manpower Project, Inc. in Chinatown in New York City. The document describes the evaluation design and methodology as well as the evaluation results,…

Program Impact Evaluations: An Introduction for Managers of Title VII Projects. A Draft Guidebook.

ERIC Educational Resources Information Center

Bissell, Joan S.

Intended to assist administrators in the planning, management, and utilization of evaluation, this guidebook is designed as an introduction and supplement to other evaluation materials for bilingual education programs being developed under federal sponsorship, including evaluation models for Title VII projects. General information is provided on…

Students Training for Academic Readiness (STAR): Year Three Evaluation Report

ERIC Educational Resources Information Center

Rainey, Katharine; Sheehan, Daniel; Maloney, Catherine

2010-01-01

This report presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation considers…

A Descriptive and Evaluative Analysis of Program Planning Literature, 1950-1983.

ERIC Educational Resources Information Center

Sork, Thomas J.; Buskey, John H.

1986-01-01

Literature that presents a complete program planning model was described and analyzed using explicitly defined and uniformly applied descriptive and evaluative dimensions. Several observations about the current state of the program planning literature are made, and recommendations designed to strengthen the literature are offered. (Author/CT)

Problems and Solutions in Evaluating Child Outcomes of Large-Scale Educational Programs.

ERIC Educational Resources Information Center

Abrams, Allan S.; And Others

1979-01-01

Evaluation of large-scale programs is problematical because of inherent bias in assignment of treatment and control groups, resulting in serious regression artifacts even with the use of analysis of covariance designs. Nonuniformity of program implementation across sites and classrooms is also a problem. (Author/GSK)

Ethnographic Evaluation of the MESA Program at a South-Central Phoenix High School.

ERIC Educational Resources Information Center

Jaramillo, James A.

MESA (Mathematics, Engineering, and Science Achievement) is a program designed to increase the number of underrepresented ethnic groups in professions related to mathematics, engineering, and the physical sciences. This paper describes and evaluates the MESA program at Jarama High School, Phoenix (Arizona), using informal interviews and…

Child Services Demonstration Center Evaluation. Summary Report. (ESEA VI-G).

ERIC Educational Resources Information Center

Colorado State Dept. of Education, Denver.

Presented is the final report of Colorado's Child Services Demonstration Project, designed to develop, implement, and evaluate a team staffing program to aid children with specific learning disabilities. The program is described in terms of rationale, replication, children served, staff activities (educational diagnosis, prescriptive programing,…

CAI Programs and Macros for Formative Curriculum Evaluation.

ERIC Educational Resources Information Center

Dasenbrock, David; Teates, Thomas

This technical memo is designed for persons who are interested in research with and development of curriculum material. Detailed information regarding computer programs, and program documentation used in the development and evaluation of ISCS curriculum materials is provided. The memo includes supplemental information to ISCS Technical Report I…

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

PubMed

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

PubMed Central

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Defining, illustrating and reflecting on logic analysis with an example from a professional development program.

PubMed

Tremblay, Marie-Claude; Brousselle, Astrid; Richard, Lucie; Beaudet, Nicole

2013-10-01

Program designers and evaluators should make a point of testing the validity of a program's intervention theory before investing either in implementation or in any type of evaluation. In this context, logic analysis can be a particularly useful option, since it can be used to test the plausibility of a program's intervention theory using scientific knowledge. Professional development in public health is one field among several that would truly benefit from logic analysis, as it appears to be generally lacking in theorization and evaluation. This article presents the application of this analysis method to an innovative public health professional development program, the Health Promotion Laboratory. More specifically, this paper aims to (1) define the logic analysis approach and differentiate it from similar evaluative methods; (2) illustrate the application of this method by a concrete example (logic analysis of a professional development program); and (3) reflect on the requirements of each phase of logic analysis, as well as on the advantages and disadvantages of such an evaluation method. Using logic analysis to evaluate the Health Promotion Laboratory showed that, generally speaking, the program's intervention theory appeared to have been well designed. By testing and critically discussing logic analysis, this article also contributes to further improving and clarifying the method. Copyright © 2013 Elsevier Ltd. All rights reserved.

Sustainable urban stormwater management in the tropics: An evaluation of Singapore's ABC Waters Program

NASA Astrophysics Data System (ADS)

Lim, H. S.; Lu, X. X.

2016-07-01

The Active Beautiful Clean (ABC) Waters Program was implemented in 2006 as part of Singapore's stormwater management strategy and reflects the country's move towards Water Sensitive Urbanism through the adoption of Low-Impact Development (LID) ideology and practices. It is the first holistic and comprehensive LID program in the tropics and holds promise for extension to other tropical cities. This paper presents a comprehensive summary of the goals, LID practices (ABC design features) and design considerations as well as results of several monitored sites, including a constructed wetland, two rain gardens, green roofs and three canal restoration projects. We evaluate the ABC Waters Program based on these initial results and consider the challenges, issues and the research needs for it to meet its hydrological and water quality remediation goals. So far, the ABC design features evaluated perform well in removing particulates. Performance in nutrient removal is poor. With over 60 projects completed within 10 years, post-project monitoring and evaluation is necessary and complements on-going laboratory and modelling research projects conducted by local academic institutions.

A Comprehensive Evaluation Rubric for Assessing Instructional Apps

ERIC Educational Resources Information Center

Lee, Cheng-Yuan; Cherner, Todd Sloan

2015-01-01

There is a pressing need for an evaluation rubric that examines all aspects of educational apps designed for instructional purposes. In past decades, many rubrics have been developed for evaluating educational computer-based programs; however, rubrics designed for evaluating the instructional implications of educational apps are scarce. When an…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goltz, G.; Weiner, H.

A computer program has been developed for designing and analyzing the performance of solar array/battery power systems for the U. S. Coast Guard Navigational Aids. This program is called the Design Synthesis/Performance Analysis (DSPA) Computer Program. The basic function of the Design Synthesis portion of the DSPA program is to evaluate functional and economic criteria to provide specifications for viable solar array/battery power systems. The basic function of the Performance Analysis portion of the DSPA program is to simulate the operation of solar array/battery power systems under specific loads and environmental conditions. This document provides all the information necessary tomore » access the DSPA programs, to input required data and to generate appropriate Design Synthesis or Performance Analysis Output.« less

Carbide fuel pin and capsule design for irradiations at thermionic temperatures

NASA Technical Reports Server (NTRS)

Siegel, B. L.; Slaby, J. G.; Mattson, W. F.; Dilanni, D. C.

1973-01-01

The design of a capsule assembly to evaluate tungsten-emitter - carbide-fuel combinations for thermionic fuel elements is presented. An inpile fuel pin evaluation program concerned with clad temperture, neutron spectrum, carbide fuel composition, fuel geometry,fuel density, and clad thickness is discussed. The capsule design was a compromise involving considerations between heat transfer, instrumentation, materials compatibility, and test location. Heat-transfer calculations were instrumental in determining the method of support of the fuel pin to minimize axial temperature variations. The capsule design was easily fabricable and utilized existing state-of-the-art experience from previous programs.

Comprehensive Educational Assessment for the States: The Duplex Design.

ERIC Educational Resources Information Center

Bock, R. Darrell; Mislevy, Robert

State testing programs often attempt to provide annual information for use in student guidance and qualification, school and program evaluation, and broad policy decisions. With the development of a new type of assessment instrument, the "duplex design," the several functions of state testing programs can be served in a single test…

78 FR 37741 - Approval and Promulgation of Implementation Plans; California; South Coast; Contingency Measures...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-24

.... Id. \\7\\ Consistent with EPA's definition of ``design value'' in 40 CFR 58.1, we use the term ``design... evaluations below. Carl Moyer Memorial Air Quality Standards Attainment Program The Contingency Measures SIP identifies a portion of the Carl Moyer Memorial Air Quality Standards Attainment Program (Carl Moyer Program...

VISUAL AND AUDIO PRESENTATION IN MACHINE PROGRAMED INSTRUCTION. FINAL REPORT.

ERIC Educational Resources Information Center

ALLEN, WILLIAM H.

THIS STUDY WAS PART OF A LARGER RESEARCH PROGRAM AIMED TOWARD DEVELOPMENT OF PARADIGMS OF MESSAGE DESIGN. OBJECTIVES OF THREE PARALLEL EXPERIMENTS WERE TO EVALUATE INTERACTIONS OF PRESENTATION MODE, PROGRAM TYPE, AND CONTENT AS THEY AFFECT LEARNER CHARACTERISTICS. EACH EXPERIMENT USED 18 TREATMENTS IN A FACTORIAL DESIGN WITH RANDOMLY SELECTED…

English as a Second Language: Implementing Effective Adult Education Programs.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento. Adult, Alternative, and Continuation Education Div.

The manual is designed to assist California educators and public in understanding the various aspects of an effective English-as-a-Second-Language (ESL) program for adults. It provides theory-based and practical guidelines for conceptualizing, planning, designing, managing, and evaluating such programs. Chapters address these topics: the adult ESL…

Meeting the Pepsi Challenge: Preparing Evaluation Programs for Scholastic Improvement.

ERIC Educational Resources Information Center

Hopkins, Mona S.

This document provides guidelines for preparing evaluation programs for scholastic improvement. The philosophy underlying assessment and accountability is discussed, with specific reference to the positive and negative aspects of assessment. The design of a curriculum evaluation model is presented, including goal identification, data gathering,…

Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use.

PubMed

Campbell, Rebecca; Townsend, Stephanie M; Shaw, Jessica; Karim, Nidal; Markowitz, Jenifer

2015-10-01

In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Steps to a HealthierUS Cooperative Agreement Program: foundational elements for program evaluation planning, implementation, and use of findings.

PubMed

MacDonald, Goldie; Garcia, Danyael; Zaza, Stephanie; Schooley, Michael; Compton, Don; Bryant, Terry; Bagnol, Lulu; Edgerly, Cathy; Haverkate, Rick

2006-01-01

The Steps to a HealthierUS Cooperative Agreement Program (Steps Program) enables funded communities to implement chronic disease prevention and health promotion efforts to reduce the burden of diabetes, obesity, asthma, and related risk factors. At both the national and community levels, investment in surveillance and program evaluation is substantial. Public health practitioners engaged in program evaluation planning often identify desired outcomes, related indicators, and data collection methods but may pay only limited attention to an overarching vision for program evaluation among participating sites. We developed a set of foundational elements to provide a vision of program evaluation that informs the technical decisions made throughout the evaluation process. Given the diversity of activities across the Steps Program and the need for coordination between national- and community-level evaluation efforts, our recommendations to guide program evaluation practice are explicit yet leave room for site-specific context and needs. Staff across the Steps Program must consider these foundational elements to prepare a formal plan for program evaluation. Attention to each element moves the Steps Program closer to well-designed and complementary plans for program evaluation at the national, state, and community levels.

When science and politics listen to each other: good prospects from a new school breakfast program in Peru.

PubMed

Jacoby, E R; Cueto, S; Pollitt, E

1998-04-01

This article provides an overview of a school breakfast program implemented in 1993 in the Peruvian Andes. The program, designed by the Instituto de Investigación Nutricional in Lima and supported by the government of Peru, constitutes a clear departure from previous school feeding programs, which were heavily politicized and poorly documented. From the program's inception, nutritionists, managers, and social scientists have collaborated to produce a sound nutritional design, efficient distribution mechanisms, and effective evaluation methods. During the program's first year, controlled evaluations conducted in several Andean regions documented improved dietary intake and a significant decline in the prevalence of anemia. An educational evaluation also found improved verbal skills, higher school attendance, and lower dropout rates among recipients of the school breakfast. The results have prompted the Peruvian government to continue supporting the program, thus setting a new standard for the effective management of social expenditure in the context of economic adjustment.

The Coordination of Program Planning and Evaluation Systems for Occupational Education. Volume 1 Appendix: A Layman's Guide to the Reporting and Evaluation System for Occupational Education.

ERIC Educational Resources Information Center

Pargament, Richard

The manuscript is a draft written in nontechnical terms, for the purpose of acquainting local and regional occupational administrators with RESOE's functional specifications and basic design concepts. Following a brief introduction is a description of what RESOE does, covering: evaluation of occupational programs; program monitoring and…

A Supplement to the Component Four Implementation Booklet. Broad Goal Definition in Emerald School District. SPECS: School Planning, Evaluation, and Communication System.

ERIC Educational Resources Information Center

Nagle, John M.; Walker, Harold E.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. This…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

The Upside of an Annual Survey in Light of Involvement and Use: Evaluating the Advanced Technological Education Program

ERIC Educational Resources Information Center

Toal, Stacie A.; Gullickson, Arlen R.

2011-01-01

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

Evaluation of Medical Education virtual Program: P3 model.

PubMed

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Evaluation of Medical Education virtual Program: P3 model

PubMed Central

REZAEE, RITA; SHOKRPOUR, NASRIN; BOROUMAND, MARYAM

2016-01-01

Introduction: In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way. PMID:27795971

Evaluation of materials and design modifications for aircraft brakes

NASA Technical Reports Server (NTRS)

Ho, T. L.; Kennedy, F. E.; Peterson, M. B.

1975-01-01

A test program is described which was carried out to evaluate several proposed design modifications and several high-temperature friction materials for use in aircraft disk brakes. The evaluation program was carried out on a specially built test apparatus utilizing a disk brake and wheel half from a small het aircraft. The apparatus enabled control of brake pressure, velocity, and braking time. Tests were run under both constant and variable velocity conditions and covered a kinetic energy range similar to that encountered in aircraft brake service. The results of the design evaluation program showed that some improvement in brake performance can be realized by making design changes in the components of the brake containing friction material. The materials evaluation showed that two friction materials show potential for use in aircraft disk brakes. One of the materials is a nickel-based sintered composite, while the other is a molybdenum-based material. Both materials show much lower wear rates than conventional copper-based materials and are better able to withstand the high temperatures encountered during braking. Additional materials improvement is necessary since both materials show a significant negative slope of the friction-velocity curve at low velocities.

Evaluating the Australian Traineeship System.

ERIC Educational Resources Information Center

Ryan, R. J.

1987-01-01

Describes the Australian Traineeship System (ATS), a program integrating formal education and employment designed to increase options for dropouts. Discusses problems involving the centrality of ATS's educational component and implementation of a program evaluation strategy. Includes two references. (MLH)

Evaluation of Achieving a College Education Plus: A Credit-Based Transition Program

ERIC Educational Resources Information Center

Luna, Gaye; Fowler, Michael

2011-01-01

This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to…

Evaluation Design 1978-1979: ESAA Title I Migrant Program. Publication Number 78.11.

ERIC Educational Resources Information Center

Friedman, Myron; And Others

To collect and disseminate information relevant to the accountability and program components of the Title I Migrant Program in the Austin school district and to report to the Texas Education Agency through interim and final reports on how well the migrant program is meeting its stated objectives for 1978-79 are the functions of the evaluation for…

Evaluating an Enrichment Program in Early Childhood: A Multi-Methods Approach

ERIC Educational Resources Information Center

van Aswegen, Christa; Pendergast, Donna

2015-01-01

This article reports on the evaluation of one topic in an enrichment program designed for children in their early years of learning. The program is responsive to an increased understanding of the benefits for very young children of programs that not only take advantage of the sensitive periods for learning but that also assist parents to a take a…

Crossroads Cafe: An ESOL Program for Adult Learners. Formative Evaluation Study, Summer 1996 Pilot Implementation.

ERIC Educational Resources Information Center

Spiegel, Seymour; Rayman, Irene C.

The reports presents findings of a formative evaluation of "Crossroads Cafe," an adult-level distance learning program designed to teach English to speakers of other languages (ESOL). The study focused on how 22 programs were implemented in 6 different regions of New York State. The program is a collaborative efforts of the Department of…

Look-Listen Opinion Poll, 1984-1985. Project of the National Telemedia Council, Inc.

ERIC Educational Resources Information Center

Giles, Doris, Ed.; And Others

Designed to indicate the reasons behind viewer program preferences, this 32nd report of an annual opinion poll presents the results of a survey which asked 914 participants to evaluate 3,584 television programs they liked, did not like, and/or to evaluate new programs. Tables summarize the reasons why programs were selected by viewers, their…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

EVALUATION STUDY OF FARM AND HOME MANAGEMENT PROGRAM IN NEW YORK STATE. A SIX-PART REPORT.

ERIC Educational Resources Information Center

ALEXANDER, FRANK D.

IN 1954 CONGRESS EARMARKED FUNDS FOR A FARM AND HOME MANAGEMENT PROGRAM TO OFFER INTENSIVE ON-THE FARM COUNSELING IN MANAGEMENT AND DECISION MAKING. THIS SIX-PART EVALUATION OF THE PROGRAM AS IT WAS CONDUCTED IN NEW YORK STATE, PRIMARILY WITH DAIRY OPERATORS, WAS DESIGNED TO DETERMINE THE PROGRAM'S EFFECTIVENESS RELATIVE TO LESS INTENSIVE…

Evaluation of the Veterans' Education and Training Service (VETS) Program of the National League of Cities and U.S. Conference of Mayors.

ERIC Educational Resources Information Center

Scheflen, Kenneth C.; Brandewie, Robert J.

The document evaluates the impact of the Veterans' Education and Training Service (VETS) program on G.I. Bill utilization rates. The VETS program is designed to increase enrollments of educationally and economically disadvantaged veterans in Veterans' Administration education and training programs. Statistical data on veterans and descriptive data…

eMINTS Program Evaluation Report: An Investigation of Program Fidelity and Its Impact on Teacher Mastery and Student Achievement

ERIC Educational Resources Information Center

Martin, Wendy; Strother, Scott; Weatherholt, Tara; Dechaume, Merav

2008-01-01

The eMINTS professional development programs are designed to help teachers learn how to integrate technology into their teaching, using instructional strategies that promote inquiry-based learning and encourage collaboration and community building among students and teachers. The eMINTS programs considered in this evaluation include: (1) eMINTS…

The AcCell series 2000 as a support system for training and evaluation in educational and clinical settings.

PubMed

Greening, S E; Grohs, D H; Guidos, B J

1997-01-01

Providing effective training, retraining and evaluation programs, including proficiency testing programs, for cytoprofessionals is a challenge shared by many academic and clinical educators internationally. In cytopathology the quality of training has immediately transferable and critically important impacts on satisfactory performance in the clinical setting. Well-designed interactive computer-assisted instruction and testing programs have been shown to enhance initial learning and to reinforce factual and conceptual knowledge. Computer systems designed not only to promote diagnostic accuracy but to integrate and streamline work flow in clinical service settings are candidates for educational adaptation. The AcCell 2000 system, designed as a diagnostic screening support system, offers technology that is adaptable to educational needs during basic and in-service training as well as testing of screening proficiency in both locator and identification skills. We describe the considerations, approaches and applications of the AcCell 2000 system in education programs for both training and evaluation of gynecologic diagnostic screening proficiency.

78 FR 5035 - Final Priorities; Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-23

... flexibility where possible, and develop and implement a study design that would answer important questions... basic design requirements--for both program management and evaluation purposes--for data and account... commenter stated that based on its experience with schools, local governments, and others in the design and...

Principles in sampling design, lessons, and recommendations from a multi-year, multi-port surveillance program in Lake Superior

EPA Science Inventory

We evaluated a pilot aquatic invasive species (AIS) early detection monitoring program in Lake Superior that was designed to detect newly-introduced fishes. We established survey protocols for three major ports (Duluth-Superior, Sault Ste. Marie, Thunder Bay), and designed an ada...

Energy efficient engine. Volume 1: Component development and integration program

NASA Technical Reports Server (NTRS)

1981-01-01

Technology for achieving lower installed fuel consumption and lower operating costs in future commercial turbofan engines are developed, evaluated, and demonstrated. The four program objectives are: (1) propulsion system analysis; (2) component analysis, design, and development; (3) core design, fabrication, and test; and (4) integrated core/low spoon design, fabrication, and test.

Design, Delivery and Evaluation of Teaching by Service Users and Carers

ERIC Educational Resources Information Center

Benbow, Susan Mary; Taylor, Louise; Mustafa, Nageen; Morgan, Kathleen

2011-01-01

Education influences individual health and social care professionals and the systems in which they work. We describe a postgraduate educational program that did this through involving service users and carers in designing and facilitating teaching programs. A module of teaching was designed and delivered in partnership with users and carers from…

Bringing a Perspective from Outside the Field: A Commentary on Davis et al.'s (2010) Use of a Modified Regression Discontinuity Design to Evaluate a Gifted Program

ERIC Educational Resources Information Center

Adelson, Jill L.; Kelcey, Benjamin

2016-01-01

In this commentary of "Evaluating the Gifted Program of an Urban School District Using a Modified Regression Discontinuity Design" by Davis, Engberg, Epple, Sieg, and Zimmer, we examine the background of the study, critique the methods used, and discuss the results and implications. The study used a fuzzy regression discontinuity design…

Creating an Advertising Campaign: An Evaluation Report for the Occupational Exploration Programs.

ERIC Educational Resources Information Center

Altschuld, James W.; And Others

The evaluation report is one of seven produced for the Occupational Exploration Program (OEP), a series of simulated occupational experiences designed for junior high school students. Describing the pilot testing of the simulation dealing with advertising, the report contains sections describing the simulation context, evaluation procedures,…

Cyber-Evaluation: Evaluating a Distance Learning Program.

ERIC Educational Resources Information Center

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Pretesting Effects in the Evaluation of Social Skills Training.

ERIC Educational Resources Information Center

Mungas, Dan M.; Walters, Herman A.

1979-01-01

Evaluated effects of pretesting in conjunction with a group social skills training program. A Solomon four-groups design was used to evaluate the effects of pretesting, the skills training program, and their interaction. Strong evidence of pretesting effects was found for measures associated with a behavioral forced interaction task. (Author)

In Vitro Evaluation of a Program for Machine-Aided Indexing.

ERIC Educational Resources Information Center

Jacquemin, Christian; Daille, Beatrice; Royaute, Jean; Polanco, Xavier

2002-01-01

Presents the human evaluation of ILIAD, a program for machine-aided indexing that was designed to assist expert librarians in computer-aided indexing and document analysis. Topics include controlled indexing and free indexing; natural language and concept-based information retrieval; evaluation methodology; syntactic variations; and a comparison…

The Efficacy of Stuttering Measurement Training: Evaluating Two Training Programs

ERIC Educational Resources Information Center

Bainbridge, Lauren A.; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J.

2015-01-01

Purpose: Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Method: Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of…

75 FR 28287 - Final Plan for Fiscal Year 2010

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-20

... Federal agencies. In keeping with OJJDP's mission, these programs are designed to help strengthen the.../intervention based on sound theory and evaluative literature, which has yet to be evaluated rigorously. OJJDP..., and research and evaluation projects designed to improve juvenile justice systems and delinquency...

Meeting IYA Goals for Diverse Science Center and Planetarium Audiences

NASA Astrophysics Data System (ADS)

Nichols Yehling, Michelle; Carney, K.

2008-05-01

The International Year of Astronomy provides the Adler Planetarium in Chicago, IL with a chance to bring astronomy into the greater Chicagoland area. 1) The presenters will outline Adler's program plans to date, from community outreach programs such as Café Scientifique and citizen science light pollution observations, to programs within the institution, like a temporary exhibit about how telescopes have shaped our understanding of the cosmos. The presenters will focus on the range of programming and how this suite of programs brings together IYA topical threads, addressing sustainability and the needs of our audiences. 2) How do we know that the IYA programs we design actually work for our audiences? How do we assess and improve our work? This session will introduce participants to the "backwards design” process through which Adler educators create experiences that begin with focused goals. Facilitators will take participants through the Adler's evaluation planning method that uncovers what we want to know about our educational programs and experiences. Tools for program design and evaluation will be shared. 3) Facilitators will present for discussion three activities that have been designed and evaluated for one of our audiences, the museum-going family. Workshop participants are invited to critique and discuss these activities, their rationale, their fit with identified audience and institutional needs, and IYA thematic strands. Participants will share any ideas they have for adaptation of these activities for other audiences in their own settings. 4) Finally, all of the educational design and evaluation tools, program descriptions, and lesson plans will be compiled into an electronic document. Participants are encouraged to bring program description examples and/or activity lesson plans that can be incorporated into the document to provide an IYA "workbook". This workbook will be sent to all interested session participants by no later than July 31, 2008.

Learning for All: The Value of Field Experience in Training a New Generation of Program Evaluators

ERIC Educational Resources Information Center

Buitrag, Carolina

2015-01-01

Professionals in various fields have the opportunity to train in real-life situations before they take on a job by themselves. In program evaluation, however, preservice training usually focuses on coursework oriented to research design and methods. After completing these studies, evaluators go off to conduct evaluations guided primarily by their…

Postadoption and Guardianship: An Evaluation of the Adoption Preservation, Assessment, and Linkage Program

ERIC Educational Resources Information Center

Liao, Minli; Testa, Mark

2016-01-01

Objectives: This study evaluated the effects of the Adoption Preservation, Assessment, and Linkage (APAL) postpermanency program. Method: A quasi-experimental, posttest-only design was used to estimate the program's effects on youth discharged from foster care to adoption or legal guardianship. A random sample was surveyed (female = 44.7%; African…

The Development of an Automated Data Base for Program Research and Evaluation in Continuing Education.

ERIC Educational Resources Information Center

Taylor, William H.

The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…

Reframing Resilience: Pilot Evaluation of a Program to Promote Resilience in Marginalized Older Adults

ERIC Educational Resources Information Center

Fullen, Matthew C.; Gorby, Sean R.

2016-01-01

Resilience has been described as a paradigm for aging that is more inclusive than models that focus on physiological and functional abilities. We evaluated a novel program, Resilient Aging, designed to influence marginalized older adults' perceptions of their resilience, self-efficacy, and wellness. The multiweek group program incorporated an…

Marketing: Managing the Marketing Mix. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Fleming, Lian; And Others

This courseware evaluation rates the Marketing: Managing the Marketing Mix program developed by Control Data Limited. (This program--not contained in this document--is designed to introduce decisions made by marketing managers during the implementation phase of marketing.) Part A describes the program in terms of subject area (marketing, decision…

An Evaluation of the Chapter 2 Inexpensive Book Distribution Program.

ERIC Educational Resources Information Center

Abbott, Catherine; And Others

This report describes and evaluates the Chapter 2 Inexpensive Book Distribution Program (IBDP), a federal program designed to motivate children from age three to high school to read, and the Reading Is Fundamental (RIF) organization--the sole contractor of the IBDP. Following an executive summary, an introductory section presents basic…

Social Validity Evaluation of the FRIENDS for Life Program with Mexican Children

ERIC Educational Resources Information Center

Gallegos-Guajardo, Julia; Ruvalcaba-Romero, Norma Alicia; Garza-Tamez, Martha; Villegas-Guinea, Diana

2013-01-01

This study is the first social validity evaluation of the Spanish version of the "FRIENDS for Life" program with Mexican children. "FRIENDS for Life" is a cognitive-behavioral intervention aimed at increasing social and emotional competence and decreasing anxiety and depressive symptoms in children. The program is designed to…

Evaluation of a Dual Bilingual Program: English-Spanish and English-Southeast Asian Languages.

ERIC Educational Resources Information Center

Wheeler, George; And Others

An external evaluation of the Title VII Bilingual Education Program was designed to: (1) gather a subjective assessment from personnel working with the program; (2) observe classroom teaching and activities utilized in bilingual instruction; and (3) measure differences in levels of achievement. The instructional personnel appear to accept the…

An Evaluation System for Training Programs: A Case Study Using a Four-Phase Approach

ERIC Educational Resources Information Center

Lingham, Tony; Richley, Bonnie; Rezania, Davar

2006-01-01

Purpose: With the increased importance of training in organizations, creating important and meaningful programs are critical to an organization and its members. The purpose of this paper is to suggest a four-phase systematic approach to designing and evaluating training programs that promotes collaboration between organizational leaders, trainers,…

Work Experience Career Exploration Program (WECEP) Advisory Committee Report: Evaluation and Recommendations.

ERIC Educational Resources Information Center

Minneapolis Public Schools, Minn.

The Work Experience Career Exploration Program (WECEP) is a prevocational exploratory program designed for educationally disadvantaged ninth grade students, emphasizing the cultivation of individual talents, development of social skills, and the recognition of the student as an individual with social and economic worth. In order to evaluate WECEP,…

Peer Tutoring: A Guide to Program Design. Research and Development Series No. 260.

ERIC Educational Resources Information Center

Ashley, William L.; And Others

This publication presents guidelines for planning, implementing, and evaluating a peer tutoring program within a vocational setting. Chapter 1 discusses benefits of peer tutoring and presents a compilation of guidelines, suggestions, and examples for planning, developing, and evaluating a peer tutoring program. Tasks in each area--program…

Queens Tri-School Confederation 1992-93 Evaluation Report. OREA Report.

ERIC Educational Resources Information Center

Dworkowitz, Barbara

This report presents the evaluation results of the Queens Tri-School Confederation magnet programs in New York City: programs designed to reduce minority-group isolation among high school students in three high schools and simultaneously improve the quality of their education through the sharing of resources and expertise. These programs, which…

An Inservice Program for Elementary Teachers: Components, Instructional Procedures, and Evaluation.

ERIC Educational Resources Information Center

Horak, Willis J.; And Others

A description and evaluation of a year-long science in-service program for elementary teachers is provided. Consisting of three components, the program was designed to expand teachers' understandings of physics and chemistry concepts and processes and to encourage more science teaching and science activities in their classrooms. The on-campus…

An Evaluation of a Program to Help Dual-Earner Couples Share the Second Shift.

ERIC Educational Resources Information Center

Hawkins, Alan J.; And Others

1994-01-01

Used both traditional scientific and feminist methodologies to evaluate effectiveness of family life education program designed to help dual-earner couples (n=14 couples) share domestic labor. Both quantitative and qualitative data suggest that program produced small increases in husbands' involvement in both housework and child care and large…

Summer Education Program for Neurologically and Physically Handicapped Children. Summer 1975. Evaluation Report.

ERIC Educational Resources Information Center

Ellis, Ronald S.

Evaluated was the Summer Education Program for Neurologically and Physically Handicapped Children, designed to improve the performance of 145 children (6-16 years old) in the following areas--gross motor skills, swimming, fine motor skills, socialization with nonhandicapped peers, and independent daily living skills. The program included the…

An Evaluation of a Community College Workforce-Training Program

ERIC Educational Resources Information Center

Duru-Nnebue, Thomisha M.

2012-01-01

This project study is an evaluation of a job-training program designed to serve unemployed adult learners at a community college. The program lacked empirical data about participants finding employment. The rationale for selecting the problem is the need to provide skill development and vocational training in response to high unemployment rates.…

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

Parenting after Divorce: Evaluation of Preventive Programs for Divorcing Families.

ERIC Educational Resources Information Center

Warren, Nancy J.; And Others

Preventive educational programs are potentially useful in reducing the effects of divorce on children and families. Parenting After Divorce is an ongoing study designed to evaluate preventive programs. Divorcing families with children aged 7-12 are identified from court records and contacted to participate. Families are randomly assigned to one of…

Evaluating Predictors of Program Attrition among Women Mandated into Batterer Intervention Treatment

ERIC Educational Resources Information Center

Buttell, Frederick P.; Powers, Dolores; Wong, Asia

2012-01-01

Objective: The purpose of the present study was to evaluate pretreatment differences between treatment completers and dropouts among a large sample of women ordered into a 26-week batterer intervention program (BIP). Method: The study employed a nonequivalent, control-group design (comparing program completers to dropouts) in a secondary analysis…

Evaluation of an Online Youth Ambassador Program to Promote Mental Health

ERIC Educational Resources Information Center

Beamish, Nicola; Cannan, Philippa; Fujiyama, Hakuei; Matthews, Allison; Spiranovic, Caroline; Briggs, Kate; Kirkby, Kenneth; Mobsby, Caroline; Daniels, Brett

2011-01-01

This article presents results of an evaluation of an online Youth Ambassador (YA) program designed to promote internet resources for mental health in an adolescent population. Results suggest that an online YA program delivered in school is useful in improving mental health awareness for workshop participants. (Contains 1 table.)

The Development and Validation of a Human Systems Integration (HSI) Program for the Canadian Department of National Defence (DND)

DTIC Science & Technology

2008-09-01

inputs to interface and workspace design , and iterative user testing is not required. However, an effective HSI Program is just as important on a COTS...this phase is the contract, and the various design reviews, tests , and evaluations that occur to ensure that the system meets it goals. 3.3 DBCM ESM...Report(s). • HSI Approvals of Relevant Design Changes. • HSI Test Plans and Reports. • HSI Review Progress and Evaluation Memos and Reports. • HSI

Evaluation Design, 1978-1979. Local/State Bilingual Education Evaluation.

ERIC Educational Resources Information Center

Weibly, Gary; And Others

The evaluation design of the 1978-79 local/state bilingual education program of Austin Independent School District is presented. The primary focus of the evaluation is the assessment of the objectives in language development and concept development submitted to the Texas Education Agency. A secondary focus is the collection of information related…

State of the Art Methodology for the Design and Analysis of Future Large Scale Evaluations: A Selective Examination.

ERIC Educational Resources Information Center

Burstein, Leigh

Two specific methods of analysis in large-scale evaluations are considered: structural equation modeling and selection modeling/analysis of non-equivalent control group designs. Their utility in large-scale educational program evaluation is discussed. The examination of these methodological developments indicates how people (evaluators,…

Cost considerations for long-term ecological monitoring

USGS Publications Warehouse

Caughlan, L.; Oakley, K.L.

2001-01-01

For an ecological monitoring program to be successful over the long-term, the perceived benefits of the information must justify the cost. Financial limitations will always restrict the scope of a monitoring program, hence the program's focus must be carefully prioritized. Clearly identifying the costs and benefits of a program will assist in this prioritization process, but this is easier said than done. Frequently, the true costs of monitoring are not recognized and are, therefore, underestimated. Benefits are rarely evaluated, because they are difficult to quantify. The intent of this review is to assist the designers and managers of long-term ecological monitoring programs by providing a general framework for building and operating a cost-effective program. Previous considerations of monitoring costs have focused on sampling design optimization. We present cost considerations of monitoring in a broader context. We explore monitoring costs, including both budgetary costs--what dollars are spent on--and economic costs, which include opportunity costs. Often, the largest portion of a monitoring program budget is spent on data collection, and other, critical aspects of the program, such as scientific oversight, training, data management, quality assurance, and reporting, are neglected. Recognizing and budgeting for all program costs is therefore a key factor in a program's longevity. The close relationship between statistical issues and cost is discussed, highlighting the importance of sampling design, replication and power, and comparing the costs of alternative designs through pilot studies and simulation modeling. A monitoring program development process that includes explicit checkpoints for considering costs is presented. The first checkpoint occur during the setting of objectives and during sampling design optimization. The last checkpoint occurs once the basic shape of the program is known, and the costs and benefits, or alternatively the cost-effectiveness, of each program element can be evaluated. Moving into the implementation phase without careful evaluation of costs and benefits is risky because if costs are later found to exceed benefits, the program will fail. The costs of development, which can be quite high, will have been largely wasted. Realistic expectations of costs and benefits will help ensure that monitoring programs survive the early, turbulent stages of development and the challenges posed by fluctuating budgets during implementation.

Evaluation of the Transit Reliability Information Program

DOT National Transportation Integrated Search

1982-06-01

This report presents an evaluation of the rail portion of the Transit Reliability Information Program (TRIP), which was designed to collect and analyze equipment reliability data on U.S. transit systems. This assessment was conducted at the end of it...

Advanced composite elevator for Boeing 727 aircraft, volume 2

NASA Technical Reports Server (NTRS)

Chovil, D. V.; Grant, W. D.; Jamison, E. S.; Syder, H.; Desper, O. E.; Harvey, S. T.; Mccarty, J. E.

1980-01-01

Preliminary design activity consisted of developing and analyzing alternate design concepts and selecting the optimum elevator configuration. This included trade studies in which durability, inspectability, producibility, repairability, and customer acceptance were evaluated. Preliminary development efforts consisted of evaluating and selecting material, identifying ancillary structural development test requirements, and defining full scale ground and flight test requirements necessary to obtain Federal Aviation Administration (FAA) certification. After selection of the optimum elevator configuration, detail design was begun and included basic configuration design improvements resulting from manufacturing verification hardware, the ancillary test program, weight analysis, and structural analysis. Detail and assembly tools were designed and fabricated to support a full-scope production program, rather than a limited run. The producibility development programs were used to verify tooling approaches, fabrication processes, and inspection methods for the production mode. Quality parts were readily fabricated and assembled with a minimum rejection rate, using prior inspection methods.

The Identification, Implementation, and Evaluation of Critical User Interface Design Features of Computer-Assisted Instruction Programs in Mathematics for Students with Learning Disabilities

ERIC Educational Resources Information Center

Seo, You-Jin; Woo, Honguk

2010-01-01

Critical user interface design features of computer-assisted instruction programs in mathematics for students with learning disabilities and corresponding implementation guidelines were identified in this study. Based on the identified features and guidelines, a multimedia computer-assisted instruction program, "Math Explorer", which delivers…

The Design of Schools' Performance Incentive Programs in Texas: Findings from Year One of GEEG. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Governor's Educator Excellence Grant (GEEG) program, one of several statewide educator incentive programs in Texas. In this report, the authors provide an overview of 99 schools' locally designed educator…

A CONTROLLED EVALUATION OF A HIGH SCHOOL BIOMEDICAL PIPELINE PROGRAM: DESIGN AND METHODS

PubMed Central

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2013-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program’s Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90%, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers. PMID:24563603

Report to the Board of Regents State University System of Florida. Review of Programs: Architecture, Architectural Technology, Landscape Architecture, Interior Design, Construction and Construction Technology, Building Construction, Urban and Regional Planning.

ERIC Educational Resources Information Center

McMinn, William G.

An evaluation and report was done on the status of programs in architecture and related fields in the Florida State University System as a follow-up to a 1983 evaluation. The evaluation involved self-studies prepared by each program and a series of site visits to each of seven campuses and two centers with programs under review. These institutions…

Flight program language requirements. Volume 3: Appendices

NASA Technical Reports Server (NTRS)

1972-01-01

Government-sponsored study and development efforts were directed toward design and implementation of high level programming languages suitable for future aerospace applications. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of language requirements was synthesized from these activities.

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

An Evaluation Model Applied to a Mathematics-Methods Program Involving Three Characteristics of Teaching Style and Their Relationship to Pupil Achievement. Teacher Education Forum; Volume 3, Number 4.

ERIC Educational Resources Information Center

Dodd, Carol Ann

This study explores a technique for evaluating teacher education programs in terms of teaching competencies, as applied to the Indiana University Mathematics Methods Program (MMP). The evaluation procedures formulated for the study include a process product design in combination with a modification of Pophan's performance test paradigm and Gage's…

Design of training programs for a positive youth development program: Project P.A.T.H.S. in Hong Kong.

PubMed

Shek, Daniel T L; Chak, Yammy L Y

2010-01-01

To facilitate the implementation of the Secondary 1 to Secondary 3 program of the Project P.A.T.H.S. in Hong Kong, systematic training programs are designed for the potential program implementers. The rationales, objectives and design of the Secondary 1 to Secondary 3 training programs are outlined in this paper. The training programs cover theories of adolescent development, positive youth development, background and curricula of the Project P.A.T.H.S., factors affecting program implementation quality and evaluation of the project. Besides introducing the curriculum units, the training programs also focus on nature of learning and related theories (particularly experiential learning), teaching methods and instructional techniques, motivating students, and classroom management.

Children's Kindergarten Outcomes and Program Quality in the North Carolina Pre-Kindergarten Program: 2013-2014 Statewide Evaluation

ERIC Educational Resources Information Center

Peisner-Feinberg, Ellen S.; Schaaf, Jennifer M.; Hildebrandt, Lisa M.; Pan, Yi; Warnaar, Bethany L.

2015-01-01

The 2013-2014 North Carolina Pre-Kindergarten (NC Pre-K) Evaluation study was designed to examine the longitudinal outcomes through kindergarten for children who attended the Pre-K program, along with comparisons to previous cohorts of program attendees. A sample of 561 children was included in the study, with data gathered at the beginning and…

The Effect of a Physiological Evaluation Program on Coronary Heart Disease Risk Scores for Sedentary Individuals.

ERIC Educational Resources Information Center

Finkenberg, Mel; And Others

The purpose of this study was to compare the coronary heart disease (CHD) probability estimates of a group of sedentary males involved in an exercise stress test program from 1968 through 1974 with those of a comparison group of sedentary males not involved in the program. The program was designed to evaluate cardiopulmonary function and improve…

Mississippi School Library Media Programs: A Guide for Management. A Competency Based Handbook for Certified Library Media Specialists, Administrators, and Evaluators.

ERIC Educational Resources Information Center

Mississippi State Dept. of Education, Jackson.

This new publication, which replaces A Primer for Mississippi School Librarians published in 1967, is designed for use in planning, implementing, and evaluating school library media programs. For the administrator, there are competencies which must be met to develop the library media program as an integral part of the total instructional program.…

Advanced turboprop testbed systems study. Volume 1: Testbed program objectives and priorities, drive system and aircraft design studies, evaluation and recommendations and wind tunnel test plans

NASA Technical Reports Server (NTRS)

Bradley, E. S.; Little, B. H.; Warnock, W.; Jenness, C. M.; Wilson, J. M.; Powell, C. W.; Shoaf, L.

1982-01-01

The establishment of propfan technology readiness was determined and candidate drive systems for propfan application were identified. Candidate testbed aircraft were investigated for testbed aircraft suitability and four aircraft selected as possible propfan testbed vehicles. An evaluation of the four candidates was performed and the Boeing KC-135A and the Gulfstream American Gulfstream II recommended as the most suitable aircraft for test application. Conceptual designs of the two recommended aircraft were performed and cost and schedule data for the entire testbed program were generated. The program total cost was estimated and a wind tunnel program cost and schedule is generated in support of the testbed program.

Development, implementation, and evaluation of a multi-addiction prevention program for primary school students in Hong Kong: the B.E.S.T. Teen Program.

PubMed

Shek, Daniel T L; Yu, Lu; Leung, Hildie; Wu, Florence K Y; Law, Moon Y M

Based on the evaluation findings of the B.E.S.T. Teen Program which aimed at promoting behavioral, emotional, social, and thinking competencies in primary school students, it is argued in this paper that promotion of psychosocial competence to prevent addiction in primary school students is a promising strategy. A total of 382 Primary 5 (Grade 5) and 297 Primary 6 (Grade 6) students from five primary schools in Hong Kong participated in the program. Different evaluation strategies were adopted to evaluate the program. First, objective outcome evaluation adopting a non-equivalent group pretest-posttest experimental-control group design was conducted to examine change in the students. Second, to gauge students' perceptions of the program, subjective outcome evaluation was conducted. The evaluation findings basically converged to tentatively suggest that young adolescents benefited from participating in the program. Implications on the development, implementation, and evaluation of addiction prevention programs for teenagers are discussed.

Examples of Sports-Based Youth Development Programs

ERIC Educational Resources Information Center

Berlin, Richard A.; Dworkin, Aaron; Eames, Ned; Menconi, Arn; Perkins, Daniel F.

2007-01-01

The authors provide examples of sports-based youth development programs and offer information about program mission and vision, program design and content, evaluation results, and program sustainability. The four sports-based youth development programs presented are Harlem RBI, Tenacity, Snowsports Outreach Society, and Hoops & Leaders…

An Introduction to "My Environmental Education Evaluation Resource Assistant" (MEERA), a Web-Based Resource for Self-Directed Learning about Environmental Education Program Evaluation

ERIC Educational Resources Information Center

Zint, Michaela

2010-01-01

My Environmental Education Evaluation Resource Assistant or "MEERA" is a web-site designed to support environmental educators' program evaluation activities. MEERA has several characteristics that set it apart from other self-directed learning evaluation resources. Readers are encouraged to explore the site and to reflect on the role that…

Designers' unified cost model

NASA Technical Reports Server (NTRS)

Freeman, W.; Ilcewicz, L.; Swanson, G.; Gutowski, T.

1992-01-01

The Structures Technology Program Office (STPO) at NASA LaRC has initiated development of a conceptual and preliminary designers' cost prediction model. The model will provide a technically sound method for evaluating the relative cost of different composite structural designs, fabrication processes, and assembly methods that can be compared to equivalent metallic parts or assemblies. The feasibility of developing cost prediction software in a modular form for interfacing with state-of-the-art preliminary design tools and computer aided design programs is being evaluated. The goal of this task is to establish theoretical cost functions that relate geometric design features to summed material cost and labor content in terms of process mechanics and physics. The output of the designers' present analytical tools will be input for the designers' cost prediction model to provide the designer with a database and deterministic cost methodology that allows one to trade and synthesize designs with both cost and weight as objective functions for optimization. This paper presents the team members, approach, goals, plans, and progress to date for development of COSTADE (Cost Optimization Software for Transport Aircraft Design Evaluation).

40 CFR 86.1809-12 - Prohibition of defeat devices.

Code of Federal Regulations, 2014 CFR

2014-07-01

... manufacturer must provide an explanation containing detailed information regarding test programs, engineering evaluations, design specifications, calibrations, on-board computer algorithms, and design strategies..., with the Part II certification application, an engineering evaluation demonstrating to the satisfaction...

Department of Defense Energy Initiatives: Background and Issues for Congress

DTIC Science & Technology

2012-07-20

the fully burdened cost of fuel during analysis of alternatives and evaluation of alternatives and acquisition program design trades .” The provision ...cost of fuel during analysis of alternatives and evaluation of alternatives and acquisition program design trades .” The provision is codified at 10...aware that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if

Department of Defense Energy Initiatives: Background and Issues for Congress

DTIC Science & Technology

2012-06-05

alternatives and evaluation of alternatives and acquisition program design trades .” The provision is codified at 10 U.S.C. 2911 note. Contractor...during analysis of alternatives and evaluation of alternatives and acquisition program design trades .” The provision is codified at 10 U.S.C. 2911...that notwithstanding any other provision of law, no person shall be subject to a penalty for failing to comply with a collection of information if it

The Effect of a Computer Program Based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) in Improving Ninth Graders' Listening and Reading Comprehension Skills in English in Jordan

ERIC Educational Resources Information Center

Alodwan, Talal; Almosa, Mosaab

2018-01-01

The study aimed to assess the effectiveness of a computer program based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) Model on the achievement of Ninth Graders' listening and Reading Comprehension Skills in English. The study sample comprised 70 ninth graders during the second semester of the academic year 2016/2017. The…

Gifted Identification and the Role of Gifted Education: A Commentary on "Evaluating the Gifted Program of an Urban School District Using a Modified Regression Discontinuity Design"

ERIC Educational Resources Information Center

Steenbergen-Hu, Saiying; Olszewski-Kubilius, Paula

2016-01-01

The article by Davis, Engberg, Epple, Sieg, and Zimmer (2010) represents one of the recent research efforts from economists in evaluating the impact of gifted programs. It can serve as a worked example of the implementation of the regression discontinuity (RD) design method in gifted education research. In this commentary, we first illustrate the…

High Cycle Fatigue (HCF) Science and Technology Program 2002 Annual Report

DTIC Science & Technology

2003-08-01

Turbine Engine Airfoils, Phase I 4.3 Probabilistic Design of Turbine Engine Airfoils, Phase II 4.4 Probabilistic Blade Design System 4.5...XTL17/SE2 7.4 Conclusion 8.0 TEST AND EVALUATION 8.1 Characterization Test Protocol 8.2 Demonstration Test Protocol 8.3 Development of Multi ...transparent and opaque overlays for processing. The objective of the SBIR Phase I program was to identify and evaluate promising methods for

Evaluating disease management program effectiveness: an introduction to survival analysis.

PubMed

Linden, Ariel; Adams, John L; Roberts, Nancy

2004-01-01

Currently, the most widely used method in the disease management industry for evaluating program effectiveness is the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer plausible rationale explaining the change from baseline. Survival analysis allows for the inclusion of data from censored cases, those subjects who either "survived" the program without experiencing the event (e.g., achievement of target clinical levels, hospitalization) or left the program prematurely, due to disenrollement from the health plan or program, or were lost to follow-up. Additionally, independent variables may be included in the model to help explain the variability in the outcome measure. In order to maximize the potential of this statistical method, validity of the model and research design must be assured. This paper reviews survival analysis as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

Where are the food animal veterinarian shortage areas anyway?

PubMed

Wang, Tong; Hennessy, David A; O'Connor, Annette M

2012-05-01

In 2010 the United States implemented the Veterinary Medicine Loan Repayment Program (VMLRP) to address perceived regional shortages in certain veterinary occupations, including food animal practice. With county as the unit of analysis, this paper describes a pair of models to evaluate factors associated with being designated a private practice shortage area in 2010. One model is used to explain food animal veterinarian location choices so as to provide an objective evaluation of comparative shortage. The other model seeks to explain the counties chosen as shortage areas. Model results are then used to evaluate the program. On the whole the program appears to perform quite well. For several states, however, VMLRP shortage designations are inconsistent with the food animal veterinarian location model. Comparative shortage is generally more severe in states that have no VMLRP designated private practice shortage counties than in states that do. Copyright © 2012 Elsevier B.V. All rights reserved.

Design of study without drugs--a Surinamese school-based drug-prevention program for adolescents.

PubMed

Ishaak, Fariel; de Vries, Nanne Karel; van der Wolf, Kees

2015-10-12

The aim of this study was to design the content and accompanying materials for a school-based program--Study without Drugs--for adolescents in junior secondary schools in Suriname based on the starting points and tasks of the fourth step of the Intervention Mapping protocol (which consists of six steps). A program based on this protocol should include a combination of theory, empirical evidence, and qualitative and quantitative research. Two surveys were conducted when designing the program. In Survey I, teachers and students were asked to complete a questionnaire to determine which school year they thought would be most appropriate for implementing a drug-prevention program for adolescents (we completed a similar survey as part of previous research). An attempt was made to identify suitable culturally sensitive elements to include in the program. In Survey II, the same teachers were asked to complete a questionnaire to determine the programs' scope, sequence, structure, and topics as well as the general didactic principles to serve as a basis for program design. After outlining the program plan, lessons, and materials, we conducted a formative pretest evaluation among teachers, students, and parents. That evaluation included measures related to the program's attractiveness, comprehensibility, and usefulness. The resulting lessons were presented to the teachers for assessment. The drug-prevention program we developed comprises 10 activities and lasts 2-2.5 months in an actual school setting. The activities take place during Dutch, biology, physical education, art, religion, and social studies lessons. We based the structure of the lessons in the program on McGuire's Persuasion Communication Model, which takes into account important didactic principles. Evaluations of the program materials and lesson plans by students, teachers, and parents were mostly positive. We believe that using the fourth step of the Intervention Mapping protocol to develop a drug-prevention intervention for adolescents has a produced promising, feasible program.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

INSTRUCTIONAL DESIGN, RECORDED INSTRUCTION AND FACULTY INTERESTS. SUPPLEMENT, INSTRUCTIONAL DESIGN, RECORDED INSTRUCTION AND FACULTY INTERESTS WITHIN THE UNIVERSITY OF CALIFORNIA. OCCASIONAL PAPER NO. 2.

ERIC Educational Resources Information Center

KARWIN, THOMAS J.

THE SYSTEMS APPROACH TO PLANNING IS USEFUL IN DESIGNING MORE EFFECTIVE AND EFFICIENT INSTRUCTIONAL PROGRAMS. IT SPECIFIES INSTRUCTIONAL OBJECTIVES, COORDINATES APPROPRIATE METHODS, AND EVALUATES THE RESULTING INSTRUCTIONAL SYSTEM. CONFLICTS CAN ARISE FROM INDIVIDUAL INTERPERTATIONS OF INTEREST IN SPECIFIC PROGRAMS. A COMPREHENSIVE, EQUITABLE…

Does the Kids Cafe Program's nutrition education improve children's dietary intake? A pilot evaluation study

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the Kids Café Program (KCP) nutrition education intervention and assess its impact on children's diet quality and body mass index (BMI) percentile. An experimental design consisting of pretest-posttest comparison groups using mixed methods was used to evaluate the 6-ses...

A Model for Evaluating Programs for the Gifted under Non-Experimental Conditions.

ERIC Educational Resources Information Center

Carter, Kyle R.

1992-01-01

The article presents and illustrates use of an evaluation model for assessing programs for the gifted where tight experimental control is not possible. The model consists of four components: ex post factor designs including intact groups; comparative evaluation; strength of treatment; and multiple outcome assessment from flexible data sources. (DB)

A PLAN FOR EVALUATING MAJOR ACTIVITIES IN GREAT CITIES SCHOOL IMPROVEMENT PROGRAM.

ERIC Educational Resources Information Center

MARBURGER, CARL L.; RASSCHAERT, WILLIAM M.

THE GUIDE IS INTENDED TO ASSIST PROJECT DIRECTORS IN THEIR EFFORTS TO DEVELOP MORE SYSTEMATIC AND THOROUGH EVALUATION DESIGNS FOR THE GREAT CITIES SCHOOL IMPROVEMENT PROGRAM. MAJOR DIMENSIONS OF TEACHING-LEARNING, SCHOOL-COMMUNITY, AND PUPIL-PARENT-TEACHER ACTIVITIES ARE LISTED. MAJOR EVALUATION AREAS ARE IN PUPIL ACHIEVEMENT, IMPLEMENTED BY GROUP…

Handicap Accessibility: A Self-Evaluation Guidebook for ACTION and Its Grantees. Handbook 240.

ERIC Educational Resources Information Center

ACTION, Washington, DC. Office of Equal Opportunity.

This handbook is designed to assist managers of ACTION grantee programs in evaluating the degree to which the needs of persons with disabilities are incorporated into their programs for physical accessibility of buildings and facilities. After a general discussion of self-evaluation principles and accessibility guidelines, a checklist is provided…

Evaluability Assessment Thesis and Dissertation Studies in Graduate Professional Degree Programs

ERIC Educational Resources Information Center

Walser, Tamara M.; Trevisan, Michael S.

2016-01-01

Evaluability assessment (EA) has potential as a design option for thesis and dissertation studies, serving as a practical training experience for both technical and nontechnical evaluation skills. Based on a content review of a sample of EA theses and dissertations from graduate professional degree programs, the authors of this article found that…

Students Training for Academic Readiness (STAR): Year Three Evaluation Report. Executive Summary

ERIC Educational Resources Information Center

Texas Center for Educational Research, 2010

2010-01-01

This executive summary presents findings from the Year 3 evaluation of Texas' state-level Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, grant. GEAR UP grant requirements include an evaluation component designed to assess program effectiveness and to measure progress toward project goals. To this end, the evaluation…

Evaluation Techniques for the Sandy Point Discovery Center, Great Bay National Estuarine Research Reserve.

ERIC Educational Resources Information Center

Heffernan, Bernadette M.

1998-01-01

Describes work done to provide staff of the Sandy Point Discovery Center with methods for evaluating exhibits and interpretive programming. Quantitative and qualitative evaluation measures were designed to assess the program's objective of estuary education. Pretest-posttest questionnaires and interviews are used to measure subjects' knowledge and…

Employer Expectations of Sport Managers and Evaluation of Sport Management Programs in the United States.

ERIC Educational Resources Information Center

DeSensi, Joy T.; And Others

The report consists of a series of studies designed to assess the needs of sport management positions and evaluate sport management programs/curricula in institutions of higher education. Three surveys were conducted to determine: (1) employer expectations of sport managers; (2) employer evaluation of educational sport management…

Intensive Reading Instructional Teams, Evaluation Manual for Project Directors.

ERIC Educational Resources Information Center

Nearine, Robert J.

In this manual, project directors of the Intensive Reading Instructional Teams (IRIT) program in Hartford, Connecticut, public schools, are provided with suggestions for evaluating compensatory programs such as the IRIT. Three models for basic Title I evaluation are discussed and compared: a norm-referenced model, a control group design, and a…

Design and evaluation of low-cost stainless steel fiberglass foam blades for large wind driven generating systems

NASA Technical Reports Server (NTRS)

Eggert, W. S.

1982-01-01

A low cost wind turbine blade based on a stainless steel fiberglass foam Budd blade design concept, was evaluated for its principle characteristics, low cost features, and its advantages and disadvantages. A blade structure was designed and construction methods and materials were selected. A complete blade tooling concepts, various technical and economic analysis, and evaluations of the blade design were performed. A comprehensive fatigue test program is conducted to provide data to verify the design stress allowables.

Design and evaluation of low-cost stainless steel fiberglass foam blades for large wind driven generating systems

NASA Astrophysics Data System (ADS)

Eggert, W. S.

1982-10-01

A low cost wind turbine blade based on a stainless steel fiberglass foam Budd blade design concept, was evaluated for its principle characteristics, low cost features, and its advantages and disadvantages. A blade structure was designed and construction methods and materials were selected. A complete blade tooling concepts, various technical and economic analysis, and evaluations of the blade design were performed. A comprehensive fatigue test program is conducted to provide data to verify the design stress allowables.

Summer School for Retainees, 1982. Evaluation Design.

ERIC Educational Resources Information Center

Austin Independent School District, TX. Office of Research and Evaluation.

The evaluation design for the Austin Independent School District 1982 summer school program for elementary retainees is described. The evaluation is meant to focus on short-term skill mastery in reading and mathematics and the long-term achievement growth of the participants. Separate reading objectives and materials in Spanish and English…

A synthesis of evaluation monitoring projects by the forest health monitoring program (1998-2007)

Treesearch

William A. Bechtold; Michael J. Bohne; Barbara L. Conkling; Dana L. Friedman

2012-01-01

The national Forest Health Monitoring Program of the Forest Service, U.S. Department of Agriculture, has funded over 200 Evaluation Monitoring projects. Evaluation Monitoring is designed to verify and define the extent of deterioration in forest ecosystems where potential problems have been identified. This report is a synthesis of results from over 150 Evaluation...

Promoting Diversity in the Field of Evaluation: Reflections on the First Year of the Robert Wood Johnson Foundation Evaluation Fellowship Program

ERIC Educational Resources Information Center

Christie, Christina A.; Vo, Anne T.

2011-01-01

In this paper we describe an evaluation training program sponsored by the Robert Wood Johnson Foundation and led by Duquesne University and OMG Center for Collaborative Learning designed to meet the challenge of developing a cadre of diverse evaluation professionals, specifically those from traditionally underrepresented or underserved…

Development and Evaluation of a Parent-Engagement Curriculum to Connect Latino Families and Schools

ERIC Educational Resources Information Center

Hurtado, Ghaffar A.; Olson, Kathleen A.; de Davila, Silvia Alvarez; Campoverde, Victoria

2018-01-01

Parent-school engagement is a contributor to student achievement, but few relevant programs exist for immigrant Latino families. This article describes the design, pilot implementation, and evaluation of a parent-engagement Extension program, developed and implemented in Spanish. The purpose of the program is to help parents develop and/or…

Evaluation of Link Courses and Other Co-Operative Educational Programs in New South Wales During 1979.

ERIC Educational Resources Information Center

Craig, Alan; And Others

Link courses and other cooperative educational programs designed for secondary school students in New South Wales were evaluated in 1979. Link courses/programs are instructional sessions in which secondary students attend a postsecondary institution, or in which postsecondary faculty give lessons to students at the secondary school. The study was…

The Three-Year (1995-1997) Workplace Literacy Program at Chinatown Manpower Project, Inc. Final Evaluation.

ERIC Educational Resources Information Center

Friedenberg, Joan E.

An external evaluation was conducted of the Workplace Literacy Program at Chinatown Manpower Project, Inc., which provided oral and written job-specific instruction in English as a second language to Chinese garment workers. The program was designed for underemployed garment industry workers with low English proficiency, including seamstresses,…

Challenging the Gifted through Problem Solving Experiences: Design and Evaluation of the COMET Program.

ERIC Educational Resources Information Center

Feldhusen, John F.; And Others

1992-01-01

The COMET summer residential program at Purdue University (Indiana) offers gifted and talented youth in grades 4-6 a week of intensive study in a single content area. Courses stress specific problem-solving skills and development of a rich knowledge base. Extensive program evaluation by students, teachers, counselors, and parents was highly…

SETRC Basic Training Program. O.E.E. Evaluation Report, 1981-82.

ERIC Educational Resources Information Center

Tobias, Robert; And Others

The Special Education Training and Resource Center (SETRC) program was developed in 1979-80 to design, provide, and coordinate specialized staff and parent training to ensure that handicapped students in New York City Schools receive appropriate and meaningful education in accordance with public policy. An evaluation of the program in the 1981-82…

The Parents Helping Parents and Count Me In Projects: Evaluation Report, 1983-1984.

ERIC Educational Resources Information Center

Goldberg, Paula F.; And Others

The report presents 1983-84 evaluative data on two projects sponsored by the PACER Center (the Parent Advocacy Coalition for Educational Rights): a statewide parent training program and a program designed to foster positive attitudes about handicapped persons. The parent training program is analyzed in terms of five levels of activity: public…

Self-Study and Evaluation Guide/1979 Edition. Section D-16: Other Service Program.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

The self evaluation guide is explained to be designed for accreditation of services to blind and visually handicapped students in service programs for which the NAC (National Accreditation Council for Agencies Serving the Blind and Visually Handicapped) does not have specific program standards (such as radio reading services and library services).…

A Program Evaluation of a Worksite Wellness Initiative for Weight Loss

ERIC Educational Resources Information Center

Martinez, Nicholas

2017-01-01

The purpose of this study was to conduct a program evaluation of ACME's worksite weight loss initiative and collect evidence relative to the efficacy of the program. An anonymous online survey was administered to participants of the weight loss initiative. The survey was designed to gather information relative to the research questions, which…

Evaluation Report of the Harlandale Independent School District's Bilingual Education Program.

ERIC Educational Resources Information Center

Harrison, Helene W.

The 1973 report evaluates the Bilingual Education Program of Harlandale Independent School District. The bilingual program is designed for Spanish speaking pupils in grades K-5 (1,517 children in 8 of the district's 15 elementary schools) who have limited English-speaking ability. The 1972-73 project involved (1) development and revision of…

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

ERIC Educational Resources Information Center

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

ERIC Educational Resources Information Center

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Evaluation of an Organizational Development Program for Social Service Agencies. Final Report 77-2.

ERIC Educational Resources Information Center

Olmstead, Joseph A.

This report describes and evaluates an agency development program designed to aid administrators and supervisors of local social services to achieve effective agency performance. The program was conducted for a period of one year within four local agencies; two additional agencies were used as control groups. Assistance was provided through…

A study of commuter airplane design optimization

NASA Technical Reports Server (NTRS)

Keppel, B. V.; Eysink, H.; Hammer, J.; Hawley, K.; Meredith, P.; Roskam, J.

1978-01-01

The usability of the general aviation synthesis program (GASP) was enhanced by the development of separate computer subroutines which can be added as a package to this assembly of computerized design methods or used as a separate subroutine program to compute the dynamic longitudinal, lateral-directional stability characteristics for a given airplane. Currently available analysis methods were evaluated to ascertain those most appropriate for the design functions which the GASP computerized design program performs. Methods for providing proper constraint and/or analysis functions for GASP were developed as well as the appropriate subroutines.

Lessons from the trenches: meeting evaluation challenges in school health education.

PubMed

Young, Michael; Denny, George; Donnelly, Joseph

2012-11-01

Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.

Food fortification: issues on quality assurance and impact evaluation in developing countries.

PubMed

Florentino, R

2003-01-01

Quality assurance and impact evaluation are essential components of a food fortification program and should be integrated in the fortification process. Quality assurance will ensure that the micronutrient meant to be delivered is indeed reaching the target population at the correct level. Impact evaluation will determine the effectiveness of food fortification as a strategy in controlling micronutrient deficiency and enable program planners to make decisions on the future of the program. In developing countries, both quality assurance and impact evaluation are often constrained not only by inadequacy of facilities as well as financial and manpower resources, but by unclear definition of objectives and inappropriate design. It is therefore necessary to consider the target audience for the quality assurance monitoring and impact evaluation in order to clearly define their objectives and in turn suit the design to these objectives, at the same time as the limitations in financial and manpower resources are considered.

Curated Collections for Educators: Five Key Papers about Program Evaluation.

PubMed

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Curated Collections for Educators: Five Key Papers about Program Evaluation

PubMed Central

Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-01-01

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group’s top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs. PMID:28589073

Space station thermal control surfaces. [space radiators

NASA Technical Reports Server (NTRS)

Maag, C. R.; Millard, J. M.; Jeffery, J. A.; Scott, R. R.

1979-01-01

Mission planning documents were used to analyze the radiator design and thermal control surface requirements for both space station and 25-kW power module, to analyze the missions, and to determine the thermal control technology needed to satisfy both sets of requirements. Parameters such as thermal control coating degradation, vehicle attitude, self eclipsing, variation in solar constant, albedo, and Earth emission are considered. Four computer programs were developed which provide a preliminary design and evaluation tool for active radiator systems in LEO and GEO. Two programs were developed as general programs for space station analysis. Both types of programs find the radiator-flow solution and evaluate external heat loads in the same way. Fortran listings are included.

A statewide nurse training program for a hospital based infant abusive head trauma prevention program.

PubMed

Nocera, Maryalice; Shanahan, Meghan; Murphy, Robert A; Sullivan, Kelly M; Barr, Marilyn; Price, Julie; Zolotor, Adam

2016-01-01

Successful implementation of universal patient education programs requires training large numbers of nursing staff in new content and procedures and maintaining fidelity to program standards. In preparation for statewide adoption of a hospital based universal education program, nursing staff at 85 hospitals and 1 birthing center in North Carolina received standardized training. This article describes the training program and reports findings from the process, outcome and impact evaluations of this training. Evaluation strategies were designed to query nurse satisfaction with training and course content; determine if training conveyed new information, and assess if nurses applied lessons from the training sessions to deliver the program as designed. Trainings were conducted during April 2008-February 2010. Evaluations were received from 4358 attendees. Information was obtained about training type, participants' perceptions of newness and usefulness of information and how the program compared to other education materials. Program fidelity data were collected using telephone surveys about compliance to delivery of teaching points and teaching behaviors. Results demonstrate high levels of satisfaction and perceptions of program utility as well as adherence to program model. These findings support the feasibility of implementing a universal patient education programs with strong uptake utilizing large scale systematic training programs. Copyright © 2015 Elsevier Ltd. All rights reserved.

The opportunities and challenges of multi-site evaluations: lessons from the jail diversion and trauma recovery national cross-site evaluation.

PubMed

Stainbrook, Kristin; Penney, Darby; Elwyn, Laura

2015-06-01

Multi-site evaluations, particularly of federally funded service programs, pose a special set of challenges for program evaluation. Not only are there contextual differences related to project location, there are often relatively few programmatic requirements, which results in variations in program models, target populations and services. The Jail Diversion and Trauma Recovery-Priority to Veterans (JDTR) National Cross-Site Evaluation was tasked with conducting a multi-site evaluation of thirteen grantee programs that varied along multiple domains. This article describes the use of a mixed methods evaluation design to understand the jail diversion programs and client outcomes for veterans with trauma, mental health and/or substance use problems. We discuss the challenges encountered in evaluating diverse programs, the benefits of the evaluation in the face of these challenges, and offer lessons learned for other evaluators undertaking this type of evaluation. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Design of Schools' Performance Incentive Programs in Texas: Findings from Year One of TEEG. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2008

2008-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the first-year evaluation of the Texas Educator Excellence Grant (TEEG) program, one of several statewide educator incentive programs in Texas. This report provides an overview of over 1,000 schools' locally designed TEEG performance incentive…

WINCADRE (COMPUTER-AIDED DATA REVIEW AND EVALUATION)

EPA Science Inventory

WinCADRE (Computer-Aided Data Review and Evaluation) is a Windows -based program designed for computer-assisted data validation. WinCADRE is a powerful tool which significantly decreases data validation turnaround time. The electronic-data-deliverable format has been designed ...

Computer-aided system of evaluation for population-based all-in-one service screening (CASE-PASS): from study design to outcome analysis with bias adjustment.

PubMed

Chen, Li-Sheng; Yen, Amy Ming-Fang; Duffy, Stephen W; Tabar, Laszlo; Lin, Wen-Chou; Chen, Hsiu-Hsi

2010-10-01

Population-based routine service screening has gained popularity following an era of randomized controlled trials. The evaluation of these service screening programs is subject to study design, data availability, and the precise data analysis for adjusting bias. We developed a computer-aided system that allows the evaluation of population-based service screening to unify these aspects and facilitate and guide the program assessor to efficiently perform an evaluation. This system underpins two experimental designs: the posttest-only non-equivalent design and the one-group pretest-posttest design and demonstrates the type of data required at both the population and individual levels. Three major analyses were developed that included a cumulative mortality analysis, survival analysis with lead-time adjustment, and self-selection bias adjustment. We used SAS AF software to develop a graphic interface system with a pull-down menu style. We demonstrate the application of this system with data obtained from a Swedish population-based service screen and a population-based randomized controlled trial for the screening of breast, colorectal, and prostate cancer, and one service screening program for cervical cancer with Pap smears. The system provided automated descriptive results based on the various sources of available data and cumulative mortality curves corresponding to the study designs. The comparison of cumulative survival between clinically and screen-detected cases without a lead-time adjustment are also demonstrated. The intention-to-treat and noncompliance analysis with self-selection bias adjustments are also shown to assess the effectiveness of the population-based service screening program. Model validation was composed of a comparison between our adjusted self-selection bias estimates and the empirical results on effectiveness reported in the literature. We demonstrate a computer-aided system allowing the evaluation of population-based service screening programs with an adjustment for self-selection and lead-time bias. This is achieved by providing a tutorial guide from the study design to the data analysis, with bias adjustment. Copyright © 2010 Elsevier Inc. All rights reserved.

Computer-aided design development transition for IPAD environment

NASA Technical Reports Server (NTRS)

Owens, H. G.; Mock, W. D.; Mitchell, J. C.

1980-01-01

The relationship of federally sponsored computer-aided design/computer-aided manufacturing (CAD/CAM) programs to the aircraft life cycle design process, an overview of NAAD'S CAD development program, an evaluation of the CAD design process, a discussion of the current computing environment within which NAAD is developing its CAD system, some of the advantages/disadvantages of the NAAD-IPAD approach, and CAD developments during transition into the IPAD system are discussed.

Hydrazine Gas Generator Program. [space shuttles

NASA Technical Reports Server (NTRS)

Kusak, L.; Marcy, R. D.

1975-01-01

The design and fabrication of a flight gas generator for the space shuttle were investigated. Critical performance parameters and stability criteria were evaluated as well as a scaling laws that could be applied in designing the flight gas generator. A test program to provide the necessary design information was included. A structural design, including thermal and stress analysis, and two gas generators were fabricated based on the results. Conclusions are presented.

Final Accumulative Results & Transfer of Knowledge of the Arizona Career Ladder Research & Evaluation Project: Impact on Student Achievement, Formulated Models, Network Anecdotes, & Recommendations to the Legislature for Policy Development, Program Continuation & State-Wide Expansion. Summative Report VIII.

ERIC Educational Resources Information Center

Packard, Richard D.; Dereshiwsky, Mary I.

This paper presents research findings concerning the Career Ladder pilot test program in Arizona. The program is designed to reward and motivate teachers based on performance. One of the program's key features is the flexibility and innovation allowed to participating districts in their individual development of program designs and structures. An…

An Analysis of a Contingency Program on Designated Drivers at a College Bar

ERIC Educational Resources Information Center

Kazbour, Richard R.; Bailey, Jon S.

2010-01-01

The present study evaluated the effects of prompts and incentives on designated drivers in a bar. We defined the dependent variable as the percentage of customers either functioning as or riding with a designated driver. We used an ABCA design to evaluate the effectiveness of prompts and incentives on the dependent variable. Results indicated that…

Fault diagnostic instrumentation design for environmental control and life support systems

NASA Technical Reports Server (NTRS)

Yang, P. Y.; You, K. C.; Wynveen, R. A.; Powell, J. D., Jr.

1979-01-01

As a development phase moves toward flight hardware, the system availability becomes an important design aspect which requires high reliability and maintainability. As part of continous development efforts, a program to evaluate, design, and demonstrate advanced instrumentation fault diagnostics was successfully completed. Fault tolerance designs for reliability and other instrumenation capabilities to increase maintainability were evaluated and studied.

Using multimedia for patient information--a program about nocturnal enuresis.

PubMed

Evans, J H; Collier, J; Crook, I; Garrud, P; Harris, P; MacKinlay, D R; Redsell, S A

1998-05-01

To identify the information needs of children with nocturnal enuresis, and to design, produce and evaluate an interactive computer program to provide this information. The program was developed over an 18-month period using information provided by children, parents and professionals, and was evaluated in a hospital-based enuresis clinic in 65 children. Usability and knowledge gained were also evaluated in 43 healthy children aged 8-10 years attending a local inner-city primary school. An interactive program about nocturnal enuresis was developed, which runs on a personal computer and uses sound, voice, cartoon drawings and animation in a modular design. Knowledge scores increased in clinic attendees and in schoolchildren after using the program (Wilcoxon matched pairs test, P < 0.001). This improvement was maintained when the program was re-tested 6-10 months later. This interactive computer program holds children's attention and increases their understanding of enuresis. Interactive multimedia may be useful to complement the information provided by health professionals. This method of communication may be particularly useful for children with a low level of literacy.

Family Literacy Report.

ERIC Educational Resources Information Center

Illinois Literacy Resource Development Center, Rantoul.

Seven model family literacy programs in Illinois were monitored for one year to determine successful program components and characteristics and to assist local programs in developing and implementing practical evaluation systems. Six were networking programs each of which involved several agencies, and one program was designed on a center-based…

75 FR 7573 - Office of Safe and Drug-Free Schools; Overview Information; Models of Exemplary, Effective, and...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-22

... to the research, then a quasi- experimental evaluation of the program's implementation on the... experimental or quasi- experimental research design, with the evaluation results suggesting effectiveness in... this grant competition, a research design of the highest quality means an experimental design in which...

Development and evaluation of a school-based asthma educational program.

PubMed

Al Aloola, Noha Abdullah; Saba, Maya; Nissen, Lisa; Alewairdhi, Huda Abdullaziz; Alaloola, Alhnouf; Saini, Bandana

2017-05-01

To develop, implement, and evaluate the effects of a school-based asthma educational program on Saudi primary school teachers' asthma awareness and competence in delivering asthma-related first aid interventions. An asthma educational intervention program entitled "School Asthma Action Program" (SAAP) was designed based on pedagogical principles and implemented among teachers randomly selected from girls' primary schools in Riyadh, Saudi Arabia. This pilot study employed a pre-test/post-test experimental design. A previously tested asthma awareness questionnaire and a custom-designed asthma competence score sheet were used to evaluate the effects of the educational intervention program on teacher's asthma awareness and competence in providing asthma-related first aid interventions at schools. Forty-seven teachers from five different primary schools participated in the program. Of the 47 teachers, 39 completed both the pre- and post-program questionnaires. The SAAP improved teachers' awareness of asthma (teachers' median pre-program score was 11 (range 5-18) and their post-program score was 15 (range 7-18), p < 0.001) and their attitudes toward asthma management at schools (teachers' median pre-program score was 74 (range 15-75) and their post-program score was 75 (range 15-75), p = 0.043). Further, it improved teachers' competence in providing asthma-related first aid interventions (teachers' mean pre-program score was 1.4 ± 2.3 and their mean post-program score was 9.8 ± 0.5, p < 0.001). After completing the SAAP, a high proportion of teachers reported increased confidence in providing care to children with asthma at school. School-based asthma educational programs can significantly improve teachers' knowledge of asthma and their competence in providing asthma-related first aid interventions during emergencies.

Building leadership capacity to drive sustainable water management: the evaluation of a customised program.

PubMed

Taylor, A C

2010-01-01

This paper describes a customised, six-month, leadership development program (LDP) that was designed for emerging leaders in the Australian water industry who were promoting sustainable urban water management (SUWM). It also presents results from an evaluation of the program's benefits, costs and overall 'return on investment' (ROI). The program was designed to help build emergent leadership capacity in the water industry, given strong evidence that this form of leadership plays an important role in advancing SUWM. It involved '360-degree feedback' processes, training, individual leadership development plans, and coaching sessions. Its design was informed by a review of the literature, and its content was informed by local empirical research involving effective SUWM leaders. The evaluation used a seven-tier assessment framework that examined different dimensions of the program's performance using source and methodological triangulation. The results indicate that such LDPs can produce a range of positive outcomes, such as promoting desired leadership behaviours and generating a positive ROI estimate. Specifically, the program's estimated ROI was approximately 190% after only one year. The primary conclusion is that evidence-based LDPs which are highly customised for specific types of leaders in the water industry represent a promising type of intervention to build forms of leadership capacity which are needed to successfully promote SUWM.

Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

PubMed Central

Burrus, Barri B.; Scott, Alicia Richmond

2012-01-01

Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541

Sampling design for early detection of aquatic invasive species in Great Lakes ports

EPA Science Inventory

We evaluated a pilot adaptive monitoring program for aquatic invasive species (AIS) early detection in Lake Superior. The monitoring program is designed to detect newly-introduced fishes, and encompasses the lake’s three major ports (Duluth-Superior, Sault Ste. Marie, Thund...

The Use of Engineering Design Concept for Computer Programming Course: A Model of Blended Learning Environment

ERIC Educational Resources Information Center

Tritrakan, Kasame; Kidrakarn, Pachoen; Asanok, Manit

2016-01-01

The aim of this research is to develop a learning model which blends factors from learning environment and engineering design concept for learning in computer programming course. The usage of the model was also analyzed. This study presents the design, implementation, and evaluation of the model. The research methodology is divided into three…

Results of the 2004 DesignShare POE Program: Students and Teachers Tell Us what They Really Think

ERIC Educational Resources Information Center

Lackney, Jeffery A.

2004-01-01

DesignShare/School Construction News (DS/SCN) Jurists have often critically reflected on their desire to know more about how teachers and students really experience so-called innovative award-winning schools. Through the DesignShare Post-Occupancy Evaluation Program, the intention is to give voice to the individuals whose lives are directly…

Avoiding Problems in Evaluation.

ERIC Educational Resources Information Center

Tallmadge, G. Kasten

1979-01-01

Discusses the need for awareness of real and potential problems in educational evaluation approaches, kinds of problems there are with true experimental designs and with quasi-experimental designs, and the criteria applied by the Joint Dissemination Review Panel to its review of educational programs. (MF)

Factors Affecting Regression-Discontinuity.

ERIC Educational Resources Information Center

Schumacker, Randall E.

The regression-discontinuity approach to evaluating educational programs is reviewed, and regression-discontinuity post-program mean differences under various conditions are discussed. The regression-discontinuity design is used to determine whether post-program differences exist between an experimental program and a control group. The difference…

An Evaluation of Therapeutic Horseback Riding Programs for Adults with Physical Impairments.

ERIC Educational Resources Information Center

Farias-Tomaszewski, Sarah; Jenkins, Sharon Rae; Keller, Jean

2001-01-01

Assessed the outcome of a therapeutic horseback riding program for adults with physical disabilities. A one-group, pre- test/post-test design was used to evaluate changes on level of physical and global self-efficacy. Behavioral indices of self-confidence were also evaluated. Physical self-efficacy and behavioral self-confidence increased from…

Design and Implementation of a Multi-Strategy, Collegewide Program of Evaluation and Planning: The Mercy College Self-Study Project.

ERIC Educational Resources Information Center

Kraetzer, Mary C.; And Others

The rationale, strategies, and methods of The Mercy College Self-Study Project are considered, and evaluation instruments are provided. This program of institutional evaluation and planning was initiated in 1980 and consists of: standardized surveys, a 10-year longitudinal (panel) study, and academic department self-studies. Questionnaires…

Head Start Teaching Center: Outcome Evaluation of 3 Years of Participatory Training.

ERIC Educational Resources Information Center

Caruso, D. A.; Horm-Wingerd, D. M.; Golas, J. C.

The New England Head Start Teaching Center (NEHSTC) is one of 14 federally funded programs created to test the efficacy of participatory, hands-on training for enhancing Head Start service delivery. An outcome evaluation of the program was conducted after 3 years of operation. The research design of the evaluation was a nonequivalent comparison…

Exercises in Evaluation of a Large-Scale Educational Program.

ERIC Educational Resources Information Center

Glass, Gene V.

This workbook is designed to serve as training experience for educational evaluators at the preservice (graduate school) or inservice stages. The book comprises a series of exercises in the planning, execution, and reporting of the evaluation of a large-scale educational program in this case Title I of the Elementary and Secondary Education Act of…

North Carolina State Supported Early Childhood Demonstration Centers. Second Annual Evaluation: 1970-1971.

ERIC Educational Resources Information Center

Learning Inst. of North Carolina, Durham.

The second year of a state supported early childhood education program was evaluated, using a pre-post evaluation design involving experimental and control groups. An Early Childhood Assessment Battery was administered to 720 five-year-olds enrolled in the kindergarten program by their teachers. The control group (178) were tested locally. Results…

Models and Procedures for Improving the Planning, Management, and Evaluation of Cooperative Education Programs. Final Report. Volume I.

ERIC Educational Resources Information Center

Blaschke, Charles L.; Steiger, JoAnn

This report of a project to design a set of training guidelines for planning, managing, and evaluating cooperative education programs describes briefly the procedures used in developing the guidelines and model; discusses the various components of the planning, management, and evaluation process; and presents guidelines and criteria for designing…

Assessment and Evaluation in Adapted Physical Education.

ERIC Educational Resources Information Center

Kennedy, Charlotte I.; Bundschuh, Ernie

Intended for physical education teachers, the booklet describes informal and formal methods for evaluating handicapped children to determine whether they can participate in a regular physical education program with nonhandicapped students, in a regular physical education program with modification, or in a specially designed physical education…

Evaluation Strategies for EWP Programs: A Marketing Perspective.

ERIC Educational Resources Information Center

Turkewych, Christine

1986-01-01

Describes how evaluation strategies can be implemented to increase the effectiveness of English in the Work Place programs. Discusses the design and implementation of the strategy, how to analyze its results and produce a final report, and ways to get the results used. (SED)

Knowledge-based environment for optical system design

NASA Astrophysics Data System (ADS)

Johnson, R. Barry

1991-01-01

Optical systems are extensively utilized by industry government and military organizations. The conceptual design engineering design fabrication and testing of these systems presently requires significant time typically on the order of 3-5 years. The Knowledge-Based Environment for Optical System Design (KB-OSD) Program has as its principal objectives the development of a methodology and tool(s) that will make a notable reduction in the development time of optical system projects reduce technical risk and overall cost. KB-OSD can be considered as a computer-based optical design associate for system engineers and design engineers. By utilizing artificial intelligence technology coupled with extensive design/evaluation computer application programs and knowledge bases the KB-OSD will provide the user with assistance and guidance to accomplish such activities as (i) develop system level and hardware level requirements from mission requirements (ii) formulate conceptual designs (iii) construct a statement of work for an RFP (iv) develop engineering level designs (v) evaluate an existing design and (vi) explore the sensitivity of a system to changing scenarios. The KB-OSD comprises a variety of computer platforms including a Stardent Titan supercomputer numerous design programs (lens design coating design thermal materials structural atmospherics etc. ) data bases and heuristic knowledge bases. An important element of the KB-OSD Program is the inclusion of the knowledge of individual experts in various areas of optics and optical system engineering. This knowledge is obtained by KB-OSD knowledge engineers performing

Reliability analysis of laminated CMC components through shell subelement techniques

NASA Technical Reports Server (NTRS)

Starlinger, A.; Duffy, S. F.; Gyekenyesi, J. P.

1992-01-01

An updated version of the integrated design program C/CARES (composite ceramic analysis and reliability evaluation of structures) was developed for the reliability evaluation of CMC laminated shell components. The algorithm is now split in two modules: a finite-element data interface program and a reliability evaluation algorithm. More flexibility is achieved, allowing for easy implementation with various finite-element programs. The new interface program from the finite-element code MARC also includes the option of using hybrid laminates and allows for variations in temperature fields throughout the component.

TEAM-HF Cost-Effectiveness Model: A Web-Based Program Designed to Evaluate the Cost-Effectiveness of Disease Management Programs in Heart Failure

PubMed Central

Reed, Shelby D.; Neilson, Matthew P.; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H.; Polsky, Daniel E.; Graham, Felicia L.; Bowers, Margaret T.; Paul, Sara C.; Granger, Bradi B.; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara; Levy, Wayne C.

2015-01-01

Background Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. Methods We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics, use of evidence-based medications, and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model (SHFM). Projections of resource use and quality of life are modeled using relationships with time-varying SHFM scores. The model can be used to evaluate parallel-group and single-cohort designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. Results The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. Conclusion The TEAM-HF Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. PMID:26542504

Evaluation Design: 1981-82 State Compensatory Education. Publication No. 81.20.

ERIC Educational Resources Information Center

Mangino, Evangelina; And Others

The evaluation of the 1981-82 State Compensatory Education (SCE) program, as implemented in the Austin Independent School District, will involve the following major activities: production of an Evaluation Design based on input received from key SCE personnel; production of a Final Report and a Technical Report which present information and…

10 CFR 709.3 - Covered persons subject to a CI evaluation and polygraph.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Covered persons subject to a CI evaluation and polygraph. 709.3 Section 709.3 Energy DEPARTMENT OF ENERGY COUNTERINTELLIGENCE EVALUATION PROGRAM General... (currently designated as Sigma 14); and improvised nuclear device concepts or designs; and (6) Any system...

Program for establishing long time flight service performance of composite materials in the central wing structure of C-130 aircraft. Phase 2: Detailed design

NASA Technical Reports Server (NTRS)

Harvill, W. E.; Duhig, J. J.; Spencer, B. R.

1973-01-01

The design, fabrication, and evaluation of boron-epoxy reinforced C-130 center wing boxes are discussed. Design drawings, static strength, fatigue endurance, flutter, and weight analyses required for the wing box fabrication are presented. Additional component testing to verify the design for panel buckling and to evaluate specific local design areas are reported.

George W. Wingate High School Bilingual Program ESEA Title VII Final Evaluation Report, 1979-1980.

ERIC Educational Resources Information Center

New York City Board of Education, Brooklyn, NY. Office of Educational Evaluation.

This is an evaluation report of the fifth year of a bilingual career education program, funded under Title VII and carried out at George W. Wingate High School, Brooklyn, New York. The program was designed to offer bilingual instruction and supportive services to the school's Haitian population, with the aim of preparing these students to…

Evaluation of the Pilot Program of the Truancy Case Management Partnership Initiative in the District of Columbia, 2011-12

ERIC Educational Resources Information Center

Liberman, Akiva; Cahill, Meagan

2012-01-01

This evaluation of the Case Management Partnership Initiative (CPMI) found that the program successfully linked high-need families with services designed to prevent truancy. The truancy prevention program, implemented at Anacostia and Ballou High Schools in 2011-2012, links chronically truant ninth graders and their families to social services and…

Evaluation of the Tennessee Voluntary Prekindergarten Program: Kindergarten and First Grade Follow-Up Results from the Randomized Control Design. Research Report

ERIC Educational Resources Information Center

Lipsey, Mark W.; Hofer, Kerry G.; Dong, Nianbo; Farran, Dale C.; Bilbrey, Carol

2013-01-01

In 2009, Vanderbilt University's Peabody Research Institute, with the assistance of the Tennessee Department of Education's Division of Curriculum and Instruction, initiated a rigorous, independent evaluation of the state's Voluntary Prekindergarten program (TN- VPK). TN-VPK is a full-day prekindergarten program for four-year-old children expected…

School-Based Smoking Prevention Programs for Adolescents in South Korea: A Systematic Review

ERIC Educational Resources Information Center

Park, Eunok

2006-01-01

The number of research papers evaluating programs designed to prevent adolescent smoking have increased in the last 13 years in Korea. The purpose of this study was to evaluate these programs, to review the features of the studies and to systemically assess the results on the knowledge about, and attitude to, smoking and smoking behavior. Database…

Bronx Multidiscipline Special Education Bilingual Program. E.S.E.A Title VII Annual Evaluation Report, 1980-81.

ERIC Educational Resources Information Center

Tobias, Robert; Spiridakis, John

This report evaluates a program designed to supplement the basic educational services, provided by New York City's Division of Special Education, for Hispanic handicapped students with limited English proficiency. In 1980-81, the program served 129 students in nine public schools (seven elementary and two intermediate) and one private school in…

National Home Start Evaluation Interim Report VII. Twenty-Month Program Analysis and Findings.

ERIC Educational Resources Information Center

Love, John M.; And Others

This interim evaluation report focuses on process (formative) and outcome (summative) data collected in spring 1975 on the National Home Start Program. Home Start, a federally-funded 3-year (1972-1975) home-based demonstration program for low-income families with 3- to 5-year-old children was designed to enhance a mother's skills in dealing with…

Evaluating the Impact of the "Teaching as a Chemistry Laboratory Graduate Teaching Assistant" Program on Cognitive and Psychomotor Verbal Interactions in the Laboratory

ERIC Educational Resources Information Center

Flaherty, A.; O'Dwyer, A.; Mannix-McNamara, P.; Leahy, J. J.

2017-01-01

Designing and evaluating teacher development programs for graduate teaching assistants (GTAs) who teach in the laboratory is a prominent feature of chemistry education research. However, few studies have investigated the impact of a GTA teacher development program on the verbal interactions between participating GTAs and students in the…

Evaluation of the Even Start--Padres y Progreso Program in the Houston Independent School District.

ERIC Educational Resources Information Center

Stevens, Carla J.; And Others

The Even Start-Padres y Progreso program is a nationally funded program designed to prepare young children to enter school by not only offering early childhood education, but also assisting their families with adult literacy and English as a Second Language (ESL), parenting-skills training, and employment-skills training. An evaluation of the…

WWC Review of the Report "Evaluation of the College Possible Program: Results from a Randomized Controlled Trial." What Works Clearinghouse Single Study Review

ERIC Educational Resources Information Center

What Works Clearinghouse, 2014

2014-01-01

The 2013 study, "Evaluation of the College Possible Program: Results From a Randomized Controlled Trial", investigated the effect of the "College Possible" program, which is designed to serve low-income high school students by providing SAT/ACT test preparation, financial aid consulting, and college admissions guidance in an…

An Evaluation of the National Teachers' Institute's Manpower Training Program for Teaching Personnel in Mid-Western Nigeria

ERIC Educational Resources Information Center

Osunde, A. U.; Omoruyi, F. E. O.

2004-01-01

This study evaluated the manpower-training program for teaching personnel in mid-western Nigeria by the National Teachers' Institute. Overall, 240 participants involved in the training program who were randomly selected from the area constituted the sample for the study. A questionnaire designed by the authors was the major instrument used for…

Youth Empowerment Solutions: Evaluation of an After-School Program to Engage Middle School Students in Community Change

ERIC Educational Resources Information Center

Zimmerman, Marc A.; Eisman, Andria B.; Reischl, Thomas M.; Morrel-Samuels, Susan; Stoddard, Sarah; Miller, Alison L.; Hutchison, Pete; Franzen, Susan; Rupp, Laney

2018-01-01

We report on an effectiveness evaluation of the Youth Empowerment Solutions (YES) program. YES applies empowerment theory to an after-school program for middle school students. YES is an active learning curriculum designed to help youth gain confidence in themselves, think critically about their community, and work with adults to create positive…

Evaluation of Minority Retention Programs: The Undergraduate Research Opportunities Program at the University of Michigan.

ERIC Educational Resources Information Center

Jonides, John; And Others

An evaluation was done of the first year of the Undergraduate Research Opportunities Program (UROP) at the University of Michigan (Ann Arbor), which is designed not only to teach students about research and/or certain academic topics, but also to facilitate the identification of minority students with the university. This second aim is based on…

A Model-Based Evaluation of a Cultural Mediator Outreach Program for HIV+ Ethiopian Immigrants in Israel.

ERIC Educational Resources Information Center

Kaplan, Edward H.; Soskolne, Varda; Adler, Bella; Leventhal, Alex; Shtarkshall, Ronny A.

2002-01-01

Conducted a model-based evaluation of a program designed to reduce HIV transmission from HIV-infected Ethiopian immigrants in Israel. Focused on pregnancy rate reduction as a measure of sexual exposure. Results for 145 female and 176 male clients in the intervention suggest reduction in unprotected sexual exposures among program participants. (SLD)

Incarcerated women develop a nutrition and fitness program: participatory research.

PubMed

Elwood Martin, Ruth; Adamson, Sue; Korchinski, Mo; Granger-Brown, Alison; R Ramsden, Vivian; A Buxton, Jane; Espinoza-Magana, Nancy; L Pollock, Sue; J F Smith, Megan; C Macaulay, Ann; Lisa Condello, Lara; Gregory Hislop, T

2013-01-01

Women in prison throughout the world experience higher rates of mental and physical illness compared with the general population and compared with men in prison. The paper finds no published studies that report on men or women in prison engaging in participatory health research to address their concerns about nutrition and fitness. The purpose of this paper is to describe a pilot nutrition and fitness program, which resulted from a unique prison participatory health research project. Women in prison designed, led, and evaluated a six-week pilot fitness program in a minimum/medium security women's prison. Pre- and post-program assessments included a self-administered questionnaire and body measures. Open-ended questionnaire responses illuminated the quantitative findings. Sixteen women in prison completed the program evaluation. Weight, body mass index, waist-to-hip ratio, and chest measurements decreased, and energy, sleep, and stress levels improved by the end of the program. As a component of a participatory research project, incarcerated women designed and led a nutrition and fitness program, which resulted in improved body measures and self-reported health benefits. ORIGINALITY VALUE: Incarceration provides opportunities to engage women in designing their own health programs with consequent potential long-term "healing" benefits.

HKHC Community Dashboard: design, development, and function of a Web-based performance monitoring system.

PubMed

Bors, Philip A; Kemner, Allison; Fulton, John; Stachecki, Jessica; Brennan, Laura K

2015-01-01

As part of Robert Wood Johnson Foundation's Healthy Kids, Healthy Communities (HKHC) national grant program, a technical assistance team designed the HKHC Community Dashboard, an online progress documentation and networking system. The Dashboard was central to HKHC's multimethod program evaluation and became a communication interface for grantees and technical assistance providers. The Dashboard was designed through an iterative process of identifying needs and priorities; designing the user experience, technical development, and usability testing; and applying visual design. The system was created with an open-source content management system and support for building an online community of users. The site developer trained technical assistance providers at the national program office and evaluators, who subsequently trained all 49 grantees. Evaluators provided support for Dashboard users and populated the site with the bulk of its uploaded tools and resource documents. The system tracked progress through an interactive work plan template, regular documentation by local staff and partners, and data coding and analysis by the evaluation team. Other features included the ability to broadcast information to Dashboard users via e-mail, event calendars, discussion forums, private messaging, a resource clearinghouse, a technical assistance diary, and real-time progress reports. The average number of Dashboard posts was 694 per grantee during the grant period. Technical assistance providers and grantees uploaded a total of 1304 resource documents. The Dashboard functions with the highest grantee satisfaction were its interfaces for sharing and progress documentation. A majority of Dashboard users (69%) indicated a preference for continued access to the Dashboard's uploaded resource documents. The Dashboard was a useful and innovative tool for participatory evaluation of a large national grant program. While progress documentation added some burden to local project staff, the system proved to be a useful resource-sharing technology.

Evaluation of ADAM/1 model for advanced coal extraction concepts

NASA Technical Reports Server (NTRS)

Deshpande, G. K.; Gangal, M. D.

1982-01-01

Several existing computer programs for estimating life cycle cost of mining systems were evaluated. A commercially available program, ADAM/1 was found to be satisfactory in relation to the needs of the advanced coal extraction project. Two test cases were run to confirm the ability of the program to handle nonconventional mining equipment and procedures. The results were satisfactory. The model, therefore, is recommended to the project team for evaluation of their conceptual designs.

ACT-CCREC Core Research Program: Study Questions and Design. ACT Working Paper Series. WP-2015-01

ERIC Educational Resources Information Center

Cruce, Ty M.

2015-01-01

This report provides a non-technical overview of the guiding research questions and research design for the ACT-led core research program conducted on behalf of the GEAR UP College and Career Readiness Evaluation Consortium (CCREC). The core research program is a longitudinal study of the effectiveness of 14 GEAR UP state grants on the academic…

Cookbook Versus Creative Chemistry

ERIC Educational Resources Information Center

Venkatachelam, Chaya; Rudolph, R. W.

1974-01-01

A new approach to a research-oriented general chemistry laboratory is described. Objectives for the laboratory program are specified, details are provided concerning the program design, and the results of an experiment to evaluate the program are reported. (DT)

Minimum Hamiltonian ascent trajectory evaluation (MASTRE) program (update to automatic flight trajectory design, performance prediction, and vehicle sizing for support of shuttle and shuttle derived vehicles) users manual

NASA Technical Reports Server (NTRS)

Lyons, J. T.; Borchers, William R.

1993-01-01

Documentation for the User Interface Program for the Minimum Hamiltonian Ascent Trajectory Evaluation (MASTRE) is provided. The User Interface Program is a separate software package designed to ease the user input requirements when using the MASTRE Trajectory Program. This document supplements documentation on the MASTRE Program that consists of the MASTRE Engineering Manual and the MASTRE Programmers Guide. The User Interface Program provides a series of menus and tables using the VAX Screen Management Guideline (SMG) software. These menus and tables allow the user to modify the MASTRE Program input without the need for learning the various program dependent mnemonics. In addition, the User Interface Program allows the user to modify and/or review additional input Namelist and data files, to build and review command files, to formulate and calculate mass properties related data, and to have a plotting capability.

Development of a recovery education program for inpatient mental health providers.

PubMed

Chen, Shu-Ping; Krupa, Terry; Lysaght, Rosemary; McCay, Elizabeth; Piat, Myra

2014-12-01

Mental health system transformation toward a recovery-orientation has created a demand for education to equip providers with recovery competencies. This report describes the development of a recovery education program designed specifically for inpatient providers. Part 1 of the education is a self-learning program introducing recovery concepts and a recovery competency framework; Part 2 is a group-learning program focusing on real-life dilemmas and applying the Appreciative Inquiry approach to address these clinical dilemmas. A pilot study with a pretest/posttest design was used to evaluate the program. Participants included 26 inpatient multidisciplinary providers from 3 hospitals. The results showed participants' improvement on recovery knowledge (z = -2.55, p = .011) after the self-learning program. Evaluations of the group-learning program were high (4.21 out of 5). These results support continued efforts to refine the program. Inpatient providers could use this program to lead interprofessional practice in promoting recovery. (c) 2014 APA, all rights reserved.

Methods for the evaluation of the Jamie Oliver Ministry of Food program, Australia

PubMed Central

2013-01-01

Background Community-based programs aimed at improving cooking skills, cooking confidence and individual eating behaviours have grown in number over the past two decades. Whilst some evidence exists to support their effectiveness, only small behavioural changes have been reported and limitations in study design may have impacted on results. This paper describes the first evaluation of the Jamie Oliver Ministry of Food Program (JMoF) Australia, in Ipswich, Queensland. JMoF Australia is a community-based cooking skills program open to the general public consisting of 1.5 hour classes weekly over a 10 week period, based on the program of the same name originating in the United Kingdom. Methods/Design A mixed methods study design is proposed. Given the programmatic implementation of JMoF in Ipswich, the quantitative study is a non-randomised, pre-post design comparing participants undergoing the program with a wait-list control group. There will be two primary outcome measures: (i) change in cooking confidence (self-efficacy) and (ii) change in self-reported mean vegetable intake (serves per day). Secondary outcome measures will include change in individual cooking and eating behaviours and psycho-social measures such as social connectedness and self-esteem. Repeated measures will be collected at baseline, program completion (10 weeks) and 6 months follow up from program completion. A sample of 250 participants per group will be recruited for the evaluation to detect a mean change of 0.5 serves a day of vegetables at 80% power (0.5% significance level). Data analysis will assess the magnitude of change of these variables both within and between groups and use sub group analysis to explore the relationships between socio-demographic characteristics and outcomes. The qualitative study will be a longitudinal design consisting of semi-structured interviews with approximately 10-15 participants conducted at successive time points. An inductive thematic analysis will be conducted to explore social, attitudinal and behavioural changes experienced by program participants. Discussion This evaluation will contribute to the evidence of whether cooking programs work in terms of improving health and wellbeing and the underlying mechanisms which may lead to positive behaviour change. Trial registration Australian and New Zealand Trial registration number: ACTRN12611001209987. PMID:23631683

77 FR 32612 - Proposed Priorities; Gaining Early Awareness and Readiness for Undergraduate Programs; College...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-01

... authorizes GEAR UP program grantees to design projects that promote participating students' secondary school... regarding implementation of the project and surveys of students and parents about their participation in... student survey by the evaluator and about the release of designated ``directory information'' from the...

Program Fighter: An Evaluation.

ERIC Educational Resources Information Center

Hull, David G.; Fowler, Wallace T.

A computer program for the sizing of subsonic and supersonic fighter planes was adapted for use in an aerospace engineering course at the University of Texas at Austin. FIGHTER uses classroom notation and separate subroutines for different disciplines to implement the conceptual design process. Input consists of a set of design variables and a set…

Comprehensive Career Education in a University: Evaluation.

ERIC Educational Resources Information Center

McLean, James E.; Loree, M. Ray

The University of Alabama Career Development Program was designed as a comprehensive, university-wide effort to enhance career development of students and faculty. The operational plan included four systems: (1) Academic mainstream system, designed to assist in the development of separate programs within the colleges and departments, (2) support…

WINCADRE INORGANIC (WINDOWS COMPUTER-AIDED DATA REVIEW AND EVALUATION)

EPA Science Inventory

WinCADRE (Computer-Aided Data Review and Evaluation) is a Windows -based program designed for computer-assisted data validation. WinCADRE is a powerful tool which significantly decreases data validation turnaround time. The electronic-data-deliverable format has been designed in...

Building Maintenance. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This program guide identifies primary concerns in the organization, operation, and evaluation of a building maintenance program. It is designed for local school district and community college administrators, instructors, program advisory committees, and regional coordinating councils. The guide begins with the Dictionary of Occupational Titles…

Evaluating Writing Programs: Paradigms, Problems, Possibilities.

ERIC Educational Resources Information Center

McLeod, Susan H.

1992-01-01

Describes two methodological approaches (qualitative and quantitative) that grow out of two different research examples. Suggests the problems these methods present. Discusses the ways in which an awareness of these problems can help teachers to understand how to work with researchers in designing useful evaluations of writing programs. (PRA)

Computer-Assisted Telephone Screening: A New System for Patient Evaluation and Recruitment

PubMed Central

Radcliffe, Jeanne M.; Latham, Georgia S.; Sunderland, Trey; Lawlor, Brian A.

1990-01-01

Recruitment of subjects for research studies is a time consuming process for any research coordinator. This paper introduces three computerized databases designed to help screen potential research candidates by telephone. The three programs discussed are designed to evaluate specific populations: geriatric patients (i.e. Alzheimer's patients), patients with affective disorders and normal volunteers. The interview content, software development, and the utility of these programs is discussed with particular focus on how they can be helpful in the research setting.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic

PubMed Central

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B.

2016-01-01

Background: The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. Objectives: A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. Study Design/Methods: This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. Results: The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. Conclusions: This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies. PMID:29444602

Methods for the evaluation of the Jamie Oliver Ministry of Food program, Australia.

PubMed

Flego, Anna; Herbert, Jessica; Gibbs, Lisa; Swinburn, Boyd; Keating, Catherine; Waters, Elizabeth; Moodie, Marj

2013-04-30

Community-based programs aimed at improving cooking skills, cooking confidence and individual eating behaviours have grown in number over the past two decades. Whilst some evidence exists to support their effectiveness, only small behavioural changes have been reported and limitations in study design may have impacted on results.This paper describes the first evaluation of the Jamie Oliver Ministry of Food Program (JMoF) Australia, in Ipswich, Queensland. JMoF Australia is a community-based cooking skills program open to the general public consisting of 1.5 hour classes weekly over a 10 week period, based on the program of the same name originating in the United Kingdom. A mixed methods study design is proposed. Given the programmatic implementation of JMoF in Ipswich, the quantitative study is a non-randomised, pre-post design comparing participants undergoing the program with a wait-list control group. There will be two primary outcome measures: (i) change in cooking confidence (self-efficacy) and (ii) change in self-reported mean vegetable intake (serves per day). Secondary outcome measures will include change in individual cooking and eating behaviours and psycho-social measures such as social connectedness and self-esteem. Repeated measures will be collected at baseline, program completion (10 weeks) and 6 months follow up from program completion. A sample of 250 participants per group will be recruited for the evaluation to detect a mean change of 0.5 serves a day of vegetables at 80% power (0.5% significance level). Data analysis will assess the magnitude of change of these variables both within and between groups and use sub group analysis to explore the relationships between socio-demographic characteristics and outcomes.The qualitative study will be a longitudinal design consisting of semi-structured interviews with approximately 10-15 participants conducted at successive time points. An inductive thematic analysis will be conducted to explore social, attitudinal and behavioural changes experienced by program participants. This evaluation will contribute to the evidence of whether cooking programs work in terms of improving health and wellbeing and the underlying mechanisms which may lead to positive behaviour change. Australian and New Zealand Trial registration number: ACTRN12611001209987.

The State of Evaluation in Internal Medicine Residency

PubMed Central

Holmboe, Eric; Beasley, Brent W.

2008-01-01

Background There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations. Objective To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation. Design Nationwide survey. Participants All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM). Measurements Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods. Results The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods. Conclusions Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high. PMID:18612734

Design of a verifiable subset for HAL/S

NASA Technical Reports Server (NTRS)

Browne, J. C.; Good, D. I.; Tripathi, A. R.; Young, W. D.

1979-01-01

An attempt to evaluate the applicability of program verification techniques to the existing programming language, HAL/S is discussed. HAL/S is a general purpose high level language designed to accommodate the software needs of the NASA Space Shuttle project. A diversity of features for scientific computing, concurrent and real-time programming, and error handling are discussed. The criteria by which features were evaluated for inclusion into the verifiable subset are described. Individual features of HAL/S with respect to these criteria are examined and justification for the omission of various features from the subset is provided. Conclusions drawn from the research are presented along with recommendations made for the use of HAL/S with respect to the area of program verification.

Computer aided design environment for the analysis and design of multi-body flexible structures

NASA Technical Reports Server (NTRS)

Ramakrishnan, Jayant V.; Singh, Ramen P.

1989-01-01

A computer aided design environment consisting of the programs NASTRAN, TREETOPS and MATLAB is presented in this paper. With links for data transfer between these programs, the integrated design of multi-body flexible structures is significantly enhanced. The CAD environment is used to model the Space Shuttle/Pinhole Occulater Facility. Then a controller is designed and evaluated in the nonlinear time history sense. Recent enhancements and ongoing research to add more capabilities are also described.

Final Report for the Intensified Career Exploration Program.

ERIC Educational Resources Information Center

McCauley, Lynne D.; Rusling, Diane E.

An intensified Career Exploration Program was evaluated through an analysis of the cognitive and affective learning resulting from ninth- and tenth-grade students' participation in the program. Designed to supplement the existing ninth- and tenth-grade components of the Ohio Career Development Program, this three-year program offered additional…

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

PubMed

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

Evaluations of reproductive health programs in humanitarian settings: a systematic review

PubMed Central

2015-01-01

Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and the results must be shared. The papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality. PMID:25685183

Designing cost effective water demand management programs in Australia.

PubMed

White, S B; Fane, S A

2002-01-01

This paper describes recent experience with integrated resource planning (IRP) and the application of least cost planning (LCP) for the evaluation of demand management strategies in urban water. Two Australian case studies, Sydney and Northern New South Wales (NSW) are used in illustration. LCP can determine the most cost effective means of providing water services or alternatively the cheapest forms of water conservation. LCP contrasts to a traditional approach of evaluation which looks only at means of increasing supply. Detailed investigation of water usage, known as end-use analysis, is required for LCP. End-use analysis allows both rigorous demand forecasting, and the development and evaluation of conservation strategies. Strategies include education campaigns, increasing water use efficiency and promoting wastewater reuse or rainwater tanks. The optimal mix of conservation strategies and conventional capacity expansion is identified based on levelised unit cost. IRP uses LCP in the iterative process, evaluating and assessing options, investing in selected options, measuring the results, and then re-evaluating options. Key to this process is the design of cost effective demand management programs. IRP however includes a range of parameters beyond least economic cost in the planning process and program designs, including uncertainty, benefit partitioning and implementation considerations.

Childhood obesity prevention in rural settings: background, rationale, and study design of ‘4-Health,’ a parent-only intervention

PubMed Central

2012-01-01

Background Childhood obesity in rural communities is a serious but understudied problem. The current experiment aims to assess a wide range of obesity risk factors among rural youth and to offer an 8-month intervention program for parents to reduce obesity risk in their preteen child. Methods/Design A two-group, repeated measures design is used to assess the effectiveness of the 4-Health intervention program. Assessments include anthropometric measures, child self-evaluations, parent self-evaluations, and parent evaluations of child. County Extension agents from 21 rural Montana counties recruit approximately 150 parent–child dyads and counties are semi-randomly assigned to the active intervention group (4-Health Educational Program) or a “best-practices” (Healthy Living Information) control group. Discussion This study will shed light on the effectiveness of this parent-only intervention strategy in reducing obesity risk factors among rural preteens. The 4-Health program is designed to provide information and skills development for busy rural parents that will increase healthy lifestyles of their preteen children and improve the parents’ ability to intervene effectively in the lives of their families during this critical developmental period. Trial registration ClinicalTrials.gov ID: NCT01510587 PMID:22471650

Advancing Care Within an Adult Mental Health Day Hospital: Program Re-Design and Evaluation.

PubMed

Taube-Schiff, Marlene; Mehak, Adrienne; Marangos, Sandy; Kalim, Anastasia; Ungar, Thomas

2017-11-13

Day hospital mental health programs provide alternate care to individuals of high acuity that do not require an inpatient psychiatric stay. Ensuring provision of best practice within these programs is essential for patient stabilization and recovery. However, there is scant literature to review when creating such a program. This paper provides an overview of the steps an acute care hospital took when designing and implementing new programming within a day hospital program. Qualitative data was collected following initial program rollout. This data helped to inform the ongoing modification of groups offered, group scheduling and content, as well as ensuring patient satisfaction and adequate skill delivery during the rollout period and beyond. The goal of this paper is to inform health service delivery for other programs when attempting to build or re-design a day hospital program.

Evaluation of Athletic Training Students' Clinical Proficiencies

PubMed Central

Walker, Stacy E; Weidner, Thomas G; Armstrong, Kirk J

2008-01-01

Context: Appropriate methods for evaluating clinical proficiencies are essential in ensuring entry-level competence. Objective: To investigate the common methods athletic training education programs use to evaluate student performance of clinical proficiencies. Design: Cross-sectional design. Setting: Public and private institutions nationwide. Patients or Other Participants: All program directors of athletic training education programs accredited by the Commission on Accreditation of Allied Health Education Programs as of January 2006 (n  =  337); 201 (59.6%) program directors responded. Data Collection and Analysis: The institutional survey consisted of 11 items regarding institutional and program demographics. The 14-item Methods of Clinical Proficiency Evaluation in Athletic Training survey consisted of respondents' demographic characteristics and Likert-scale items regarding clinical proficiency evaluation methods and barriers, educational content areas, and clinical experience settings. We used analyses of variance and independent t tests to assess differences among athletic training education program characteristics and the barriers, methods, content areas, and settings regarding clinical proficiency evaluation. Results: Of the 3 methods investigated, simulations (n  =  191, 95.0%) were the most prevalent method of clinical proficiency evaluation. An independent-samples t test revealed that more opportunities existed for real-time evaluations in the college or high school athletic training room (t189  =  2.866, P  =  .037) than in other settings. Orthopaedic clinical examination and diagnosis (4.37 ± 0.826) and therapeutic modalities (4.36 ± 0.738) content areas were scored the highest in sufficient opportunities for real-time clinical proficiency evaluations. An inadequate volume of injuries or conditions (3.99 ± 1.033) and injury/condition occurrence not coinciding with the clinical proficiency assessment timetable (4.06 ± 0.995) were barriers to real-time evaluation. One-way analyses of variance revealed no difference between athletic training education program characteristics and the opportunities for and barriers to real-time evaluations among the various clinical experience settings. Conclusions: No one primary barrier hindered real-time clinical proficiency evaluation. To determine athletic training students' clinical proficiency for entry-level employment, athletic training education programs must incorporate standardized patients or take a disciplined approach to using simulation for instruction and evaluation. PMID:18668172

Evaluation of Demonstrations of National School Lunch Program and School Breakfast Program Direct Certification of Children Receiving Medicaid Benefits: Access Evaluation Report

ERIC Educational Resources Information Center

Hulsey, Lara; Gordon, Anne; Leftin, Joshua; Beyler, Nicholas; Schirm, Allen; Smither-Wulsin, Claire; Crumbley, Will

2015-01-01

This report presents findings from the Access Evaluation, a study component that is designed to assess the potential impacts of direct certification-Medicaid (DC-M) on students' access to free school meals by conducting retrospective simulations of DC-M in school year 2011-2012, the year before the demonstration began. For the Access Evaluation,…

Long life reliability thermal control systems study

NASA Technical Reports Server (NTRS)

Scollon, T. R., Jr.; Killen, R. E.

1972-01-01

The results of a program undertaken to conceptually design and evaluate a passive, high reliability, long life thermal control system for space station application are presented. The program consisted of four steps: (1) investigate and select potential thermal system elements; (2) conceive, evaluate and select a thermal control system using these elements; (3) conduct a verification test of a prototype segment of the selected system; and (4) evaluate the utilization of waste heat from the power supply. The result of this project is a conceptual thermal control system design which employs heat pipes as primary components, both for heat transport and temperature control. The system, its evaluation, and the test results are described.

Pilot GPS LORAN Receiver Programming Performance A Laboratory Evaluation

DOT National Transportation Integrated Search

1994-02-01

This study was designed to explore GPS/LORAN receiver programming performance under : simulated flight conditions. The programming task consisted of entering, editing, and : verifying a four-waypoint flight plan. The task demands were manipulated by ...

Student Health Advocates: A Program for Extending Health Services to UCLA Students

ERIC Educational Resources Information Center

Habibi, Michele; Levine, Eileen Nebel

1976-01-01

The article describes and evaluates the pilot Student Health Advocate Program of UCLA, a peer-staffed, general health outreach program designed to provide care for students' minor medical and emotional concerns. (MB)

Collaborative evaluation of a high school prevention curriculum: How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement.

PubMed

Orsini, Muhsin Michael; Wyrick, David L; Milroy, Jeffrey J

2012-11-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome variables that can be used for program improvement. Throughout this project there were many examples of client learning from evaluator and evaluator learning from client. This article presents convincing evidence that collaborative evaluation can improve the design, implementation, and findings of the randomized control trial. Throughout this paper, we discuss many examples of good science, good evaluation, and other practical benefits of practicing collaborative evaluation. Ultimately, the authors created the term pre-formative evaluation to describe the period prior to data collection and before program implementation, when collaborative evaluation can inform program improvement. Copyright © 2012 Elsevier Ltd. All rights reserved.

A Comparison of Methodological Approaches for Evaluating the Quality of Basic Skills Programs. AIR Forum 1982 Paper.

ERIC Educational Resources Information Center

Dumont, Richard G.; And Others

A multiple-indicator and multiple-design approach for evaluating the quality of basic skills programs in reading, writing, and mathematics that has been implemented within a statewide system of higher education in the southeastern United States was assessed. Several of the evaluation methodologies are compared in order to determine whether results…

Evaluation of the Professional Development Program on Web Based Content Development

ERIC Educational Resources Information Center

Yurdakul, Bünyamin; Uslu, Öner; Çakar, Esra; Yildiz, Derya G.

2014-01-01

The aim of this study is to evaluate the professional development program on web based content development (WBCD) designed by the Ministry of National Education (MoNE). Based on the theoretical CIPP model by Stufflebeam and Guskey's levels of evaluation, the study was carried out as a case study. The study group consisted of the courses that…

Late Hebrew Immersion at Mt. Scopus College, Melbourne: Towards Complete Hebrew Fluency for Jewish Day School Students.

ERIC Educational Resources Information Center

Lorch, S. C.; And Others

1992-01-01

This paper describes and evaluates a Hebrew immersion program for Jewish day school students at Mt. Scopus College in Melbourne, Australia. Specific sections address the following: (1) the first year; (2) the second year; (3) designing the evaluation of the program; (4) results of the evaluation (including academic outcomes, student and parent…

A Mixed Methods Program Evaluation on the Effectiveness of a School Redesign Model on Teacher Empowerment and Student Achievement

ERIC Educational Resources Information Center

Costa, Ann Marie

2012-01-01

A recent law in a New England state allowed public schools to operate with increased flexibility and autonomy through the authorization of the creation of Innovation Schools. This project study, a program evaluation using a convergent parallel mixed methods research design, allowed for a comprehensive evaluation of the first Innovation School…

Evaluating Social Programs; Theory, Practice, and Politics. Quantitative Studies in Social Relations Series.

ERIC Educational Resources Information Center

Rossi, Peter H., Ed.; Williams, Walter, Ed.

This book addresses itself to three questions which are crucial to effective social action and hence to the lives of those whom social programs are designed to improve: (1) why has so little high quality evaluative research been done? (2) what problems are involved in developing more evaluative research and using its results in policy making? and,…

A GUIDE FOR SELF-EVALUATION OF STATE SUPERVISORY PROGRAMS IN VOCATIONAL EDUCATION IN AGRICULTURE.

ERIC Educational Resources Information Center

LINSON, MARVIN G.

THE PURPOSE OF THE STUDY WAS TO DEVELOP A GUIDE FOR THE SELF-EVALUATION OF STATE SUPERVISORY PROGRAMS OF VOCATIONAL EDUCATION IN AGRICULTURE AND TO DESIGN AN INSTRUMENT TO ASSIST IN THIS EVALUATION. TWO NATIONAL JURIES OF EXPERTS IN EDUCATIONAL SUPERVISION ASSISTED IN REFINING A SET OF STATEMENTS, DEVELOPED TO SERVE AS INDICATORS OF SUCCESSFUL…

Evaluating the social and economic impact of community-based prenatal care.

PubMed

Cramer, Mary E; Chen, Li-Wu; Roberts, Sara; Clute, Dorothea

2007-01-01

This article describes the evaluation and findings of a community-based prenatal care program, Omaha Healthy Start (OHS), designed to reduce local racial disparities in birth outcomes. This evaluative study used a comparative descriptive design, and Targeting Outcomes of Programs was the conceptual framework for evaluation. The evaluation followed 3 groups for 2 years: OHS birth mothers (N=79; N=157); non-OHS participant birth mothers (N=746; N=774); and Douglas County birth mothers (N=7,962; N=7,987). OHS provided case management, home visits, screening, referral, transportation, and health education to participants. Program outcome measures included low birth weight, infant mortality, adequacy of care, trimester of care, and costs of care. OHS birth outcomes improved during year 2, and there was a 31% cost saving in the average hospital expenditure compared with the nonparticipant groups. Preliminary evaluative analysis indicates that prenatal case management and community outreach can improve birth outcomes for minority women, while producing cost savings. Further prospective study is needed to document trends over a longer period of time regarding the relationship between community-based case management programs for minority populations, birth outcomes, and costs of care.

The promise and challenge of practice-research collaborations: Guiding principles and strategies for initiating, designing, and implementing program evaluation research.

PubMed

Secret, Mary; Abell, Melissa L; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations, and building on their experiences in successfully completing a community-based research evaluation, the authors identify specific relationship-focused principles and strategies and illustrate how these approaches can guide practice-research teams through the various sequential activities of the evaluation research process. In particular, it is suggested that practice-research collaborations can be formed, strengthened, and sustained by emphasis on a spirit of discovery and shared leadership at the start of the relationship, use of a comprehensive evaluation model to clarify and frame the evaluation and program goals, beginning where the client is when selecting research methodology and measurement tools, commitment to keeping the program first and recording everything during the implementation and data-collection stages, discussion of emerging findings and presentation of findings in graphic format at the data-analysis stage, and a total team approach at the dissemination stage.

Basic Automotive Mechanics. Florida Vocational Program Guide.

ERIC Educational Resources Information Center

University of South Florida, Tampa. Dept. of Adult and Vocational Education.

This program guide identifies primary concerns in the organization, operation, and evaluation of a basic automotive mechanics program. It is designed for local school district and community college administrators, instructors, program advisory committees, and regional coordinating councils. The guide begins with the Dictionary of Occupational…

An Evaluation Study of an Executive Master of Business Administration (EMBA) Program in an Urban City: Examining the Transfer of Knowledge and Leadership Practices

ERIC Educational Resources Information Center

Choi, Hye Lim

2011-01-01

This study examined the effectiveness of the Executive Master of Business Administration (EMBA) degree program in terms of transfer of knowledge and leadership practices. Based on a review of literature related to adult learning theories, EMBA programs, the importance of evaluation practices, and leadership practices, this study was designed to…

Growing Our Own: A Longitudinal Evaluation of a Professional Development Program for Early-Career 4-H Professionals

ERIC Educational Resources Information Center

Varrella, Gary F.; Luckey, Brian P.; Baca, Jacqueline S.; Peters, Curt

2016-01-01

We present the results of a longitudinal evaluation of the Western Region 4-H Institute, a 5-day training program designed to enhance the skill sets of early-career Extension professionals organized around the 4-H professional research, knowledge, and competencies model. Programs such as this often are assessed for their short-term relevance and…

State “Technical Assistance Programs” for nursing home quality improvement: variations and potential implications

PubMed Central

Li, Yue; Spector, Williams D.; Glance, Laurent G.; Mukamel, Dana B.

2013-01-01

Context To improve nursing home quality, many states developed “Technical Assistance Programs” that provide on-site consultation and training for nursing facility staff. Methods We conducted a national survey on these state programs to collect data on program design, operations, financing, and perceived effectiveness. Results As of 2010, 17 states have developed such programs. Compared to existing state nursing home quality regulations, these programs represent a collaborative, rather than enforcement-oriented, approach to quality. However, existing programs vary substantially in key structural features such as staffing patterns, funding levels, and relationship with state survey and certification agencies. Perceived effectiveness by program officials on quality was high, although few states have performed formal evaluations. Perceived barriers to program effectiveness included lack of appropriate staff and funding, among others. Conclusion State “Technical Assistance Programs” for nursing homes varies in program design and perceived effectiveness. Future comparative evaluations are needed to inform evidence-based quality initiatives. PMID:23216345

Measurement and Design Issues in the Study of Adolescent Sexual Behavior and the Evaluation of Adolescent Sexual Health Behavior Interventions

ERIC Educational Resources Information Center

Young, Michael; Palacios, Rebecca; Penhollow, Tina M.

2012-01-01

To improve the quality of research and commentary concerning adolescent sexuality and evaluation of both comprehensive sexuality education and abstinence education programs, this article aims to help readers (1) select appropriate measures to study adolescent sexual behavior, (2) develop appropriate study designs to evaluate adolescent sexual…

Risks Associated with Federal Construction Projects

DTIC Science & Technology

2011-06-01

awarding contracts for construction projects (USACE, 2010). BIM offers a method to effectively design a facility while maximizing work performance during...includes Requirements, Programming, Funding, Solicitation, AEC Evaluation, Award , Project Validation, Design and Construction, and Project Management...includes the Solicitation, AEC Evaluation, and Award Steps. In this Phase, BIM is only used in the Solicitation and the AEC Evaluation steps

Evaluation of the three-dimensional parabolic flow computer program SHIP

NASA Technical Reports Server (NTRS)

Pan, Y. S.

1978-01-01

The three-dimensional parabolic flow program SHIP designed for predicting supersonic combustor flow fields is evaluated to determine its capabilities. The mathematical foundation and numerical procedure are reviewed; simplifications are pointed out and commented upon. The program is then evaluated numerically by applying it to several subsonic and supersonic, turbulent, reacting and nonreacting flow problems. Computational results are compared with available experimental or other analytical data. Good agreements are obtained when the simplifications on which the program is based are justified. Limitations of the program and the needs for improvement and extension are pointed out. The present three dimensional parabolic flow program appears to be potentially useful for the development of supersonic combustors.

Insurance: An Evaluation Report for the Occupational Exploration Program.

ERIC Educational Resources Information Center

Altschuld, James W.; And Others

The evaluation report is one of seven produced for the Occupational Exploration Program (OEP), a series of simulated occupational experiences designed for junior high school students. Describing the pilot testing of the simulation dealing with the insurance field, the report contains sections describing the simulation context, evaluation…

A National Survey of Undergraduate Teaching in Obstetrics and Gynecology.

ERIC Educational Resources Information Center

And Others; Stenchever, Morton A.

1979-01-01

A survey of academic departments of obstetrics and gynecology was designed to assess undergraduate educational programs and the impact of efforts made to improve teaching in the specialty. It focuses on instructional patterns, the clinical clerkship, student evaluation, and program administration and evaluation. Prior surveys are noted.…

Evaluation of Teacher Training in a Title III Center.

ERIC Educational Resources Information Center

Reid, Ethna R.

This study is a report on a series of exemplary and instructional reading programs conducted by the Exemplary Center for Reading Instruction and designed to improve reading instruction in kindergarten through grade 12. The following topics are included: (1) evaluation of beginning reading programs, including materials selection, materials…

Peace Works: A Program Evaluation Model

ERIC Educational Resources Information Center

LeBlanc, Patrice; Lacey, Candace

2002-01-01

The purpose of this paper is to describe the model used to evaluate the two-year Allegany Grant between the Peace Education Foundation and the Miami-Dade County Public Schools that focused on reducing school violence through implementing the "Peace Works" program. A mixed method design using simultaneous methodologies was employed. For…

Evaluator's Guide for Word Processing Software.

ERIC Educational Resources Information Center

Alberta Dept. of Education, Edmonton.

This guide provides a detailed evaluation form, together with complete instructions for using it, which is designed to elicit answers to the following questions: (1) What features and abilities does a specific word processing program have? (2) On which computer(s) will the program work? (3) Is additional hardware/software necessary before the…

Pilot evaluation of a walking school bus program in a low-income, urban community

USDA-ARS?s Scientific Manuscript database

Our objective was to evaluate the impact of a walking school bus (WSB) program on student transport in a low-income, urban neighborhood. The design was a controlled, quasi-experimental trial with consecutive cross-sectional assessments. The setting was three urban, socioeconomically disadvantaged, p...

Public-Private Partnership Program Evaluation. 1988-89.

ERIC Educational Resources Information Center

Bland, June

This evaluation of the 1988-89 Public Private Partnership (PPP) program in Washington (District of Columbia) was seriously limited by the unavailability of statistical data on student progress and internship performance. PPP was designed to improve the preparation of high school students for the world of work by involving community businesses in…

Evaluation of the Alaska Native Science & Engineering Program (ANSEP). Research Report

ERIC Educational Resources Information Center

Bernstein, Hamutal; Martin, Carlos; Eyster, Lauren; Anderson, Theresa; Owen, Stephanie; Martin-Caughey, Amanda

2015-01-01

The Urban Institute conducted an implementation and participant-outcomes evaluation of the Alaska Native Science & Engineering Program (ANSEP). ANSEP is a multi-stage initiative designed to prepare and support Alaska Native students from middle school through graduate school to succeed in science, technology, engineering, and math (STEM)…

Evaluating Technology Integration in the Elementary School: A Site-Based Approach.

ERIC Educational Resources Information Center

Mowe, Richard

This book enables educators at the elementary level to conduct formative evaluations of their technology programs in minimum time. Most of the technology is computer related, including word processing, graphics, desktop publishing, spreadsheets, databases, instructional software, programming, and telecommunications. The design of the book is aimed…

Evaluation of Sensory Impairment Program for Gerontological Service Providers.

ERIC Educational Resources Information Center

Fatula, Betty J.; And Others

The report deals with the design, development, and evaluation of a short-term training program directed toward modifying attitudes and acquiring new information and skills about sensory impairments frequently found among institutionalized elderly people. The training attempted to provide participants with a clearer understanding of the implication…

New-Teacher Induction 2.0

ERIC Educational Resources Information Center

Taranto, Greg

2011-01-01

The purpose of this program evaluation study was to design, implement, and evaluate the effectiveness of incorporating an online learning community as part of a comprehensive new-teacher induction program. The researcher, who serves as the middle school principal and new induction coordinator for the school district, used a mixed-method approach…

Bilingual Mathematics and Science Achievement, 1988-89. Evaluation Section Report.

ERIC Educational Resources Information Center

Berney, Tomi D.; Barrera, Marbella

This report documents the evaluation of the Bilingual Mathematics and Science Achievement Program (Project BMSA) for students of limited English proficiency. The bilingual program was designed to provide intensive mathematics and science instruction, using mastery level concepts, in the native language and to incorporate mathematics and science…

Evaluating the Effectiveness of Student Assistance Programs in Pennsylvania.

ERIC Educational Resources Information Center

Fertman, Carl I.; Fichter, Cele; Schlesinger, Jo; Tarasevich, Susan; Wald, Holly; Zhang, Xiaoyan

2001-01-01

This evaluation of the Pennsylvania Student Assistance Program (SAP) was conducted to determine overall efficacy of SAPs and, more specifically, how SAP is currently implemented. Findings indicate that SAP is being implemented as designed. Recommended is the development of benchmarks and indicators focusing on best SAP practices and effectiveness.…