Charting the Impact of Federal Spending for Education Research: A Bibliometric Approach

ERIC Educational Resources Information Center

Milesi, Carolina; Brown, Kevin L.; Hawkley, Louise; Dropkin, Eric; Schneider, Barbara L.

2014-01-01

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice.

PubMed

Rorrer, Audrey S

2016-04-01

This paper describes the approach and process undertaken to develop evaluation capacity among the leaders of a federally funded undergraduate research program. An evaluation toolkit was developed for Computer and Information Sciences and Engineering(1) Research Experiences for Undergraduates(2) (CISE REU) programs to address the ongoing need for evaluation capacity among principal investigators who manage program evaluation. The toolkit was the result of collaboration within the CISE REU community with the purpose being to provide targeted instructional resources and tools for quality program evaluation. Challenges were to balance the desire for standardized assessment with the responsibility to account for individual program contexts. Toolkit contents included instructional materials about evaluation practice, a standardized applicant management tool, and a modulated outcomes measure. Resulting benefits from toolkit deployment were having cost effective, sustainable evaluation tools, a community evaluation forum, and aggregate measurement of key program outcomes for the national program. Lessons learned included the imperative of understanding the evaluation context, engaging stakeholders, and building stakeholder trust. Results from project measures are presented along with a discussion of guidelines for facilitating evaluation capacity building that will serve a variety of contexts. Copyright © 2016. Published by Elsevier Ltd.

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

PubMed

Jacobson, Miriam R; Azzam, Tarek

2018-06-01

This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

Evaluating International Research Ethics Capacity Development: An Empirical Approach

PubMed Central

Ali, Joseph; Kass, Nancy E.; Sewankambo, Nelson K.; White, Tara D.; Hyder, Adnan A.

2014-01-01

The US National Institutes of health, Fogarty International Center (NIH-FIC) has, for the past 13 years, been a leading funder of international research ethics education for resource-limited settings. Nearly half of the NIH-FIC funding in this area has gone to training programs that train individuals from sub-Saharan Africa. Identifying the impact of training investments, as well as the potential predictors of post-training success, can support curricular decision-making, help establish funding priorities, and recognize the ultimate outcomes of trainees and training programs. Comprehensive evaluation frameworks and targeted evaluation tools for bioethics training programs generally, and for international research ethics programs in particular, are largely absent from published literature. This paper shares an original conceptual framework, data collection tool, and detailed methods for evaluating the inputs, processes, outputs, and outcomes of research ethics training programs serving individuals in resource-limited settings. This paper is part of a collection of papers analyzing the Fogarty International Center’s International Research Ethics Education and Curriculum Development program. PMID:24782071

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

PubMed

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Tailored program evaluation: Past, present, future.

PubMed

Suggs, L Suzanne; Cowdery, Joan E; Carroll, Jennifer B

2006-11-01

This paper discusses measurement issues related to the evaluation of computer-tailored health behavior change programs. As the first generation of commercially available tailored products is utilized in health promotion programming, programmers and researchers are becoming aware of the unique challenges that the evaluation of these programs presents. A project is presented that used an online tailored health behavior assessment (HBA) in a worksite setting. Process and outcome evaluation methods are described and include the challenges faced, and strategies proposed and implemented, for meeting them. Implications for future research in tailored program development, implementation, and evaluation are also discussed.

The promise and challenge of practice-research collaborations: Guiding principles and strategies for initiating, designing, and implementing program evaluation research.

PubMed

Secret, Mary; Abell, Melissa L; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations, and building on their experiences in successfully completing a community-based research evaluation, the authors identify specific relationship-focused principles and strategies and illustrate how these approaches can guide practice-research teams through the various sequential activities of the evaluation research process. In particular, it is suggested that practice-research collaborations can be formed, strengthened, and sustained by emphasis on a spirit of discovery and shared leadership at the start of the relationship, use of a comprehensive evaluation model to clarify and frame the evaluation and program goals, beginning where the client is when selecting research methodology and measurement tools, commitment to keeping the program first and recording everything during the implementation and data-collection stages, discussion of emerging findings and presentation of findings in graphic format at the data-analysis stage, and a total team approach at the dissemination stage.

A Program Evaluation of a Summer Research Training Institute for American Indian and Alaska Native Health Professionals

ERIC Educational Resources Information Center

Zaback, Tosha; Becker, Thomas M.; Dignan, Mark B.; Lambert, William E.

2010-01-01

In this article, the authors describe a unique summer program to train American Indian/Alaska Native (AI/AN) health professionals in a variety of health research-related skills, including epidemiology, data management, statistical analysis, program evaluation, cost-benefit analysis, community-based participatory research, grant writing, and…

Creating a Research-Rich Curriculum at Miami University

NASA Astrophysics Data System (ADS)

Rauckhorst, William H.

2007-10-01

Miami University has attempted in recent years to build upon a collection of individual student research participation opportunities at the University, and develop a comprehensive ``research-rich'' undergraduate curriculum. A major step in this direction was the creation of the Undergraduate Summer Scholars (USS) program. This program provides 10-week summer research experiences with faculty mentors for 100 juniors or seniors each year. The USS Program is not limited to science and engineering areas, as approximately 30 academic departments participate annually. Development of the USS program at Miami was motivated by the University's prior experience with student research appointments funded by the National Science Foundation, the Howard Hughes Medical Institute, and other sponsoring agencies. The University's evaluation of these earlier student research experiences provided evidence that such experiences were at least as significant in a student's education as formal course work. A second important step in Miami's effort was obtaining a grant from the National Science Foundation's Comprehensive Reform of Undergraduate Education program. This funding enabled the University to enhance the Undergraduate Summer Scholars (USS) Program and evaluate student intellectual growth within the program. Two outcomes of this NSF-funded project are noteworthy: first, the USS program now is firmly established within the University's offerings; second, the evaluation ndicated profound student intellectual growth as a result of mentored research experiences. We will describe the development of the Undergraduate Summer Scholars Program, our evaluation of the Program, and ongoing efforts to extend the benefits of research experience to more students by incorporating research components within traditional coursework.

Culturally Competent Research with American Indians and Alaska Natives: Findings and Recommendations of the First Symposium of the Work Group on American Indian Research and Program Evaluation Methodology

ERIC Educational Resources Information Center

Caldwell, Joyce Y.; Davis, Jamie D.; Du Bois, Barbara; Echo-Hawk, Holly; Erickson, Jill Shepard; Goins, R. Turner; Hill, Calvin; Hillabrant, Walter; Johnson, Sharon R.; Kendall, Elizabeth; Keemer, Kelly; Manson, Spero M.; Marshall, Catherine A.; Running Wolf, Paulette; Santiago, Rolando L.; Schacht, Robert; Stone, Joseph B.

2005-01-01

This article describes the collective experience of a multidisciplinary network of researchers, practitioners, and program evaluators who support appropriate research and evaluation methods in working with Native peoples. Our experience underlines the critical importance of culture in understanding and conducting research with the diverse…

Evaluation of a program to increase evidence-based practice change.

PubMed

Larrabee, June H; Sions, Jacqueline; Fanning, Mary; Withrow, Mary Lynne; Ferretti, Andrea

2007-06-01

The study evaluated a nursing research program designed to achieve systematic evidence-based practice change. Specifically, change in nurse attitudes about use of research and research conduct, practice change projects, and nurse participation in research-related activities were evaluated. Evidence indicates that successful evidence-based practice change in an organization requires senior leadership support and a systematic program for practice change. Evaluation of program effectiveness provides evidence about opportunities for further improvement. Quantitative evaluation used a pretest-posttest design. The site was an academic medical center in rural West Virginia. Participants were registered nurses from all inpatients units, perioperative services, and emergency departments. Surveys used Alcock et al's Staff Nurses and Research Activities scale. Descriptive evaluation included the number of nurses who attended the workshop, practice change projects, scholarly products disseminated, and outcome of a Magnet review. First, knowledge about the availability of support services increased between 1999 and 2002 and was associated with higher attitude scores about research and research utilization. Second, registered nurses who reported participating in research-related activities had more positive scores on all attitudes than registered nurses who reported not participating. Nurse leaders may improve participation and attitudes about research and research utilization by internally marketing the support available for research-related activities.

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service.

PubMed

Misso, Marie L; Ilic, Dragan; Haines, Terry P; Hutchinson, Alison M; East, Christine E; Teede, Helena J

2016-01-14

Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education. The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up. It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Right timing in formative program evaluation.

PubMed

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

ERIC Educational Resources Information Center

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

The Role of Formative Research in Evaluating Specific Curriculum-Based Television Programs at the Primary Level.

ERIC Educational Resources Information Center

Teachman, Goody; Zuckernick, Arlene

Formative research of Math Patrol, curriculum-based television program in mathematics at the primary level, was carried out as part of a research and evaluation project at the Ontario Educational Communications Authority (OECA). The series, which utilizes plasticene animations, consists of 15-minute magazine format programs which introduce and…

Research and Evaluation in Operational Competency-Based Teacher Education Programs.

ERIC Educational Resources Information Center

Dickson, George E., Ed.

1975-01-01

This is a collection of papers presented at a 1974 conference on research and evaluation in operational competency-based teacher education (CBTE) programs. Two conceptual models for research and evaluation of CBTE activities were presented at the conference and the presentations of these models are the first two chapters of this collection: "A…

Evaluation Program on the Implementation of Industrial Apprenticeship (Prakerin) in Electrical Engineering

NASA Astrophysics Data System (ADS)

Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.

2018-02-01

This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.

Evaluating the BK 21 Program. Research Brief

ERIC Educational Resources Information Center

Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.

2008-01-01

The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

The development of a TED-Ed online resident research training program.

PubMed

Moreau, Katherine A; Pound, Catherine M; Peddle, Beth; Tokarewicz, Jaclyn; Eady, Kaylee

2014-01-01

Pediatric health research is important for improving the health and well-being of children and their families. To foster the development of physicians' research competencies, it is vital to integrate practical and context-specific research training into residency programs. To describe the development of a resident research training program at one tertiary care pediatric academic health sciences center in Ontario, Canada. We surveyed residents and pediatricians/research staff to establish the need and content for a resident research training program. Residents and resident research supervisors agreed or strongly agreed that research training is important for residents. However, few residents and supervisors believed that their academic health sciences center provided adequate training and resources to support resident research. As such, an online resident research training program was established. Residents and supervisors agreed that the program should focus on the following topics: 1) critically evaluating research literature, 2) writing a research proposal, 3) submitting an application for research funding, and 4) writing a manuscript. This highly accessible, context-specific, and inexpensive online program model may be of interest and benefit to other residency programs as a means to enhance residents' scholarly roles. A formal evaluation of the research training program is now underway.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic.

PubMed

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B

2018-03-01

The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies.

Educational Evaluation: Key Characteristics. ACER Research Series No. 102.

ERIC Educational Resources Information Center

Maling-Keepes, Jillian

A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

ERIC Educational Resources Information Center

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

"I've Lost My Husband, My House and I Need a New Knee...Why Should I Smile?": Action Research Evaluation of a Group Cognitive Behavioural Therapy Program for Older Adults with Depression

ERIC Educational Resources Information Center

Richardson, Lisa; Reid, Corinne

2006-01-01

The current paper details an action research approach to developing and evaluating a group cognitive-behavioural therapy (CBT) program for older adults (65+ years) experiencing depression. This approach allowed the development of a novel program and for each component of the program to be evaluated and modified in an iterative, developmental…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

DOT National Transportation Integrated Search

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

A Review of Out-of-School Time Program Quasi-Experimental and Experimental Evaluation Results. Out-of-School Time Evaluation Snapshot.

ERIC Educational Resources Information Center

Little, Priscilla M. D.; Harris, Erin

As the amount of resources allocated to out-of-school (OST) programming and policymakers' demands for research-based results increase, there is increasing interest in rigorous research designs to examine OST program outcomes. This issue of "Out-of-School Time Evaluation Snapshots" reviews 27 quasi-experimental and experimental OST…

Evaluation of WYDOT's research center and research program.

DOT National Transportation Integrated Search

2008-03-01

This study examined multiple aspects of the Wyoming Department of Transportations Research Program. It provides numerous observations of : the overall program and the research investment portfolio as well as guidance for developing a strategic res...

Evaluation of Minority Retention Programs: The Undergraduate Research Opportunities Program at the University of Michigan.

ERIC Educational Resources Information Center

Jonides, John; And Others

An evaluation was done of the first year of the Undergraduate Research Opportunities Program (UROP) at the University of Michigan (Ann Arbor), which is designed not only to teach students about research and/or certain academic topics, but also to facilitate the identification of minority students with the university. This second aim is based on…

Evaluating Evaluations: The Case of Parent Involvement Programs

ERIC Educational Resources Information Center

Mattingly, Doreen J.; Prislin, Radmila; McKenzie, Thomas L.; Rodriguez, James L.; Kayzar, Brenda

2002-01-01

This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

Evaluation and capacity building to improve precollege science and mathematics achievement in the US: 10 CFR, Part 605. Technical progress report, June--December 1992

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-12-31

The National Center for Improving Science Education has undertaken activities to achieve evaluation goals for DOE`s Precollege programs: develop means to determine program quality; develop means for determining the contribution of DOE precollege programs to both teacher enhancement and student achievement; provide evaluation designs and instruments and reports of program quality and impact; and strengthen both DOE`s and the Labs` capacity to do both short- and long-term planning as well as deliver effective programs and evaluation. Appendices include evaluation/technical assistance report, profiling teacher research participation and teacher development programs, teacher surveys, impact assessment design, and teacher research participation programs anecdotesmore » for 8 labs.« less

MoDOT pavement preservation research program volume IV, pavement evaluation tools-data collection methods.

DOT National Transportation Integrated Search

2015-10-01

The overarching goal of the MoDOT Pavement Preservation Research Program, Task 3: Pavement Evaluation Tools Data : Collection Methods was to identify and evaluate methods to rapidly obtain network-level and project-level information relevant to :...

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

General Criteria for Evaluating Social Programs.

ERIC Educational Resources Information Center

Shipman, Stephanie

1989-01-01

A framework of general evaluation criteria for ensuring the comprehensiveness of program reviews and appropriate and fair comparison of children's programs is outlined. It has two components: (1) descriptive; and (2) evaluative. The framework was developed by researchers at the General Accounting Office for evaluation of federal programs. (TJH)

The Community Research Scholars Initiative: A Mid‐Project Assessment

PubMed Central

Pike, Earl; Sehgal, Ashwini R.; Fischer, Robert L.; Collins, Cyleste

2015-01-01

Abstract Community organizations addressing health and human service needs generally have minimal capacity for research and evaluation. As a result, they are often inadequately equipped to independently carry out activities that can be critical for their own success, such as conducting needs assessments, identifying best practices, and evaluating outcomes. Moreover, they are unable to develop equitable partnerships with academic researchers to conduct community‐based research. This paper reports on the progress of the Community Research Scholar Initiative (CRSI), a program that aims to enhance community research and evaluation capacity through training of selected employees from Greater Cleveland community organizations. The intensive 2‐year CRSI program includes didactic instruction, fieldwork, multiple levels of community and academic engagement, leadership training, and a mentored research project. The first cohort of CRSI Scholars, their community organizations, and other community stakeholders have incorporated program lessons into their practices and operations. The CRSI program evaluation indicates: the importance of careful Scholar selection; the need to engage executive leadership from Scholar organizations; the value of a curriculum integrating classwork, fieldwork, and community engagement; and the need for continual scholar skill and knowledge assessment. These findings and lessons learned guide other efforts to enhance community organization research and evaluation capacity. PMID:26073663

Reaching Your Program Goals: The Secret to a Successful Relationship with Your Evaluator

NASA Astrophysics Data System (ADS)

Warburton, J.; Crowley, S.; Larson, A.

2012-12-01

PolarTREC (Teachers and Researchers Exploring and Collaborating) is a National Science Foundation (NSF) funded program in which K-12 teachers participate in hands-on field research experiences in the Polar Regions. PolarTREC has become a leader in the evaluation of teacher research experiences (TREs) and offers a model for outside evaluation for education and public outreach. Programs such as TRE's offer a direct package of outreach opportunities for effective broader impacts. This presentation offers a model for the evaluative process beginning with project design and goals, which involve an outside evaluator, and that provide funders with an outlined scope of projects as well as outcomes and products for use by the public to advance scientific understanding. Outcomes are determined before the program is developed to ensure that all components are striving for program efficacy. Formative and summative evaluations for all audiences ensure robust program reports via survey's, knowledge assessments, conference calls, outreach implementation plans for multiple diverse audiences and in-depth case studies with teachers back in their classrooms. PolarTREC has become part of a larger, international working group of evaluators and program managers on program assessment. As part of this working group, sharing best practices for effective evaluation to better support science efforts, inform funders, and communicate with the public, has been integral to the evolution and advancement of our successful evaluation model.

Conflict of Interest in the Evaluation and Dissemination of “Model” School-based Drug and Violence Prevention Programs

PubMed Central

Gorman, Dennis M.; Conde, Eugenia

2010-01-01

Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been that of financial relationships between investigators and research sponsors. The potential for conflicts of interest to arise in the evaluation of drug prevention programs was raised by Moskowitz in this journal in 1993, but to date there has been no attempt made to estimate the scope of this problem. The present study addressed this issue using a sample of “model” school-based drug and violence prevention interventions by first, identifying the types or relationships that exist between program developers and program distributors, and, second, by assessing how many of the evaluations of these programs published in peer-reviewed journals had been conducted by the developers of the programs compared to independent evaluation teams. The data presented indicate that there are relatively few published evaluations that do not involve program developers and that there are few instances in which there is complete separation between the program developer and program distributor. Using the open systems model of the Institute of Medicine Committee on Research Integrity as a framework, it is argued that the culture and norms of the program developer and those of the program evaluator are fundamentally distinct and therefore failure to separate these roles produces high potential for conflict of interest to arise. PMID:17945143

Evaluation Report of the Fall River Middle School Research and Development Center Title VII Program, 1973-1974.

ERIC Educational Resources Information Center

Heuristics, Inc., Dedham, MA.

This report presents the evaluation of the 1973-1974 Fall River Middle School Research and Development Center, a project funded by ESEA Title VII as a model demonstration bilingual program beginning in 1972-1973. The evaluation focused on the assessment of the degree of accomplishment of product objectives for each component of the program. The…

The Role of Evaluation and Plans for Evaluating the Current Testing Program.

ERIC Educational Resources Information Center

Winters, Lynn

The Palos Verdes Peninsula Unified School District Office of Program Evaluation and Research is responsible for providing information for program development and improvement; providing test information to special programs coordinators; and acting as a clearinghouse for all information concerning tests, evaluation methodology, and educational…

Utilizing Staff Perceptions to Guide and Shape Future Program Planning

ERIC Educational Resources Information Center

Sherwood, Heather

2010-01-01

This paper describes an action research project evaluating an elementary school counseling program in a large suburban Georgia city. Using staff surveys (which include homeroom teachers as well as support teachers and paraprofessionals), interviews, and researcher observations the program was evaluated to determine strengths and weaknesses. The…

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic

PubMed Central

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B.

2016-01-01

Background: The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. Objectives: A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. Study Design/Methods: This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. Results: The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. Conclusions: This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies. PMID:29444602

The development of a TED-Ed online resident research training program

PubMed Central

Moreau, Katherine A.; Pound, Catherine M.; Peddle, Beth; Tokarewicz, Jaclyn; Eady, Kaylee

2014-01-01

Background Pediatric health research is important for improving the health and well-being of children and their families. To foster the development of physicians’ research competencies, it is vital to integrate practical and context-specific research training into residency programs. Purpose To describe the development of a resident research training program at one tertiary care pediatric academic health sciences center in Ontario, Canada. Methods We surveyed residents and pediatricians/research staff to establish the need and content for a resident research training program. Results Residents and resident research supervisors agreed or strongly agreed that research training is important for residents. However, few residents and supervisors believed that their academic health sciences center provided adequate training and resources to support resident research. As such, an online resident research training program was established. Residents and supervisors agreed that the program should focus on the following topics: 1) critically evaluating research literature, 2) writing a research proposal, 3) submitting an application for research funding, and 4) writing a manuscript. Discussion This highly accessible, context-specific, and inexpensive online program model may be of interest and benefit to other residency programs as a means to enhance residents’ scholarly roles. A formal evaluation of the research training program is now underway. PMID:25526717

The development of a TED-Ed online resident research training program.

PubMed

Moreau, Katherine A; Pound, Catherine M; Peddle, Beth; Tokarewicz, Jaclyn; Eady, Kaylee

2014-01-01

Background Pediatric health research is important for improving the health and well-being of children and their families. To foster the development of physicians' research competencies, it is vital to integrate practical and context-specific research training into residency programs. Purpose To describe the development of a resident research training program at one tertiary care pediatric academic health sciences center in Ontario, Canada. Methods We surveyed residents and pediatricians/research staff to establish the need and content for a resident research training program. Results Residents and resident research supervisors agreed or strongly agreed that research training is important for residents. However, few residents and supervisors believed that their academic health sciences center provided adequate training and resources to support resident research. As such, an online resident research training program was established. Residents and supervisors agreed that the program should focus on the following topics: 1) critically evaluating research literature, 2) writing a research proposal, 3) submitting an application for research funding, and 4) writing a manuscript. Discussion This highly accessible, context-specific, and inexpensive online program model may be of interest and benefit to other residency programs as a means to enhance residents' scholarly roles. A formal evaluation of the research training program is now underway.

Evaluation of the Initial Impacts of the National Science Foundation's Integrative Graduate Education and Research Traineeship Program: Final Report

ERIC Educational Resources Information Center

Carney, Jennifer; Chawla, Deepika; Wiley, Autumn; Young, Denise

2006-01-01

This report summarizes findings from an evaluation of the impacts of the National Science Foundation's (NSF) Integrative Graduate Education and Research Traineeships (IGERT) program. Through support of interdisciplinary graduate education programs in Science, Technology, Engineering, and Mathematics, the IGERT program aims to educate U.S.…

Issues Surrounding the Evaluation of Teacher Internship Programs

NASA Astrophysics Data System (ADS)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Dissemination research: the University of Wisconsin Population Health Institute.

PubMed

Remington, Patrick L; Moberg, D Paul; Booske, Bridget C; Ceraso, Marion; Friedsam, Donna; Kindig, David A

2009-08-01

Despite significant accomplishments in basic, clinical, and population health research, a wide gap persists between research discoveries (ie, what we know) and actual practice (ie, what we do). The University of Wisconsin Population Health Institute (Institute) researchers study the process and outcomes of disseminating evidence-based public health programs and policies into practice. This paper briefly describes the approach and experience of the Institute's programs in population health assessment, health policy, program evaluation, and education and training. An essential component of this dissemination research program is the active engagement of the practitioners and policymakers. Each of the Institute's programs conducts data collection, analysis, education, and dialogue with practitioners that is closely tied to the planning, implementation, and evaluation of programs and policies. Our approach involves a reciprocal exchange of knowledge with non-academic partners, such that research informs practice and practice informs research. Dissemination research serves an important role along the continuum of research and is increasingly recognized as an important way to improve population health by accelerating the translation of research into practice.

Learning From Small-Scale Experimental Evaluations of After School Programs. Snapshot Number 8

ERIC Educational Resources Information Center

Harvard Family Research Project, Harvard University, 2006

2006-01-01

The Harvard Family Research Project (HFRP) Out-of-School Time Program Evaluation Database contains profiles of out-of-school time (OST) program evaluations. Its purpose is to provide accessible information about previous and current evaluations to support the development of high quality evaluations and programs in the OST field. Types of Programs…

Advanced Visualization and Interactive Display Rapid Innovation and Discovery Evaluation Research (VISRIDER) Program Task 6: Point Cloud Visualization Techniques for Desktop and Web Platforms

DTIC Science & Technology

2017-04-01

ADVANCED VISUALIZATION AND INTERACTIVE DISPLAY RAPID INNOVATION AND DISCOVERY EVALUATION RESEARCH (VISRIDER) PROGRAM TASK 6: POINT CLOUD...To) OCT 2013 – SEP 2014 4. TITLE AND SUBTITLE ADVANCED VISUALIZATION AND INTERACTIVE DISPLAY RAPID INNOVATION AND DISCOVERY EVALUATION RESEARCH...various point cloud visualization techniques for viewing large scale LiDAR datasets. Evaluate their potential use for thick client desktop platforms

Evaluating an interdisciplinary undergraduate training program in health promotion research.

PubMed

Misra, Shalini; Harvey, Richard H; Stokols, Daniel; Pine, Kathleen H; Fuqua, Juliana; Shokair, Said M; Whiteley, John M

2009-04-01

The University of California at Irvine Interdisciplinary Summer Undergraduate Research Experience (ID-SURE) program had three objectives: (1) designing an interdisciplinary health promotion training curriculum for undergraduate research fellows; (2) developing measures for evaluating and assessing program-related educational processes and products; and (3) comparing these educational process and product measures between groups of students who did or did not receive the training. A total of 101 students participated in the ID-SURE program during 2005, 2006, and 2007. A longitudinal research design was employed whereby students' interdisciplinary attitudes and behaviors were assessed at the beginning and end of the training program. The interdisciplinary and intellectual qualities of students' academic and research products were assessed at the conclusion of the training activities. In addition, ID-SURE participants' interdisciplinary attitudes, behaviors, and research products were compared to those of 70 participants in another fellowship program that did not have an interdisciplinary training component. Exposing undergraduate research fellows to the interdisciplinary curriculum led to increased participation in, and positive attitudes about, interdisciplinary classroom and laboratory activities. Products, such as the integrative and interdisciplinary quality of student research projects, showed no differences when compared to those of undergraduates who were not exposed to the interdisciplinary curriculum. However, undergraduates exposed to the training engaged in more interdisciplinary behaviors at the end of the program than students who were not trained in interdisciplinary research techniques. The findings from this study offer evidence for the efficacy of the ID-SURE program for training undergraduate students in transdisciplinary concepts, methods, and skills that are needed for effective scientific collaboration. Additionally, this study makes two important contributions to the development and evaluation of interdisciplinary health research training programs: (1) It presents and evaluates a novel curriculum for training undergraduate students in interdisciplinary theories, concepts, and methods of health promotion that can be replicated in other settings and contexts; (2) It provides and tests the reliability of new measures for evaluating interdisciplinary collaborative processes and develops objective criteria for rating the integrative and intellectual quality of students' research products.

Evaluating department of transportation's research program : a methodology and case study.

DOT National Transportation Integrated Search

2012-06-01

An effective research program within a transportation organization can be a valuable asset to accomplish the goals of the overall : mission. Determining whether a research program is pursuing relevant research projects and obtaining results for the s...

7 CFR 1206.50 - Programs, plans, and projects.

Code of Federal Regulations, 2011 CFR

2011-01-01

... PROMOTION, RESEARCH, AND INFORMATION Mango Promotion, Research, and Information Order Definitions Promotion, Research, and Information § 1206.50 Programs, plans, and projects. (a) The Board shall receive and evaluate... establishment, issuance, effectuation, and administration of appropriate programs for promotion, research, and...

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Implementing a Service Learning Model for Teaching Research Methods and Program Evaluation

ERIC Educational Resources Information Center

Shannon, Patrick; Kim, Wooksoo; Robinson, Adjoa

2012-01-01

In an effort to teach students the basic knowledge of research methods and the realities of conducting research in the context of agencies in the community, faculty developed and implemented a service learning model for teaching research and program evaluation to foundation-year MSW students. A year-long foundation course was designed in which one…

Evaluation of the National Science Foundation's Partnerships for International Research and Education (PIRE) Program, Volume 2: Supplementary Materials. Final Report

ERIC Educational Resources Information Center

Martinez, Alina; Epstein, Carter; Parsad, Amanda

2015-01-01

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

Evaluation of the National Science Foundation's Partnerships for International Research and Education (PIRE) Program, Volume 1: Final Report

ERIC Educational Resources Information Center

Martinez, Alina; Epstein, Carter; Parsad, Amanda

2015-01-01

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

A Participatory Action Research Approach To Evaluating Inclusive School Programs.

ERIC Educational Resources Information Center

Dymond, Stacy K.

2001-01-01

This article proposes a model for evaluating inclusive schools. Key elements of the model are inclusion of stakeholders in the evaluation process through a participatory action research approach, analysis of program processes and outcomes, use of multiple methods and measures, and obtaining perceptions from diverse stakeholder groups. (Contains…

Reducing Disparities by way of a Cancer Disparities Research Training Program.

PubMed

Caplan, Lee S; Akintobi, Tabia H; Gordon, Tandeca King; Zellner, Tiffany; Smith, Selina A; Blumenthal, Daniel S

2016-01-01

For minority populations, there is a continuing disparity in the burden of death and illness from cancer. Research to address this disparity should be conducted by investigators who can best understand and address the needs of culturally diverse communities. However, minorities are under-represented in health-related research. The goal of this project was to develop and evaluate an approach to motivating and preparing master's degree students for careers dedicated to cancer disparities research. A Cancer Disparities Research Training Program (CDRTP) was initiated in 2010. The program consists of coursework, practicum experiences, and research opportunities. Assessment of the curriculum is based on monitoring achievement of evaluation indicators and included a mixed-method approach with included both quantitative and qualitative approach. In its first three years, the program graduated 20 trainees, all of whom were minorities (18 African Americans and two Asians). When asked about career goals, two-thirds of the trainees indicated interest in pursuing careers in research in cancer prevention and control. The trainees expressed high satisfaction with the courses, instructor, materials, and curriculum. Although trainees had suggestions about course details, evaluations overall were positive. Across focus groups, three recurrent themes emerged regarding activities to enhance the trainee experience: having a wider variety of topics, more guest speakers, and field trips. The CDRTP was intended to recruit students - primarily African Americans - into research on prevention and control of cancer disparities. Although final evaluation of the program's overall outcome will not be available for several years, this preliminary evaluation indicates early program success.

The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

NASA Astrophysics Data System (ADS)

Luera, Gail Rose

As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which emerged from the interview responses included cost of the program, respondent and program receptivity to change, reconciling program philosophy with personal philosophy (Orange County program), perception of environmental education, definition of the program's boundaries and barriers to implementation (Project WILD). The dissertation concludes with a presentation of a preliminary model for environmental education program evaluation and recommendations for future related research.

The Evaluation of an Early Childhood Teacher Preparation Program: An Action Research Project

ERIC Educational Resources Information Center

Ragno, Kerry Sullivan

2013-01-01

The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…

Using ePortfolios to Assess Applied and Collaborative Learning and Academic Identity in a Summer Research Program for Community College Students

ERIC Educational Resources Information Center

Singer-Freeman, Karen; Bastone, Linda; Skrivanek, Joseph

2016-01-01

We evaluate the extent to which ePortfolios can be used to assess applied and collaborative learning and academic identity among community college students from underrepresented minority groups who participated in a summer research program. Thirty-eight students were evaluated by their research sponsor and two or three naïve faculty evaluators.…

Description of a Compensatory College Education Program for the Disadvantaged and Its Associated Research and Evaluation Program.

ERIC Educational Resources Information Center

Spuck, Dennis W.; And Others

This paper reports on a large-scale project of research and evaluation of a program for disadvantaged minority group students conducted by the Center for Educational Opportunity at the Claremont Colleges. The Program of Special Directed Studies for Transition to College (PSDS), a five-year experimental project, is aimed at providing a four-year,…

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

PubMed

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Integrating research, policy, and practice in juvenile justice education.

PubMed

Blomberg, Thomas G; Waldo, Gordon P

2002-06-01

This article provides an overview of the history and context leading to Florida's efforts to implement an evaluation-driven research and associated quality assurance system for its juvenile justice education policies and practices. The Juvenile Justice Educational Enhancement Program began implementing Florida's evaluation research and quality assurance system to juvenile justice education in 1998. The article includes a brief summary of articles comprising this special issue of Evaluation Review that address the Juvenile Justice Educational Enhancement Program's various functions, methodological components, data, preliminary findings, continuing evaluation research efforts, and impediments.

Researcher development program of the primary health care research, evaluation and development strategy.

PubMed

McIntyre, Ellen; Brun, Lyn; Cameron, Helen

2011-01-01

The Research Development Program (RDP) was initiated in 2004 under the Primary Health Care Research, Evaluation and Development (PHCRED) Strategy to increase the number and range of people with knowledge and skills in primary health care research and evaluation. RDP Fellows were invited to participate in an online survey about the effect the program had on their research knowledge, attitudes and practice. The response rate was 42% (105/248). Most were female (88%) with 66% aged between 31 and 50 years. Over two-thirds (72%) were health practitioners. Activities undertaken during the RDP ranged from literature reviews, developing a research question, preparing ethics submissions, attending and presenting at conferences and seminars, preparing papers and reports, and submitting grant applications. Despite the fact that only 52% agreed that the RDP time was adequate, 94% agreed that the RDP was a valuable experience, with 89% expressing interest in undertaking further research. These results indicate that this program has had a positive effect on the RDP Fellows in terms of their knowledge about research, their attitude to research, and the way they use research in their work.

Evaluative Thinking in Practice: The National Asthma Control Program.

PubMed

Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

Lessons Learned: The Evolution of an Undergraduate Research Program

ERIC Educational Resources Information Center

Smith, Gregory; Laker, Lauren; Tesch, Debbie

2013-01-01

Undergraduate research programs are commonplace at many universities. However, little research has been conducted to evaluate their ongoing and long-term effectiveness from the standpoint of the undergraduate student researcher. In an effort to gain perspective from the student researcher, including their thoughts on such a program, a survey was…

Human Research Program Science Management: Overview of Research and Development Activities

NASA Technical Reports Server (NTRS)

Charles, John B.

2007-01-01

An overview of research and development activities of NASA's Human Research Science Management Program is presented. The topics include: 1) Human Research Program Goals; 2) Elements and Projects within HRP; 3) Development and Maintenance of Priorities; 4) Acquisition and Evaluation of Research and Technology Proposals; and 5) Annual Reviews

EVALUE : a computer program for evaluating investments in forest products industries

Treesearch

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Evaluating the benefits of government funded R & D aimed at the private sector

NASA Technical Reports Server (NTRS)

Greenberg, J. S.

1977-01-01

Federal funding of technological research and development is discussed with regard to the procedures for an economic analysis with the goals of (1) determining when the public sector should invest in a research and development program, (2) evaluating the likelihood of private sector participation in terms of public sector participation, and (3) considering the major factors in the formulation of a research and development program in terms of defining initiatives. Public sector investments are evaluated, noting procedures for determining whether benefits exceed costs. The role of the public sector research and development planning is described, considering the procedure for private sector implementation decisions and a methodology for evaluating the possibility of private sector commercialization. The economic value of the public sector research and development program is presented with attention given to a specific case of NASA-sponsored research and development aimed toward the commercialization of new public communications services.

An alternative model for postdoctoral education of nurses engaged in research with potentially vulnerable populations.

PubMed

Gennaro, Susan; Deatrick, Janet A; Dobal, May T; Jemmott, Loretta Sweet; Ball, Katherine R

2007-01-01

Post-doctoral education has become a necessity for new nursing doctoral graduates. However, post-doctoral positions are limited and nurse scientists may face barriers that make non-traditional programs necessary. This study describes the outcomes of the Summer Nursing Research Institute (SNRI), an alternative post-doctoral educational program, reports formative perceptions of SNRI participants, and illustrates the efficacy and limitations of the model with selected summative research related outcomes. Participants between 1997 and 2006 were asked to evaluate the experience while attending the Institute (formative evaluation) and an overall summative evaluation was also conducted. Evaluations indicate that participants gained knowledge, skills, and networking abilities in terms of conducting research with vulnerable populations. A program like the SNRI can be successful in widening the research pipeline, in imparting knowledge, and in fostering positive attitudes as well as in improving research skills.

The Quantitative Evaluation of the Clinical and Translational Science Awards (CTSA) Program Based on Science Mapping and Scientometric Analysis

PubMed Central

Zhang, Yin; Wang, Lei

2013-01-01

Abstract The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. PMID:24330689

The quantitative evaluation of the Clinical and Translational Science Awards (CTSA) program based on science mapping and scientometric analysis.

PubMed

Zhang, Yin; Wang, Lei; Diao, Tianxi

2013-12-01

The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. © 2013 Wiley Periodicals, Inc.

Approaches and impact of non-academic research capacity strengthening training models in sub-Saharan Africa: a systematic review.

PubMed

Mugabo, Lambert; Rouleau, Dominique; Odhiambo, Jackline; Nisingizwe, Marie Paul; Amoroso, Cheryl; Barebwanuwe, Peter; Warugaba, Christine; Habumugisha, Lameck; Hedt-Gauthier, Bethany L

2015-06-09

Research is essential to identify and prioritize health needs and to develop appropriate strategies to improve health outcomes. In the last decade, non-academic research capacity strengthening trainings in sub-Saharan Africa, coupled with developing research infrastructure and the provision of individual mentorship support, has been used to build health worker skills. The objectives of this review are to describe different training approaches to research capacity strengthening in sub-Saharan Africa outside academic programs, assess methods used to evaluate research capacity strengthening activities, and learn about the challenges facing research capacity strengthening and the strategies/innovations required to overcome them. The PubMed database was searched using nine search terms and articles were included if 1) they explicitly described research capacity strengthening training activities, including information on program duration, target audience, immediate program outputs and outcomes; 2) all or part of the training program took place in sub-Saharan African countries; 3) the training activities were not a formal academic program; 4) papers were published between 2000 and 2013; and 5) both abstract and full paper were available in English. The search resulted in 495 articles, of which 450 were retained; 14 papers met all inclusion criteria and were included and analysed. In total, 4136 people were trained, of which 2939 were from Africa. Of the 14 included papers, six fell in the category of short-term evaluation period and eight in the long-term evaluation period. Conduct of evaluations and use of evaluation frameworks varied between short and long term models and some trainings were not evaluated. Evaluation methods included tests, surveys, interviews, and systems approach matrix. Research capacity strengthening activities in sub-Saharan Africa outside of academic settings provide important contributions to developing in-country capacity to participate in and lead research. Institutional support, increased funds, and dedicated time for research activities are critical factors that lead to the development of successful programs. Further, knowledge sharing through scientific articles with sufficient detail is needed to enable replication of successful models in other settings.

A Review and Evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of Phase I--Knowledge and Attitudes Survey, LaRC Research Personnel. Final Report.

ERIC Educational Resources Information Center

Pinelli, Thomas E.; And Others

As Phase I of a comprehensive evaluation of the NASA-affiliated Langley Research Center's (LaRC) scientific and technical information (STI) program, an internal survey was conducted to obtain feedback from LaRC scientists and engineers concerning the effectiveness of the STI program. The first stage of the survey, which involved interviews with 64…

Long-term evaluation of individualized marketing programs for travel demand management

DOT National Transportation Integrated Search

2010-07-01

This research examines the use of individualized marketing as a transportation demand : management (TDM) strategy, using the City of Portlands SmartTrips program. This research : project has two specific aims: (1) to evaluate whether the benefits ...

The Promise and Challenge of Practice-Research Collaborations: Guiding Principles and Strategies for Initiating, Designing, and Implementing Program Evaluation Research

ERIC Educational Resources Information Center

Secret, Mary; Abell, Melissa L.; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations,…

How To Design a Program Evaluation. CSE Program Evaluation Kit, Volume 3. Second Edition.

ERIC Educational Resources Information Center

Fitz-Gibbon, Carol Taylor; Morris, Lynn Lyons

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

Teaching Note--Keeping It Real: Program Evaluation Projects for an Undergraduate Research Class

ERIC Educational Resources Information Center

John, Aesha; Bang, Eun-Jun

2017-01-01

This article describes a teaching innovation that focused on the redesign of an undergraduate social work research class. Students enrolled in the redesigned class had an opportunity to conduct program evaluation projects in community agencies. The projects included (a) pretest and posttest evaluation of reminiscence approach in improving the…

1993 at a Glance: Executive Summaries of Reports from the Office of Research and Evaluation.

ERIC Educational Resources Information Center

Austin Independent School District, TX. Office of Research and Evaluation.

This compilation contains executive summaries of 13 program evaluations conducted by the Office of Research and Evaluation of the Austin Independent School District (AISD) (Texas), as well as short summary reports on 3 programs. The following summaries are included: (1) "1991-92 Dropout Report"; (2) "Faculty/Staff Recruitment…

Intervention Research and Program Evaluation in the School Setting: Issues and Alternative Research Designs

ERIC Educational Resources Information Center

de Anda, Diane

2007-01-01

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

A data collection and processing procedure for evaluating a research program

Treesearch

Giuseppe Rensi; H. Dean Claxton

1972-01-01

A set of computer programs compiled for the information processing requirements of a model for evaluating research proposals are described. The programs serve to assemble and store information, periodically update it, and convert it to a form usable for decision-making. Guides for collecting and coding data are explained. The data-processing options available and...

Documenting Progress and Demonstrating Results: Evaluating Local Out-of-School Time Programs.

ERIC Educational Resources Information Center

Little, Priscilla; DuPree, Sharon; Deich, Sharon

A collaborative publication between Harvard Family Research Project and The Finance Project, this brief offers guidance in documenting progress and demonstrating results in local out-of-school-time programs. Following introductory remarks providing a rationale for program evaluation, discussing principles of program evaluation, and clarifying key…

Nebraska Prostate Cancer Research Program

DTIC Science & Technology

2015-10-01

Toiletries (soap, shampoo , deodorant, etc.) Shower shoes- flip flops Shower caddy Robe/ pajamas/ lounge wear Notebook paper, pens, pencils...Research Scholars Program Evaluation Survey ‐ A Summary 1. How satisfied are you with the Nebraska Prostate Cancer Research Scholars Program (NPCRSP

Enhancing Research Capacity for Global Health: Evaluation of a Distance-Based Program for International Study Coordinators

PubMed Central

Wilson, Lynda Law; Rice, Marti; Jones, Carolynn T.; Joiner, Cynthia; LaBorde, Jennifer; McCall, Kimberly; Jester, Penelope M; Carter, Sheree C.; Boone, Chrissy; Onwuzuligbo, Uzoma; Koneru, Alaya

2013-01-01

Introduction Due to the increasing number of clinical trials conducted globally, there is a need for quality continuing education for health professionals in clinical research manager (CRM) roles. This paper describes the development, implementation, and evaluation of a distance-based continuing education program for CRMs working outside the United States. Methods A total of 692 applications were received from CRMs in 50 countries. Of these, 166 were admitted to the program in two cohorts. The program, taught online and in English, included four required and one optional course. Course materials were also provided as hard copies and on CDs. A pretest/posttest design was used to evaluate the outcome of the program in terms of changes in knowledge, participants’ capacity-building activities at their research sites; and participant and supervisor perceptions of program impact. Results Participants demonstrated significant improvements in knowledge about clinical research, rated course content and teaching strategies positively, and identified the opportunity for interactions with international peers as a major program strength. Challenges for participants were limited time to complete assignments and erratic internet access. Participants offered capacity building programs to 5061 individuals at their research sites. Supervisors indicated that they would recommend the program and perceived the program improved CRM effectiveness and site research capacity. Findings Results suggest that this type of continuing education program addresses a growing need for education of CRMs working in countries that have previously had limited involvement with global clinical trials. PMID:23512562

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Twenty years of Medicare and Medicaid: Covered populations, use of benefits, and program expenditures

PubMed Central

Gornick, Marian; Greenberg, Jay N.; Eggers, Paul W.; Dobson, Allen

1985-01-01

Marian Gornick is Director, Division of Beneficiary Studies, in the Office of Research, Health Care Financing Administration. She has been involved in research studies relating to Medicare and Medicaid since the programs were first implemented. Jay N. Greenberg is on the faculty of the Heller Graduate School, Brandeis University. Dr. Greenberg serves as the Associate Director for Research of the school's Health Policy Center. Paul W. Eggers is Chief, Program Evaluation Branch, in the Office of Research, Health Care Financing Administration (HCFA). Dr. Eggers’ research activities involve the evaluation of the impact of HCFA programs on the beneficiaries. Allen Dobson is Director, Office of Research, Health Care Financing Administration. Dr. Dobson is responsible for directing the planning and development of the Agency's research agenda. PMID:10311371

75 FR 42760 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-22

... accounting reports and invoices, and monitoring all spending. The Team develops, defends and executes the... results; performance measurement; research and evaluation methodologies; demonstration testing and model... ACF programs; strategic planning; performance measurement; program and policy evaluation; research and...

Establishing a methodology to evaluate teen driver-training programs.

DOT National Transportation Integrated Search

2013-11-01

The goal of this research project was to develop a methodology to assist the Wisconsin Department of : Transportation (WisDOT) in the evaluation of effectiveness of teen driver education programs over the : short and long terms. The research effort w...

Cancer Therapy Evaluation Program | Office of Cancer Genomics

Cancer.gov

The Cancer Therapy Evaluation Program (CTEP) seeks to improve the lives of cancer patients by finding better treatments, control mechanisms, and cures for cancer. CTEP funds a national program of cancer research, sponsoring clinical trials to evaluate new anti-cancer agents.

American Society for Engineering Education/NASA Summer Faculty Fellowship Program 1982

NASA Technical Reports Server (NTRS)

Spencer, J. H. (Compiler)

1983-01-01

A program of summer faculty fellowships for engineering and science educators is described. The program involves participation in cooperative research and study. Results of the program evaluation are summarized. The research fellows indicated satisfaction with the program. Benefits of the program cited include: (1) enhancement of professional abilities; (2) contact with professionals in a chosen area of research; (3) familiarity with research facilities; and (4) development of new research techniques and their adaptation to an academic setting. Abstracts of each of the research projects undertaken are presented.

Evaluating a complex, multi-site, community-based program to improve healthcare quality: the summative research design for the Aligning Forces for Quality initiative.

PubMed

Scanlon, Dennis P; Wolf, Laura J; Alexander, Jeffrey A; Christianson, Jon B; Greene, Jessica; Jean-Jacques, Muriel; McHugh, Megan; Shi, Yunfeng; Leitzell, Brigitt; Vanderbrink, Jocelyn M

2016-08-01

The Aligning Forces for Quality (AF4Q) initiative was the Robert Wood Johnson Foundation's (RWJF's) signature effort to increase the overall quality of healthcare in targeted communities throughout the country. In addition to sponsoring this 16-site complex program, RWJF funded an independent scientific evaluation to support objective research on the initiative's effectiveness and contributions to basic knowledge in 5 core programmatic areas. The research design, data, and challenges faced during the summative evaluation phase of this near decade-long program are discussed. A descriptive overview of the summative research design and its development for a multi-site, community-based, healthcare quality improvement initiative is provided. The summative research design employed by the evaluation team is discussed. The evaluation team's summative research design involved a data-driven assessment of the effectiveness of the AF4Q program at large, assessments of the impact of AF4Q in the specific programmatic areas, and an assessment of how the AF4Q alliances were positioned for the future at the end of the program. The AF4Q initiative was the largest privately funded community-based healthcare improvement initiative in the United States to date and was implemented at a time of rapid change in national healthcare policy. The implementation of large-scale, multi-site initiatives is becoming an increasingly common approach for addressing problems in healthcare. The summative evaluation research design for the AF4Q initiative, and the lessons learned from its approach, may be valuable to others tasked with evaluating similarly complex community-based initiatives.

A potential role of anti-poverty programs in health promotion

PubMed Central

Silverman, Kenneth; Holtyn, August F.; Jarvis, Brantley

2016-01-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. PMID:27235603

A potential role of anti-poverty programs in health promotion.

PubMed

Silverman, Kenneth; Holtyn, August F; Jarvis, Brantley P

2016-11-01

Poverty is one of the most pervasive risk factors underlying poor health, but is rarely targeted to improve health. Research on the effects of anti-poverty interventions on health has been limited, at least in part because funding for that research has been limited. Anti-poverty programs have been applied on a large scale, frequently by governments, but without systematic development and cumulative programmatic experimental studies. Anti-poverty programs that produce lasting effects on poverty have not been developed. Before evaluating the effect of anti-poverty programs on health, programs must be developed that can reduce poverty consistently. Anti-poverty programs require systematic development and cumulative programmatic scientific evaluation. Research on the therapeutic workplace could provide a model for that research and an adaptation of the therapeutic workplace could serve as a foundation of a comprehensive anti-poverty program. Once effective anti-poverty programs are developed, future research could determine if those programs improve health in addition to increasing income. The potential personal, health and economic benefits of effective anti-poverty programs could be substantial, and could justify the major efforts and expenses that would be required to support systematic research to develop such programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Evaluation and Recommendations for Improvement of the Department of Defense Small Business Innovation Research (SBIR) Program

DTIC Science & Technology

2006-01-01

representation of RAND intellectual property is provided for non- commercial use only. Permission is required from RAND to reproduce, or reuse in another...Law 97-219) created the Small Business Innovation Research (SBIR) program by mandating that all federal research, development, test , and evaluation (RDT...contractors and the small, technology-oriented business community. 6. Expand intellectual capital in the United States. POLICY OPTIONS FOR THE DOD SBIR PROGRAM

Evaluating Youth Development Programs: Progress and Promise

PubMed Central

Brooks-Gunn, Jeanne

2016-01-01

Advances in theories of adolescent development and positive youth development have greatly increased our understanding of how programs and practices with adolescents can impede or enhance their development. In this paper the authors reflect on the progress in research on youth development programs in the last two decades, since possibly the first review of empirical evaluations by Roth, Brooks-Gunn, Murray, and Foster (1998). The authors use the terms Version 1.0, 2.0 and 3.0 to refer to changes in youth development research and programs over time. They argue that advances in theory and descriptive accounts of youth development programs (Version 2.0) need to be coupled with progress in definitions of youth development programs, measurement of inputs and outputs that incorporate an understanding of programs as contexts for development, and stronger design and evaluation of programs (Version 3.0). The authors also advocate for an integration of prevention and promotion research, and for use of the term youth development rather than positive youth development. PMID:28077922

Evaluation of NSF's International Research Fellowship Program: Final Report

ERIC Educational Resources Information Center

Martinez, Alina; Epstein, Carter; Parsad, Amanda; Whittaker, Karla

2012-01-01

Among the National Science Foundation's (NSF) postdoctoral programs, the International Research Fellowship Program (IRFP) is unique in its emphasis on providing postdoctoral fellows with international research experiences. Established in 1992, IRFP provides financial support to postdoctoral scientists for a research experience abroad lasting…

A Framework of Operating Models for Interdisciplinary Research Programs in Clinical Service Organizations

ERIC Educational Resources Information Center

King, Gillian; Currie, Melissa; Smith, Linda; Servais, Michelle; McDougall, Janette

2008-01-01

A framework of operating models for interdisciplinary research programs in clinical service organizations is presented, consisting of a "clinician-researcher" skill development model, a program evaluation model, a researcher-led knowledge generation model, and a knowledge conduit model. Together, these models comprise a tailored, collaborative…

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

A Glossary of Research Terms for Out-of-School Time Program Practitioners. Research-to-Results Fact Sheet. Publication #2007-02

ERIC Educational Resources Information Center

Bronte-Tinkew, Jacinta; Horowitz, Allison; Redd, Zakia; Moore, Kristin A.; Valladares, Sherylls

2007-01-01

This glossary of common research and evaluation terms can serve as a quick reference guide for out-of school time practitioners as they face the challenges posed in this new era of program accountability. Subsequent briefs will provide more detailed information on particular types of research and evaluation designs. A list of additional resources…

Experiments in evaluation capacity building: Enhancing brain disorders research impact in Ontario.

PubMed

Nylen, Kirk; Sridharan, Sanjeev

2017-05-08

This paper is the introductory paper on a forum on evaluation capacity building for enhancing impacts of research on brain disorders. It describes challenges and opportunities of building evaluation capacity among community-based organizations in Ontario involved in enhancing brain health and supporting people living with a brain disorder. Using an example of a capacity building program called the "Evaluation Support Program", which is run by the Ontario Brain Institute, this forum discusses multiple themes including evaluation capacity building, evaluation culture and evaluation methodologies appropriate for evaluating complex community interventions. The goal of the Evaluation Support Program is to help community-based organizations build the capacity to demonstrate the value that they offer in order to improve, sustain, and spread their programs and activities. One of the features of this forum is that perspectives on the Evaluation Support Program are provided by multiple stakeholders, including the community-based organizations, evaluation team members involved in capacity building, thought leaders in the fields of evaluation capacity building and evaluation culture, and the funders. Copyright © 2017. Published by Elsevier Ltd.

EPA'S SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION (SITE) PROGRAM

EPA Science Inventory

In 1986, the U.S. Environmental Protection Agen- cy`s Offices of Solid Waste and Emergency Response (OSWER), and the Office of Research and Develop- ment (ORD) established a technology research, dem- onstration, and evaluation program to promote the development and use of alterna...

Evaluating Educational Programs. ETS R&D Scientific and Policy Contributions Series. ETS SPC-11-01. ETS Research Report No. RR-11-15

ERIC Educational Resources Information Center

Ball, Samuel

2011-01-01

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

Evaluation of the Tennessee Voluntary Prekindergarten Program: Kindergarten and First Grade Follow-Up Results from the Randomized Control Design. Research Report

ERIC Educational Resources Information Center

Lipsey, Mark W.; Hofer, Kerry G.; Dong, Nianbo; Farran, Dale C.; Bilbrey, Carol

2013-01-01

In 2009, Vanderbilt University's Peabody Research Institute, with the assistance of the Tennessee Department of Education's Division of Curriculum and Instruction, initiated a rigorous, independent evaluation of the state's Voluntary Prekindergarten program (TN- VPK). TN-VPK is a full-day prekindergarten program for four-year-old children expected…

Adding to the Pool of Methods for Program Evaluation: A Comparison of Latent Class Analysis and Propensity Score Analysis

ERIC Educational Resources Information Center

Taylor, Lauren Christine

2013-01-01

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

Evaluation of the Pilot Mentoring Program at the Research Foundation for SUNY

ERIC Educational Resources Information Center

Henderson-Harr, Amy; Caggiano-Siino, Kathleen; Prewitt, Ashlee

2016-01-01

This article provides a description of an 18-month pilot program focused on the leadership development of the next generation of research administrators (RAs) in the State University of New York system (SUNY). The key questions for the evaluators were: 1) can we create a developmental program that effectively prepares the next generation of RAs;…

Participatory Action Research: Reflections on Critical Incidents in a PAR Project.

ERIC Educational Resources Information Center

Santelli, Betsy; Singer, George H. S.; DiVenere, Nancy; Ginsberg, Connie; Powers, Laurie E.

1998-01-01

This article describes a participatory action research (PAR) project designed to evaluate Parent to Parent programs in five states. The process of developing a shared understanding of the program and of the purpose for evaluating them, along with an on-going willingness of parents and researchers to compromise, led to creative solutions to…

77 FR 22792 - Non-Competitive Program Expansion Supplement To Revise, Update, and Disseminate Educational...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-17

... Medical Center UB4HP19192 Kansas 429,472.00 42,222 Research Institute. University of Kentucky Research....00 42,222 West Virginia University Research UB4HP19050 West Virginia 428,800.00 42,222 Corp... benefits for program evaluative purposes since the GEC grantees already have evaluation requirements with...

Institute for Training Minority Group Research and Evaluation Specialists. Final Report.

ERIC Educational Resources Information Center

Brown, Roscoe C., Jr.

The Institute for Training Minority Group Research and Evaluation Specialists comprised 4 programs in 1: (1) a 6-week graduate course at New York University (NYU) during the 1970 summer session for 20 minority group persons that provided training in research design, statistics, data collection and analysis, and report writing; (2) a program of…

Current trends in systematic program evaluation of online graduate nursing education: an integrative literature review.

PubMed

Horne, Eva M; Sandmann, Lorilee R

2012-10-01

Over the past decade, the Internet's e3 ect has transformed nursing education, particularly at the graduate level. Schools of nursing have embraced Internet-based course delivery technology to broaden students' access to academic degrees. However, the rush to stay competitive in online education raises questions. What is the quality of these online programs? To what extent are schools of nursing systematically evaluating the programs beyond the course level? What evaluation tools are used? What are the findings? How are the evaluation data used? By answering these questions, nurse educators can develop strategies for evaluating the quality and worth of online learning, thus improving instruction and learning outcomes. This integrative review of nursing and adult education literature identified as the current trends in program evaluation of online nursing education at the graduate level. Research articles were analyzed and perspectives were synthesized from a research agenda viewpoint. Recommendations and needs for future research are discussed. Copyright 2012, SLACK Incorporated.

ORD Land Research Program Mid-Cycle Review - January 2009

EPA Pesticide Factsheets

The purpose of the review was to evaluate progress that the Land Research Program has made since the 2005 program review and to assess the responsiveness of the Program to advice, comments, and recommendations provided by the BOSC.

Evaluating a Small-Group Counseling Program--A Model for Program Planning and Improvement in the Elementary Setting

ERIC Educational Resources Information Center

Bostick, Dee; Anderson, Ron

2009-01-01

School counselors are under increasing pressure to evaluate their programs in a manner consistent with teachers and other educators. A small-group counseling intervention was used by a school counselor as part of a three-level program planning initiative that illustrated best research practices to evaluate program outcomes. Forty-nine third-grade…

NASULGC Council on Extension, Committee on Program Innovation and Action Oriented Research; 1968 Report. Part 1. Program Innovations. Part 2. Action Oriented Research.

ERIC Educational Resources Information Center

National Association of State Universities and Land Grant Colleges, Washington, DC.

This report on extension activities of member institutions of the National Association of State Universities and Land Grant Colleges describes 91 program innovations and action oriented research activities. Objectives, sponsorship, program evaluations, and other data are cited for program innovations in such areas as continuing medical education,…

75 FR 38082 - Solicitation of Applications for the Research and Evaluation Program: FY 2010 Triple Bottom Line...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-01

...Pursuant to the Research and Evaluation program, the Economic Development Administration (EDA) seeks applications to research, develop, and disseminate metrics to enable policymakers and practitioners to more effectively understand how to assess the triple bottom line (economic, environmental, and social impacts) of various economic development activities. EDA's mission is to lead the Federal economic development agenda by promoting innovation and competitiveness, preparing American regions for growth and success in the worldwide economy. Through its Research and Evaluation program, EDA works towards fulfilling its mission by funding research and technical assistance projects to promote competitiveness and innovation in distressed rural and urban regions throughout the United States and its territories. By working in conjunction with its research partners, EDA will help States, local governments, and community-based organizations to achieve their highest economic potential.

Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Building a community-based culture of evaluation.

PubMed

Janzen, Rich; Ochocka, Joanna; Turner, Leanne; Cook, Tabitha; Franklin, Michelle; Deichert, Debbie

2017-12-01

In this article we argue for a community-based approach as a means of promoting a culture of evaluation. We do this by linking two bodies of knowledge - the 70-year theoretical tradition of community-based research and the trans-discipline of program evaluation - that are seldom intersected within the evaluation capacity building literature. We use the three hallmarks of a community-based research approach (community-determined; equitable participation; action and change) as a conceptual lens to reflect on a case example of an evaluation capacity building program led by the Ontario Brian Institute. This program involved two community-based groups (Epilepsy Southwestern Ontarioand the South West Alzheimer Society Alliance) who were supported by evaluators from the Centre for Community Based Research to conduct their own internal evaluation. The article provides an overview of a community-based research approach and its link to evaluation. It then describes the featured evaluation capacity building initiative, including reflections by the participating organizations themselves. We end by discussing lessons learned and their implications for future evaluation capacity building. Our main argument is that organizations that strive towards a community-based approach to evaluation are well placed to build and sustain a culture of evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Partnership Among Peers: Lessons Learned From the Development of a Community Organization–Academic Research Training Program

PubMed Central

Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J.; Borawski, Elaine A.

2017-01-01

Background Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization–academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. Methods The PEER program was developed and guided by a community–academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows’ pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. Objectives The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. Conclusion PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions. PMID:28230553

Partnership Among Peers: Lessons Learned From the Development of a Community Organization-Academic Research Training Program.

PubMed

Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J; Borawski, Elaine A

2016-01-01

Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization-academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. The PEER program was developed and guided by a community-academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows' pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions.

Evaluating Afterschool Programs

ERIC Educational Resources Information Center

Little, Priscilla M.

2014-01-01

Well-implemented afterschool programs can promote a range of positive learning and developmental outcomes. However, not all research and evaluation studies have shown the benefits of participation, in part because programs and their evaluation were out of sync. This chapter provides practical guidance on how to foster that alignment between…

Integration and Evaluation of Substance Abuse Research Education Training (SARET) into a Master of Social Work program.

PubMed

Tuchman, Ellen; Hanley, Kathleen; Naegle, Madeline; More, Frederick; Bereket, Sewit; Gourevitch, Marc N

2017-01-01

The Substance Abuse Research and Education Training (SARET) program is funded by the National Institutes of Drug Abuse in 2006 as a novel approach to spark interest in substance abuse research among medical, dental, nursing, and social work graduate students through a Web-based curriculum and research mentorships. This report presents the initial integration of the intervention in a Master of Social Work (MSW) program, the components of the program, and the mixed-methods evaluation of its effect on students' attitudes towards substance abuse research and treatment. SARET comprises 2 main components: stipend-supported research mentorships and a Web-based module series, consisting of 6 interactive, multimedia modules addressing core SA research topics, delivered via course curricula and in the research mentorships. An initial evaluation was designed to assess SARET's acceptability and short-term impact on participants' interest in SA research. The components of this Web-based curriculum evaluation include focus group feedback on the relevance of the modules to SW students, number of courses into which the modules were integrated with number of module completions, changes in interest in SA research associated with module completion. The full series of Web-based modules has been integrated across several courses in the social work curriculum, and social work students have become integral participants in the summer mentored research experience. One hundred eighteen students completed at least 1 module and 42 students completed all 6 modules. Neurobiology, Screening, and Epidemiology were the most widely viewed modules. Students reported positive impact on their vision of SA-related clinical care, more positive attitudes about conducting research, and in some cases, change in career. The SARET program's modules and summer mentored research increased clinical and research interest related to SUDs, as well as interprofessional attitudes among social work students. Participants have shown some early research success. Longer-term follow-up will enable us to continue to assess the effectiveness of the program.

Assessment Study of an Undergraduate Research Training Abroad Program

ERIC Educational Resources Information Center

Nieto-Fernandez, Fernando; Race, Kathryn; Quarless, Duncan A.

2013-01-01

The Old Westbury Neuroscience International Research Program (OWNIP) encourages undergraduate students from health disparities populations and underrepresented minorities to pursue careers in basic science, biomedical, clinical, and behavioral health research fields. To evaluate this program, several measures were used tracked through an online…

Building Graduate Student Capacity as Future Researchers Through a Research and Training Award Program.

PubMed

Cepanec, Diane; Humphries, Amanda; Rieger, Kendra L; Marshall, Shelley; Londono, Yenly; Clarke, Diana

2016-05-01

With the global shortage of doctor of philosophy-prepared nursing faculty and an aging nursing professorate, the nursing profession is at risk of having fewer nurses doing research and fewer faculty to supervise the next generation of nurse researchers. A research training award for graduate nursing students was piloted with the intent of providing a research-intensive experiential learning opportunity that would contribute to graduate students' future roles as nurse researchers. This article describes the program design, implementation, and evaluation. The Graduate Student Research Training Awards afforded students an opportunity to develop research and methodologic skills and achieve student-centered outcomes. These awards build their capacity as future researchers by both empowering them and increasing their confidence in research. The input and evaluation from graduate students was integral to the success of the program. Graduate student research training awards can be a valuable experiential learning opportunity in research intensive graduate programs. [J Nurs Educ. 2016;55(5):284-287.]. Copyright 2016, SLACK Incorporated.

Effects of NIGMS Training Programs on Graduate Education in the Biomedical Sciences. An Evaluative Study of the Training Programs of the National Institute of General Medical Sciences 1958-1967.

ERIC Educational Resources Information Center

National Inst. of General Medical Sciences (NIH), Bethesda, MD.

This report was prepared by the National Research Council, at the request of the National Institutes of Health, in an attempt to evaluate the Graduate Research Training Grant Program and Fellowship Program in bioscience. One of the purposes of the study was to collect objective data that would provide answers to such questions as: What have been…

Evaluative Thinking in Practice: The National Asthma Control Program

PubMed Central

Fierro, Leslie A.; Codd, Heather; Gill, Sarah; Pham, Phung K.; Grandjean Targos, Piper T.; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings—specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention’s National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs’ evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts. PMID:29950803

Bonus Awards for Teachers in Texas' Performance Pay Program: Findings from the First Round of TEEG Schools. Research Brief

ERIC Educational Resources Information Center

National Center on Performance Incentives, 2009

2009-01-01

A recent report published by the National Center on Performance Incentives (NCPI) presents findings from the second-year of a multi-year evaluation of the Texas Educator Excellence Grant (TEEG) program, a statewide educator incentive program that operated in Texas. As part of this evaluation report, researchers examined how first-year TEEG schools…

Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

ERIC Educational Resources Information Center

Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

2012-01-01

This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…

Evaluating Social Programs; Theory, Practice, and Politics. Quantitative Studies in Social Relations Series.

ERIC Educational Resources Information Center

Rossi, Peter H., Ed.; Williams, Walter, Ed.

This book addresses itself to three questions which are crucial to effective social action and hence to the lives of those whom social programs are designed to improve: (1) why has so little high quality evaluative research been done? (2) what problems are involved in developing more evaluative research and using its results in policy making? and,…

Evaluation Guidelines for the Clinical and Translational Science Awards (CTSAs)

PubMed Central

Rubio, Doris M.; Thomas, Veronica G.

2013-01-01

Abstract The National Center for Advancing Translational Sciences (NCATS), a part of the National Institutes of Health, currently funds the Clinical and Translational Science Awards (CTSAs), a national consortium of 61 medical research institutions in 30 states and the District of Columbia. The program seeks to transform the way biomedical research is conducted, speed the translation of laboratory discoveries into treatments for patients, engage communities in clinical research efforts, and train a new generation of clinical and translational researchers. An endeavor as ambitious and complex as the CTSA program requires high‐quality evaluations in order to show that the program is well implemented, efficiently managed, and demonstrably effective. In this paper, the Evaluation Key Function Committee of the CTSA Consortium presents an overall framework for evaluating the CTSA program and offers policies to guide the evaluation work. The guidelines set forth are designed to serve as a tool for education within the CTSA community by illuminating key issues and practices that should be considered during evaluation planning, implementation, and utilization. Additionally, these guidelines can provide a basis for ongoing discussions about how the principles articulated in this paper can most effectively be translated into operational reality. PMID:23919366

The Evaluation of Industry Practical of Mechanical Engineering in Vocational Education: A CIPP Model Approach

NASA Astrophysics Data System (ADS)

Kamaludin, M.; Munawar, W.; Mahdan, D.; Simanjuntak, M. V.; Wendi, H. F.

2018-02-01

The learning system is not only studied on campus but also practicing in the world of work. Industry Practical aims to enable students to develop their skills in accordance with the real world of work. To know the success of the implementation of industry practical program then held evaluation. The evaluation of the program in this study used the CIPP evaluation approach (Context, Input, Process, Product). The purpose of this research is to know the extent of achievement and success of industry practical program at vocational school in Bandung with descriptive research method using mix method approach. The sample in this research is students majoring in mechanical engineering in the city of Bandung who have done industry practical.

Implementing and Evaluating a Rural Community-Based Sexual Abstinence Program: Challenges and Solutions

ERIC Educational Resources Information Center

Stauss, Kimberly; Boyas, Javier; Murphy-Erby, Yvette

2012-01-01

Informing both program evaluation and practice research, this paper describes lessons learned during the planning, implementation, and pilot phases of an abstinence education program based in a rural community in a southern state in the USA. Although a number of challenges can emerge in successfully implementing and evaluating such a program in a…

Fellowship Effects in Graduate Education: Evaluating the Impact of the National Science Foundation's Graduate Research Fellowship Program. ASHE Annual Meeting Paper.

ERIC Educational Resources Information Center

Goldsmith, Sharon S.; Presley, Jennifer B.

This report results from an evaluation of the National Research Foundation's Graduate Research Fellowship program. The study sought to determine: (1) whether NSF fellows show evidence of more timely degree completion and early career success; (2) whether graduate fellows and minority graduate fellows experience similar education and career…

Can Broad Inferences Be Drawn from Lottery Analyses of School Choice Programs? An Exploration of Appropriate Sensitivity Analyses

ERIC Educational Resources Information Center

Zimmer, Ron; Engberg, John

2016-01-01

School choice programs continue to be controversial, spurring a number of researchers into evaluating them. When possible, researchers evaluate the effect of attending a school of choice using randomized designs to eliminate possible selection bias. Randomized designs are often thought of as the gold standard for research, but many circumstances…

Wildland Fire Prevention: Today, Intuition--Tomorrow, Management

Treesearch

Albert J. Simard; Linda R. Donoghue

1987-01-01

Describes, from a historical perspective, methods used to characterize fire prevention problems and evaluate prevention programs and discusses past research efforts to bolster these analytical and management efforts. Highlights research on the sociological perspectives of the wildfire problem and on quantitative fire occurrence prediction and program evaluation systems...

Evaluating Writing Programs: Paradigms, Problems, Possibilities.

ERIC Educational Resources Information Center

McLeod, Susan H.

1992-01-01

Describes two methodological approaches (qualitative and quantitative) that grow out of two different research examples. Suggests the problems these methods present. Discusses the ways in which an awareness of these problems can help teachers to understand how to work with researchers in designing useful evaluations of writing programs. (PRA)

Evaluating WIC.

ERIC Educational Resources Information Center

Germanis, Peter; Besharov, Douglas J.

2000-01-01

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

7 CFR 634.50 - Program and project monitoring and evaluation.

Code of Federal Regulations, 2014 CFR

2014-01-01

... Secretary for Conservation, Research and Education, USDA, the Director of Economics, Policy Analysis, and... representatives working through NRCWCC. (3) Evaluative reports for the program and each project area will be submitted annually to the Secretary of Agriculture and the Administrator, EPA. (c) Funding. (1) Research...

7 CFR 634.50 - Program and project monitoring and evaluation.

Code of Federal Regulations, 2011 CFR

2011-01-01

... Secretary for Conservation, Research and Education, USDA, the Director of Economics, Policy Analysis, and... representatives working through NRCWCC. (3) Evaluative reports for the program and each project area will be submitted annually to the Secretary of Agriculture and the Administrator, EPA. (c) Funding. (1) Research...

7 CFR 634.50 - Program and project monitoring and evaluation.

Code of Federal Regulations, 2013 CFR

2013-01-01

... Secretary for Conservation, Research and Education, USDA, the Director of Economics, Policy Analysis, and... representatives working through NRCWCC. (3) Evaluative reports for the program and each project area will be submitted annually to the Secretary of Agriculture and the Administrator, EPA. (c) Funding. (1) Research...

7 CFR 634.50 - Program and project monitoring and evaluation.

Code of Federal Regulations, 2012 CFR

2012-01-01

... Secretary for Conservation, Research and Education, USDA, the Director of Economics, Policy Analysis, and... representatives working through NRCWCC. (3) Evaluative reports for the program and each project area will be submitted annually to the Secretary of Agriculture and the Administrator, EPA. (c) Funding. (1) Research...

7 CFR 634.50 - Program and project monitoring and evaluation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... Secretary for Conservation, Research and Education, USDA, the Director of Economics, Policy Analysis, and... representatives working through NRCWCC. (3) Evaluative reports for the program and each project area will be submitted annually to the Secretary of Agriculture and the Administrator, EPA. (c) Funding. (1) Research...

Evaluation Project of a Postvention Program.

ERIC Educational Resources Information Center

Simon, Robert; And Others

A student suicide or parasuicide increases the risk that potentially suicidal teenagers see suicide as an enviable option. The "copycat effect" can be reduced by a postvention program. This proposed evaluative research project will provide an implementation and impact evaluation of a school's postvention program following a suicide or…

Evaluation of Prevention Programs: A Basic Guide for Practitioners.

ERIC Educational Resources Information Center

Moberg, D. Paul

This guide is intended for professionals, laypersons, funding agents and others involved in planning and delivering local prevention services. Chapter 1 defines prevention, and differentiates between prevention strategies and programs targeted toward individuals or to general populations. Program evaluation and evaluation research are defined and…

Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program: Sharing a Program Model from Design and Development through Evaluation

ERIC Educational Resources Information Center

Young, Shawna; Uy, Ana; Bell, Joyce

2017-01-01

The Student Engagement in Research, Scholarship, and Creative Activity (SERSCA) Program at California State University, Stanislaus provides support for student engagement in these areas from idea conception through dissemination. Through assistantships, mini-grants, the Student Research Competition, and travel grants, the Program is designed to…

The Impact of Federal Early Childhood Programs on Children.

ERIC Educational Resources Information Center

Hertz, Thomas W.

This paper reviews research findings concerning the effects on young children of major Federal programs in education and child care. It offers a summary rather than a detailed view of research on the impact of programs, and is based primarily on major program evaluation reports and research reviews. In addition, it draws upon a small number of…

Teacher Education Program Evaluation: An Annotated Bibliography and Guide to Research.

ERIC Educational Resources Information Center

Ayers, Jerry B.; Berney, Mary F.

This book includes an annotated bibliography of the essentials needed to conduct an effective evaluation of a teacher education program. Specific information on evaluation includes: (1) general evaluation techniques, (2) evaluation of candidates and students, (3) evaluation of the knowledge base, (4) quality controls, (5) evaluation of laboratory…

Alternative management and funding options for aeronautics programs, Task 1

NASA Technical Reports Server (NTRS)

1975-01-01

Research and technology will be at lower program levels with basic military research for aviation decreasing as fewer aircraft programs are initiated and the present new aircraft programs move into the prototype and production status. The key question is can industry take on the management and financing role and meet the criteria and characteristics considered essential for a viable research and technology program. The criteria for evaluating alternative approaches include an examination of the nature of the product to be provided, responsiveness to changing needs, efficiency in terms of costs, ability to provide leadership, and to provide impartial and independent evaluation of approaches, and to provide technological inputs for regulating functions.

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

PubMed

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Redesigning and Aligning Assessment and Evaluation for a Federally Funded Math and Science Teacher Educational Program

ERIC Educational Resources Information Center

Hardre, Patricia L.; Slater, Janis; Nanny, Mark

2010-01-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

Curriculum and Evaluation Guide for Safety Education Programs. Research and Evaluation Report Series No. 40.00.

ERIC Educational Resources Information Center

Lowry, Carlee S.

Designed to assist Bureau of Indian Affairs school officials in the identification of safety education program needs, this evaluation guide focuses upon the basic operational components in a safety education program. The means for establishing an evaluation design for safety education are presented via a flexible model appropriate for most…

Thoughts of One's Own: Innovative Leadership in Institutional Research. Proceedings of the Annual Conference of the North East Association for Institutional Research (23rd, Princeton, New Jersey, November 16-19, 1996).

ERIC Educational Resources Information Center

North East Association for Institutional Research.

This proceedings document is comprised of the 18 papers, panel presentations, and work shares presented at a 1996 conference on institutional research. The papers are: (1) "Using Cohort Analysis To Evaluate the Impact of a Support Program for Minority Students" (Hershel Alexander); (2) "The Institutional Researcher as Program Evaluator:…

7 CFR 4285.69 - Evaluation and disposition of applications.

Code of Federal Regulations, 2011 CFR

2011-01-01

...-State Research on Cooperatives Program § 4285.69 Evaluation and disposition of applications. (a... will be made for responsiveness to the program solicitation (e.g., relationship of proposal to research topic(s) listed in solicitation). Proposals that do not fall within the guidelines as stated in the...

7 CFR 4285.69 - Evaluation and disposition of applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

...-State Research on Cooperatives Program § 4285.69 Evaluation and disposition of applications. (a... will be made for responsiveness to the program solicitation (e.g., relationship of proposal to research topic(s) listed in solicitation). Proposals that do not fall within the guidelines as stated in the...

7 CFR 4285.69 - Evaluation and disposition of applications.

Code of Federal Regulations, 2014 CFR

2014-01-01

...-State Research on Cooperatives Program § 4285.69 Evaluation and disposition of applications. (a... will be made for responsiveness to the program solicitation (e.g., relationship of proposal to research topic(s) listed in solicitation). Proposals that do not fall within the guidelines as stated in the...

7 CFR 4285.69 - Evaluation and disposition of applications.

Code of Federal Regulations, 2013 CFR

2013-01-01

...-State Research on Cooperatives Program § 4285.69 Evaluation and disposition of applications. (a... will be made for responsiveness to the program solicitation (e.g., relationship of proposal to research topic(s) listed in solicitation). Proposals that do not fall within the guidelines as stated in the...

7 CFR 4285.69 - Evaluation and disposition of applications.

Code of Federal Regulations, 2012 CFR

2012-01-01

...-State Research on Cooperatives Program § 4285.69 Evaluation and disposition of applications. (a... will be made for responsiveness to the program solicitation (e.g., relationship of proposal to research topic(s) listed in solicitation). Proposals that do not fall within the guidelines as stated in the...

Jump start: a targeted substance abuse prevention program.

PubMed

Harrington, N G; Donohew, L

1997-10-01

A substance abuse prevention and life skills program for economically disadvantaged, high sensation seeking African American teens was developed and tested in Cincinnati, Ohio. Formative research was conducted to determine program content and format. Over two implementations, 289 individuals in the target population were recruited as participants for the field test of the program. For the first implementation, participants were randomly selected from the city's summer youth employment program. For the second, a media campaign was designed to recruit participants. Process evaluation indicated that participants evaluated the program extremely positively. Outcome evaluation indicated that significant pretest differences between high and low sensation seekers were neutralized for liquor and marijuana in both years of the program and for attitude toward drugs in the first year of the program. These results suggest that sensation seeking is a useful message design and audience-targeting variable for substance abuse prevention program design. Implications and recommendations for future research are discussed.

77 FR 47077 - Statement of Organization, Functions, and Delegations of Authority; Office of Planning, Research...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-07

...; surveys, research and evaluation methodologies; demonstration testing and model development; synthesis and..., policy and program analysis; surveys, research and evaluation methodologies; demonstration testing and... Organization, Functions, and Delegations of Authority; Office of Planning, Research and Evaluation AGENCY...

Piloting a Nationally Disseminated, Interactive Human Subjects Protection Program for Community Partners: Design, Content, and Evaluation

PubMed Central

Eakin, Brenda; Kirk, Rosalind; Piechowski, Patricia; Thomas, Barbara

2014-01-01

Abstract Funders, institutions, and research organizations are increasingly recognizing the need for human subjects protections training programs for those engaged in academic research. Current programs tend to be online and directed toward an audience of academic researchers. Research teams now include many nonacademic members, such as community partners, who are less likely to respond to either the method or the content of current online trainings. A team at the CTSA‐supported Michigan Institute for Clinical and Health Research at the University of Michigan developed a pilot human subjects protection training program for community partners that is both locally implemented and adaptable to local contexts, yet nationally consistent and deliverable from a central administrative source. Here, the developers and the analysts of this program discuss its development, its content, and the results of its evaluation. PMID:24720288

Piloting a nationally disseminated, interactive human subjects protection program for community partners: design, content, and evaluation.

PubMed

Solomon, Stephanie; Eakin, Brenda; Kirk, Rosalind; Piechowski, Patricia; Thomas, Barbara

2014-04-01

Funders, institutions, and research organizations are increasingly recognizing the need for human subjects protections training programs for those engaged in academic research. Current programs tend to be online and directed toward an audience of academic researchers. Research teams now include many nonacademic members, such as community partners, who are less likely to respond to either the method or the content of current online trainings. A team at the CTSA-supported Michigan Institute for Clinical and Health Research at the University of Michigan developed a pilot human subjects protection training program for community partners that is both locally implemented and adaptable to local contexts, yet nationally consistent and deliverable from a central administrative source. Here, the developers and the analysts of this program discuss its development, its content, and the results of its evaluation. © 2014 Wiley Periodicals, Inc.

SOIL AND FILL LABORATORY SUPPORT - 1992 RADIOLOGICAL ANALYSES - FLORIDA RADON RESEARCH PROGRAM

EPA Science Inventory

The report gives results of soil analysis laboratory work by the University of Florida in support of the Florida Radon Research Program (FRRP). Analyses were performed on soil and fill samples collected during 1992 by the FRRP Research House Program and the New House Evaluation P...

A Program Evaluation of a College and Career Program Created to Improve High School Retention

ERIC Educational Resources Information Center

Washington-Brown, Bianca

2013-01-01

Journey to College and Career (JTCC) is a PreK-12 program implemented at the research site to help students graduate from high school and plan for their future. JTCC had not been evaluated for its effectiveness at the research site regarding high school retention by determining (a) whether the goals and objectives of JTCC were being met and (b)…

Troubleshooting Assessment and Enhancement (TAE) Program: Test and Evaluation

DTIC Science & Technology

1991-04-01

Navy Personnel Research and Development Center San Diego, California 92152-6800 TN-91-13 April 1991 AD-A23 6 323 Troubleshooting Assessment and...00002 NPRDC-TN-91-13 April 1991 Troubleshooting Assessment and Enhancement (TAE) Program: Test and Evaluation Harry B. Conner Navy Personnel Research ...McLachlan Director, Training Systems Department Approved for public release; distribution is unlimited. Navy Personnel Research and Development Center

Evaluation on Social Internship Program of Iain Sultan Thaha Saifuddin Jambi Students: Using Context, Input, Process and Product Model (CIPP Model)

ERIC Educational Resources Information Center

Hurmaini, M.; Abdillah

2015-01-01

The purpose of the research is to know the context, input, process and product evaluation on the Social Internship Program (Kukerta) of IAIN Sulthan Thaha Saifuddin Jambi Students by using Participatory Action Research (PAR) system. The research is conducted in four locations of IAIN Sultan Thaha Saifuddin Jambi students' Kukerta in first period…

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

ERIC Educational Resources Information Center

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Title I, ESEA Program Evaluation, 1967-68. Program Research and Development.

ERIC Educational Resources Information Center

Jacobs, James N., Ed.; Felix, Joseph L., Ed.

This report comprises a Title I ESEA Program evaluation for 1967-68 in Cincinnati Public Schools. To make greater concentration of services possible, lesser target schools were phased out of the 1967-68 program. The five projects comprising the 1967-68 program were: Elementary School remediation and enrichment; Secondary School remediation and…

ACT-CCREC Core Research Program: Study Questions and Design. ACT Working Paper Series. WP-2015-01

ERIC Educational Resources Information Center

Cruce, Ty M.

2015-01-01

This report provides a non-technical overview of the guiding research questions and research design for the ACT-led core research program conducted on behalf of the GEAR UP College and Career Readiness Evaluation Consortium (CCREC). The core research program is a longitudinal study of the effectiveness of 14 GEAR UP state grants on the academic…

Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice.

PubMed

Abdulghani, Hamza Mohammad; Shaik, Shaffi Ahamed; Khamis, Nehal; Al-Drees, Abdulmajeed Abdulrahman; Irshad, Mohammad; Khalil, Mahmoud Salah; Alhaqwi, Ali Ibrahim; Isnani, Arthur

2014-04-01

Qualitative and quantitative evaluation of academic programs can enhance the development, effectiveness, and dissemination of comparative quality reports as well as quality improvement efforts. To evaluate the five research methodology workshops through assessing participants' satisfaction, knowledge and skills gain and impact on practices by the Kirkpatrick's evaluation model. The four level Kirkpatrick's model was applied for the evaluation. Training feedback questionnaires, pre and post tests, learner development plan reports and behavioral surveys were used to evaluate the effectiveness of the workshop programs. Of the 116 participants, 28 (24.1%) liked with appreciation, 62 (53.4%) liked with suggestions and 26 (22.4%) disliked the programs. Pre and post MCQs tests mean scores showed significant improvement of relevant basic knowledge and cognitive skills by 17.67% (p ≤ 0.005). Pre-and-post tests scores on workshops sub-topics also significantly improved for the manuscripts (p ≤ 0.031) and proposal writing (p ≤ 0.834). As for the impact, 56.9% of participants started research, and 6.9% published their studies. The results from participants' performance revealed an overall positive feedback and 79% of participant reported transfer of training skills at their workplace. The course outcomes achievement and suggestions given for improvements offer insight into the program which were encouraging and very useful. Encouraging "research culture" and work-based learning are probably the most powerful determinants for research promotion. These findings therefore encourage faculty development unit to continue its training and development in the research methodology aspects.

1968 AERA Research Training Presessions Program.

ERIC Educational Resources Information Center

American Educational Research Association, Washington, DC.

This report of the 1968 American Educational Research Association (AERA) Research Training Presessions Program, designed to train educational researchers in fundamental research skills, includes introductory sections on background and planning and a major section consisting of descriptions and evaluations of each of the eleven 5-day sessions. The…

ORD Clean Air Research Program Review and Response

EPA Pesticide Factsheets

The objective of this review was to evaluate the relevance, quality, performance, scientific and managerial leadership, and outcomes of the Program and provide guidance and recommendations as to the progress and directions of the Clean Air Research Program

Program Evaluation of Services for the Homeless: Challenges and Strategies.

ERIC Educational Resources Information Center

Mercier, Celine; And Others

1992-01-01

Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)

Program Evaluation: A Review and Synthesis.

ERIC Educational Resources Information Center

Webber, Charles F.

This paper reviews models of program evaluation. Major topics and issues found in the evaluation literature include quantitative versus qualitative approaches, identification and involvement of stakeholders, formulation of research questions, collection of data, analysis and interpretation of data, reporting of results, evaluation utilization, and…

[Introduction of a Clinical Research Experience Program in Hospital Practical Training for Pharmacy Students and Its Evaluation].

PubMed

Takahashi, Katsuyuki; Suda, Yasuki; Kawaguchi, Hiroshi; Nakamura, Yasutaka; Kawabata, Shiho; Kawakami, Noriko; Nishikawa, Takeshi; Nagayama, Katsuya

2015-01-01

Long-term clinical training based on a model core curriculum was conducted to nurture highly competent pharmacists in the clinical field. Pharmacists' responsibilities are expanding, and a system has been developed to help pharmacists gain accreditation, identify specialties, and improve their training. However, this system requires research competency. Therefore clinical research should be considered a part of clinical training to encourage high competency among pharmacists. Because the model core curriculum does not include a section on clinical research. Osaka City University Hospital introduced a hands-on clinical research experience program and evaluated its usefulness. A significant improvement in the level of knowledge and awareness of clinical research was seen among students who underwent the clinical research experience program. In addition, the level of student satisfaction was higher. These findings suggest that a clinical research experience program may be useful to nurture a greater awareness of clinical research and knowledge acquisition among pharmacists.

Using a Non-Equivalent Groups Quasi Experimental Design to Reduce Internal Validity Threats to Claims Made by Math and Science K-12 Teacher Recruitment Programs

NASA Astrophysics Data System (ADS)

Moin, Laura

2009-10-01

The American Recovery and Reinvestment Act national policy established in 2009 calls for ``meaningful data'' that demonstrate educational improvements, including the recruitment of high-quality teachers. The scant data available and the low credibility of many K-12 math/science teacher recruitment program evaluations remain the major barriers for the identification of effective recruitment strategies. Our study presents a methodology to better evaluate the impact of recruitment programs on increasing participants' interest in teaching careers. The research capitalizes on the use of several control groups and presents a non-equivalent groups quasi-experimental evaluation design that produces program effect claims with higher internal validity than claims generated by current program evaluations. With this method that compares responses to a teaching career interest question from undergraduates all along a continuum from just attending an information session to participating (or not) in the recruitment program, we were able to compare the effect of the program in increasing participants' interest in teaching careers versus the evolution of the same interest but in the absence of the program. We were also able to make suggestions for program improvement and further research. While our findings may not apply to other K-12 math/science teacher recruitment programs, we believe that our evaluation methodology does and will contribute to conduct stronger program evaluations. In so doing, our evaluation procedure may inform recruitment program designers and policy makers.

7 CFR 3400.5 - Evaluation and disposition of applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM... eligible applicants in accordance with eligible research problem or program areas and deadlines established..., employees, and others as the Administrator determines are uniquely qualified in the areas of research...

7 CFR 3401.7 - Evaluation and disposition of applications.

Code of Federal Regulations, 2010 CFR

2010-01-01

... RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE RANGELAND RESEARCH GRANTS PROGRAM... eligible applicants in accordance with eligible research problem or program areas and deadlines established..., employees, and others as the Administrator determines are particularly qualified in the areas of research...

A Research Preparatory Program for First-Year College Students: Student Selection and Preparation Lead to Persistence in Research

ERIC Educational Resources Information Center

Baiduc, Rachael R.; Drane, Denise; Beitel, Greg J.; Flores, Luke C.

2017-01-01

Undergraduate research experiences may increase persistence in STEM majors. We describe a research program that targets first-year students selected for their curiosity and attitudes towards science. We explain the implementation of the program over 3 years and present evaluation data using a group of matched controls. Participants and controls…

Operations Research as a Metaphor for Evaluation. Research on Evaluation Program Paper and Report Series.

ERIC Educational Resources Information Center

Page, Ellis B.

One of a series of research reports examining objective principles successfully used in other fields which can lend integrity and legitimacy to evaluation, this report presents an overview of operations research (OR) as a potential source of evaluation methodology. The nature of the methods common to this discipline are summarized and the…

Analyzing for Individual Differences in Evaluating Compensatory Education Programs. Occasional Paper No. 27.

ERIC Educational Resources Information Center

Krus, Patricia H.

Trait-Treatment Interaction (TTI), a research method for observing experimental effects of treatments on subjects of different aptitudes and learning characteristics, is suggested as an effective evaluation tool to provide evaluators and educators in compensatory education programs with information about which program is best for different kinds…

Evaluation of the Tennessee Nutrition Education and Training Program. 1981 Final Report.

ERIC Educational Resources Information Center

Banta, Trudy W.; And Others

The Tennessee Nutrition Education and Training (NET) program is part of a U.S. Department of Agriculture effort to develop a coordinated nutrition education program for children from preschool through grade 12. For this second-year evaluation, researchers associated with the University of Tennessee collected data for the evaluation of program…

GLOBE in the Czech Republic: A Program Evaluation

ERIC Educational Resources Information Center

Cincera, Jan; Maskova, Veronika

2011-01-01

The article presents results of the evaluation of the GLOBE program (Global Learning and Observations to Benefit the Environment) in the Czech Republic. The evaluation explores the implementation of the program in schools and its impact on research skills. Four hundred and sixty six pupils, aged 13, from 28 different schools participated in the…

New Opportunities and Directions in Home Visiting Research and Evaluation

ERIC Educational Resources Information Center

Supplee, Lauren H.; Harwood, Robin L.; Margie, Nancy Geyelin; Meyer, Aleta L.

2013-01-01

The authors describe the research and evaluation activities connected to the new Maternal, Infant and Early Childhood Home Visiting program. The goal of these activities is to provide information on federal, state, and local efforts to strengthen programs by providing much needed knowledge on the best ways to support the implementation of home…

Assessing the Value of the Enviroscape Watershed Learning Module

ERIC Educational Resources Information Center

Edwards, Warren Patrick

2013-01-01

Scope and Method of Study: The researcher's evaluation of the West Atlanta Watershed Alliance's (WAWA) programs highlighted that few if any of the offered educational programs included a program evaluation, especially the most promising, the Enviroscape® Watershed learning module. The education programs that were customized and developed by the…

New Teacher Induction: A Program Evaluation

ERIC Educational Resources Information Center

Hunter, J. Warren

2016-01-01

The purpose of this qualitative program evaluation was to examine the impact a two-year new teacher induction program had on teachers' feelings of support, satisfaction, and self-efficacy. The program purports that higher feelings of support, satisfaction, and self-efficacy in teachers will lead to lower teacher attrition. In turn, research shows…

ADDENDUM TO SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION PROGRAM TECHNOLOGY PROFILES, TENTH EDITION, VOLUME 1 - DEMONSTRATION PROGRAM

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program, now in its thirteenth year, is an integral part of EPA's research into alternative cleanup methods for hazardous waste sites around the nation. The SITE Program was created to encourage the development and routine us...

Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

ERIC Educational Resources Information Center

Greci, Dana

2016-01-01

Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

A Program Evaluation of Cardinal Stritch University's Undergraduate Teacher Education Program

ERIC Educational Resources Information Center

Russell, Freda Renee

2009-01-01

The purpose of the research was to study the effectiveness of Cardinal Stritch University's Undergraduate Teacher Education Program in preparing its graduates to teach all children. The researcher framed the study around four areas of concern common to beginning teachers from the research and literature: (a) curriculum, instruction and assessment…

Evaluating Industry-Based Doctoral Research Programs: Perspectives and Outcomes of Australian Cooperative Research Centre Graduates

ERIC Educational Resources Information Center

Manathunga, Catherine; Pitt, Rachael; Cox, Laura; Boreham, Paul; Mellick, George; Lant, Paul

2012-01-01

Researchers of the future will need to be able to work across the increasingly porous boundaries between university, industry, government and community sectors. Concerns have been raised internationally for several decades about the content and approaches adopted in doctoral programs. Innovative doctoral programs that facilitate students'…

Sensory Aids Research Project - Clarke School for the Deaf.

ERIC Educational Resources Information Center

Boothroyd, Arthur

Described is a program of research into sensory aids for the deaf, emphasizing research on factors involved in the effective use of sensory aids rather than evaluation of particular devices. Aspects of the program are the development of a programed testing and training unit, the control of fundamental voice frequency using visual feedback, and…

Prevention-Related Research Targeting African American Alternative Education Program Students

ERIC Educational Resources Information Center

Carswell, Steven B.; Hanlon, Thomas E.; Watts, Amy M.; O'Grady, Kevin E.

2014-01-01

This article reports on a program of research that examined the background, planning, implementation, and evaluation of an after-school preventive intervention program within an ongoing urban alternative education program targeting African American students referred to the school because of their problematic behavior in regular schools. The…

75 FR 44 - Temporary Suspension of the Population Estimates and Income Estimates Challenge Programs

Federal Register 2010, 2011, 2012, 2013, 2014

2010-01-04

..., conduct research to enhance the estimates and challenge programs, and to integrate the updates from the... local governments would increase the administrative and evaluative complexity of this program for the... comparison with the population estimates, conducting research to enhance the estimates and challenge programs...

Curriculum development of 6for6: Longitudinal research skills program for rural and remote family physicians.

PubMed

McCarthy, Patti; Bethune, Cheri; Fitzgerald, Shari; Graham, Wendy; Asghari, Shabnam; Heeley, Thomas; Godwin, Marshall

2016-02-01

To address barriers challenging the engagement of rural and remote family physicians (RRFPs) in research, Memorial University of Newfoundland in St John's has developed a longitudinal faculty development program (FDP) called 6for6. To establish and evaluate a longitudinal FDP that promotes a foundation of research activity. Program description Informed by a needs assessment in phase 1, phase 2 saw the 6for6 curriculum designed, developed, and implemented to reflect the unique needs of RRFPs. Preliminary evaluations have been conducted and results will be presented after year 1 of the program. The 6for6 FDP has been positively received by participants, and it is evident that they will serve as champions of rural research capacity building. It is anticipated that by April 2017, 18 RRFPs will be equipped with the research and leadership skills required to foster research networks within and outside their communities.

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Solar thermal storage applications program

NASA Astrophysics Data System (ADS)

Peila, W. C.

1982-12-01

The efforts of the Storage Applications Program are reviewed. The program concentrated on the investigation of storage media and evaluation of storage methods. Extensive effort was given to experimental and analytical investigations of nitrate salts. Two tasks are the preliminary design of a 1200 MW/sub th/ system and the design, construction, operation, and evaluation of a subsystem research experiment, which utilized the same design. Some preliminary conclusions drawn from the subsystem research experiment are given.

Quantitative assessment of participant knowledge and evaluation of participant satisfaction in the CARES training program.

PubMed

Goodman, Melody S; Si, Xuemei; Stafford, Jewel D; Obasohan, Adesuwa; Mchunguzi, Cheryl

2012-01-01

The purpose of the Community Alliance for Research Empowering Social change (CARES) training program was to (1) train community members on evidence-based public health, (2) increase their scientific literacy, and (3) develop the infrastructure for community-based participatory research (CBPR). We assessed participant knowledge and evaluated participant satisfaction of the CARES training program to identify learning needs, obtain valuable feedback about the training, and ensure learning objectives were met through mutually beneficial CBPR approaches. A baseline assessment was administered before the first training session and a follow-up assessment and evaluation was administered after the final training session. At each training session a pretest was administered before the session and a posttest and evaluation were administered at the end of the session. After training session six, a mid-training evaluation was administered. We analyze results from quantitative questions on the assessments, pre- and post-tests, and evaluations. CARES fellows knowledge increased at follow-up (75% of questions were answered correctly on average) compared with baseline (38% of questions were answered correctly on average) assessment; post-test scores were higher than pre-test scores in 9 out of 11 sessions. Fellows enjoyed the training and rated all sessions well on the evaluations. The CARES fellows training program was successful in participant satisfaction and increasing community knowledge of public health, CBPR, and research methodology. Engaging and training community members in evidence-based public health research can develop an infrastructure for community-academic research partnerships.

Advancing Evaluation of Character Building Programs

ERIC Educational Resources Information Center

Urban, Jennifer Brown; Trochim, William M.

2017-01-01

This article presents how character development practitioners, researchers, and funders might think about evaluation, how evaluation fits into their work, and what needs to happen in order to sustain evaluative practices. A broader view of evaluation is presented whereby evaluation is not just seen as something that is applied at a program level,…

An Agenda for Research on the Sustainability of Public Health Programs

PubMed Central

Dearing, James W.

2011-01-01

Funders of programs in public health and community health are increasingly concerned about the sustainability of changes they initiate. Despite a recent increase in sustainability research and evaluation, this literature has not developed a widely used paradigm for conducting research that can accumulate into generalizable findings. We provide guidance for research and evaluation of health program sustainability, including definitions and types of sustainability, specifications and measurements of dependent variables, definitions of independent variables or factors that influence sustainability, and suggestions for designs for research and data collection. We suggest viewing sustainability research as a further stage in the translation or dissemination of research-based interventions into practice. This perspective emphasizes ongoing relationships with earlier stages of a broader diffusion framework, including adoption and implementation processes. PMID:21940916

Quantitative Research Attitudes and Research Training Perceptions among Master's-Level Students

ERIC Educational Resources Information Center

Steele, Janeé M.; Rawls, Glinda J.

2015-01-01

This study explored master's-level counseling students' (N = 804) perceptions of training in the Council for Accreditation of Counseling and Related Educational Programs (2009) Research and Program Evaluation standard, and their attitudes toward quantitative research. Training perceptions and quantitative research attitudes were low to moderate,…

A qualitative evaluation of the 2005-2011 National Academic Centers of Excellence in Youth Violence Prevention Program.

PubMed

Holland, Kristin M; Vivolo-Kantor, Alana M; Dela Cruz, Jason; Massetti, Greta M; Mahendra, Reshma

2015-12-01

The Centers for Disease Control and Prevention's Division of Violence Prevention (DVP) funded eight National Academic Centers of Excellence (ACEs) in Youth Violence Prevention from 2005 to 2010 and two Urban Partnership Academic Centers of Excellence (UPACEs) in Youth Violence Prevention from 2006 to 2011. The ACEs and UPACEs constitute DVP's 2005-2011 ACE Program. ACE Program goals include partnering with communities to promote youth violence (YV) prevention and fostering connections between research and community practice. This article describes a qualitative evaluation of the 2005-2011 ACE Program using an innovative approach for collecting and analyzing data from multiple large research centers via a web-based Information System (ACE-IS). The ACE-IS was established as an efficient mechanism to collect and document ACE research and programmatic activities. Performance indicators for the ACE Program were established in an ACE Program logic model. Data on performance indicators were collected through the ACE-IS biannually. Data assessed Centers' ability to develop, implement, and evaluate YV prevention activities. Performance indicator data demonstrate substantial progress on Centers' research in YV risk and protective factors, community partnerships, and other accomplishments. Findings provide important lessons learned, illustrate progress made by the Centers, and point to new directions for YV prevention research and programmatic efforts. Published by Elsevier Ltd.

An update of engine system research at the Army Propulsion Directorate

NASA Technical Reports Server (NTRS)

Bobula, George A.

1990-01-01

The Small Turboshaft Engine Research (STER) program provides a vehicle for evaluating the application of emerging technologies to Army turboshaft engine systems and to investigate related phenomena. Capitalizing on the resources at hand, in the form of both the NASA facilities and the Army personnel, the program goal of developing a physical understanding of engine system dynamics and/or system interactions is being realized. STER entries investigate concepts and components developed both in-house and out-of-house. Emphasis is placed upon evaluations which have evolved from on-going basic research and advanced development programs. Army aviation program managers are also encouraged to make use of STER resources, both people and facilities. The STER personnel have established their reputations as experts in the fields of engine system experimental evaluations and engine system related phenomena. The STER facility has demonstrated its utility in both research and development programs. The STER program provides the Army aviation community the opportunity to perform system level investigations, and then to offer the findings to the entire engine community for their consideration in next generation propulsion systems. In this way results of the fundamental research being conducted to meet small turboshaft engine technology challenges expeditiously find their way into that next generation of propulsion systems.

Social Science at the Center for Adaptive Optics: Synergistic Systems of Program Evaluation, Applied Research, Educational Assessment, and Pedagogy

NASA Astrophysics Data System (ADS)

Goza, B. K.; Hunter, L.; Shaw, J. M.; Metevier, A. J.; Raschke, L.; Espinoza, E.; Geaney, E. R.; Reyes, G.; Rothman, D. L.

2010-12-01

This paper describes the interaction of four elements of social science as they have evolved in concert with the Center for Adaptive Optics Professional Development Program (CfAO PDP). We hope these examples persuade early-career scientists and engineers to include social science activities as they develop grant proposals and carry out their research. To frame our discussion we use a metaphor from astronomy. At the University of California Santa Cruz (UCSC), the CfAO PDP and the Educational Partnership Center (EPC) are two young stars in the process of forming a solar system. Together, they are surrounded by a disk of gas and dust made up of program evaluation, applied research, educational assessment, and pedagogy. An idea from the 2001 PDP intensive workshops program evaluation developed into the Assessing Scientific Inquiry and Leadership Skills (AScILS) applied research project. In iterative cycles, AScILS researchers participated in subsequent PDP intensive workshops, teaching social science while piloting AScILS measurement strategies. Subsequent "orbits" of the PDP program evaluation gathered ideas from the applied research and pedagogy. The denser regions of this disk of social science are in the process of forming new protoplanets as tools for research and teaching are developed. These tools include problem-solving exercises or simulations of adaptive optics explanations and scientific reasoning; rubrics to evaluate the scientific reasoning simulation responses, knowledge regarding inclusive science education, and student explanations of science/engineering inquiry investigations; and a scientific reasoning curriculum. Another applied research project is forming with the design of a study regarding how to assess engineering explanations. To illustrate the mutual shaping of the cross-disciplinary, intergenerational group of educational researchers and their projects, the paper ends with a description of the professional trajectories of some of the researchers involved in this complex solar system.

Profile of Prior-Service Accessions to the U.S. (United States) Navy: Fiscal Years 1973-1981.

DTIC Science & Technology

1983-04-01

ORGANIZATION NAME AND ADDRESS 10. PROGRAM ELEMENT. PROJECT. TASK AREA A WORKC UNIT NUMBERS " Institute for Policy Research and Evaluation N-253...research effort aimed at enhancing Navy manpower policy. * *. . . . . . .. - Distribution List Director Technology Programs Office of Naval Research (Code...200) Arlington, VA 22217 Director Research Programs Office of Naval Research (Code 400) Arlington, VA 22217 Manpower, Personnel and Training

Re-examining Responsibilities: Health Educators as Researchers.

ERIC Educational Resources Information Center

Drolet, Judy C.

1991-01-01

Discusses seven areas of responsibility for entry-level health educators which can be demonstrated through research: assessing individual and community needs for health education; planning effective health education programs; implementing programs; evaluating program effectiveness; coordinating service provision; acting as a resource; and…

77 FR 47676 - Comment Request: Experimental Program to Stimulate Competitive Research Jurisdictional Survey

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-09

... Research Jurisdictional Survey AGENCY: National Science Foundation. ACTION: Notice. SUMMARY: Under the... Program to Stimulate Competitive Research Jurisdictional Survey Evaluation for the National Science... objective of the Foundation to strengthen science and engineering research potential and education at all...

Assessing Student Outcomes of Undergraduate Research with URSSA, the Undergraduate Student Self-Assessment Instrument

NASA Astrophysics Data System (ADS)

Laursen, S. L.; Weston, T. J.; Thiry, H.

2012-12-01

URSSA is the Undergraduate Research Student Self-Assessment, an online survey instrument for programs and departments to use in assessing the student outcomes of undergraduate research (UR). URSSA focuses on what students learn from their UR experience, rather than whether they liked it. The online questionnaire includes both multiple-choice and open-ended items that focus on students' gains from undergraduate research. These gains include skills, knowledge, deeper understanding of the intellectual and practical work of science, growth in confidence, changes in identity, and career preparation. Other items probe students' participation in important research-related activities that lead to these gains (e.g. giving presentations, having responsibility for a project). These activities, and the gains themselves, are based in research and thus constitute a core set of items. Using these items as a group helps to align a particular program assessment with research-demonstrated outcomes. Optional items may be used to probe particular features that are augment the research experience (e.g. field trips, career seminars, housing arrangements). The URSSA items are based on extensive, interview-based research and evaluation work on undergraduate research by our group and others. This grounding in research means that URSSA measures what we know to be important about the UR experience The items were tested with students, revised and re-tested. Data from a large pilot sample of over 500 students enabled statistical testing of the items' validity and reliability. Optional items about UR program elements were developed in consultation with UR program developers and leaders. The resulting instrument is flexible. Users begin with a set of core items, then customize their survey with optional items to probe students' experiences of specific program elements. The online instrument is free and easy to use, with numeric results available as raw data, summary statistics, cross-tabs, and graphs, and as raw, downloadable data. Finally, URSSA has high content validity based on its research grounding and rigorous development. We will present examples of how URSSA has been used in evaluations of UR programs. A multi-year evaluation of a university-based UR program shows that URSSA items are sensitive to differences in students' prior level of experience with research. For example, experienced student researchers reported greater gains than did their peers new to UR in understanding the process of research and in coming to see themselves as scientists. These differences are consistent with interview data that suggest a developmental progression of gains as students pursue research and gain confidence in their ability to contribute meaningfully. A second example comes from a multi-site evaluation of sites funded by the National Science Foundation's Research Experience for Undergraduates (REU) program in Biology. This study acquired data from nearly 800 students at some 60 Bio REU sites in 2010 and 2011. Results reveal differences in gains among demographic groups, and the general strength of these well-planned programs relative to a comparison sample of UR programs that are not part of REU. Our presentation will demonstrate the evaluative use of URSSA and its potential applications to undergraduate research in the geosciences.

Development of an Experiment High Performance Nozzle Research Program

NASA Technical Reports Server (NTRS)

2004-01-01

As proposed in the above OAI/NASA Glenn Research Center (GRC) Co-Operative Agreement the objective of the work was to provide consultation and assistance to the NASA GRC GTX Rocket Based Combined Cycle (RBCC) Program Team in planning and developing requirements, scale model concepts, and plans for an experimental nozzle research program. The GTX was one of the launch vehicle concepts being studied as a possible future replacement for the aging NASA Space Shuttle, and was one RBCC element in the ongoing NASA Access to Space R&D Program (Reference 1). The ultimate program objective was the development of an appropriate experimental research program to evaluate and validate proposed nozzle concepts, and thereby result in the optimization of a high performance nozzle for the GTX launch vehicle. Included in this task were the identification of appropriate existing test facilities, development of requirements for new non-existent test rigs and fixtures, develop scale nozzle model concepts, and propose corresponding test plans. Also included were the evaluation of originally proposed and alternate nozzle designs (in-house and contractor), evaluation of Computational Fluid Dynamics (CFD) study results, and make recommendations for geometric changes to result in improved nozzle thrust coefficient performance (Cfg).

Interdisciplinary research and education in the Vienna Doctoral Programme on Water Resource Systems: a framework for evaluation

NASA Astrophysics Data System (ADS)

Bloeschl, G.; Carr, G.; Loucks, D. P.

2017-12-01

Greater understanding of how interdisciplinary research and education evolves is critical for identifying and implementing appropriate programme management strategies. We propose a program evaluation framework that is based on social learning processes (individual learning, interdisciplinary research practices, and interaction between researchers with different backgrounds); social capital outcomes (ability to interact, interpersonal connectivity, and shared understanding); and knowledge and human capital outcomes (new knowledge that integrates multiple research fields). The framework is tested on established case study doctoral program: the Vienna Doctoral Program on Water Resource Systems. Data are collected via mixed qualitative/quantitative methods that include semi-structured interviews, publication co-author analysis, analysis of research proposals, categorisation of the interdisciplinarity of publications and graduate analysis. Through the evaluation and analysis, several interesting findings about how interdisciplinary research evolves and can be supported are identified. Firstly, different aspects of individual learning seem to contribute to a researcher's ability to interact with researchers from other research fields and work collaboratively. These include learning new material from different research fields, learning how to learn new material and learning how to integrate different material. Secondly, shared interdisciplinary research practices can be identified that may be common to other programs and support interaction and shared understanding between different researchers. They include clarification and questioning, harnessing differences and setting defensible research boundaries. Thirdly, intensive interaction between researchers from different backgrounds support connectivity between the researchers, further enabling cross-disciplinary collaborative work. The case study data suggest that social learning processes and social capital outcomes precede new interdisciplinary research findings and are therefore a critical aspect to consider in interdisciplinary program management.

Computer-Assisted Telephone Screening: A New System for Patient Evaluation and Recruitment

PubMed Central

Radcliffe, Jeanne M.; Latham, Georgia S.; Sunderland, Trey; Lawlor, Brian A.

1990-01-01

Recruitment of subjects for research studies is a time consuming process for any research coordinator. This paper introduces three computerized databases designed to help screen potential research candidates by telephone. The three programs discussed are designed to evaluate specific populations: geriatric patients (i.e. Alzheimer's patients), patients with affective disorders and normal volunteers. The interview content, software development, and the utility of these programs is discussed with particular focus on how they can be helpful in the research setting.

The Evaluation of Federal Programs in Agricultural Research, Education, and Extension. Hearings before the Subcommittee on Resource Conservation, Research, and Forestry of the Committee on Agriculture. House of Representatives, One Hundred Fourth Congress, Second Session (March 27, May 14, July 17, 1996).

ERIC Educational Resources Information Center

Congress of the U.S., Washington, DC. House Committee on Agriculture.

Three House of Representatives' subcommittee hearings were held in March, May, and July 1996 to evaluate the goals, priority setting, and advisory mechanisms of federal programs in agricultural research, education, and extension. To become competitive in global markets, farmers will need to rely on the research community to provide up-to-date…

An Evaluation Methodology for Longitudinal Studies of Short Term Cancer Research Training Programs

PubMed Central

Padilla, Luz A.; Venkatesh, Raam; Daniel, Casey L.; Desmond, Renee A.; Brooks, C. Michael; Waterbor, John W.

2014-01-01

The need to familiarize medical students and graduate health professional students with research training opportunities that cultivate the appeal of research careers is vital to the future of research. Comprehensive evaluation of a cancer research training program can be achieved through longitudinal tracking of program alumni to assess the program’s impact on each participant’s career path and professional achievements. With advances in technology and smarter means of communication, effective ways to track alumni have changed. In order to collect data on the career outcomes and achievements of nearly 500 short-term cancer research training program alumni from 1999–2013, we sought to contact each alumnus to request completion of a survey instrument online, or by means of a telephone interview. The effectiveness of each contact method that we used was quantified according to ease of use and time required. The most reliable source of contact information for tracking alumni from the early years of the program was previous tracking results; and for alumni from the later years, the most important source of contact information was university alumni records that provided email addresses and telephone numbers. Personal contacts with former preceptors were sometimes helpful, as were generic search engines and people search engines. Social networking was of little value for most searches. Using information from two or more sources in combination was most effective in tracking alumni. These results provide insights and tools for other research training programs that wish to track their alumni for long-term program evaluation. PMID:25412722

Evaluating a physician leadership development program - a mixed methods approach.

PubMed

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Research training of students in minority and international settings: lessons learned from cancer epidemiology education in special populations.

PubMed

Soliman, Amr S; Mullan, Patricia B; Chamberlain, Robert M

2010-06-01

This article describes the development and evaluation of an NCI-sponsored short-term summer cancer research education program. The study questions examined: the feasibility of conducting a cancer education program in special populations at multiple US and international field sites for masters students; the merit and worth that students and faculty attribute to the program; and students' scholarly and cancer-related career outcomes. Developing a new curriculum, increasing the pool of mentors, utilizing and increasing the number of field sites, and program dissemination were also evaluated. Evidence of the program's success included students' completion of field experiences at multiple sites and their subsequent 70% project-related publication rate, with 79% of trainees reporting themselves as likely to pursue future cancer-related careers. Evaluation-guided future plans for the program include implementing faculty development to further enhance the program outcomes.

75 FR 68829 - Agency Information Collection Activities: Comment Request; Generic Survey Clearance for the...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-09

... evaluation studies. In order to conduct program- or portfolio-level evaluations, however, both experimental and quasi-experimental evaluation research studies on STEM education interventions require researchers...

Transition Room Program, 1967 Report.

ERIC Educational Resources Information Center

Glassner, Leonard E.

The Transition Room Program of the Pittsburgh Schools was defined and evaluated by the staff, the administration, and a program evaluator from the Office of Research. The definition included general objectives, anticipated outcomes, student criteria and characteristics, staff qualifications and functions, media, student activities, and staff…

Design, development, and evaluation of truck and bus driver wellness programs

DOT National Transportation Integrated Search

2000-06-01

In May 1997, the Federal Motor Carrier Safety Administration (FMCSA) began a research project to design, develop, and evaluate a model truck and bus driver wellness program. This wellness program was developed to provide a resource for addressing tru...

Evaluation of training programs and entry-level qualifications for nuclear-power-plant control-room personnel based on the systems approach to training

DOE Office of Scientific and Technical Information (OSTI.GOV)

Haas, P M; Selby, D L; Hanley, M J

1983-09-01

This report summarizes results of research sponsored by the US Nuclear Regulatory Commission (NRC) Office of Nuclear Regulatory Research to initiate the use of the Systems Approach to Training in the evaluation of training programs and entry level qualifications for nuclear power plant (NPP) personnel. Variables (performance shaping factors) of potential importance to personnel selection and training are identified, and research to more rigorously define an operationally useful taxonomy of those variables is recommended. A high-level model of the Systems Approach to Training for use in the nuclear industry, which could serve as a model for NRC evaluation of industrymore » programs, is presented. The model is consistent with current publically stated NRC policy, with the approach being followed by the Institute for Nuclear Power Operations, and with current training technology. Checklists to be used by NRC evaluators to assess training programs for NPP control-room personnel are proposed which are based on this model.« less

Health economics and outcomes research fellowship practices reviewed.

PubMed

Suh, Kangho; Gabriel, Susan; Adams, Michelle A; Arcona, Steve

2015-01-01

The guidelines for health economics and outcomes research (HEOR) fellowship training programs devised by the American College of Clinical Pharmacy (ACCP) and the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) suggest that continuous improvements are made to ensure that postgraduate training through didactic and professional experiences prepare fellows for HEOR research careers. The HEOR Fellowship Program at Novartis Pharmaceuticals Corporation was standardized to enhance the fellows' HEOR research understanding and align professional skill sets with the ACCP-ISPOR Fellowship Program Guidelines. Based on feedback from an internal task force comprised of HEOR employees and current and former fellows, the HEOR Fellowship Program was normatively and qualitatively assessed to evaluate the current curricular program. Fellowship program activities were instituted to ensure that the suggested minimum level requirements established by the guidelines were being met. Research opportunities enabling fellows to work hand-in-hand with other fellows and HEOR professionals were emphasized. Curricular enhancements in research methodology and professional training and development, and materials for a structured journal club focusing on specific methodological and HEOR research topics were developed. A seminar series (e.g., creating SMART Goals, StrengthsFinder 2.0) and professional courses (e.g., ISPOR short courses, statistics.com) were included to enhance the fellows' short- and long-term professional experience. Additional program attributes include an online reference library developed to enrich the current research facilities and a Statistical Analysis Software training program. Continuously assessing and updating HEOR fellowship programs keeps programs up-to-date in the latest HEOR concepts and approaches used to evaluate health care, both professionally and educationally. Copyright © 2015 Elsevier Inc. All rights reserved.

Designing and evaluating a STEM teacher learning opportunity in the research university.

PubMed

Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D

2014-04-01

This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer. Copyright © 2013 Elsevier Ltd. All rights reserved.

The Nature and Frequency of Inclusion of People with Disabilities in Program Evaluation

ERIC Educational Resources Information Center

Jacobson, Miriam R.; Azzam, Tarek; Baez, Jeanette G.

2013-01-01

Although evaluation theorists over the last two decades have argued for the importance of including stakeholders from marginalized groups in program planning and research, little is known about the degree of inclusion in program evaluation practice. In particular, we know little about the type and level of inclusion of people with intellectual,…

Evaluation of School Environmental Programs Regarding the Objectives for the Environmentally Literate Students, of Heraklion, Greece Prefecture

ERIC Educational Resources Information Center

Kalathak, Maria

2015-01-01

This evaluation research concerns the aims and objectives for creating the future environmentally literate citizen through the environmental programs (PEEs) of Secondary Education of Heraklion prefecture, Crete, Greece. An evaluation tool applied on the application forms and the final reports of the programs, in order to asses how sustainable they…

A Mixed Methods Approach to Understanding School Counseling Program Evaluation: High School Counselors' Methods and Perceptions

ERIC Educational Resources Information Center

Aucoin, Jennifer Mangrum

2013-01-01

The purpose of this mixed methods concurrent triangulation study was to examine the program evaluation practices of high school counselors. A total of 294 high school counselors in Texas were assessed using a mixed methods concurrent triangulation design. A researcher-developed survey, the School Counseling Program Evaluation Questionnaire…

78 FR 42795 - Submission for OMB review; 30-Day Comment Request: Evaluation of the Brain Disorders in the...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-17

...; 30-Day Comment Request: Evaluation of the Brain Disorders in the Developing World Program of the John... Collection: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty... outcomes of the Brain Disorders in the Developing World extramural research program administered by the...

Seeing the Forest Despite the Trees: The Benefit of Exploratory Data Analysis to Program Evaluation Research.

ERIC Educational Resources Information Center

Sinacore, James M.; And Others

1992-01-01

It is argued that there is a benefit to applying techniques of exploratory data analysis (EDA) to program evaluation. The evaluation of a rehabilitation program for people with rheumatoid arthritis (20 subjects and 21 comparisons) through EDA supports the argument, indicating outcomes more precisely than conventional analysis of variance. (SLD)

Supplemental Literacy Instruction for Students with Down Syndrome: A Program Evaluation

ERIC Educational Resources Information Center

Regan, Lisa Michelle

2013-01-01

The study utilizes an inductive, qualitative approach to program evaluation to understand the nature of an afterschool literacy tutoring program for students with Down syndrome. Two research questions guide this study: (a) What are the curricular and instructional elements of the Let's Read Now (LRN) literacy tutoring program for students…

Evaluating Mentoring Programs. P/PV Brief

ERIC Educational Resources Information Center

Grossman, Jean Baldwin

2009-01-01

This methodological brief is designed to provide both program operators and researchers with practical advice about how to assess a program's implementation and impact. Adapted from an article that first appeared in "The Handbook of Youth Mentoring" (DuBois and Karcher, ed. 2005), the brief focuses on the evaluation of mentoring programs, but the…

The 1977 Rankings of Programs for an In-Depth Evaluation. Research Note.

ERIC Educational Resources Information Center

Baratta, Mary Kathryne

Placement, unit cost, retention and attraction data for all programs at Moraine Valley Community College for which information was available were used to determine which programs needed in-depth evaluation. Four of the 24 associate degree programs (secretarial science, radiologic technology, power machine technology, and industrial supervision)…

Two Feathers Endowment Scholarship Program: Program Evaluation

ERIC Educational Resources Information Center

Pierce, Alexandra

2004-01-01

The Saint Paul Foundation contracted with the Wilder Research Center to conduct an evaluation of their Two Feathers Scholarship Program. The Two Feathers Scholarship Program is funded through the Two Feathers Endowment, which is one part of the Foundation's SpectrumTrust. SpectrumTrust is a unique partnership between communities of color and The…

Enhancing Research Capacity for Global Health: Evaluation of a Distance-Based Program for International Study Coordinators

ERIC Educational Resources Information Center

Wilson, Lynda Law; Rice, Marti; Jones, Carolynn T.; Joiner, Cynthia; LaBorde, Jennifer; McCall, Kimberly; Jester, Penelope M.; Carter, Sheree C.; Boone, Chrissy; Onwuzuligbo, Uzoma; Koneru, Alaya

2013-01-01

Introduction: Due to the increasing number of clinical trials conducted globally, there is a need for quality continuing education for health professionals in clinical research manager (CRM) roles. This article describes the development, implementation, and evaluation of a distance-based continuing education program for CRMs working outside the…

An Approach for Selecting a Theoretical Framework for the Evaluation of Training Programs

ERIC Educational Resources Information Center

Tasca, Jorge Eduardo; Ensslin, Leonardo; Ensslin, Sandra Rolim; Alves, Maria Bernardete Martins

2010-01-01

Purpose: This research paper proposes a method for selecting references related to a research topic, and seeks to exemplify it for the case of a study evaluating training programs. The method is designed to identify references with high academic relevance in databases accessed via the internet, using a bibliometric analysis to sift the selected…

Using Participatory Action Research To Evaluate Programs Serving People with Severe Disabilities: Reflections from the Field.

ERIC Educational Resources Information Center

Stevens, Karen A.; Folchman, Ruth

1998-01-01

This article discusses challenges in using participatory action research (PAR) in the evaluation of programs that provide services and supports to people with severe disabilities. Challenges include the need for modification of the model, time constraints, issues around power and position, and inclusion of individuals with severe disabilities.…

Highway concrete pavement technology development and testing : volume IV, field evaluation of Strategic Highway Research Program (SHRP) C-206 test sites (early opening of full-depth pavement repairs).

DOT National Transportation Integrated Search

2006-08-01

The objective of this study was to monitor and evaluate the performance of experimental full-depth repairs made with high-early-strength (HES) materials placed under Strategic Highway Research Program (SHRP) project C-206, Optimization of Highway Con...

Toward a Capacity Framework for Useful Student Learning Outcomes Assessment in College Foreign Language Programs

ERIC Educational Resources Information Center

Davis, John McEwan

2016-01-01

The educational impacts of mandated assessment in U.S. colleges is part of a growing research agenda focused on how methodologies of program evaluation best enable educators to improve teaching and learning. Accordingly, research has tried to identify the key aspects of evaluation/assessment "capacity" in college language departments…

Connected Classroom: A Program Evaluation of the Professional Development Program of a One-to-One Educational Technology Initiative in South Carolina

ERIC Educational Resources Information Center

Grant, Kelly J.

2016-01-01

The purpose of this study was to evaluate the impact of the first year of a multi-year, district-wide professional development program for teachers that accompanied a one-to-one Apple device rollout for all students. A mixed-method research design was used to perform a logic model of program evaluation. Teacher self-reported proficiency in basic…

Use of Bennett's Hierarchical Model in the Evaluation of the Extension Education Program for Cacao Farmers in the Northeast Region of the Dominican Republic. Summary of Research 54.

ERIC Educational Resources Information Center

De los Santos, Saturnino; Norland, Emmalou Van Tilburg

A study evaluated the cacao farmer training program in the Dominican Republic by testing hypothesized relationships among reactions, knowledge and skills, attitudes, aspirations, and some selected demographic characteristics of farmers who attended programs. Bennett's hierarchical model of program evaluation was used as the framework of the study.…

Research in computer science

NASA Technical Reports Server (NTRS)

Ortega, J. M.

1984-01-01

The research efforts of University of Virginia students under a NASA sponsored program are summarized and the status of the program is reported. The research includes: testing method evaluations for N version programming; a representation scheme for modeling three dimensional objects; fault tolerant protocols for real time local area networks; performance investigation of Cyber network; XFEM implementation; and vectorizing incomplete Cholesky conjugate gradients.

Mentoring advanced practice nurses in research: recommendations from a pilot program.

PubMed

Leung, Doris; Widger, Kimberley; Howell, Doris; Nelson, Sioban; Molassiotis, Alex

2012-01-01

Advanced Practice Nurses (APNs) need research skills to develop and advance their practice and, yet, many have limited access to research training and support following completion of their advanced degree. In this paper we report on the development, delivery, and evaluation of an innovative pilot program that combined research training and one-to-one mentorship for nine APNs in conducting research relevant to their practice. The program was organized within an academic institution and its affiliated hospitals in Toronto, Canada. Our experience with this program may assist those in other organizations to plan and deliver a similar program for APN research mentorship.

Mentoring Undergraduate Students in Estuarine Research Experiences: Different Strokes for Different Folks

NASA Astrophysics Data System (ADS)

Moser, F. C.; Allen, M. R.; Montoya-Ospina, R. A.; Maldonado, P.; Barberena-Arias, M.; Olivo-Delgado, C.; Harris, L.; Pierson, J. J.; Alvarez, J. P.

2015-12-01

Here we consider how mentoring, both traditional and peer based, contributes to successful student outcomes in undergraduate research programs and we present several approaches to encourage positive mentor-mentee relationships. From several different research mentoring programs with undergraduates in Maryland and in Puerto Rico, we find that some mentoring techniques are universally useful, while others need to be tailored to a specific program and mentee population. Our programs differ in length, student composition, and student expectations, we find that success occurs across-the-board when mentors quickly establish rapport with their students and reach an early joint understanding of the program's requirements and the students' capabilities and needs through immersive orientations early in the program. Alternatively, mentors have to customize their approaches (e.g. simplify presentations of concepts, increase time for questions) when they encounter differences in student knowledge levels and cultural disconnects (e.g. language barriers, unfamiliarity with research labs and academia). Our current approach to improving and evaluating mentoring includes using a system of multiple mentor tiers (peer, near-peer, faculty, and program leaders), multiple qualitative and quantitative evaluations during the program, and post-research experience student outreach, all of which we believe improve student outcomes. Although we have measures of mentee success (e.g., presenting at national meetings, pursuing additional research experiences, applying to graduate school in marine science-related fields, etc.), we continue to look for additional short and long-term evaluation techniques that may help us to distinguish between the influence of mentoring and that of other program attributes (e.g. lab and field experiences, professional development seminars, ethics training, etc.) on student achievement.

Encyclopedia of Educational Evaluation: Concepts and Techniques for Evaluating Education and Training Programs.

ERIC Educational Resources Information Center

Anderson, Scarvia B.; And Others

Arranged like an encyclopedia, this book, addressed to directors and sponsors of education/training programs, as well as evaluators and those studying to become evaluators, unifies and systematizes the field of evaluation by organizing its main concepts and techniques into one volume. Researched and documented articles, contributed by recognized…

Higher Education Trends (1997-1999): Program Evaluation. ERIC-HE Trends.

ERIC Educational Resources Information Center

Kezar, Adrianna J.

The amount of literature on program evaluation decreased in 1996, continuing a trend begun in the late 1980s. One exception to this is the literature on assessment. Another frequent issue is the technique of evaluation. Many examples of research on evaluation are from international settings, where accountability and evaluation appear to be…

Program Evaluation at HEW: Research versus Reality. Part 2: Education.

ERIC Educational Resources Information Center

Abert, James G., Ed.

Intended for both the student and the practitioner of evaluation, this book describes the state of the practice of program evaluation. Its focus is mainly institutional. Results of evaluation studies are of secondary importance. An introductory chapter written by the editor discusses evaluation at the Office of Education from 1967 through 1973.…

RBS Career Education. Evaluation Planning Manual. Education Is Going to Work.

ERIC Educational Resources Information Center

Kershner, Keith M.

Designed for use with the Research for Better Schools career education program, this evaluation planning manual focuses on procedures and issues central to planning the evaluation of an educational program. Following a statement on the need for evaluation, nine sequential steps for evaluation planning are discussed. The first two steps, program…

SITE PROGRAM EVALUATION OF THE SONOTECH PULSE COMBUSTION BURNER TECHNOLOGY - TECHNICAL RESULTS

EPA Science Inventory

A series of demonstration tests was performed at the Environmental Protection Agency's (EPA's) Incineration Research Facility (IRF) under the Superfund Innovative Technology Evaluation (SITE) program. These tests, twelve in all, evaluated a pulse combustion burner technology dev...

A Review and Evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of Phase IV--Knowledge and Attitudes Survey, Academic and Industrial Personnel. Final Report.

ERIC Educational Resources Information Center

Pinelli, Thomas E.; And Others

As Phase IV of a comprehensive evaluation of the NASA-affiliated Langley Research Center's (LaRC) scientific and technical information (STI) program, a study was conducted to assess the usage, importance, and perceived quality of Langley-generated STI among academic and industrial research personnel, and to determine ways in which that information…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

NASA Astrophysics Data System (ADS)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding period. Evaluation of programs like EMPOWER provide essential information to support continual improvement of STEM graduate programs.

How Bigelow Laboratory Measured Broader Impacts: The Case Study of the Evaluation of the Keller BLOOM Program (Invited)

NASA Astrophysics Data System (ADS)

Fowler, R. A.; Repa, J.

2010-12-01

In this presentation we discuss the impetus for, the results of the short and long term effects, and the impacts of the Keller BLOOM Program, hosted by Bigelow Laboratory for Ocean Sciences of West Boothbay Harbor, Maine. Each May, for the last 21 years, 16 bright high school juniors, one from each county in Maine, have been invited to spend five days with the research scientists at the lab conducting and reporting research on the bottom layers of the ocean’s food chain: phytoplankton and zooplankton. Bigelow has chosen to evaluate BLOOM through a series of questionnaires delivered during the program, and long term tracking of participants after the program, in order to better understand the impact of the program on participants. The short term effect of the experience, measured at the end of the week, found that participants are able to: 1) develop testable research questions, 2) collect multiple water samples from a local estuary, 3) measure various characteristics of those samples with the sophisticated instruments in Bigelow’s labs assisted by their research scientists, 4) analyze and integrate the results from the various labs, and 5) present their findings to a non-scientific audience. To measure long term participation effects, a random sample of 40 of the 332 participants were interviewed resulting in the following findings: 100% attend college; 62% have STEM majors; 88% graduate from college; 57% pursue STEM careers; and 60% live and work in Maine. Bigelow scientists include a description of the BLOOM Program and the evaluation results in their NSF Broader Impacts statements to demonstrate that their research activities are being integrated into a successful STEM education program. Evaluation results are also used by Bigelow scientists and program administrators to refine program content and delivery, to promote the program to potential applicants, and to strengthen proposals to funding agencies when seeking financial support for BLOOM.

7 CFR 3415.15 - Evaluation factors.

Code of Federal Regulations, 2013 CFR

2013-01-01

... AGRICULTURE BIOTECHNOLOGY RISK ASSESSMENT RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant... criteria are specified in the annual program solicitation: (a) Scientific merit of the proposal. (1... uncertainty for United States agriculture. (1) Scientific contribution of research in leading to important...

7 CFR 3415.15 - Evaluation factors.

Code of Federal Regulations, 2014 CFR

2014-01-01

... AGRICULTURE BIOTECHNOLOGY RISK ASSESSMENT RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant... criteria are specified in the annual program solicitation: (a) Scientific merit of the proposal. (1... uncertainty for United States agriculture. (1) Scientific contribution of research in leading to important...

7 CFR 3415.15 - Evaluation factors.

Code of Federal Regulations, 2012 CFR

2012-01-01

... AGRICULTURE BIOTECHNOLOGY RISK ASSESSMENT RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant... criteria are specified in the annual program solicitation: (a) Scientific merit of the proposal. (1... uncertainty for United States agriculture. (1) Scientific contribution of research in leading to important...

Status of anesthesiology resident research education in the United States: structured education programs increase resident research productivity.

PubMed

Ahmad, Shireen; De Oliveira, Gildasio S; McCarthy, Robert J

2013-01-01

The enhancement of resident research education has been proposed to increase the number of academic anesthesiologists with the skills and knowledge to conduct meaningful research. Program directors (PDs) of the U.S. anesthesiology residency programs were surveyed to evaluate the status of research education during residency training and to test the hypothesis that structured programs result in greater resident research productivity based on resident publications. Survey responses were solicited from 131 anesthesiology residency PDs. Seventy-four percent of PDs responded to the survey. Questions evaluated department demographic information, the extent of faculty research activity, research resources and research funding in the department, the characteristics of resident research education and resident research productivity, departmental support for resident research, and perceived barriers to resident research education. Thirty-two percent of programs had a structured resident research education program. Structured programs were more likely to be curriculum based, require resident participation in a research project, and provide specific training in presentation and writing skills. Productivity expectations were similar between structured and nonstructured programs. Forty percent of structured programs had > 20% of trainees with a publication in the last 2 years compared with 14% of departments with unstructured programs (difference, 26%; 99% confidence interval [CI], 8%-51%; P = 0.01). The percentage of programs that had research rotations for ≥2 months was not different between the structured and the nonstructured programs. A research rotation of >2 months did not increase the percentage of residents who had published an article within the last 2 months compared with a research rotation of <2 months (difference, 13%; 99% CI, 10%-37%; P = 0.14). There was no difference in the percentage of faculty involved in research in structured compared with unstructured research education. In programs with <20% of faculty involved in research, 15% reported >20% of residents with a publication in the last 2 years compared with 36% in programs with >20% of faculty involvement (difference, 21%; 99% CI, -4% to 46%; P = 0.03). Our findings suggest that structured residency research programs are associated with higher resident research productivity. The program duration and the fraction of faculty in resident research education did not significantly increase research productivity. Research training is an integral component of resident education, but the mandatory enhancement of resident research education will require a significant change in the culture of academic anesthesiology leadership and faculty.

Toward Useful Program Evaluation in College Foreign Language Education

ERIC Educational Resources Information Center

Norris, John M., Ed.; Davis, John McE., Ed.; Sinicrope, Castle, Ed.; Watanabe, Yukiko, Ed.

2009-01-01

This volume reports on innovative, useful evaluation work conducted within U.S. college foreign language programs. An introductory chapter scopes out the territory, reporting key findings from research into the concerns, impetuses, and uses for evaluation that FL educators identify. Seven chapters then highlight examples of evaluations conducted…

Evaluating Federal Education Programs.

ERIC Educational Resources Information Center

Baker, Eva L., Ed.

A series of papers was developed by the authors as part of their deliberations as members of the National Research Council's Committee of Program Evaluation in Education. The papers provide a broad range of present evaluative thinking. The conflict between preferences in evaluation methodology comes through in these papers. The selections include:…

Evaluating Community College Personnel: A Research Report.

ERIC Educational Resources Information Center

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

76 FR 3913 - National Institute on Drug Abuse; Notice of Closed Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-21

... evaluation of individual intramural programs and projects conducted by the National Institute on Drug Abuse... individual investigators. Place: Intramural Research Program, National Institute on Drug Abuse, NIH, Johns... Psychologist, Clinical Pharmacology Branch, Intramural Research Program, National Institute on Drug Abuse...

A Study of Facilities and Infrastructure Planning, Prioritization, and Assessment at Federal Security Laboratories

DTIC Science & Technology

2012-11-01

Research , Development, Test , and Evaluation (RDT&E) Appropriations The RDT&E appropriation consists of the mission program budgets for all... research , development, test and evaluation work performed by contractors and government installations and includes an installations and activities budget...than $4,000,000. 9 f. Research , Development, Test , and Evaluation Appropriations The Research , Development, Test , and Evaluation (RDT&E

Medication Exposure in Pregnancy Risk Evaluation Program

PubMed Central

Andrade, Susan E.; Davis, Robert L.; Cheetham, T. Craig; Cooper, William O.; Li, De-Kun; Amini, Thushi; Beaton, Sarah J.; Dublin, Sascha; Hammad, Tarek A.; Pawloski, Pamala A.; Raebel, Marsha A.; Smith, David H.; Staffa, Judy A.; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E.

2011-01-01

To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy. PMID:22002179

Medication Exposure in Pregnancy Risk Evaluation Program.

PubMed

Andrade, Susan E; Davis, Robert L; Cheetham, T Craig; Cooper, William O; Li, De-Kun; Amini, Thushi; Beaton, Sarah J; Dublin, Sascha; Hammad, Tarek A; Pawloski, Pamala A; Raebel, Marsha A; Smith, David H; Staffa, Judy A; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E

2012-10-01

To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy.

Tools to Assess the Impact of Teacher Enhancement Programs

NASA Astrophysics Data System (ADS)

Heatherly, S. A.; Maddalena, R. J.; Govett, A.; Hemler, D.

1997-05-01

Beginning in 1994, the NRAO has hosted an NSF-funded program, ``Research Experience in Teacher Preparation (RETP),'' in which inservice and preservice science teachers participate in residential institutes lasting one or two weeks. While on site, they conduct open-ended investigations using a 40-foot diameter working radio telescope. The aim of RETP has been to deepen and personalize participants' understanding of the nature of science, and to assist them in applying their newfound knowledge to their classroom teaching. So far RETP, and the teacher enhancement programs from which it evolved, have trained 434 inservice and 69 preservice teachers. The impact of the research experience on teachers' perceptions of themselves as professionals and their views of science was initially assessed through open-ended questionnaires and participant journals. From teachers' responses we learned that the research experience has a profound, positive influence on participants' views of science and increased their confidence in using research-based teaching methods. However, determining what actually happens in the classroom is harder to evaluate and requires a more structured approach. Therefore, to determine what changes occurred in teachers and their students, five survey instruments were developed. The instruments: 1) assess changes in teachers' perceptions of their ability to conduct research; 2) gauge teachers' perceptions of three aspects of the institute; 3) measure changes in teachers' concerns about implementing classroom research projects; 4) evaluate the development of teachers' understanding into the nature of science; and 5) determine changes in their students' perceptions of science and science class. To increase the reliability of the instruments, the survey questions were tested for internal consistency. Early results show that the RETP program has significantly affected participants and their students. These instruments are useful not only for evaluating this program but also for evaluating other teacher enhancement and preparation programs.

[The evaluation of science].

PubMed

Ramiro-H, Manuel; Cruz-A, J Enrique; García-Gómez, Francisco

2017-01-01

The evaluation and quantification of scientific activity is an extremely complex task. Evaluation of research results is often difficult, and different indicators for the quantification and evaluation of scientific publications have been identified, as well as the development and success of the training programs of researchers.

Organization and use of a Software/Hardware Avionics Research Program (SHARP)

NASA Technical Reports Server (NTRS)

Karmarkar, J. S.; Kareemi, M. N.

1975-01-01

The organization and use is described of the software/hardware avionics research program (SHARP) developed to duplicate the automatic portion of the STOLAND simulator system, on a general-purpose computer system (i.e., IBM 360). The program's uses are: (1) to conduct comparative evaluation studies of current and proposed airborne and ground system concepts via single run or Monte Carlo simulation techniques, and (2) to provide a software tool for efficient algorithm evaluation and development for the STOLAND avionics computer.

The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia. Impact Evaluation Series No. 29. Policy Research Working Paper 4836

ERIC Educational Resources Information Center

Barrera-Osorio, Felipe; Linden, Leigh L.

2009-01-01

This paper presents the evaluation of the program Computers for Education. The program aims to integrate computers, donated by the private sector, into the teaching of language in public schools. The authors conduct a two-year randomized evaluation of the program using a sample of 97 schools and 5,201 children. Overall, the program seems to have…

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

Evaluation of a Commercially Available Program and in Situ Training by Parents to Teach Abduction-Prevention Skills to Children

ERIC Educational Resources Information Center

Beck, Kimberly V.; Miltenberger, Raymond G.

2009-01-01

Child abduction is a serious problem; therefore, it is essential that researchers evaluate the efficacy of commercially available abduction-prevention programs. A multiple baseline design across participants (ages 6 to 8 years) was used to evaluate the effects of a training program, The Safe Side. Experimenters assessed safety responses in situ in…

Automated Writing Evaluation Program's Effect on Student Writing Achievement

ERIC Educational Resources Information Center

Holman, Lester Donnie

2011-01-01

In an ex post facto causal-comparative research design, this study investigated the effectiveness of Automated Writing Evaluation (AWE) programs on raising the student writing achievement. Tennessee Comprehensive Assessment Program (TCAP) writing achievement scores from the 2010 administration were utilized for this study. The independent variable…

Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting.

PubMed

Smith, Katherine; Firth, Kimberly; Smeeding, Sandra; Wolever, Ruth; Kaufman, Joanna; Delgado, Roxana; Bellanti, Dawn; Xenakis, Lea

2016-01-01

Research suggests that the development of mind-body skills can improve individual and family resilience, particularly related to the stresses of illness, trauma, and caregiving. To operationalize the research evidence that mind-body skills help with health and recovery, Samueli Institute, in partnership with experts in mind-body programming, created a set of guidelines for developing and evaluating mind-body programs for service members, veterans, and their families. The Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting outline key strategies and issues to consider when developing, implementing, and evaluating a mind-body focused family empowerment approach in a military healthcare setting. Although these guidelines were developed specifically for a military setting, most of the same principles can be applied to the development of programs in the civilian setting as well. The guidelines particularly address issues unique to mind-body programs, such as choosing evidence-based modalities, licensure and credentialing, safety and contraindications, and choosing evaluation measures that capture the holistic nature of these types of programs. The guidelines are practical, practice-based guidelines, developed by experts in the fields of program development and evaluation, mind-body therapies, patient- and family-centered care, as well as, experts in military and veteran's health systems. They provide a flexible framework to create mind-body family empowerment programs and describe important issues that program developers and evaluators are encouraged to address to ensure the development of the most impactful, successful, evidence-supported programs possible. Copyright © 2016 Elsevier Inc. All rights reserved.

Harvard Project Physics Research and Evaluation Bibliography.

ERIC Educational Resources Information Center

Welch, Wayne W.

The articles listed were written as part of the research and evaluation program of Project Physics. Many articles are concerned with problems of educational research while others are devoted directly to the evaluation of Project Physics. The articles are listed in four categories according to the availability of reprints: (1) published articles…

77 FR 59930 - Clinical Development Programs for Disease-Modifying Agents for Peripheral Neuropathy; Public...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-01

... for comments. SUMMARY: The Food and Drug Administration (FDA), Center for Drug Evaluation and Research... Contacts: Randi Clark, Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New..., Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New Hampshire Ave., Silver...

The Floating Lab Research Project: An Approach to Evaluating Field Programs.

ERIC Educational Resources Information Center

Brody, Michael J.

This report explains an evaluative study of the conceptual and affective development of students associated with the Floating Lab Program, an experiential field project sponsored by the University of New Hampshire and the Maine Sea Grant Program. The field program involved an opportunity for students to have hands-on experiences aboard a 65-foot…

78 FR 26372 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-06

... Profession Opportunity Grants (HPOG) program. ACF has developed a multi-pronged research and evaluation... Opportunity Grants (HPOG-Impact). Two data collection efforts related to HPOG research were approved by OMB... collect data about the HPOG program designs and implementation, HPOG partner and program networks and...

Family intervention in Indigenous communities: emergent issues in conducting outcome research.

PubMed

Turner, Karen; Sanders, Matthew

2007-01-01

Indigenous children and youth are at greater risk of emotional and behavioural problems than non-Indigenous youth, with family life stresses and parenting style identified as common risk factors. There is substantial evidence that parenting programs can improve family relationships and improve child outcomes, however little research has focused on Indigenous communities. Our team is conducting research to evaluate a culturally sensitive adaptation of a mainstream intervention, the Group Triple P---Positive Parenting Program, for Indigenous families. This paper shares some of the insights into research and clinical issues gained as non-Indigenous researchers working with urban, rural and remote Indigenous communities. The experience of the research team and feedback from practitioners and parents have been drawn on for this discussion. Parenting programs need to be sensitive to the political and cultural context in which parenting takes place, flexibly incorporate cultural practices and expectations, and develop an evidence base of outcomes for families in diverse communities. As research is needed to evaluate the acceptability and effectiveness of these programs, culturally sensitive research practices are also necessary and the value of program evaluation and its benefit to the community must be clear. Community acceptance of the research process and the intervention itself is vital and may be influenced by community perceptions, current priorities, and local issues. If our overall aim is to increase the skilled health and mental health workforce in Indigenous communities and their use of evidence-based interventions, ongoing collaborative relationships between research institutions and service providers will serve to further this aim.

Can Local Voluntary Environmental Programs "Work"? An Examination of Fort Collins' (Colorado) Climate Wise Program

NASA Astrophysics Data System (ADS)

Samantha, Mosier; Jonathan, Fisk

2013-05-01

Previous research on voluntary environmental programs (VEPs) frequently assesses the effectiveness of federal, state, and third party programs and why organizations seek to join such programs. Yet, research has yet to evaluate the effectiveness or firm motivation relative to local VEPs. Recognizing this gap, our paper examines the structure and organization of Fort Collins' Climate Wise program, a local VEP. Using a variety of sources, we find that the program has successfully met both short- and long-term goals by persistently self-evaluating and seeking outside financial support. Findings from this analysis can aid in understanding and developing local VEPs elsewhere. Specifically, this initial research suggests that local VEPs need to consider local context and available resources when implementing such programs. Furthermore, it is possible for local VEPs to attract a diverse variety of participating firms by avoiding one-size-fits-all participation levels and by establishing a sense of ownership among partners.

Can local voluntary environmental programs "work"? An examination of Fort Collins' (Colorado) climate wise program.

PubMed

Mosier, Samantha; Samantha, Mosier; Fisk, Jonathan; Jonathan, Fisk

2013-05-01

Previous research on voluntary environmental programs (VEPs) frequently assesses the effectiveness of federal, state, and third party programs and why organizations seek to join such programs. Yet, research has yet to evaluate the effectiveness or firm motivation relative to local VEPs. Recognizing this gap, our paper examines the structure and organization of Fort Collins' Climate Wise program, a local VEP. Using a variety of sources, we find that the program has successfully met both short- and long-term goals by persistently self-evaluating and seeking outside financial support. Findings from this analysis can aid in understanding and developing local VEPs elsewhere. Specifically, this initial research suggests that local VEPs need to consider local context and available resources when implementing such programs. Furthermore, it is possible for local VEPs to attract a diverse variety of participating firms by avoiding one-size-fits-all participation levels and by establishing a sense of ownership among partners.

Enhancing diversity in the public health research workforce: the research and mentorship program for future HIV vaccine scientists.

PubMed

Sopher, Carrie J; Adamson, Blythe Jane S; Andrasik, Michele P; Flood, Danna M; Wakefield, Steven F; Stoff, David M; Cook, Ryan S; Kublin, James G; Fuchs, Jonathan D

2015-04-01

We developed and evaluated a novel National Institutes of Health-sponsored Research and Mentorship Program for African American and Hispanic medical students embedded within the international, multisite HIV Vaccine Trials Network, and explored its impact on scientific knowledge, acquired skills, and future career plans. Scholars conducted social, behavioral, clinical, or laboratory-based research projects with HIV Vaccine Trials Network investigators over 8 to 16 weeks (track 1) or 9 to 12 months (track 2). We conducted an in-depth, mixed-methods evaluation of the first 2 cohorts (2011-2013) to identify program strengths, areas for improvement, and influence on professional development. A pre-post program assessment demonstrated increases in self-reported knowledge, professional skills, and interest in future HIV vaccine research. During in-depth interviews, scholars reported that a supportive, centrally administered program; available funding; and highly involved mentors and staff were keys to the program's early success. A multicomponent, mentored research experience that engages medical students from underrepresented communities and is organized within a clinical trials network may expand the pool of diverse public health scientists. Efforts to sustain scholar interest over time and track career trajectories are warranted.

Evaluation of Nuclear Facility Decommissioning Projects program: a reference research reactor. Project summary report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Baumann, B.L.; Miller, R.L.

1983-10-01

This document presents, in summary form, generic conceptual information relevant to the decommissioning of a reference research reactor (RRR). All of the data presented were extracted from NUREG/CR-1756 and arranged in a form that will provide a basis for future comparison studies for the Evaluation of Nuclear Facility Decommissioning Projects (ENFDP) program.

SBIR and STTR Program for Assistive Technology Device Development: Evaluation of Impact Using an ICF-Based Classification

ERIC Educational Resources Information Center

Bauer, Stephen M.; Arthanat, Sajay

2010-01-01

The purpose of this paper was to evaluate the impact of Small Business Innovation Research (SBIR) and Small Business Technology Transfer Research (STTR) grant programs of 5 federal agencies National Institutes of Health (NIH), National Science Foundation (NSF), U.S. Department of Education (USDE), U.S. Department of Agriculture (USDA), and…

The Evaluation of a Clinical Development Unit Leadership Preparation Program by Focus Group Interviews--Part I: Positive Aspects. Part II: Negative Aspects.

ERIC Educational Resources Information Center

Greenwood, Jennifer; Parsons, Myra

2002-01-01

Focus group evaluations of a training program for nurses leading clinical development units focused on research-based practice found that leadership and strategic skills were developed. However, participants had insufficient time to assimilate knowledge or develop mentoring relationships and needed more help developing research-receptive culture…

Evaluation of a Health Professionals' Training Program to Conduct Research in New York City's Asian American Community

ERIC Educational Resources Information Center

Zhang, Pao San Lucy; Sim, Shao-Chee; Pong, Perry; Islam, Nadia; Trinh-Shevrin, Chau; Li, Shijian; Tsang, Thomas; Rey, Mariano

2014-01-01

Background: Because health disparities among Asian Americans are understudied, a partnership program between the Charles B. Wang Community Health Center and the Center for the Study of Asian American Health was created to increase awareness and interest in Asian American research. Purpose: To evaluate the process, outcome, and impact of a health…

NASA Human Research Program (HRP). International Space Station Medical Project (ISSMP)

NASA Technical Reports Server (NTRS)

Sams, Clarence F.

2009-01-01

This viewgraph presentation describes the various flight investigations performed on the International Space Station as part of the NASA Human Research Program (HRP). The evaluations include: 1) Stability; 2) Periodic Fitness Evaluation with Oxygen Uptake Measurement; 3) Nutrition; 4) CCISS; 5) Sleep; 6) Braslet; 7) Integrated Immune; 8) Epstein Barr; 9) Biophosphonates; 10) Integrated cardiovascular; and 11) VO2 max.

Lights, Camera, Action: Advancing Learning, Research, and Program Evaluation through Video Production in Educational Leadership Preparation

ERIC Educational Resources Information Center

Friend, Jennifer; Militello, Matthew

2015-01-01

This article analyzes specific uses of digital video production in the field of educational leadership preparation, advancing a three-part framework that includes the use of video in (a) teaching and learning, (b) research methods, and (c) program evaluation and service to the profession. The first category within the framework examines videos…

Multicomponent Programs for Reducing Peer Victimization in Early Elementary School: A Longitudinal Evaluation of the WITS Primary Program

ERIC Educational Resources Information Center

Leadbeater, Bonnie; Sukhawathanakul, Paweena

2011-01-01

Past research demonstrates the promise of multicomponent programs in reducing peer victimization and bullying in older elementary and middle school children, however little research focuses on young children. The current study examines the effectiveness of the WITS Primary program on trajectories of victimization and social responsibility in…

Parents Making a Difference: International Research on the Home Instruction for Parents of Preschool Youngsters (HIPPY) Program.

ERIC Educational Resources Information Center

Westheimer, Miriam, Ed.

Begun in Israel in 1960, the HIPPY (Home Instruction for Parents of Preschool Youngsters) program is a family support, parent-focused, early childhood literacy program. This book compiles 17 evaluation studies of the program, from researchers and practitioners in 7 countries. The studies are organized around five themes: exploring theoretical…

Administration, Best Practices, and Evaluation of the National Weather Center REU Program

NASA Astrophysics Data System (ADS)

Zaras, D. S.; Gonzalez-Espada, W.

2005-12-01

The National Weather Center Research Experiences for Undergraduates program in Norman, Oklahoma, is a unique undergraduate career exploration experience, drawing upon the resources available in the National Weather Center's (NWC) state, federal, and university groups. This program takes full advantage of our location by including a wide variety of professionals from throughout the NWC community as mentors and contributors of lectures, workshops, tours, field trips, and job shadow experiences to expose the students to a broad spectrum of research topics and careers in meteorology. Students actively practice good research methodology by being paired with mentors who are productive researchers. The program aims to provide a strong and transformative educational experience that models the life of a scientist. This presentation will include a brief overview of program administration, analysis of applicant characteristics, "best practices" learned since 2001, and new additions to the NWC program funded through a 2-Year Extension for Special Creativity. The presentation will conclude with a brief evaluation of how well the program meets its goals of helping students clarify graduate school and career plans, and build self-efficacy regarding their potential for a career in scientific research.

38 CFR 1.15 - Standards for program evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... decisions. (4) Reliability. Use of the same research design by others should yield the same findings. (g...

Evaluation in the Context of the Government Market Place: Implications for the Evaluation of Research

ERIC Educational Resources Information Center

Della-Piana, Connie Kubo; Della-Piana, Gabriel M.

2007-01-01

While the current debate in the evaluation community has concentrated on examining and explicating implications of the choice of methods for evaluating federal programs, the authors of this paper address the challenges faced by the government in the selection of funding mechanisms for supporting program evaluation efforts. The choice of funding…

2012 Wind Program Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zayas, Jose; Higgins, Mark

2012-06-01

This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

Components of a Comprehensive Market Research Program for Commuter Colleges.

ERIC Educational Resources Information Center

Clagett, Cragi

1999-01-01

Describes and evaluates eight elements of a comprehensive market-research program for commuter colleges: secondary research with formal environmental scanning, local business community-needs assessment; adult community-member telephone survey, classroom survey, new student survey, focus groups, brainstorming sessions, and survey of college…

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

The State of the Empirical Research Literature on Stakeholder Involvement in Program Evaluation

ERIC Educational Resources Information Center

Brandon, Paul R.; Fukunaga, Landry L.

2014-01-01

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2013 CFR

2013-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2014 CFR

2014-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2012 CFR

2012-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2011 CFR

2011-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2010 CFR

2010-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...

Simulation for Nurse Anesthesia Program Selection: Redesigned

ERIC Educational Resources Information Center

Roebuck, John Arthur

2017-01-01

Purpose: This project is meant to answer the research question: What applicant character traits do Nurse Anesthesia Program Directors and Faculty identify as favorable predictors for successful completion of a nurse anesthesia program, and what evaluation methods are best to evaluate these traits in prospective students? Methods: A prospective…

7 CFR 1486.209 - How are program applications evaluated and approved?

Code of Federal Regulations, 2011 CFR

2011-01-01

... or new uses. Examples include food service development, market research on potential for consumer... MARKETS PROGRAM Eligibility, Applications, and Funding § 1486.209 How are program applications evaluated... affecting the level of U.S. exports and market share for the agricultural commodity/product; (4) The degree...

Career Development in Language Education Programs

ERIC Educational Resources Information Center

Shawer, Saad Fathy; Alkahtani, Saad Ali

2013-01-01

This study assesses the influence of a two-year language program evaluation on program directors and faculty career development. The study makes use of mixed-paradigms (positivism and qualitative interpretive), mixed-strategies (survey research and qualitative evaluation), one-way analysis of variance (ANOVA) and a post-hoc test of multiple…

Evaluating a Psychology Graduate Student Peer Mentoring Program

ERIC Educational Resources Information Center

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

CAI Programs and Macros for Formative Curriculum Evaluation.

ERIC Educational Resources Information Center

Dasenbrock, David; Teates, Thomas

This technical memo is designed for persons who are interested in research with and development of curriculum material. Detailed information regarding computer programs, and program documentation used in the development and evaluation of ISCS curriculum materials is provided. The memo includes supplemental information to ISCS Technical Report I…

Evaluation of Children's After-School Programs in Taiwan: FAHP Approach

ERIC Educational Resources Information Center

Lee, Amy H. I.; Yang, Chih-Neng; Lin, Chun-Yu

2012-01-01

The need of after-school programs has become urgent for school-age children in many industrialized countries due to social structure changes. This research develops a hierarchical framework to evaluate after-school programs from two distinct aspects--service quality from parents' perspectives and marketing strategy from operators'…

Methodological and Design Considerations in Evaluating the Impact of Prevention Programs on Violence and Related Health Outcomes.

PubMed

Massetti, Greta M; Simon, Thomas R; Smith, Deborah Gorman

2016-10-01

Drawing on research that has identified specific predictors and trajectories of risk for violence and related negative outcomes, a multitude of small- and large-scale preventive interventions for specific risk behaviors have been developed, implemented, and evaluated. One of the principal challenges of these approaches is that a number of separate problem-specific programs targeting different risk areas have emerged. However, as many negative health behaviors such as substance abuse and violence share a multitude of risk factors, many programs target identical risk factors. There are opportunities to understand whether evidence-based programs can be leveraged for potential effects across a spectrum of outcomes and over time. Some recent work has documented longitudinal effects of evidence-based interventions on generalized outcomes. This work has potential for advancing our understanding of the effectiveness of promising and evidence-based prevention strategies. However, conducting longitudinal follow-up of established interventions presents a number of methodological and design challenges. To answer some of these questions, the Centers for Disease Control and Prevention convened a panel of multidisciplinary experts to discuss opportunities to take advantage of evaluations of early prevention programs and evaluating multiple long-term outcomes. This special section of the journal Prevention Science includes a series of papers that begin to address the relevant considerations for conducting longitudinal follow-up evaluation research. This collection of papers is intended to inform our understanding of the challenges and strategies for conducting longitudinal follow-up evaluation research that could be used to drive future research endeavors.

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

PubMed

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

An update of engine system research at the Army Propulsion Directorate

NASA Technical Reports Server (NTRS)

Bobula, George A.

1990-01-01

The Small Turboshaft Engine Research (STER) program provides a vehicle for evaluating the application of emerging technologies to Army turboshaft engine systems and to investigate related phenomena. Capitalizing on the resources at hand, in the form of both the NASA facilities and the Army personnel, the program goal of developing a physical understanding of engine system dynamics and/or system interactions is being realized. STER entries investigate concepts and components developed both in-house and out-of-house. Emphasis is placed upon evaluations which evolved from on-going basic research and advanced development programs. Army aviation program managers are also encouraged to make use of STER resources, both people and facilities. The STER personnel have established their reputations as experts in the fields of engine system experimental evaluations and engine system related phenomena. The STER facility has STER program provides the Army aviation community the opportunity to perform system level investigations, and then to offer the findings to the entire engine community for their consideration in next generation propulsion systems. In this way results of the fundamental research being conducted to meet small turboshaft engine technology challenges expeditiously find their way into that next generation of propulsion systems.

Approaches for Evaluating the NRC Resident Research Associateship Program at NIST

ERIC Educational Resources Information Center

Sislin, John, Ed.

2007-01-01

The NRC Resident Research Associateship Program at NIST provides two-year temporary appointments for outstanding scientists and engineers. This book describes program applicants and awardees and offers suggestions for an in-depth assessment of career outcomes. Preliminary investigation indicates that outreach efforts produce more qualified…

77 FR 62518 - Proposed Collection; Comment Request: Recipient Epidemiology and Donor Evaluation Study-III (REDS...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-15

..., translational, and clinical research to improve the benefits of transfusion while reducing its risks. The... Institute (NHLBI) REDS programs have proven to be the premier research programs in blood collection and... successes that this research network has realized over the years while being responsive to changing research...

Action Research: Its Origins and Early Application.

ERIC Educational Resources Information Center

Cook, Stuart W.

This paper contains informal remarks on action research in social psychology from its post World War II origins to its current status. Kurt Lewin first described action research in the 1946 article, "Action Research and Minority Problems," as a three-step process of program planning, program execution, and follow-up evaluation. Ronald Lippitt and…

Evaluating Behaviorally Oriented Aviation Maintenance Resource Management (MRM) Training and Programs: Methods, Results, and Conclusions

NASA Technical Reports Server (NTRS)

Taylor, James C.; Thomas, Robert L., III

2003-01-01

Assessment of the impact of Aviation Resource Management Programs on aviation culture and performance has compelled a considerable body of research (Taylor & Robertson, 1995; Taylor, 1998; Taylor & Patankar, 2001). In recent years new methods have been applied to the problem of maintenance error precipitated by factors such as the need for self-assessment of communication and trust. The present study - 2002 -- is an extension of that past work. This research project was designed as the conclusion of a larger effort to help understand, evaluate and validate the impact of Maintenance Resource Management (MRM) training programs, and other MRM interventions on participant attitudes, opinions, behaviors, and ultimately on enhanced safety performance. It includes research and development of evaluation methodology as well as examination of psychological constructs and correlates of maintainer performance. In particular, during 2002, three issues were addressed. First, the evaluation of two (independent & different) MRM programs for changing behaviors was undertaken. In one case we were able to further apply the approach to measuring written communication developed during 2001 (Taylor, 2002; Taylor & Thomas, 2003). Second, the MRM/TOQ surveys were made available for completion on the internet. The responses from these on-line surveys were automatically linked to a results calculator (like the one developed and described in Taylor, 2002) to aid industry users in analyzing and evaluating their local survey data on the internet. Third, the main trends and themes from our research about MRM programs over the past dozen years were reviewed.

Evaluation of funding gastroenterology research in Canada illustrates the beneficial role of partnerships

PubMed Central

Sherman, Philip M; Hart, Kimberly Banks; Rose, Keeley; Bosompra, Kwadwo; Manuel, Christopher; Belanger, Paul; Daniels, Sandra; Sinclair, Paul; Vanner, Stephen; Buret, André G

2013-01-01

BACKGROUND: Funders of health research in Canada seek to determine how their funding programs impact research capacity and knowledge creation. OBJECTIVE: To evaluate the impact of a focused grants and award program that was cofunded by the Canadian Institutes of Health Research Institute of Nutrition, Metabolism and Diabetes, and the Canadian Association of Gastroenterology; and to measure the impact of the Program on the career paths of funded researchers and assess the outcomes of research supported through the Program. METHODS: A survey of the recipients of grants and awards from 2000 to 2008 was conducted in 2012. The CIHR Funding Decisions database was searched to determine subsequent funding; a bibliometric citation analysis of publications arising from the Program was performed. RESULTS: Of 160 grant and award recipients, 147 (92%) completed the survey. With >$17.4 million in research funding, support was provided for 131 fellowship awards, seven career transition awards, and 22 operating grants. More than three-quarters of grant and award recipients continue to work or train in a research-related position. Combined research outputs included 545 research articles, 130 review articles, 33 book chapters and 11 patents. Comparative analyses indicate that publications supported by the funding program had a greater impact than other Canadian and international comparators. CONCLUSIONS: Continuity in support of a long-term health research funding partnership strengthened the career development of gastroenterology researchers in Canada, and enhanced the creation and dissemination of new knowledge in the discipline. PMID:24340317

A participatory approach to evaluating a national training and institutional change initiative: the BUILD longitudinal evaluation.

PubMed

Davidson, Pamela L; Maccalla, Nicole M G; Afifi, Abdelmonem A; Guerrero, Lourdes; Nakazono, Terry T; Zhong, Shujin; Wallace, Steven P

2017-01-01

The National Institutes of Health (NIH) funds training programs to increase the numbers and skills of scientists who obtain NIH research grants, but few programs have been rigorously evaluated. The sizeable recent NIH investment in developing programs to increase the diversity of the NIH-funded workforce, implemented through the Diversity Program Consortium (DPC), is unusual in that it also funds a Consortium-wide evaluation plan, which spans the activities of the 10 BUilding Infrastructure Leading to Diversity (BUILD) awardees and the National Research Mentoring Network (NRMN). The purpose of this article is to describe the evaluation design and innovations of the BUILD Program on students, faculty, and institutions of the 10 primarily undergraduate BUILD sites. Our approach to this multi-methods quasi-experimental longitudinal evaluation emphasizes stakeholder participation and collaboration. The evaluation plan specifies the major evaluation questions and key short- to long-term outcome measures (or Hallmarks of Success). The Coordination and Evaluation Center (CEC) embarked on a comprehensive evaluation strategy by developing a set of logic models that incorporate the Hallmarks of Success and other outcomes that were collaboratively identified by the DPC. Data were collected from each BUILD site through national surveys from the Higher Education Research Institute at UCLA (HERI), annual followup surveys that align with the HERI instruments, site visits and case studies, program encounter data ("tracker" data), and institutional data. The analytic approach involves comparing changes in Hallmarks (key outcomes) within institutions for biomedical students who participated versus those who did not participate in the BUILD program at each institution, as well as between institution patterns of biomedical students at the BUILD sites, and matched institutions that were not BUILD grantees. Case studies provide insights into the institutionalization of these new programs and help to explain the processes that lead to the observed outcomes. Ultimately, the results of the consortium-wide evaluation will be used to inform national policy in higher education and will provide relevant examples of institutional and educational programmatic changes required to diversify the biomedical workforce in the USA.

Compendium of Traffic Safety Research Projects 1985-2013.

DOT National Transportation Integrated Search

2014-01-01

Through many name changes, from the Office of Program Development and Evaluation, the Office of Research and Evaluation, to the current, Office of Behavioral Safety Research, our focus has remained on improving the safety of drivers, occupants, pedes...

3 CFR - Expanding America's Leadership in Wireless Innovation

Code of Federal Regulations, 2014 CFR

2014-01-01

... results from the Networking and Information Technology Research and Development Program, shall publish an... in research, development, testing, and evaluation of technologies to enhance spectrum sharing and... templates governing the following: research, development, testing, and evaluation of spectrum sharing...

Developing a framework for assessing responsible conduct of research education programs.

PubMed

Olson, Lynne E

2010-03-01

Education in the responsible conduct of research (RCR) in the United States has evolved over the past decade from targeting trainees to including educational efforts aimed at faculty and staff. In addition RCR education has become more focused as federal agencies have moved to recommend specific content and to mandate education in certain areas. RCR education has therefore become a research-compliance issue necessitating the development of policies and the commitment of resources to develop or expand systems for educating faculty and staff and for assuring compliance. These changes implied the need to develop a program evaluation model that could be applied to institutional RCR education programs, which were expected to differ from traditional academic credit-bearing courses targeting trainees. Information gleaned from the examination of corporate compliance models was analyzed in order to create a program evaluation module that could be used to document and assess educational programs focused on teaching RCR. A programmed series of questions for each of the nine RCR content areas identified by the United States Office of Research Integrity was created based on a performance-monitoring evaluation model. The questions focus on educational goals, resources provided to support the educational efforts, educational content, content delivery, educational outcomes, compliance requirements and feedback. Answers collected in response to the questions could be used to both document and continually improve the quality of RCR educational programs through on-going formative assessment and feedback.

AHRQ series paper 3: identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the effective health-care program.

PubMed

Whitlock, Evelyn P; Lopez, Sarah A; Chang, Stephanie; Helfand, Mark; Eder, Michelle; Floyd, Nicole

2010-05-01

This article discusses the identification, selection, and refinement of topics for comparative effectiveness systematic reviews within the Agency for Healthcare Research and Quality's Effective Health Care (EHC) program. The EHC program seeks to align its research topic selection with the overall goals of the program, impartially and consistently apply predefined criteria to potential topics, involve stakeholders to identify high-priority topics, be transparent and accountable, and continually evaluate and improve processes. A topic prioritization group representing stakeholder and scientific perspectives evaluates topic nominations that fit within the EHC program (are "appropriate") to determine how "important" topics are as considered against seven criteria. The group then judges whether a new comparative effectiveness systematic review would be a duplication of existing research syntheses, and if not duplicative, if there is adequate type and volume of research to conduct a new systematic review. Finally, the group considers the "potential value and impact" of a comparative effectiveness systematic review. As the EHC program develops, ongoing challenges include ensuring the program addresses truly unmet needs for synthesized research because national and international efforts in this arena are uncoordinated, as well as engaging a range of stakeholders in program decisions while also achieving efficiency and timeliness.

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 30 Mineral Resources 2 2010-07-01 2010-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 30 Mineral Resources 2 2014-07-01 2014-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 30 Mineral Resources 2 2013-07-01 2013-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 30 Mineral Resources 2 2012-07-01 2012-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

30 CFR 402.12 - Evaluation of applications for grants and contracts.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 30 Mineral Resources 2 2011-07-01 2011-07-01 false Evaluation of applications for grants and contracts. 402.12 Section 402.12 Mineral Resources GEOLOGICAL SURVEY, DEPARTMENT OF THE INTERIOR WATER-RESOURCES RESEARCH PROGRAM AND THE WATER-RESOURCES TECHNOLOGY DEVELOPMENT PROGRAM Application, Evaluation...

A system for evaluating the use of media in CDC's National AIDS Information and Education Program.

PubMed

Salmon, C T; Jason, J

1991-01-01

The National AIDS Information and Education Program (NAIEP) commissioned the National Academy of Sciences to design a prototypical system of research for use in the evaluation of the agency's media campaign. It consists of four types of evaluation: formative, efficacy, process, and outcome. These types of evaluations are used to answer such questions as the following: What message strategies will work best? Can a campaign under optimal conditions be expected to make a difference? What interventions are actually delivered during the campaign? Has the campaign actually had an impact? How NAIEP has used the system and adapted it during 1 year of research activities is outlined, and examples from a variety of other social marketing programs are described.

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

ERIC Educational Resources Information Center

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Definition of Life Sciences laboratories for shuttle/Spacelab. Volume 1: Executive summary

NASA Technical Reports Server (NTRS)

1975-01-01

Research requirements and the laboratories needed to support a Life Sciences research program during the shuttle/Spacelab era were investigated. A common operational research equipment inventory was developed to support a comprehensive but flexible Life Sciences program. Candidate laboratories and operational schedules were defined and evaluated in terms of accomodation with the Spacelab and overall program planning. Results provide a firm foundation for the initiation of a life science program for the shuttle era.

77 FR 74483 - Proposed Data Collections Submitted for Public Comment and Recommendations

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-14

... outcomes- oriented health promotion and disease prevention research on a broad range of topics using a... days of this notice. Proposed Project Prevention Research Centers Program National Evaluation Reporting... Description The Prevention Research Centers (PRC) Program was established by Congress through the Health...

75 FR 18503 - Agency Forms Undergoing Paperwork Reduction Act Review

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-12

... promotion and disease prevention research on a broad range of topics using a multi- disciplinary and... Project Prevention Research Centers Program National Evaluation Reporting System (OMB No. 0920-0650 exp. 8... Brief Description The Prevention Research Centers (PRC) Program was established by Congress through the...

SEWER-SEDIMENT CONTROL: OVERVIEW OF AN EPA WET-WEATHER FLOW RESEARCH PROGRAM

EPA Science Inventory

This paper presents a historical overview of the sewer sediment control projects conducted by the Wet-Weather Flow Research Program of the USEPA. Research presented includes studies of the causes of sewer solids deposition and development/evaluation of control methods that can pr...

GWERD CAFO Research Program – CAFO Impacts on Ground Water Quality

EPA Science Inventory

An overview of several projects will be presented on a research program currently underway at ORD’s Ground Water and Ecosystems Restoration Division (GWERD) to evaluate CAFO impacts on ground water quality. The overall research objectives are to characterize the potential for gro...

A Snapshot of OST Programs in Philadelphia: An Evaluation of Eleven 21st Century Community Learning Center Grantees

ERIC Educational Resources Information Center

Gao, Jian; Hallar, Brittan; Hartmann, Tracey A.

2014-01-01

This report examines the 21st Century Community Learning Center (CCLC) programs evaluated by Research for Action (RFA) and presents an aggregate analysis of key findings to inform broader discussions about OST programs. The report addresses the following questions: (1) Who participated in the 21st CCLC programs and how frequently did they…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

7 CFR 3406.19 - Proposal review-research.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 15 2013-01-01 2013-01-01 false Proposal review-research. 3406.19 Section 3406.19... AGRICULTURE 1890 INSTITUTION CAPACITY BUILDING GRANTS PROGRAM Review and Evaluation of a Research Proposal § 3406.19 Proposal review—research. The proposal evaluation process includes both internal staff review...

7 CFR 3406.19 - Proposal review-research.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 15 2012-01-01 2012-01-01 false Proposal review-research. 3406.19 Section 3406.19... AGRICULTURE 1890 INSTITUTION CAPACITY BUILDING GRANTS PROGRAM Review and Evaluation of a Research Proposal § 3406.19 Proposal review—research. The proposal evaluation process includes both internal staff review...

7 CFR 3406.19 - Proposal review-research.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Proposal review-research. 3406.19 Section 3406.19... AGRICULTURE 1890 INSTITUTION CAPACITY BUILDING GRANTS PROGRAM Review and Evaluation of a Research Proposal § 3406.19 Proposal review—research. The proposal evaluation process includes both internal staff review...

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

PubMed

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.

Adolescent asthma education programs for teens: review and summary.

PubMed

Srof, Brenda; Taboas, Peggy; Velsor-Friedrich, Barbara

2012-01-01

The purpose of this review is to describe and evaluate education programs for teens with asthma. Although asthma educational programs for children are plentiful, this is not the case for adolescents. The developmental tasks of adolescence require asthma education programs that are uniquely tailored to this age group. Although several well-designed studies appear in the literature, further research is needed to evaluate the efficacy of asthma education programs among teens. Although the quality of research varies, demonstrated program benefits include improved asthma self-management, self-efficacy, family support mechanisms, and quality of life. Practice implications point to the need for education programs in schools and camp settings that are consistent with national asthma guidelines. Copyright © 2012 National Association of Pediatric Nurse Practitioners. Published by Mosby, Inc. All rights reserved.

Methods for Evaluating Mammography Imaging Techniques

DTIC Science & Technology

1999-06-01

Distribution Unlimited 12b. DIS5TRIBUTION CODE 13. ABSTRACT (Maximum 200 words) This Department of Defense Breast Cancer Research Program Career...Development Award is enabling Dr. Rütter to develop bio’statistical methods for breast cancer research. Dr. Rutter is focusing on methods for...evaluating the accuracy of breast cancer screening. This four year program includes advanced training in the epidemiology of breast cancer , training in

A Review and Evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of Phase VI-The Technical Report: A Survey and Analysis.

ERIC Educational Resources Information Center

McCullough, Robert A.; And Others

This report presents the results of a review and evaluation of the Langley Research Center's scientific and technical information program, which examined technical reports from various institutions and organizations to determine the organization of reports, the language used to convey information, and the methods used to present information.…

Analyzing the Curricula of Doctor of Philosophy in Educational Technology-Related Programs in the United States

ERIC Educational Resources Information Center

Almaden, Abdullah; Ku, Heng-Yu

2017-01-01

The purpose of this study was to analyze on-campus and online PhD programs in educational technology-related fields in the United States. In particular, it sought to evaluate the most common program titles; core, elective, and research courses based on program curricula. The research design was quantitative content analysis and data were collected…

Incarcerated women develop a nutrition and fitness program: participatory research.

PubMed

Elwood Martin, Ruth; Adamson, Sue; Korchinski, Mo; Granger-Brown, Alison; R Ramsden, Vivian; A Buxton, Jane; Espinoza-Magana, Nancy; L Pollock, Sue; J F Smith, Megan; C Macaulay, Ann; Lisa Condello, Lara; Gregory Hislop, T

2013-01-01

Women in prison throughout the world experience higher rates of mental and physical illness compared with the general population and compared with men in prison. The paper finds no published studies that report on men or women in prison engaging in participatory health research to address their concerns about nutrition and fitness. The purpose of this paper is to describe a pilot nutrition and fitness program, which resulted from a unique prison participatory health research project. Women in prison designed, led, and evaluated a six-week pilot fitness program in a minimum/medium security women's prison. Pre- and post-program assessments included a self-administered questionnaire and body measures. Open-ended questionnaire responses illuminated the quantitative findings. Sixteen women in prison completed the program evaluation. Weight, body mass index, waist-to-hip ratio, and chest measurements decreased, and energy, sleep, and stress levels improved by the end of the program. As a component of a participatory research project, incarcerated women designed and led a nutrition and fitness program, which resulted in improved body measures and self-reported health benefits. ORIGINALITY VALUE: Incarceration provides opportunities to engage women in designing their own health programs with consequent potential long-term "healing" benefits.

MRM Evaluation Research Program

NASA Technical Reports Server (NTRS)

Taylor, James C.

1998-01-01

This is an interim report on the current output of the MRM evaluation research program. During 1998 this research program has used new and existing data to create an important tool for the development and improvement of "maintenance resource management" (MRM). Thousands of surveys completed by participants in airline MRM training and/or behavior change programs have, for the first time, been consolidated into a panel of "MRM Attitudes and Opinion Profiles." These profiles can be used to compare the attitudes about decision making and communication in any given company at any stage in its MRM program with attitudes of a large sample of like employees during a similar period in their MRM involvement. This panel of comparison profiles for attitudes and opinions is a tool to help audit the effectiveness of a maintenance human factors program. The profile panel is the first of several tools envisioned for applying the information accumulating in MRM databases produced as one of the program's long range objectives.

Student Perceptions of an Online Medical Dosimetry Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lenards, Nishele, E-mail: lenards.nish@uwlax.ed

2011-07-01

The University of Wisconsin-La Crosse offers the first online medical dosimetry program in the nation. There is no data to research a program of this type. This research consisted of the evaluation of other distance education programs including health profession programs in addition to face-to-face medical dosimetry programs. There was a need to collect and analyze student perceptions of online learning in medical dosimetry. This research provided a guide for future implementation by other programs as well as validated the University of Wisconsin-La Crosse program. Methodology used consisted of an electronic survey sent to all previous and currently enrolled studentsmore » in the University of Wisconsin-La Crosse medical dosimetry program. The survey was both quantitative and qualitative in demonstrating attitudinal perceptions of students in the program. Quantitative data was collected and analyzed using a 5-point Likert scale. Qualitative data was gathered based on the open-ended responses and the identifying themes from the responses. The results demonstrated an overall satisfaction with this program, the instructor, and the online courses. Students felt a sense of belonging to the courses and the program. Considering that a majority of the students had never taken an online course previously, the students felt there were no technology issues. Future research should include an evaluation of board exam statistics for students enrolled in the online and face-to-face medical dosimetry programs.« less

GREEN INFRASTRUCTURE RESEARCH PROGRAM: Rain Gardens

EPA Science Inventory

the National Risk Management Research Laboratory (NRMRL) rain garden evaluation is part of a larger collection of long-term research that evaluates a variety of stormwater management practices. The U.S. EPA recognizes the potential of rain gardens as a green infrastructure manag...

NHTSA's behavioral safety research: updated, annotated bibliography, 1985-2013 : traffic tech.

DOT National Transportation Integrated Search

2014-01-01

Through many name changes, from the Office of Program : Development and Evaluation, the Office of Research and : Evaluation, to the current Office of Behavioral Safety Research, : our focus has remained on improving the safety of drivers, : occupants...

Evaluating scholarship productivity in COAMFTE-accredited PhD programs.

PubMed

Jared DuPree, W; White, Mark B; Meredith, William H; Ruddick, Lindsay; Anderson, Michael P

2009-04-01

Due to an increasing trend among states to cut higher education funds, many universities are relying more on private donations and federal funding to keep programs afloat. Scholarship productivity in general has become an integral factor in terms of universities granting tenure to faculty, allocating resources, and supporting program goals due to the fact that more research in a particular area tends to increase the likelihood that one will obtain funding from federal, state, and private sources. In the past, ranking systems have also been used to evaluate programs. However, most ranking systems use methodologies that do not quantify research productivity or evaluate factors that match current university trends. The purpose of this article is to explore current scholarship productivity trends among COAMFTE-accredited doctoral programs through the use of several evaluation methods. Specifically, productivity was examined in regard to the following areas: (a) family therapy journal publications; (b) family science journal publications; (c) historic journal publication trends; and (d) recent journal publication trends.

MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES.

PubMed

Semple, Randye J; Droutman, Vita; Reid, Brittany Ann

2017-01-01

Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment , and Wellness and Resilience Program . We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations.

MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES

PubMed Central

Semple, Randye J.; Droutman, Vita; Reid, Brittany Ann

2016-01-01

Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment, and Wellness and Resilience Program. We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations. PMID:28458403

Developing a Successful High School Science Research Program via Teacher Training, Student Internships, and Community Support

NASA Astrophysics Data System (ADS)

Danch, J. M.; Darytichen, F.

2004-12-01

The purpose of the Science Research Program is to allow students to perform authentic scientific research in disciplines of their choosing over a period of 3 years. The success of the program has allowed for expansion including community involvement, student mentorship, and a series of professional development programs. Through state and national competition and community symposia, student research is evaluated, showcased, and subsequently supported both idealistically and financially by local government and industrial partnerships. Student internships and university/industrial mentorship programs allow students to pursue research topics and utilize equipment exceeding the scope of the secondary science classroom. Involved teachers have developed and delivered professional development workshops to foster the successful implementation of scientific research programs at additional high schools throughout the state.

Traffic Control Device Evaluation Program : FY 2017

DOT National Transportation Integrated Search

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Flight Evaluation of LORAN-C in the State of Vermont

DOT National Transportation Integrated Search

1981-09-01

The Transportation Systems Center, Langley Research Center, the Federal Aviation Administration, and the Agency of Transportation, State of Vermont conducted a program sponsored by the Research and Special Programs Administration of the Department of...

TMDL MODEL EVALUATION AND RESEARCH NEEDS

EPA Science Inventory

This review examines the modeling research needs to support environmental decision-making for the 303(d) requirements for development of total maximum daily loads (TMDLs) and related programs such as 319 Nonpoint Source Program activities, watershed management, stormwater permits...

Adapting Job Analysis Methodology to Improve Evaluation Practice

ERIC Educational Resources Information Center

Jenkins, Susan M.; Curtin, Patrick

2006-01-01

This article describes how job analysis, a method commonly used in personnel research and organizational psychology, provides a systematic method for documenting program staffing and service delivery that can improve evaluators' knowledge about program operations. Job analysis data can be used to increase evaluators' insight into how staffs…

Evaluating Alternative High Schools: Program Evaluation in Action

ERIC Educational Resources Information Center

Hinds, Drew Samuel Wayne

2013-01-01

Alternative high schools serve some of the most vulnerable students and their programs present a significant challenge to evaluate. Determining the impact of an alternative high school that serves mostly at-risk students presented a significant research problem. Few studies exist that dig deeper into the characteristics and strategies of…

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Evaluating in political turmoil: nursing challenges in prevention programs.

PubMed

Laperrière, Hélène

2007-03-01

The concrete insertion of nurses into the context of an inquiry contributes to empirical evaluation research of health promotion programs. As interveners and concrete actors in social movements, nurses are in a privileged position to give realism to a local understanding of the political and cultural context of evaluative research. Drawing on the practice of empirical evaluation research, this paper seeks to generate new methodological approaches in a way that broadens nursing inquiries in community health nursing. It explores new ways of thinking about epistemology and knowledge production in nursing practice. For 5 months an evaluative research project adopting a participatory-action research approach was conducted with local community actors in an AIDS prevention project in Amazonas (Brazil) in a prostitution setting. An auto-ethnographic journal was used as a reflective approach for the critical analysis of nursing research activities. This paper calls for a closer relationship between scientific research settings and the sociopolitical and the sociocultural aspects of nursing practice. It increases an incorporation of popular, social and professional experiential learning and skill acquisition in embedded knowledge production.

Non-formal educator use of evaluation results.

PubMed

Baughman, Sarah; Boyd, Heather H; Franz, Nancy K

2012-08-01

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational programs through land grant universities. Many Extension services require non-formal educational program evaluations be conducted by field-based Extension educators. Evaluation research has focused primarily on the efforts of professional, external evaluators. The work of program staff with many responsibilities including program evaluation has received little attention. This study examined how field based Extension educators (i.e. program staff) in four Extension services use the results of evaluations of programs that they have conducted themselves. Four types of evaluation use are measured and explored; instrumental use, conceptual use, persuasive use and process use. Results indicate that there are few programmatic changes as a result of evaluation findings among the non-formal educators surveyed in this study. Extension educators tend to use evaluation results to persuade others about the value of their programs and learn from the evaluation process. Evaluation use is driven by accountability measures with very little program improvement use as measured in this study. Practical implications include delineating accountability and program improvement tasks within complex organizations in order to align evaluation efforts and to improve the results of both. There is some evidence that evaluation capacity building efforts may be increasing instrumental use by educators evaluating their own programs. Copyright © 2011 Elsevier Ltd. All rights reserved.

Learning for All: The Value of Field Experience in Training a New Generation of Program Evaluators

ERIC Educational Resources Information Center

Buitrag, Carolina

2015-01-01

Professionals in various fields have the opportunity to train in real-life situations before they take on a job by themselves. In program evaluation, however, preservice training usually focuses on coursework oriented to research design and methods. After completing these studies, evaluators go off to conduct evaluations guided primarily by their…

Evaluation of Adult Literacy Education in the United States: A Review of Methodological Issues

ERIC Educational Resources Information Center

Shi, Yan; Tsang, Mun C.

2008-01-01

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

NASA Technical Reports Server (NTRS)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs immediately after the instruction. Although EDCATS is designed for teachers to enter their data logged onto the appropriate internet web site, most surveys were completed on a printed copy and entered into the EDCATS system by USSF personnel. The Aviation and Space Basics class were taken to a computer lab where they responded to the survey on-line. Data from the Inservice surveys were manually entered into a computer spreadsheet program by US Space Foundation personnel and processed using the statistical program SPSS for Windows. The raw data and copy of the EDCATS survey for the five-day programs are in Appendix 1. The raw data and copy of the Inservice survey are in Appendix 2. Comments from both programs are in Appendices 3 and 4, respectively.

COLLECTION SYSTEM SOLIDS CONTROL: OVERVIEW OF AN EPA WET-WEATHER FLOW RESEARCH PROGRAM

EPA Science Inventory

This paper presents an historical overview of the sewer-solids control projects conducted by the Wet-Weather Flow Research Program of the US EPA. Research includes studies of the causes of sewer-solids deposition and development/evaluation of control methods that can prevent sewe...

Building Participation through Market Research. The Guide Series in Continuing Education.

ERIC Educational Resources Information Center

Campbell, M. Donald

Market research, important for professional renewal, is a critical part of continuing education program planning. It includes attention to learning needs and learner motivation to participate in continuing education. Informal market research makes use of internal sources, such as enrollment data, program evaluations, policy statements, and staff…

Evaluation of the NSF Industry/University Cooperative Research Centers: Descriptive and Correlative Findings.

ERIC Educational Resources Information Center

National Science Foundation, Washington, DC. Directorate for Engineering.

This report presents results of a survey of participants in the National Science Foundation (NSF) Industry-University Cooperative Research Centers program. The program promotes more rapid technological innovation by creating linkages between industry and university scientists. The Centers function as university research groups, with partial…

Evaluating Urban Resilience to Climate Change: A Multi-Sector Approach (Final Report)

EPA Science Inventory

EPA is announcing the availability of this final report prepared by the Air, Climate, and Energy (ACE) Research Program, located within the Office of Research and Development, with support from Cadmus. One of the goals of the ACE research program is to provide scientific informat...

Research on Cleaning Up in San Diego.

ERIC Educational Resources Information Center

Middleman, Stanley

1983-01-01

Discusses the evolution of a set of research programs (dealing with the removal of liquid contaminants from surfaces) used to introduce graduate students to methods of design, evaluation, and modification within the context of a larger research program. Stresses the simultaneity and interaction of theoretical and experimental studies. (JM)

Solar energy program evaluation: an introduction

DOE Office of Scientific and Technical Information (OSTI.GOV)

deLeon, P.

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the rolemore » and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)« less

EVALUATION OF 1966 EOA SECONDARY SUMMER SCHOOL PROGRAM. RESEARCH REPORT.

ERIC Educational Resources Information Center

GODON, ROLF M.

PRESENTED IS AN EVALUATION OF A 6-WEEK SUMMER SCHOOL PROGRAM FOR 502 DISADVANTAGED STUDENTS ENTERING JUNIOR HIGH SCHOOLS IN THE FALL OF 1966. PROGRAM GOALS WERE TO RAISE ACHIEVEMENT LEVELS, REDUCE SUMMER LEARNING LOSSES, ENCOURAGE ASPIRATION AND MOTIVATION FOR LEARNING, AND PROVIDE ENRICHMENT. THESE OBJECTIVES WERE IMPLEMENTED BY INTENSIVE…

The Development of an Automated Data Base for Program Research and Evaluation in Continuing Education.

ERIC Educational Resources Information Center

Taylor, William H.

The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…

Teaching Evaluation: A Student-Run Consulting Firm

ERIC Educational Resources Information Center

Cundiff, Nicole; Nadler, Joel; Scribner, Shauna

2011-01-01

Applied Research Consultants (ARC) is a graduate student run consulting firm that provides experience to students in evaluation and consultation. An overview of this program has been compiled in order to serve as a model of a graduate training practicum that could be applied to similar programs or aid in the development of such programs. Key…

Effectiveness of the Combat Operational Stress Control Training Program: Expectations of the U.S. Marine Corps

ERIC Educational Resources Information Center

Sipko, Marek M.

2010-01-01

This study evaluated the effectiveness of the U.S. Marine Corps combat operational stress preventive training program to determine whether the program meets the training effectiveness criteria of the Marine Corps. This evaluation entailed both qualitative and quantitative inquiries to answer the subject matter research questions. The…

Peer Tutoring: A Guide to Program Design. Research and Development Series No. 260.

ERIC Educational Resources Information Center

Ashley, William L.; And Others

This publication presents guidelines for planning, implementing, and evaluating a peer tutoring program within a vocational setting. Chapter 1 discusses benefits of peer tutoring and presents a compilation of guidelines, suggestions, and examples for planning, developing, and evaluating a peer tutoring program. Tasks in each area--program…

Evaluating a National Science and Technology Program Using the Human Capital and Relational Asset Perspectives

ERIC Educational Resources Information Center

Hung, Chia-Liang; Chou, Jerome Chih-Lung; Roan, Hung-Wei

2010-01-01

The purpose of this research is to evaluate the performance of the National Science and Technology Program (NSTP) by targeting the Taiwan National Telecommunication Program (NTP) initiated in 1998. The Taiwan telecommunications industry has prospered, currently occupying key positions in global markets even though NTP seldom contributes positively…

A Critical Review of Research on the Alert Program®

ERIC Educational Resources Information Center

Gill, Kamaldeep; Thompson-Hodgetts, Sandra; Rasmussen, Carmen

2018-01-01

To evaluate the strength of evidence for the effectiveness, feasibility, and appropriateness of the Alert Program®. Multiple databases were systematically searched for peer-reviewed, English-language articles that evaluated the Alert Program®. Six articles met the inclusion criteria. The strength of evidence ranged from weak to moderate using the…

Middle Immersion Study 1988. Research Paper 88-08.

ERIC Educational Resources Information Center

Parkin, Michael; And Others

Ottawa's program of middle French immersion (MFI) instruction, beginning in fourth grade, was evaluated when the first cohort reached sixth grade. Results of the study were compared with those of other groups, particularly the early French immersion (EFI) program and late French immersion (LFI) program students. The evaluation also added data from…

An Evaluation of the Technical Adequacy of a Revised Measure of Quality Indicators of Transition

ERIC Educational Resources Information Center

Morningstar, Mary E.; Lee, Hyunjoo; Lattin, Dana L.; Murray, Angela K.

2016-01-01

This study confirmed the reliability and validity of the Quality Indicators of Exemplary Transition Programs Needs Assessment-2 (QI-2). Quality transition program indicators were identified through a systematic synthesis of transition research, policies, and program evaluation measures. To verify reliability and validity of the QI-2, we…

How to Recognize a Quality Technical Education Program.

ERIC Educational Resources Information Center

Doty, Charles R.

Criteria for the evaluation of quality technical educational programs must be identified if follow-up studies are to be effective. Current research shows that problems in the development of such criteria include the tendency to evaluate programs on the basis of organizational structure rather than on the quality of the instructional program…

Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

Educational Program Development for the Rural Disadvantaged. Research Report.

ERIC Educational Resources Information Center

Thomas, Hollie B.; And Others

As part of a far-reaching research project on educational needs of the rural disadvantaged, this phase of the Rural Education Disadvantaged Youth Project (Project REDY) dealt with the development and evaluation of a vocationally-oriented family-centered educational program. The model program, which was field-tested at a single site, focused upon:…

Integrating the Full Range of Security Cooperation Programs into Air Force Planning: An Analytic Primer

DTIC Science & Technology

2011-01-01

Exchange Program ( IEP ) Authority 10 U.S.C. §2358, “Research and development projects” Processes and agreements IEP agreements with the...2015.4, “Defense Research, Development, Test and Evaluation (RDT&E) Information Exchange Program ( IEP )”; DoDD 5134.1, “Under Secretary of Defense for

A Learning Research Informed Design and Evaluation of a Web-Enhanced Object Oriented Programming Seminar

ERIC Educational Resources Information Center

Georgantaki, Stavroula C.; Retalis, Symeon D.

2007-01-01

"Object-Oriented Programming" subject is included in the ACM Curriculum Guidelines for Undergraduate and Graduate Degree Programs in Computer Science as well as in Curriculum for K-12 Computer Science. In a few research studies learning problems and difficulties have been recorded, and therefore, specific pedagogical guidelines and…

Putting Empirical Knowledge to Work: Linking Research and Programming on Marital Quality

ERIC Educational Resources Information Center

Adler-Baeder, Francesca; Higginbotham, Brian; Lamke, Leanne

2004-01-01

When selecting a marriage education curriculum, educators can turn to programs that have been evaluated for effectiveness; however, few curricula have undergone such study. An alternative approach, consistent with best practices, is to ensure a research base for program content. A translation process model is offered as an initial attempt to…

Development of a Training Program for Enhancement of Technology Competencies of University Lecturers

ERIC Educational Resources Information Center

Cruthaka, Chomsupak; Pinngern, Ouen

2016-01-01

The objectives were: (1) the components of the technology competencies of university lecturers were studied. The researchers also described and analyzed (2) the development of a training program for enhancement of the technology competencies of these lecturers. Also, the researchers evaluated (3) the program they had constructed. The sample…

Research in Agricultural Education. Proceedings of the Annual Southern Agricultural Education Research Meeting (44th, Wilmington, North Carolina, March 19-20, 1995).

ERIC Educational Resources Information Center

Flowers, Jim, Comp.

The proceedings includes the following: "Evaluation of the Leadership Development of Oklahoma Agricultural Leadership Program Graduates" (Lee-Cooper, Weeks); "Model for Undergraduate Academic Programs in Agricultural Communications" (Terry, Jr. et al.); "Competencies Needed for Graduates of Agricultural Communications Programs" (Terry,…

Patient involvement in research programming and implementation: A responsive evaluation of the Dialogue Model for research agenda setting.

PubMed

Abma, Tineke A; Pittens, Carina A C M; Visse, Merel; Elberse, Janneke E; Broerse, Jacqueline E W

2015-12-01

The Dialogue Model for research agenda-setting, involving multiple stakeholders including patients, was developed and validated in the Netherlands. However, there is little insight into whether and how patient involvement is sustained during the programming and implementation of research agendas. To understand how the Dialogue Model can be optimised by focusing on programming and implementation, in order to stimulate the inclusion of (the perspectives of) patients in research. A responsive evaluation of the programming and implementation phases of nine agenda-setting projects that had used the Dialogue Model for agenda-setting was conducted. Fifty-four semi-structured interviews were held with different stakeholders (patients, researchers, funding agencies). Three focus groups with patients, funding agencies and researchers (16 participants) were organized to validate the findings. Patient involvement in programming and implementation of the research agendas was limited. This was partly related to poor programming and implementation, partly to pitfalls in earlier phases of the agenda-setting. Optimization of the Dialogue Model is possible by attending to the nature of the agenda and its intended use in earlier phases. Attention should also be given to the ambassadors and intended users of agenda topics. Support is needed during programming and implementation to organize patient involvement and adapt organizational structures like review procedures. In all phases the attitude to patient involvement, stakeholder participation, especially of researchers, and formal and informal relationships between parties need to be addressed to build a strong relationship with a shared goal. Patient involvement in agenda-setting is not automatically followed by patient involvement in programming and implementation. More attention should be paid, in earlier stages, to the attitude and engagement of researchers and funding agencies. © 2014 John Wiley & Sons Ltd.

77 FR 15139 - Agency Information Collection Activities: Comment Request; Generic Survey Clearance for the...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-14

... order to conduct program- or portfolio-level evaluations, however, both experimental and quasi-experimental evaluation research studies on STEM education interventions require researchers to identify...

An Evaluation of Research Training: The Testing, Research, and Data Processing Unit of the University Counseling Center. Research Report #5-88.

ERIC Educational Resources Information Center

Thompson, Chalmer E.; Sedlacek, William E.

The relative contributions of a research assistantship experience to graduate training programs in counseling psychology and student personnel were evaluated. The following areas were assessed: (1) the extent to which research competencies are enhanced among former research assistants; (2) the extent to which attitudes toward research are enhanced…

What Works to Reduce Victimization? Synthesizing What We Know and Where to Go From Here.

PubMed

Fox, Kathleen A; Shjarback, John A

2016-01-01

While some attention has been paid to "what works" to reduce crime, little is known about the effectiveness of programs designed to reduce victimization. This study systematically reviews 83 program evaluations to identify what works to (a) reduce victimization, (b) enhance beliefs/attitudes about victims, and (c) improve knowledge/awareness of victimization issues. Evidence-based findings are organized around 4 major forms of victimization, including bullying, intimate partner violence, sexual abuse, and other general forms of victimization. Determining whether certain types of programs can reduce the risk of victimization has important implications for improving people's quality of life. Based on our findings, we offer several promising directions for the next generation of research on evaluating victimization programs. The goal of this study is to improve the strength of future program evaluations, replications, and other systematic reviews as researchers and practitioners continue to learn what works to reduce victimization.

Laboratory Directed Research and Development Program FY 2006 Annual Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sjoreen, Terrence P

2007-04-01

The Oak Ridge National Laboratory (ORNL) Laboratory Directed Research and Development (LDRD) Program reports its status to the US Departmental of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, 'Laboratory Directed Research and Development' (April 19, 2006), which establishes DOE's requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries all ORNL LDRD research activities supported during FY 2006. The associated FY 2006 ORNL LDRD Self-Assessment (ORNL/PPA-2007/2) provides financial data about themore » FY 2006 projects and an internal evaluation of the program's management process.« less

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

The NASA hypersonic research engine program

NASA Technical Reports Server (NTRS)

Rubert, Kennedy F.; Lopez, Henry J.

1992-01-01

An overview is provided of the NASA Hypersonic Research Engine Program. The engine concept is described which was evolved, and the accomplishments of the program are summarized. The program was undertaken as an in-depth program of hypersonic airbreathing propulsion research to provide essential inputs to future prototype engine development and decision making. An airbreathing liquid hydrogen fueled research oriented scramjet was to be developed to certain performance goals. The work was many faceted, required aerodynamic design evaluation, structures development, and development of flight systems such as the fuel and control system, but the main objective was the study of the internal aerothermodynamics of the propulsion system.

5 CFR 470.101 - Statutory authority.

Code of Federal Regulations, 2012 CFR

2012-01-01

... MANAGEMENT RESEARCH PROGRAMS AND DEMONSTRATIONS PROJECTS General Provisions § 470.101 Statutory authority. (a... programs to study improved methods and technologies in Federal personnel management; (2) Evaluate the... for the collection and public dissemination of information relating to personnel management research...

5 CFR 470.101 - Statutory authority.

Code of Federal Regulations, 2014 CFR

2014-01-01

... MANAGEMENT RESEARCH PROGRAMS AND DEMONSTRATIONS PROJECTS General Provisions § 470.101 Statutory authority. (a... programs to study improved methods and technologies in Federal personnel management; (2) Evaluate the... for the collection and public dissemination of information relating to personnel management research...

5 CFR 470.101 - Statutory authority.

Code of Federal Regulations, 2013 CFR

2013-01-01

... MANAGEMENT RESEARCH PROGRAMS AND DEMONSTRATIONS PROJECTS General Provisions § 470.101 Statutory authority. (a... programs to study improved methods and technologies in Federal personnel management; (2) Evaluate the... for the collection and public dissemination of information relating to personnel management research...

7 CFR 3403.10 - Proposal review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SMALL BUSINESS INNOVATION RESEARCH GRANTS PROGRAM Submission and... in the “Method of Selection and Evaluation Criteria” section of the program solicitation. (d...

Draft Environmental Statement For Physics and Astronomy Sounding Rocket, Balloon, and Airborne Research Programs

NASA Technical Reports Server (NTRS)

1971-01-01

This document is a draft of an environmental impact statement, evaluating the effect on the environment of the use of sounding rockets, balloons and air borne research programs in studying the atmosphere.

Valuing Our Communities: Ethical Considerations for Economic Evaluation of Community-Based Prevention.

PubMed

Crowley, Max; Jones, Damon

2017-12-01

Restricted public budgets and increasing efforts to link the impact of community interventions to public savings have increased the use of economic evaluation. While this type of evaluation can be important for program planning, it also raises important ethical issues about how we value the time of local stakeholders who support community interventions. In particular, researchers navigate issues of scientific accuracy, institutional inequality, and research utility in their pursuit of even basic cost estimates. We provide an example of how we confronted these issues when estimating the costs of a large-scale community-based intervention. Principles for valuing community members' time and conducting economic evaluations of community programs are discussed. © Society for Community Research and Action 2017.

Clinical and translational scientist career success: metrics for evaluation.

PubMed

Lee, Linda S; Pusek, Susan N; McCormack, Wayne T; Helitzer, Deborah L; Martina, Camille A; Dozier, Ann M; Ahluwalia, Jasjit S; Schwartz, Lisa S; McManus, Linda M; Reynolds, Brian D; Haynes, Erin N; Rubio, Doris M

2012-10-01

Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. © 2012 Wiley Periodicals, Inc.

Who Is Afraid of Evaluation? Ethics in Evaluation Research as a Way to Cope with Excessive Evaluation Anxiety: Insights from a Case Study

ERIC Educational Resources Information Center

Bechar, Shlomit; Mero-Jaffe, Irit

2014-01-01

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

A qualitative evaluation of the 2005–2011 National Academic Centers of Excellence in Youth Violence Prevention Program☆

PubMed Central

Holland, Kristin M.; Vivolo-Kantor, Alana M.; Cruz, Jason Dela; Massetti, Greta M.; Mahendra, Reshma

2018-01-01

The Centers for Disease Control and Prevention’s Division of Violence Prevention (DVP) funded eight National Academic Centers of Excellence (ACEs) in Youth Violence Prevention from 2005 to 2010 and two Urban Partnership Academic Centers of Excellence (UPACEs) in Youth Violence Prevention from 2006 to 2011. The ACEs and UPACEs constitute DVP’s 2005–2011 ACE Program. ACE Program goals include partnering with communities to promote youth violence (YV) prevention and fostering connections between research and community practice. This article describes a qualitative evaluation of the 2005–2011 ACE Program using an innovative approach for collecting and analyzing data from multiple large research centers via a web-based Information System (ACE-IS). The ACE-IS was established as an efficient mechanism to collect and document ACE research and programmatic activities. Performance indicators for the ACE Program were established in an ACE Program logic model. Data on performance indicators were collected through the ACE-IS biannually. Data assessed Centers’ ability to develop, implement, and evaluate YV prevention activities. Performance indicator data demonstrate substantial progress on Centers’ research in YV risk and protective factors, community partnerships, and other accomplishments. Findings provide important lessons learned, illustrate progress made by the Centers, and point to new directions for YV prevention research and programmatic efforts. PMID:26319174

Opening the Conversation on REU Assessment and Evaluation

NASA Astrophysics Data System (ADS)

Pressley, S. N.; LeBeau, J. E.

2015-12-01

Project evaluation is a key component to ensuring success of any Research Experience for Undergraduates (REU) program. The Washington State University (WSU) Regional Atmospheric Chemistry: State-of-the-art Measurement and Modeling in the Pacific Northwest REU Site employs a mixed method approach to determine what is working well and what can use improvement (formative evaluation) and to determine impact and effectiveness of the project in reaching the stated goals (summative evaluation). Quantitative data is collected via a pre-/post-test measuring participants' research self-efficacy (RSE), motivation, background information, extent of socialization, and their interpretation of the value of the REU experience. Qualitative data is gathered through individual interviews with the REU students (at the beginning and end of the program) and faculty mentors (at the end). Beginning interviews focus on expectations for the REU program and student backgrounds. End interviews focus on student RSE development, interpretations of their experience, and the value of the experience. Faculty mentors are interviewed to gather insight on student performance in the program and perspectives on the overall success of the program in meeting the proposed goals. Students are provided an opportunity to comment on the strengths and weaknesses of workshops, providing critical feedback to the particular instructor and enabling the faculty to modify the workshop content and activities in future years. Finally, research results are evaluated during the final poster presentation, and faculty are interviewed to report on their perception of how each student learned and gained knowledge during the program. To evaluate the retention of students in engineering and science and identify chosen career paths, a longitudinal survey was created and it is administered via email each year. Many REU programs also employ the Undergraduate Research Students Self-Assessment (URSSA) online tool designed for evaluating REU experiences (University of Colorado at Boulder). Information presented in this presentation will include a discussion of the current tools used as described above as well as a discussion of the pros/cons of using URSSA. One of the concerns with using URSSA in conjunction with the other assessment tools is "survey fatigue".

Moving evidence-based drug abuse prevention programs from basic science to practice: "bridging the efficacy-effectiveness interface".

PubMed

August, Gerald J; Winters, Ken C; Realmuto, George M; Tarter, Ralph; Perry, Cheryl; Hektner, Joel M

2004-01-01

This article examines the challenges faced by developers of youth drug abuse prevention programs in transporting scientifically proven or evidence-based programs into natural community practice systems. Models for research on the transfer of prevention technology are described with specific emphasis given to the relationship between efficacy and effectiveness studies. Barriers that impede the successful integration of efficacy methods within effectiveness studies (e.g., client factors, practitioner factors, intervention structure characteristics, and environmental and organizational factors) are discussed. We present a modified model for program development and evaluation that includes a new type of research design, the hybrid efficacy-effectiveness study that addresses program transportability. The utility of the hybrid study is illustrated in the evaluation of the Early Risers "Skills for Success" prevention program.

Design and Assessment of an Associate Degree-Level Plant Operations Technical Education Program

NASA Astrophysics Data System (ADS)

Selwitz, Jason Lawrence

Research was undertaken to develop and evaluate an associate degree-level technical education program in Plant Operations oriented towards training students in applied science, technology, engineering, and mathematics (STEM) skills and knowledge relevant to a spectrum of processing industries. This work focuses on four aspects of the curriculum and course development and evaluation research. First, the context of, and impetus for, what was formerly called vocational education, now referred to as technical or workforce education, is provided. Second, the research that was undertaken to design and evaluate an associate degree-level STEM workforce education program is described. Third, the adaptation of a student self-assessment of learning gains instrument is reviewed, and an analysis of the resulting data using an adapted logic model is provided, to evaluate the extent to which instructional approaches, in two process control/improvement-focused courses, were effective in meeting course-level intended learning outcomes. Finally, eight integrative multiscale exercises were designed from two example process systems, wastewater treatment and fast pyrolysis. The integrative exercises are intended for use as tools to accelerate the formation of an operator-technician's multiscale vision of systems, unit operations, underlying processes, and fundamental reactions relevant to multiple industries. Community and technical colleges serve a vital function in STEM education by training workers for medium- and high-skilled technical careers and providing employers the labor necessary to operate and maintain thriving business ventures. Through development of the curricular, course, and assessment-related instruments and tools, this research helps ensure associate degree-level technical education programs can engage in a continual process of program evaluation and improvement.

Southeast Regional Experiment Station

NASA Astrophysics Data System (ADS)

1994-08-01

This is the final report of the Southeast Regional Experiment Station project. The Florida Solar Energy Center (FSEC), a research institute of the University of Central Florida (UCF), has operated the Southeast Regional Experiment Station (SE RES) for the US Department of Energy (DOE) since September 1982. Sandia National Laboratories, Albuquerque (SNLA) provides technical program direction for both the SE RES and the Southwest Regional Experiment Station (SW RES) located at the Southwest Technology Development Institute at Las Cruces, New Mexico. This cooperative effort serves a critical role in the national photovoltaic program by conducting system evaluations, design assistance and technology transfer to enhance the cost-effective utilization and development of photovoltaic technology. Initially, the research focus of the SE RES program centered on utility-connected PV systems and associated issues. In 1987, the SE RES began evaluating amorphous silicon (a-Si) thin-film PV modules for application in utility-interactive systems. Stand-alone PV systems began receiving increased emphasis at the SE RES in 1986. Research projects were initiated that involved evaluation of vaccine refrigeration, water pumping and other stand-alone power systems. The results of this work have led to design optimization techniques and procedures for the sizing and modeling of PV water pumping systems. Later recent research at the SE RES included test and evaluation of batteries and charge controllers for stand-alone PV system applications. The SE RES project provided the foundation on which FSEC achieved national recognition for its expertise in PV systems research and related technology transfer programs. These synergistic products of the SE RES illustrate the high visibility and contributions the FSEC PV program offers to the DOE.

The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) Program: Reach, Sustainability, Spread and Lessons Learned from an Implementation Funding Model.

PubMed

Moore, Julia E; Grouchy, Michelle; Graham, Ian D; Shandling, Maureen; Doyle, Winnie; Straus, Sharon E

2016-05-01

Despite evidence on what works in healthcare, there is a significant gap in the time it takes to bring research into practice. The Council of Academic Hospitals of Ontario's Adopting Research to Improve Care program addresses this research-to-practice gap by incorporating the following components into its funding program: strategic selection of evidence for implementation, education and training for implementation, implementation supports, executive champions and governance, and evaluation. Funded projects have been sustained (76% reported full sustainability) and spread to over 200 new sites. Lessons learned include the following: assess readiness, develop tailored implementation materials, consider characteristics of implementation supports, protect champion time and consider evaluation feasibility. Copyright © 2016 Longwoods Publishing.

The Council of Academic Hospitals of Ontario (CAHO) Adopting Research to Improve Care (ARTIC) Program: Reach, Sustainability, Spread and Lessons Learned from an Implementation Funding Model

PubMed Central

Grouchy, Michelle; Graham, Ian D.; Shandling, Maureen; Doyle, Winnie; Straus, Sharon E.

2016-01-01

Despite evidence on what works in healthcare, there is a significant gap in the time it takes to bring research into practice. The Council of Academic Hospitals of Ontario's Adopting Research to Improve Care program addresses this research-to-practice gap by incorporating the following components into its funding program: strategic selection of evidence for implementation, education and training for implementation, implementation supports, executive champions and governance, and evaluation. Funded projects have been sustained (76% reported full sustainability) and spread to over 200 new sites. Lessons learned include the following: assess readiness, develop tailored implementation materials, consider characteristics of implementation supports, protect champion time and consider evaluation feasibility. PMID:27232234

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Cultural Competence Approaches to Evaluation in Tribal Communities.

ERIC Educational Resources Information Center

Running Wolf, Paulette; Soler, Robin; Manteuffel, Brigitte; Sondheimer, Diane; Santiago, Rolando L.; Erickson, Jill Shephard

Disability research and program evaluation have generally been viewed with suspicion in Indian country because research designs, procedures, instruments, and interpretation and dissemination of outcomes have often ignored potential cultural conflicts. This paper explores a national evaluation in eight tribal communities that established systems of…

A case study of the Physics Enhancement Project for Two Year Colleges, its effects and outcomes on the teaching of undergraduate physics at two year colleges

NASA Astrophysics Data System (ADS)

Leif, Todd Robert

This dissertation reports on a naturalistic evaluation study of a series of NSF grant projects collectively known as PEPTYC -- Physics Enhancement Project for Two Year College Physics Instructors. The project encompassed seven different cycles of professional development occurring during the 1990's via May Institutes, held at Texas A&M University. Follow-up meetings were held at American Association of Physics Teachers - Texas Section Meetings. The research was conducted post hoc. The research evaluated the characteristics of effective professional development under an evaluation frame work designed by D.L. Kirkpatrick (1959) and adapted by the researcher to address issues that are pertinent to the professional development of faculty. This framework was adapted to be viewed through an educator's eye in an effort to ascertain the long term affects of the program and determine how the program affected the participants' attitudes, pedagogical knowledge, and instructional practices. The PEPTYC program philosophy was based on the premise, supported by research, that professional development programs addressing specific teaching practices are more successful than generic programs. Furthermore, professional development is more effective in helping teachers use alternative approaches when teachers are engaged in active learning experiences rather than passively listening to lectures or presentations. The naturalistic study was based on surveys and semi-structured interviews with 14 individuals who participated in PEPTYC workshops, as well as presenters of the PEPTYC program. The interviews were analyzed to describe how the PEPTYC project influenced the participants long after they had completed their training. This project can inform the development of similar evaluation studies of other professional development programs.

New England Instructional Television Research Center (NETREC).

ERIC Educational Resources Information Center

Friedlander, Bernard Z.; Wetstone, Harriet S.

Projects of the New England Instructional Television Research Center (NITREC) are summarized in a collection of papers. Objectives, rationale, and program of NETREC are defined, along with methods of formative evaluation during production. Seven videotest research projects cover methods of evaluating communicative effectiveness of primary-grade…

EPA Research Evaluating CAFO Impacts on Ground Water Quality

EPA Science Inventory

An overview of several projects will be presented on a research program currently underway at ORD’s Ground Water and Ecosystems Restoration Division (GWERD) to evaluate CAFO impacts on ground water quality. The overall research objectives are to characterize the potential for gro...

75 FR 38819 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-06

... disorders; (12) conducts and supports both qualitative and quantitative research to expand the knowledge... division, supports program evaluation, and ensures that research meets the highest standards in the field...) develops, implements and evaluates long term plans for surveillance, research and prevention activities...

Housing First and Photovoice: Transforming Lives, Communities, and Systems

PubMed Central

Barile, John P.; Ogawa, Terry Yasuko; Peralta, Nelson; Bugg, Reumell; Lau, John; Lamberton, Thomas; Hall, Corazon; Mori, Victor

2018-01-01

This article presents findings from a community-based participatory evaluation of a Housing First program on the Island of O’ahu. In this study, clients in a Housing First program used Photovoice to evaluate the program and to advocate for progressive housing policies. Written together by members of the Housing First Photovoice group, this collaborative article describes the outcomes from both the Housing First program and the Photovoice project and demonstrates the ways in which participatory program evaluations can interact with client-driven programs like Housing First to produce a cumulative, transformative impact. Findings suggest that community psychologists hoping to re-engage with community mental health systems through enacting transformative change should consider taking a community-based participatory approach to program evaluation because increased client voice in community mental health programs and their evaluations can have far-reaching, transformative impacts for research, practice, and policy. PMID:29323410

When Control Groups Do Not Exist: Program Evaluation without a Net.

ERIC Educational Resources Information Center

Clark, Sheldon B.; And Others

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Insights on Using Developmental Evaluation for Innovating: A Case Study on the Cocreation of an Innovative Program

ERIC Educational Resources Information Center

Lam, Chi Yan; Shulha, Lyn M.

2015-01-01

This article contributes to research on evaluation by examining the capacity and contribution of developmental evaluation for innovating. This case study describes the "preformative development" of an educational program (from conceptualization to pilot implementation) and analyzes the processes of innovation within a developmental…

A Strategy for Program Evaluation.

ERIC Educational Resources Information Center

Leinhardt, Gaea

This paper proposes a strategy for in-house evaluations in the context of an educational research and development facility. The obstacles in conducting an evaluation of colleagues' programs are discussed; these fall into two categories. First, there is a set of problems that relate to conflicts inherent in judging the work of a colleague without…

RESTORATION PLUS: A COLLABORATIVE RESEARCH PROGRAM TO DEVELOP AND EVALUATE ECOSYSTEM RESTORATION AND MANAGEMENT OPTIONS TO ACHIEVE ECOLOGICALLY AND ECONOMICALLY SUSTAINABLE SOLUTIONS

EPA Science Inventory

EPA is evaluating ecosystem restoration and management techniques to ensure they create sustainable solutions for degraded watersheds. ORD NRMRL initiated the Restoration Plus (RePlus) program in 2002 to a) evaluate ecosystem restoration and management options, b) assess the non-...

Evaluation Techniques for the Sandy Point Discovery Center, Great Bay National Estuarine Research Reserve.

ERIC Educational Resources Information Center

Heffernan, Bernadette M.

1998-01-01

Describes work done to provide staff of the Sandy Point Discovery Center with methods for evaluating exhibits and interpretive programming. Quantitative and qualitative evaluation measures were designed to assess the program's objective of estuary education. Pretest-posttest questionnaires and interviews are used to measure subjects' knowledge and…

Transforming Equity-Oriented Leaders: Principal Residency Network Program Evaluation

ERIC Educational Resources Information Center

Braun, Donna; Billups, Felice D.; Gable, Robert K.

2013-01-01

After 12 years focused on developing school leaders who act as change agents for educational equity, the Principal Residency Network (PRN) partnered with Johnson and Wales University's Center for Research and Evaluation to conduct a utilization-focused (Patton, 2002) program evaluation funded by a grant from the Rhode Island Foundation. The PRN…

"Evaluation as Illumination: A New Approach to the Study of Innovatory Programs". Occasional Paper.

ERIC Educational Resources Information Center

Parlett, Malcolm; Hamilton, David

Conventional approaches to program evaluation have followed the experimental and psychometric traditions dominant in educational research. Their aim (unfulfilled) of achieving fully objective methods had led to studies that are artificial and restricted in scope. Illuminative evaluation is introduced as a total re-appraisal of the rationale and…

78 FR 20924 - Center for Biologics Evaluation and Research eSubmitter Pilot Evaluation Program for...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-08

... DEPARTMENT OF HEALTH AND HUMAN SERVICES Food and Drug Administration [Docket No. FDA-2013-N-0248... Drug Applications AGENCY: Food and Drug Administration, HHS. ACTION: Notice. SUMMARY: The Food and Drug... sponsors of investigational new drug (IND) applications to participate in a pilot evaluation program for...

Stepping Stones to Evaluating Your Own School Literacy Program

ERIC Educational Resources Information Center

Levesque, Jeri; Carnahan, Danielle

2005-01-01

Stepping Stones to Literacy is a tool for elementary school improvement teams to evaluate and strengthen their reading programs. Each Stepping Stone is a guided activity to stimulate reflection and guide systematic inquiry. It is a collaborative, active research approach to evaluation (Levesque & Hinton 2001). The goal is to eliminate the gap…

Graduate Program Evaluation in the Area Leading Educational, Outlying and Backward

ERIC Educational Resources Information Center

Prasetyono, Hendro

2016-01-01

This study aimed to evaluate the Bachelor program Educating in the Regions Frontier, Outermost and Disadvantaged (SM-3T). The research location is at the Jakarta State University. The evaluation method used is Cippo consisting of components Context, Input, Process, Product and Outcomes. The method used is qualitative descriptive data analysis…

The Role of NIE in Foreign Language Dissemination and Evaluation.

ERIC Educational Resources Information Center

Eddy, Peter A.

One of 10 studies commissioned to investigate research needs and to stimulate planning activities, this paper reviews program evaluation in foreign language education (FLED), and offers a number of recommendations to improve present practice. It begins by noting that very little FLED program evaluation is taking place today, and by arguing that…

Collaborative Evaluation of a High School Prevention Curriculum: How Methods of Collaborative Evaluation Enhanced a Randomized Control Trial to Inform Program Improvement

ERIC Educational Resources Information Center

Orsini, Muhsin Michael; Wyrick, David L.; Milroy, Jeffrey J.

2012-01-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

PubMed

Wand, Timothy; White, Kathryn; Patching, Joanna

2011-06-01

Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

7 CFR 3402.24 - Evaluation of program.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3402.24 Section 3402.24 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE FOOD AND AGRICULTURAL SCIENCES NATIONAL NEEDS...

Evaluation of freeway motorist assist : staff summary, February 2010.

DOT National Transportation Integrated Search

2010-02-01

This research document builds on the previous Return on Investment (ROI) Study of Motorist Assist (1994) that evaluated the St. Louis Motor Assist program to establish and update current benefits of this program. The following is a summary of finding...

ORD Human Health Risk Assessment (HHRA) Research Program Mid-Cycle Progress Report and Review - 2010

EPA Pesticide Factsheets

The principal charge to the BOSC reviewers was to evaluate ORD’s HHRA Program from a program assessment framework relative to program relevance, structure, performance, quality, leadership, communication, and outcomes.

Program Evaluation. AAHE-ERIC/Higher Education Research Report No. 2, 1980.

ERIC Educational Resources Information Center

Feasley, Charles E.

The major distinctions between evaluation and research are examined, the chief differences being the intent and type of criteria against which judgments are made. Conceptualization of the evaluation process in higher education is discussed on two levels. A collection of nine similes for understanding evaluation is examined in terms of major…

75 FR 69086 - Submission for OMB review; comment request; NCCAM Office of Communications and Public Liaison...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-10

...) formative and (2) evaluative research of a variety of print and online materials, outreach activities, and... evaluative research on existing materials and messages, as part of OCPL's ongoing effort to develop a comprehensive program of testing and evaluation of all of its communications strategies. This evaluative...

75 FR 61763 - Submission for OMB Review; Comment Request; NCCAM Office of Communications and Public Liaison...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-06

...) formative and (2) evaluative research of a variety of print and online materials, outreach activities, and... evaluative research on existing materials and messages, as part of OCPL's ongoing effort to develop a comprehensive program of testing and evaluation of all of its communications strategies. This evaluative...

Learning "about" and "from" Variation in Program Impacts Using Multisite Trials. MDRC Working Papers on Research Methodology

ERIC Educational Resources Information Center

Raudenbush, Stephen W.; Bloom, Howard S.

2015-01-01

The present paper, which is intended for a diverse audience of evaluation researchers, applied social scientists, and research funders, provides a broad overview of the conceptual and statistical issues involved in using multisite randomized trials to learn "about" and "from" variation in program effects across…

Connecting Neuroscience, Cognitive, and Educational Theories and Research to Practice: A Review of Mathematics Intervention Programs

ERIC Educational Resources Information Center

Kroeger, Lori A.; Brown, Rhonda Douglas; O'Brien, Beth A.

2012-01-01

Research Findings: This article describes major theories and research on math cognition across the fields of neuroscience, cognitive psychology, and education and connects these literatures to intervention practices. Commercially available math intervention programs were identified and evaluated using the following questions: (a) Did neuroscience…

Research in Teaching Reading to Disadvantaged Learners: A Critical Review and Evaluation of Research.

ERIC Educational Resources Information Center

Webster, Staten W.

This review of reading research literature deals with three major areas. First, 10 problems that inhibit the educational development of disadvantaged learners are identified and discussed. Secondly, programs designed to aid these students are reviewed. They include reading programs for preschool, elementary school, and secondary school age groups…

Research notes : evaluation of the oregon medically at-risk driver program.

DOT National Transportation Integrated Search

2009-05-01

Dr. James Strathman, a Portland State University researcher, recently completed an assessment of the safety risk of persons whose licenses were suspended under the Oregon Medically At-Risk Driver program. The results of the analysis suggested modific...

POLLUTION PREVENTION RESEARCH WITHIN THE FEDERAL COMMUNITY

EPA Science Inventory

One of the primary ongoing programs for promotion and encouragement of pollution prevention research is a cooperative program between the U.S. Environmental Protection Agency (EPA) and the Federal community at large. EPA’s Waste Reduction Evaluations At Federal Sites (WREAFS) Pro...

A Collaborative Web-Based Approach to Planning Research, Integration, and Testing Using a Wiki

NASA Technical Reports Server (NTRS)

Delaney, Michael M.; Koshimoto, Edwin T.; Noble, Deleena; Duggan, Christopher

2010-01-01

The National Aeronautics and Space Administration Integrated Vehicle Health Management program touches on many different research areas while striving to enable the automated detection, diagnosis, prognosis, and mitigation of adverse events at the aircraft and system level. At the system level, the research focus is on the evaluation of multidisciplinary integrated methods, tools, and technologies for achieving the program goal. The participating program members form a diverse group of government, industry, and academic researchers. The program team developed the Research and Test Integration Plan in order to track significant test and evaluation activities, which are important for understanding, demonstrating, and communicating the overall project state and project direction. The Plan is a living document, which allows the project team the flexibility to construct conceptual test scenarios and to track project resources. The Plan also incorporates several desirable feature requirements for Plan users and maintainers. A wiki has proven to be the most efficient and effective means of implementing the feature requirements for the Plan. The wiki has proven very valuable as a research project management tool, and there are plans to expand its scope.

Youth participatory research and evaluation to inform a Chagas disease prevention program in Ecuador.

PubMed

Marco-Crespo, Belén; Casapulla, Sharon; Nieto-Sanchez, Claudia; Urrego, J Guillermo Gómez; Grijalva, Mario J

2018-04-30

This qualitative study engaged a group of young people in participatory research and evaluation activities in order to study to what extent engaging youth in health interventions can inform research and evaluation processes. We applied a youth participatory research and evaluation approach (PRE) to inform research and evaluation on the impact of a Chagas disease control program in southern Ecuador. Our main interest was to examine the methodological contributions of PRE to knowledge sharing for health intervention planning in the context of global health and neglected tropical diseases. The results of this study suggest that by demystifying research and evaluation practices and rendering them accessible and relevant, marginalized youth can develop critical and reflexive thinking skills that could be useful for decision-making on health promotion. Our findings also reveal the potential of youth as active participants in project development in ways that enhance, validate, and improve health interventions. Young people are interested in learning about and sharing local knowledge that can benefit research and evaluation processes. Despite the numerous strengths demonstrated by PRE, the inherent complexities of international development, such as cultural differences, asymmetrical power relations, and the ongoing challenges of sustainability, remain. Copyright © 2018 Elsevier Ltd. All rights reserved.

Beyond Data Points and Research Contributions: The Personal Meaning and Value Associated with Public Participation in Scientific Research

ERIC Educational Resources Information Center

Haywood, Benjamin K.

2016-01-01

As public participation in scientific research (PPSR) initiatives have expanded rapidly among private, public, and non-profit science research communities over the past decade, program managers and scholars regularly promote, evaluate, and manage such programs with a focus on the value and impact of PPSR efforts on the practice and relevancy of…

Implementing a Sustainable Program Evaluation Component at a Large University Counseling Center

ERIC Educational Resources Information Center

Lacey, Sheila

2012-01-01

This action research dissertation study was undertaken to establish the foundation of a comprehensive evaluation component for the Turn-It-Around (TIA) workshop intervention program at Arizona State University (ASU), and was delivered in the form of a program development consultation. The study's intent was to enhance the ASU Counseling Service's…

Measuring Program Quality, Part 2: Addressing Potential Cultural Bias in a Rater Reliability Exam

ERIC Educational Resources Information Center

Richer, Amanda; Charmaraman, Linda; Ceder, Ineke

2018-01-01

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

An Evaluative Study of the Nurse Education Program. Research Report Number 82-1.

ERIC Educational Resources Information Center

Capoor, Madan

An evaluation of the nurse education program at Middlesex County College (MCC) was conducted in response to an increasing dropout rate and a decline in the passing rate of program graduates on the Licensing Board Examination (LBE). The study focused on the relationship between student background and performance and between student performance in…

A Program Evaluation of a Worksite Wellness Initiative for Weight Loss

ERIC Educational Resources Information Center

Martinez, Nicholas

2017-01-01

The purpose of this study was to conduct a program evaluation of ACME's worksite weight loss initiative and collect evidence relative to the efficacy of the program. An anonymous online survey was administered to participants of the weight loss initiative. The survey was designed to gather information relative to the research questions, which…

Evaluation of the Effectiveness of Educational Preparation for Critical Care Nursing. Research Highlights.

ERIC Educational Resources Information Center

English National Board for Nursing, Midwifery and Health Visiting, London.

Curriculum analysis of the English National Board for Nursing, Midwifery, and Health Visiting (ENB) critical care programs ENB 100, 124, 176/183, 199, and 415 revealed great diversity in programs bearing the same title. An evaluation identified if this diversity was reflected in the competencies acquired by students on different programs,…

Evaluating a Blended Degree Program through the Use of the NSSE Framework

ERIC Educational Resources Information Center

Vaughan, Norman; Cloutier, David

2017-01-01

The purpose of this student-faculty partnership research study was to evaluate the effectiveness of a blended four-year Bachelor of Education Elementary Program at a Canadian university using the National Survey of Student Engagement (NSSE) framework. Data was collected from the first graduating cohort of students from the B.Ed. program in…

Preventing Dating Violence in Public Schools: An Evaluation of an Interagency Collaborative Program for Youth

ERIC Educational Resources Information Center

Lowe, Laura A.; Jones, Chris D.; Banks, Leon

2007-01-01

Many communities offer programs aimed at improving teen dating skills and knowledge about violence and sexual behavior. This research study evaluates one such program, operated by an interagency collaborative. Each of four participating community agencies provided one hour of curriculum during one week of health class. Lecture, group activities,…

Evaluation of a Weight Loss Treatment Program for Individuals with Mild Mental Retardation

ERIC Educational Resources Information Center

Sailer, Angela B.; Miltenberger, Raymond G.; Johnson, Brigitte; Zetocha, Kim; Egemo, Kristin; Hegstad, Holly

2006-01-01

Obesity is a major problem for people in the United States. Individuals with mental retardation also are prone to obesity. The most successful programs for treating obesity typically are treatment packages consisting of multiple behavioral components. Research in the area of weight loss and mental retardation has not evaluated programs for…

Evaluation of College Reading and Study Skills Programs; Problems and Approaches.

ERIC Educational Resources Information Center

Anderson, William W.

The purpose of this paper was to bring together some of the most outstanding and significant research in recent years relating to the problems of evaluating college reading and study skills programs and the corresponding prospects and implications for improvement. The sections of the paper include: "Criterion Measures of Program Success," which is…

Evaluations of School Readiness Initiatives: What Are We Learning? SERVE's Expanded Learning Opportunities National Leadership Area Research Report.

ERIC Educational Resources Information Center

Brown, Elizabeth G.; Scott-Little, Catherine

Encouraged by evidence linking quality early care/education programs and improved student outcomes, a variety of school readiness programs and initiatives have been created. This report reviews and synthesizes evaluation studies conducted on early childhood interventions, focusing on programs emphasizing a school readiness goal. The report…

Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence.

PubMed

Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily

2017-10-01

Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.

Federal Highway Administration research and technology evaluation final report : Eco-Logical

DOT National Transportation Integrated Search

2018-03-01

This report documents an evaluation of Federal Highway Administrations (FHWA) Research and Technology Programs activities on the implementation of the Eco-Logical approach by State transportation departments and metropolitan planning organizati...

Compendium of Traffic Safety Research Projects: 1985-1995 and Beyond

DOT National Transportation Integrated Search

1996-03-01

The National Highway Traffic Safety Administration's Office of Program : Development and Evaluation (OPDE) conducts research and evaluation projects : dealing with human attitudes, behaviors and failures (motor vehicle crashes). : OPDE's focus is on ...

Safety evaluation of centerline rumble strips

DOT National Transportation Integrated Search

2003-11-10

A study of centerline rumble strips was undertaken as part of the Massachusetts Highway Department Research Program. The objective of this research was to evaluate the effectiveness of centerline rumble strips in reducing crossover crashes and improv...

Compendium of research and evaluations in traffic safety published

DOT National Transportation Integrated Search

1996-05-01

The National Highway Traffic Safety Administration's (NHTSA's) Office of Program Development and Evaluation (OPDE) conducts research projects that investigate human attitudes, behaviors, and failures as they relate to motor vehicle crashes. OPDE focu...

Hypermedia and Research Methodology: An Associative Research Model. Final Report.

ERIC Educational Resources Information Center

City Univ. of New York, NY. Bernard Baruch Coll.

The purpose of the project described in this three-part report was to test the value of hypermedia for library instruction. The project included the development of a hypermedia program built around a marketing topic; implementation and testing of the program with one group of students assigned to use the new program; evaluation of the project by…

Hardwood rangeland landowners in California from 1985 to 2004: production, ecosystem services, and permanence

Treesearch

Lynn Huntsinger; Martin Johnson; Monica Stafford; Jeremy S. Fried

2010-01-01

A longitudinal study of California hardwood rangelands shows significant change in landowner characteristics and goals. Results of three studies spanning 1985 to 2004 were used to develop and evaluate a multiagency research and extension program known as the Integrated Hardwood Range Management Program. Program-sponsored education and research aimed at encouraging...

Russell Sage Foundation Annual Report, 1974-1975.

ERIC Educational Resources Information Center

Russell Sage Foundation, New York, NY.

During the year the foundation staff completed the formation of eight program areas in which to concentrate future research. Four of these areas are major, and it is expected that they will receive larger appropriations in the next few years than the four minor program areas. The major program areas are: Age and Aging; Evaluation Research and…

Teacher and Principal Leadership in Chicago: Ongoing Analyses of Preparation Programs. Research Report

ERIC Educational Resources Information Center

Hart, Holly M.; Sporte, Susan E.; Ponisciak, Stephen M.; Stevens, W, David; Cambronne, Alissa

2008-01-01

This is the third report by the Consortium on Chicago School Research (CCSR) that examines leadership development programs supported by The Chicago Public Education Fund for Chicago public school principals and teachers. This current study, like the previous two, is not a comprehensive program evaluation. It is more descriptive in nature,…

So, You Need To Justify Your Existing ABC Program (or Lobby for a New One).

ERIC Educational Resources Information Center

Walsh, Jean Terry; Gillis, Lee

1998-01-01

Advice for adventure-based counseling (ABC) programs seeking funding includes setting realistic goals, designing an evaluation that matches program resources, and keeping it simple. Low recidivism is most important to grantors. Published research on ABC is scarce, but on-site process research generates useful data, and local schools and agencies…

The role of conservation programs in drought risk adaptation

Treesearch

Steven Wallander; Marcel Aillery; Daniel Hellerstein; Michael Hand

2013-01-01

This report evaluates the extent to which farms facing higher levels of drought risk are more likely to participate in conservation programs, and fi nds a strong link between drought risk and program participation. Prior research has shown that climate-related risk exposure infl uences production decisions such as crop choice; our research shows that adaptation also...

Engaging partners to initiate evaluation efforts: tactics used and lessons learned from the prevention research centers program.

PubMed

Wright, Demia Sundra; Anderson, Lynda A; Brownson, Ross C; Gwaltney, Margaret K; Scherer, Jennifer; Cross, Alan W; Goodman, Robert M; Schwartz, Randy; Sims, Tom; White, Carol R

2008-01-01

The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

AAAS Communicating Science Program: Reflections on Evaluation

NASA Astrophysics Data System (ADS)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Johnson, Gary E.; Diefenderfer, Heida L.; Ebberts, Blaine D.

The purpose ofthis document is to describe research, monitoring, and evaluation (RME) for the Federal Columbia River Estuary Program. The intent of this RME effort is to provide data and information to evaluate progress toward meeting program goals and objectives and support decision-making in the Estuary Program. The goal of the Estuary Program is to understand, conserve, and restore the estuary ecosystem to improve the performance of listed salmonid populations. The Estuary Program has five general objectives, designed to fulfill the program goal, as follows. 1. Understand the primary stressors affecting ecosystem controlling factors, such as ocean conditions and invasivemore » species. 2. Conserve and restore factors controlling ecosystem structures and processes, such as hydrodynamics and water quality. 3. Increase the quantity and quality of ecosystem structures, i.e., habitats, juvenile salmonids use during migration through the estuary. 4. Maintain the food web to benefit salmonid performance. 5. Improve salmonid performance in terms of life history diversity, foraging success, growth, and survival. The goal of estuary RME is to provide pertinent and timely research and monitoring information to planners, implementers, and managers of the Estuary Program. In conclusion, the estuary RME effort is designed to meet the research and monitoring needs of the estuary Program using an adaptive management process. Estuary RME's success and usefulness will depend on the actual conduct of adaptive management, as embodied in the objectives, implrementation, data, reporting, and synthesis, evaluation, and decision-making described herein.« less

Developing a public health policy-research nexus: an evaluation of Nurse Practitioner models in aged care.

PubMed

Prosser, Brenton; Clark, Shannon; Davey, Rachel; Parker, Rhian

2013-10-01

A frustration often expressed by researchers and policy-makers in public health is an apparent mismatch between respective priorities and expectations for research. Academics bemoan an oversimplification of their work, a reticence for independent critique and the constant pressure to pursue evaluation funding. Meanwhile, policy-makers look for research reports written in plain language with clear application, which are attuned to current policy settings and produced quickly. In a context where there are calls in western nations for evidence based policy with stronger links to academic research, such a mismatch can present significant challenges to policy program evaluation. The purpose of this paper is to present one attempt to overcome these challenges. Specifically, the paper describes the development of a conceptual framework for a large-scale, multifaceted evaluation of an Australian Government health initiative to expand Nurse Practitioner models of practice in aged care service delivery. In doing so, the paper provides a brief review of key points for the facilitation of a strong research-policy nexus in public health evaluations, as well as describes how this particular evaluation embodies these key points. As such, the paper presents an evaluation approach which may be adopted and adapted by others undertaking public health policy program evaluations. Copyright © 2013 Elsevier Ltd. All rights reserved.

Emergency Immigration Education Act Programs: Summer E.S.L. Welcome Plus Program for Students of Limited English Proficiency (LEP), Summer Bilingual Program, and Project Omega. OREA Report.

ERIC Educational Resources Information Center

Duque, Diana L.

This report presents findings of the evaluation by the New York City public school system's Office of Research, Evaluation, and Assessment of three programs (Summer E.S.L. Welcome Plus, Summer Bilingual, and Project Omega) for immigrant students. The Summer E.S.L. (English as a Second Language) Welcome Plus program operated at 19 sites in New York…

An Incentive Program for Nurse Aides Implementation Report: Description and Evaluation. Illinois Long Term Care Research and Demonstration Projects Series. Final Report.

ERIC Educational Resources Information Center

Sinke, Mary

This study examined a nursing aide recognition program in a nursing home with 50 nurses and 200 nurse aides. Before the program was implemented, baseline data on job satisfaction were gathered with a questionnaire. A one-page description of the program and an evaluation tool were distributed to the nurse aides at their information sessions. Nurse…

Traffic control device evaluation program: simulator evaluation of sponsored changeable message signs and in-situ evaluation of rumble strip alternatives.

DOT National Transportation Integrated Search

2016-07-01

This report describes two research activities. One research study tested the effects of adding commercial : logos acknowledging sponsorship to Changeable Message Signs. A driving simulator study was conducted : using test signs with travel times and ...

Measuring the Impact of Programs that Challenge the Public Stigma of Mental Illness

PubMed Central

Corrigan, Patrick W.; Shapiro, Jenessa R.

2010-01-01

Public stigma robs people with mental illnesses from rightful opportunities related to work and other important life goals. Advocates have developed anti-stigma programs meant to address the prejudice and discrimination associated with these conditions. Evidence is now needed to make sense of program impact; this paper looks at measurement issues related to stigma change. Community based participatory research is central to this research and includes the involvement of a diverse collection of stakeholders in all phases of evaluation. Investigators should be cautious about measures vis-à-vis social desirability effects and should directed by social validity of targeted audiences. Conceptual domains with some research support that correspond with assessments include behavior, penetration, psychological perspective, knowledge, and physiological/information processes. These issues are summarized as ten recommendations for evaluation of anti-stigma programs. PMID:20674114

A participatory evaluation model for Healthier Communities: developing indicators for New Mexico.

PubMed Central

Wallerstein, N

2000-01-01

Participatory evaluation models that invite community coalitions to take an active role in developing evaluations of their programs are a natural fit with Healthy Communities initiatives. The author describes the development of a participatory evaluation model for New Mexico's Healthier Communities program. She describes evaluation principles, research questions, and baseline findings. The evaluation model shows the links between process, community-level system impacts, and population health changes. PMID:10968754

The West African Health Organization's experience in improving the health research environment in the ECOWAS region.

PubMed

Aidam, Jude; Sombié, Issiaka

2016-04-20

The West African Health Organization (WAHO) implemented a research development program in West Africa during 2009-2013 using the Knowledge for Better Health Research Capacity Development Framework, developed by Pang et al. (Bull World Health Organ 81(11):815-820, 2003), on strategies used to improve the research environment. The framework has the following components: stewardship, financing, sustainable resourcing and research utilization. This paper describes how WAHO implemented this research development program in the West African region to help improve the research environment and lessons learnt. This is a retrospective review of the regional research development program using a triangulation of activity reports, an independent evaluation and the authors' experiences with stakeholders. This program was designed to address gaps along the components of the framework and to improve partnership. The activities, results and challenges are summarised for each component of the framework. The independent evaluation was conducted using over 180 semi-structured interviews of key stakeholders in the West African region and activity reports. WAHO and major stakeholders validated these findings during a regional meeting. All 15 ECOWAS countries benefited from this regional research development program. WAHO provided technical and financial support to eight countries to develop their policies, priorities and plans for research development to improve their research governance. WAHO, along with other technical and financial partners, organised many capacity-strengthening trainings in health systems research methodology, resource mobilization, ethical oversight and on HRWeb, a research information management platform. WAHO helped launch a regional network of health research institutions to improve collaboration between regional participating institutions. Further, WAHO developed strategic research partnerships and mobilised additional funding to support the program. The program supported 24 health research projects. High staff turnover, weak institutional capacities and ineffective collaboration were some of the challenges encountered during program activity implementation. The regional collaborative approach to health research development using this framework was effective given the challenges in the West African region. The achievements particularly with improved research partnerships and funding helped strengthen local health research environments. This highlights WAHO's role and the common experiences in the West African region in improving health research.

Simulation of the XV-15 tilt rotor research aircraft

NASA Technical Reports Server (NTRS)

Churchill, G. B.; Dugan, D. C.

1982-01-01

The effective use of simulation from issuance of the request for proposal through conduct of a flight test program for the XV-15 Tilt Rotor Research Aircraft is discussed. From program inception, simulation complemented all phases of XV-15 development. The initial simulation evaluations during the source evaluation board proceedings contributed significantly to performance and stability and control evaluations. Eight subsequent simulation periods provided major contributions in the areas of control concepts; cockpit configuration; handling qualities; pilot workload; failure effects and recovery procedures; and flight boundary problems and recovery procedures. The fidelity of the simulation also made it a valuable pilot training aid, as well as a suitable tool for military and civil mission evaluations. Simulation also provided valuable design data for refinement of automatic flight control systems. Throughout the program, fidelity was a prime issue and resulted in unique data and methods for fidelity evaluation which are presented and discussed.

Evaluating Experiential Leader Development: A Programmatic Evaluation and Comparison of the Effectiveness of US Air Force Squadron Officer School Curricula

DTIC Science & Technology

2008-03-01

programs regularly use mean differences between pretest and posttest measurements to represent program impact. However, research shows that participants...al. (2005) conducted a one-way comparison of models, using a single group’s pretest and posttest scores. The 2x2 structure of this research requires...for self-reports.........................................43 6. Within group across occasion ( pretest , posttest ) means, mean differences

Gifted Identification and the Role of Gifted Education: A Commentary on "Evaluating the Gifted Program of an Urban School District Using a Modified Regression Discontinuity Design"

ERIC Educational Resources Information Center

Steenbergen-Hu, Saiying; Olszewski-Kubilius, Paula

2016-01-01

The article by Davis, Engberg, Epple, Sieg, and Zimmer (2010) represents one of the recent research efforts from economists in evaluating the impact of gifted programs. It can serve as a worked example of the implementation of the regression discontinuity (RD) design method in gifted education research. In this commentary, we first illustrate the…

ORNLs Laboratory Directed Research and Development Program FY 2009 Annual Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

2010-03-01

The Laboratory Directed Research and Development (LDRD) program at Oak Ridge National Laboratory (ORNL) reports its status to the U.S. Department of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, “Laboratory Directed Research and Development” (April 19, 2006), which establishes DOE’s requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries all ORNL LDRD research activities supported during FY 2009. The associated FY 2009 ORNL LDRD Self-Assessment (ORNL/PPA-2010/2) provides financial data andmore » an internal evaluation of the program’s management process.« less

ORNLs Laboratory Directed Research and Development Program FY 2013 Annual Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

2014-03-01

The Laboratory Directed Research and Development (LDRD) program at Oak Ridge National Laboratory (ORNL) reports its status to the US Department of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, “Laboratory Directed Research and Development” (April 19, 2006), which establishes DOE’s requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries of all ORNL LDRD research activities supported during FY 2013. The associated FY 2013 ORNL LDRD Self-Assessment (ORNL/PPA-2014/2) provides financial datamore » and an internal evaluation of the program’s management process.« less

ORNLs Laboratory Directed Research and Development Program FY 2008 Annual Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

2009-03-01

The Oak Ridge National Laboratory (ORNL) Laboratory Directed Research and Development (LDRD) Program reports its status to the U.S. Department of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, “Laboratory Directed Research and Development” (April 19, 2006), which establishes DOE’s requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries all ORNL LDRD research activities supported during FY 2008. The associated FY 2008 ORNL LDRD Self-Assessment (ORNL/PPA-2008/2) provides financial data and anmore » internal evaluation of the program’s management process.« less

ORNLs Laboratory Directed Research and Development Program FY 2012 Annual Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

2013-03-01

The Laboratory Directed Research and Development (LDRD) program at Oak Ridge National Laboratory (ORNL) reports its status to the US Department of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, “Laboratory Directed Research and Development” (April 19, 2006), which establishes DOE’s requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries of all ORNL LDRD research activities supported during FY 2012. The associated FY 2012 ORNL LDRD Self-Assessment (ORNL/PPA-2012/2) provides financial datamore » and an internal evaluation of the program’s management process.« less

Recruiting for Caregiver Education Research

PubMed Central

Finlayson, Marcia; Henkel, Christin

2012-01-01

Caregiver education programs can support participants in a role that is often challenging. Research is needed to determine the effectiveness of these programs; however, recruitment for such studies can be difficult. The objectives of this study were to explore 1) how multiple sclerosis (MS) caregivers respond to recruitment materials for a research study evaluating a caregiver education program, including aspects of the materials that encourage or discourage their interest in participation; and 2) what recommendations MS caregivers have for improving study recruitment advertising. Qualitative interviews were conducted with seven MS caregivers. Participants were asked about their reactions to advertisements for a pilot study intended to evaluate an MS caregiver education program. Participants were also asked to reflect on factors that would influence their decision to participate in the program and to provide suggestions to improve recruitment materials. Data were analyzed using a constant-comparative approach. Study findings indicated that the language and visual design of the advertisements influenced the participants' initial responses. Some caregivers first responded to the fact that the program was part of a research study, and these caregivers had overall negative responses to the advertising, such as concern that the program was being “tested.” Other caregivers first considered the personal relevance of the program. These caregivers had neutral-to-positive responses to the flyers and weighed the relevance of the program against the research and logistical aspects. Participants provided recommendations to improve the recruitment materials. While recruiting for caregiver education research can be challenging, piloting recruitment materials and using a variety of advertising options may improve response. PMID:24453751

An Examination of the Indiana State University Aerospace Administration Program

NASA Technical Reports Server (NTRS)

Schwab, Gregory L.

2005-01-01

Declining enrollments in the Indiana State University (ISU) aerospace administration program prompted this case study. which evaluates the program in comparison with parallel programs at other universities, industry standards, and an independent audit. Survey instruments were administered to graduates, faculty, and employers for their views on competencies of an excellent aerospace administration program Results show the deficiency of the ISU program. Graduates, faculty, and employers rated all competencies-from moderate to considerable importance-similarly for an excellent program. Recommendations for program improvement were made, and suggestions for further research include studies to evaluate the effectiveness of a revised aerospace administration program.

7 CFR 3405.22 - Evaluation of program.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION... achievement test scores, grade point average, academic standing, career patterns, age, race/ethnicity, gender...

7 CFR 3406.29 - Evaluation of program.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3406.29 Section 3406.29 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION... achievement test scores, grade point average, academic standing, career patterns, age, race/ethnicity, gender...

Field and Simulator Evaluations of a PC-Based Attention Maintenance Training Program

DOT National Transportation Integrated Search

2011-07-01

This report presents the results of three research studies regarding driver distraction from the forward roadway due to : secondary in-vehicle tasks. Study 1 included the development and evaluation of a PC-based training program named : FOrward Conce...

77 FR 28360 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-14

... study has two main components: (1) A review of recent research on the identification of ELs with special... descriptive in nature. The study is not a program evaluation and does not purport to assess program outcomes...

SUPERFUND INNOVATIVE TECHNOLOGY EVALUATION: TECHNOLOGY PROFILES, NINTH EDITION

EPA Science Inventory

The Superfund Innovative Technology Evaluation (SITE) Program, now in its eleventh year, is an integral part of EPA's research into alternative cleanup methods for hazardous waste sites around the nation. The SITE Program was created to encourage the development and routine use o...

UPDATE ON THE MARINA STUDY ON LAKE TEXOMA

EPA Science Inventory

The National Risk Management Research Laboratory (NRMRL) has instituted a program for Risk Management Research for Ecosystem Restoration in Watersheds. As part of this program a large scale project was initiated on Lake Texoma and the surrounding watershed to evaluate the assimi...