Iterative evaluation in a mobile counseling and testing program to reach people of color at risk for HIV--new strategies improve program acceptability, effectiveness, and evaluation capabilities.

PubMed

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-06-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention's HIV testing recommendations.

Experiments in evaluation capacity building: Enhancing brain disorders research impact in Ontario.

PubMed

Nylen, Kirk; Sridharan, Sanjeev

2017-05-08

This paper is the introductory paper on a forum on evaluation capacity building for enhancing impacts of research on brain disorders. It describes challenges and opportunities of building evaluation capacity among community-based organizations in Ontario involved in enhancing brain health and supporting people living with a brain disorder. Using an example of a capacity building program called the "Evaluation Support Program", which is run by the Ontario Brain Institute, this forum discusses multiple themes including evaluation capacity building, evaluation culture and evaluation methodologies appropriate for evaluating complex community interventions. The goal of the Evaluation Support Program is to help community-based organizations build the capacity to demonstrate the value that they offer in order to improve, sustain, and spread their programs and activities. One of the features of this forum is that perspectives on the Evaluation Support Program are provided by multiple stakeholders, including the community-based organizations, evaluation team members involved in capacity building, thought leaders in the fields of evaluation capacity building and evaluation culture, and the funders. Copyright © 2017. Published by Elsevier Ltd.

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

ERIC Educational Resources Information Center

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

PubMed

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Using EPAS[TM] to Evaluate School-Based Intervention Programs: GEAR UP. Case Study

ERIC Educational Resources Information Center

ACT, Inc., 2007

2007-01-01

This brief examines how the ACT's EPAS[TM] (Educational Planning and Assessment System) can be used to evaluate school-based intervention programs. Specific evaluation considered is that of the federal government's Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP), an initiative designed to increase the college awareness…

A Service-Based Program Evaluation Platform for Enhancing Student Engagement in Assignments

ERIC Educational Resources Information Center

Wu, Ye-Chi; Ma, Lee Wei; Jiau, Hewijin Christine

2013-01-01

Programming assignments are commonly used in computer science education to encourage students to practice target concepts and evaluate their learning status. Ensuring students are engaged in such assignments is critical in attracting and retaining students. To this end, WebHat, a service-based program evaluation platform, is introduced in this…

Program Evaluation of a Competency-Based Online Model in Higher Education

ERIC Educational Resources Information Center

DiGiacomo, Karen

2017-01-01

In order to serve its nontraditional students, a university piloted a competency-based program as alternative method for its students to earn college credit. The purpose of this mixed-methods study was to conduct a summative program evaluation to determine if the program was successful in order to make decisions about program revision and…

Cognitive Restructuring through Dreams and Imagery: Descriptive Analysis of a Women's Prison-Based Program

ERIC Educational Resources Information Center

DeHart, Dana

2010-01-01

This report describes process and outcome evaluation of an innovative program based in a women's maximum-security correctional facility. Methodology included review of program materials, unobtrusive observation of group process, participant evaluation forms, focus groups, and individual interviews with current and former program participants.…

Evaluation of a Group-Based Trauma Recovery Program in Gaza: Students' Subjective Experiences

ERIC Educational Resources Information Center

Barron, Ian; Abdullah, Ghassan

2012-01-01

Internationally, evaluation of group-based trauma recovery programs has relied upon normative outcome measures, with no studies systematically analyzing children's subjective experience for program development. In contrast, the current study explored children's experience of a Gazan recovery program "in their own words." Twenty-four…

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

PubMed

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

The Effectiveness of Adapted Versions of an Evidence-Based Prevention Program in Reducing Alcohol Use among Alternative School Students

ERIC Educational Resources Information Center

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youths, there is a need to facilitate the implementation and evaluation of these programs in real-world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin' it REAL (kiR), with alternative…

Rational drug therapy education in clinical phase carried out by task-based learning

PubMed Central

Bilge, S. Sırrı; Akyüz, Bahar; Ağrı, Arzu Erdal; Özlem, Mıdık

2017-01-01

Objectives: Irrational drug use results in drug interactions, treatment noncompliance, and drug resistance. Rational pharmacotherapy education is being implemented in many faculties of medicine. Our aim is to introduce rational pharmacotherapy education by clinicians and to evaluate task-based rational drug therapy education in the clinical context. Methods: The Kirkpatrick's evaluation model was used for the evaluation of the program. The participants evaluated the program in terms of constituents of the program, utilization, and contribution to learning. Voluntary participants responded to the evaluation forms after the educational program. Data are evaluated using both quantitative and qualitative tools. SPSS (version 21) used for quantitative data for determining mean and standard deviation values. Descriptive qualitative analysis approach is used for the analysis of open-ended questions. Results: It was revealed that the program and its components have been favorable. A total 95.9% of the students consider the education to be beneficial. Simulated patients practice and personal drug choice/problem-based learning sessions were appreciated by the students in particular. 93.9% of the students stated that all students of medicine should undergo this educational program. Among the five presentations contained in the program, “The Principles of Prescribing” received the highest points (9 ± 1.00) from participating students in general evaluation of the educational program. Conclusion: This study was carried out to improve task-based rational drug therapy education. According to feedback from the students concerning content, method, resource, assessment, and program design; some important changes, especially in number of facilitators and indications, are made in rational pharmacotherapy education in clinical task-based learning program. PMID:28458432

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

ERIC Educational Resources Information Center

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

PubMed Central

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Economic Evaluation of Community-Based HIV Prevention Programs in Ontario: Evidence of Effectiveness in Reducing HIV Infections and Health Care Costs.

PubMed

Choi, Stephanie K Y; Holtgrave, David R; Bacon, Jean; Kennedy, Rick; Lush, Joanne; McGee, Frank; Tomlinson, George A; Rourke, Sean B

2016-06-01

Investments in community-based HIV prevention programs in Ontario over the past two and a half decades are assumed to have had an impact on the HIV epidemic, but they have never been systematically evaluated. To help close this knowledge gap, we conducted a macro-level evaluation of investment in Ontario HIV prevention programs from the payer perspective. Our results showed that, from 1987 to 2011, province-wide community-based programs helped to avert a total of 16,672 HIV infections, saving Ontario's health care system approximately $6.5 billion Canadian dollars (range 4.8-7.5B). We also showed that these community-based HIV programs were cost-saving: from 2005 to 2011, every dollar invested in these programs saved about $5. This study is an important first step in understanding the impact of investing in community-based HIV prevention programs in Ontario and recognizing the impact that these programs have had in reducing HIV infections and health care costs.

Building an Evaluation Framework for a Competency-Based Graduate Program at the University Of Southern Mississippi

ERIC Educational Resources Information Center

Gaudet, Cyndi H.; Annulis, Heather M.; Kmiec, John J., Jr.

2008-01-01

This article describes an ongoing project to build a comprehensive evaluation framework for the competency-based Master of Science in Workforce Training and Development (MSWTD) program at The University of Southern Mississippi (USM). First, it discusses some trends and issues in evaluating the performance of higher education programs in the United…

Solar energy program evaluation: an introduction

DOE Office of Scientific and Technical Information (OSTI.GOV)

deLeon, P.

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the rolemore » and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)« less

45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

Code of Federal Regulations, 2010 CFR

2010-10-01

... individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to Public Welfare (Continued) CORPORATION FOR NATIONAL AND COMMUNITY SERVICE SCHOOL-BASED SERVICE-LEARNING... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

Shortening the Miles to the Milestones: Connecting EPA-Based Evaluations to ACGME Milestone Reports for Internal Medicine Residency Programs.

PubMed

Choe, John H; Knight, Christopher L; Stiling, Rebekah; Corning, Kelli; Lock, Keli; Steinberg, Kenneth P

2016-07-01

The Next Accreditation System requires internal medicine training programs to provide the Accreditation Council for Graduate Medical Education (ACGME) with semiannual information about each resident's progress in 22 subcompetency domains. Evaluation of resident "trustworthiness" in performing entrustable professional activities (EPAs) may offer a more tangible assessment construct than evaluations based on expectations of usual progression toward competence. However, translating results from EPA-based evaluations into ACGME milestone progress reports has proven to be challenging because the constructs that underlay these two systems differ.The authors describe a process to bridge the gap between rotation-specific EPA-based evaluations and ACGME milestone reporting. Developed at the University of Washington in 2012 and 2013, this method involves mapping EPA-based evaluation responses to "milestone elements," the narrative descriptions within the columns of each of the 22 internal medicine subcompetencies. As faculty members complete EPA-based evaluations, the mapped milestone elements are automatically marked as "confirmed." Programs can maintain a database that tallies the number of times each milestone element is confirmed for a resident; these data can be used to produce graphical displays of resident progress along the internal medicine milestones.Using this count of milestone elements allows programs to bridge the gap between faculty assessments of residents based on rotation-specific observed activities and semiannual ACGME reports based on the internal medicine milestones. Although potentially useful for all programs, this method is especially beneficial to large programs where clinical competency committee members may not have the opportunity for direct observation of all residents.

The Discrepancy Evaluation Model: A Systematic Approach for the Evaluation of Career Planning and Placement Programs.

ERIC Educational Resources Information Center

Buttram, Joan L.; Covert, Robert W.

The Discrepancy Evaluation Model (DEM), developed in 1966 by Malcolm Provus, provides information for program assessment and program improvement. Under the DEM, evaluation is defined as the comparison of an actual performance to a desired standard. The DEM embodies five stages of evaluation based upon a program's natural development: program…

Building a community-based culture of evaluation.

PubMed

Janzen, Rich; Ochocka, Joanna; Turner, Leanne; Cook, Tabitha; Franklin, Michelle; Deichert, Debbie

2017-12-01

In this article we argue for a community-based approach as a means of promoting a culture of evaluation. We do this by linking two bodies of knowledge - the 70-year theoretical tradition of community-based research and the trans-discipline of program evaluation - that are seldom intersected within the evaluation capacity building literature. We use the three hallmarks of a community-based research approach (community-determined; equitable participation; action and change) as a conceptual lens to reflect on a case example of an evaluation capacity building program led by the Ontario Brian Institute. This program involved two community-based groups (Epilepsy Southwestern Ontarioand the South West Alzheimer Society Alliance) who were supported by evaluators from the Centre for Community Based Research to conduct their own internal evaluation. The article provides an overview of a community-based research approach and its link to evaluation. It then describes the featured evaluation capacity building initiative, including reflections by the participating organizations themselves. We end by discussing lessons learned and their implications for future evaluation capacity building. Our main argument is that organizations that strive towards a community-based approach to evaluation are well placed to build and sustain a culture of evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Evaluation and Research of Multi-Project Programs: Program Component Analysis.

ERIC Educational Resources Information Center

Baker, Eva L.

1977-01-01

It is difficult to base evaluations on concepts irrelevant to state policy making. Evaluation of a multiproject program requires both time and differentiation of method. Data from the California Early Childhood Program illustrate process variables for program component analysis, and research questions for intraprogram comparison. (CP)

A School-Based Dental Program Evaluation: Comparison to the Massachusetts Statewide Survey

ERIC Educational Resources Information Center

Culler, Corinna S.; Kotelchuck, Milton; Declercq, Eugene; Kuhlthau, Karen; Jones, Kari; Yoder, Karen M.

2017-01-01

Background: School-based dental programs target high-risk communities and reduce barriers to obtaining dental services by delivering care to students in their schools. We describe the evaluation of a school-based dental program operating in Chelsea, a city north of Boston, with a low-income and largely minority population, by comparing…

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

A systematic review of school-based suicide prevention programs.

PubMed

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

Housing First and Photovoice: Transforming Lives, Communities, and Systems

PubMed Central

Barile, John P.; Ogawa, Terry Yasuko; Peralta, Nelson; Bugg, Reumell; Lau, John; Lamberton, Thomas; Hall, Corazon; Mori, Victor

2018-01-01

This article presents findings from a community-based participatory evaluation of a Housing First program on the Island of O’ahu. In this study, clients in a Housing First program used Photovoice to evaluate the program and to advocate for progressive housing policies. Written together by members of the Housing First Photovoice group, this collaborative article describes the outcomes from both the Housing First program and the Photovoice project and demonstrates the ways in which participatory program evaluations can interact with client-driven programs like Housing First to produce a cumulative, transformative impact. Findings suggest that community psychologists hoping to re-engage with community mental health systems through enacting transformative change should consider taking a community-based participatory approach to program evaluation because increased client voice in community mental health programs and their evaluations can have far-reaching, transformative impacts for research, practice, and policy. PMID:29323410

Evaluating the Sharing Stories youth theatre program: an interactive theatre and drama-based strategy for sexual health promotion among multicultural youth.

PubMed

Roberts, Meagan; Lobo, Roanna; Sorenson, Anne

2017-03-01

Issue addressed Rates of sexually transmissible infections among young people are high, and there is a need for innovative, youth-focused sexual health promotion programs. This study evaluated the effectiveness of the Sharing Stories youth theatre program, which uses interactive theatre and drama-based strategies to engage and educate multicultural youth on sexual health issues. The effectiveness of using drama-based evaluation methods is also discussed. Methods The youth theatre program participants were 18 multicultural youth from South East Asian, African and Middle Eastern backgrounds aged between 14 and 21 years. Four sexual health drama scenarios and a sexual health questionnaire were used to measure changes in knowledge and attitudes. Results Participants reported being confident talking to and supporting their friends with regards to safe sex messages, improved their sexual health knowledge and demonstrated a positive shift in their attitudes towards sexual health. Drama-based evaluation methods were effective in engaging multicultural youth and worked well across the cultures and age groups. Conclusions Theatre and drama-based sexual health promotion strategies are an effective method for up-skilling young people from multicultural backgrounds to be peer educators and good communicators of sexual health information. Drama-based evaluation methods are engaging for young people and an effective way of collecting data from culturally diverse youth. So what? This study recommends incorporating interactive and arts-based strategies into sexual health promotion programs for multicultural youth. It also provides guidance for health promotion practitioners evaluating an arts-based health promotion program using arts-based data collection methods.

A review of elementary school-based substance use prevention programs: identifying program attributes.

PubMed

Hopfer, S; Davis, D; Kam, J A; Shin, Y; Elek, E; Hecht, M L

2010-01-01

This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary school-based substance use prevention programs were reviewed. The study selection criteria included searching for program evaluations from 1980 to 2008. Among 27 evaluation studies that examined program effects on substance use, 56% (n = 15) found significant decreases. In addition, programs most often demonstrated effects on increasing negative substance use attitudes, increasing knowledge, decreasing perceptions of prevalence rates (i.e., descriptive norms), and improving resistance skills. These results have implications for the appropriateness and value of introducing substance use prevention programs to youth in elementary school.

Examples of Sports-Based Youth Development Programs

ERIC Educational Resources Information Center

Berlin, Richard A.; Dworkin, Aaron; Eames, Ned; Menconi, Arn; Perkins, Daniel F.

2007-01-01

The authors provide examples of sports-based youth development programs and offer information about program mission and vision, program design and content, evaluation results, and program sustainability. The four sports-based youth development programs presented are Harlem RBI, Tenacity, Snowsports Outreach Society, and Hoops & Leaders…

An Agent-Based Cockpit Task Management System

NASA Technical Reports Server (NTRS)

Funk, Ken

1997-01-01

An agent-based program to facilitate Cockpit Task Management (CTM) in commercial transport aircraft is developed and evaluated. The agent-based program called the AgendaManager (AMgr) is described and evaluated in a part-task simulator study using airline pilots.

Stirring up the Mud: Using a Community-Based Participatory Approach to Address Health Disparities through a Faith-Based Initiative

PubMed Central

Kaplan, Sue A.; Ruddock, Charmaine; Golub, Maxine; Davis, Joyce; Foley, Robert; Devia, Carlos; Rosen, Rosa; Berry, Carolyn; Barretto, Brenda; Carter, Toni; Irish-Spencer, Evalina; Marchena, Maria; Purcaro, Ellenrita; Calman, Neil

2011-01-01

This case study provides a mid-course assessment of the Bronx Health REACH faith-based initiative four years into its implementation. The study uses qualitative methods to identify lessons learned and to reflect on the benefits and challenges of using a community-based participatory approach for the development and evaluation of a faith-based program designed to address health disparities. Key findings concern the role of pastoral leadership, the importance of providing a religious context for health promotion and health equality messages, the challenges of creating a bilingual/bi-cultural program, and the need to provide management support to the lay program coordinators. The study also identifies lessons learned about community-based evaluation and the importance of addressing community concern about the balance between evaluation and program. Finally, the study identifies the challenges that lie ahead, including issues of program institution-alization and sustainability. PMID:20168022

Assessing communications effectiveness in meeting corporate goals of public health organizations.

PubMed

Brown, Gordon D; Bopp, Kenneth D; Boren, Suzanne Austin

2005-01-01

Much evaluation of health communications in public health is considered from a program perspective of smoking cessation, weight reduction, education on sexually transmitted diseases, etc. These studies have advanced the knowledge base of communications theory and evaluation and have contributed to program effectiveness. In program-based evaluation the communications process is structured as part of the program itself. This article extends program-based communications evaluation to view communications from the perspective of the consumer and how effectively public health departments respond to consumer expectations. It develops a conceptual model for evaluating elements of communications such as its importance in defining mission and goals within the community, managing strategic constituencies, and enlisting individuals and groups as customers and co-producers of health. It gives a broader perspective on how communications in public heath organizations are managed and a basis for assessing whether they are being managed effectively.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Language Program Evaluation

ERIC Educational Resources Information Center

Norris, John M.

2016-01-01

Language program evaluation is a pragmatic mode of inquiry that illuminates the complex nature of language-related interventions of various kinds, the factors that foster or constrain them, and the consequences that ensue. Program evaluation enables a variety of evidence-based decisions and actions, from designing programs and implementing…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

ERIC Educational Resources Information Center

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Using Curriculum-Based Measurements for Program Evaluation: Expanding Roles for School Psychologists

ERIC Educational Resources Information Center

Tusing, Mary E.; Breikjern, Nicholle A.

2017-01-01

Educators increasingly need to evaluate schoolwide reform efforts; however, complex program evaluations often are not feasible in schools. Through a case example, we provide a heuristic for program evaluation that is easily replicated in schools. Criterion-referenced interpretations of schoolwide screening data were used to evaluate outcomes…

Pilot Evaluation of a Sexual Abuse Prevention Program for Taiwanese Children

ERIC Educational Resources Information Center

Chen, Yi-Chuen; Fortson, Beverly L.; Tseng, Kai-Wen

2012-01-01

The purpose of the current study was to develop and evaluate the efficacy of a school-based child sexual abuse prevention program for Taiwanese children. Forty-six Taiwanese children age 6 to 13 were divided into one of two groups based on their school grade and then randomly assigned to a skills-based child sexual abuse prevention program who…

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

ERIC Educational Resources Information Center

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Community outreach: from measuring the difference to making a difference with health information*

PubMed Central

Ottoson, Judith M.; Green, Lawrence W.

2005-01-01

Background: Community-based outreach seeks to move libraries beyond their traditional institutional boundaries to improve both access to and effectiveness of health information. The evaluation of such outreach needs to involve the community in assessing the program's process and outcomes. Purpose: Evaluation of community-based library outreach programs benefits from a participatory approach. To explain this premise of the paper, three components of evaluation theory are paired with relevant participatory strategies. Concepts: The first component of evaluation theory is also a standard of program evaluation: use. Evaluation is intended to be useful for stakeholders to make decisions. A useful evaluation is credible, timely, and of adequate scope. Participatory approaches to increase use of evaluation findings include engaging end users early in planning the program itself and in deciding on the outcomes of the evaluation. A second component of evaluation theory seeks to understand what is being evaluated, such as specific aspects of outreach programs. A transparent understanding of the ways outreach achieves intended goals, its activities and linkages, and the context in which it operates precedes any attempt to measure it. Participatory approaches to evaluating outreach include having end users, such as health practitioners in other community-based organizations, identify what components of the outreach program are most important to their work. A third component of evaluation theory is concerned with the process by which value is placed on outreach. What will count as outreach success or failure? Who decides? Participatory approaches to valuing include assuring end-user representation in the formulation of evaluation questions and in the interpretation of evaluation results. Conclusions: The evaluation of community-based outreach is a complex process that is not made easier by a participatory approach. Nevertheless, a participatory approach is more likely to make the evaluation findings useful, ensure that program knowledge is shared, and make outreach valuing transparent. PMID:16239958

Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

PubMed Central

Burrus, Barri B.; Scott, Alicia Richmond

2012-01-01

Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541

Process evaluation of the Enabling Mothers toPrevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial.

PubMed

Knowlden, Adam P; Sharma, Manoj

2014-09-01

Family-and-home-based interventions are an important vehicle for preventing childhood obesity. Systematic process evaluations have not been routinely conducted in assessment of these interventions. The purpose of this study was to plan and conduct a process evaluation of the Enabling Mothers to Prevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial. The trial was composed of two web-based, mother-centered interventions for prevention of obesity in children between 4 and 6 years of age. Process evaluation used the components of program fidelity, dose delivered, dose received, context, reach, and recruitment. Categorical process evaluation data (program fidelity, dose delivered, dose exposure, and context) were assessed using Program Implementation Index (PII) values. Continuous process evaluation variables (dose satisfaction and recruitment) were assessed using ANOVA tests to evaluate mean differences between groups (experimental and control) and sessions (sessions 1 through 5). Process evaluation results found that both groups (experimental and control) were equivalent, and interventions were administered as planned. Analysis of web-based intervention process objectives requires tailoring of process evaluation models for online delivery. Dissemination of process evaluation results can advance best practices for implementing effective online health promotion programs. © 2014 Society for Public Health Education.

Evaluation of Achieving a College Education Plus: A Credit-Based Transition Program

ERIC Educational Resources Information Center

Luna, Gaye; Fowler, Michael

2011-01-01

This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to…

Getting Teachers in on the Act: Evaluation of a Theater- and Classroom-Based Youth Violence Prevention Program

ERIC Educational Resources Information Center

Zucker, Marla; Spinazzola, Joseph; Pollack, Amie Alley; Pepe, Lauren; Barry, Stephanie; Zhang, Lynda; van der Kolk, Bessel

2010-01-01

This study replicated and extended our previous evaluation of Urban Improv (UI), a theater-based youth violence prevention (YVP) program developed for urban youth. It assessed the replicability of positive program impacts when implemented by nonprogram originators, as well as the utility of a comprehensive version of the UI program that included a…

Connect: An Effective Community-Based Youth Suicide Prevention Program

ERIC Educational Resources Information Center

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

Improving the Impact and Implementation of Disaster Education: Programs for Children Through Theory-Based Evaluation.

PubMed

Johnson, Victoria A; Ronan, Kevin R; Johnston, David M; Peace, Robin

2016-11-01

A main weakness in the evaluation of disaster education programs for children is evaluators' propensity to judge program effectiveness based on changes in children's knowledge. Few studies have articulated an explicit program theory of how children's education would achieve desired outcomes and impacts related to disaster risk reduction in households and communities. This article describes the advantages of constructing program theory models for the purpose of evaluating disaster education programs for children. Following a review of some potential frameworks for program theory development, including the logic model, the program theory matrix, and the stage step model, the article provides working examples of these frameworks. The first example is the development of a program theory matrix used in an evaluation of ShakeOut, an earthquake drill practiced in two Washington State school districts. The model illustrates a theory of action; specifically, the effectiveness of school earthquake drills in preventing injuries and deaths during disasters. The second example is the development of a stage step model used for a process evaluation of What's the Plan Stan?, a voluntary teaching resource distributed to all New Zealand primary schools for curricular integration of disaster education. The model illustrates a theory of use; specifically, expanding the reach of disaster education for children through increased promotion of the resource. The process of developing the program theory models for the purpose of evaluation planning is discussed, as well as the advantages and shortcomings of the theory-based approaches. © 2015 Society for Risk Analysis.

Creating an Information Literacy Badges Program in Blackboard: A Formative Program Evaluation

ERIC Educational Resources Information Center

Tunon, Johanna; Ramirez, Laura Lucio; Ryckman, Brian; Campbell, Loy; Mlinar, Courtney

2015-01-01

A formative program evaluation using Stufflebeam's (2010) Context, Input, Process, Product (CIPP) model was conducted to assess the use of digital badges for tracking basic library instructional skills across academic programs at Nova Southeastern University. Based on the evaluation of pilot library modules and Blackboard Learn's badges…

Home-Start between Childhood and Maturity: A Programme Evaluation.

ERIC Educational Resources Information Center

Terpstra, Linda; van Dijke, Anke

A crucial question for evaluating nationally or internationally implemented programs is whether local adaptations detract from program quality and effectiveness. An evaluation examined the program successes and challenges encountered in the first 5 years of Home-Start in the Netherlands, a home-based family support program for families with young…

Is Evaluative Research on Youth Suicide Programs Theory-Driven? The Canadian Experience.

ERIC Educational Resources Information Center

Breton, Jean-Jacques; Boyer, Richard; Bilodeau, Henriette; Raymond, Sylvaine; Joubert, Natacha; Nantel, Marie-Andree

2002-01-01

A review found that only 15 Canadian youth suicide programs were evaluated over the last decade. Descriptions of the programs were incomplete and theoretical bases for programs were not presented. Only two programs led to a reduction in suicidal behavior. Suggests that future evaluative research needs to place greater emphasis on content and…

Hui Malama O Ke Kai: A Positive Prevention-Based Youth Development Program Based on Native Hawaiian Values and Activities

ERIC Educational Resources Information Center

Hishinuma, Earl S.; Chang, Janice Y.; Sy, Angela; Greaney, Malia F.; Morris, Katherine A.; Scronce, Ami C.; Rehuher, Davis; Nishimura, Stephanie T.

2009-01-01

Evaluation of after-school programs that are culturally and place-based and promote positive youth development among minority and indigenous youths has not been widely published. The present evaluation is the first of its kind of an after-school, youth-risk prevention program called Hui Malama O Ke Kai (HMK), that emphasizes Native Hawaiian values…

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

PubMed

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric rehabilitation have been studied without an extensive process evaluation. The findings of this process evaluation will have implications for clinical practice and further research regarding development and application of home-based bimanual training programs, executed by parents and aimed at improving activity performance and participation of children with uCP.

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

Evaluation of the Professional Development Program on Web Based Content Development

ERIC Educational Resources Information Center

Yurdakul, Bünyamin; Uslu, Öner; Çakar, Esra; Yildiz, Derya G.

2014-01-01

The aim of this study is to evaluate the professional development program on web based content development (WBCD) designed by the Ministry of National Education (MoNE). Based on the theoretical CIPP model by Stufflebeam and Guskey's levels of evaluation, the study was carried out as a case study. The study group consisted of the courses that…

Evaluation of the Academic Occupational Program of the County of Leduc, From September, 1981 to June, 1984. Executive Summary.

ERIC Educational Resources Information Center

Nyberg, V. R.

The paper reports results of an academic occupational program intended for educable mentally handicapped and learning disabled secondary students in Leduc, Alberta. An introduction reviews history of the program and the evaluation process. The evaluation plan, based on R. Stake's model for program evaluation, is described, and sources of data…

Program Evaluation: Two Management-Oriented Samples

ERIC Educational Resources Information Center

Alford, Kenneth Ray

2010-01-01

Two Management-Oriented Samples details two examples of the management-oriented approach to program evaluation. Kenneth Alford, a doctorate candidate at the University of the Cumberlands, details two separate program evaluations conducted in his school district and seeks to compare and contrast the two evaluations based upon the characteristics of…

School-Based Smoking Prevention with Media Literacy: A Pilot Study

ERIC Educational Resources Information Center

Bier, Melinda C.; Schmidt, Spring J.; Shields, David; Zwarun, Lara; Sherblom, Stephen; Pulley, Cynthia; Rucker, Billy

2011-01-01

School-based tobacco prevention programs have had limited success reducing smoking rates in the long term. Media literacy programs offer an innovative vehicle for delivery of potentially more efficacious anti-tobacco education. However, these programs have been neither widely implemented nor well evaluated. We conducted a pre-post evaluation of a…

Outcome Evaluation of a Community Center-Based Program for Mothers at High Psychosocial Risk

ERIC Educational Resources Information Center

Rodrigo, Maria Jose; Maiquez, Maria Luisa; Correa, Ana Delia; Martin, Juan Carlos; Rodriguez, Guacimara

2006-01-01

Objective: This study reported the outcome evaluation of the "Apoyo Personal y Familiar" (APF) program for poorly-educated mothers from multi-problem families, showing inadequate behavior with their children. APF is a community-based multi-site program delivered through weekly group meetings in municipal resource centers. Method: A total…

The effectiveness of laser and radar based enforcement programs for deterrence of speeding

DOT National Transportation Integrated Search

1997-02-01

This report documents the results of a study to determine the community-wide effectiveness of laser-based speed enforcement programs relative to radar-based programs. Jurisdiction-wide speeding enforcement programs were implemented and evaluated in t...

Intervention mapping: a process for developing theory- and evidence-based health education programs.

PubMed

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Evaluation of a peer assessment approach for enhancing the organizational capacity of state injury prevention programs.

PubMed

Hunter, Wanda M; Schmidt, Ellen R; Zakocs, Ronda

2005-01-01

To conduct a formative and pilot impact evaluation of the State Technical Assessment Team (STAT) program, a visitation-based (visitatie) peer assessment program designed to enhance the organizational capacity of state health department injury prevention programs. The formative evaluation was based on observational, record review, and key informant interview data collected during the implementation of the first 7 STAT visits. Pilot impact data were derived from semi-structured interviews with state injury prevention personnel one year after the visit. Formative evaluation identified 6 significant implementation problems in the first visits that were addressed by the program planners, resulting in improvements to the STAT assessment protocol. Impact evaluation revealed that after one year, the 7 state injury prevention programs had acted on 81% of the recommendations received during their STAT visits. All programs reported gains in visibility and credibility within the state health department and increased collaboration and cooperation with other units and agencies. Other significant program advancements were also reported. Specific program standards and review procedures are important to the success of peer assessment programs such as STAT. Early impact evaluation suggests that peer assessment protocols using the visitatie model can lead to gains in organizational capacity.

A Program Evaluation Tool for Dual Enrollment Transition Programs

ERIC Educational Resources Information Center

Grigal, Meg; Dwyre, Amy; Emmett, Joyce; Emmett, Richard

2012-01-01

This article describes the development and use of a program evaluation tool designed to support self-assessment of college-based dual enrollment transition programs serving students with intellectual disabilities between the ages of 18-21 in college settings. The authors describe the need for such an evaluation tool, outline the areas addressed by…

Applying the Concept of Trustworthiness to the Evaluation of a Clinical Program.

ERIC Educational Resources Information Center

Barzansky, Barbara; And Others

An attending tutor program designed to increase faculty-student contact within an Obstetrics and Gynecology clerkship was evaluated. Sessions were observed, written documents were reviewed, and faculty and students were interviewed in order to determine if the program was meeting its goals. Based on the evaluation data, the program was…

Competency-based goals, objectives, and linked evaluations for rheumatology training programs: a standardized template of learning activities from the Carolinas Fellows Collaborative.

PubMed

Criscione-Schreiber, Lisa G; Bolster, Marcy B; Jonas, Beth L; O'Rourke, Kenneth S

2013-06-01

American Council on Graduate Medical Education program requirements mandate that rheumatology training programs have written goals, objectives, and performance evaluations for each learning activity. Since learning activities are similar across rheumatology programs, we aimed to create competency-based goals and objectives (CBGO) and evaluations that would be generalizable nationally. Through an established collaboration of the 4 training programs' directors in North Carolina and South Carolina, we collaboratively composed CBGO and evaluations for each learning activity for rheumatology training programs. CBGO and linked evaluations were written using appropriate verbs based on Bloom's taxonomy. Draft documents were peer reviewed by faculty at the 4 institutions and by members of the American College of Rheumatology (ACR) Clinician Scholar Educator Group. We completed templates of CBGO for core and elective rotations and conferences. Templates detail progressive fellow performance improvement appropriate to educational level. Specific CBGO are mirrored in learning activity evaluations. Templates are easily modified to fit individual program attributes, have been successfully implemented by our 4 programs, and have proven their value in 4 residency review committee reviews. We propose adoption of these template CBGO by the ACR, with access available to all rheumatology training programs. Evaluation forms that exactly reflect stated objectives ensure that trainees are assessed using standardized measures and that trainees are aware of the learning expectations. The objectives mirrored in the evaluations closely align with the proposed milestones for internal medicine training, and will therefore be a useful starting point for creating these milestones in rheumatology. Copyright © 2013 by the American College of Rheumatology.

Positive youth development programs for adolescents with greater psychosocial needs: evaluation based on program implementers.

PubMed

Shek, Daniel T L; Ng, Catalina S M; Law, Moon Y M

2017-02-01

As program implementers' views are seldom included in program evaluation and there are few related studies in different Chinese communities, this study examined the perceptions of the program implementers who implemented the Tier 2 Program of the P.A.T.H.S. Program in Hong Kong. The Tier 2 Program was designed to promote the development of adolescents with greater psychosocial needs. In the community-based P.A.T.H.S. Project, 400 program implementers completed a subjective outcome evaluation form (Form D) for program implementers. Consistent with the previous findings, program implementers generally held positive views towards the program, implementers, and program effectiveness and their views towards these three domains did not differ across grades. In line with the hypotheses, perceived program quality and perceived implementer quality predicted program effectiveness. The present findings provided an alternative perspective showing that the Tier 2 Program was well received by the program implementers and they regarded the program to be beneficial to the program participants.

Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

PubMed Central

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

PubMed

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Lazy evaluation of FP programs: A data-flow approach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wei, Y.H.; Gaudiot, J.L.

1988-12-31

This paper presents a lazy evaluation system for the list-based functional language, Backus` FP in data-driven environment. A superset language of FP, called DFP (Demand-driven FP), is introduced. FP eager programs are transformed into DFP lazy programs which contain the notions of demands. The data-driven execution of DFP programs has the same effects of lazy evaluation. DFP lazy programs have the property of always evaluating a sufficient and necessary result. The infinite sequence generator is used to demonstrate the eager-lazy program transformation and the execution of the lazy programs.

A merged model of quality improvement and evaluation: maximizing return on investment.

PubMed

Woodhouse, Lynn D; Toal, Russ; Nguyen, Trang; Keene, DeAnna; Gunn, Laura; Kellum, Andrea; Nelson, Gary; Charles, Simone; Tedders, Stuart; Williams, Natalie; Livingood, William C

2013-11-01

Quality improvement (QI) and evaluation are frequently considered to be alternative approaches for monitoring and assessing program implementation and impact. The emphasis on third-party evaluation, particularly associated with summative evaluation, and the grounding of evaluation in the social and behavioral science contrast with an emphasis on the integration of QI process within programs or organizations and its origins in management science and industrial engineering. Working with a major philanthropic organization in Georgia, we illustrate how a QI model is integrated with evaluation for five asthma prevention and control sites serving poor and underserved communities in rural and urban Georgia. A primary foundation of this merged model of QI and evaluation is a refocusing of the evaluation from an intimidating report card summative evaluation by external evaluators to an internally engaged program focus on developmental evaluation. The benefits of the merged model to both QI and evaluation are discussed. The use of evaluation based logic models can help anchor a QI program in evidence-based practice and provide linkage between process and outputs with the longer term distal outcomes. Merging the QI approach with evaluation has major advantages, particularly related to enhancing the funder's return on investment. We illustrate how a Plan-Do-Study-Act model of QI can (a) be integrated with evaluation based logic models, (b) help refocus emphasis from summative to developmental evaluation, (c) enhance program ownership and engagement in evaluation activities, and (d) increase the role of evaluators in providing technical assistance and support.

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

ERIC Educational Resources Information Center

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

An Evaluation of a School-Based, Peer-Facilitated, Healthy Relationship Program for At-Risk Adolescents

ERIC Educational Resources Information Center

McLeod, David Axlyn; Jones, Robin; Cramer, Elizabeth P.

2015-01-01

There are few evaluations of peer-facilitated teenage dating violence prevention programs in the literature. To begin to address this gap, this project assessed the effectiveness of a school-based, peer-facilitated healthy relationships program among academically at-risk students. Two hundred and ninety-one ninth graders of mixed race and gender…

The Role of Formative Research in Evaluating Specific Curriculum-Based Television Programs at the Primary Level.

ERIC Educational Resources Information Center

Teachman, Goody; Zuckernick, Arlene

Formative research of Math Patrol, curriculum-based television program in mathematics at the primary level, was carried out as part of a research and evaluation project at the Ontario Educational Communications Authority (OECA). The series, which utilizes plasticene animations, consists of 15-minute magazine format programs which introduce and…

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

ERIC Educational Resources Information Center

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

ERIC Educational Resources Information Center

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-01-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of…

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

PubMed

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

[Process evaluation in relation to effectiveness assessment: experiences with school-based programs].

PubMed

Ariza, Carles; Villalbí, Joan R; Sánchez-Martínez, Francesca; Nebot, Manel

2011-06-01

Evaluation of public health interventions usually focus on the quality of design and research methods, and less on the quality of the intervention or process evaluation. In process evaluation of school-based interventions, key issues are how completely the intervention is carried out and adherence to the protocol. In addition, exploration of intermediate variables, such as those that influence (and often predict) preventable behavior, is highly useful. This article describes the basic concepts in this topic, using examples of the effectiveness of some preventive interventions carried out in schools. The interventions discussed were mainly quasi-experimental studies, based on data from programs promoted by public health teams in the city of Barcelona. Data from process evaluation of preventive programs in secondary schools that underwent formal assessment of their effectiveness is provided. The examples are drawn from preventive programs of HIV infection or unprotected sexual intercourse (PRESSEC program) and drug consumption prevention (the PASE, PASE.bcn and x kpts programs). These examples show why the intervention process influences the impact of the programs and their results. Thorough planning of process evaluation is essential to obtain valid indicators that will identify, in the effectiveness evaluation of the intervention, the most efficacious strategies to obtain positive outcomes. Copyright © 2011 Sociedad Española de Salud Pública y Administración Sanitaria. Published by Elsevier Espana. All rights reserved.

Evaluation of a School-Based Asthma Education Protocol: "Iggy and the Inhalers"

ERIC Educational Resources Information Center

Mickel, Catherine F.; Shanovich, Kathleen K.; Evans, Michael D.; Jackson, Daniel J.

2017-01-01

School-based asthma education offers an opportunity to reach low-income children at risk for poor asthma control. "Iggy and the Inhalers" (Iggy) is an asthma education program that was implemented in a Midwest metropolitan school district. The purpose of this evaluation was to conduct a comprehensive program evaluation. Objectives…

Development and Implementation of a Web-based Evaluation System for an Internal Medicine Residency Program.

ERIC Educational Resources Information Center

Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.

2001-01-01

Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…

Research and Evaluation in Operational Competency-Based Teacher Education Programs.

ERIC Educational Resources Information Center

Dickson, George E., Ed.

1975-01-01

This is a collection of papers presented at a 1974 conference on research and evaluation in operational competency-based teacher education (CBTE) programs. Two conceptual models for research and evaluation of CBTE activities were presented at the conference and the presentations of these models are the first two chapters of this collection: "A…

Traditional versus rule-based programming techniques - Application to the control of optional flight information

NASA Technical Reports Server (NTRS)

Ricks, Wendell R.; Abbott, Kathy H.

1987-01-01

A traditional programming technique for controlling the display of optional flight information in a civil transport cockpit is compared to a rule-based technique for the same function. This application required complex decision logic and a frequently modified rule base. The techniques are evaluated for execution efficiency and implementation ease; the criterion used to calculate the execution efficiency is the total number of steps required to isolate hypotheses that were true and the criteria used to evaluate the implementability are ease of modification and verification and explanation capability. It is observed that the traditional program is more efficient than the rule-based program; however, the rule-based programming technique is more applicable for improving programmer productivity.

Evaluation of Career Development Programs from an Action Perspective.

ERIC Educational Resources Information Center

Young, Richard A.; Valach, Ladislav

1994-01-01

Presents action-theoretical approach to evaluation of career development programs based on constructionist epistemology. Propositions from action-theoretical perspective center around career and action as related, interpretative constructs. Propositions give rise to implications for evaluation of career programs that address ongoing nature of…

Evaluation of an employer-sponsored pedometer-based physical activity program.

PubMed

Behrens, Timothy K; Domina, Lorie; Fletcher, Gena M

2007-12-01

This study evaluated a competition-based employer-sponsored physical activity program using pedometers. City employees (N approximately 2,600) formed teams in groups of 10 persons (N = 640). The groups competed against each other over a 12-wk. period with the goal of attaining 10,000 steps per day, per person. Only teams with complete data were included in the formal evaluation. A repeated-measures analysis of variance indicated significant differences in team steps by week of the program, with post hoc comparisons indicating significant differences from baseline step counts evident during Weeks 6-8 but not at the end of the program. These data confirm that competition-based physical activity programs using pedometers may not be an effective means of increasing the long-term physical activity of employees.

Do State Pre-K Programs Improve Children's Pre-Literacy and Math Learning? Evaluation Science Brief

ERIC Educational Resources Information Center

National Forum on Early Childhood Program Evaluation, 2008

2008-01-01

"Evaluation Science Briefs" summarize the findings and implications of a recent study evaluating the effects of an early childhood program or environment. This Brief evaluates the study "An Effectiveness-Based Evaluation of Five State Pre-Kindergarten Programs" (V. C. Wong, T. D. Cook, W. S. Barnett, and K. Jung.) States have high aspirations for…

Participants' perceptions of the 1997-1998 Missouri State Parks Passport Program

Treesearch

Yi-Jin Ye; Jaclyn Card

2002-01-01

Service quality is increasingly important to park managers. Recreation and park evaluation measures the implementation and outcome of programs for decision-making. Decisions based on evaluations are often concerned with improving the quality of the program for participants. The purpose of the study was to evaluate the Missouri State Parks Passport Program (MSPPP) by...

An Evaluation of On-Line, Interactive Tutorials Designed to Teach Practice Concepts

ERIC Educational Resources Information Center

Seabury, Brett A.

2005-01-01

This paper presents an evaluation of two on-line-based programs designed to teach practice skills. One program teaches crisis intervention and the other teaches suicide assessment. The evaluation of the use of these programs compares outcomes for two groups of students, one using the interactive program outside a class context and the other using…

45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 4 2012-10-01 2012-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 4 2011-10-01 2011-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 4 2013-10-01 2013-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

45 CFR 2516.840 - By what standards will the Corporation evaluate individual Learn and Serve America programs?

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 4 2014-10-01 2014-10-01 false By what standards will the Corporation evaluate individual Learn and Serve America programs? 2516.840 Section 2516.840 Public Welfare Regulations Relating to... Learn and Serve America programs? The Corporation will evaluate programs based on the following: (a) The...

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

NASA Technical Reports Server (NTRS)

Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

PubMed

Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

2017-07-01

In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P < .01). Larger programs were more likely to teach (P = .04) and evaluate (P = .02) community-based research. Experiential learning and classroom-based didactics were the most frequent teaching methodologies. Many programs used multiple teaching methodologies for all competencies. Observation was the most frequent evaluation technique used; portfolio review and written reflection were also commonly reported. Our findings show a strong emphasis on community pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

An Evaluation of Knowledge Transfer from Microworld Programming to Conventional Programming

ERIC Educational Resources Information Center

Xinogalos, Stelios

2012-01-01

Programming microworlds are being used for introducing students to programming for many years. Although many professors and school teachers report positive results from using programming microwords, these results are usually based on anecdotal evidence rather than rigorous empirical evaluation. A question that has not been answered yet with…

Planning, Implementation, and Evaluation of AIDS Education Programs for Dentists.

ERIC Educational Resources Information Center

Gerbert, Barbara; And Others

1991-01-01

An office-based continuing education program on acquired immune deficiency syndrome (AIDS) for dentists is described, including needs assessment, model development, local piloting, national implementation with 119 dentists, and evaluation phases. Program evaluation indicated an improvement in risk perception, knowledge, and practice resulted, but…

Critical Measurement Issues in Translational Research

ERIC Educational Resources Information Center

Glasgow, Russell E.

2009-01-01

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Evaluation of Hospital-Based Palliative Care Programs.

PubMed

Hall, Karen Lynn; Rafalson, Lisa; Mariano, Kathleen; Michalek, Arthur

2016-02-01

This study evaluated current hospital-based palliative care programs using recommendations from the Center to Advance Palliative Care (CAPC) as a framework. Seven hospitals located in Buffalo, New York were included based on the existence of a hospital-based palliative care program. Data was collected from August through October of 2013 by means of key informant interviews with nine staff members from these hospitals using a guide comprised of questions based on CAPC's recommendations. A gap analysis was conducted to analyze the current state of each hospital's program based upon CAPC's definition of a quality palliative care program. The findings identify challenges facing both existing/evolving palliative care programs, and establish a foundation for strategies to attain best practices not yet implemented. This study affirms the growing availability of palliative care services among these selected hospitals along with opportunities to improve the scope of services in line with national recommendations. © The Author(s) 2014.

Teacher Education Program Evaluation: An Annotated Bibliography and Guide to Research.

ERIC Educational Resources Information Center

Ayers, Jerry B.; Berney, Mary F.

This book includes an annotated bibliography of the essentials needed to conduct an effective evaluation of a teacher education program. Specific information on evaluation includes: (1) general evaluation techniques, (2) evaluation of candidates and students, (3) evaluation of the knowledge base, (4) quality controls, (5) evaluation of laboratory…

The Use of Multiple Evaluation Approaches in Program Evaluation

ERIC Educational Resources Information Center

Bledsoe, Katrina L.; Graham, James A.

2005-01-01

The authors discuss the use of multiple evaluation approaches in conducting program evaluations. Specifically, they illustrate four evaluation approaches (theory-driven, consumer-based, empowerment, and inclusive evaluation) and briefly discuss a fifth (use-focused evaluation) as a side effect of the use of the others. The authors also address the…

Insourcing, Not Capacity Building, a Better Model for Sustained Program Evaluation

ERIC Educational Resources Information Center

Miller, Thomas I.; Kobayashi, Michelle M.; Noble, Paula M.

2006-01-01

Community-based organizations (CBOs), typically small and underfunded with transient staff members, are told by funders to care for clients and verify program value. To assist CBOs with evaluations that speak to program effectiveness, many funders wish to expand the evaluation capacity of CBO staff members so that evaluation will occur as long as…

An overview of the effectiveness and efficiency of HIV prevention programs.

PubMed Central

Holtgrave, D R; Qualls, N L; Curran, J W; Valdiserri, R O; Guinan, M E; Parra, W C

1995-01-01

Because of the enormity of the HIV-AIDS epidemic and the urgency for preventing transmission, HIV prevention programs are a high priority for careful and timely evaluations. Information on program effectiveness and efficiency is needed for decision-making about future HIV prevention priorities. General characteristics of successful HIV prevention programs, programs empirically evaluated and found to change (or not change) high-risk behaviors or in need of further empirical study, and economic evaluations of certain programs are described and summarized with attention limited to programs that have a behavioral basis. HIV prevention programs have an impact on averting or reducing risk behaviors, particularly when they are delivered with sufficient resources, intensity, and cultural competency and are based on a firm foundation of behavioral and social science theory and past research. Economic evaluations have found that some of these behaviorally based programs yield net economic benefits to society, and others are likely cost-effective (even if not cost-saving) relative to other health programs. Still, specific improvements should be made in certain HIV prevention programs. PMID:7630989

What Works for Whom? A Bayesian Approach to Channeling Big Data Streams for Public Program Evaluation

ERIC Educational Resources Information Center

Finucane, Mariel McKenzie; Martinez, Ignacio; Cody, Scott

2018-01-01

In the coming years, public programs will capture even more and richer data than they do now, including data from web-based tools used by participants in employment services, from tablet-based educational curricula, and from electronic health records for Medicaid beneficiaries. Program evaluators seeking to take full advantage of these data…

Decreasing Heavy Drinking in First-Year Students: Evaluation of a Web-Based Personalized Feedback Program Administered during Orientation

ERIC Educational Resources Information Center

Doumas, Diana M.; Kane, Christina M.; Navarro, Tabitha B.; Roman, Jennifer

2011-01-01

This study evaluated the effectiveness of a web-based personalized normative feedback program, electronic Check-Up to Go (e-CHUG), in decreasing heavy drinking among 1st-year university students. Results indicated high-risk students receiving the e-CHUG program during 1st-year orientation activities reported significantly greater reductions in…

A Model-Based Evaluation of a Cultural Mediator Outreach Program for HIV+ Ethiopian Immigrants in Israel.

ERIC Educational Resources Information Center

Kaplan, Edward H.; Soskolne, Varda; Adler, Bella; Leventhal, Alex; Shtarkshall, Ronny A.

2002-01-01

Conducted a model-based evaluation of a program designed to reduce HIV transmission from HIV-infected Ethiopian immigrants in Israel. Focused on pregnancy rate reduction as a measure of sexual exposure. Results for 145 female and 176 male clients in the intervention suggest reduction in unprotected sexual exposures among program participants. (SLD)

Effective Practices for Evaluating Education and Public Outreach Programs

NASA Astrophysics Data System (ADS)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Evaluator's Guide for Microcomputer-Based Instructional Packages. Developed by MicroSIFT, a Project of the Computer Technology Program. Sixth Revision.

ERIC Educational Resources Information Center

Northwest Regional Educational Lab., Portland, OR.

This guide developed by MicroSIFT, a clearinghouse for microcomputer-based educational software and courseware, provides background information and forms to aid teachers and other educators in evaluating available microcomputer courseware. The evaluation process comprises six stages: (1) sifting, which screens out those programs that are not…

EVALUATION OF THE REAL-TIME AIR-QUALITY MODEL USING THE RAPS (REGIONAL AIR POLLUTION STUDY) DATA BASE. VOLUME 3. PROGRAM USER'S GUIDE

EPA Science Inventory

The theory and programming of statistical tests for evaluating the Real-Time Air-Quality Model (RAM) using the Regional Air Pollution Study (RAPS) data base are fully documented in four volumes. Moreover, the tests are generally applicable to other model evaluation problems. Volu...

Practical experience from the Office of Adolescent Health's large scale implementation of an evidence-based Teen Pregnancy Prevention Program.

PubMed

Margolis, Amy Lynn; Roper, Allison Yvonne

2014-03-01

After 3 years of experience overseeing the implementation and evaluation of evidence-based teen pregnancy prevention programs in a diversity of populations and settings across the country, the Office of Adolescent Health (OAH) has learned numerous lessons through practical application and new experiences. These lessons and experiences are applicable to those working to implement evidence-based programs on a large scale. The lessons described in this paper focus on what it means for a program to be implementation ready, the role of the program developer in replicating evidence-based programs, the importance of a planning period to ensure quality implementation, the need to define and measure fidelity, and the conditions necessary to support rigorous grantee-level evaluation. Published by Elsevier Inc.

Student Assistance Program in Pennsylvania. Evaluation Final Report.

ERIC Educational Resources Information Center

Fertman, Carl I.; Schlesinger, Jo; Fichter, Cele; Tarasevich, Susan; Zhang, Xiaoyan; Wald, Holly

This report contains the second year evaluation of the Student Assistance Program (SAP) in Pennsylvania. These school-based and school-linked programs address barriers to learning for youth at risk for social and emotional problems, drug and alcohol use and abuse, and depression. Second year evaluation focused on identifying essential components…

Field and Simulator Evaluations of a PC-Based Attention Maintenance Training Program

DOT National Transportation Integrated Search

2011-07-01

This report presents the results of three research studies regarding driver distraction from the forward roadway due to : secondary in-vehicle tasks. Study 1 included the development and evaluation of a PC-based training program named : FOrward Conce...

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

PubMed

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

A Structure and Scheme for the Evaluation of Innovative Programs. The EPIC Brief, Issue No. 2.

ERIC Educational Resources Information Center

Objective evaluation of school programs is a process in which a school staff collects information used to provide feedback as to whether or not a given set of objectives has been met. The Evaluative Programs for Innovativ e Curriculums (EPIC) four-step scheme of objective evaluation is based on a three-dimensional structure of variables…

Evaluation of drug interaction microcomputer software: comparative study.

PubMed

Poirier, T I; Giudici, R

1991-01-01

Twelve drug interaction microcomputer software programs were evaluated and compared using general and specific criteria. This article summarizes and compares the features, ratings, advantages, and disadvantages of each program. Features of an ideal drug interaction program are noted. Recommended programs based on three price ranges are suggested.

Which BRCA genetic testing programs are ready for implementation in health care? A systematic review of economic evaluations.

PubMed

D'Andrea, Elvira; Marzuillo, Carolina; De Vito, Corrado; Di Marco, Marco; Pitini, Erica; Vacchio, Maria Rosaria; Villari, Paolo

2016-12-01

There is considerable evidence regarding the efficacy and effectiveness of BRCA genetic testing programs, but whether they represent good use of financial resources is not clear. Therefore, we aimed to identify the main health-care programs for BRCA testing and to evaluate their cost-effectiveness. We performed a systematic review of full economic evaluations of health-care programs involving BRCA testing. Nine economic evaluations were included, and four main categories of BRCA testing programs were identified: (i) population-based genetic screening of individuals without cancer, either comprehensive or targeted based on ancestry; (ii) family history (FH)-based genetic screening, i.e., testing individuals without cancer but with FH suggestive of BRCA mutation; (iii) familial mutation (FM)-based genetic screening, i.e., testing individuals without cancer but with known familial BRCA mutation; and (iv) cancer-based genetic screening, i.e., testing individuals with BRCA-related cancers. Currently BRCA1/2 population-based screening represents good value for the money among Ashkenazi Jews only. FH-based screening is potentially very cost-effective, although further studies that include costs of identifying high-risk women are needed. There is no evidence of cost-effectiveness for BRCA screening of all newly diagnosed cases of breast/ovarian cancers followed by cascade testing of relatives, but programs that include tools for identifying affected women at higher risk for inherited forms are promising. Cost-effectiveness is highly sensitive to the cost of BRCA1/2 testing.Genet Med 18 12, 1171-1180.

Formative process evaluation for implementing a social marketing intervention to increase walking among African Americans in the Positive Action for Today's Health trial.

PubMed

Coulon, Sandra M; Wilson, Dawn K; Griffin, Sarah; St George, Sara M; Alia, Kassandra A; Trumpeter, Nevelyn N; Wandersman, Abraham K; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-12-01

Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today's Health trial. We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities.

The Reality of Evaluating Community-Based Sport and Physical Activity Programs to Enhance the Development of Underserved Youth: Challenges and Potential Strategies

ERIC Educational Resources Information Center

Whitley, Meredith A.; Forneris, Tanya; Barker, Bryce

2014-01-01

In recent years, underserved communities have received much attention within the field of positive youth development (PYD). While there are an increasing number of opportunities for underserved youth to join PYD-based programs, there is growing concern surrounding the lack of critical evaluation of these programs (Kidd, 2008). Unfortunately, there…

School-based obesity prevention: a blueprint for taming the epidemic.

PubMed

Baranowski, Tom; Cullen, Karen W; Nicklas, Theresa; Thompson, Deborah; Baranowski, Janice

2002-01-01

To review the literature on school-based obesity prevention programs to identify what can be done to minimize the increasing levels of obesity. Twenty articles reporting school-based dietary or physical activity change programs were identified that used BMI or skinfolds as part of the evaluation. Seven studies obtained change in BMI and differed from those not finding change in 3 ways: program implementers were not classroom teachers; intervention targeted middle or high schools; and inactivity reduction was promoted. An 8-step research strategy was delineated to develop and evaluate programs with a maximum chance of taming the obesity epidemic.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

PubMed

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centred Instructional Program in Indonesia

ERIC Educational Resources Information Center

Rahayu, Sri; Chandrasegaran, A. L.; Treagust, David F.; Kita, Masakazu; Ibnu, Suhadi

2011-01-01

This study was a mixed quantitative-qualitative research to evaluate the efficacy of a designed student-centred instructional (DSCI) program for teaching about acids and bases. The teaching innovation was designed based on constructivist, hands-on inquiry and context-based approaches and implemented in seven 45-min lessons with a class of 36 grade…

Evaluating the Effectiveness of the 2001-2002 NASA CONNECT(tm) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.; Williams, Amy C.

2002-01-01

NASA CONNECT(tm) is a research and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6-8. Respondents who evaluated the programs in the 2001-2002 NASA CONNECT(tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Evaluating the Effectiveness of the 2002-2003 NASA CONNECT(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Lambert, Matthew A.; Williams, Amy C.

2004-01-01

NASA CONNECT is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6 8. Respondents who evaluated the programs in the 2002 2003 NASA CONNECT series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

An Evaluation of the Nutrition Education and Training Program: Project Summary.

ERIC Educational Resources Information Center

St. Pierre, Robert G.

This project summary reviews and extends the findings of prior reports made by Abt Associates, Inc. (Cambridge, Massachusetts) on the Nutrition Education and Training (NET) program, synthesizes evaluation efforts in nutrition education, and presents a set of conclusions based on the evaluations of nutrition programs. Chapter 1 presents background…

Evaluation development for a physical activity positive youth development program for girls.

PubMed

Ullrich-French, Sarah; Cole, Amy N; Montgomery, Anna K

2016-04-01

Girls on the Run (GOTR) is an after school program for girls in third through fifth grade which utilizes a physical activity based positive youth development curriculum that culminates with completing a 5K run. Unfortunately, there is little empirical data documenting GOTR participant changes that align with the curriculum and describe the evaluation process. Therefore, this study presents an evaluation of GOTR consisting of three main processes: curriculum content analysis and stakeholder focus groups (N=11) to identify key outcomes of the program; community-based participatory research to collaborate with program personnel to further identify important outcomes; and the design and pilot testing of an instrument (N=104) for assessing changes in the theoretically grounded outcomes over time. Findings demonstrated a positive collaborative process that led to important information to be used for an impact evaluation of Girls on the Run and for future evaluation development efforts for physical activity based positive youth development. Copyright © 2015 Elsevier Ltd. All rights reserved.

Improving Literacy Achievement for English Learners in Transitional Bilingual Programs.

ERIC Educational Resources Information Center

Saunders, William M.

1999-01-01

Reports on the development and evaluation of a transitional bilingual program for grades 2 through 5. Evaluation results based on achievement of 42 students and 42 comparisons show that the program is more effective than the transition program students typically receive. Discusses implications for education of English learners. (SLD)

Oasis Connections: Results from an Evaluation Study

ERIC Educational Resources Information Center

Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-01-01

Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

Criteria for Evaluating Advancement Programs.

ERIC Educational Resources Information Center

Heemann, Warren, Ed.

Criteria for evaluating college and university advancement programs are presented, based on the efforts of professional area trustees and advisory committees of the Council for Advancement and Support of Education (CASE). The criteria can be useful in three ways: as the basis of internal audits of advancement programs or program components; as the…

Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

PubMed Central

Pound, Catherine M.; Moreau, Katherine A.; Ward, Natalie; Eady, Kaylee; Writer, Hilary

2015-01-01

Background Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE) program. Methods We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes. PMID:26059213

Factors that affect implementation of web-based faculty evaluation forms: residents' perspectives from a developing country.

PubMed

Ibrahim, S H; Ali, S K; Sadaf, S

2010-08-01

A web-based evaluation system for residents to provide feedback on faculty was piloted in four training programs at the Aga Khan University prior to institution-wide implementation. Of the four programs, less than 50% of forms were submitted by residents of three programs while more than 70% of forms were submitted by the residents of one program. This study was conducted to identify reasons for the varying participation rates of the four programs with a view to improving the system. A qualitative approach was employed using focus group discussions (FGDs). Volunteers were invited and three groups of eight to ten residents each were formed. Participants for FGDs were selected from all residency years. FGDs were used to identify residents' perceptions regarding the web-based faculty evaluation system and to identify residents' problems and concerns with completing the web-based faculty evaluating forms. Technical issues in completing and submitting the forms online were identified to be the main deterrents to completing the evaluation forms. Non-accessibility of a resource person for resolving technical problems with the software and the burden of taking time out to complete the forms were considered as limiting factors by many residents. Residents recommended a focused orientation session to the new system within the departments. Residents' confidence and support are key to promoting adequate participation in web-based evaluations. Focused orientation sessions, reinforcement, reminders, assurances of confidentiality, and removal of technical glitches should help to improve resident participation.

Evaluation of freeway motorist assist program : final report, September 30, 2009.

DOT National Transportation Integrated Search

2010-02-01

This evaluation of the Motorist Assist (MA) program in St. Louis estimated that MA has an annual benefit-cost ratio (B/C) of 38.25:1 using 2009 dollars. This estimate was based on nationally accepted AASHTO methodology and was based on 1082 secondary...

The Evaluation of School-Based Violence Prevention Programs: A Meta-Analysis

ERIC Educational Resources Information Center

Park-Higgerson, Hyoun-Kyoung; Perumean-Chaney, Suzanne E.; Bartolucci, Alfred A.; Grimley, Diane M.; Singh, Karan P.

2008-01-01

Background: Youth violence and related aggressive behaviors have become serious public health issues with physical, economic, social, and psychological impacts and consequences. This study identified and evaluated the characteristics of successful school-based violence prevention programs. Methods: Twenty-six randomized controlled trial (RCT),…

A program and data base for evaluating SMMR algorithms

NASA Technical Reports Server (NTRS)

1979-01-01

A program (PARAM) is described which enables a user to compare the values of meteorological parameters derived from data obtained by the scanning multichannel microwave radiometer (SMMR) instrument on NIMBUS 7 with surface observations made over the ocean. The input to this program is a data base, also described, which contains the surface observations and coincident SMMR data. The evaluation of meteorological parameters using SMMR data is done by a user supplied subroutine. Instruments are given for executing the program and writing the subroutine.

An Evaluative Overview of the Gloria Floyd Community School Academic Excellence Program.

ERIC Educational Resources Information Center

Dade County Public Schools, Miami, FL. Office of Educational Accountability.

The Gloria Floyd Academic Excellence Program (AEP) was designed as a school-based enrichment program for average and above-average students in grades one through six. The evaluation of this program involved discussions with the school administrator and program teacher, as well as a questionnaire-survey of AEP students, their parents, and regular…

A Value-Added Approach to Selecting the Best Master of Business Administration (MBA) Program

ERIC Educational Resources Information Center

Fisher, Dorothy M.; Kiang, Melody; Fisher, Steven A.

2007-01-01

Although numerous studies rank master of business administration (MBA) programs, prospective students' selection of the best MBA program is a formidable task. In this study, the authors used a linear-programming-based model called data envelopment analysis (DEA) to evaluate MBA programs. The DEA model connects costs to benefits to evaluate the…

Is abstinence education theory based? The underlying logic of abstinence education programs in Texas.

PubMed

Goodson, Patricia; Pruitt, B E; Suther, Sandy; Wilson, Kelly; Buhi, Eric

2006-04-01

Authors examined the logic (or the implicit theory) underlying 16 abstinence-only-until-marriage programs in Texas (50% of all programs funded under the federal welfare reform legislation during 2001 and 2002). Defined as a set of propositions regarding the relationship between program activities and their intended outcomes, program staff's implicit theories were summarized and compared to (a) data from studies on adolescent sexual behavior, (b) a theory-based model of youth abstinent behavior, and (c) preliminary findings from the national evaluation of Title V programs. Authors interviewed 62 program directors and instructors and employed selected principles of grounded theory to analyze interview data. Findings indicated that abstinence education staff could clearly articulate the logic guiding program activity choices. Comparisons between interview data and a theory-based model of adolescent sexual behavior revealed striking similarities. Implications of these findings for conceptualizing and evaluating abstinence-only-until-marriage (or similar) programs are examined.

The social construction of "evidence-based'' drug prevention programs: a reanalysis of data from the Drug Abuse Resistance Education (DARE) program.

PubMed

Gorman, Dennis M; Huber, J Charles

2009-08-01

This study explores the possibility that any drug prevention program might be considered ;;evidence-based'' given the use of data analysis procedures that optimize the chance of producing statistically significant results by reanalyzing data from a Drug Abuse Resistance Education (DARE) program evaluation. The analysis produced a number of statistically significant differences between the DARE and control conditions on alcohol and marijuana use measures. Many of these differences occurred at cutoff points on the assessment scales for which post hoc meaningful labels were created. Our results are compared to those from evaluations of programs that appear on evidence-based drug prevention lists.

Evaluating AIDS Prevention: Contributions of Multiple Disciplines.

ERIC Educational Resources Information Center

Leviton, Laura C., Ed.; And Others

1990-01-01

Seven essays on efforts of evaluate prevention programs aimed at the acquired immune deficiency syndrome (AIDS) are presented. Topics include public health psychology, mathematical models of epidemiology, estimates of incubation periods, ethnographic evaluations of AIDS prevention programs, an AIDS education model, theory-based evaluation, and…

Alternative Education: Evaluation and Implementation of EBCE.

ERIC Educational Resources Information Center

Shively, Joe E.; Sanders, Jack

Increasing student disenchantment with traditional schooling prompted the development of an alternative educational program: Experience-Based Career Education (EBCE). During three years of development, evaluation provided student, parent, and employer data on program impact and effectiveness. Stakeholders' involvement in program development and…

Alternatives to Piloting Textbooks.

ERIC Educational Resources Information Center

Muther, Connie

1985-01-01

Using short-term pilot programs to evaluate textbooks can lead to unreliable results and interfere with effective education. Alternative methods for evaluating textbook-based programs include obtaining documented analyses of competitors' products from sales agents, visiting districts using programs being considered, and examining publishers' own…

Management Data Base Development.

ERIC Educational Resources Information Center

Dan, Robert L.

1975-01-01

A management data base is seen as essential for a management information system, program budgeting, program costing, management by objectives, program evaluation, productivity measures, and accountability in institutions of higher education. The necessity of a management data base is addressed, along with the benefits and limitations it may have…

Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

ERIC Educational Resources Information Center

Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

2014-01-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…

What does a Performance Measurement System Tell Us about the National Comprehensive Cancer Control Program?

PubMed Central

Townsend, Julie S.; Moore, Angela R.; Mulder, Tiffani N.; Boyd, Mary

2015-01-01

Context The National Comprehensive Cancer Control Program (NCCCP) performance measurement system seeks to understand both the processes that funded programs undertake with their respective coalitions to implement the objectives of their cancer plans and outcomes of those efforts. Objective To identify areas of achievement and technical assistance needs of NCCCP awardees. Design Program performance was assessed through surveys completed by program directors on performance indicators in 2009 and 2010 and queries from a web-based management information system in 2011 and 2012. Setting Programs funded by CDC’s NCCCP. Participants 69 programs. Main Outcome Measure(s) The key performance measures assessed were: inclusion of diverse partners and key sectors in cancer coalitions; partners’ involvement in activities; receiving in-kind resources from partners; using evidence-based interventions and data for setting priorities; conducting program evaluation; using community- or organization-level strategies to address cancer control efforts; and demonstrating progress toward achieving health outcomes. Results Most programs reported having active coalitions that represent diverse organizational sectors. Nearly all programs routinely assess the burden of cancer. In-kind resources to implement activities peaked at $64,716 in the second year of a five year funding cycle, and declined in subsequent project years. By year 3, over 70% of programs reported having an evaluation plan. While programs reported that nearly two-thirds of their interventions were evidence-based, some programs implemented non-evidence-based interventions. A majority of programs successfully used at least one community- or organization-level change strategy. However, many programs did not incorporate objectives linked to health outcomes as they reported progress in implementing interventions. Conclusions: While NCCCP programs were strong at building and maintaining infrastructure, some programs may need additional technical assistance to increase the adoption of evidence-based interventions, develop solid and responsive evaluation plans, and better link efforts to population-based measures that demonstrate impact toward reducing the burden of cancer. PMID:25136936

Pilot Evaluation of the Feasibility and Acceptability of StressOFF Strategies: A Single-Session School-Based Stress Management Program for Adolescents

ERIC Educational Resources Information Center

Shapiro, Amy J.; Heath, Nancy L.; Carsley, Dana

2016-01-01

The present study reports the pilot evaluation of the feasibility and acceptability of StressOFF Strategies, a "single-session" (45 min) adolescent-targeted, school-based psychoeducational program, which introduces cognitive behavioral techniques and mindfulness-based techniques. Five hundred and sixty-five Grade 9 students (57% female;…

Curriculum-Based Vocational Assessment of Students with Special Needs at the Middle School/Junior High School Levels: The Practical Arts Evaluation System (PAES).

ERIC Educational Resources Information Center

Swisher, Judy; Clark, Gary M.

1991-01-01

Describes the Practical Arts Evaluation System (PAES), a curriculum-based vocational assessment program for students with special needs at the middle school/junior high school level. Provides a rationale for curriculum-based assessment and occupational exploration at this level and describes benefits of the program. (Author/JOW)

Formative Evaluations of a Web-Based Masters Program: Insights for Web-Based Course Developers.

ERIC Educational Resources Information Center

Shih, Ching-Chun; Howard, Marvin; Thompson, Ann D.

The purpose of this paper is to report on the various formative evaluation activities that have been conducted for the Masters of Science in Agronomy Distance Education Program at Iowa State University and to provide useful recommendations for educators involved in World Wide Web-based course development. It was found that those faculty members…

COMMUNITY-BASED WATERSHED MANAGEMENT: CREATING A TOOL FOR PROGRAM EVALUATION AND DESIGN

EPA Science Inventory

The criteria will be assembled into a manual to be used by community organizers, academics, managers, or policy makers in evaluating community-based watershed management initiatives and in designing new watershed management programs. The case study will also be added to the b...

Evaluation of a Spiritually Based Child Maltreatment Prevention Training Program

ERIC Educational Resources Information Center

Baker, Louisa K.; Rigazio-DiGilio, Sandra A.

2013-01-01

The authors empirically evaluated a spiritually based 1-day child maltreatment training program. Pretest, posttest, and follow-up results indicated that participants' recognition of hypothetical maltreatment did not increase after training. Furthermore, although participants decreased their use of items known to dissuade decisions to report, they…

Program Evaluation in the Arts. An Annotated Bibliography.

ERIC Educational Resources Information Center

Wildemuth, Barbara M., Comp.; Eichinger, Debra S., Comp.

This 56-item annotated bibliography gives teachers and administrators access to information on the evaluation of school fine arts programs. Based upon a computer search of the Educational Resources Information Center (ERIC) data base, it cites project reports, journal articles, and dissertations published from 1963 to 1976. Citations of elementary…

The Effectiveness of Adapted Versions of an Evidence-based Prevention Program in Reducing Alcohol Use among Alternative School Students

PubMed Central

Hopson, Laura M.; Holleran Steiker, Lori K.

2010-01-01

Although there is a strong evidence base for effective substance abuse prevention programs for youth, there is a need to facilitate the implementation and evaluation of these programs in real world settings. This study evaluates the effectiveness of adapted versions of an evidence-based prevention program, keepin’ it REAL (kiR), with alternative school students. Programs are often adapted when used in schools and other community settings for a variety of reasons. The kiR adaptations, developed during an earlier phase of this study, were created to make the curriculum more appropriate for alternative high school youth. The adaptations were evaluated using a quasi-experimental design in which questionnaires were administered at pretest, posttest, and follow-up, and focus groups were conducted at posttest. MANOVA analyses indicate significantly reduced intentions to accept alcohol and, for younger participants, reduced alcohol use. Focus group data support the need for age appropriate prevention content. The authors discuss implications for practitioners implementing prevention programs in schools. PMID:20622971

77 FR 59197 - Epilepsy Program

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-26

... evidence-based strategies to achieve the legislative purpose of the program. As a result of the evaluation... newly published Institute of Medicine recommendations for the Epilepsies, focusing on evaluating...

INSREC: Computational System for Quantitative Analysis of Radiation Effects Covering All Radiation Field

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dong Hoon Shin; Young Wook Lee; Young Ho Cho

2006-07-01

In the nuclear energy field, there are so many difficult things that even people who are working in this field are not much familiar with, such as, Dose evaluation, Dose management, etc. Thus, so many efforts have been done to achieve the knowledge and data for understanding. Although some data had been achieved, the applications of these data to necessary cases were more difficult job. Moreover, the type of Dose evaluation program until now was 'Console type' which is not easy enough to use for the beginners. To overcome the above causes of difficulties, the window-based integrated program and databasemore » management were developed in our research lab. The program, called as INSREC, consists of four sub-programs as follow; INSREC-NOM, INSREC-ACT, INSREC-MED, and INSREC-EXI. In ICONE 11 conference, INSREC-program(ICONE-36203) which can evaluates on/off-site dose of nuclear power plant in normal operation was introduced. Upgraded INSREC-program which will be presented in ICONE 14 conference has three additional codes comparing with pre-presented INSREC-program. Those subprograms can evaluate on/off-site Dose of nuclear power plant in accident cases. And they also have the functions of 'Dose evaluation and management' in the hospital and provide the 'Expert system' based on knowledge related to nuclear energy/radiation field. The INSREC-NOM, one of subprograms, is composed of 'Source term evaluation program', 'Atmospheric diffusion factor evaluation program', 'Off-site dose evaluation program', and 'On-site database program'. The INSREC-ACT is composed of 'On/Off-site dose evaluation program' and 'Result analysis program' and the INSREC-MED is composed of 'Workers/patients dose database program' and 'Dose evaluation program for treatment room'. The final one, INSREC-EXI, is composed of 'Database searching program based on artificial intelligence', 'Instruction program,' and 'FAQ/Q and A boards'. Each program was developed by using of Visual C++, Microsoft Access mainly. To verify the reliability, some suitable programs were selected such as AZAP and Stardose programs for the comparison. The AZAP program was selected for the on/off-site dose evaluation during the normal operation of nuclear reactor and Stardose program was used for the on/off-site dose evaluation in accident. The MCNP code was used for the dose evaluation and management in the hospital. Each comparison result was acceptable in errors analysis. According to the reliable verification results, it was concluded that INSREC program had an acceptable reliability for dose calculation and could give many proper dada for the sites. To serve the INSREC to people, the proper server system was constructed. We gave chances for the people (user) to utilize the INSREC through network connected to server system. The reactions were pretty much good enough to be satisfied. For the future work, many efforts will be given to improve the better user-interface and more necessary data will be provided to more people through database supplement and management. (authors)« less

Implementing and Evaluating School-Based Primary Prevention Programs and the Importance of Differential Effects on Outcomes

ERIC Educational Resources Information Center

Hussey, David L.; Flannery, Daniel J.

2007-01-01

In 2004, Second Step (Committee for Children, 2002), a violence prevention program, was implemented in the Cleveland Heights-University Heights school district for 1,416 K through second grade students. Both process and outcome measures were used to evaluate program impact and examine issues related to the implementation and evaluation of…

Regional Interstate Planning Project Program . . . Vol. IX. California Program Evaluation Improvement Project. Seminar Report.

ERIC Educational Resources Information Center

Dearmin, Evalyn, Ed.; And Others

Program evaluation strategies and techniques based on materials developed by the California Evaluation Improvement Project were discussed at this meeting of the Regional Interstate Planning Project (RIPP). RIPP members represent the State Departments of Education of ten western states, and have met periodically over the past nine years to discuss…

Improving Programs for the Preparation of Teachers through the Use of Program Evaluation--The Second Phase.

ERIC Educational Resources Information Center

Berney, Mary F.

Plans for the field-testing and implementation of the Accreditation Plus Model (APM) for evaluation of teacher preparation programs are described. Field-testing is taking place in the Center for Teacher Education Evaluation at Tennessee Technological University (Cookeville). The APM is based on the professional judgment approach to program…

Independent Evaluation of Middle School-Based Drug Prevention Curricula: A Systematic Review.

PubMed

Flynn, Anna B; Falco, Mathea; Hocini, Sophia

2015-11-01

Lack of robust program evaluation has hindered the effectiveness of school-based drug abuse prevention curricula overall. Independently evaluated randomized controlled trials (RCTs) of universal, middle school-based drug abuse prevention curricula are the most useful indicators of whether such programs are effective or ineffective. To conduct a systematic review identifying independently evaluated RCTs of universal, middle school-based drug abuse prevention curricula; extract data on study quality and substance use outcomes; and assess evidence of program effectiveness. PsycInfo, Educational Resources Information Center, Science Citation Index, Social Science Citation Index, Cumulative Index to Nursing and Allied Health Literature, MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews were searched between January 1, 1984, and March 15, 2015. Search terms included variations of drug, alcohol, tobacco, and marijuana use, as well as school, prevention, and effectiveness. Studies included in the review were RCTs carried out by independent evaluators of universal school-based drug prevention curricula available for dissemination in the United States that reported alcohol, tobacco, marijuana, or other drug use outcomes. Two researchers extracted data on study quality and outcomes independently using a data extraction form and met to resolve disagreements. A total of 5071 publications were reviewed, with 13 articles meeting final inclusion criteria. Of the 13 articles, 6 RCTs of 4 distinct school-based curricula were identified for inclusion. Outcomes were reported for 42 single-drug measures in the independent RCTs, with just 3 presenting statistically significant (P < .05) differences between the intervention group and the control group. One program revealed statistically significant positive effects at final follow-up (Lions-Quest Skills for Adolescence). The results of our review demonstrate the dearth of independent research that appropriately evaluates the effectiveness of universal, middle school-based drug prevention curricula. Independent evaluations show little evidence of effectiveness for widely used programs. New methods may be necessary to approach school-based adolescent drug prevention.

Evaluating a Web-Based Educational Module on Oral Cancer Examination Based on a Behavioral Framework.

PubMed

Wee, Alvin G; Zimmerman, Lani M; Pullen, Carol H; Allen, Carl M; Lambert, Paul M; Paskett, Electra D

2016-03-01

Patients at risk of developing oral and/or oropharyngeal cancer (OPC) are more likely to see primary care providers (PCPs) than a dentist. Many PCPs do not regularly perform oral cancer examination (OCE). The purpose of this study was to design a web-based educational program based on a behavioral framework to encourage PCPs to conduct OCE. PCPs were solicited to provide feedback on the program and to evaluate their short-term knowledge. The integrated behavioral model was used to design the program. Fifteen PCPs (five in each group: physicians, physician assistants, and nurse practitioners) reviewed the program and took a posttest: (1) index of knowledge of risk factors for oral cancer (RiskOC) and (2) index of knowledge of diagnostic procedures for oral cancer (DiagOC). Findings from the process evaluation were mainly positive, with comments on the length of the program comprising the ten negative comments. No significant difference among groups of PCPs (physicians, physician assistants, and nurse practitioners) was detected for DiagOC (p = 0.43) or RiskOC (p = 0.201). A program on OPC for PCPs should be less than 40 min. Postviewing knowledge outcomes were similar for all PCPs. The web-based program on OPC based on a behavioral framework could have similar short-term knowledge outcomes for all PCPs and may increase the number of PCPs performing OCEs.

A Review of Elementary School-Based Substance Use Prevention Programs: Identifying Program Attributes

ERIC Educational Resources Information Center

Hopfer, S.; Davis, D.; Kam, J. A.; Shin, Y.; Elek, E.; Hecht, M. L.

2010-01-01

This article takes a systematic approach to reviewing substance use prevention programs introduced in elementary school (K-6th grade). Previous studies evaluating such programs among elementary school students showed mixed effects on subsequent substance use and related psychosocial factors. Thirty published evaluation studies of 24 elementary…

Effects of the Saluda Prevention Program: A Review of Controlled Evaluation Studies

ERIC Educational Resources Information Center

Espada-Sánchez, José P.; Hernández-Serrano, Olga

2015-01-01

The objective of the present study is to review the evidence on the effectiveness concerning the Saluda program, a school-based substance use prevention protocol used amongst adolescents. We provide a description of the program content and the results from nine controlled trials evaluating the program effectiveness. Participants were Spanish…

Evaluation of the Olweus Bullying Prevention Program in Nine Urban Schools: Effective Practices and next Steps

ERIC Educational Resources Information Center

Black, Sally; Washington, Ericka

2008-01-01

The Olweus Bullying Prevention Program (BPP) is an internationally recognized school-based bullying prevention program. This project sought to evaluate pilot implementation of the program in one urban district using fidelity of implementation, bullying incident density (BID), student surveys, and serious incident reports as process and outcome…

House fire injury prevention update. Part II. A review of the effectiveness of preventive interventions

PubMed Central

Warda, L.; Tenenbein, M.; Moffatt, M.

1999-01-01

Objective—To evaluate and summarize the house fire injury prevention literature. Methods—MEDLINE (1983 to March 1997) was searched by keyword: fire, burn, etiology, cause, prevention, epidemiology, and smoke detector/alarm. ERIC (1966 to March 1997) and PSYCLIT (1974 to June 1997) were searched by keyword: as above, and safety, skills, education, and training. Other sources included references of retrieved publications, review articles, and books; Injury Prevention hand search; government documents; and internet sources. Sources relevant to residential fire injury prevention were selected, evaluated, and summarized. Results—Forty three publications were selected for review, including seven randomized controlled trials, nine quasiexperiments, two natural experiments, 21 prospective cohort studies, two cross sectional surveys, one case report, and one program evaluation. These studies examined the following types of interventions: school (9), preschool (1), and community based educational programs (5); fire response training programs for children (7), blind adolescents (2), and mentally retarded adults (5) and children (1); office based counseling (4); home inspection programs (3); smoke detector giveaway campaigns (5); and smoke detector legislation (1). Conclusions—This review of house fire prevention interventions underscores the importance of program evaluation. There is a need for more rigorous evaluation of educational programs, particularly those targeted at schools. An evidence based, coordinated approach to house fire injury prevention is critical, given current financial constraints and the potential for program overload for communities and schools. PMID:10518271

Guide Lines for Evaluation of Continuing Education Programs in Mental Health.

ERIC Educational Resources Information Center

Miller, Norma; And Others

Suggestions for program administrators and training program directors to develop comprehensive plans based on principles of community involvement, education, administration and finance, and the disciplines being taught are broadly outlined. Three accompanying charts illustrate approach to evaluation planning. (NF)

The development of a parenting program for incarcerated mothers in Australia: a review of prison-based parenting programs.

PubMed

Newman, Claire; Fowler, Cathrine; Cashin, Andrew

2011-08-01

The increasing population of children with an incarcerated parent is a significant public health issue. A literature search highlighted that children of incarcerated parents experience psychological stressors that may potentially impact on health and behavioural outcomes. Parenting programs for prisoners may be of benefit as early parenting experiences during childhood have a significant impact on a child's future experiences as an adolescent and adult. A review of identified evaluation-based studies of parenting programs for prisoners (N = 11), although varied in program delivery approaches and evaluation methods, suggest that such programs have the potential to improve the parenting skills, knowledge and confidence of incarcerated parents. Finally, this paper provides an outline of the development of an Australian based parenting program for incarcerated mothers and their young children.

Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

PubMed

Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

2015-02-01

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

Crossing boundaries: the design of an interdisciplinary training program to improve care for the frail elderly.

PubMed

Kolomitro, Klodiana; Stockley, Denise; Egan, Rylan; MacDonald, Michelle L

2015-01-01

The Technology Evaluation in the Elderly Network (TVN) was funded in July 2012 under the Canadian Networks of Centres of Excellence program. This article highlights the development and preliminary evaluation of the TVN Interdisciplinary Training Program. This program is based on an experiential learning approach that crosses a multitude of disciplines including health sciences, law, social sciences, and ethical aspects of working with the frail elderly. Opportunities within the program include mentorship, interdisciplinary online collaborative projects, external placements, academic products, pre-grant submission, trainee-driven requirements, Network meetings, online modules/webinars, and most importantly active involvement with patients, families, and their support systems. The authors have 120 trainees from approximately 23 different disciplines including law, ethics, public policy, social work, and engineering engaged in the program. Based on our evaluation this program has been perceived as highly valuable by the participants and the community.

Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting.

PubMed

Smith, Katherine; Firth, Kimberly; Smeeding, Sandra; Wolever, Ruth; Kaufman, Joanna; Delgado, Roxana; Bellanti, Dawn; Xenakis, Lea

2016-01-01

Research suggests that the development of mind-body skills can improve individual and family resilience, particularly related to the stresses of illness, trauma, and caregiving. To operationalize the research evidence that mind-body skills help with health and recovery, Samueli Institute, in partnership with experts in mind-body programming, created a set of guidelines for developing and evaluating mind-body programs for service members, veterans, and their families. The Guidelines for Creating, Implementing, and Evaluating Mind-Body Programs in a Military Healthcare Setting outline key strategies and issues to consider when developing, implementing, and evaluating a mind-body focused family empowerment approach in a military healthcare setting. Although these guidelines were developed specifically for a military setting, most of the same principles can be applied to the development of programs in the civilian setting as well. The guidelines particularly address issues unique to mind-body programs, such as choosing evidence-based modalities, licensure and credentialing, safety and contraindications, and choosing evaluation measures that capture the holistic nature of these types of programs. The guidelines are practical, practice-based guidelines, developed by experts in the fields of program development and evaluation, mind-body therapies, patient- and family-centered care, as well as, experts in military and veteran's health systems. They provide a flexible framework to create mind-body family empowerment programs and describe important issues that program developers and evaluators are encouraged to address to ensure the development of the most impactful, successful, evidence-supported programs possible. Copyright © 2016 Elsevier Inc. All rights reserved.

Evaluating the Effectiveness of the 2002-2003 NASA SCIence Files(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Lambert, Matthew A.; Williams, Amy C.

2004-01-01

NASA SCIence Files (tm) is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 60-minute instructional distance learning (television and web-based) programs for students in grades 3-5. Respondents who evaluated the programs in the 2002-2003 NASA SCIence Files (tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Historical context for the creation of the Office of Adolescent Health and the Teen Pregnancy Prevention Program.

PubMed

Kappeler, Evelyn M; Farb, Amy Feldman

2014-03-01

In Fiscal Year 2010, Federal funds were dedicated to support evidence-based approaches to effectively target teen pregnancy prevention and resulted in the establishment of the Office of Adolescent Health (OAH) and the Teen Pregnancy Prevention (TPP) Program. Through the tiered TPP Program, OAH supports replication and evaluation of programs using models whose effectiveness has been demonstrated through rigorous evaluation and the development and testing of promising or innovative pregnancy prevention strategies and approaches. This article documents the creation of OAH and the development of the TPP Program, the identification of a TPP evidence base, current program and evaluation efforts at OAH, and government coordination and partnerships related to reducing teen pregnancy. This article is of interest to those working to improve the health and wellbeing of adolescents. Published by Elsevier Inc.

Development, implementation, and evaluation of a multi-addiction prevention program for primary school students in Hong Kong: the B.E.S.T. Teen Program.

PubMed

Shek, Daniel T L; Yu, Lu; Leung, Hildie; Wu, Florence K Y; Law, Moon Y M

Based on the evaluation findings of the B.E.S.T. Teen Program which aimed at promoting behavioral, emotional, social, and thinking competencies in primary school students, it is argued in this paper that promotion of psychosocial competence to prevent addiction in primary school students is a promising strategy. A total of 382 Primary 5 (Grade 5) and 297 Primary 6 (Grade 6) students from five primary schools in Hong Kong participated in the program. Different evaluation strategies were adopted to evaluate the program. First, objective outcome evaluation adopting a non-equivalent group pretest-posttest experimental-control group design was conducted to examine change in the students. Second, to gauge students' perceptions of the program, subjective outcome evaluation was conducted. The evaluation findings basically converged to tentatively suggest that young adolescents benefited from participating in the program. Implications on the development, implementation, and evaluation of addiction prevention programs for teenagers are discussed.

Formative Process Evaluation for Implementing a Social Marketing Intervention to Increase Walking Among African Americans in the Positive Action for Today’s Health Trial

PubMed Central

Wilson, Dawn K.; Griffin, Sarah; St. George, Sara M.; Alia, Kassandra A.; Trumpeter, Nevelyn N.; Wandersman, Abraham K.; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-01-01

Objectives. Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today’s Health trial. Methods: We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Results: Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Conclusions: Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities. PMID:23078486

A Field-Based Curriculum Model for Earth Science Teacher-Preparation Programs.

ERIC Educational Resources Information Center

Dubois, David D.

1979-01-01

This study proposed a model set of cognitive-behavioral objectives for field-based teacher education programs for earth science teachers. It describes field experience integration into teacher education programs. The model is also applicable for evaluation of earth science teacher education programs. (RE)

Feasibility of the evidence-based cognitive telerehabilitation program Remind for patients with primary brain tumors.

PubMed

van der Linden, Sophie D; Sitskoorn, Margriet M; Rutten, Geert-Jan M; Gehring, Karin

2018-05-01

Many patients with primary brain tumors experience cognitive deficits. Cognitive rehabilitation programs focus on alleviating these deficits, but availability of such programs is limited. Our large randomized controlled trial (RCT) demonstrated positive effects of the cognitive rehabilitation program developed by our group. We converted the program into the iPad-based cognitive rehabilitation program ReMind, to increase its accessibility. The app incorporates psychoeducation, strategy training and retraining. This pilot study in patients with primary brain tumors evaluates the feasibility of the use of the ReMind-app in a clinical (research) setting in terms of accrual, attrition, adherence and patient satisfaction. The intervention commenced 3 months after resective surgery and patients were advised to spend 3 h per week on the program for 10 weeks. Of 28 eligible patients, 15 patients with presumed low-grade glioma or meningioma provided informed consent. Most important reason for decline was that patients (7) experienced no cognitive complaints. Participants completed on average 71% of the strategy training and 76% of the retraining. Some patients evaluated the retraining as too easy. Overall, 85% of the patients evaluated the intervention as "good" or "excellent". All patients indicated that they would recommend the program to other patients with brain tumors. The ReMind-app is the first evidence-based cognitive telerehabilitation program for adult patients with brain tumors and this pilot study suggests that postoperative cognitive rehabilitation via this app is feasible. Based on patients' feedback, we have expanded the retraining with more difficult exercises. We will evaluate the efficacy of ReMind in an RCT.

The evaluation of reproductive health PhD program in Iran: The input indicators analysis.

PubMed

AbdiShahshahani, Mahshid; Ehsanpour, Soheila; Yamani, Nikoo; Kohan, Shahnaz

2014-11-01

Appropriate quality achievement of a PhD program requires frequent assessment and discovering the shortcomings in the program. Inputs, which are important elements of the curriculum, are frequently missed in evaluations. The purpose of this study was to evaluate the input indicators of reproductive health PhD program in Iran based on the Context, Input, Process, and Product (CIPP) evaluation model. This is a descriptive and evaluative study based on the CIPP evaluation model. It was conducted in 2013 in four Iranian schools of nursing and midwifery of medical sciences universities. Statistical population consisted of four groups: heads of departments (n = 5), faculty members (n = 18), graduates (n = 12), and PhD students of reproductive health (n = 54). Data collection tools were five separate questionnaires including 37 indicators that were developed by the researcher. Content and face validity were evaluated based on the experts' indications. The Cronbach's alpha coefficient was calculated in order to obtain the reliability of the questionnaires. Collected data were analyzed by SPSS software. Data were analyzed by descriptive statistics (mean, frequency, percentage, and standard deviation), and one-way analysis of variance (ANOVA) and least significant difference (LSD) post hoc tests to compare means between groups. The results of the study indicated that the highest percentage of the heads of departments (80%), graduates (66.7%), and students (68.5%) evaluated the status of input indicators of reproductive health PhD program as relatively appropriate, while most of the faculties (66.7%) evaluated that as appropriate. It is suggested to explore the reasons for relatively appropriate evaluation of input indicators by further academic researches and improve the reproductive health PhD program accordingly.

The effectiveness of workshops on management evaluation of traffic safety programs.

DOT National Transportation Integrated Search

1977-01-01

Nine management evaluation workshops based on The Evaluation of Highway Traffic Safety Programs' A Manual for Managers were held in various cities throughout the United States by the Office of Manpower Development (NHTSA). The analysis reported here ...

Using Elite Athletes to Promote Drug Abstinence: Evaluation of a Single-Session School-Based Drug Use Prevention Program Delivered by Junior Hockey Players

ERIC Educational Resources Information Center

Wong, Jennifer

2016-01-01

School-based substance use prevention programs are a common method to approaching drug use in youths. Project SOS is a single-session drug prevention program developed by police officers and delivered by elite junior hockey players to students in grades 6 and 7. The current study evaluates the effects of Project SOS at achieving its objectives of…

Detecting selection effects in community implementations of family-based substance abuse prevention programs.

PubMed

Hill, Laura G; Goates, Scott G; Rosenman, Robert

2010-04-01

To calculate valid estimates of the costs and benefits of substance abuse prevention programs, selection effects must be identified and corrected. A supplemental comparison sample is typically used for this purpose, but in community-based program implementations, such a sample is often not available. We present an evaluation design and analytic approach that can be used in program evaluations of real-world implementations to identify selection effects, which in turn can help inform recruitment strategies, pinpoint possible selection influences on measured program outcomes, and refine estimates of program costs and benefits. We illustrate our approach with data from a multisite implementation of a popular substance abuse prevention program. Our results indicate that the program's participants differed significantly from the population at large.

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Standards Based Reform. Abbott Implementation Resource Guide

ERIC Educational Resources Information Center

Passantino, Claire; Kenyon, Susan

2004-01-01

The goal of this guide is to provide information, support and practical tools that may help educators design, implement, and evaluate their school's standards-based education program. In order to work, a comprehensive, standards-based educational program must, by definition, be the organizing structure upon which the school program operates.…

Teaming up for Literacy: Examining Participants' Contributions to a Collaborative Family-Based Program

ERIC Educational Resources Information Center

Kumar, Tracey

2016-01-01

This study of participants' contributions to a university-based family literacy program was informed by both "funds of knowledge" (Moll, 1992) and "multiple literacies" (Auerbach, 1995). The study examined participants' contributions to the design, implementation, and evaluation of a university-based family literacy program. In…

The Development of MUMPS-Based Rehabilitation Psychology Computer Applications.

ERIC Educational Resources Information Center

Dutro, Kenneth R.

The use of computer assisted programs in career exploration and occupational information is well documented. Various phases of the vocational counseling process, i.e., diagnostic evaluation, program planning, career exploration, case management, and program evaluation, offer similarly promising opportunities for computerization. Using the…

Theory-Based Evaluation Meets Ambiguity: The Role of Janus Variables

ERIC Educational Resources Information Center

Dahler-Larsen, Peter

2018-01-01

As theory-based evaluation (TBE) engages in situations where multiple stakeholders help develop complex program theory about dynamic phenomena in politically contested settings, it becomes difficult to develop and use program theory without ambiguity. The purpose of this article is to explore ambiguity as a fruitful perspective that helps TBE face…

Effective Practices in Community Based Family Literacy: Results of a National Research and Evaluation Project.

ERIC Educational Resources Information Center

Association for Community Based Education, Washington, DC.

A field evaluation of 14 community-based family and intergenerational literacy programs identified the most effective strategies, structures, and approaches to reach and teach the "hardest to reach." Information was collected through 90-minute telephone surveys with program coordinators and/or executive directors. Although different in structural…

76 FR 46831 - Notice of Submission of Proposed Information Collection to OMB Mortgagor's Certification of...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-03

... below has been submitted to the Office of Management and Budget (OMB) for review, as required by the... profits. Its use provides a base for evaluating housing programs, labor costs, and physical improvements... windfall profits. Its use provides a base for evaluating housing programs, labor costs, and physical...

Evaluation of a Community-Based Parenting Program with the Parents of Young Children.

ERIC Educational Resources Information Center

Brenner, Viktor; Nicholson, Bonnie C.; Fox, Robert A.

1999-01-01

Evaluated effectiveness of a cognitive-behavioral parenting program for parents of children ages 1 to 5 years offered through community-based family resource centers. Found that participants showed significant decreases in use of verbal and corporal punishment, and increases in nurturing behaviors as measured by the Parent Behavior Checklist.…

An Evaluation Model for Competency Based Teacher Preparatory Programs.

ERIC Educational Resources Information Center

Denton, Jon J.

This discussion describes an evaluation model designed to complement a curriculum development project, the primary goal of which is to structure a performance based program for preservice teachers. Data collected from the implementation of this four-phase model can be used to make decisions for developing and changing performance objectives and…

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

ERIC Educational Resources Information Center

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

A Review of Out-of-School Time Program Quasi-Experimental and Experimental Evaluation Results. Out-of-School Time Evaluation Snapshot.

ERIC Educational Resources Information Center

Little, Priscilla M. D.; Harris, Erin

As the amount of resources allocated to out-of-school (OST) programming and policymakers' demands for research-based results increase, there is increasing interest in rigorous research designs to examine OST program outcomes. This issue of "Out-of-School Time Evaluation Snapshots" reviews 27 quasi-experimental and experimental OST…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Analyzing the Assumptions of a Policy Program: An Ex-Ante Evaluation of "Educational Governance" in the Netherlands

ERIC Educational Resources Information Center

Janssens, Frans J. G.; de Wolf, Inge F.

2009-01-01

This article demonstrates the value of theoretical ex-ante evaluation of policy programs. We show how a specific policy might not achieve its objectives and illustrate the elements of the policy, which need improvement. These conclusions are based on a reconstruction and evaluation of the theory behind a policy program that aims to increase…

Methodological convergence of program evaluation designs.

PubMed

Chacón-Moscoso, Salvador; Anguera, M Teresa; Sanduvete-Chaves, Susana; Sánchez-Martín, Milagrosa

2014-01-01

Nowadays, the confronting dichotomous view between experimental/quasi-experimental and non-experimental/ethnographic studies still exists but, despite the extensive use of non-experimental/ethnographic studies, the most systematic work on methodological quality has been developed based on experimental and quasi-experimental studies. This hinders evaluators and planners' practice of empirical program evaluation, a sphere in which the distinction between types of study is changing continually and is less clear. Based on the classical validity framework of experimental/quasi-experimental studies, we carry out a review of the literature in order to analyze the convergence of design elements in methodological quality in primary studies in systematic reviews and ethnographic research. We specify the relevant design elements that should be taken into account in order to improve validity and generalization in program evaluation practice in different methodologies from a practical methodological and complementary view. We recommend ways to improve design elements so as to enhance validity and generalization in program evaluation practice.

Academic Quality Control: The Case of College Programs on Military Bases.

ERIC Educational Resources Information Center

Bailey, Stephen K.

The quality of college programs at 13 U.S. military bases and the activities of various agencies for maintaining quality control were evaluated. Based on site visits to military bases in the continental United States and Hawaii in 1978, some academic programs appeared to have few standards and practices that promote quality. It is claimed that…

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

PubMed Central

Van der Wees, Philip J; Hendriks, Erik JM; Custers, Jan WH; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-01-01

Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program. PMID:18036215

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

PubMed

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common. The AGREE criteria are common basis for the development of guidelines, although it is not clear how final decisions are made. Detailed comparison of the different guideline programs was used for updating the Dutch program. As a result the updated KNGF program complied with 22 AGREE criteria. International discussion is continuing and will be used for further improvement of the program.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Lessons from a Concurrent Evaluation of Eight Antibullying Programs Used in Sweden

ERIC Educational Resources Information Center

Flygare, Erik; Gill, Peter Edward; Johansson, Bjorn

2013-01-01

Sweden has a low prevalence of bullying and Swedish schools are legally obliged to have anti-bullying policies. Many commercial programs are available. A mixed methods, quasi-experimental, concurrent evaluation of 8 programs, chosen from a pool of 21 widely used anti-bullying programs, was planned. Preliminary data, based on 835 stakeholder…

A Comparison of Linear and Systems Thinking Approaches for Program Evaluation Illustrated Using the Indiana Interdisciplinary GK-12

ERIC Educational Resources Information Center

Dyehouse, Melissa; Bennett, Deborah; Harbor, Jon; Childress, Amy; Dark, Melissa

2009-01-01

Logic models are based on linear relationships between program resources, activities, and outcomes, and have been used widely to support both program development and evaluation. While useful in describing some programs, the linear nature of the logic model makes it difficult to capture the complex relationships within larger, multifaceted…

What Matters for Excellence in PhD Programs? Latent Constructs of Doctoral Program Quality Used by Early Career Social Scientists

ERIC Educational Resources Information Center

Morrison, Emory; Rudd, Elizabeth; Zumeta, William; Nerad, Maresi

2011-01-01

This paper unpacks how social science doctorate-holders come to evaluate overall excellence in their PhD training programs based on their domain-specific assessments of aspects of their programs. Latent class analysis reveals that social scientists 6-10 years beyond their PhD evaluate the quality of their doctoral program with one of two…

Social Work and Evaluation: Why You Might Be Interested in the American Evaluation Association Social Work Topical Interest Group

ERIC Educational Resources Information Center

Wharton, Tracy C.; Kazi, Mansoor A.

2012-01-01

With increased pressure on programs to evaluate outcomes, the issue of evaluation in social work has never been so topical. In response to these pressures, there has been a growing interest in evidence-based practice and strategies for the evaluation of social work programs. The American Evaluation Association (AEA) is an international…

The Role for an Evaluator: A Fundamental Issue for Evaluation of Education and Social Programs

ERIC Educational Resources Information Center

Luo, Heng

2010-01-01

This paper discusses one of the fundamental issues in education and social program evaluation: the proper role for an evaluator. Based on respective and comparative analysis of five theorists' positions on this fundamental issue, this paper reveals how different perspectives on other fundamental issues in evaluation such as value, methods, use and…

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

ERIC Educational Resources Information Center

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Evaluation of a Secure Laptop-Based Testing Program in an Undergraduate Nursing Program: Students' Perspective.

PubMed

Tao, Jinyuan; Gunter, Glenda; Tsai, Ming-Hsiu; Lim, Dan

2016-01-01

Recently, the many robust learning management systems, and the availability of affordable laptops, have made secure laptop-based testing a reality on many campuses. The undergraduate nursing program at the authors' university began to implement a secure laptop-based testing program in 2009, which allowed students to use their newly purchased laptops to take quizzes and tests securely in classrooms. After nearly 5 years' secure laptop-based testing program implementation, a formative evaluation, using a mixed method that has both descriptive and correlational data elements, was conducted to seek constructive feedback from students to improve the program. Evaluation data show that, overall, students (n = 166) believed the secure laptop-based testing program helps them get hands-on experience of taking examinations on the computer and gets them prepared for their computerized NCLEX-RN. Students, however, had a lot of concerns about laptop glitches and campus wireless network glitches they experienced during testing. At the same time, NCLEX-RN first-time passing rate data were analyzed using the χ2 test, and revealed no significant association between the two testing methods (paper-and-pencil testing and the secure laptop-based testing) and students' first-time NCLEX-RN passing rate. Based on the odds ratio, however, the odds of students passing NCLEX-RN the first time was 1.37 times higher if they were taught with the secure laptop-based testing method than if taught with the traditional paper-and-pencil testing method in nursing school. It was recommended to the institution that better quality of laptops needs to be provided to future students, measures needed to be taken to further stabilize the campus wireless Internet network, and there was a need to reevaluate the Laptop Initiative Program.

Evaluating the social and economic impact of community-based prenatal care.

PubMed

Cramer, Mary E; Chen, Li-Wu; Roberts, Sara; Clute, Dorothea

2007-01-01

This article describes the evaluation and findings of a community-based prenatal care program, Omaha Healthy Start (OHS), designed to reduce local racial disparities in birth outcomes. This evaluative study used a comparative descriptive design, and Targeting Outcomes of Programs was the conceptual framework for evaluation. The evaluation followed 3 groups for 2 years: OHS birth mothers (N=79; N=157); non-OHS participant birth mothers (N=746; N=774); and Douglas County birth mothers (N=7,962; N=7,987). OHS provided case management, home visits, screening, referral, transportation, and health education to participants. Program outcome measures included low birth weight, infant mortality, adequacy of care, trimester of care, and costs of care. OHS birth outcomes improved during year 2, and there was a 31% cost saving in the average hospital expenditure compared with the nonparticipant groups. Preliminary evaluative analysis indicates that prenatal case management and community outreach can improve birth outcomes for minority women, while producing cost savings. Further prospective study is needed to document trends over a longer period of time regarding the relationship between community-based case management programs for minority populations, birth outcomes, and costs of care.

E-simulation: preregistration nursing students' evaluation of an online patient deterioration program.

PubMed

Cant, Robyn; Young, Susan; Cooper, Simon J; Porter, Joanne

2015-03-01

This study explores preregistration nursing students' views of a Web-based simulation program: FIRST ACTWeb (Feedback Incorporating Review and Simulation Techniques to Act on Clinical Trends-Web). The multimedia program incorporating three videoed scenarios portrayed by a standardized patient (human actor) aims to improve students' recognition and management of hospital patient deterioration. Participants were 367 final-year nursing students from three universities who completed an online evaluation survey and 19 students from two universities who attended one of five focus groups. Two researchers conducted a thematic analysis of the transcribed narratives. Three core themes identified were as follows: "ease of program use," "experience of e-Simulation," and "satisfaction with the learning experience." The Web-based clinical learning environment was endorsed as functional, feasible, and easy to use and was reported to have high fidelity and realism. Feedback in both focus groups and surveys showed high satisfaction with the learning experience. Overall, evaluation suggested that the Web-based simulation program successfully integrated elements essential for blended learning. Although Web-based educational applications are resource intensive to develop, positive appraisal of program quality, plus program accessibility and repeatability, appears to provide important educational benefits. Further research is needed to determine the transferability of these learning experiences into real-world practice.

School-based sleep education program improves sleep and academic performance of school-age children.

PubMed

Gruber, Reut; Somerville, Gail; Bergmame, Lana; Fontil, Laura; Paquin, Soukaina

2016-05-01

The objective of this study was to develop and evaluate the effectiveness of a school-based sleep education program aimed at improving the sleep and academic performance of school-age children. Using a community-based participatory research approach, we created a school-based sleep education program, "Sleep for Success"™ (SFS), composed of four distinct modules that addressed the children, their family and community, the school staff, and decision makers within the school setting. Implementation was carried out in three elementary schools. Seventy-one students participated in the evaluation of the program. The effectiveness of the SFS program was evaluated using non-randomized controlled before-and-after study groups (intervention and control) assessed over two time points (pre- and post-program implementation). Before (baseline) and after implementation, sleep and academic performance were measured using actigraphy and report card marks, respectively. In the intervention group, true sleep was extended by 18.2 min per night, sleep efficiency improved by 2.3%, and sleep latency was shortened by 2.3 min, and report card grades in mathematics and English improved significantly. No changes were noted in the control group. Participation in the sleep education program was associated with significant improvements in children's sleep and academic performance. Copyright © 2016 Elsevier B.V. All rights reserved.

A constructive Indian country response to the evidence-based program mandate.

PubMed

Walker, R Dale; Bigelow, Douglas A

2011-01-01

Over the last 20 years governmental mandates for preferentially funding evidence-based "model" practices and programs has become doctrine in some legislative bodies, federal agencies, and state agencies. It was assumed that what works in small sample, controlled settings would work in all community settings, substantially improving safety, effectiveness, and value-for-money. The evidence-based "model" programs mandate has imposed immutable "core components," fidelity testing, alien programming and program developers, loss of familiar programs, and resource capacity requirements upon tribes, while infringing upon their tribal sovereignty and consultation rights. Tribal response in one state (Oregon) went through three phases: shock and rejection; proposing an alternative approach using criteria of cultural appropriateness, aspiring to evaluability; and adopting logic modeling. The state heard and accepted the argument that the tribal way of knowing is different and valid. Currently, a state-authorized tribal logic model and a review panel process are used to approve tribal best practices for state funding. This constructive response to the evidence-based program mandate elevates tribal practices in the funding and regulatory world, facilitates continuing quality improvement and evaluation, while ensuring that practices and programs remain based on local community context and culture. This article provides details of a model that could well serve tribes facing evidence-based model program mandates throughout the country.

Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

PubMed

Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

2014-12-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

ERIC Educational Resources Information Center

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

The State of Evaluation in Internal Medicine Residency

PubMed Central

Holmboe, Eric; Beasley, Brent W.

2008-01-01

Background There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations. Objective To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation. Design Nationwide survey. Participants All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM). Measurements Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods. Results The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods. Conclusions Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high. PMID:18612734

Evaluating Practice-Based Learning.

PubMed

Logue, Nancy C

2017-03-01

Practice-based learning is an essential aspect of nursing education, and evaluating this form of learning is vital in determining whether students have the competence required to enter nursing practice. However, limited knowledge exists about the influences that shape how competence development is recognized in nursing programs. The purpose of this study was to explore the evaluation of practice-based learning from the students' standpoint. A qualitative design based on institutional ethnography was used to investigate evaluation of practice-based learning with students, preceptors, and faculty in a preceptorship practicum. The findings revealed how work associated with evaluation was organized by coexisting and often disparate influences within a nursing program and the workplaces where learning took place. The implications and recommendations of the inquiry are intended to encourage dialogue and action among stakeholders from education and practice to improve evaluation practices in preparing new members of the nursing profession. [J Nurs Educ. 2017;56(3):131-138.]. Copyright 2017, SLACK Incorporated.

Evaluating community-based public health leadership training.

PubMed

Ceraso, Marion; Gruebling, Kirsten; Layde, Peter; Remington, Patrick; Hill, Barbara; Morzinski, Jeffrey; Ore, Peggy

2011-01-01

Addressing the nation's increasingly complex public health challenges will require more effective multisector collaboration and stronger public health leadership. In 2005, the Healthy Wisconsin Leadership Institute launched an annual, year-long intensive "community teams" program. The goal of this program is to develop collaborative leadership and public health skills among Wisconsin-based multisectoral teams mobilizing their communities to improve public health. To measure the scope of participation and program impacts on individual learning and practice, including application of new knowledge and collective achievements of teams on coalition and short-term community outcomes. End-of-year participant program evaluations and follow-up telephone interviews with participants 20 months after program completion. Community-based public health leadership training program. Sixty-eight participants in the Community Teams Program during the years 2006 to 2007 and 2007 to 2008. Professional diversity of program participants; individual learning and practice, including application of new knowledge; and collective achievements of teams, including coalition and short-term community outcomes. Participants in the Community Teams Program represent a diversity of sectors, including nonprofit, governmental, academic, business, and local public health. Participation increased knowledge across all public health and leadership competency areas covered in the program. Participating teams reported outcomes, including increased engagement of community leadership, expansion of preventive services, increased media coverage, strengthened community coalitions, and increased grant funding. Evaluation of this community-based approach to public health leadership training has shown it to be a promising model for building collaborative and public health leadership skills and initiating sustained community change for health improvement.

Implementing a Project-Based Learning Model in a Pre-Service Leadership Program

ERIC Educational Resources Information Center

Albritton, Shelly; Stacks, Jamie

2016-01-01

This paper describes two instructors' efforts to more authentically engage students in a preservice leadership program's course called Program Planning and Evaluation by using a project-based learning approach. Markham, Larmer, and Ravitz (2003) describe project-based learning (PjBL) as "a systematic teaching method that engages students in…

Conflict of Interest in the Evaluation and Dissemination of “Model” School-based Drug and Violence Prevention Programs

PubMed Central

Gorman, Dennis M.; Conde, Eugenia

2010-01-01

Conflict of interest refers to a set of conditions in which professional judgment concerning the validity of research might be influenced by a secondary competing interest. The competing interest that has received most attention in the literature addressing the prevalence and effects of such conflicts on the practice of empirical research has been that of financial relationships between investigators and research sponsors. The potential for conflicts of interest to arise in the evaluation of drug prevention programs was raised by Moskowitz in this journal in 1993, but to date there has been no attempt made to estimate the scope of this problem. The present study addressed this issue using a sample of “model” school-based drug and violence prevention interventions by first, identifying the types or relationships that exist between program developers and program distributors, and, second, by assessing how many of the evaluations of these programs published in peer-reviewed journals had been conducted by the developers of the programs compared to independent evaluation teams. The data presented indicate that there are relatively few published evaluations that do not involve program developers and that there are few instances in which there is complete separation between the program developer and program distributor. Using the open systems model of the Institute of Medicine Committee on Research Integrity as a framework, it is argued that the culture and norms of the program developer and those of the program evaluator are fundamentally distinct and therefore failure to separate these roles produces high potential for conflict of interest to arise. PMID:17945143

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2013 CFR

2013-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2014 CFR

2014-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2012 CFR

2012-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2011 CFR

2011-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... services from your program who increase their reading ability from “below grade level” to “at or above grade level”. This measure indicates something good is happening to your program's service beneficiaries...

Situated Research Design and Methodological Choices in Formative Program Evaluation

ERIC Educational Resources Information Center

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Evaluation of a Sandplay Program for Preschoolers in a Multiethnic Neighborhood

ERIC Educational Resources Information Center

Rousseau, Cecile; Benoit, Maryse; Lacroix, Louise; Gauthier, Marie-France

2009-01-01

Background: This evaluative study assesses the efficacy of a school-based secondary prevention program consisting of creative expression workshops for immigrant and refugee preschoolers in a predominantly South Asian multiethnic neighborhood. Coincidentally, the program began in the wake of the tsunami. Method: Pretest and posttest data were…

45 CFR 2522.700 - How does evaluation differ from performance measurement?

Code of Federal Regulations, 2010 CFR

2010-10-01

... progress, evaluation uses scientifically-based research methods to assess the effectiveness of programs by... the reading ability of students in a program over time to a similar group of students not... example, a performance measure for a literacy program may include the percentage of students receiving...

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

PubMed

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Base Realignment and Closure Environmental Evaluation (BRAC EE) Fort Devens, Massachusetts

DTIC Science & Technology

1995-09-01

Not Sampled ......... 6 2.3.2 Transformer Sites Sampled ........................ 7 2.4 Soil Sampling Protocol and Analytical Program ...Evaluation (AREE) 66. The study included evaluating the current PCB Transformer Management Program administered by the Fort Devens Environmental Management...Office (EMO), the Fort Devens Spill Contingency Plan, and the ongoing transformer inspection program . Personnel in both the Fort Devens EMO and the Fort

The Impact of Not on Tobacco on Teen Smoking Cessation: End-of-Program Evaluation Results, 1998 to 2003

ERIC Educational Resources Information Center

Horn, Kimberly; Dino, Geri; Kalsekar, Iftekhar; Mody, Reema

2005-01-01

This review summarizes end-of-program quit rates from 6 controlled and 10 field-based Not on Tobacco (NOT) evaluations. Approximately 6,130 youth from 5 states and 489 schools participated. Intent-to-treat and compliant quit rates were calculated at 3 months postbaseline (end-of-program). Results from controlled evaluations revealed an aggregate…

Experience Based Career Education at Wichita East High School: A Third-Party Evaluation for Year Two, 1977-78.

ERIC Educational Resources Information Center

Crawford, George; Miskel, Cecil

A third-party evaluation was conducted to assess the second year's operation of the Experience Based Career Education (EBCE) program at Wichita (Kansas) High School East. The program proposal contained fourteen process objectives and twelve outcome objectives. The status of the process objective achievement was determined by interviewing program…

Enhancing Research Capacity for Global Health: Evaluation of a Distance-Based Program for International Study Coordinators

ERIC Educational Resources Information Center

Wilson, Lynda Law; Rice, Marti; Jones, Carolynn T.; Joiner, Cynthia; LaBorde, Jennifer; McCall, Kimberly; Jester, Penelope M.; Carter, Sheree C.; Boone, Chrissy; Onwuzuligbo, Uzoma; Koneru, Alaya

2013-01-01

Introduction: Due to the increasing number of clinical trials conducted globally, there is a need for quality continuing education for health professionals in clinical research manager (CRM) roles. This article describes the development, implementation, and evaluation of a distance-based continuing education program for CRMs working outside the…

Teaching Grocery Store Purchasing Skills to Students with Intellectual Disabilities Using a Computer-Based Instruction Program

ERIC Educational Resources Information Center

Hansen, David L.; Morgan, Robert L.

2008-01-01

This research evaluated effects of a multi-media computer-based instruction (CBI) program designed to teach grocery store purchasing skills to three high-school students with intellectual disabilities. A multiple baseline design across participants used measures of computer performance mastery and grocery store probes to evaluate the CBI. All…

Evaluation of a Family-based Substance Abuse Prevention Program Targeted for the Middle School Years.

ERIC Educational Resources Information Center

Abbey, Antonia; Pilgrim, Colleen; Hendrickson, Peggy; Buresl, Sue

2000-01-01

Evaluates family-based substance abuse prevention program implemented in a rural community for families with middle school students. In comparison with nonparticipants, students had higher family cohesion, less family fighting, greater school attachment, higher self-esteem, and believed alcohol should be consumed at an older age, at one-year…

Impact on house staff evaluation scores when changing from a Dreyfus- to a Milestone-based evaluation model: one internal medicine residency program's findings.

PubMed

Friedman, Karen A; Balwan, Sandy; Cacace, Frank; Katona, Kyle; Sunday, Suzanne; Chaudhry, Saima

2014-01-01

As graduate medical education (GME) moves into the Next Accreditation System (NAS), programs must take a critical look at their current models of evaluation and assess how well they align with reporting outcomes. Our objective was to assess the impact on house staff evaluation scores when transitioning from a Dreyfus-based model of evaluation to a Milestone-based model of evaluation. Milestones are a key component of the NAS. We analyzed all end of rotation evaluations of house staff completed by faculty for academic years 2010-2011 (pre-Dreyfus model) and 2011-2012 (post-Milestone model) in one large university-based internal medicine residency training program. Main measures included change in PGY-level average score; slope, range, and separation of average scores across all six Accreditation Council for Graduate Medical Education (ACGME) competencies. Transitioning from a Dreyfus-based model to a Milestone-based model resulted in a larger separation in the scores between our three post-graduate year classes, a steeper progression of scores in the PGY-1 class, a wider use of the 5-point scale on our global end of rotation evaluation form, and a downward shift in the PGY-1 scores and an upward shift in the PGY-3 scores. For faculty trained in both models of assessment, the Milestone-based model had greater discriminatory ability as evidenced by the larger separation in the scores for all the classes, in particular the PGY-1 class.

Can outcome-based continuing medical education improve performance of immigrant physicians?

PubMed

Castel, Orit Cohen; Ezra, Vered; Alperin, Mordechai; Nave, Rachel; Porat, Tamar; Golan, Avivit Cohen; Vinker, Shlomo; Karkabi, Khaled

2011-01-01

Immigrant physicians are a valued resource for physician workforces in many countries. Few studies have explored the education and training needs of immigrant physicians and ways to facilitate their integration into the health care system in which they work. Using an educational program developed for immigrant civilian physicians working in military primary care clinics at the Israel Defence Force, we illustrate how an outcome-based CME program can address practicing physicians' needs for military-specific primary care education and improve patient care. Following an extensive needs assessment, a 3-year curriculum was developed. The curriculum was delivered by a multidisciplinary educational team. Pre/post multiple-choice examinations, objective structured clinical examinations (OSCE), and end-of-program evaluations were administered for curriculum evaluation. To evaluate change in learners' performance, data from the 2003 (before-program) and 2006 (after-program) work-based assessments were retrieved retrospectively. Change in the performance of program participants was compared with that of immigrant physicians who did not participate in the program. Out of 28 learners, 23 (82%) completed the program. Learners did significantly better in the annual post-tests compared with the pretests (p <.01) and improved their OSCE scores (p <.001). Most program graduates (90%) rated overall satisfaction as very good or excellent. In comparison with nonparticipants, program graduates performed better on work-based assessments (Cohen's d =.63). Our intensive, outcome-based, longitudinal CME program has yielded encouraging results. Other medical educators, facing the challenge of integrating immigrant physicians to fit their health care system, may consider adapting our approach. Copyright © 2011 The Alliance for Continuing Medical Education, the Society for Academic Continuing Medical Education, and the Council on CME, Association for Hospital Medical Education.

Evaluation of Project P.A.T.H.S. (Secondary 1 Program) by the Program Participants: Findings Based on the Full Implementation Phase

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Sun, Rachel C. F.

2008-01-01

A total of 207 schools (N = 33,693 students) participated in the Secondary 1 Program of Project P.A.T.H.S. in the Full Implementation Phase (2006-07). Participants responded to a Subjective Outcome Evaluation Form (Form A) to assess their views of the program, instructors, and perceived effectiveness after program completion. Utilizing the…

Maximizing Student Learning: The Effects of a Comprehensive School-Based Program for Preventing Problem Behaviors.

ERIC Educational Resources Information Center

Nelson, J. Ron; Martella, Ronald M.; Marchand-Martella, Nancy

2002-01-01

A study evaluated a comprehensive school-wide program based on an effective behavioral support approach for preventing disruptive behaviors implemented in seven elementary schools. The program included a school-wide discipline program, tutoring, conflict resolution, and functional behavioral intervention plans. Schools showed positive effects on…

Models for Integrating Human Services into the School.

ERIC Educational Resources Information Center

Dolan, Lawrence J.

This report examines five models of school-based integrated human service programs to evaluate the effects of the programs in light of the growing support for and implementation of these programs. The study examined the following programs: (1) school-based health clinics in Baltimore (Maryland); (2) Success for All (an elementary school-level…

Improving delivery of a health-promoting-environments program: experiences from Queensland Health.

PubMed

Dwyer, S

1997-01-01

The purpose of this paper is to outline the key components of a statewide multisite health-promoting-environments program. Contemporary health-promotion programs in settings such as schools, workplaces and hospitals use organisational development theory to address the health issues of the setting, including the physical environment, the organisational environment, and the specific health needs of the employees and consumers of the service. Program principles include management of each project by the participant organisation or site (for example, a school or workplace), using resources available within the organisation and the local community, voluntary participation, social justice and participant-based priority setting, and evaluation and monitoring. Adoption of these principles implies a shift in the role of the health worker from implementer to facilitator. Based on the experience of Queensland Health, it is proposed that the essential building blocks of the health-promoting-environments program are an intersectoral policy base, a model for action, training and resources, local facilitators, support from local organisations, a supportive network of sites, marketing of the program, and a state-based evaluation and monitoring system. The program in Queensland was able to develop a significant number of these components over the 1990-1996 period. In regard to evaluation, process measures can be built around the program components; however, further research is required for development of impact indicators and benchmarks on quality.

Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

ERIC Educational Resources Information Center

Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

2004-01-01

This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

Development and Evaluation of the Efficiency of In-Service Training Program with the Theme of Peace Education

ERIC Educational Resources Information Center

Basaran, Semra Demir; Karakurt, Sevgi Özden

2017-01-01

In this article, an in-service training program was developed and evaluated to improve the peace education competencies of primary school teachers. This program, named as In-Service Training Program with the Theme of Peace Education for Primary Teachers (BEHEP), was based on the system approach. The implementation was completed in 28 hours with…

eMINTS Program Evaluation Report: An Investigation of Program Fidelity and Its Impact on Teacher Mastery and Student Achievement

ERIC Educational Resources Information Center

Martin, Wendy; Strother, Scott; Weatherholt, Tara; Dechaume, Merav

2008-01-01

The eMINTS professional development programs are designed to help teachers learn how to integrate technology into their teaching, using instructional strategies that promote inquiry-based learning and encourage collaboration and community building among students and teachers. The eMINTS programs considered in this evaluation include: (1) eMINTS…

An Examination of the Concept and Role of Program Monitoring and Evaluation.

ERIC Educational Resources Information Center

Sherwood-Fabre, Liese

This paper examines the concepts of program monitoring and program evaluation in the literature, and offers working definitions based on two dimensions of measurement: focus (what questions are addressed) and timing (how often the measures are taken). Focus can be on inputs to the program or outcomes from it; timing can be one-shot or continuous.…

Development and evaluation of a school-based asthma educational program.

PubMed

Al Aloola, Noha Abdullah; Saba, Maya; Nissen, Lisa; Alewairdhi, Huda Abdullaziz; Alaloola, Alhnouf; Saini, Bandana

2017-05-01

To develop, implement, and evaluate the effects of a school-based asthma educational program on Saudi primary school teachers' asthma awareness and competence in delivering asthma-related first aid interventions. An asthma educational intervention program entitled "School Asthma Action Program" (SAAP) was designed based on pedagogical principles and implemented among teachers randomly selected from girls' primary schools in Riyadh, Saudi Arabia. This pilot study employed a pre-test/post-test experimental design. A previously tested asthma awareness questionnaire and a custom-designed asthma competence score sheet were used to evaluate the effects of the educational intervention program on teacher's asthma awareness and competence in providing asthma-related first aid interventions at schools. Forty-seven teachers from five different primary schools participated in the program. Of the 47 teachers, 39 completed both the pre- and post-program questionnaires. The SAAP improved teachers' awareness of asthma (teachers' median pre-program score was 11 (range 5-18) and their post-program score was 15 (range 7-18), p < 0.001) and their attitudes toward asthma management at schools (teachers' median pre-program score was 74 (range 15-75) and their post-program score was 75 (range 15-75), p = 0.043). Further, it improved teachers' competence in providing asthma-related first aid interventions (teachers' mean pre-program score was 1.4 ± 2.3 and their mean post-program score was 9.8 ± 0.5, p < 0.001). After completing the SAAP, a high proportion of teachers reported increased confidence in providing care to children with asthma at school. School-based asthma educational programs can significantly improve teachers' knowledge of asthma and their competence in providing asthma-related first aid interventions during emergencies.

Evaluation of a Postdischarge Call System Using the Logic Model.

PubMed

Frye, Timothy C; Poe, Terri L; Wilson, Marisa L; Milligan, Gary

2018-02-01

This mixed-method study was conducted to evaluate a postdischarge call program for congestive heart failure patients at a major teaching hospital in the southeastern United States. The program was implemented based on the premise that it would improve patient outcomes and overall quality of life, but it had never been evaluated for effectiveness. The Logic Model was used to evaluate the input of key staff members to determine whether the outputs and results of the program matched the expectations of the organization. Interviews, online surveys, reviews of existing patient outcome data, and reviews of publicly available program marketing materials were used to ascertain current program output. After analyzing both qualitative and quantitative data from the evaluation, recommendations were made to the organization to improve the effectiveness of the program.

Strategies for Evaluating Complex Environmental Education Programs

NASA Astrophysics Data System (ADS)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Program evaluation of an Integrated Basic Science Medical Curriculum in Shiraz Medical School, Using CIPP Evaluation Model

PubMed Central

ROOHOLAMINI, AZADEH; AMINI, MITRA; BAZRAFKAN, LEILA; DEHGHANI, MOHAMMAD REZA; ESMAEILZADEH, ZOHREH; NABEIEI, PARISA; REZAEE, RITA; KOJURI, JAVAD

2017-01-01

Introduction: In recent years curriculum reform and integration was done in many medical schools. The integrated curriculum is a popular concept all over the world. In Shiraz medical school, the reform was initiated by stablishing the horizontal basic science integration model and Early Clinical Exposure (ECE) for undergraduate medical education. The purpose of this study was to provide the required data for the program evaluation of this curriculum for undergraduate medical students, using CIPP program evaluation model. Methods: This study is an analytic descriptive and triangulation mixed method study which was carried out in Shiraz Medical School in 2012, based on the views of professors of basic sciences courses and first and second year medical students. The study evaluated the quality of the relationship between basic sciences and clinical courses and the method of presenting such courses based on the Context, Input, Process and Product (CIPP) model. The tools for collecting data, both quantitatively and qualitatively, were some questionnaires, content analysis of portfolios, semi- structured interview and brain storming sessions. For quantitative data analysis, SPSS software, version 14, was used. Results: In the context evaluation by modified DREEM questionnaire, 77.75%of the students believed that this educational system encourages them to actively participate in classes. Course schedule and atmosphere of class were reported suitable by 87.81% and 83.86% of students. In input domain that was measured by a researcher made questionnaire, the facilities for education were acceptable except for shortage of cadavers. In process evaluation, the quality of integrated modules presentation and Early Clinical Exposure (ECE) was good from the students’ viewpoint. In product evaluation, students’ brain storming, students’ portfolio and semi-structured interview with faculties were done, showing some positive aspects of integration and some areas that need improvement. Conclusion: The main advantage of assessing an educational program based on CIPP evaluation model is that the context, input, process and product of the program are viewed and evaluated systematically. This will help the educational authorities to make proper decisions based on the weaknesses and strengths of the program on its continuation, cessation and revision. Based on the results of this study, the integrated basic sciences course for undergraduate medical students in Shiraz Medical School is at a desirable level. However, attempts to improve or reform some sections and continual evaluation of the program and its accreditation seem to be necessary. PMID:28761888

Some Evaluative Comments Based on a Review of the Curriculum Development Processes Operating in the Stanford Program on International and Cross Cultural Education. [and] A Review of the Curriculum. Development Processes Operating in the Stanford Program on International and Cross-Cultural Education.

ERIC Educational Resources Information Center

Kennedy, Kerry J.

The processes of instructional materials development and dissemination used in four Stanford Program on International and Cross Cultural Education (SPICE) projects dealing with Latin America, Africa, China, and Japan are described, and evaluative comments based on a review of the curriculum development process are made. The major purpose of the…

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

PubMed

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper contributes to debate about appropriate evaluation approaches to meet the information needs of all stakeholders and will support the sharing of measures and potential comparisons between program outcomes for comparable population groups and settings.

Dissemination and implementation science in program evaluation: A telemental health clinical consultation case example.

PubMed

Arora, Prerna G; Connors, Elizabeth H; Blizzard, Angela; Coble, Kelly; Gloff, Nicole; Pruitt, David

2017-02-01

Increased attention has been placed on evaluating the extent to which clinical programs that support the behavioral health needs of youth have effective processes and result in improved patient outcomes. Several theoretical frameworks from dissemination and implementation (D&I) science have been put forth to guide the evaluation of behavioral health program implemented in the context of real-world settings. Although a strong rationale for the integration of D&I science in program evaluation exists, few examples exist available to guide the evaluator in integrating D&I science in the planning and execution of evaluation activities. This paper seeks to inform program evaluation efforts by outlining two D&I frameworks and describing their integration in program evaluation design. Specifically, this paper seeks to support evaluation efforts by illustrating the use of these frameworks via a case example of a telemental health consultation program in pediatric primary care designed to improve access to behavioral health care for children and adolescents in rural settings. Lessons learned from this effort, as well as recommendations regarding the future evaluation of programs using D&I science to support behavioral health care in community-based settings are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Assessing Capacity for Sustainability of Effective Programs and Policies in Local Health Departments.

PubMed

Tabak, Rachel G; Duggan, Katie; Smith, Carson; Aisaka, Kristelle; Moreland-Russell, Sarah; Brownson, Ross C

2016-01-01

Sustainability has been defined as the existence of structures and processes that allow a program to leverage resources to effectively implement and maintain evidence-based public health and is important in local health departments (LHDs) to retain the benefits of effective programs. Explore the applicability of the Program Sustainability Framework in high- and low-capacity LHDs as defined by national performance standards. Case study interviews from June to July 2013. Standard qualitative methodology was used to code transcripts; codes were developed inductively and deductively. Six geographically diverse LHD's (selected from 3 of high and 3 of low capacity) : 35 LHD practitioners. Thematic reports explored the 8 domains (Organizational Capacity, Program Adaptation, Program Evaluation, Communications, Strategic Planning, Funding Stability, Environmental Support, and Partnerships) of the Program Sustainability Framework. High-capacity LHDs described having environmental support, while low-capacity LHDs reported this was lacking. Both high- and low-capacity LHDs described limited funding; however, high-capacity LHDs reported greater funding flexibility. Partnerships were important to high- and low-capacity LHDs, and both described building partnerships to sustain programming. Regarding organizational capacity, high-capacity LHDs reported better access to and support for adequate staff and staff training when compared with low-capacity LHDs. While high-capacity LHDs described integration of program evaluation into implementation and sustainability, low-capacity LHDs reported limited capacity for measurement specifically and evaluation generally. When high-capacity LHDs described program adoption, they discussed an opportunity to adapt and evaluate. Low-capacity LHDs struggled with programs requiring adaptation. High-capacity LHDs described higher quality communication than low-capacity LHDs. High- and low-capacity LHDs described strategic planning, but high-capacity LHDs reported efforts to integrate evidence-based public health. Investments in leadership support for improving organizational capacity, improvements in communication from the top of the organization, integrating program evaluation into implementation, and greater funding flexibility may enhance sustainability of evidence-based public health in LHDs.

Agent-based modeling as a tool for program design and evaluation.

PubMed

Lawlor, Jennifer A; McGirr, Sara

2017-12-01

Recently, systems thinking and systems science approaches have gained popularity in the field of evaluation; however, there has been relatively little exploration of how evaluators could use quantitative tools to assist in the implementation of systems approaches therein. The purpose of this paper is to explore potential uses of one such quantitative tool, agent-based modeling, in evaluation practice. To this end, we define agent-based modeling and offer potential uses for it in typical evaluation activities, including: engaging stakeholders, selecting an intervention, modeling program theory, setting performance targets, and interpreting evaluation results. We provide demonstrative examples from published agent-based modeling efforts both inside and outside the field of evaluation for each of the evaluative activities discussed. We further describe potential pitfalls of this tool and offer cautions for evaluators who may chose to implement it in their practice. Finally, the article concludes with a discussion of the future of agent-based modeling in evaluation practice and a call for more formal exploration of this tool as well as other approaches to simulation modeling in the field. Copyright © 2017 Elsevier Ltd. All rights reserved.

Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity.

PubMed

Walker, Sarah Cusworth; Bumbarger, Brian K; Phillippi, Stephen W

2015-10-01

Evidence-based programs (EBPs) are an increasingly visible aspect of the treatment landscape in juvenile justice. Research demonstrates that such programs yield positive returns on investment and are replacing more expensive, less effective options. However, programs are unlikely to produce expected benefits when they are not well-matched to community needs, not sustained and do not reach sufficient reach and scale. We argue that achieving these benchmarks for successful implementation will require states and county governments to invest in data-driven decision infrastructure in order to respond in a rigorous and flexible way to shifting political and funding climates. We conceptualize this infrastructure as diagnostic capacity and evaluative capacity: Diagnostic capacity is defined as the process of selecting appropriate programing and evaluative capacity is defined as the ability to monitor and evaluate progress. Policy analyses of Washington State, Pennsylvania and Louisiana's program implementation successes are used to illustrate the benefits of diagnostic and evaluate capacity as a critical element of EBP implementation. Copyright © 2015 Elsevier Ltd. All rights reserved.

Integrating Computer-Based Career Development into Your Career Planning Program.

ERIC Educational Resources Information Center

Campbell, Robert B.; Mack, Sharon E.

This paper focuses on the real and theoretical usefulness of a computer-based career development system in a career planning program, based on a 2-year pilot program evaluating the DISCOVER system. The system overview discusses components and contents of DISCOVER, and describes the 11 modules which assist users in learning about their values,…

Faith Is Confidence: The Implication of Psychosocial Components in Faith-Based Educational Programs on Expressive Communication Skills of Adult Learners

ERIC Educational Resources Information Center

Lynch, Erin M.

2016-01-01

Faith-based programs for adult learners have environmental factors that differentiate them from non-faith based programs, but explicit empirical studies evaluating the impact of the psychosocial factors have been lacking in the literature. This study comparatively examines the achievement level of expressive communication skills as measured…

Design of study without drugs--a Surinamese school-based drug-prevention program for adolescents.

PubMed

Ishaak, Fariel; de Vries, Nanne Karel; van der Wolf, Kees

2015-10-12

The aim of this study was to design the content and accompanying materials for a school-based program--Study without Drugs--for adolescents in junior secondary schools in Suriname based on the starting points and tasks of the fourth step of the Intervention Mapping protocol (which consists of six steps). A program based on this protocol should include a combination of theory, empirical evidence, and qualitative and quantitative research. Two surveys were conducted when designing the program. In Survey I, teachers and students were asked to complete a questionnaire to determine which school year they thought would be most appropriate for implementing a drug-prevention program for adolescents (we completed a similar survey as part of previous research). An attempt was made to identify suitable culturally sensitive elements to include in the program. In Survey II, the same teachers were asked to complete a questionnaire to determine the programs' scope, sequence, structure, and topics as well as the general didactic principles to serve as a basis for program design. After outlining the program plan, lessons, and materials, we conducted a formative pretest evaluation among teachers, students, and parents. That evaluation included measures related to the program's attractiveness, comprehensibility, and usefulness. The resulting lessons were presented to the teachers for assessment. The drug-prevention program we developed comprises 10 activities and lasts 2-2.5 months in an actual school setting. The activities take place during Dutch, biology, physical education, art, religion, and social studies lessons. We based the structure of the lessons in the program on McGuire's Persuasion Communication Model, which takes into account important didactic principles. Evaluations of the program materials and lesson plans by students, teachers, and parents were mostly positive. We believe that using the fourth step of the Intervention Mapping protocol to develop a drug-prevention intervention for adolescents has a produced promising, feasible program.

The Role of Extension Nutrition Education in Student Achievement of Nutrition Standards in Grades K-3: A Descriptive Evaluation of a School-Based Program

ERIC Educational Resources Information Center

Arnold, Mary E.; Schreiber, Debera

2012-01-01

This article reports the results of a descriptive evaluation of the impact of an in-school Extension nutrition education program in a small, very rural county. The evaluation focused on understanding the nature of the role the Extension educator plays in delivering nutrition education, the impact of the program on student learning and achievement…

An experimental evaluation of theory-based mother and mother-child programs for children of divorce.

PubMed

Wolchik, S A; West, S G; Sandler, I N; Tein, J Y; Coatsworth, D; Lengua, L; Weiss, L; Anderson, E R; Greene, S M; Griffin, W A

2000-10-01

This study evaluated the efficacy of 2 theory-based preventive interventions for divorced families: a program for mothers and a dual component mother-child program. The mother program targeted mother-child relationship quality, discipline, interparental conflict, and the father-child relationship. The child program targeted active coping, avoidant coping, appraisals of divorce stressors, and mother-child relationship quality. Families with a 9- to 12-year-old child (N = 240) were randomly assigned to the mother, dual-component, or self-study program. Postintervention comparisons showed significant positive program effects of the mother program versus self-study condition on relationship quality, discipline, attitude toward father-child contact, and adjustment problems. For several outcomes, more positive effects occurred in families with poorer initial functioning. Program effects on externalizing problems were maintained at 6-month follow-up. A few additive effects of the dual-component program occurred for the putative mediators; none occurred for adjustment problems.

Steps toward a Formative Evaluation of NSDL. Technical Report

ERIC Educational Resources Information Center

Bikson, Tora K.; Kalra, Nidhi; Galway, Lionel A.; Agnew, Grace

2011-01-01

The National Science Foundation's (NSF) National Science Digital Library/Distributed Learning (NSDL) program turned 10 years old in 2010. This report presents results of a preliminary program evaluation carried out by RAND and is organized around three principal goals: (1) Provide an initial evaluation of NSDL based on existing information…

In Vitro Evaluation of a Program for Machine-Aided Indexing.

ERIC Educational Resources Information Center

Jacquemin, Christian; Daille, Beatrice; Royaute, Jean; Polanco, Xavier

2002-01-01

Presents the human evaluation of ILIAD, a program for machine-aided indexing that was designed to assist expert librarians in computer-aided indexing and document analysis. Topics include controlled indexing and free indexing; natural language and concept-based information retrieval; evaluation methodology; syntactic variations; and a comparison…

Statistical Process Control in the Practice of Program Evaluation.

ERIC Educational Resources Information Center

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Evaluating the Child Care Director: The Collaborative Professional Assessment Process.

ERIC Educational Resources Information Center

Freeman, Nancy K.; Brown, Mac H.

2000-01-01

Describes the Collaborative Professional Assessment Process (CPAP) to guide the evaluation of the director of early childhood programs. Examines the assumptions upon which the CPAP is based. Lists the management skills and leadership abilities of successful child care directors. Includes the Director Self-Evaluation form and a program evaluation…

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

Effects of a National Indicated Preventive Intervention Program

ERIC Educational Resources Information Center

Husler, Gebhard; Werlen, Egon; Blakeney, Ronny

2005-01-01

As there have been few science-based evaluations of secondary prevention programs, the Federal Office of Public Health in Switzerland carried out a national program evaluation at 12 sites in the French- and German-speaking parts of Switzerland to study the question, "What works in secondary prevention?" These 12 centers offer different…

The Development of an Automated Data Base for Program Research and Evaluation in Continuing Education.

ERIC Educational Resources Information Center

Taylor, William H.

The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…

Innovations in Doctoral Education: Distance Education Methodology Applied

ERIC Educational Resources Information Center

Bettmann, Joanna; Thompson, Kimberly; Padykula, Nora; Berzoff, Joan

2009-01-01

This study evaluated the impact of a distance education program to meet the practice learning needs of first-year doctoral students. The program, a six-session case-based telephonic seminar, was taught to 19 first-year doctoral students. Evaluation of the program included self-report quantitative and qualitative data gathered pre- and postseminar,…

PAL[R] Services Being Measured through Scientifically-Based Evaluation Process

ERIC Educational Resources Information Center

Perspectives in Peer Programs, 2007

2007-01-01

In January 2006, PAL[R] Peer Assistance and Leadership, a Promising Prevention Program of Workers Assistance Program, Inc. (WAP), received a $30,000 grant from the Center for Substance Abuse Prevention (CSAP) in order to be scientifically-evaluated on the outcomes and effectiveness of its programs and services. According to the grant, the…

Curriculum, Technology, and Education Reform (CTER) Online: Evaluation of an Online Master of Education Program.

ERIC Educational Resources Information Center

Levin, Sandra R.; Levin, James A.; Guell, James G.; Waddoups, Gregory L.

2002-01-01

Describes a Master of Education program at the University of Illinois, Urbana-Champaign called Curriculum, Technology, and Education Reform OnLine (CTER) that is aimed at K-12 teachers. The evaluation based on program stakeholders includes interface design; instructional design; faculty satisfaction; student attitudes; economic viability;…

A Program Evaluation of a Summer Research Training Institute for American Indian and Alaska Native Health Professionals

ERIC Educational Resources Information Center

Zaback, Tosha; Becker, Thomas M.; Dignan, Mark B.; Lambert, William E.

2010-01-01

In this article, the authors describe a unique summer program to train American Indian/Alaska Native (AI/AN) health professionals in a variety of health research-related skills, including epidemiology, data management, statistical analysis, program evaluation, cost-benefit analysis, community-based participatory research, grant writing, and…

Baylor SBIRT Medical Residency Training Program: Model Description and Initial Evaluation

ERIC Educational Resources Information Center

Bray, James H.; Kowalchuk, Alicia; Waters, Vicki; Laufman, Larry; Shilling, Elizabeth H.

2012-01-01

The Baylor College of Medicine SBIRT Medical Residency Training Program is a multilevel project that trains residents and faculty in evidenced-based screening, brief intervention, and referral to treatment (SBIRT) methods for alcohol and substance use problems. This paper describes the training program and provides initial evaluation after the…

Multiple-Methods Needs Assessment of California 4-H Science Education Programming

ERIC Educational Resources Information Center

Worker, Steven M.; Schmitt-McQuitty, Lynn; Ambrose, Andrea; Brian, Kelley; Schoenfelder, Emily; Smith, Martin H.

2017-01-01

The California 4-H Science Leadership Team conducted a statewide assessment to evaluate the needs of county-based 4-H programs related to the key areas of the 4-H Science Initiative: program development and design, professional development, curricula, evaluation, partnerships, and fund development. The use of multiple qualitative data sources…

Assessing the Effectiveness of a Mathematics-Focused, Instructional Technology Program for Grades 6-8: A 5-Year Trend Analysis of NASA CONNECT(tm) Evaluation Data

NASA Technical Reports Server (NTRS)

Glassman, Nanci A.; Perry, Jeannine B.; Giersch, Christopher E.; Lambert, Matthew A.; Pinelli, Thomas E.

2004-01-01

NASA CONNECT is a research-, inquiry, and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6 8. Respondents who evaluated the programs in the series over the first five seasons (1998-99 through 2002-03) reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for the grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

A Formative Evaluation of Healthy Heroes: A Photo Comic Book-Social Cognitive Theory Based Obesity Prevention Program

ERIC Educational Resources Information Center

Branscum, Paul; Housley, Alexandra; Bhochhibhoya, Amir; Hayes, Logan

2016-01-01

Purpose: Low consumption of fruits and vegetables is often associated with poor diet quality, and childhood obesity. The purpose of this study was to assess the feasibility, and conduct a formative evaluation, of Healthy Heroes, an innovative, social cognitive theory-based program that uses child created photo-comic books to promote fruit and…

An Investigation of the Potential for a Computer-based Tutorial Program Covering the Cardiovascular System to Replace Traditional Lectures.

ERIC Educational Resources Information Center

Dewhurst, D. G.; Williams, A. D.

1998-01-01

Presents the results of a comparative study to evaluate the effectiveness of two interactive computer-based learning (CBL) programs, covering the cardiovascular system, as an alternative to lectures for first year undergraduate students at a United Kingdom University. Discusses results in relation to the design of evaluative studies and the future…

Evaluating the Impact of a School-Based Helmet Promotion Program on Eligible Adolescent Drivers: Different Audiences, Different Needs?

ERIC Educational Resources Information Center

Germeni, Evi; Lionis, Christos; Kalampoki, Vassiliki; Davou, Bettina; Belechri, Maria; Petridou, Eleni

2010-01-01

The school environment has been often identified as a prosperous venue for public health improvement. This study is a cluster randomized controlled trial evaluating the impact of a school-based helmet promotion program on knowledge, attitudes and practices of eligible adolescent drivers. Four public, four private and four vocational high schools…

Evaluation of a Web-Based Professional Development Program (Project ACE) for Teachers of Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Rakap, Salih; Jones, Hazel A.; Emery, Alice Kaye

2015-01-01

This article describes the development, implementation, and second-year evaluation of Project Autism Competencies for Endorsement (ACE), a web-based professional development (PD) program that is designed to train teachers currently working in the field to meet the unique and diverse needs of children with autism spectrum disorders (ASDs). A…

The Inquiry Based Science and Technology Education Program (IN-STEP): The Evaluation of the First Year

ERIC Educational Resources Information Center

Corcoran, Thomas B.

2008-01-01

This is the first report on the evaluation of the Inquiry Based Science and Technology Education Program (IN-STEP), an innovative and ambitious science education initiative for lower secondary schools being undertaken by a public-private partnership in Thailand funded by MSD-Thailand, an affiliate of Merck & Co. IN-STEP is a public-private…

Reducing Alcohol Use in First-Year University Students: Evaluation of a Web-Based Personalized Feedback Program

ERIC Educational Resources Information Center

Doumas, Diana M.; Andersen, Lorna L.

2009-01-01

The efficacy of a Web-based personalized feedback program--electronic CHECKUP TO GO (e-CHUG), aimed at reducing heavy drinking in 1st-year university students--is evaluated. Results indicated that high-risk students in the e-CHUG group reported significantly greater reductions in weekly drinking quantity, frequency of drinking to intoxication, and…

Teaching Advanced Operation of an iPod-Based Speech-Generating Device to Two Students with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Achmadi, Donna; Kagohara, Debora M.; van der Meer, Larah; O'Reilly, Mark F.; Lancioni, Giulio E.; Sutherland, Dean; Lang, Russell; Marschik, Peter B.; Green, Vanessa A.; Sigafoos, Jeff

2012-01-01

We evaluated a program for teaching two adolescents with autism spectrum disorders (ASD) to perform more advanced operations on an iPod-based speech-generating device (SGD). The effects of the teaching program were evaluated in a multiprobe multiple baseline across participants design that included two intervention phases. The first intervention…

Evaluation of a School-Based Program Aimed at Preventing Depressive Symptoms in Adolescents

ERIC Educational Resources Information Center

Garmy, Pernilla; Jakobsson, Ulf; Carlsson, Katarina Steen; Berg, Agneta; Clausson, Eva K.

2015-01-01

The aim of this pilot study was to evaluate the implementation of a universal school-based cognitive behavioral program whose target is to prevent depressive symptoms in adolescents. The study had a quasi-experimental design with pretest, posttest, and a 1-year follow-up and provides an illustrative calculation for the implementation costs of the…

Evaluative Thinking in Practice: The National Asthma Control Program.

PubMed

Fierro, Leslie A; Codd, Heather; Gill, Sarah; Pham, Phung K; Grandjean Targos, Piper T; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings-specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention's National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs' evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts.

Evaluating a complex, multi-site, community-based program to improve healthcare quality: the summative research design for the Aligning Forces for Quality initiative.

PubMed

Scanlon, Dennis P; Wolf, Laura J; Alexander, Jeffrey A; Christianson, Jon B; Greene, Jessica; Jean-Jacques, Muriel; McHugh, Megan; Shi, Yunfeng; Leitzell, Brigitt; Vanderbrink, Jocelyn M

2016-08-01

The Aligning Forces for Quality (AF4Q) initiative was the Robert Wood Johnson Foundation's (RWJF's) signature effort to increase the overall quality of healthcare in targeted communities throughout the country. In addition to sponsoring this 16-site complex program, RWJF funded an independent scientific evaluation to support objective research on the initiative's effectiveness and contributions to basic knowledge in 5 core programmatic areas. The research design, data, and challenges faced during the summative evaluation phase of this near decade-long program are discussed. A descriptive overview of the summative research design and its development for a multi-site, community-based, healthcare quality improvement initiative is provided. The summative research design employed by the evaluation team is discussed. The evaluation team's summative research design involved a data-driven assessment of the effectiveness of the AF4Q program at large, assessments of the impact of AF4Q in the specific programmatic areas, and an assessment of how the AF4Q alliances were positioned for the future at the end of the program. The AF4Q initiative was the largest privately funded community-based healthcare improvement initiative in the United States to date and was implemented at a time of rapid change in national healthcare policy. The implementation of large-scale, multi-site initiatives is becoming an increasingly common approach for addressing problems in healthcare. The summative evaluation research design for the AF4Q initiative, and the lessons learned from its approach, may be valuable to others tasked with evaluating similarly complex community-based initiatives.

Purposive Facebook Recruitment Endows Cost-Effective Nutrition Education Program Evaluation

PubMed Central

Wamboldt, Patricia

2013-01-01

Background Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. Objective The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. Methods English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Results Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. Conclusions With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy. PMID:23948573

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

PubMed

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, <40 years, overweight or obese body mass index, and not eating competent. A total of 807 Facebook users clicked on the WI ad with 73 unique site visitors and 47 of them completing the program evaluation (ie, 47/807, 5.8% of clickers and 47/73, 64% of site visitors completed the evaluation). Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from traditional research recruitment strategies reported in the literature. Limitations prompted by repeated survey attempts need to be addressed to optimize this recruitment strategy.

Mississippi School Library Media Programs: A Guide for Management. A Competency Based Handbook for Certified Library Media Specialists, Administrators, and Evaluators.

ERIC Educational Resources Information Center

Mississippi State Dept. of Education, Jackson.

This new publication, which replaces A Primer for Mississippi School Librarians published in 1967, is designed for use in planning, implementing, and evaluating school library media programs. For the administrator, there are competencies which must be met to develop the library media program as an integral part of the total instructional program.…

Common Evaluation Tools across Multi-State Programs: A Study of Parenting Education and Youth Engagement Programs in Children, Youth, and Families At-Risk

ERIC Educational Resources Information Center

Payne, Pamela B.; McDonald, Daniel A.

2015-01-01

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

The Impact of a Sport-Based Life Skill Program on Adolescent Prosocial Values

ERIC Educational Resources Information Center

Brunelle, John; Danish, Steven J.; Forneris, Tanya

2007-01-01

This article describes the implementation and evaluation of a sport-based life skills and community service program. The purpose of this investigation was to determine the impact of a combined life skills and community service program on adolescents' prosocial values. The program was part of a national golf and life skills enrichment academy for…

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

PubMed

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Stage I Final Report for the Study of Program Management Procedures in the Campus-Based and Basic Grant Programs. (Volume I).

ERIC Educational Resources Information Center

Puma, Michael J.; And Others

The third phase of SISFAP (Study on the Impact of Student Financial Aid Programs), the primary purpose of this study is to evaluate federal and institutional management policies and practices for Basic Educational Opportunity Grant (BEOG) and campus-based programs as they impact on the extent to which the programs are meeting their legislative…

School-based programs to reduce sexual risk-taking behaviors.

PubMed

Kirby, D

1992-09-01

This article reviews the major approaches implemented during the last two decades to reduce sexual risk-taking behaviors, examines their evidence for success, and provides several recommendations for effective programs and program evaluations. This article does not discuss more broad-based sexuality education programs which address sexuality in a broader context. Instead, this article focuses primarily on programs that educators believed would reduce unprotected sexual intercourse.

An Introduction to "My Environmental Education Evaluation Resource Assistant" (MEERA), a Web-Based Resource for Self-Directed Learning about Environmental Education Program Evaluation

ERIC Educational Resources Information Center

Zint, Michaela

2010-01-01

My Environmental Education Evaluation Resource Assistant or "MEERA" is a web-site designed to support environmental educators' program evaluation activities. MEERA has several characteristics that set it apart from other self-directed learning evaluation resources. Readers are encouraged to explore the site and to reflect on the role that…

Program Planners’ Perspectives of Promotora Roles, Recruitment, and Selection

PubMed Central

Koskan, Alexis; Hilfinger Messias, DeAnne K.; Friedman, Daniela B.; Brandt, Heather M.; Walsemann, Katrina M.

2013-01-01

Objective Program planners work with promotoras (the Spanish term for female community health workers) to reduce health disparities among underserved populations. Based on the Role-Outcomes Linkage Evaluation Model for Community Health Workers (ROLES) conceptual model, we explored how program planners conceptualized the promotora role and the approaches and strategies they used to recruit, select, and sustain promotoras. Design We conducted semi-structured, in-depth interviews with a purposive convenience sample of 24 program planners, program coordinators, promotora recruiters, research principal investigators, and other individuals who worked closely with promotoras on United States-based health programs for Hispanic women (ages 18 and older). Results Planners conceptualized the promotora role based on their personal experiences and their understanding of the underlying philosophical tenets of the promotora approach. Recruitment and selection methods reflected planners’ conceptualizations and experiences of promotoras as paid staff or volunteers. Participants described a variety of program planning and implementation methods. They focused on sustainability of the programs, the intended health behavior changes or activities, and the individual promotoras. Conclusion To strengthen health programs employing the promotora delivery model, job descriptions should delineate role expectations and boundaries and better guide promotora evaluations. We suggest including additional components such as information on funding sources, program type and delivery, and sustainability outcomes to enhance the ROLES conceptual model. The expanded model can be used to guide program planners in the planning, implementing, and evaluating of promotora health programs. PMID:23039847

The Arizona Performance-Based Teacher Certification Program.

ERIC Educational Resources Information Center

Kelley, Michael F.

In response to public pressures and a legislative mandate, the State of Arizona began to systematically evaluate prospective teachers while concomitantly requiring a restructuring of the Arizona teacher preparation programs at the college and university level as part of a program entitled the Arizona Performance-Based Teacher Certification…

Evaluating the Effectiveness of the 2001-2002 NASA "Why?" Files Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2001-2002 NASA 'Why?' Files program that was conducted in March 2002. The analysis is based on the results of 139 surveys collected from educators registered for the program. Respondents indicated that (1) the programs in the series are aligned with the national mathematics, science, and technology standards; (2) the programs are developmentally (grade level) appropriate; and (3) the programs enhance and enrich the teaching and learning of mathematics, science, and technology.

Development and evaluation of the evidence-based medicine program in surgery: a spiral approach

PubMed Central

Elçin, Melih; Turan, Sevgi; Odabaşı, Orhan; Sayek, İskender

2014-01-01

Background Evidence-based medicine (EBM) aims to provide skills that help physicians answer clinically important questions, determine new evidence, and incorporate the acquired knowledge in practice. EBM skills are necessary for the practice of modern medicine, since physicians should use up-to-date knowledge and information to justify their medical decisions. Purpose We aimed to evaluate the EBM program implemented at Hacettepe University School of Medicine. Methods In 2004, a spiral program for the teaching and practice of EBM was developed for the first 3 years of medical school. Following this program, a practice of EBM was included in the fourth year during the surgery clerkship, after an introductory lecture. The students worked within collaborative teams of 3–5 and practiced EBM with actual cases seen in the surgical service in which they were involved. Each student was asked to complete a questionnaire that evaluated the more theoretical program from the first 3 years and the practical application in the fourth year. Results Nearly half of the students stated that the preclinical years of the EBM program were ‘adequate’, but only 30% of the students indicated that the program was practical. They stated that ‘more practical approaches were used in the fourth year, whereas more theory-based approaches were used during the preclinical years’. More than 75% of the students declared that the practice of EBM in the fourth year was useful and appropriate for team-based learning. Conclusions The EBM program was evaluated as ‘adequate’. EBM courses should be included in the entire curriculum in an integrated manner. The students understand the main philosophy of EBM in the clinical year when involved in its practical application with actual patients. PMID:24767706

Preparing the workforce for healthy aging programs: the Skills for Healthy Aging Resources and Programs (SHARP) model.

PubMed

Frank, Janet C; Altpeter, Mary; Damron-Rodriguez, JoAnn; Driggers, Joann; Lachenmayr, Susan; Manning, Colleen; Martinez, Dana M; Price, Rachel M; Robinson, Patricia

2014-10-01

Current public health and aging service agency personnel have little training in gerontology, and virtually no training in evidence-based health promotion and disease management programs for older adults. These programs are rapidly becoming the future of our community-based long-term care support system. The purpose of this project was to develop and test a model community college career technical education program, Skills for Healthy Aging Resources and Programs (SHARP), for undergraduate college students, current personnel in aging service and community organizations, and others interested in retraining. A multidisciplinary cross-sector team from disciplines of public health, sociology, gerontology and nursing developed four competency-based courses that focus on healthy aging, behavior change strategies, program management, an internship, and an option for leader training in the Chronic Disease Self-Management Program. To enhance implementation and fidelity, intensive faculty development training was provided to all instructors and community agency partners. Baseline and postprogram evaluation of competencies for faculty and students was conducted. Process evaluation for both groups focused on satisfaction with the curricula and suggestions for program improvement. SHARP has been piloted five times at two community colleges. Trainees (n = 113) were primarily community college students (n = 108) and current aging service personnel (n = 5). Statistically significant improvements in all competencies were found for both faculty and students. Process evaluation outcomes identified the needed logical and component adaptations to enhance the feasibility of program implementation, dissemination, and student satisfaction. The SHARP program provides a well-tested, evidence-based effective model for addressing workforce preparation in support of healthy aging service program expansion and delivery. © 2014 Society for Public Health Education.

Program Sustainability: Hearing Loss and Tinnitus Prevention in American Indian Communities.

PubMed

Martin, William Hal; Sobel, Judith L; Griest, Susan E; Howarth, Linda C; Becker, Thomas M

2017-03-01

An important goal of any health promotion effort is to have it maintained in delivery and effectiveness over time. The purpose of this study was to establish a community-based noise-induced hearing loss and tinnitus prevention program in three different types of American Indian communities and evaluate them for evidence of long-term sustainability. The target population was fourth- and fifth-grade students from three different models of American Indian communities. The evidenced-based Dangerous Decibels ® program was adapted to include local media, classroom education, family and community outreach, and web-based activities. Sustainability was attempted by promoting funding stability, political support, partnerships, organizational capacity, program adaptation, program evaluation, communications, public health impacts, and strategic planning. Currently, there is evidence suggesting that the hearing health promotion program is self-sustaining in all three American Indian communities. The intervention was effective at changing knowledge, attitudes, beliefs, and behaviors in the target population, but program adoption and self-sustenance faced challenges that required patience, persistence, and creativity by the program team. Components of the intervention continue to be delivered by local members of each community. Critical factors that led to self-sustaining programs included approval of community leaders and engagement of community members in the design, administration, and evaluation of the effort; use of a well-developed, evidence-based intervention; and high-level training of local participants who could confidently and effectively continue delivering the program following a gradual transition to independence. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Evaluation of Embedded System Component Utilized in Delivery Integrated Design Project Course

NASA Astrophysics Data System (ADS)

Junid, Syed Abdul Mutalib Al; Hussaini, Yusnira; Nazmie Osman, Fairul; Razak, Abdul Hadi Abdul; Idros, Mohd Faizul Md; Karimi Halim, Abdul

2018-03-01

This paper reports the evaluation of the embedded system component utilized in delivering the integrated electronic engineering design project course. The evaluation is conducted based on the report project submitted as to fulfil the assessment criteria for the integrated electronic engineering design project course named; engineering system design. Six projects were assessed in this evaluation. The evaluation covers the type of controller, programming language and the number of embedded component utilization as well. From the evaluation, the C-programming based language is the best solution preferred by the students which provide them flexibility in the programming. Moreover, the Analog to Digital converter is intensively used in the projects which include sensors in their proposed design. As a conclusion, in delivering the integrated design project course, the knowledge over the embedded system solution is very important since the high density of the knowledge acquired in accomplishing the project assigned.

A Synthetic Comparator Approach to Local Evaluation of School-Based Substance Use Prevention Programming.

PubMed

Hansen, William B; Derzon, James H; Reese, Eric L

2014-06-01

We propose a method for creating groups against which outcomes of local pretest-posttest evaluations of evidence-based programs can be judged. This involves assessing pretest markers for new and previously conducted evaluations to identify groups that have high pretest similarity. A database of 802 prior local evaluations provided six summary measures for analysis. The proximity of all groups using these variables is calculated as standardized proximities having values between 0 and 1. Five methods for creating standardized proximities are demonstrated. The approach allows proximity limits to be adjusted to find sufficient numbers of synthetic comparators. Several index cases are examined to assess the numbers of groups available to serve as comparators. Results show that most local evaluations would have sufficient numbers of comparators available for estimating program effects. This method holds promise as a tool for local evaluations to estimate relative effectiveness. © The Author(s) 2012.

Essential elements for community engagement in evidence-based youth violence prevention.

PubMed

Miao, Tai-An; Umemoto, Karen; Gonda, Deanna; Hishinuma, Earl S

2011-09-01

In the field of youth violence prevention, there has been increasing emphasis on "evidence based" programs and principles shown through scientific research as reaching their intended outcomes. Community mobilization and engagement play a critical role in many evidence-based programs and strategies, as it takes a concerted effort among a wide range of people within a community to alter behavior and maintain behavioral change. How do concerned individuals and groups within a community engage others within and outside of that community to effectively plan, develop and implement appropriate EB programs as well as evaluate the outcomes and impacts of locally developed programs yet to be proven? The authors discuss five elements essential for community engagement in evidence-based youth violence prevention based on their work in a university-community partnership through the Asian/Pacific Islander Youth Violence Prevention Center (API Center), a National Academic Center for Excellence on Youth Violence Prevention Center supported by the Centers for Disease Control and Prevention. They include: (a) aligning EBPs with a community's shared vision and values; (b) establishing an inclusive environment for the planning, implementation and evaluation of EBPs; (c) nurturing collaboration for increased effectiveness and efficacy of EBPs; (d) building adequate leadership and community capacity to develop and sustain EBPs; and (e) building a learning community for evaluation and self-reflection. The authors propose placing greater emphasis on "evaluative thinking" and organizational capacity for evaluation as we pursue evidence-based practices for youth violence prevention. This is especially important for ethnic groups for which an evidence base is not well established.

The Quantitative Evaluation of the Clinical and Translational Science Awards (CTSA) Program Based on Science Mapping and Scientometric Analysis

PubMed Central

Zhang, Yin; Wang, Lei

2013-01-01

Abstract The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. PMID:24330689

Evaluating the potential of group singing to enhance the well-being of older people.

PubMed

Davidson, Jane W; McNamara, Beverley; Rosenwax, Lorna; Lange, Andrea; Jenkins, Sue; Lewin, Gill

2014-06-01

To evaluate the effect of a singing program developed specifically for older community-dwelling people on measures of health and well-being. An eight-week singing program was developed and evaluated using standardised measures of health and well-being, measures designed to examine specific singing program outcomes, and semi-structured interviews. Participants aged 70 years and older were recruited through a home care service provider (n = 17) and an advertisement in a community newspaper (n = 19). Standard outcome measures indicated that the program had little effect on health and well-being. However, study-specific measures indicated that many participants had positive gains. Those in the home care group required more assistance to attend and continue in the program than those in the general community. Participants reported that the community-based singing facilitator was essential to the program's success. Well-structured community-based singing programs have the potential to impact positively upon the well-being of older people, but program viability depends on support with recruitment, transport and funding. © 2013 The Authors. Australasian Journal on Ageing © 2013 ACOTA.

The quantitative evaluation of the Clinical and Translational Science Awards (CTSA) program based on science mapping and scientometric analysis.

PubMed

Zhang, Yin; Wang, Lei; Diao, Tianxi

2013-12-01

The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. © 2013 Wiley Periodicals, Inc.

What Works to Reduce Victimization? Synthesizing What We Know and Where to Go From Here.

PubMed

Fox, Kathleen A; Shjarback, John A

2016-01-01

While some attention has been paid to "what works" to reduce crime, little is known about the effectiveness of programs designed to reduce victimization. This study systematically reviews 83 program evaluations to identify what works to (a) reduce victimization, (b) enhance beliefs/attitudes about victims, and (c) improve knowledge/awareness of victimization issues. Evidence-based findings are organized around 4 major forms of victimization, including bullying, intimate partner violence, sexual abuse, and other general forms of victimization. Determining whether certain types of programs can reduce the risk of victimization has important implications for improving people's quality of life. Based on our findings, we offer several promising directions for the next generation of research on evaluating victimization programs. The goal of this study is to improve the strength of future program evaluations, replications, and other systematic reviews as researchers and practitioners continue to learn what works to reduce victimization.

Design and evaluation of the computer-based training program Calcularis for enhancing numerical cognition

PubMed Central

Käser, Tanja; Baschera, Gian-Marco; Kohn, Juliane; Kucian, Karin; Richtmann, Verena; Grond, Ursina; Gross, Markus; von Aster, Michael

2013-01-01

This article presents the design and a first pilot evaluation of the computer-based training program Calcularis for children with developmental dyscalculia (DD) or difficulties in learning mathematics. The program has been designed according to insights on the typical and atypical development of mathematical abilities. The learning process is supported through multimodal cues, which encode different properties of numbers. To offer optimal learning conditions, a user model completes the program and allows flexible adaptation to a child's individual learning and knowledge profile. Thirty-two children with difficulties in learning mathematics completed the 6–12-weeks computer training. The children played the game for 20 min per day for 5 days a week. The training effects were evaluated using neuropsychological tests. Generally, children benefited significantly from the training regarding number representation and arithmetic operations. Furthermore, children liked to play with the program and reported that the training improved their mathematical abilities. PMID:23935586

Impact on house staff evaluation scores when changing from a Dreyfus- to a Milestone-based evaluation model: one internal medicine residency program's findings.

PubMed

Friedman, Karen A; Balwan, Sandy; Cacace, Frank; Katona, Kyle; Sunday, Suzanne; Chaudhry, Saima

2014-01-01

Purpose As graduate medical education (GME) moves into the Next Accreditation System (NAS), programs must take a critical look at their current models of evaluation and assess how well they align with reporting outcomes. Our objective was to assess the impact on house staff evaluation scores when transitioning from a Dreyfus-based model of evaluation to a Milestone-based model of evaluation. Milestones are a key component of the NAS. Method We analyzed all end of rotation evaluations of house staff completed by faculty for academic years 2010-2011 (pre-Dreyfus model) and 2011-2012 (post-Milestone model) in one large university-based internal medicine residency training program. Main measures included change in PGY-level average score; slope, range, and separation of average scores across all six Accreditation Council for Graduate Medical Education (ACGME) competencies. Results Transitioning from a Dreyfus-based model to a Milestone-based model resulted in a larger separation in the scores between our three post-graduate year classes, a steeper progression of scores in the PGY-1 class, a wider use of the 5-point scale on our global end of rotation evaluation form, and a downward shift in the PGY-1 scores and an upward shift in the PGY-3 scores. Conclusions For faculty trained in both models of assessment, the Milestone-based model had greater discriminatory ability as evidenced by the larger separation in the scores for all the classes, in particular the PGY-1 class.

Evaluation of a program to increase evidence-based practice change.

PubMed

Larrabee, June H; Sions, Jacqueline; Fanning, Mary; Withrow, Mary Lynne; Ferretti, Andrea

2007-06-01

The study evaluated a nursing research program designed to achieve systematic evidence-based practice change. Specifically, change in nurse attitudes about use of research and research conduct, practice change projects, and nurse participation in research-related activities were evaluated. Evidence indicates that successful evidence-based practice change in an organization requires senior leadership support and a systematic program for practice change. Evaluation of program effectiveness provides evidence about opportunities for further improvement. Quantitative evaluation used a pretest-posttest design. The site was an academic medical center in rural West Virginia. Participants were registered nurses from all inpatients units, perioperative services, and emergency departments. Surveys used Alcock et al's Staff Nurses and Research Activities scale. Descriptive evaluation included the number of nurses who attended the workshop, practice change projects, scholarly products disseminated, and outcome of a Magnet review. First, knowledge about the availability of support services increased between 1999 and 2002 and was associated with higher attitude scores about research and research utilization. Second, registered nurses who reported participating in research-related activities had more positive scores on all attitudes than registered nurses who reported not participating. Nurse leaders may improve participation and attitudes about research and research utilization by internally marketing the support available for research-related activities.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

PubMed

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

PubMed Central

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-01-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies. PMID:29234174

Development of the Joint Committee Standards for Evaluations of Educational Programs, Projects, and Materials.

ERIC Educational Resources Information Center

Diamond, Esther E.

The growing demand for program evaluation in the 1970s gave rise to a need for a comprehensive, carefully developed, objective set of guiding principles for the evaluation process, from initial planning to final report. The Joint Committee on Standards for Education Evaluation was established to meet this need. This broad-based group, representing…

Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

PubMed

Wand, Timothy; White, Kathryn; Patching, Joanna

2011-06-01

Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

Tai Chi: moving for better balance -- development of a community-based falls prevention program.

PubMed

Li, Fuzhong; Harmer, Peter; Mack, Karin A; Sleet, David; Fisher, K John; Kohn, Melvin A; Millet, Lisa M; Xu, Junheng; Yang, Tingzhong; Sutton, Beth; Tompkins, Yvaughn

2008-05-01

This study was designed to develop an evidence- and community based falls prevention program -- Tai Chi: Moving for Better Balance. A mixed qualitative and quantitative approach was used to develop a package of materials for program implementation and evaluation. The developmental work was conducted in 2 communities in the Pacific Northwest. Participants included a panel of experts, senior service program managers or activity coordinators, and older adults. Outcome measures involved program feasibility and satisfaction. Through an iterative process, a program package was developed. The package contained an implementation plan and class training materials (ie, instructor's manual, videotape, and user's guidebook). Pilot testing of program materials showed that the content was appropriate for the targeted users (community-living older adults) and providers (local senior service organizations). A feasibility survey indicated interest and support from users and providers for program implementation. A 2-week pilot evaluation showed that the program implementation was feasible and evidenced good class attendance, high participant satisfaction, and interest in continuing Tai Chi. The package of materials developed in this study provides a solid foundation for larger scale implementation and evaluation of the program in community settings.

Evaluating the Effectiveness of the 2000-2001 NASA CONNECT(TM) Program

NASA Technical Reports Server (NTRS)

Pinelli, Thomas E.; Frank, Kari Lou; Lambert, Matthew A.

2002-01-01

This report contains the results of the evaluation conducted for the 2000-2001 NASA CONNECT(TM) program conducted in March 2001. The analysis is based on the results collected from 154 surveys collected from educators registered for the program. Respondents indicated that the objectives for each program were met; the programs were aligned with the national (mathematics, science, and technology) standards; the programs were developmentally (grade level) appropriate; and the programs in the 2000-2001 NASA CONNECT(TM) series enhanced/enriched the teaching of mathematics, science, and technology.

Analysis of School Food Safety Programs Based on HACCP Principles

ERIC Educational Resources Information Center

Roberts, Kevin R.; Sauer, Kevin; Sneed, Jeannie; Kwon, Junehee; Olds, David; Cole, Kerri; Shanklin, Carol

2014-01-01

Purpose/Objectives: The purpose of this study was to determine how school districts have implemented food safety programs based on HACCP principles. Specific objectives included: (1) Evaluate how schools are implementing components of food safety programs; and (2) Determine foodservice employees food-handling practices related to food safety.…

Exploratory Evaluation of a School-Based Child Sexual Abuse Prevention Program

ERIC Educational Resources Information Center

Barron, Ian G.; Topping, Keith J.

2013-01-01

Internationally, efficacy studies of school-based child sexual abuse prevention programs display a series of methodological shortcomings. Few studies include adolescent participants, recording of disclosures has been inconsistent, and no studies to date have assessed presenter adherence to program protocols or summated the costs of program…

A statewide nurse training program for a hospital based infant abusive head trauma prevention program.

PubMed

Nocera, Maryalice; Shanahan, Meghan; Murphy, Robert A; Sullivan, Kelly M; Barr, Marilyn; Price, Julie; Zolotor, Adam

2016-01-01

Successful implementation of universal patient education programs requires training large numbers of nursing staff in new content and procedures and maintaining fidelity to program standards. In preparation for statewide adoption of a hospital based universal education program, nursing staff at 85 hospitals and 1 birthing center in North Carolina received standardized training. This article describes the training program and reports findings from the process, outcome and impact evaluations of this training. Evaluation strategies were designed to query nurse satisfaction with training and course content; determine if training conveyed new information, and assess if nurses applied lessons from the training sessions to deliver the program as designed. Trainings were conducted during April 2008-February 2010. Evaluations were received from 4358 attendees. Information was obtained about training type, participants' perceptions of newness and usefulness of information and how the program compared to other education materials. Program fidelity data were collected using telephone surveys about compliance to delivery of teaching points and teaching behaviors. Results demonstrate high levels of satisfaction and perceptions of program utility as well as adherence to program model. These findings support the feasibility of implementing a universal patient education programs with strong uptake utilizing large scale systematic training programs. Copyright © 2015 Elsevier Ltd. All rights reserved.

Pharmacist Web-Based Training Program on Medication Use in Chronic Kidney Disease Patients: Impact on Knowledge, Skills, and Satisfaction

ERIC Educational Resources Information Center

Legris, Marie-eve; Seguin, Noemie Charbonneau; Desforges, Katherine; Sauve, Patricia; Lord, Anne; Bell, Robert; Berbiche, Djamal; Desrochers, Jean-Francois; Lemieux, Jean-Philippe; Morin-Belanger, Claudia; Paradis, Francois Ste-Marie; Lalonde, Lyne

2011-01-01

Introduction: Chronic kidney disease (CKD) patients are multimorbid elderly at high risk of drug-related problems. A Web-based training program was developed based on a list of significant drug-related problems in CKD patients requiring a pharmaceutical intervention. The objectives were to evaluate the impact of the program on community…

Typology of Delivery Quality: Latent Profile Analysis of Teacher Engagement and Delivery Techniques in a School-Based Prevention Intervention, "Keepin' It REAL" Curriculum

ERIC Educational Resources Information Center

Shin, YoungJu; Miller-Day, Michelle; Pettigrew, Jonathan; Hecht, Michael L.; Krieger, Janice L.

2014-01-01

Enhancing the delivery quality of school-based, evidence-based prevention programs is one key to ensuring uniform program effects on student outcomes. Program evaluations often focus on content dosage when implementing prevention curricula, however, less is known about implementation quality of prevention content, especially among teachers who may…

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

PubMed

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. ©Patrick Ware, Heather J Ross, Joseph A Cafazzo, Audrey Laporte, Emily Seto. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 03.05.2018.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol

PubMed Central

Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-01-01

Background Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. Objective The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. Methods The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. Results The telemonitoring program was launched in August 2016 and patient enrollment is ongoing. Conclusions The methods described provide an example for conducting comprehensive evaluations of telemonitoring programs. The combination of impact, implementation, and cost evaluations will inform the quality improvement of the existing program and will yield insights into the sustainability of smartphone-based telemonitoring programs for patients with heart failure within a specialty care setting. PMID:29724704

40 CFR 122.37 - Will the small MS4 storm water program regulations at §§ 122.32 through 122.36 and § 123.35 of...

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 23 2012-07-01 2012-07-01 false Will the small MS4 storm water program... Special NPDES Program Requirements § 122.37 Will the small MS4 storm water program regulations at §§ 122... evaluation of the NPDES MS4 storm water program. EPA will re-evaluate the regulations based on data from the...

40 CFR 122.37 - Will the small MS4 storm water program regulations at §§ 122.32 through 122.36 and § 123.35 of...

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 23 2013-07-01 2013-07-01 false Will the small MS4 storm water program... Special NPDES Program Requirements § 122.37 Will the small MS4 storm water program regulations at §§ 122... evaluation of the NPDES MS4 storm water program. EPA will re-evaluate the regulations based on data from the...

40 CFR 122.37 - Will the small MS4 storm water program regulations at §§ 122.32 through 122.36 and § 123.35 of...

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 22 2014-07-01 2013-07-01 true Will the small MS4 storm water program... Special NPDES Program Requirements § 122.37 Will the small MS4 storm water program regulations at §§ 122... evaluation of the NPDES MS4 storm water program. EPA will re-evaluate the regulations based on data from the...

The Project P.A.T.H.S. in Hong Kong: Work Done and Lessons Learned in a Decade.

PubMed

Shek, Daniel T L; Wu, Florence K Y

2016-02-01

The Project Positive Adolescent Training through Holistic Social Programs is a positive youth development program initiated and financially supported by The Hong Kong Jockey Club Charities Trust. Since 2005, the project has gone through several phases, including the initial phase (2005-2012), school-based extension phase (2009-2016), and community-based extension phase (2013-2017). In the initial phase, with the involvement of academics from 5 universities in Hong Kong, the research team developed youth enhancement programs for junior secondary school students (20 hours per grade), trained the program implementers (20 hours per grade), assisted in the implementation in more than 250 schools, and evaluated the program using multiple evaluation strategies, including a 5-year longitudinal experimental study. In the school-based extension phase, the project was implemented for another cycle (2009-2010 and 2011-2012 school years) and a 6-year longitudinal study was conducted to understand the psychosocial development of Chinese adolescents in Hong Kong. In the community-based extension phase, the programs were administered by social workers in the community settings. Generally speaking, different evaluation findings showed that the programs in Project Positive Adolescent Training through Holistic Social Programs promoted positive development and reduced risk behavior in Chinese adolescents in Hong Kong. Positive youth development attributes and family functioning also have positive contributions to adolescent developmental outcomes over time. Copyright © 2016 North American Society for Pediatric and Adolescent Gynecology. Published by Elsevier Inc. All rights reserved.

Evaluating theory-based evaluation: information, norms, and adherence.

PubMed

Jacobs, W Jake; Sisco, Melissa; Hill, Dawn; Malter, Frederic; Figueredo, Aurelio José

2012-08-01

Programmatic social interventions attempt to produce appropriate social-norm-guided behavior in an open environment. A marriage of applicable psychological theory, appropriate program evaluation theory, and outcome of evaluations of specific social interventions assures the acquisition of cumulative theory and the production of successful social interventions--the marriage permits us to advance knowledge by making use of both success and failures. We briefly review well-established principles within the field of program evaluation, well-established processes involved in changing social norms and social-norm adherence, the outcome of several program evaluations focusing on smoking prevention, pro-environmental behavior, and rape prevention and, using the principle of learning from our failures, examine why these programs often do not perform as expected. Finally, we discuss the promise of learning from our collective experiences to develop a cumulative science of program evaluation and to improve the performance of extant and future interventions. Copyright © 2012. Published by Elsevier Ltd.

When Control Groups Do Not Exist: Program Evaluation without a Net.

ERIC Educational Resources Information Center

Clark, Sheldon B.; And Others

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Benefits of Using the "NADE Self-Evaluation Guides" for Program Development, Improvement, and Evaluation

ERIC Educational Resources Information Center

Neuburger, Jane

2018-01-01

The "NADE Self-Evaluation Guides" are a compendium of best practices in four areas: (1) Tutoring Services; (2) Course-based Learning Assistance; (3) the Teaching & Learning Process; and (4) Developmental Coursework, also recently known as transitional, co-requisite, accelerated, or bridge programs, all of which are…

Evaluability Assessment Thesis and Dissertation Studies in Graduate Professional Degree Programs

ERIC Educational Resources Information Center

Walser, Tamara M.; Trevisan, Michael S.

2016-01-01

Evaluability assessment (EA) has potential as a design option for thesis and dissertation studies, serving as a practical training experience for both technical and nontechnical evaluation skills. Based on a content review of a sample of EA theses and dissertations from graduate professional degree programs, the authors of this article found that…

Evaluation of the Science Enrichment Activities (SEA) Program: A Decision Oriented Model.

ERIC Educational Resources Information Center

Linn, Marcia C.

1978-01-01

Three questions guided an evaluation of sixth and eighth grade science enrichment activities: (1) Does a free choice interactive program affect cognitive abilities? (2) Do students in a free choice program make predictable selections of activities based on their age, sex, or ability level? and (3) Are specific student choices associated with…

Evaluation of the Waterford Early Reading Program in Kindergarten, 2005-06

ERIC Educational Resources Information Center

Powers, Stephen; Price-Johnson, Connie

2006-01-01

Background: The Waterford Early Reading Program (WERP), a technology-based program for early elementary grades, was provided through Arizona all day kindergarten funds to kindergarten students in 15 Title I elementary schools in the Tucson Unified School District (TUSD) in the 2005-06 school year. The purpose of this study is to evaluate the…

Using Maps in Web Analytics to Evaluate the Impact of Web-Based Extension Programs

ERIC Educational Resources Information Center

Veregin, Howard

2015-01-01

Maps can be a valuable addition to the Web analytics toolbox for Extension programs that use the Web to disseminate information. Extension professionals use Web analytics tools to evaluate program impacts. Maps add a unique perspective through visualization and analysis of geographic patterns and their relationships to other variables. Maps can…

Challenging the Gifted through Problem Solving Experiences: Design and Evaluation of the COMET Program.

ERIC Educational Resources Information Center

Feldhusen, John F.; And Others

1992-01-01

The COMET summer residential program at Purdue University (Indiana) offers gifted and talented youth in grades 4-6 a week of intensive study in a single content area. Courses stress specific problem-solving skills and development of a rich knowledge base. Extensive program evaluation by students, teachers, counselors, and parents was highly…

Program Evaluation and Replications of School-Based Mental Health Services and Family-Community Interventions with Chronically Disruptive Students

ERIC Educational Resources Information Center

Carpenter-Aeby, Tracy; Aeby, Victor G.

2005-01-01

Although outcomes for alternative schools may be mixed, it is generally agreed that counseling, therapy, group work, case management, and family-community involvement have been credited in some effective programs. This study examined program evaluations from 1994-1999 for an alternative school for chronically disruptive students (599 students,…

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

ERIC Educational Resources Information Center

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

National Home Start Evaluation. Interim Report V: Case Studies.

ERIC Educational Resources Information Center

Jerome, Chris H.; And Others

One of a series of documents on the evaluation of the National Home Start (NHS) program this third year interim report of case studies describes program efforts and successes with 16 Home Start families throughout the nation. A federally funded demonstration program, NHS is aimed at providing home-based services (such as health, education,…

Demonstrating Impact through Replicable Analysis: Implications of an Evaluation of Arkansas's Expanded Food and Nutrition Education Program

ERIC Educational Resources Information Center

Phelps, Josh; Brite-Lane, Allison; Crook, Tina; Hakkak, Reza; Fuller, Serena

2017-01-01

The evaluation described in this article focused on the effectiveness of Arkansas's Extension-based Expanded Food and Nutrition Education Program (EFNEP) but demonstrates an analytic approach that may be useful across Extension programs. We analyzed data from 1,810 Arkansas EFNEP participants' entry and exit Behavior Checklists to assess…

Development and Pilot Evaluation of a Psychosocial Intervention Program for Patients with Age-Related Macular Degeneration

ERIC Educational Resources Information Center

Birk, Tanja; Hickl, Susanne; Wahl, Hans-Werner; Miller, Daniel; Kammerer, Annette; Holz, Frank; Becker, Stefanie; Volcker, Hans E.

2004-01-01

Purpose: The psychosocial needs of patients suffering from severe visual loss associated with advanced age-related macular degeneration (ARMD) are generally ignored in the clinical routine. The aim of this study was to develop and evaluate a psychosocial intervention program for ARMD patients. This intervention program was based on six modules…

Development of a Logic Model to Guide Evaluations of the ASCA National Model for School Counseling Programs

ERIC Educational Resources Information Center

Martin, Ian; Carey, John

2014-01-01

A logic model was developed based on an analysis of the 2012 American School Counselor Association (ASCA) National Model in order to provide direction for program evaluation initiatives. The logic model identified three outcomes (increased student achievement/gap reduction, increased school counseling program resources, and systemic change and…

Improving Processual Quality in Early Education and Care: Process Findings from the Evaluation of the Benevolent Society's Partnerships in Early Education Program

ERIC Educational Resources Information Center

Valentine, Kylie; Thomson, Cathy

2009-01-01

This paper describes the facilitators and barriers to implementing an attachment-based intervention in early education and care settings, the Partnerships in Early Childhood program (PIEC), based on findings from the process evaluation of its first year of implementation. The paper focuses on four areas: the nature of the partnership and program…

Assessing the Effectiveness of a School-Based Dental Clinic on the Oral Health of Children Who Lack Access to Dental Care: A Program Evaluation

ERIC Educational Resources Information Center

Carpino, Rachel; Walker, Mary P.; Liu, Ying; Simmer-Beck, Melanie

2017-01-01

This program evaluation examines the effectiveness of a school-based dental clinic. A repeated-measures design was used to longitudinally examine secondary data from participants (N = 293). Encounter intensity was developed to normalize data. Multivariate analysis of variance and Kruskal-Wallis test were used to investigate the effect of encounter…

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

PubMed

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

Design of the Dutch Obesity Intervention in Teenagers (NRG-DOiT): systematic development, implementation and evaluation of a school-based intervention aimed at the prevention of excessive weight gain in adolescents

PubMed Central

Singh, Amika S; Chin A Paw, Marijke JM; Kremers, Stef PJ; Visscher, Tommy LS; Brug, Johannes; van Mechelen, Willem

2006-01-01

Background Only limited data are available on the development, implementation, and evaluation processes of weight gain prevention programs in adolescents. To be able to learn from successes and failures of such interventions, integral written and published reports are needed. Methods Applying the Intervention Mapping (IM) protocol, this paper describes the development, implementation, and evaluation of the Dutch Obesity Intervention in Teenagers (DOiT), a school-based intervention program aimed at the prevention of excessive weight gain. The intervention focussed on the following health behaviours: (1) reduction of the consumption of sugar-sweetened beverages, (2) reduction of energy intake derived from snacks, (3) decrease of levels of sedentary behaviour, and (4) increase of levels of physical activity (i.e. active transport behaviour and sports participation). The intervention program consisted of an individual classroom-based component (i.e. an educational program, covering 11 lessons of both biology and physical education classes), and an environmental component (i.e. encouraging and supporting changes at the school canteens, as well as offering additional physical education classes). We evaluated the effectiveness of the intervention program using a randomised controlled trial design. We assessed the effects of the intervention on body composition (primary outcome measure), as well as on behaviour, behavioural determinants, and aerobic fitness (secondary outcome measures). Furthermore, we conducted a process evaluation. Discussion The development of the DOiT-intervention resulted in a comprehensive school-based weight gain prevention program, tailored to the needs of Dutch adolescents from low socio-economic background. PMID:17173701

A multidimensional evaluation of a nursing information-literacy program.

PubMed Central

Fox, L M; Richter, J M; White, N E

1996-01-01

The goal of an information-literacy program is to develop student skills in locating, evaluating, and applying information for use in critical thinking and problem solving. This paper describes a multidimensional evaluation process for determining nursing students' growth in cognitive and affective domains. Results indicate improvement in student skills as a result of a nursing information-literacy program. Multidimensional evaluation produces a well-rounded picture of student progress based on formal measurement as well as informal feedback. Developing new educational programs can be a time-consuming challenge. It is important, when expending so much effort, to ensure that the goals of the new program are achieved and benefits to students demonstrated. A multidimensional approach to evaluation can help to accomplish those ends. In 1988, The University of Northern Colorado School of Nursing began working with a librarian to integrate an information-literacy component, entitled Pathways to Information Literacy, into the curriculum. This article describes the program and discusses how a multidimensional evaluation process was used to assess program effectiveness. The evaluation process not only helped to measure the effectiveness of the program but also allowed the instructors to use several different approaches to evaluation. PMID:8826621

The Impact of a Campus-Based 4-H Summer Conference Program on Youth Thriving

ERIC Educational Resources Information Center

Arnold, Mary E.; Davis, Jamie M.; Lundeberg, Roberta

2017-01-01

In 2014 the Oregon 4-H program adopted a new program model to describe and evaluate the impact of 4-H on youths. The model is based on promoting thriving in young people, with an emphasis on high program quality. This article discusses the impact on thriving in 378 youth participants of the 4-H Summer Conference (4-HSC) program. The results of the…

The Development and Evaluation of a Parent Training Manual for Home Instruction.

ERIC Educational Resources Information Center

Yaman, Nancy; Hanson, Ralph A.

The development of a simple and effective means of training parents and other non-professionals in the use of a home-based instructional program is the concern of this paper. The home-based program is the SWRL Parent-Assisted Learning Program (PAL). PAL was created as an adjunct to a broader communication skills program, First Year Communication…

The Social Construction of "Evidence-Based" Drug Prevention Programs: A Reanalysis of Data from the Drug Abuse Resistance Education (DARE) Program

ERIC Educational Resources Information Center

Gorman, Dennis M.; Huber, J. Charles, Jr.

2009-01-01

This study explores the possibility that any drug prevention program might be considered "evidence-based" given the use of data analysis procedures that optimize the chance of producing statistically significant results by reanalyzing data from a Drug Abuse Resistance Education (DARE) program evaluation. The analysis produced a number of…

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

PubMed

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

Assessment of Evidence-based Management Training Program: Application of a Logic Model.

PubMed

Guo, Ruiling; Farnsworth, Tracy J; Hermanson, Patrick M

2016-06-01

The purposes of this study were to apply a logic model to plan and implement an evidence-based management (EBMgt) educational training program for healthcare administrators and to examine whether a logic model is a useful tool for evaluating the outcomes of the educational program. The logic model was used as a conceptual framework to guide the investigators in developing an EBMgt educational training program and evaluating the outcomes of the program. The major components of the logic model were constructed as inputs, outputs, and outcomes/impacts. The investigators delineated the logic model based on the results of the needs assessment survey. Two 3-hour training workshops were delivered to 30 participants. To assess the outcomes of the EBMgt educational program, pre- and post-tests and self-reflection surveys were conducted. The data were collected and analyzed descriptively and inferentially, using the IBM Statistical Package for the Social Sciences (SPSS) 22.0. A paired sample t-test was performed to compare the differences in participants' EBMgt knowledge and skills prior to and after the training. The assessment results showed that there was a statistically significant difference in participants' EBMgt knowledge and information searching skills before and after the training (p< 0.001). Participants' confidence in using the EBMgt approach for decision-making was significantly increased after the training workshops (p< 0.001). Eighty-three percent of participants indicated that the knowledge and skills they gained through the training program could be used for future management decision-making in their healthcare organizations. The overall evaluation results of the program were positive. It is suggested that the logic model is a useful tool for program planning, implementation, and evaluation, and it also improves the outcomes of the educational program.

Development and process evaluation of a Web-based responsible beverage service training program.

PubMed

Danaher, Brian G; Dresser, Jack; Shaw, Tracy; Severson, Herbert H; Tyler, Milagra S; Maxwell, Elisabeth D; Christiansen, Steve M

2012-09-22

Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers' knowledge, attitudes, and self-efficacy. Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention.

Moving toward evidence-based federal Healthy Start program evaluations: accounting for bias in birth outcomes studies.

PubMed

Meghea, Cristian I; Raffo, Jennifer E; VanderMeulen, Peggy; Roman, Lee Anne

2014-02-01

We used administrative and screening data from 2009 to 2010 to determine if Healthy Start (HS), an enhanced prenatal services program, is reaching the most vulnerable African American women in Kent County, Michigan. Women in HS are at higher risk of key predictors of birth outcomes compared with other women. To advance toward evidence-based HS program evaluations in the absence of randomized controlled trials, future studies using comparison groups need to appropriately establish baseline equivalence on a variety of risk factors related to birth outcomes.

National impacts of the Weatherization Assistance Program in single-family and small multifamily dwellings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brown, M.A.; Berry, L.G.; Balzer, R.A.

1993-05-01

Since 1976, the US Department of Energy (DOE) has operated one of the largest energy conservation programs in the nation -- the low-income Weatherization Assistance Program. The program strives to increase the energy efficiency of dwellings occupied by low-income persons in order to reduce their energy consumption, lower their fuel bills, increase the comfort of their homes, and safeguard their health. It targets vulnerable groups including the elderly, people with disabilities, and families with children. The most recent national evaluation of the impacts of the Program was completed in 1984 based on energy consumption data for households weatherized in 1981.more » DOE Program regulations and operations have changed substantially since then: new funding sources, management principles, diagnostic procedures, and weatherization technologies have been incorporated. Many of these new features have been studied in isolation or at a local level; however, no recent evaluation has assessed their combined, nationwide impacts to date or their potential for the future. In 1990, DOE initiated such an evaluation. This evaluation is comprised of three ``impact`` studies (the Single-Family Study, High-Density Multifamily Study, and Fuel-Oil Study) and two ``policy`` studies. Altogether, these five studies will provide a comprehensive national assessment of the Weatherization Assistance Program as it existed in the 1989 Program Year (PY 1989). This report presents the results of the first phase of the Single-Family Study. It evaluates the energy savings and cost effectiveness of the Program as it has been applied to the largest portion of its client base -- low-income households that occupy single-family dwellings, mobile homes, and small (2- to 4-unit) multifamily dwellings. It is based upon a representative national sample that covers the full range of conditions under which the program was implemented in PY 1989.« less

Moving evidence-based drug abuse prevention programs from basic science to practice: "bridging the efficacy-effectiveness interface".

PubMed

August, Gerald J; Winters, Ken C; Realmuto, George M; Tarter, Ralph; Perry, Cheryl; Hektner, Joel M

2004-01-01

This article examines the challenges faced by developers of youth drug abuse prevention programs in transporting scientifically proven or evidence-based programs into natural community practice systems. Models for research on the transfer of prevention technology are described with specific emphasis given to the relationship between efficacy and effectiveness studies. Barriers that impede the successful integration of efficacy methods within effectiveness studies (e.g., client factors, practitioner factors, intervention structure characteristics, and environmental and organizational factors) are discussed. We present a modified model for program development and evaluation that includes a new type of research design, the hybrid efficacy-effectiveness study that addresses program transportability. The utility of the hybrid study is illustrated in the evaluation of the Early Risers "Skills for Success" prevention program.

Constructing a competency-based bariatric surgery fellowship training curriculum.

PubMed

McBride, Corrigan L; Rosenthal, Raul J; Brethauer, Stacy; DeMaria, Eric; Kelly, John J; Morton, John M; Lo Menzo, Emanuele; Moore, Rachel; Pomp, Alfons; Nguyen, Ninh T

2017-03-01

Bariatric fellowship training after general surgery has historically been time based and competence was determined at completion based on a minimum number of cases during the fellowship. Graduate medical education is moving toward competency-based medical education where learners are evaluated during the course of their training and competence assessment occurs throughout. The Executive Council of the American Society of Metabolic and Bariatric Surgery (ASMBS) at the direction of the American Board of Surgery wanted to transition the bariatric surgery fellowship curriculum from its traditional format to a competency-based curriculum using competency-based medical education principles. The ASMBS Education and Training Committee established a task force of 9 members to create a new curriculum and all of the necessary evaluation tools to support the curriculum, and initiate a pilot program. A competency-based curriculum consisting of 6 modules with cognitive and technical milestones, and the innovative evaluation tools needed to evaluate the learners, was created. A pilot program consisting of 10 programs and 19 fellows has been undertaken for the 2016-2017 academic year. The Education Committee of the ASMBS is leading the charge in curriculum development for competency-based medical education for bariatric fellowship. Copyright © 2017 American Society for Bariatric Surgery. Published by Elsevier Inc. All rights reserved.

Breaking barriers: a competency-based framework for promoting the integration of the pediatrician's education.

PubMed

Naghettini, Alessandra V; Bollela, Valdes R; Costa, Nilce M S C; Salgado, Luciana M R

2011-01-01

To describe the process of integration and revision of a pediatric program curriculum which resulted in the creation of a competency-based framework recommended in the Brazilian National Curricular Guidelines. Quali-quantitative analysis of an intervention evaluating the students and professors' perception of the pediatric program curriculum (focus groups and semi-structured interviews). Results were discussed during teaching development workshops. A competency-based framework was suggested for the pediatric program from the 3rd to the 6th year. The new curriculum was approved, implemented, and reevaluated six months later. Twelve students (12%) from the 3rd to the 6th year participated in the focus groups, and 11 professors (78.5%) answered the questionnaire. Most participants reported lack of integration among the courses, lack of knowledge about the learning goals of the internships, few opportunities of practice, and predominance of theoretical evaluation. In the training workshops, a competency-based curriculum was created after pediatrics and collective health professors reached an agreement. The new curriculum was focused on general competency, learning goals, opportunities available to learn these goals, and evaluation system. After six months, 93% (104/112) of students and 79% (11/14) of professors reported greater integration of the program and highlighted the inclusion of the clinical performance evaluation. The collective creation of a competency-based curriculum promoted higher satisfaction of students and professors. After being implemented, the new curriculum was considered to integrate the teaching practices and contents, improving the quality of the clinical performance evaluation.

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

PubMed

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Feasibility of Recruiting Families into a Heart Disease Prevention Program Based on Dietary Patterns

PubMed Central

Schumacher, Tracy L.; Burrows, Tracy L.; Thompson, Deborah I.; Spratt, Neil J.; Callister, Robin; Collins, Clare E.

2015-01-01

Offspring of parents with a history of cardiovascular disease (CVD) inherit a similar genetic profile and share diet and lifestyle behaviors. This study aimed to evaluate the feasibility of recruiting families at risk of CVD to a dietary prevention program, determine the changes in diet achieved, and program acceptability. Families were recruited into a pilot parallel group randomized controlled trial consisting of a three month evidence-based dietary intervention, based on the Mediterranean and Portfolio diets. Feasibility was assessed by recruitment and retention rates, change in diet by food frequency questionnaire, and program acceptability by qualitative interviews and program evaluation. Twenty one families were enrolled over 16 months, with fourteen families (n = 42 individuals) completing the study. Post-program dietary changes in the intervention group included small daily increases in vegetable serves (0.8 ± 1.3) and reduced usage of full-fat milk (−21%), cheese (−12%) and meat products (−17%). Qualitative interviews highlighted beneficial changes in food purchasing habits. Future studies need more effective methods of recruitment to engage families in the intervention. Once engaged, families made small incremental improvements in their diets. Evaluation indicated that feedback on diet and CVD risk factors, dietetic counselling and the resources provided were appropriate for a program of this type. PMID:26308048

Feasibility of Recruiting Families into a Heart Disease Prevention Program Based on Dietary Patterns.

PubMed

Schumacher, Tracy L; Burrows, Tracy L; Thompson, Deborah I; Spratt, Neil J; Callister, Robin; Collins, Clare E

2015-08-21

Offspring of parents with a history of cardiovascular disease (CVD) inherit a similar genetic profile and share diet and lifestyle behaviors. This study aimed to evaluate the feasibility of recruiting families at risk of CVD to a dietary prevention program, determine the changes in diet achieved, and program acceptability. Families were recruited into a pilot parallel group randomized controlled trial consisting of a three month evidence-based dietary intervention, based on the Mediterranean and Portfolio diets. Feasibility was assessed by recruitment and retention rates, change in diet by food frequency questionnaire, and program acceptability by qualitative interviews and program evaluation. Twenty one families were enrolled over 16 months, with fourteen families (n = 42 individuals) completing the study. Post-program dietary changes in the intervention group included small daily increases in vegetable serves (0.8 ± 1.3) and reduced usage of full-fat milk (-21%), cheese (-12%) and meat products (-17%). Qualitative interviews highlighted beneficial changes in food purchasing habits. Future studies need more effective methods of recruitment to engage families in the intervention. Once engaged, families made small incremental improvements in their diets. Evaluation indicated that feedback on diet and CVD risk factors, dietetic counselling and the resources provided were appropriate for a program of this type.

Do adolescents perceive police officers as credible instructors of substance abuse prevention programs?

PubMed

Hammond, Augustine; Sloboda, Zili; Tonkin, Peggy; Stephens, Richard; Teasdale, Brent; Grey, Scott F; Williams, Joseph

2008-08-01

Although program recipients' attitudes toward instructors are crucial to program outcomes, they have not been adequately examined in the substance abuse prevention literature. This study uses survey data to explore attitudes toward instructors of prevention programming held by students from a national longitudinal evaluation of a school-based substance abuse prevention program delivered by Drug Abuse Resistance Education (D.A.R.E.) officers. Our analyses indicated that students who had police officers as instructors evaluated program instructors significantly higher than students who had non-police officers as instructors. The evaluation of police instructors varied according to students' sociodemographic characteristics. Implications for future research and practice are considered.

Evaluation of the three-dimensional parabolic flow computer program SHIP

NASA Technical Reports Server (NTRS)

Pan, Y. S.

1978-01-01

The three-dimensional parabolic flow program SHIP designed for predicting supersonic combustor flow fields is evaluated to determine its capabilities. The mathematical foundation and numerical procedure are reviewed; simplifications are pointed out and commented upon. The program is then evaluated numerically by applying it to several subsonic and supersonic, turbulent, reacting and nonreacting flow problems. Computational results are compared with available experimental or other analytical data. Good agreements are obtained when the simplifications on which the program is based are justified. Limitations of the program and the needs for improvement and extension are pointed out. The present three dimensional parabolic flow program appears to be potentially useful for the development of supersonic combustors.

Evaluation of a Community-Based Intervention to Promote Rear Seating for Children

PubMed Central

Greenberg-Seth, Jennifer; Hemenway, David; Gallagher, Susan S.; Ross, Julie B.; Lissy, Karen S.

2004-01-01

Objectives. We evaluated the short-term effect of a community-based effort to promote child rear seating in a low-income Hispanic community. Methods. Child seating patterns were observed pre- and postintervention at intersections in 1 intervention and 2 control cities. Brief interviews assessed exposure to program messages. Results. Child rear seating increased from 33% to 49% in the intervention city (P < .0001), which represented a greater increase than that in the control cities (P < .0001). The greatest improvement was observed in relatively higher-income areas. Rear seating was significantly correlated with reported program exposure. Incentives and exposure to the program across multiple channels seemed to have the greatest effect. Conclusions. Independent of legislation, community-based programs incorporating incentives can increase child rear seating. PMID:15249307

The ElderSmile TimeMap: Benefits of Connecting Statistics With Time and Place.

PubMed

Kum, Susan S; Wang, Hua; Wang, Peng; Jin, Zhu; De La Cruz, Leydis; Northridge, Mary E; Kunzel, Carol; Marshall, Stephen E; Metcalf, Sara S

2015-09-01

Community-based programs are critical for locally targeted public health education and accessible service delivery. Deriving useful information from such programs is important for their own evaluation and improvement and may facilitate research collaboration with partners and experts. Here we present an interactive Web-based application designed for a community-based oral health outreach program called ElderSmile to demonstrate how data can be summarized, filtered, compared, and visualized by time and place to inform program planning, evaluation, and research. The ElderSmile TimeMap ( http://www.acsu.buffalo.edu/∼smetcalf/resources/timemap.html ) is an emergent product of a US National Institutes of Health-funded collaboration of knowledge sharing among multidisciplinary team members at the University at Buffalo, Columbia University, and New York University.

Acceptability Study of "Ascenso": An Online Program for Monitoring and Supporting Patients with Depression in Chile.

PubMed

Espinosa, H Daniel; Carrasco, Álvaro; Moessner, Markus; Cáceres, Cristian; Gloger, Sergio; Rojas, Graciela; Perez, J Carola; Vanegas, Jorge; Bauer, Stephanie; Krause, Mariane

2016-07-01

Major depression is a highly prevalent and severe mental disease. Despite the effective treatment options available, the risk of relapse is high. Interventions based on information and communication technologies generate innovative opportunities to provide support to patients after they completed treatment for depression. This acceptability study evaluated the Internet-based program Apoyo, Seguimiento y Cuidado de Enfermedades a partir de Sistemas Operativos (ASCENSO) in terms of its feasibility and acceptability in a sample of 35 patients in Chile. The study reveals high rates of acceptance and satisfaction among patients who actively used the program. As obstacles, patients mentioned technical problems, a lack of contact with other participants, and an insufficient connection between the program and the health service professionals. ASCENSO appears to be a promising complement to regular care for depression. Following improvements of the program based on participants' feedback, future research should evaluate its efficacy and cost-effectiveness.

Process and impact evaluation of a legal assistance and health care community partnership.

PubMed

Teufel, James A; Brown, Stephen L; Thorne, Woody; Goffinet, Diane M; Clemons, Latesha

2009-07-01

Community health partnerships have increased in popularity, but their effectiveness is often not evaluated. Through secondary data analysis, this study evaluates a program that offered access to legal services to address health-related issues, such as Medicaid reimbursement, Social Security benefits, medication coverage, and divorce. Based on the analysis reimbursements to expenditures, the health and law program appears to be cost-effective and thereby economically sustainable. The cost-effectiveness of this program increases the likelihood that it will be institutionalized and/or expanded. This program evaluation is used to exemplify how community stakeholders could partner to leverage resources to establish a sustainable community health and law program to address the needs of people living in medically underserved areas.

Building on a YMCA's health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_.

PubMed

Bush, Paula Louise; García Bengoechea, Enrique

2016-08-01

School-based physical activity programs are only effective for increasing adolescents' school-based physical activity. To increase out-of-school-time physical activity, complementary community programs are warranted. Partnerships between universities and community organizations may help build the capacity of these organizations to provide sustainable programs. To understand capacity building processes and outcomes, we partnered with a YMCA to build on their adolescent physical activity promotion capacity. Together, we designed and implemented means to evaluate the YMCA teen program to inform program planning. For this qualitative case study, emails and interviews and meetings transcripts were collected over 2.5 years and analyzed using inductive and deductive thematic analysis. Findings illustrate that the YMCA's workforce and organizational development capacities (e.g., evaluation and health promotion capacity and competence) were increased through our partnership, resource allocation, and leadership. We responded to YMCA partners' perceived needs, yet guided them beyond those needs, successfully combining our complementary objectives, knowledge, and skills to generate an integrated program vision, rationale, and evaluation results. This provided YMCA partners with validation, reminders, and awareness. In turn, this contributed to programming and evaluation practice changes. In light of extant capacity building literature, we discuss how our partnership increased the YMCA's capacity to promote healthy adolescent programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and implementation of a competency-based clinical evaluation tool for midwifery education.

PubMed

Woeber, Kate

2018-07-01

The learning goals and evaluation strategies of competency-based midwifery programs must be explicit and well-defined. In the US, didactic learning is evaluated through a standardized certification examination, but standardized clinical competence evaluation is lacking. The Midwifery Competency Assessment Tool (MCAT) has been adapted from the International Confederation of Midwives' (ICM) "Essential Competencies" and from the American College of Nurse-Midwives' (ACNM) "Core Competencies", with student self-evaluation based on Benner's Novice-to-Expert theory. The MCAT allows for the measurement and monitoring of competence development in all domains of full-scope practice over the course of the midwifery program. Strengths of the MCAT are that it provides clear learning goals and performance evaluations for students, ensures and communicates content mapping across a curriculum, and highlights strengths and gaps in clinical opportunities at individual clinical sites and for entire programs. Challenges of the MCAT lie in balancing the number of competency items to be measured with the tedium of form completion, in ensuring the accuracy of student self-evaluation, and in determining "adequate" competence achievement when particular clinical opportunities are limited. Use of the MCAT with competency-based clinical education may facilitate a more standardized approach to clinical evaluation, as well as a more strategic approach to clinical site development and use. Copyright © 2018 Elsevier Ltd. All rights reserved.

School-Based Mental Health Program Evaluation: Children's School Outcomes and Acute Mental Health Service Use

ERIC Educational Resources Information Center

Kang-Yi, Christina D.; Mandell, David S.; Hadley, Trevor

2013-01-01

Background: This study examined the impact of school-based mental health programs on children's school outcomes and the utilization of acute mental health services. Methods: The study sample included 468 Medicaid-enrolled children aged 6 to 17 years who were enrolled 1 of 2 school-based mental health programs (SBMHs) in a metropolitan area…

Reliability analysis of laminated CMC components through shell subelement techniques

NASA Technical Reports Server (NTRS)

Starlinger, Alois; Duffy, Stephen F.; Gyekenyesi, John P.

1992-01-01

An updated version of the integrated design program Composite Ceramics Analysis and Reliability Evaluation of Structures (C/CARES) was developed for the reliability evaluation of ceramic matrix composites (CMC) laminated shell components. The algorithm is now split into two modules: a finite-element data interface program and a reliability evaluation algorithm. More flexibility is achieved, allowing for easy implementation with various finite-element programs. The interface program creates a neutral data base which is then read by the reliability module. This neutral data base concept allows easy data transfer between different computer systems. The new interface program from the finite-element code Matrix Automated Reduction and Coupling (MARC) also includes the option of using hybrid laminates (a combination of plies of different materials or different layups) and allows for variations in temperature fields throughout the component. In the current version of C/CARES, a subelement technique was implemented, enabling stress gradients within an element to be taken into account. The noninteractive reliability function is now evaluated at each Gaussian integration point instead of using averaging techniques. As a result of the increased number of stress evaluation points, considerable improvements in the accuracy of reliability analyses were realized.

Evaluation of clinical practice guidelines.

PubMed Central

Basinski, A S

1995-01-01

Compared with the current focus on the development of clinical practice guidelines the effort devoted to their evaluation is meagre. Yet the ultimate success of guidelines depends on routine evaluation. Three types of evaluation are identified: evaluation of guidelines under development and before dissemination and implementation, evaluation of health care programs in which guidelines play a central role, and scientific evaluation, through studies that provide the scientific knowledge base for further evolution of guidelines. Identification of evaluation and program goals, evaluation design and a framework for evaluation planning are discussed. PMID:7489550

Innovative strategies for nursing education program evaluation.

PubMed

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

A Qualitative Analysis of Participant Learning and Growth Using a New Outward Bound Outcomes Instrument

ERIC Educational Resources Information Center

Bobilya, Andrew J.; Lindley, Betsy R.; Faircloth, W. Brad; Holman, Tom

2017-01-01

Evidence-based programming and the importance of research has gained attention among outdoor and adventure-based programs in recent years (Sibthorp, 2009) regardless of the challenges that often accompany this type of investigation (Bialeschki, Henderson, Hickerson, & Browne, 2012). Programs must often develop their own evaluation instruments,…

Raising Awareness of Assistive Technology in Older Adults through a Community-Based, Cooperative Extension Program

ERIC Educational Resources Information Center

Sellers, Debra M.; Markham, Melinda Stafford

2012-01-01

The Fashion an Easier Lifestyle with Assistive Technology (FELAT) curriculum was developed as a needs-based, community educational program provided through a state Cooperative Extension Service. The overall goal for participants was to raise awareness of assistive technology. Program evaluation included a postassessment and subsequent interview to…

The Effect of a Collaborative Mentoring Program on Beginning Science Teachers' Inquiry-Based Teaching Practice

ERIC Educational Resources Information Center

Nam, Jeonghee; Seung, Eulsun; Go, MunSuk

2013-01-01

This study investigated how a collaborative mentoring program influenced beginning science teachers' inquiry-based teaching and their reflection on practice. The one-year program consisted of five one-on-one mentoring meetings, weekly science education seminars, weekly mentoring group discussions, and self-evaluation activities. The participants…

The Effectiveness of a Web-Based Motor Skill Assessment Training Program

ERIC Educational Resources Information Center

Kelly, Luke E.; Moran, Thomas E.

2010-01-01

The purpose of this study was to evaluate the effectiveness of a web-based, intereactive video assessment program on teaching preservice physical education majors to assess the motor skill of kicking. The program provided component specific feedback through tutorial, guided practice, and competency training options. The 72 participants were…

75 FR 14165 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-24

..., telephone interviews, and a Web-based indicator reporting system. Web-based surveys are intended to collect... Project: Evaluation of the State Early Childhood Comprehensive Systems Grant (ECCS) Program: New HRSA's... Comprehensive Systems Grant (ECCS) Program. The purpose of the ECCS Program is to assist States and Territories...

Outcomes of Parent Education Programs Based on Reevaluation Counseling

ERIC Educational Resources Information Center

Wolfe, Randi B.; Hirsch, Barton J.

2003-01-01

We report two studies in which a parent education program based on Reevaluation Counseling was field-tested on mothers randomly assigned to treatment groups or equivalent, no-treatment comparison groups. The goal was to evaluate the program's viability, whether there were measurable effects, whether those effects were sustained over time, and…

76 FR 13648 - Proposed Collection; Comment Request; Process Evaluation of the NIH Roadmap Epigenomics Program

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-14

... assess program process and progress, is non-experimental. The assessment is based on secondary source... programs of the Agency. To reduce response bias and to make the survey as accessible as possible to busy principal investigators, the survey will be Web-based. Frequency of Response: Once. Affected Public...

Evaluating a county-based Healthy nail Salon Recognition Program

EPA Science Inventory

To determine whether nail solons that participate in the SF recognition program have reduced measured levels of toluene, methyl methacrylate (MMA), and total volatile organic compounds (TVOC)as compared to nail salons that do not participate. We also evaluated changes in worker ...

Using evaluation methods to guide the development of a tobacco-use prevention curriculum for youth: a case study.

PubMed

Bridge, P D; Gallagher, R E; Berry-Bobovski, L C

2000-01-01

Fundamental to the development of educational programs and curricula is the evaluation of processes and outcomes. Unfortunately, many otherwise well-designed programs do not incorporate stringent evaluation methods and are limited in measuring program development and effectiveness. Using an advertising lesson in a school-based tobacco-use prevention curriculum as a case study, the authors examine the role of evaluation in the development, implementation, and enhancement of the curricular lesson. A four-phase formative and summative evaluation design was developed to divide the program-evaluation continuum into a structured process that would aid in the management of the evaluation, as well as assess curricular components. Formative and summative evaluation can provide important guidance in the development, implementation, and enhancement of educational curricula. Evaluation strategies identified unexpected barriers and allowed the project team to make necessary "time-relevant" curricular adjustments during each stage of the process.

Supplemental Instruction (SI) at the Faculty of Engineering (LTH), Lund University, Sweden. An Evaluation of the SI-Program at Five LTH Engineering Programs Autumn 2008

ERIC Educational Resources Information Center

Malm, Joakim; Bryngfors, Leif E.; Mörner, Lise-Lotte

2010-01-01

The study presents an evaluation of the SI program in five engineering programs within the Faculty of Engineering (LTH) based on data from questionnaires to SI participants and SI-Leaders, credits taken by the students during the first year, and average grade data from high school for the first year students. The results show that participation in…

TEAM-HF Cost-Effectiveness Model: A Web-Based Program Designed to Evaluate the Cost-Effectiveness of Disease Management Programs in Heart Failure

PubMed Central

Reed, Shelby D.; Neilson, Matthew P.; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H.; Polsky, Daniel E.; Graham, Felicia L.; Bowers, Margaret T.; Paul, Sara C.; Granger, Bradi B.; Schulman, Kevin A.; Whellan, David J.; Riegel, Barbara; Levy, Wayne C.

2015-01-01

Background Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. Methods We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure (TEAM-HF) Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics, use of evidence-based medications, and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model (SHFM). Projections of resource use and quality of life are modeled using relationships with time-varying SHFM scores. The model can be used to evaluate parallel-group and single-cohort designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. Results The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. Conclusion The TEAM-HF Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. PMID:26542504

Pilot Program on Common Status Measures Objective-Referenced Tests. Colorado Evaluation Project, Report No. 1.

ERIC Educational Resources Information Center

Colorado State Dept. of Education, Denver.

The purpose of the Colorado Evaluation Project was to field test the Common Status Measures at grades four and eleven in conjunction with a statewide assessment program based on objective-referenced testing instruments developed by the Colorado Department of Education for grades kindergarten, three, six, nine, and twelve. The evaluation was…

A Pilot Evaluation of an Art Therapy Program for Refugee Youth from Burma

ERIC Educational Resources Information Center

Kowitt, Sarah Dorothy; Emmerling, Dane; Gavarkavich, Diane; Mershon, Claire-Helene; Linton, Kristin; Rubesin, Hillary; Agnew-Brune, Christine; Eng, Eugenia

2016-01-01

Art therapy is a promising form of therapy to address mental health concerns for refugee youth. This article describes the development and implementation of a pilot evaluation of an art therapy program for refugee adolescents from Burma currently living in the United States. Evaluation activities were based on the Centers for Disease Control and…

Third Year Report: Evaluation of the Artful Learning Program. CRESST Report 760

ERIC Educational Resources Information Center

Griffin, Noelle C.; Miyoshi, Judy N.

2009-01-01

The National Center for Research on Evaluation, Standards, and Student Testing (CRESST) at University of California, Los Angeles (UCLA) was contracted to undertake a three-year external evaluation of the Artful Learning program, an arts-based school improvement model developed from the work and philosophy of the late composer Leonard Bernstein.…

Message Design Guidelines For Screen-Based Programs.

ERIC Educational Resources Information Center

Rimar, G. I.

1996-01-01

Effective message design for screen-based computer or video instructional programs requires knowledge from many disciplines. Evaluates current conventions and suggests a new set of guidelines for screen-based designers. Discusses screen layout, highlighting and cueing, text font and style, text positioning, color, and graphical user interfaces for…

Intervention mapping protocol for developing a theory-based diabetes self-management education program.

PubMed

Song, Misoon; Choi, Suyoung; Kim, Se-An; Seo, Kyoungsan; Lee, Soo Jin

2015-01-01

Development of behavior theory-based health promotion programs is encouraged with the paradigm shift from contents to behavior outcomes. This article describes the development process of the diabetes self-management program for older Koreans (DSME-OK) using intervention mapping (IM) protocol. The IM protocol includes needs assessment, defining goals and objectives, identifying theory and determinants, developing a matrix to form change objectives, selecting strategies and methods, structuring the program, and planning for evaluation and pilot testing. The DSME-OK adopted seven behavior objectives developed by the American Association of Diabetes Educators as behavioral outcomes. The program applied an information-motivation-behavioral skills model, and interventions were targeted to 3 determinants to change health behaviors. Specific methods were selected to achieve each objective guided by IM protocol. As the final step, program evaluation was planned including a pilot test. The DSME-OK was structured as the 3 determinants of the IMB model were intervened to achieve behavior objectives in each session. The program has 12 weekly 90-min sessions tailored for older adults. Using the IM protocol in developing a theory-based self-management program was beneficial in terms of providing a systematic guide to developing theory-based and behavior outcome-focused health education programs.

A Program Evaluation of the Language Lab™: Response to Intervention Program for Teaching Grammar, Vocabulary, and Storytelling

ERIC Educational Resources Information Center

Wiechmann, JoAnn; Richardson, Martha; Jones, Don

2014-01-01

This program evaluation study addressed the struggle of local elementary school speech-language pathologists (SLPs) in a school district to provide evidence-based intervention in language for students below grade level as required by the U.S. Department of Education. Recently, Language Lab™ was published to address the needs of oral language…

A Drawing and Multi-Representational Computer Environment for Beginners' Learning of Programming Using C: Design and Pilot Formative Evaluation

ERIC Educational Resources Information Center

Kordaki, Maria

2010-01-01

This paper presents both the design and the pilot formative evaluation study of a computer-based problem-solving environment (named LECGO: Learning Environment for programming using C using Geometrical Objects) for the learning of computer programming using C by beginners. In its design, constructivist and social learning theories were taken into…

School-Based Smoking Prevention Programs for Adolescents in South Korea: A Systematic Review

ERIC Educational Resources Information Center

Park, Eunok

2006-01-01

The number of research papers evaluating programs designed to prevent adolescent smoking have increased in the last 13 years in Korea. The purpose of this study was to evaluate these programs, to review the features of the studies and to systemically assess the results on the knowledge about, and attitude to, smoking and smoking behavior. Database…

National Home Start Evaluation Interim Report VII. Twenty-Month Program Analysis and Findings.

ERIC Educational Resources Information Center

Love, John M.; And Others

This interim evaluation report focuses on process (formative) and outcome (summative) data collected in spring 1975 on the National Home Start Program. Home Start, a federally-funded 3-year (1972-1975) home-based demonstration program for low-income families with 3- to 5-year-old children was designed to enhance a mother's skills in dealing with…

Evaluation Report of a Detention-Based Student Disciplinary Program in a Honduran/International Primary School.

ERIC Educational Resources Information Center

Evans, Thomas J.

The Escuela Internacional Sampedrana (EIS) in Honduras implemented a new discipline program in its Primary School during the 1996-97 school year. This paper contains findings from three evaluations of the program--an initial analysis, a midyear report, and a year-end report. The first report analyzed the number of suspensions and detentions, as…

Adding to the Pool of Methods for Program Evaluation: A Comparison of Latent Class Analysis and Propensity Score Analysis

ERIC Educational Resources Information Center

Taylor, Lauren Christine

2013-01-01

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

Information Needs to Support an Evaluation Process for Bureau of Indian Affairs Educational Programs.

ERIC Educational Resources Information Center

Jeffery, James R., Comp.

The purpose of this paper is to provide the Director of the Office of Education Programs with an instrument with which to develop an educational data base for providing information to evaluate the education programs of the Bureau of Indian Affairs (BIA). Some specific issues and questions are presented along with background information. BIA…

Evaluation of Minority Retention Programs: The Undergraduate Research Opportunities Program at the University of Michigan.

ERIC Educational Resources Information Center

Jonides, John; And Others

An evaluation was done of the first year of the Undergraduate Research Opportunities Program (UROP) at the University of Michigan (Ann Arbor), which is designed not only to teach students about research and/or certain academic topics, but also to facilitate the identification of minority students with the university. This second aim is based on…

Evaluation of a Faith-Based Culturally Relevant Program for African American Substance Users at Risk for HIV in the Southern United States

ERIC Educational Resources Information Center

MacMaster, Samuel A.; Jones, Jenny L.; Rasch, Randolph F. R.; Crawford, Sharon L.; Thompson, Stephanie; Sanders, Edwin C., II

2007-01-01

Objective: This article provides an evaluation of a federally funded faith-based program that serves African Americans who use heroin and cocaine and are at risk for HIV/AIDS in Nashville, Tennessee. Methods: Data were collected from 163 individuals at baseline and 6- and 12-month follow-up interviews. A subset of participants (n = 51) completed…

Systematic Review of Empirically Evaluated School-Based Gambling Education Programs.

PubMed

Keen, Brittany; Blaszczynski, Alex; Anjoul, Fadi

2017-03-01

Adolescent problem gambling prevalence rates are reportedly five times higher than in the adult population. Several school-based gambling education programs have been developed in an attempt to reduce problem gambling among adolescents; however few have been empirically evaluated. The aim of this review was to report the outcome of studies empirically evaluating gambling education programs across international jurisdictions. A systematic review following guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement searching five academic databases: PubMed, Scopus, Medline, PsycINFO, and ERIC, was conducted. A total of 20 papers and 19 studies were included after screening and exclusion criteria were applied. All studies reported intervention effects on cognitive outcomes such as knowledge, perceptions, and beliefs. Only nine of the studies attempted to measure intervention effects on behavioural outcomes, and only five of those reported significant changes in gambling behaviour. Of these five, methodological inadequacies were commonly found including brief follow-up periods, lack of control comparison in post hoc analyses, and inconsistencies and misclassifications in the measurement of gambling behaviour, including problem gambling. Based on this review, recommendations are offered for the future development and evaluation of school-based gambling education programs relating to both methodological and content design and delivery considerations.

"Compassion, pleasantry, and hope": a process evaluation of a volunteer-based nonprofit.

PubMed

Mye, Sarah C; Moracco, Kathryn E

2015-06-01

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Grog Mob: lessons from an evaluation of a multi-disciplinary alcohol intervention for Aboriginal clients.

PubMed

d'Abbs, Peter; Togni, Samantha; Rosewarne, Clive; Boffa, John

2013-10-01

To evaluate a 12-month trial of an evidence-based non-residential treatment program for Indigenous clients with alcohol problems, offering three streams of care: pharmacotherapy, psychological and social support. Process evaluation of program implementation; outcome evaluation of client outcomes. despite constraints of time and remoteness, the trial demonstrated the feasibility of implementing such a program. The medical stream generated fewer pharmacotherapy prescriptions than expected. The most active stream was the psychological therapy stream. between March 2008 and April 2009, 129 clients were referred to the program, of whom 49 consented to have de-identified data used for the evaluation. Of these, 19 clients received one or more streams of care, 15 of whom (78.9%) subsequently stopped or reduced drinking. However, among the remaining 30 consenting clients who had not received an intervention, 70.0% also reported stopping or reducing drinking. The evidence of program effectiveness is therefore equivocal and evaluation over a longer period is required. The trial demonstrated the viability of, and demand for, evidence-based non-residential treatment for Indigenous clients with alcohol problems. Reasons behind an apparent reluctance among GPs to prescribe pharmacotherapy for Indigenous clients, and steps to overcome this, need further attention. © 2013 The Authors. ANZJPH © 2013 Public Health Association of Australia.

Evaluation of a case-based urology learning program.

PubMed

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Matching Interventions to Children's Mental Health Needs: Feasibility and Acceptability of a Pilot School-Based Trauma Intervention Program

ERIC Educational Resources Information Center

Brown, Elissa J.; McQuaid, Jennifer; Farina, Lana; Ali, Rehana; Winnick-Gelles, Amy

2006-01-01

The primary goal was to develop and implement a school-based, trauma-specific intervention program for inner-city children exposed to the World Trade Center attacks on September 11th, 2001. The feasibility and acceptability of the program, and its research component, were examined. The efficacy of the program was evaluated in a pilot study.…

A program evaluation of Protovation Camp at an elementary school in North Carolina

NASA Astrophysics Data System (ADS)

Cavoly, Denise Y.

The purpose of this program evaluation was to investigate the impact over time teachers' self-efficacies and the outcome expectancies of those who participated in an inquiry-based, hands-on, constructivist professional development program to learn science content. The hope was that after active participation in this inquiry-based professional development program that provides science inquiry experiences, the teachers, graduate students and elementary students would gain content knowledge, increase self-efficacies, and provide the outcome expectancies of the learning development program that provides science inquiry experiences. The mixed-methods approach used quantitative and qualitative data for campers, which consisted of pre-test and post-test scores on the Test of Science-Related Attitudes (TOSRA), the Draw-A-Scientist Test, Science Process Skills Inventory (SPSI) and content tests based on the camp activities. Additionally, TOSRA scores, Teacher Sense of Efficacy Scale (TSES), and Thinking about Science Survey (TSSI) results for the graduate students and elementary teachers were used along with qualitative data collected from plusdelta charts and interviews to determine the impact of participation in Protovation Camp on teachers and students. Results of the program evaluation indicated that when students were taught inquiry-based lessons that ignite wonder, both their attitudes toward science and their knowledge about science improved. An implication for teacher preparation programs was that practicing inquiry-based lessons on actual elementary students was an important component for teachers and graduate students as they prepare to positively impact student learning in their own classrooms. The findings of this study suggest that it is not just the length of the professional development program that is crucial, but the need for an implementation period while teachers work to transfer the learning to the classroom to their own students is critical to the success of process.

Effectiveness of a Core-Competency-based Program on Residents' Learning and Experience.

PubMed

Charles, Lesley; Triscott, Jean; Dobbs, Bonnie; Tian, Peter George; Babenko, Oksana

2016-06-01

The Care of the Elderly (COE) Diploma Program is a six-to-twelve-month enhanced skills program taken after two years of core residency training in Family Medicine. In 2010, we developed and implemented a core-competency-based COE Diploma program (CC), in lieu of one based on learning objectives (LO). This study assessed the effectiveness of the core-competency-based program on residents' learning and their training experience as compared to residents trained using learning objectives. The data from the 2007-2013 COE residents were used in the study, with nine and eight residents trained in the LO and CC programs, respectively. Residents' learning was measured using preceptors' evaluations of residents' skills/abilities throughout the program (118 evaluations in total). Residents' rating of training experience was measured using the Graduate's Questionnaire which residents completed after graduation. For residents' learning, overall, there was no significant difference between the two programs. However, when examined as a function of the four CanMEDS roles, there were significant increases in the CC residents' scores for two of the CanMEDS roles: Communicator/Collaborator/Manager and Scholar compared to residents in the LO program. With respect to residents' training experience, seven out of ten program components were rated by the CC residents higher than by the LO residents. The implementation of a COE CC program appears to facilitate resident learning and training experience.

Defining a staged-based process for economic and financial evaluations of mHealth programs.

PubMed

LeFevre, Amnesty E; Shillcutt, Samuel D; Broomhead, Sean; Labrique, Alain B; Jones, Tom

2017-01-01

Mobile and wireless technology for health (mHealth) has the potential to improve health outcomes by addressing critical health systems constraints that impede coverage, utilization, and effectiveness of health services. To date, few mHealth programs have been implemented at scale and there remains a paucity of evidence on their effectiveness and value for money. This paper aims to improve understanding among mHealth program managers and key stakeholders of how to select methods for economic evaluation (comparative analysis for determining value for money) and financial evaluation (determination of the cost of implementing an intervention, estimation of costs for sustaining or expanding an intervention, and assessment of its affordability). We outline a 6 stage-based process for selecting and integrating economic and financial evaluation methods into the monitoring and evaluation of mHealth solutions including (1) defining the program strategy and linkages with key outcomes, (2) assessment of effectiveness, (3) full economic evaluation or partial evaluation, (4) sub-group analyses, (5) estimating resource requirements for expansion, (6) affordability assessment and identification of models for financial sustainability. While application of these stages optimally occurs linearly, finite resources, limited technical expertise, and the timing of evaluation initiation may impede this. We recommend that analysts prioritize economic and financial evaluation methods based on programmatic linkages with health outcomes; alignment with an mHealth solution's broader stage of maturity and stage of evaluation; overarching monitoring and evaluation activities; stakeholder evidence needs; time point of initiation; and available resources for evaluations.

A Review of Indicators of Estuarine Tidal Wetland Condition

EPA Science Inventory

This review critically evaluates indicators of tidal wetland condition based on 36 indicator development studies and indicators developed as part of U.S. state tidal wetland monitoring programs. Individual metrics were evaluated based on relative scores on two sets of evaluation ...

Cardiac Rehabilitation Online Pilot: Extending Reach of Cardiac Rehabilitation.

PubMed

Higgins, Rosemary O; Rogerson, Michelle; Murphy, Barbara M; Navaratnam, Hema; Butler, Michael V; Barker, Lauren; Turner, Alyna; Lefkovits, Jeffrey; Jackson, Alun C

While cardiac rehabilitation (CR) is recommended for all patients after an acute cardiac event, limitations exist in reach. The purpose of the current study was to develop and pilot a flexible online CR program based on self-management principles "Help Yourself Online." The program was designed as an alternative to group-based CR as well as to complement traditional CR. The program was based on existing self-management resources developed previously by the Heart Research Centre. Twenty-one patients admitted to Cabrini Health for an acute cardiac event were recruited to test the program. The program was evaluated using qualitative and quantitative methods. Quantitative results demonstrated that patients believed the program would assist them in their self-management. Qualitative evaluation, using focus group and interview methods with 15 patients, showed that patients perceived the online CR approach to be a useful instrument for self-management. Broader implications of the data include the acceptability of the intervention, timing of intervention delivery, and patients' desire for additional online community support.

The Careers in Health and Medical Professions Program (CHAMPS): An Impact Study of a University-Based STEM+H Outreach Program

NASA Astrophysics Data System (ADS)

Wallace, Eric W.; Perry, Justin C.; Ferguson, Robert L.; Jackson, Debbie K.

2015-08-01

The present study investigated the impact of a Science, Technology, Engineering, Mathematics and Health (STEM+H) university-based pipeline program, the Careers in Health and Medical Professions Program, over the course of two summers among predominantly African-American high school students recruited from urban school districts ( N = 155). Based on a mixed methods approach, results indicated that youth made significant gains in both academic and career knowledge. Furthermore, youth generally rated the program's sessions favorably, but also rated sessions with varying levels of satisfaction. The limitations and implications for program delivery and evaluation methods among pipeline programs are discussed.

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Introduction Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Methods Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Results Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. Conclusions The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Resident dashboards: helping your clinical competency committee visualize trainees' key performance indicators.

PubMed

Friedman, Karen A; Raimo, John; Spielmann, Kelly; Chaudhry, Saima

2016-01-01

Under the Next Accreditation System, programs need to find ways to collect and assess meaningful reportable information on its residents to assist the program director regarding resident milestone progression. This paper discusses the process that one large Internal Medicine Residency Program used to provide both quantitative and qualitative data to its clinical competency committee (CCC) through the creation of a resident dashboard. Program leadership at a large university-based program developed four new end of rotation evaluations based on the American Board of Internal Medicine (ABIM) and Accreditation Council of Graduated Medical Education's (ACGME) 22 reportable milestones. A resident dashboard was then created to pull together both milestone- and non-milestone-based quantitative data and qualitative data compiled from faculty, nurses, peers, staff, and patients. Dashboards were distributed to the members of the CCC in preparation for the semiannual CCC meeting. CCC members adjudicated quantitative and qualitative data to present their cohort of residents at the CCC meeting. Based on the committee's response, evaluation scores remained the same or were adjusted. Final milestone scores were then entered into the accreditation data system (ADS) on the ACGME website. The process of resident assessment is complex and should comprise both quantitative and qualitative data. The dashboard is a valuable tool for program leadership to use both when evaluating house staff on a semiannual basis at the CCC and to the resident in person.

Evaluation of a computer-based approach to teaching acid/base physiology.

PubMed

Rawson, Richard E; Quinlan, Kathleen M

2002-12-01

Because acid/base physiology is a difficult subject for most medical and veterinary students, the first author designed a software program, Acid/Base Primer, that would help students with this topic. The Acid/Base Primer was designed and evaluated within a conceptual framework of basic educational principles. Seventy-five first-year veterinary students (of 81; 93% response rate) participated in this study. Students took both a pre- and posttest of content understanding. After completing the Acid/Base Primer in pairs, each student filled out a survey evaluating the features of the program and describing his/her use and experience of it. Four pairs of students participated in interviews that elaborated on the surveys. Scores improved from 53 +/- 2% on the pretest to 74 +/- 1% on an immediate posttest. On surveys and in interviews, students reported that the program helped them construct their own understanding of acid/base physiology and prompted discussions in pairs of students when individual understandings differed. The case-based format provided anchors and a high degree of relevance. Repetition of concepts helped students develop a more complex network of understanding. Questions in the program served to scaffold the learning process by providing direction, accentuating the relevant features of the cases, and provoking discussion. Guidelines for software development were generated on the basis of the findings and relevant educational literature.

Improving health equity through theory-informed evaluations: a look at housing first strategies, cross-sectoral health programs, and prostitution policy.

PubMed

Dunn, James R; van der Meulen, Emily; O'Campo, Patricia; Muntaner, Carles

2013-02-01

The emergent realist perspective on evaluation is instructive in the quest to use theory-informed evaluations to reduce health inequities. This perspective suggests that in addition to knowing whether a program works, it is imperative to know 'what works for whom in what circumstances and in what respects, and how?' (Pawson & Tilley, 1997). This addresses the important issue of heterogeneity of effect, in other words, that programs have different effects for different people, potentially even exacerbating inequities and worsening the situation of marginalized groups. But in addition, the realist perspective implies that a program may not only have a greater or lesser effect, but even for the same effect, it may work by way of a different mechanism, about which we must theorize, for different groups. For this reason, theory, and theory-based evaluations are critical to health equity. We present here three examples of evaluations with a focus on program theories and their links to inequalities. All three examples illustrate the importance of theory-based evaluations in reducing health inequities. We offer these examples from a wide variety of settings to illustrate that the problem of which we write is not an exception to usual practice. The 'Housing First' model of supportive housing for people with severe mental illness is based on a theory of the role of housing in living with mental illness that has a number of elements that directly contradict the theory underlying the dominant model. Multisectoral action theories form the basis for the second example on Venezuela's revolutionary national Barrio Adentro health improvement program. Finally, decriminalization of prostitution and related health and safety policies in New Zealand illustrate how evaluations can play an important role in both refining the theory and contributing to improved policy interventions to address inequalities. The theoretically driven and transformative nature of these interventions create special demands for the use of theory in evaluations. Copyright © 2012 Elsevier Ltd. All rights reserved.

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

PubMed

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

Web-Based Intervention Programs for Depression: A Scoping Review and Evaluation

PubMed Central

Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A

2014-01-01

Background Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. Objective The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Methods Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. Results The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. Conclusions There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool. PMID:25249003

Web-based intervention programs for depression: a scoping review and evaluation.

PubMed

Renton, Tian; Tang, Herman; Ennis, Naomi; Cusimano, Michael D; Bhalerao, Shree; Schweizer, Tom A; Topolovec-Vranic, Jane

2014-09-23

Although depression is known to affect millions of people worldwide, individuals seeking aid from qualified health care professionals are faced with a number of barriers to treatment including a lack of treatment resources, limited number of qualified service providers, stigma associated with diagnosis and treatment, prolonged wait times, cost, and barriers to accessibility such as transportation and clinic locations. The delivery of depression interventions through the Internet may provide a practical solution to addressing some of these barriers. The purpose of this scoping review was to answer the following questions: (1) What Web-delivered programs are currently available that offer an interactive treatment component for depression?, (2) What are the contents, accessibility, and usability of each identified program?, and (3) What tools, supports, and research evidence are available for each identified program? Using the popular search engines Google, Yahoo, and Bing (Canadian platforms), two reviewers independently searched for interactive Web-based interventions targeting the treatment of depression. The Beacon website, an information portal for online health applications, was also consulted. For each identified program, accessibility, usability, tools, support, and research evidence were evaluated and programs were categorized as evidence-based versus non-evidence-based if they had been the subject of at least one randomized controlled trial. Programs were scored using a 28-point rating system, and evidence- versus non-evidence-based programs were compared and contrasted. Although this review included all programs meeting exclusion and inclusion criteria found using the described search method, only English language Web-delivered depression programs were awarded an evaluation score. The review identified 32 programs meeting inclusion criteria. There was a great deal of variability among the programs captured in this evaluation. Many of the programs were developed for general adolescent or adult audiences, with few (n=2) focusing on special populations (eg, military personnel, older adults). Cognitive behavioral therapy was the most common therapeutic approach used in the programs described. Program interactive components included mood assessments and supplementary homework sheets such as activity planning and goal setting. Only 12 of the programs had published evidence in support of their efficacy and treatment of depressive symptoms. There are a number of interactive depression interventions available through the Internet. Recommendations for future programs, or the adaptation of existing programs include offering a greater selection of alternative languages, removing registration restrictions, free trial periods for programs requiring user fees, and amending programs to meet the needs of special populations (eg, those with cognitive and/or visual impairments). Furthermore, discussion of specific and relevant topics to the target audience while also enhancing overall user control would contribute to a more accessible intervention tool.

An OpenACC-Based Unified Programming Model for Multi-accelerator Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kim, Jungwon; Lee, Seyong; Vetter, Jeffrey S

2015-01-01

This paper proposes a novel SPMD programming model of OpenACC. Our model integrates the different granularities of parallelism from vector-level parallelism to node-level parallelism into a single, unified model based on OpenACC. It allows programmers to write programs for multiple accelerators using a uniform programming model whether they are in shared or distributed memory systems. We implement a prototype of our model and evaluate its performance with a GPU-based supercomputer using three benchmark applications.

Evaluation of a community-based, family focused healthy weights initiative using the RE-AIM framework.

PubMed

Jung, Mary E; Bourne, Jessica E; Gainforth, Heather L

2018-01-26

Childhood overweight and obesity is a major public health concern. Community-based interventions have the potential to reach caregivers and children. However, the overall health impact of these programs is rarely comprehensively assessed. This study evaluated a physical activity and healthy eating family program (Healthy Together; HT) using the RE-AIM framework. Ten sites implemented the 5-week program. Thirty-nine staff members and 277 program participants (126 caregivers [M age  = 35.6] and 151 children [M age  = 13]) participated in the evaluation. Each RE-AIM dimension was assessed independently using a mixed-methods approach. Sources of data included archival records, interviews and surveys. Effectiveness outcome variables were assessed at pre- and post-intervention and 6-month follow-up. Reach: HT participants were almost entirely recruited from existing programs within sites. Effectiveness: Caregivers' nutrition related efficacy beliefs increased following HT (ps < .03). Participation in HT was not associated with significant changes in physical activity or nutrition behaviour or perceived social support (ps > .05). Knowledge surrounding healthy diets and physical activity increased in children and caregivers (ps < .05). Adoption: Thirty-five percent of sites approached to implement HT expressed interest. The 10 sites selected recruited existing staff members to implement HT. Program objectives were met 72.8% of the time and 71 adaptations were made. HT was finance- and time-dependent. Maintenance: Two sites fully implemented HT in the follow-up year and 5 sites incorporated aspects of HT into other programs. Working alongside organizations that develop community programs to conduct comprehensive, arms-length evaluations can systematically highlight areas of success and challenges. Overall HT represents a feasible community-based intervention; however further support is required in order to ensure the program is effective at positively targeting the desired outcomes. As a result of this evaluation, modifications are currently being implemented to HT.

Performance Evaluation of Remote Memory Access (RMA) Programming on Shared Memory Parallel Computers

NASA Technical Reports Server (NTRS)

Jin, Hao-Qiang; Jost, Gabriele; Biegel, Bryan A. (Technical Monitor)

2002-01-01

The purpose of this study is to evaluate the feasibility of remote memory access (RMA) programming on shared memory parallel computers. We discuss different RMA based implementations of selected CFD application benchmark kernels and compare them to corresponding message passing based codes. For the message-passing implementation we use MPI point-to-point and global communication routines. For the RMA based approach we consider two different libraries supporting this programming model. One is a shared memory parallelization library (SMPlib) developed at NASA Ames, the other is the MPI-2 extensions to the MPI Standard. We give timing comparisons for the different implementation strategies and discuss the performance.

Evaluation of Three Adolescent Sexual Health Programs in Ha Noi and Khanh Hoa Province, Vietnam

PubMed Central

Pham, Van; Nguyen, Hoang; Tho, Le Huu; Minh, Truong Tan; Lerdboon, Porntip; Riel, Rosemary; Green, Mackenzie S.; Kaljee, Linda M.

2012-01-01

With an increase in sexual activity among young adults in Vietnam and associated risks, there is a need for evidence-based sexual health interventions. This evaluation of three sexual health programs based on the Protection Motivation Theory (PMT) was conducted in 12 communes in Ha Noi, Nha Trang City, and Ninh Hoa District. Inclusion criteria included unmarried youth 15–20 years residing in selected communes. Communes were randomly allocated to an intervention, and participants were randomly selected within each commune. The intervention programs included Vietnamese Focus on Kids (VFOK), the gender-based program Exploring the World of Adolescents (EWA), and EWA plus parental and health provider education (EWA+). Programs were delivered over a ten-week period in the communities by locally trained facilitators. The gender-based EWA program with parental involvement (EWA+) compared to VFOK showed significantly greater increase in knowledge. EWA+ in comparison to VFOK also showed significant decrease at immediate postintervention for intention to have sex. Sustained changes are observed in all three interventions for self-efficacy condom use, self-efficacy abstinence, response efficacy for condoms, extrinsic rewards, and perceived vulnerability for HIV. These findings suggest that theory-based community programs contribute to sustained changes in knowledge and attitudes regarding sexual risk among Vietnamese adolescents. PMID:22666565

Evaluation of three adolescent sexual health programs in ha noi and khanh hoa province, Vietnam.

PubMed

Pham, Van; Nguyen, Hoang; Tho, Le Huu; Minh, Truong Tan; Lerdboon, Porntip; Riel, Rosemary; Green, Mackenzie S; Kaljee, Linda M

2012-01-01

With an increase in sexual activity among young adults in Vietnam and associated risks, there is a need for evidence-based sexual health interventions. This evaluation of three sexual health programs based on the Protection Motivation Theory (PMT) was conducted in 12 communes in Ha Noi, Nha Trang City, and Ninh Hoa District. Inclusion criteria included unmarried youth 15-20 years residing in selected communes. Communes were randomly allocated to an intervention, and participants were randomly selected within each commune. The intervention programs included Vietnamese Focus on Kids (VFOK), the gender-based program Exploring the World of Adolescents (EWA), and EWA plus parental and health provider education (EWA+). Programs were delivered over a ten-week period in the communities by locally trained facilitators. The gender-based EWA program with parental involvement (EWA+) compared to VFOK showed significantly greater increase in knowledge. EWA+ in comparison to VFOK also showed significant decrease at immediate postintervention for intention to have sex. Sustained changes are observed in all three interventions for self-efficacy condom use, self-efficacy abstinence, response efficacy for condoms, extrinsic rewards, and perceived vulnerability for HIV. These findings suggest that theory-based community programs contribute to sustained changes in knowledge and attitudes regarding sexual risk among Vietnamese adolescents.

Evaluation of training programs and entry-level qualifications for nuclear-power-plant control-room personnel based on the systems approach to training

DOE Office of Scientific and Technical Information (OSTI.GOV)

Haas, P M; Selby, D L; Hanley, M J

1983-09-01

This report summarizes results of research sponsored by the US Nuclear Regulatory Commission (NRC) Office of Nuclear Regulatory Research to initiate the use of the Systems Approach to Training in the evaluation of training programs and entry level qualifications for nuclear power plant (NPP) personnel. Variables (performance shaping factors) of potential importance to personnel selection and training are identified, and research to more rigorously define an operationally useful taxonomy of those variables is recommended. A high-level model of the Systems Approach to Training for use in the nuclear industry, which could serve as a model for NRC evaluation of industrymore » programs, is presented. The model is consistent with current publically stated NRC policy, with the approach being followed by the Institute for Nuclear Power Operations, and with current training technology. Checklists to be used by NRC evaluators to assess training programs for NPP control-room personnel are proposed which are based on this model.« less

24 CFR 35.165 - Prior evaluation or hazard reduction.

Code of Federal Regulations, 2013 CFR

2013-04-01

... Housing and Urban Development LEAD-BASED PAINT POISONING PREVENTION IN CERTAIN RESIDENTIAL STRUCTURES General Lead-Based Paint Requirements and Definitions for All Programs. § 35.165 Prior evaluation or... conditions: (a) Lead-based paint inspection. (1) A lead-based paint inspection conducted before March 1, 2000...

24 CFR 35.165 - Prior evaluation or hazard reduction.

Code of Federal Regulations, 2012 CFR

2012-04-01

... Housing and Urban Development LEAD-BASED PAINT POISONING PREVENTION IN CERTAIN RESIDENTIAL STRUCTURES General Lead-Based Paint Requirements and Definitions for All Programs. § 35.165 Prior evaluation or... conditions: (a) Lead-based paint inspection. (1) A lead-based paint inspection conducted before March 1, 2000...

24 CFR 35.165 - Prior evaluation or hazard reduction.

Code of Federal Regulations, 2011 CFR

2011-04-01

... Housing and Urban Development LEAD-BASED PAINT POISONING PREVENTION IN CERTAIN RESIDENTIAL STRUCTURES General Lead-Based Paint Requirements and Definitions for All Programs. § 35.165 Prior evaluation or... conditions: (a) Lead-based paint inspection. (1) A lead-based paint inspection conducted before March 1, 2000...

24 CFR 35.165 - Prior evaluation or hazard reduction.

Code of Federal Regulations, 2014 CFR

2014-04-01

... Housing and Urban Development LEAD-BASED PAINT POISONING PREVENTION IN CERTAIN RESIDENTIAL STRUCTURES General Lead-Based Paint Requirements and Definitions for All Programs. § 35.165 Prior evaluation or... conditions: (a) Lead-based paint inspection. (1) A lead-based paint inspection conducted before March 1, 2000...

Healthy Steps: a systematic review of a preventive practice-based model of pediatric care.

PubMed

Piotrowski, Caroline C; Talavera, Gregory A; Mayer, Joni A

2009-02-01

The preventive role of anticipatory guidance in pediatric practice has gained increasing importance over the last two decades, resulting in the development of competing models of practice-based care. Our goal was to systematically evaluate and summarize the literature pertaining to the Healthy Steps Program for Young Children, a widely cited and utilized preventive model of care and anticipatory guidance, Medline and the bibliographies of review articles for relevant studies were searched using the keywords: Healthy Steps, preventive care, pediatric practice and others. Other sources included references of retrieved publications, review articles, and books; government documents; and Internet sources. Relevant sources were selected on the basis of their empirical evaluation of some component of care (e.g., child outcomes, parent outcomes, quality of care). From 21 identified articles, 13 met the inclusion criteria of empirical evaluation. These evaluations were summarized and compared. Results indicated that the Healthy Steps program has been rigorously evaluated and shown to be effective in preventing negative child and parent outcomes and enhancing positive outcomes. Despite limited information concerning cost effectiveness, the Healthy Steps Program provides clear benefit through early screening, family-centered care, and evidence-based anticipatory guidance. It is recommended that the Healthy Steps program be more widely disseminated to relevant stakeholders, and further enhanced by improved linguistic and cultural sensitivity and long term evaluation of cost effectiveness.

The FRIENDS emotional health program for minority groups at risk.

PubMed

Iizuka, Cristina A; Barrett, Paula M; Gillies, Robyn; Cook, Clayton R; Miller, Debbie

2014-02-01

Despite the existence of evidence-based interventions for promoting mental health in children, the number of children at risk remains high. One of the reasons is that such interventions are not reaching specific groups at risk such as low socioeconomic status and ethnic minority groups. This study evaluated an adaptation of a school-based psychosocial program for nonreferred students aged 11 to 12 years attending a multicultural school from a low socioeconomic status area. The FRIENDS Program was adapted for a multicultural population. A quasi-experimental design was used, involving a pre/post-test, to evaluate the impact of the intervention on participants' outcomes on the Strengths and Difficulties Questionnaire (SDQ). Participants were divided into 2 categories ("at risk"/"not at risk") based on their scores in the SDQ at pre-test. Post-test data were collected to evaluate the overall effectiveness and acceptability of the program. Analyses showed significant improvement for the group initially identified as "at risk," with 30% of the students being no longer at risk after the intervention. Most students rated the intervention as being highly acceptable and useful. Adaptations to existing evidence-based programs for implementation with specific minority groups at risk represents a promising approach to promote emotional health in children. © 2014, American School Health Association.

The Economic, Energy, and Environmental Impacts of the Energy-Related Inventions Program

DOE R&D Accomplishments Database

Brown, M.A.; Wilson, C.R.; Franchuk, C.A.; Cohn, S.M.; Jones, D.

1994-07-01

This report provides information on the economic, energy, and environmental impacts of inventions supported by the Energy-Related Inventions Program (ERIP) -- a program jointly operated by the US Department of Energy and the National Institute of Standards and Technology (NIST). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. The period of interest is 1980 through 1992. The evaluation is based on data collected in 1993 through mail and telephone surveys of 253 program participants, and historical data collected during previous evaluations for an additional 189 participants.

Evaluative Thinking in Practice: The National Asthma Control Program

PubMed Central

Fierro, Leslie A.; Codd, Heather; Gill, Sarah; Pham, Phung K.; Grandjean Targos, Piper T.; Wilce, Maureen

2018-01-01

Although evaluative thinking lies at the heart of what we do as evaluators and what we hope to promote in others through our efforts to build evaluation capacity, researchers have given limited attention to measuring this concept. We undertook a research study to better understand how instances of evaluative thinking may present in practice-based settings—specifically within four state asthma control programs funded by the Centers for Disease Control and Prevention’s National Asthma Control Program. Through content analyses of documents as well as interviews and a subsequent focus group with four state asthma control programs’ evaluators and program managers we identified and defined twenty-two indicators of evaluative thinking. Findings provide insights about what practitioners may wish to look for when they intend to build evaluative thinking and the types of data sources that may be more or less helpful in such efforts. PMID:29950803

Offense History and the Effectiveness of Juvenile Diversion Programs.

ERIC Educational Resources Information Center

Osgood, D. Wayne; And Others

Some evaluations have concluded that diversion programs for juvenile offenders (programs intended as community-based alternatives to formal justice dispositions) reduce recidivism only among youths with the least serious offense histories. To investigate the relationship of offense history to program effectiveness, three diversion programs were…

Partnership, knowledge translation, and substance abuse prevention with a First Nations community.

PubMed

Baydala, Lola; Fletcher, Fay; Worrell, Stephanie; Kajner, Tania; Letendre, Sherry; Letendre, Liz; Rasmussen, Carmen

2014-01-01

Having identified substance abuse as an issue of concern in their community, the Alexis Nakota Sioux Nation invited University of Alberta researchers to partner on the cultural adaptation, delivery, and evaluation of a school-based drug and alcohol abuse prevention program. Researchers conducted a literature review of available drug and alcohol prevention programs for children and youth, identifying the Life Skills Training (LST) program as a viable model for cultural adaptation. Four program objectives were developed: (1) Review and cultural adaptation of the elementary and junior high LST programs, (2) delivery of the adapted programs, (3) measurement of changes in students' knowledge of the negative effects of drug and alcohol use, attitudes toward drugs and alcohol, drug and alcohol refusal and life skills, and changes in self-esteem/self-concept, and (4) documentation of the community's experience of the project. Using the principles of community-based participatory research (CBPR), we employed both qualitative and quantitative methods to evaluate the impact of the project. Qualitative evaluation of the program adaptation and implementation were both positive. Qualitative measures of program impact on students revealed a positive effect, whereas results of the quantitative measures were mixed. Culturally adapted, evidence-based programs can have a positive effect on Aboriginal youth and their communities. Strategies to expand knowledge translation (KT) when working with Aboriginal communities include working to create an "ethical space" that draws on the strengths of both Western and Indigenous worldviews.

Pediatric Resident-as-Teacher Curricula: A National Survey of Existing Programs and Future Needs.

PubMed

Fromme, H Barrett; Whicker, Shari A; Paik, Steve; Konopasek, Lyuba; Koestler, Jennifer L; Wood, Beverly; Greenberg, Larrie

2011-06-01

We conducted a national survey of US pediatric program directors to explore the current status, content, and teaching methods of Resident-as-Teacher (RAT) curricula. The purposes of the survey were to (1) determine the level and method of evaluation of such curricula, and (2) assess the need for a national curricular resource in this area. A survey was sent to US pediatric program directors that asked questions regarding demographics, support, design, development, content, and evaluation of RAT curricula, as well as existing needs and desires for RAT curricular resources. Sixty-two percent of pediatric program directors completed our survey. Eighty-seven percent have a formal RAT curriculum, but more than 50% allocate 10 hours or less to it during residency. The primary teaching modalities are lectures and workshops. Content areas include feedback, in-patient teaching, communication skills, case-based teaching, role modeling, evaluation, leadership skills, 1-minute preceptors, teaching/learning styles, professionalism, and small-group teaching. Sixty-three percent of programs report evaluating their curricula, but only 27% perceive their program to be very/extremely effective. Nearly all respondents expressed interest in a national RAT curriculum, preferring web-based modules for dissemination. Despite an Accreditation Council for Graduate Medical Education requirement for a RAT curriculum, some pediatrics programs still lack one, and some consider their program only moderately effective. A wealth of curricular material exists across programs, which could be shared nationally. Establishing a national RAT curriculum would offer programs resources to meet educational mandates and the ability to tailor programs to best fit their own program needs.

Evaluating the implementation and impacts of middle grades inquiry-based engineering design modules

NASA Astrophysics Data System (ADS)

Harlan, Jessica M.

This dissertation uses a format where I present and discuss three articles that were written in conjunction with my work on a research and evaluation team. The articles are based on a multi-year project researching and evaluating the design, development, and implementation of a middle grades integrated Science, Technology, Engineering, and Mathematics (STEM) program. Each of the articles demonstrates the complexity in researching and evaluating curricular development in multifaceted, rapidly changing environments. While the focus of each article differs, they all examine research and evaluation in the context of the design and development of middle grades engineering-design modules. The selected articles address challenges associated with assessing program objectives and evaluating program quality in complex education programs.The first article, presented in Chapter 2, provides an overview of the nature of the EYE program and examines the extent to which participation in the EYE program resulted in the achievement of program objectives. There is evidence that EYE Module participation has a positive impact on participating students as well as teachers. This study also revealed challenges associated with determining the impact of program participation simultaneously with program revisions and assessment development. The second article, presented in Chapter 3, examined the evaluation of fidelity of implementation of inquiry-oriented educational programs. This article was intended to examine one way of triangulating information to determine fidelity while considering variation in implementation consistent with program theories of learning. When applying this model to implementation of the EYE program, we found many teachers were implementing the modules with low to moderate fidelity, especially math teachers. The third article, presented in Chapter 4, examined the factor structure of an occupational values scale intended to measure student interest in STEM careers. When reviewing the assessment's evidence base, we found no published literature regarding the assessment's psychometric properties. We found that the AWE Work Values scale assesses two separate sets of occupational values: 1) using analytical and problem solving skills and 2) personal satisfaction. In Chapter 5, I discuss the implications of the research presented in these articles to the field of integrated STEM. This includes a need to further develop and test tools and methods for measuring program impact. While the articles address several issues related to research and evaluation within the context of K-12 integrated STEM education, the concepts and implications also apply to the general field of instructional design. The primary lesson is the need to systematically evaluate designed instruction, including measuring fidelity of implementation and designing evaluations in advance to ensure appropriate data are gathered. Recommendations for future research include identification of common outcomes for integrated STEM, psychometric testing of integrated STEM attitude measures, impacts of other factors such as interest in STEM, and development and testing of instructional design models for integrated STEM.

The COMPASS study: a longitudinal hierarchical research platform for evaluating natural experiments related to changes in school-level programs, policies and built environment resources.

PubMed

Leatherdale, Scott T; Brown, K Stephen; Carson, Valerie; Childs, Ruth A; Dubin, Joel A; Elliott, Susan J; Faulkner, Guy; Hammond, David; Manske, Steve; Sabiston, Catherine M; Laxer, Rachel E; Bredin, Chad; Thompson-Haile, Audra

2014-04-08

Few researchers have the data required to adequately understand how the school environment impacts youth health behaviour development over time. COMPASS is a prospective cohort study designed to annually collect hierarchical longitudinal data from a sample of 90 secondary schools and the 50,000+ grade 9 to 12 students attending those schools. COMPASS uses a rigorous quasi-experimental design to evaluate how changes in school programs, policies, and/or built environment (BE) characteristics are related to changes in multiple youth health behaviours and outcomes over time. These data will allow for the quasi-experimental evaluation of natural experiments that will occur within schools over the course of COMPASS, providing a means for generating "practice based evidence" in school-based prevention programming. COMPASS is the first study with the infrastructure to robustly evaluate the impact that changes in multiple school-level programs, policies, and BE characteristics within or surrounding a school might have on multiple youth health behaviours or outcomes over time. COMPASS will provide valuable new insight for planning, tailoring and targeting of school-based prevention initiatives where they are most likely to have impact.

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

PubMed

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were summarized using descriptive statistics. An inductive approach was used to identify themes in the qualitative data related to the evaluation questions. The findings demonstrated the program was implemented as intended, and that there was a need for the program, with six clients on the 10-month pilot. The findings also indicated achievement of program-level outcomes and progress toward system-level outcomes. Clients/families and healthcare providers were satisfied with the program and perceived it to be meeting its objectives. The program model was also perceived to be transferrable to other First Nations communities. The results demonstrate how a rural First Nations community can build capacity and develop a palliative care program tailored to their unique culture and context that builds upon and is integrated into existing services. The Wiisokotaatiwin Program allowed community members to receive their palliative care at home, improved client experience and enhanced service integration. This article provides a First Nations specific model for a palliative care program that overcomes jurisdictional issues at the local level, and a methodology for developing and evaluating community-based palliative care programs in rural First Nations communities. The article demonstrates how local, federal and provincial healthcare providers and organizations collaborated to build capacity, fund and deliver community-based palliative care. The described process of developing the program has applicability in other First Nations (Indigenous) communities and for healthcare decisionmakers.

The Use of Information Based Evaluation in Evaluating the Diagnostic Teaching Center.

ERIC Educational Resources Information Center

Poteet, James A.

Information Based Evaluation (IBE) is identified as a design procedure for assessing a variety of projects, programs, and educational changes. IBE was used to evaluate a Comprehensive Diagnostic Teaching Center (DTC) which, in addition to providing teacher training and services to handicapped pupils, would bring together and focus all of the…

Evaluation of Turkish and Mathematics Curricula According to Value-Based Evaluation Model

ERIC Educational Resources Information Center

Duman, Serap Nur; Akbas, Oktay

2017-01-01

This study evaluated secondary school seventh-grade Turkish and mathematics programs using the Context-Input-Process-Product Evaluation Model based on student, teacher, and inspector views. The convergent parallel mixed method design was used in the study. Student values were identified using the scales for socio-level identification, traditional…

Methodological and Design Considerations in Evaluating the Impact of Prevention Programs on Violence and Related Health Outcomes.

PubMed

Massetti, Greta M; Simon, Thomas R; Smith, Deborah Gorman

2016-10-01

Drawing on research that has identified specific predictors and trajectories of risk for violence and related negative outcomes, a multitude of small- and large-scale preventive interventions for specific risk behaviors have been developed, implemented, and evaluated. One of the principal challenges of these approaches is that a number of separate problem-specific programs targeting different risk areas have emerged. However, as many negative health behaviors such as substance abuse and violence share a multitude of risk factors, many programs target identical risk factors. There are opportunities to understand whether evidence-based programs can be leveraged for potential effects across a spectrum of outcomes and over time. Some recent work has documented longitudinal effects of evidence-based interventions on generalized outcomes. This work has potential for advancing our understanding of the effectiveness of promising and evidence-based prevention strategies. However, conducting longitudinal follow-up of established interventions presents a number of methodological and design challenges. To answer some of these questions, the Centers for Disease Control and Prevention convened a panel of multidisciplinary experts to discuss opportunities to take advantage of evaluations of early prevention programs and evaluating multiple long-term outcomes. This special section of the journal Prevention Science includes a series of papers that begin to address the relevant considerations for conducting longitudinal follow-up evaluation research. This collection of papers is intended to inform our understanding of the challenges and strategies for conducting longitudinal follow-up evaluation research that could be used to drive future research endeavors.

Moving Toward Evidence-Based Federal Healthy Start Program Evaluations: Accounting for Bias in Birth Outcomes Studies

PubMed Central

Raffo, Jennifer E.; VanderMeulen, Peggy; Roman, Lee Anne

2014-01-01

We used administrative and screening data from 2009 to 2010 to determine if Healthy Start (HS), an enhanced prenatal services program, is reaching the most vulnerable African American women in Kent County, Michigan. Women in HS are at higher risk of key predictors of birth outcomes compared with other women. To advance toward evidence-based HS program evaluations in the absence of randomized controlled trials, future studies using comparison groups need to appropriately establish baseline equivalence on a variety of risk factors related to birth outcomes. PMID:24354826

Modifications of ORNL's computer programs MSF-21 and VTE-21 for the evaluation and rapid optimization of multistage flash and vertical tube evaporators

DOE Office of Scientific and Technical Information (OSTI.GOV)

Glueckstern, P.; Wilson, J.V.; Reed, S.A.

1976-06-01

Design and cost modifications were made to ORNL's Computer Programs MSF-21 and VTE-21 originally developed for the rapid calculation and design optimization of multistage flash (MSF) and multieffect vertical tube evaporator (VTE) desalination plants. The modifications include additional design options to make possible the evaluation of desalting plants based on current technology (the original programs were based on conceptual designs applying advanced and not yet proven technological developments and design features) and new materials and equipment costs updated to mid-1975.

A web-based program for informal caregivers of persons with Alzheimer's disease: an iterative user-centered design.

PubMed

Cristancho-Lacroix, Victoria; Moulin, Florence; Wrobel, Jérémy; Batrancourt, Bénédicte; Plichart, Matthieu; De Rotrou, Jocelyne; Cantegreil-Kallen, Inge; Rigaud, Anne-Sophie

2014-09-15

Web-based programs have been developed for informal caregivers of people with Alzheimer's disease (PWAD). However, these programs can prove difficult to adopt, especially for older people, who are less familiar with the Internet than other populations. Despite the fundamental role of usability testing in promoting caregivers' correct use and adoption of these programs, to our knowledge, this is the first study describing this process before evaluating a program for caregivers of PWAD in a randomized clinical trial. The objective of the study was to describe the development process of a fully automated Web-based program for caregivers of PWAD, aiming to reduce caregivers' stress, and based on the user-centered design approach. There were 49 participants (12 health care professionals, 6 caregivers, and 31 healthy older adults) that were involved in a double iterative design allowing for the adaptation of program content and for the enhancement of website usability. This process included three component parts: (1) project team workshops, (2) a proof of concept, and (3) two usability tests. The usability tests were based on a mixed methodology using behavioral analysis, semistructured interviews, and a usability questionnaire. The user-centered design approach provided valuable guidelines to adapt the content and design of the program, and to improve website usability. The professionals, caregivers (mainly spouses), and older adults considered that our project met the needs of isolated caregivers. Participants underlined that contact between caregivers would be desirable. During usability observations, the mistakes of users were also due to ergonomics issues from Internet browsers and computer interfaces. Moreover, negative self-stereotyping was evidenced, when comparing interviews and results of behavioral analysis. Face-to-face psycho-educational programs may be used as a basis for Web-based programs. Nevertheless, a user-centered design approach involving targeted users (or their representatives) remains crucial for their correct use and adoption. For future user-centered design studies, we recommend to involve end-users from preconception stages, using a mixed research method in usability evaluations, and implementing pilot studies to evaluate acceptability and feasibility of programs.

A Randomized Trial of a Multimodal Community-Based Prisoner Reentry Program Emphasizing Substance Abuse Treatment

ERIC Educational Resources Information Center

Grommon, Eric; Davidson, William S., II; Bynum, Timothy S.

2013-01-01

Prisoner reentry programs continue to be developed and implemented to ease the process of transition into the community and to curtail fiscal pressures. This study describes and provides relapse and recidivism outcome findings related to a randomized trial evaluating a multimodal, community-based reentry program that prioritized substance abuse…

The Positive Impact of Attending a Community-Based Youth Program on Child Depressive Symptoms

ERIC Educational Resources Information Center

Fite, Paula J.; Vitulano, Michael L.; Preddy, Teresa M.

2011-01-01

The current study evaluated associations between attending a community-based youth program, neighborhood problems, and child depressive symptoms in a sample of 147 children (mean [M] age=8.22 years, 54.4% male). Findings suggested that both program attendance and neighborhood problems were uniquely associated with child depressive symptoms while…

Coming Home: A Group-Based Approach for Assisting Military Veterans in Transition

ERIC Educational Resources Information Center

Westwood, Marvin J.; McLean, Holly; Cave, Douglas; Borgen, William; Slakov, Paul

2010-01-01

This study is an evaluation of the Veterans Transition Program, a residential, group-based program designed to assist the transition of military personnel back into Canadian society by aiding with their personal and career readjustment. Participants in the program included 18 male soldiers who experienced varying degrees of combat-related trauma.…

Building Enrollment Through Curriculum Change: The Implementation of a Comprehension-Based Program in Spanish.

ERIC Educational Resources Information Center

Long, Donna R.

1985-01-01

Describes the implementation of a first-year comprehension-based Spanish language program at New Mexico State University. Includes a discussion of the history of the program and of the problems encountered in changing a traditional curriculum. Also describes the materials, classroom practice, and testing and evaluation techniques used in the…

Development of a Criterion-Referenced, Performance-Based Assessment of Reading Comprehension in a Whole Literacy Program.

ERIC Educational Resources Information Center

Tibbetts, Katherine A.; And Others

This paper describes the development of a criterion-referenced, performance-based measure of third grade reading comprehension. The primary purpose of the assessment is to contribute unique and valid information for use in the formative evaluation of a whole literacy program. A secondary purpose is to supplement other program efforts to…

Effects of Participation in a Martial Arts-Based Antibullying Program in Elementary Schools

ERIC Educational Resources Information Center

Twemlow, Stuart W.; Biggs, Bridget K.; Nelson, Timothy D.; Vernberg, Eric M.; Fonagy, Peter; Twemlow, Stephen W.

2008-01-01

This study evaluated the Gentle Warrior Program, a traditional martial arts-based intervention to reduce aggression in children, as it was implemented in three elementary schools. The sample consisted of 254 children in grades 3, 4, and 5 who participated in the Gentle Warrior Program as part of a larger school violence intervention. Results…

Effect of the Creative Drama-Based Assertiveness Program on the Assertiveness Skill of Psychological Counsellor Candidates

ERIC Educational Resources Information Center

Gundogdu, Rezzan

2012-01-01

The purpose of this quasi-experimental research is to study the effects of the creative drama-based assertiveness program (CDBAP) on the assertiveness skill of Psychological Counselling and Guidance (PCG) department students. The opinions of experimental group students on the program were obtained through the CDBAP evaluation form. The sample of…

Building an evidence base for community health: a review of the quality of program evaluations.

PubMed

Jolley, Gwyn M; Lawless, Angela P; Baum, Fran E; Hurley, Catherine J; Fry, Denise

2007-11-01

An assessment of the quality of program evaluations conducted in South Australian community health services investigated how effective evaluation reporting is in producing an evidence base for community health. Evaluation reports were assessed by a team of reviewers. Practitioner workshops allowed an understanding of the uses of evaluation and what promotes or acts as a barrier to undertaking evaluations. Community health services do undertake a good deal of evaluation. However, reports were not generally explicit in dealing with the principles that underpin community health. Few engaged with program theory or rationale. Typically, reports were of short-term projects with uncertain futures so there may seem little point in considering issues of long-term health outcomes and transferability to other settings. The most important issue from our study is the lack of investment in applied health services research of the sort that will be required to produce the evidence for practice that policy makers desire. The current lack of evidence for community health reflects failure of the system to invest in research and evaluation that is adequately resourced and designed for complex community settings.

Review and evaluation of online tobacco dependence treatment training programs for health care practitioners.

PubMed

Selby, Peter; Goncharenko, Karina; Barker, Megan; Fahim, Myra; Timothy, Valerie; Dragonetti, Rosa; Kemper, Katherine; Herie, Marilyn; Hays, J Taylor

2015-04-17

Training health care professionals is associated with increased capacity to deliver evidence-based smoking cessation interventions and increased quit rates among their patients. Online training programs hold promise to provide training but questions remain regarding the quality and usability of available programs. The aim was to assess the quality of English-language online courses in tobacco dependence treatment using a validated instrument. An environmental scan was conducted using the Google search engine to identify available online tobacco dependence treatment courses. The identified courses were then evaluated using the Peer Review Rubric for Online Learning, which was selected based on its ability to evaluate instructional design. It also has clear and concise criteria descriptions to ensure uniformity of evaluations by trained experts. A total of 39 courses were identified, of which 24 unique courses were assessed based on their accessibility and functionality during the period of evaluation. Overall, the course ratings indicated that 17 of 24 courses evaluated failed to meet minimal quality standards and none of the courses evaluated could be ranked as superior. However, many excelled in providing effective navigation, course rationale, and content. Many were weak in the use of instructional design elements, such as teaching effectiveness, learning strategies, instructor's role, and assessment and evaluation. Evaluation results and suggestions for improvement were shared with course administrators. Based on the courses evaluated in this review, course developers are encouraged to employ best practices in instructional design, such as cohesiveness of material, linearity of design, practice exercises, problem solving, and ongoing evaluation to improve existing courses and in the design of new online learning opportunities.

Quantitative assessment of participant knowledge and evaluation of participant satisfaction in the CARES training program.

PubMed

Goodman, Melody S; Si, Xuemei; Stafford, Jewel D; Obasohan, Adesuwa; Mchunguzi, Cheryl

2012-01-01

The purpose of the Community Alliance for Research Empowering Social change (CARES) training program was to (1) train community members on evidence-based public health, (2) increase their scientific literacy, and (3) develop the infrastructure for community-based participatory research (CBPR). We assessed participant knowledge and evaluated participant satisfaction of the CARES training program to identify learning needs, obtain valuable feedback about the training, and ensure learning objectives were met through mutually beneficial CBPR approaches. A baseline assessment was administered before the first training session and a follow-up assessment and evaluation was administered after the final training session. At each training session a pretest was administered before the session and a posttest and evaluation were administered at the end of the session. After training session six, a mid-training evaluation was administered. We analyze results from quantitative questions on the assessments, pre- and post-tests, and evaluations. CARES fellows knowledge increased at follow-up (75% of questions were answered correctly on average) compared with baseline (38% of questions were answered correctly on average) assessment; post-test scores were higher than pre-test scores in 9 out of 11 sessions. Fellows enjoyed the training and rated all sessions well on the evaluations. The CARES fellows training program was successful in participant satisfaction and increasing community knowledge of public health, CBPR, and research methodology. Engaging and training community members in evidence-based public health research can develop an infrastructure for community-academic research partnerships.

Development and process evaluation of a web-based responsible beverage service training program

PubMed Central

2012-01-01

Background Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers’ knowledge, attitudes, and self-efficacy. Methods Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Results Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Conclusions Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention. PMID:22999419

Barbershop Talk With Brothers: using community-based participatory research to develop and pilot test a program to reduce HIV risk among Black heterosexual men.

PubMed

Wilson, Tracey E; Fraser-White, Marilyn; Williams, Kim M; Pinto, Angelo; Agbetor, Francis; Camilien, Brignel; Henny, Kirk; Browne, Ruth C; Gousse, Yolene; Taylor, Tonya; Brown, Humberto; Taylor, Raekiela; Joseph, Michael A

2014-10-01

There is a need for feasible, evidence-based interventions that support HIV risk reduction among heterosexual Black men. In this article, we describe the process for development of the Barbershop Talk With Brothers (BTWB) program and evaluation. The BTWB program is a theoretically grounded and community-based HIV prevention program that seeks to improve individual skills and motivation to decrease sexual risk, and that builds men's interest in and capacity for improving their community's health. Formative data collection included barbershop observations and barber focus groups, brief behavioral risk assessments of men in barbershops, and focus groups and individual interviews. Based on this information and in consultation with our steering committee, we developed the BTWB program and accompanying program evaluation. From April through November 2011, 80 men were recruited and completed a baseline assessment of a pilot test of the program; 78 men completed the program and 71 completed a 3-month assessment. The pilot evaluation procedures were feasible to implement, and assessments of pre- and post-test measures indicate that key behavioral outcomes and proposed mediators of those outcomes changed in hypothesized directions. Specifically, attitudes and self-efficacy toward consistent condom use improved, and respondents reported lower levels of sexual risk behavior from baseline to follow-up (all p < 0.05). Perceptions of community empowerment also increased (p = 0.06). While HIV stigma decreased, this difference did not reach statistical significance. Our approach to community-engaged program development resulted in an acceptable, feasible approach to reaching and educating heterosexual Black men about HIV prevention in community settings.

78 FR 79697 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-31

... new initiatives based on emerging issues, science, and policy; (6) supports the harmonization and..., and programmatic efforts; (10) manages evaluation fellowship; (11) guides performance-based strategic... improvement based on effective program evaluation, and performance measurement; (14) supports evidence-driven...

The Effect of a Computer Program Based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) in Improving Ninth Graders' Listening and Reading Comprehension Skills in English in Jordan

ERIC Educational Resources Information Center

Alodwan, Talal; Almosa, Mosaab

2018-01-01

The study aimed to assess the effectiveness of a computer program based on Analysis, Design, Development, Implementation and Evaluation (ADDIE) Model on the achievement of Ninth Graders' listening and Reading Comprehension Skills in English. The study sample comprised 70 ninth graders during the second semester of the academic year 2016/2017. The…

An Evaluation Study of an Executive Master of Business Administration (EMBA) Program in an Urban City: Examining the Transfer of Knowledge and Leadership Practices

ERIC Educational Resources Information Center

Choi, Hye Lim

2011-01-01

This study examined the effectiveness of the Executive Master of Business Administration (EMBA) degree program in terms of transfer of knowledge and leadership practices. Based on a review of literature related to adult learning theories, EMBA programs, the importance of evaluation practices, and leadership practices, this study was designed to…

School Age Child Care: Common Issues in Program Design and Evaluation with Annotated Bibliography. Australian Early Childhood Resource Booklets No. 2.

ERIC Educational Resources Information Center

Piscitelli, Barbara

Noting an increase in demand for school-age child care offerings, with no corresponding establishment of guidelines for program development, this booklet addresses design and evaluation issues in school age child care (SACC) in Australia. The booklet is largely based on two surveys of SACC programs conducted in 1986. The issues discussed in the…

Emotionally Troubled Teens' Help-Seeking Behaviors: An Evaluation of Surviving the Teens® Suicide Prevention and Depression Awareness Program

ERIC Educational Resources Information Center

Strunk, Catherine M.; Sorter, Michael T.; Ossege, Julianne; King, Keith A.

2014-01-01

Many school-based suicide prevention programs do not show a positive impact on help-seeking behaviors among emotionally troubled teens despite their being at high risk for suicide. This study is a secondary analysis of the Surviving the Teens® program evaluation to determine its effect on help-seeking behaviors among troubled youth. Results showed…

Evaluation of Three Osteoporosis Prevention Programs for Young Women: Application of the Health Belief Model

ERIC Educational Resources Information Center

Lein, Donald H.; Turner, Lori; Wilroy, Jereme

2016-01-01

Purpose: The purpose of this study was to evaluate the effectiveness of theory-based osteoporosis prevention programs on calcium and vitamin D intakes and osteoporosis health beliefs in young women. Methods: Women (N = 152) aged 19 to 25 years were randomly assigned to one of 3 groups: a brochure group (n = 51), a computer-tailored program group…

A re-evaluation of project pride, a redesigned school-based drug abuse prevention program.

PubMed

LoSciuto, Leonard; Steinman, Ross B

2004-01-01

The present study examined the effectiveness of Project PRIDE, a school-based, counselor-administered, drug and alcohol prevention program. The study is presented in the context of Project PRIDE'S efforts to keep itself current and effective via continual evaluation-based development. In this outcome evaluation, Project PRIDE participants demonstrated greater pretest to posttest gains on five of six outcome measures compared to control students, although many of the changes were small or moderate and only two were statistically significant. Further, as predicted, gains in more factual or objective areas of the program were greater than in more subjective areas dealing with student perceptions and feelings. The limitations and implications of the findings are discussed. Also discussed are the advantages of the Binomial Effect Size Display as a data presentation mode that promotes both client and general audience understanding of results.

Supporting the Summer Reading of Urban Youth: An Evaluation of the Baltimore SummerREADS Program

ERIC Educational Resources Information Center

Stein, Marc L.

2017-01-01

This article presents an evaluation of the first 2 years of a research-based summer learning program that provided self-selected and developmentally appropriate books to students in low-income and low-resource elementary schools by a local philanthropic organization in a large urban district. The evaluation found evidence of a positive effect of…

Blazing an Evaluation Pathway: Lessons Learned from Applying Utilization-Focused Evaluation to a Conservation Education Program

ERIC Educational Resources Information Center

Flowers, Alice B.

2010-01-01

In 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students' knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the…

Using iPads as a Data Collection Tool in Extension Programming Evaluation

ERIC Educational Resources Information Center

Rowntree, J. E.; Witman, R. R.; Lindquist, G. L.; Raven, M. R.

2013-01-01

Program evaluation is an important part of Extension, especially with the increased emphasis on metrics and accountability. Agents are often the point persons for evaluation data collection, and Web-based surveys are a commonly used tool. The iPad tablet with Internet access has the potential to be an effective survey tool. iPads were field tested…

Teacher Advancement Program (TAP) at Wilburn Elementary School: Year 3 Evaluation Report. Eye on Evaluation. D&A Report No. 11.02

ERIC Educational Resources Information Center

Baenen, Nancy

2011-01-01

The Teacher Advancement Program (TAP) is a model for training, teacher advancement, and instructional strategies. Based on interviews and observations, the four TAP principles were implemented with fidelity during the 2010-11 school year, with one exception--teacher evaluations. Feedback was slow, and teachers had concerns about the reliability of…

Pay for performance programs in Australia: a need for guiding principles.

PubMed

Scott, Ian A

2008-11-01

Pay-for-performance (P4P) programs which reward clinical providers with incentive payments based on one or more measures of quality of care are now common in the United States and the United Kingdom and it is likely they will attract increasing interest in Australia. However, empirical evidence demonstrating effectiveness of such programs is limited and many existing programs have not had rigorous outcome evaluation. To maximise success, future P4P programs should incorporate the lessons and insights obtained from previous experience. Based on a review of published trials, program evaluations and position statements, the following principles that may guide future program design and implementation were synthesised: 1) formulate a rationale and a business case for P4P; 2) use established evidence-based performance measures; 3) use rigorous and verifiable methods of data collection and analysis; 4) define performance targets using absolute and relative thresholds; 5) use rewards that are sufficient, equitable and transparent; 6) address appropriateness of provider responses and avoid perverse incentives; 7) implement communication and feedback strategies; 8) use existing organisational structures to implement P4P programs; 9) attribute credit for performance to participants in ways that foster population-based perspectives; and 10) invest in outcomes and health service research. Recommendations flowing from these principles relevant to Australian settings are provided.

Evaluation of a Nutrition Education Program for Family Practice Residents.

ERIC Educational Resources Information Center

Gray, David S.; And Others

1988-01-01

A nutrition education program at the University of South Alabama Medical Center that was based on the "co-counseling model" as described by Moore and Larsen is described. Patients with one of three problem areas were selected for evaluation: hypertension, diabetes mellitus, and pregnancy. (MLW)

Abstinence-based programs for prevention of adolescent pregnancies. A review.

PubMed

Thomas, M H

2000-01-01

This article assesses the abstinence-based programs developed by family life educators and the factors associated with positive results through a review of abstinence promotion programs of the federal government. In 1996, Section 510 was added to Title V of the Social Security Act allocating US$50 million annually from 1998-2000 to fund abstinence education programs, while in 1997, a National Strategy to Prevent Teen Pregnancy was launched by the Office of Adolescent Pregnancy Prevention to provide teen pregnancy programs to at least 25% of the communities. Presented in this paper is a discussion of the Abstinence Only programs, which focus on the prevention of pregnancy and sexually transmitted disease among adolescents, and the Abstinence Plus programs, which emphasize other prevention methods as well as abstinence. Evaluation of Abstinence Only programs include Success Express, Project Taking Charge, Sex Respect, Teen Aid, Values and Choices and Facts and Feelings. Moreover, programs such as Reducing the Risk, Postponing Sexual Involvement, Project Education Now, and Babies Later were evaluated under the Abstinence Plus programs. Several programs evaluated have shown to have a positive effect on attitudes among adolescents, but are not proven to have a significant effect on sexual behavior. In conclusion, this article encourages exploration of new approaches to address teen pregnancy and the increasing incidence of sexually transmitted diseases among adolescents, while the federal government must utilize the implementation of existing programs with positive effects.

Behavior-based safety at Amtrak-Chicago associated with reduced injuries and costs.

DOT National Transportation Integrated Search

2007-02-01

The Federal Railroad Administration (FRA) Human Factors Research and Development (R&D) Program is sponsoring the Clear Signal for Action Program (CSA) to evaluate whether an approach that combines behavior-based safety (BBS) and continuous improvemen...

Multicultural Training in Doctoral School Psychology Programs: In Search of the Model Program?

ERIC Educational Resources Information Center

Kearns, Tori; Ford, Laurie; Brown, Kimberly

The multicultural training (MCT) of APA-accredited School Psychology programs was studied. The sample included faculty and students from five programs nominated for strong MCT and five comparison programs randomly selected from the list of remaining APA-accredited programs. Program training was evaluated using a survey based on APA guidelines for…

Results of Descriptive Study of Crisis Nursery and Respite Care Programs.

ERIC Educational Resources Information Center

Huntington, Gail S.; And Others

This report describes results of an evaluation of respite care programs and crisis nursery programs for children with disabilities, based on survey forms received from 81 programs and site visits to selected programs across the United States. The survey of crisis nursery programs and the survey of respite care programs gathered data on amount of…

Evaluation of a community based childhood injury prevention program.

PubMed Central

Bablouzian, L.; Freedman, E. S.; Wolski, K. E.; Fried, L. E.

1997-01-01

OBJECTIVES: This pilot study evaluates the effectiveness of a community based childhood injury prevention program on the reduction of home hazards. METHODS: High risk pregnant women, who were enrolled in a home visiting program that augments existing health and human services, received initial home safety assessments. Clients received education about injury prevention practices, in addition to receiving selected home safety supplies. Fourteen questions from the initial assessment tool were repeated upon discharge from the program. Matched analyses were conducted to evaluate differences from initial assessment to discharge. RESULTS: A significantly larger proportion of homes were assessed as safe at discharge, compared with the initial assessment, for the following hazards: children riding unbuckled in all auto travel, Massachusetts Poison Center sticker on the telephone, outlet plugs in all unused electrical outlets, safety latches on cabinets and drawers, and syrup of ipecac in the home. CONCLUSIONS: A community based childhood injury prevention program providing education and safety supplies to clients significantly reduced four home hazards for which safety supplies were provided. Education and promotion of the proper use of child restraint systems in automobiles significantly reduced a fifth hazard, children riding unbuckled in auto travel. This program appears to reduce the prevalence of home hazards and, therefore, to increase home safety. PMID:9113841

Evaluation of a Community-Based Program That Integrates Joyful Movement Into Fall Prevention for Older Adults

PubMed Central

Carlucci, Celeste; Kardachi, Julie; Bradley, Sara M.; Prager, Jason; Wyka, Katarzyna

2018-01-01

Background: Despite the development of evidence-based fall-prevention programs, there remains a need for programming that will engage older adults in real-world settings. Objective: This study aimed to evaluate a community-based group program that integrates joyful movement into fall prevention. The curriculum emphasizes a positive experience of movement, cultivating a healthy body image, and retraining of biomechanics. Design: Program evaluation was conducted using a one-group pre–post test study design. Key outcomes were functional balance and confidence. Qualitative feedback was gathered at the final class sessions. Results: Two hundred fifteen older adults enrolled at four sites over the period from 2010 to 2014. Among 86 participants who provided feedback, most credited the program for an increased sense of optimism and/or confidence (70%), and better walking ability (50%). Among 102 participants who completed both initial and final assessments, there was evidence of significant improvements on the Functional Reach Test (d = .60, p < .001) and Modified Falls Efficacy Scale (d = .17, p < .001). Conclusion: A joyful movement curriculum is acceptable to older participants, and they show improvements in functional balance and confidence. Future research should examine whether the positive changes encouraged by joyful movement lead to lasting reductions in fall risk and additional health benefits. PMID:29796405

A Controlled Evaluation of a High School Biomedical Pipeline Program: Design and Methods

NASA Astrophysics Data System (ADS)

Winkleby, Marilyn A.; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90 %, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

A CONTROLLED EVALUATION OF A HIGH SCHOOL BIOMEDICAL PIPELINE PROGRAM: DESIGN AND METHODS.

PubMed

Winkleby, Marilyn A; Ned, Judith; Ahn, David; Koehler, Alana; Fagliano, Kathleen; Crump, Casey

2014-02-01

Given limited funding for school-based science education, non-school-based programs have been developed at colleges and universities to increase the number of students entering science- and health-related careers and address critical workforce needs. However, few evaluations of such programs have been conducted. We report the design and methods of a controlled trial to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program. This 5-year matched cohort study uses an annual survey to assess educational and career outcomes among four cohorts of students who participate in the SRP and a matched comparison group of applicants who were not chosen to participate in the SRP. Matching on sociodemographic and academic background allows control for potential confounding. This design enables the testing of whether the SRP has an independent effect on educational- and career-related outcomes above and beyond the effects of other factors such as gender, ethnicity, socioeconomic background, and pre-intervention academic preparation. The results will help determine which curriculum components contribute most to successful outcomes and which students benefit most. After 4 years of follow-up, the results demonstrate high response rates from SRP participants and the comparison group with completion rates near 90%, similar response rates by gender and ethnicity, and little attrition with each additional year of follow-up. This design and methods can potentially be replicated to evaluate and improve other biomedical pipeline programs, which are increasingly important for equipping more students for science- and health-related careers.

Overview of a pharmacist anticoagulation certificate program.

PubMed

Kirk, Julienne K; Edwards, Rebecca; Brewer, Andrew; Miller, Cathey; Bray, Bryan; Groce, James B

2017-07-01

To describe the design of an ongoing anticoagulation certificate program and annual renewal update for pharmacists. Components of the anticoagulation certificate program include home study, pre- and posttest, live sessions, case discussions with evaluation and presentation, an implementation plan, and survey information (program evaluation and use in practice). Clinical reasoning skills were assessed through case work-up and evaluation prior to live presentation. An annual renewal program requires pharmacists to complete home study and case evaluations. A total of 361 pharmacists completed the anticoagulation certificate program between 2002 and 2015. Most (62%) practiced in ambulatory care and 38% in inpatient care settings (8% in both). In the past four years, 71% were working in or starting anticoagulation clinics in ambulatory and inpatient settings. In their evaluations of the program, an average of 90% of participants agreed or strongly agreed the lecture material was relevant and objectives were met. Pharmacists are able to apply knowledge and skills in management of anticoagulation. This structured practice-based continuing education program was intended to enhance pharmacy practice and has achieved that goal. The certificate program in anticoagulation was relevant to pharmacists who attended the program. Copyright © 2017. Published by Elsevier Inc.

Innovative and Community-Guided Evaluation and Dissemination of a Prostate Cancer Education Program for African-American Men and Women

PubMed Central

Jackson, Dawnyea D.; Owens, Otis L.; Friedman, Daniela B.; Dubose-Morris, Ragan

2014-01-01

African Americans (AA) are more likely to develop and die from cancer than any other racial or ethnic group. The aims of this research were to: (1) evaluate current education materials being implemented in a community-based prostate cancer education program for AA communities; (2) refine materials based on findings from Aim 1; (3) share updated materials with participants from Aim 1 for additional improvements; and (4) disseminate and evaluate the improved education program through a statewide videoconference with AA men and women. AA individuals evaluated the current education program through a mail survey (n=32) and community forum (n=38). Participants reported that the existing prostate cancer education program content could be understood by lay persons, but recommendations for improvement were identified. They included: defining unknown and/or scientific terminology, increasing readability by increasing font size and enlarging images, and including more recent and relevant statistics. Following refinement of the education materials based on survey and forum feedback, a statewide videoconference was implemented. Following the videoconference, participants (25 men; 3 women) reported that they would encourage others to learn more about prostate cancer, talk to their doctor about whether or not to get screened for prostate cancer, and would recommend the conference to others. There is great potential for using this type of iterative approach to education program development with community and clinical partners for others conducting similar work. PMID:25510370

Implementing an Evidence-Based Fall Prevention Intervention in Community Senior Centers.

PubMed

Li, Fuzhong; Harmer, Peter; Fitzgerald, Kathleen

2016-11-01

To evaluate the impact of implementing an evidence-based fall prevention intervention in community senior centers. We used a single-group design to evaluate the Tai Ji Quan: Moving for Better Balance (TJQMBB) program's adoption, population reach, implementation, effectiveness, and maintenance among 36 senior centers in 4 Oregon counties between 2012 and 2016. The primary outcome measure, as part of the effectiveness evaluation, was number of falls as ascertained by self-report. Trained TJQMBB instructors delivered the program to community-dwelling older adults for 48 weeks, with a 6-month postintervention follow-up. TJQMBB was adopted by 89% of the senior centers approached and reached 90% of the target population. The program resulted in a 49% reduction in the total number of falls and improved physical performance. Participation was well maintained after the program's completion. The average cost-effectiveness ratio for the 48-week program implementation was $917 per fall prevented and $676 per fall prevented for multiple falls. TJQMBB is an effective public health program that can be broadly implemented in community senior centers for primary prevention of falls among community-dwelling older adults.

Effect of an Internet-based Curriculum on Postgraduate Education

PubMed Central

Sisson, Stephen D; Hughes, Mark T; Levine, David; Brancati, Frederick L

2004-01-01

We hypothesized that the Internet could be used to disseminate and evaluate a curriculum in ambulatory care, and that internal medicine residency program directors would value features made possible by online dissemination. An Internet-based ambulatory care curriculum was developed and marketed to internal medicine residency program directors. Utilization and knowledge outcomes were tracked by the website; opinions of program directors were measured by paper surveys. Twenty-four programs enrolled with the online curriculum. The curriculum was rated favorably by all programs, test scores on curricular content improved significantly, and program directors rated highly features made possible by an Internet-based curriculum. PMID:15109313

Development of GUI Type On-Line Condition Monitoring Program for a Turboprop Engine Using Labview

NASA Astrophysics Data System (ADS)

Kong, Changduk; Kim, Keonwoo

2011-12-01

Recently, an aero gas turbine health monitoring system has been developed for precaution and maintenance action against faults or performance degradations of the advanced propulsion system which occurs in severe environments such as high altitude, foreign object damage particles, hot and heavy rain and snowy atmospheric conditions. However to establish this health monitoring system, the online condition monitoring program is firstly required, and the program must monitor the engine performance trend through comparison between measured engine performance data and base performance results calculated by base engine performance model. This work aims to develop a GUI type on-line condition monitoring program for the PT6A-67 turboprop engine of a high altitude and long endurance operation UAV using LabVIEW. The base engine performance of the on-line condition monitoring program is simulated using component maps inversely generated from the limited performance deck data provided by engine manufacturer. The base engine performance simulation program is evaluated because analysis results by this program agree well with the performance deck data. The proposed on-line condition program can monitor the real engine performance as well as the trend through precise comparison between clean engine performance results calculated by the base performance simulation program and measured engine performance signals. In the development phase of this monitoring system, a signal generation module is proposed to evaluate the proposed online monitoring system. For user friendly purpose, all monitoring program are coded by LabVIEW, and monitoring examples are demonstrated using the proposed GUI type on-condition monitoring program.

An evaluation of Washington's Medicaid disease-management program.

PubMed

Lind, Alice; Kaplan, Louise

2007-10-01

In 2002, Washington State Medicaid implemented a disease-management program for clients with diagnoses of asthma, chronic obstructive pulmonary disease, heart failure, and diabetes. The program represented a unique attempt to manage disabled clients in a fee-for-services environment, and at its onset, was one of the first statewide programs in the United States. This article reviews the effectiveness of the program based on the results from two independent evaluations. Results of cost-savings measurements and health outcomes are presented for each of the conditions. These results were used to make program changes, which began in 2007.

Computer-aided system of evaluation for population-based all-in-one service screening (CASE-PASS): from study design to outcome analysis with bias adjustment.

PubMed

Chen, Li-Sheng; Yen, Amy Ming-Fang; Duffy, Stephen W; Tabar, Laszlo; Lin, Wen-Chou; Chen, Hsiu-Hsi

2010-10-01

Population-based routine service screening has gained popularity following an era of randomized controlled trials. The evaluation of these service screening programs is subject to study design, data availability, and the precise data analysis for adjusting bias. We developed a computer-aided system that allows the evaluation of population-based service screening to unify these aspects and facilitate and guide the program assessor to efficiently perform an evaluation. This system underpins two experimental designs: the posttest-only non-equivalent design and the one-group pretest-posttest design and demonstrates the type of data required at both the population and individual levels. Three major analyses were developed that included a cumulative mortality analysis, survival analysis with lead-time adjustment, and self-selection bias adjustment. We used SAS AF software to develop a graphic interface system with a pull-down menu style. We demonstrate the application of this system with data obtained from a Swedish population-based service screen and a population-based randomized controlled trial for the screening of breast, colorectal, and prostate cancer, and one service screening program for cervical cancer with Pap smears. The system provided automated descriptive results based on the various sources of available data and cumulative mortality curves corresponding to the study designs. The comparison of cumulative survival between clinically and screen-detected cases without a lead-time adjustment are also demonstrated. The intention-to-treat and noncompliance analysis with self-selection bias adjustments are also shown to assess the effectiveness of the population-based service screening program. Model validation was composed of a comparison between our adjusted self-selection bias estimates and the empirical results on effectiveness reported in the literature. We demonstrate a computer-aided system allowing the evaluation of population-based service screening programs with an adjustment for self-selection and lead-time bias. This is achieved by providing a tutorial guide from the study design to the data analysis, with bias adjustment. Copyright © 2010 Elsevier Inc. All rights reserved.

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

PubMed

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Conceptual framework for development of comprehensive e-health evaluation tool.

PubMed

Khoja, Shariq; Durrani, Hammad; Scott, Richard E; Sajwani, Afroz; Piryani, Usha

2013-01-01

The main objective of this study was to develop an e-health evaluation tool based on a conceptual framework including relevant theories for evaluating use of technology in health programs. This article presents the development of an evaluation framework for e-health programs. The study was divided into three stages: Stage 1 involved a detailed literature search of different theories and concepts on evaluation of e-health, Stage 2 plotted e-health theories to identify relevant themes, and Stage 3 developed a matrix of evaluation themes and stages of e-health programs. The framework identifies and defines different stages of e-health programs and then applies evaluation theories to each of these stages for development of the evaluation tool. This framework builds on existing theories of health and technology evaluation and presents a conceptual framework for developing an e-health evaluation tool to examine and measure different factors that play a definite role in the success of e-health programs. The framework on the horizontal axis divides e-health into different stages of program implementation, while the vertical axis identifies different themes and areas of consideration for e-health evaluation. The framework helps understand various aspects of e-health programs and their impact that require evaluation at different stages of the life cycle. The study led to the development of a new and comprehensive e-health evaluation tool, named the Khoja-Durrani-Scott Framework for e-Health Evaluation.

Evaluation of the safety benefits of the risk awareness and perception training program for novice teen drivers.

DOT National Transportation Integrated Search

2016-01-01

This project evaluated the impact of the PC-based Risk Awareness and Perception Training (RAPT) program on young driver crashes and traffic violations. Young drivers 16 to 18 years of age were recruited immediately after they passed the on-road drivi...

A Final Report for the Evaluation of the Achieve3000 Programs

ERIC Educational Resources Information Center

Shannon, Lisa; Grant, Billie-Jo

2015-01-01

Achieve3000 publishes a number of online literacy programs that differentiate lessons and activities based on student performance. Magnolia Consulting--an independent, third party evaluation firm--assessed Achieve3000 Solutions' impact on student learning during the 2014-15 school year. The researchers used a randomized control trial, where…

Computer-Assisted Learning in Elementary Reading: A Randomized Control Trial

ERIC Educational Resources Information Center

Shannon, Lisa Cassidy; Styers, Mary Koenig; Wilkerson, Stephanie Baird; Peery, Elizabeth

2015-01-01

This study evaluated the efficacy of Accelerated Reader, a computer-based learning program, at improving student reading. Accelerated Reader is a progress-monitoring, assessment, and practice tool that supports classroom instruction and guides independent reading. Researchers used a randomized controlled trial to evaluate the program with 344…

Evaluating Technology Integration in the Elementary School: A Site-Based Approach.

ERIC Educational Resources Information Center

Mowe, Richard

This book enables educators at the elementary level to conduct formative evaluations of their technology programs in minimum time. Most of the technology is computer related, including word processing, graphics, desktop publishing, spreadsheets, databases, instructional software, programming, and telecommunications. The design of the book is aimed…

The Use and Evaluation of Videodiscs in the Chemistry Laboratory.

ERIC Educational Resources Information Center

Russell, Arlene A.; And Others

1985-01-01

Describes a quantitative evaluation of an interactive videodisc program in which students measure the temperature dependence of the solubility product of lead chloride by titration of chloride with silver nitrate using a Mohr titration. Student reaction (based on responses made using the program, quiz answers, and laboratory performance) was…

Faculty and Student Views of the Interim Term

ERIC Educational Resources Information Center

Centra, John A.; Sobol, Marion G.

1974-01-01

Evaluations of the interim term or 4-1-4 program at various colleges have been generally favorable. A detailed evaluation of the Rider College interim study program based on faculty and student reports indicated that the more nontraditionally oriented courses were rated higher than the more traditional offerings. (Editor/PG)