Understanding Program Monitoring: The Relationships among Outcomes, Indicators, Measures, and Targets. REL 2014-011

ERIC Educational Resources Information Center

Malone, Nolan; Mark, Lauren; Narayan, Krishna

2014-01-01

This guide offers educators, program managers, administrators, and researchers a resource for building capacity for monitoring program outcomes. It provides concise definitions of program monitoring components and a framework for assessing program progress. Examples demonstrate the relationships among program components: outcomes, indicators,…

Curriculum Mapping: A Method to Assess and Refine Undergraduate Degree Programs

ERIC Educational Resources Information Center

Joyner-Melito, Helen S.

2016-01-01

Over the past several decades, there has been increasing interest in program- and university-level assessment and aligning learning outcomes to program content. Curriculum mapping is a tool that creates a visual map of all courses in the curriculum and how they relate to curriculum learning outcomes. Assessment tools/activities are often included…

Assessing Intermediate Outcomes of a Faith-Based Residential Prisoner Reentry Program

ERIC Educational Resources Information Center

Roman, Caterina G.; Wolff, Ashley; Correa, Vanessa; Buck, Janeen

2007-01-01

Objective: This study examined intermediate outcomes of a faith-based prisoner reentry program by assessing how client spirituality related to client- and program-level characteristics, investigating differences between completers and terminators, and examining how religious preference, religiosity/spirituality, religious salience, and…

Assessment of Student Learning Outcomes in FCS Programs

ERIC Educational Resources Information Center

Weaver-Kaulis, Amy; Crutsinger, Christy

2006-01-01

Accreditation, budget, and accountability pressures at the institution and program levels lead to the involvement of faculty in assessment-based activities. Increasingly, programs are being expected to document student learning beyond traditional course grades. The use of outcomes as a tool to improve learning relies heavily on the active…

Independence Community College Program Review Process.

ERIC Educational Resources Information Center

Romine, Robert J.

Program review at Independence Community College (ICC) is structured so that every program of study will undergo review within a 5-year period. The purpose of the program review effort is to assess the relationship of inputs to outcomes, so that actual outcomes can be compared to expected outcomes. Each program of study is evaluated according to…

Longitudinal Assessment of Comprehensive School Reform Program Implementation and Outcomes: First-Year Report

ERIC Educational Resources Information Center

Tushnet, Naida C., Flaherty, John, Jr., Smith, And

2004-01-01

The Longitudinal Assessment of Comprehensive School Reform Implementation and Outcomes (LACIO) responds to the No Child Left Behind Act's requirement for an evaluation of the federal Comprehensive School Reform (CSR) program. The legislation stipulates two broad goals for the evaluation: (1) to evaluate the implementation and outcomes achieved by…

A Model for Using a Capstone Experience as One Method of Assessment of an Information Systems Degree Program

ERIC Educational Resources Information Center

Murray, Meg; Perez, Jorge; Guimaraes, Mario

2008-01-01

Student attainment of educational outcomes is a core purpose of any institution of higher education and assessment provides a vehicle through which a program of study is able to ascertain how well it is achieving its stated learning outcomes and how program improvement might be achieved. Assessment of student learning begins with the clear…

Assessing Outcomes in Optometric Education: A Commentary by the Council on Optometric Education.

ERIC Educational Resources Information Center

Optometric Education, 1998

1998-01-01

A statement of the Council for Optometric Education (COE) defines and characterizes educational outcomes, outcomes assessment, and outcomes data, and explains the reasons for outcomes assessment, its relationship to curricular design, and its function in accreditation of optometry programs. Stated COE standards and expectations of optometry…

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Methods Used for the Assessment of Student Outcomes from Master's Degree Programs in Organizational Leadership

ERIC Educational Resources Information Center

Pugh, Joseph W. T.

2009-01-01

This descriptive, non-experimental, cross-sectional study inquired into the methods used to assess the student outcomes of master's degree programs in organizational leadership. A survey questionnaire was submitted to the directors of master's degree programs in organizational leadership at ninety-three not-for-profit institutions of higher…

Outcome Assessment of the Visiting Fulbright Scholar Program

ERIC Educational Resources Information Center

US Department of State, 2005

2005-01-01

The Office of Policy and Evaluation of the Bureau of Educational and Cultural Affairs of the U.S. Department of State contracted with SRI International to conduct a series of assessments of outcomes and impacts of various specialized exchange programs under the overall umbrella of the Fulbright Educational Exchange Program, the U.S. government's…

Can Institutions Have Quality Programming without Utilizing a Systematic Outcomes-Based Assessment Process?

ERIC Educational Resources Information Center

Weiner, Lauren; Bresciani, Marilee J.

2011-01-01

The researchers explored whether implementation of a systematic outcomes-based assessment process is necessary for demonstrating quality in service learning programs at a two-year and a four-year institution. The findings revealed that Western Community College and the University of the Coast maintained quality service-learning programs, which met…

Income Tax Preparation Assistance Service Learning Program: A Multidimensional Assessment

ERIC Educational Resources Information Center

Aldridge, Richard; Callahan, Richard A.; Chen, Yining; Wade, Stacy R.

2015-01-01

The authors present a multidimensional assessment of the outcomes and benefits of an income tax preparation assistance (ITPA) service learning program. They measure the perceived proximate benefits at the delivery of the service program, the actual learning outcome benefits prior to graduation, and the perceived long-term benefits from a…

Programmatic assessment of a university-based implant training program using patient-reported outcomes.

PubMed

Al-Sabbagh, Mohanad; Jenkins, Diane W; de Leeuw, Reny; Nihill, Patricia; Robinson, Fonda G; Thomas, Mark V

2014-11-01

The University of Kentucky College of Dentistry (UKCD) established an implant training program that provides training in the use of a single implant system, evidence-based diagnostic and treatment protocols (standardized work practices), and a total quality management system (Implant Quality Assurance Program). The aim of this study was to assess the programmatic effectiveness of the UKCD implant training program by reporting the success and survival of implants placed, using patient-reported outcomes and comparing them to previously established benchmarks. A total of 415 patients (963 implants) were interviewed, approximately 50 percent of all qualified patients. The implant survival rate was 97 percent, and 88 percent of the implants were considered successful (as determined by patient-centric criteria). These outcomes were consistent with the program's previously established benchmarks of 90 percent. These results suggest that work standardization (in the form of specific treatment protocols) and the use of a formal, incremental learning system can result in positive patient outcomes. Clinical outcomes should be monitored in academic dental settings as part of clinical process improvement, and these outcomes can provide a means of assessing the effectiveness of the training program.

Randomized trial of the Availability, Responsiveness and Continuity (ARC) organizational intervention for improving youth outcomes in community mental health programs.

PubMed

Glisson, Charles; Hemmelgarn, Anthony; Green, Philip; Williams, Nathaniel J

2013-05-01

The primary objective of the study was to assess whether the Availability, Responsiveness and Continuity (ARC) organizational intervention improved youth outcomes in community based mental health programs. The second objective was to assess whether programs with more improved organizational social contexts following the 18-month ARC intervention had better youth outcomes than programs with less improved social contexts. Eighteen community mental health programs that serve youth between the ages of 5 and 18 were randomly assigned to ARC or control conditions. Clinicians (n = 154) in the participating programs completed the Organizational Social Context (OSC) measure at baseline and following the 18-month ARC organizational intervention. Caregivers of 393 youth who were served by the 18 programs (9 in ARC and 9 in control) completed the Shortform Assessment for Children (SAC) once a month for six months beginning at intake. Hierarchical linear models (HLM) analyses indicated that youth outcomes were significantly better in the programs that completed the 18 month ARC intervention. HLM analyses also showed that youth outcomes were best in the programs with the most improved organizational social contexts following the 18 month ARC intervention. Youth outcomes in community mental health programs can be improved with the ARC organizational intervention and outcomes are best in programs that make the most improvements in organizational social context. The relationships linking ARC, organizational social context, and youth outcomes suggest that service improvement efforts will be more successful if those efforts include strategies to improve the organizational social contexts in which the services are embedded. Copyright © 2013 American Academy of Child and Adolescent Psychiatry. Published by Elsevier Inc. All rights reserved.

Combining the Tasks of Grading Individual Assignments and Assessing Student Outcomes in Project-Based Courses

ERIC Educational Resources Information Center

Dahm, Kevin

2014-01-01

ABET requires that engineering programs demonstrate continuous assessment and continuous improvement in order to be accredited. Central to the process is establishing and assessing measurable "student outcomes" that reflect whether the goals and objectives of the program are being met. This paper examines effective strategies for…

Randomized Trial of the Availability, Responsiveness and Continuity (ARC) Organizational Intervention for Improving Youth Outcomes in Community Mental Health Programs

ERIC Educational Resources Information Center

Glisson, Charles; Hemmelgarn, Anthony; Green, Philip; Williams, Nathaniel J.

2013-01-01

Objectives: The primary objective of the study was to assess whether the Availability, Responsiveness and Continuity (ARC) organizational intervention improved youth outcomes in community based mental health programs. The second objective was to assess whether programs with more improved organizational social contexts following the 18-month ARC…

Student Gains in Self-Efficacy in an Advanced MSW Curriculum: A Customized Model for Outcomes Assessment

ERIC Educational Resources Information Center

Rishel, Carrie W.; Majewski, Virginia

2009-01-01

The new Educational Policy and Accreditation Standards (EPAS) identify assessment as "an integral component of competency-based education." It is not new, however, that programs must demonstrate plans to assess attainment of competencies or expected program outcomes and show how data collection and analysis inform curriculum decisions. Previous…

Japanese Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the Japanese Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the Japanese Language and Culture…

German Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the German Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the German Language and Culture Nine-year…

Evaluating the Student Learning Outcomes Assessment Process in Undergraduate Parks and Recreation Academic Programs

ERIC Educational Resources Information Center

Ross, Craig M.; Young, Sarah J.; Sturts, Jill R.

2012-01-01

Institutions of higher education are increasingly being held more accountable for assessing student learning both in and out of their classrooms along with reporting results to their stakeholders. The purpose of this study, which examined assessment of student learning outcomes in undergraduate park and recreation academic programs, was two-fold:…

Punjabi Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the Punjabi Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the Punjabi Language and Culture Nine-year…

How to Recognize Success and Failure: Practical Assessment of an Evolving, First-Semester Laboratory Program Using Simple, Outcome-Based Tools

ERIC Educational Resources Information Center

Gron, Liz U.; Bradley, Shelly B.; McKenzie, Jennifer R.; Shinn, Sara E.; Teague, M. Warfield

2013-01-01

This paper presents the use of simple, outcome-based assessment tools to design and evaluate the first semester of a new introductory laboratory program created to teach green analytical chemistry using environmental samples. This general chemistry laboratory program, like many introductory courses, has a wide array of stakeholders within and…

Practical Approaches to Outcomes Assessment: The Undergraduate Major in Foreign Languages and Literatures.

ERIC Educational Resources Information Center

Liskin-Gasparro, Judith E.

1995-01-01

Discusses specific instruments and procedures that university-level foreign languages and literatures departments can use in outcomes-assessment of their undergraduate majors, including standardized tests, oral assessments, questionnaires, and portfolios. Case studies of outcomes-assessment programs in language departments at the University of…

Implementing Assessment in an Outcome-Based Marketing Curriculum

ERIC Educational Resources Information Center

Borin, Norm; Metcalf, Lynn E.; Tietje, Brian C.

2008-01-01

This article describes the development and implementation of assessment in a new outcome-based marketing curriculum that was developed using a zero-based approach. Outcomes for the marketing curriculum were specified at the program, department, course, and lesson levels. Direct embedded assessments as well as indirect assessment methods were used…

A Report from the Higher Education Review Board (HERB): Assessment of Undergraduate Student Learning Outcomes in Food Science

ERIC Educational Resources Information Center

Hartel, R. W.; Iwaoka, W. T.

2016-01-01

For the past 15 years, Institute of Food Technologists (IFT) has mandated assessment of undergraduate student learning outcomes as the basis for approving food science (FS) programs. No longer is a check-off course system sufficient to be an IFT-approved program. The 4 steps to gaining IFT approval include developing learning outcomes for all…

Design and Operation of the Transformed National Healthy Start Evaluation.

PubMed

Banks, Jamelle E; Dwyer, Maura; Hirai, Ashley; Ghandour, Reem M; Atrash, Hani K

2017-12-01

Purpose Improving pregnancy outcomes for women and children is one of the nation's top priorities. The Healthy Start (HS) program was created to address factors that contribute to high infant mortality rates (IMRs) and persistent disparities in IMRs. The program began in 1991 and was transformed in 2014 to apply lessons from emerging research, past evaluation findings, and expert recommendations. To understand the implementation and impact of the transformed program, there is a need for a robust and comprehensive evaluation. Description The national HS evaluation will include an implementation evaluation, which will describe program components that affect outcomes; a utilization evaluation, which will examine the characteristics of women and infants who did and did not utilize the program; and an outcome evaluation, which will assess the program's effectiveness with regard to producing expected outcomes among the target population. Data sources include the National HS Program Survey, a HS participant survey, and individual-level program data linked to vital records and the Pregnancy Risk Assessment Monitoring System (PRAMS) survey. Assessment Descriptive analyses will be used to examine differences in risk profiles between participants and non-participants, as well as to calculate penetration rates for high-risk women in respective service areas. Multivariable analyses will be used to determine the impact of the program on key outcomes and will explore variation by dose, type of services received, and grantee characteristics. Conclusion Evaluation findings are expected to inform program decisions and direction, including identification of effective program components that can be spread and scaled.

Outcomes of Community-Based Prenatal Education Programs for Pregnant Women in Rural Texas.

PubMed

Ramsey, Joseph; Mayes, Brandii

A prenatal, evidenced-based education program was implemented in 7 rural counties and provided by trained staff at the Texas Department of State Health Services. This was implemented to address health disparities, in regard to birth outcomes, in rural minorities of Southeast Texas. The participants were given a preassessment (N = 382) and a postassessment (N = 326) of relevant health knowledge and a follow-up assessment (N = 149) to document the outcomes of their birth as well as health practices they were employing as new parents. The assessment results were analyzed to determine the effectiveness of the programs on improving health outcomes and knowledge.

Assessing Impact of Technology Based Digital Equalizer Programme on Improving Student Learning Outcomes

ERIC Educational Resources Information Center

Sarkar, Subrata; Mohapatra, Sanjay; Sundarakrishnan, J.

2017-01-01

The objective of this research was to assess the impact of the Digital Equalizer program (DE Program) in terms of student learning outcomes of students in subjects like science, mathematics and geography after 8 months of implementing the DE program in 283 schools across 30 districts of Odisha, India. This study was a inter group and intra group…

Application of Matrix Outcome Mapping to Constructively Align Program Outcomes and Course Outcomes in Higher Education

ERIC Educational Resources Information Center

Mazouz, Abdelkader; Crane, Keenan

2013-01-01

Establishing a link between Course Learning Outcomes (LOs) and Program Outcomes (POs) while assessing the course contents and delivery are among the most challenging issues in Higher Education. In the present study two forms were generated based on specific Course Learning Outcomes identified in the syllabus at the beginning of the teaching term:…

Assessment of Evidence-based Management Training Program: Application of a Logic Model.

PubMed

Guo, Ruiling; Farnsworth, Tracy J; Hermanson, Patrick M

2016-06-01

The purposes of this study were to apply a logic model to plan and implement an evidence-based management (EBMgt) educational training program for healthcare administrators and to examine whether a logic model is a useful tool for evaluating the outcomes of the educational program. The logic model was used as a conceptual framework to guide the investigators in developing an EBMgt educational training program and evaluating the outcomes of the program. The major components of the logic model were constructed as inputs, outputs, and outcomes/impacts. The investigators delineated the logic model based on the results of the needs assessment survey. Two 3-hour training workshops were delivered to 30 participants. To assess the outcomes of the EBMgt educational program, pre- and post-tests and self-reflection surveys were conducted. The data were collected and analyzed descriptively and inferentially, using the IBM Statistical Package for the Social Sciences (SPSS) 22.0. A paired sample t-test was performed to compare the differences in participants' EBMgt knowledge and skills prior to and after the training. The assessment results showed that there was a statistically significant difference in participants' EBMgt knowledge and information searching skills before and after the training (p< 0.001). Participants' confidence in using the EBMgt approach for decision-making was significantly increased after the training workshops (p< 0.001). Eighty-three percent of participants indicated that the knowledge and skills they gained through the training program could be used for future management decision-making in their healthcare organizations. The overall evaluation results of the program were positive. It is suggested that the logic model is a useful tool for program planning, implementation, and evaluation, and it also improves the outcomes of the educational program.

ORD Human Health Risk Assessment (HHRA) Research Program Mid-Cycle Progress Report and Review - 2010

EPA Pesticide Factsheets

The principal charge to the BOSC reviewers was to evaluate ORD’s HHRA Program from a program assessment framework relative to program relevance, structure, performance, quality, leadership, communication, and outcomes.

An Illustration of Diagnostic Classification Modeling in Student Learning Outcomes Assessment

ERIC Educational Resources Information Center

Jurich, Daniel P.; Bradshaw, Laine P.

2014-01-01

The assessment of higher-education student learning outcomes is an important component in understanding the strengths and weaknesses of academic and general education programs. This study illustrates the application of diagnostic classification models, a burgeoning set of statistical models, in assessing student learning outcomes. To facilitate…

The Challenge Course Experience Questionnaire: A Facilitator's Assessment Tool

ERIC Educational Resources Information Center

Schary, David P.; Waldron, Alexis L.

2017-01-01

Challenge course programs influence a variety of psychological, social, and educational outcomes. Yet, many challenges exist when measuring challenge course outcomes like logistical constraints and a lack of specific assessment tools. This study piloted and tested an assessment tool designed for facilitators to measure participant outcomes in…

Identifying Barriers in Implementing Outcomes-Based Assessment Program Review: A Grounded Theory Analysis

ERIC Educational Resources Information Center

Bresciani, Marilee J.

2011-01-01

The purpose of this grounded theory study was to identify the typical barriers encountered by faculty and administrators when implementing outcomes-based assessment program review. An analysis of interviews with faculty and administrators at nine institutions revealed a theory that faculty and administrators' promotion, tenure (if applicable),…

Wave of the Future?: Integrating IR, Outcomes Assessment, Planning, Program Review, and Accreditation

ERIC Educational Resources Information Center

Leimer, Christina

2010-01-01

Integrating institutional research, outcomes assessment, program review, strategic planning, and accreditation can be a powerful means of creating a culture of evidence-based decision making and continuous improvement. This study examined how this "integrated" model is organized in practice, how such offices began, why this approach was chosen,…

Moving Nursing Program Portfolio Assessment From Midterm to End of Program: Lessons Learned.

PubMed

Hickey, Kari; Rossetti, Jeanette; Oldenburg, Nancy; Abendroth, Maryann; Uhlken, Connie; Musker, Kathleen; Peters, Bradley; Paramore, Patricia

Portfolio assessment promotes a culture of evidence, evaluates program outcomes, and provides an opportunity to assess the acquisition of knowledge and skills that are not easily assessed by examinations and other traditional assessment methods in nursing curricula. The portfolio program of 1 Midwestern school of nursing recently moved portfolio assessment to the end of program. The process of this change including logistics, rubric development, and lessons learned is highlighted.

Toward the Ideal Professional Master's Degree Program.

ERIC Educational Resources Information Center

Russell, Maria P.

1999-01-01

Outlines work accomplished at the 1998 National Communication Association Summer Conference, presenting a model for a professional master's-degree program in public relations that integrates outcomes, assessment, curriculum, and pedagogy. Outlines program outcomes, curriculum, essential curriculum-content areas, pedagogical approaches, and…

Program Characteristics and Enrollees' Outcomes in the Program of All-Inclusive Care for the Elderly (PACE)

PubMed Central

Mukamel, Dana B; Peterson, Derick R; Temkin-Greener, Helena; Delavan, Rachel; Gross, Diane; Kunitz, Stephen J; Williams, T Franklin

2007-01-01

The Program of All-Inclusive Care for the Elderly (PACE) is a unique program providing a full spectrum of health care services, from primary to acute to long-term care for frail elderly individuals certified to require nursing home care. The objective of this article is to identify program characteristics associated with better risk-adjusted health outcomes: mortality, functional status, and self-assessed health. The article examines statistical analyses of information combining DataPACE (individual-level clinical data), a survey of direct care staff about team performance, and interviews with management in twenty-three PACE programs. Several program characteristics were associated with better functional outcomes. Fewer were associated with long-term self-assessed health, and only one with mortality. These findings offer strategies that may lead to better care. PMID:17718666

Postinjury personality and outcome in acquired brain injury: the Millon Behavioral Medicine Diagnostic.

PubMed

Beck, Kelley D; Franks, Susan F; Hall, James R

2010-03-01

To examine the relationship between postinjury personality and outcome in individuals with acquired brain injury. It was hypothesized that patients with differing levels of Introversive, Dejected, and Oppositional coping styles as described by Millon's Theory of Personality would show different outcomes after completion of a rehabilitation program. A retrospective chart review and completion of an outcome assessment was undertaken to examine study hypotheses. A postacute brain injury rehabilitation program. Fifty patients who completed the rehabilitation program between 2005 and 2008, who were 18 years of age or older, who possessed at least a sixth-grade reading level, and who completed a valid Millon Behavioral Medicine Diagnostic (MBMD) were selected. Rehabilitation therapists who worked with these patients were also recruited to assess patient outcomes. Charts of patients that met inclusion criteria were reviewed. Rehabilitation therapists completed the outcome measure retrospectively. The MBMD was used to predict outcome. The MBMD is a self-report questionnaire designed to assess psychosocial factors that relate to the course of medical treatment in chronic illness. The Mayo-Portland Adaptability Inventory (MPAI-4) was used to assess patient outcome. It is a 29-item assessment designed to evaluate the common physical, cognitive, emotional, behavioral, and social issues after acquired brain injury. Findings supported our hypotheses that patients with differing levels of Introversive and Oppositional Coping Styles would have significantly different outcomes after rehabilitation. Thus, individuals with mild/moderate to moderate/severe limitations had significantly greater scores on the Introversive and Oppositional coping compared with individuals with more successful outcomes. The results of this study support the idea that postinjury personality is an important factor in understanding outcome after completion of a brain-injury rehabilitation program. Personality variables accounted for significant variance above and beyond variance accounted for by the severity of the injury alone. These findings have important implications for the development and implementation of rehabilitation treatment planning. Copyright 2010 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

Assessing Education Program Learning Outcomes

ERIC Educational Resources Information Center

Bahous, Rima; Nabhani, Mona

2011-01-01

Teacher education programs help teachers gain knowledge and skills, develop "new" attitudes, and impact their beliefs about teaching, thereby favorably affecting teaching outcomes. In the absence of national standards and formal studies in Lebanon of existing teacher preparation programs, findings of this study could greatly contribute…

Use of fictional medical television in health sciences education: a systematic review.

PubMed

Hoffman, Beth L; Hoffman, Robert; Wessel, Charles B; Shensa, Ariel; Woods, Michelle S; Primack, Brian A

2018-03-01

While medical television programs are popular among health profession trainees, it is not clear to what extent these programs affect their knowledge, perceptions, and/or behaviors. Therefore, we conducted a systematic review of research evaluating associations between program exposure and outcomes. We conducted systematic literature searches in Pubmed, CINAHL, and PsycINFO. Selected studies were required to be scholarly research, involve exposure to fictionalized medical television programming by health professional students, and assess associations between exposure and outcomes. Studies were classified according to quality and factors related to population, exposure, and outcomes. Of 3541 studies identified, 13 met selection criteria. Six studies involved undergraduate medical students, one involved nursing students, two involved both medical and nursing students, two involved medical residents, one involved medical students, residents and attending physicians, and one involved graduate epidemiology students. Mean study quality according to the MERSQI was 8.27. The most commonly assessed television programs were ER and Grey's Anatomy (six each). Five studies assessed regular viewing habits, and found that fictional medical programs are popular among students and that students recall health topics from episodes. The eight studies that assessed the association with outcomes when using clips as educational tools reported high satisfaction and increased knowledge of the presented health topics. While relatively few published studies have explored influences of fictional medical television on health professional students, those conducted suggest that students often view these television programs independently and that integration of this programming into medical education is feasible and acceptable.

Outcome Assessment of a Management Program Using a Portfolio Approach: Lessons Learned

ERIC Educational Resources Information Center

Drost, Donald; Hanson, Lee; Molstady, Clark; Peake, Lloyd; Newman, Eric

2008-01-01

Over the past two decades the interest and use of student portfolios for assessing student learning outcomes has grown considerably. This paper presents an overview of the portfolio approach to outcome assessment adopted by the Department of Management at California State University, San Bernardino and discusses major issues encountered over six…

Learning Outcomes Assessment Step-By-Step: Enhancing Evidence-Based Practice in Career Services

ERIC Educational Resources Information Center

Makela, Julia Panke; Rooney, Gail S.

2012-01-01

What difference do your career programs and services make in clients' lives? How do you know? Answer these questions and more. Learn a practical approach to learning outcomes assessment that helps you tell the story of your career programs and services, celebrate your successes, and continuously improve your practice. Within this monograph, you…

NCME Award: University-Wide Utilization of Student Outcome Information in Assessing and Improving Academic Programs.

ERIC Educational Resources Information Center

Educational Measurement: Issues and Practice, 1984

1984-01-01

The University of Tennessee, Knoxville conducted a system-wide effort to increase use of student outcome information in assessing and improving academic programs. For this effort, the university received the National Council on Measurement in Education award for an outstanding example of an application of educational measurement technology. (EGS)

Using Individual Growth and Development Indicators to Assess Child and Program Outcomes

ERIC Educational Resources Information Center

Luze, Gayle J.; Hughes, Kre

2008-01-01

This article describes the use of Individual Growth and Development Indicators (IGDIs) to assess child and program outcomes. IGDIs do not provide all information needed to plan and implement effective services for infants and toddlers, but they do provide frequent data that can be used to make good decisions about interventions. Even though IGDIs…

Enhancing nurses' ethical practice: development of a clinical ethics program.

PubMed

McDaniel, C

1998-06-01

There is increasing attention paid to ethics under managed care; however, few clinical-based ethics programs are reported. This paper reports the assessment and outcomes of one such program. A quasi-experimental research design with t-tests is used to assess the outcome differences between participants and control groups. There are twenty nurses in each; they are assessed for comparability. Differences are predicted on two outcomes using reliable and valid measures: nurses' time with their patients in ethics discussions, and nurses' opinions regarding their clinical ethics environments. Results reveal a statistically significant difference (p <.05) between the two groups, with modest positive change in the participants. Additional exploratory analyses are reported on variables influential in health care services.

Use of Standardized Mastery Content Assessments Given during the First Year of a Baccalaureate Nursing Program for Predicting NCLEX-RN Outcomes

ERIC Educational Resources Information Center

Emory, DeAnna Jan

2012-01-01

The purpose of this study was to evaluate the relationship between standardized content specific mastery assessments and NCLEX-RN outcomes. Three content-specific standardized assessments testing Fundamentals, Pharmacology and Mental Health concepts were used to explain the dichotomous NCLEX-RN outcome of pass or fail. The three assessments were…

Characteristics of successful asthma programs.

PubMed

Clark, Noreen; Lachance, Laurie; Milanovich, Amy Friedman; Stoll, Shelley; Awad, Daniel F

2009-01-01

We identified characteristics of interventions associated with positive asthma outcomes to understand how programs can be improved. We identified asthma interventions from the peer-reviewed literature or through a nomination process for unpublished programs. Initially, we identified 532 interventions. Of those, 223 met our eligibility criteria (e.g., focus on asthma, completed an evaluation, and demonstrated at least one asthma-related health outcome) and provided information on program components and processes, administration, evaluation, and findings through telephone interviews, program documents, and published reports. We analyzed bivariate relationships between programmatic factors and outcomes using Chi-square statistics, Fisher's exact tests, and unconditional logistic regression. We confirmed findings for all programs by analyzing the subset with published results in peer-reviewed journals. Our findings indicated that programs were more likely to report a positive impact on health outcomes if they (1) were community based, (2) engaged the participation of community-based organizations, (3) provided program components in a clinical setting, (4) provided asthma training to health-care providers, (5) collaborated with other organizations and institutions and with government agencies, (6) designed a program for a specific racial/ethnic group, (7) tailored content or delivery based on individual health or educational needs, and (8) conducted environmental assessments and tailored interventions based on these assessments. Positive asthma outcomes were associated with specific program characteristics: being community centered, clinically connected, and continuously collaborative. Program developers and implementers who build these characteristics into their interventions will be more likely to realize desired asthma outcomes.

Assessment and effects of Therapeutic Patient Education for patients in hemodialysis: a systematic review.

PubMed

Idier, Laëtitia; Untas, Aurélie; Koleck, Michèle; Chauveau, Philippe; Rascle, Nicole

2011-12-01

This review examined the impact of Therapeutic Patient Education (TPE) programs in hemodialysis and the assessment of these programs. REVIEW METHODS AND DATA SOURCES: A systematic review was performed. Bibliographical research was done with a database in the social and human sciences (PsychINFO, PsycARTICLES, SocINDEX with Full Text and the Psychology and Behavioural Sciences Collection). References were also searched in several reviews specialized in nephrology-dialysis and in patient education. Articles were classified according three different outcomes: (1) physiological outcomes, (2) psychosocial outcomes, (3) or combined criteria. 35 articles were selected. The majority dealt with purely physiological outcomes (18) and the minority concerned only psychosocial outcomes (4). Fifteen articles discussed both physiological and psychosocial outcomes, i.e. combined criteria. Beneficial effects were shown such as improvements in knowledge, adherence and quality of life. Most educational interventions were performed by nurses. This systematic review found that educational programs in dialysis have become more numerous and efficient, with a prevalence of assessment based on physiological outcomes. TPE is a global management method based on both the physiological and the psychological well-being of the patient. Studies that take into account both physiological and psychosocial variables are very useful for understanding the effects of TPE programs on dialysis patients. The review shows that nurses play an important role in TPE and that they require varied communicational, educational, animation and assessment skills. These positive effects are encouraging for nurses to stimulate the development of TPE programs for dialysis patients in their multidisciplinary teams. The nurse's role is important for the commitment of each health caregiver (nurse, physician, dietician, pharmacist, psychologist, etc.) for the global management of patients in the TPE process. 2011 Elsevier Ltd. All rights reserved.

Measuring Family Outcomes Early Intervention: Findings from a Large-Scale Assessment

ERIC Educational Resources Information Center

Raspa, Melissa; Bailey, Donald B., Jr.; Olmsted, Murrey G.; Nelson, Robin; Robinson, Nyle; Simpson, Mary Ellen; Guillen, Chelsea; Houts, Renate

2010-01-01

This article reports data from a large-scale assessment using the Family Outcomes Survey with families participating in early intervention. The study was designed to determine how families describe themselves with regard to outcomes achieved, the extent to which outcomes are interrelated, and the extent to which child, family, and program factors…

Challenges in the Implementation of Outcomes-Based Assessment Program Review in a California Community College District

ERIC Educational Resources Information Center

Bresciani, Marilee J.

2011-01-01

The purpose of this study was to explore the manner in which a community college district planned to implement a systematic outcomes-based assessment program review process in order to have results inform institutional, district, and state policy discussions. Data derived from this grounded theory study indicated that there was not a shared…

Out-of-School-Time Academic Programs to Improve School Achievement: A Community Guide Health Equity Systematic Review

PubMed Central

Knopf, John A.; Hahn, Robert A.; Proia, Krista K.; Truman, Benedict I.; Johnson, Robert L.; Muntaner, Carles; Fielding, Jonathan E.; Jones, Camara Phyllis; Fullilove, Mindy T.; Hunt, Pete C.; Qu, Shuli; Chattopadhyay, Sajal K.; Milstein, Bobby

2015-01-01

Context Low-income and minority status in the United States are associated with poor educational outcomes, which, in turn, reduce the long-term health benefits of education. Objective This systematic review assessed the extent to which out-of-school-time academic (OSTA) programs for at-risk students, most of whom are from low-income and racial/ethnic minority families, can improve academic achievement. Because most OSTA programs serve low-income and ethnic/racial minority students, programs may improve health equity. Design Methods of the Guide to Community Preventive Services were used. An existing systematic review assessing the effects of OSTA programs on academic outcomes (Lauer et al 2006; search period 1985–2003) was supplemented with a Community Guide update (search period 2003–2011). Main Outcome Measure Standardized mean difference. Results Thirty-two studies from the existing review and 25 studies from the update were combined and stratified by program focus (ie, reading-focused, math-focused, general academic programs, and programs with minimal academic focus). Focused programs were more effective than general or minimal academic programs. Reading-focused programs were effective only for students in grades K-3. There was insufficient evidence to determine effectiveness on behavioral outcomes and longer-term academic outcomes. Conclusions OSTA programs, particularly focused programs, are effective in increasing academic achievement for at-risk students. Ongoing school and social environments that support learning and development may be essential to ensure the longer-term benefits of OSTA programs. PMID:26062096

An Assessment of an Operational Educational Accountability System for Continuing Education in the Health Professions.

ERIC Educational Resources Information Center

Walsh, Patrick L.

1982-01-01

The Educational Quality Assessment and Assurance System for continuing education in health sciences includes three components to measure inputs, processes, and outcomes. They are (1) Program Coordinator Competency List, (2) Quality Assessment and Assurance Program, and (3) evaluation of educational programs. (SK)

Curriculum Development Based on the Big Picture Assessment of the Mechanical Engineering Program

ERIC Educational Resources Information Center

Sabri, Mohd Anas Mohd; Khamis, Nor Kamaliana; Tahir, Mohd Faizal Mat; Wahid, Zaliha; Kamal, Ahmad; Ihsan, Ariffin Mohd; Sulong, Abu Bakar; Abdullah, Shahrum

2013-01-01

One of the major concerns of the Engineering Accreditation Council (EAC) is the need for an effective monitoring and evaluation of program outcome domains that can be associated with courses taught under the Mechanical Engineering program. However, an effective monitoring method that can determine the results of each program outcome using Bloom's…

Outcomes Assessment Survey of Schools and Colleges of Optometry.

ERIC Educational Resources Information Center

Daum, Kent M.; Berman, Morris S.; Boltz, Roger L.; Beck, Diane E.

2003-01-01

A survey of the academic officers of optometric institutions suggests that outcomes assessment varies substantially across programs in the areas of curriculum, scholarship and research, faculty, administration, and facilities. (EV)

The Commander's Wellness Program: Assessing the Association Between Health Measures and Physical Fitness Assessment Scores, Fitness Assessment Exemptions, and Duration of Limited Duty.

PubMed

Tvaryanas, Col Anthony P; Greenwell, Brandon; Vicen, Gloria J; Maupin, Genny M

2018-03-26

Air Force Medical Service health promotions staff have identified a set of evidenced-based interventions targeting tobacco use, sleep habits, obesity/healthy weight, and physical activity that could be integrated, packaged, and deployed as a Commander's Wellness Program. The premise of the program is that improvements in the aforementioned aspects of the health of unit members will directly benefit commanders in terms of members' fitness assessment scores and the duration of periods of limited duty. The purpose of this study is to validate the Commander's Wellness Program assumption that body mass index (BMI), physical activity habits, tobacco use, sleep, and nutritional habits are associated with physical fitness assessment scores, fitness assessment exemptions, and aggregate days of limited duty in the population of active duty U.S. Air Force personnel. This study used a cross-sectional analysis of active duty U.S. Air Force personnel with an Air Force Web-based Health Assessment and fitness assessment data during fiscal year 2013. Predictor variables included age, BMI, gender, physical activity level (moderate physical activity, vigorous activity, and muscle activity), tobacco use, sleep, and dietary habits (consumption of a variety of foods, daily servings of fruits and vegetables, consumption of high-fiber foods, and consumption of high-fat foods). Nonparametric methods were used for the exploratory analysis and parametric methods were used for model building and statistical inference. The study population comprised 221,239 participants. Increasing BMI and tobacco use were negatively associated with the outcome of composite fitness score. Increasing BMI and tobacco use and decreasing sleep were associated with an increased likelihood for the outcome of fitness assessment exemption status. Increasing BMI and tobacco use and decreasing composite fitness score and sleep were associated with an increased likelihood for the outcome of limited duty status, whereas increasing BMI and decreasing sleep were associated with the outcome of increased aggregate days of limited duty. The observed associations were in the expected direction and the effect sizes were modest. Physical activity habits and nutritional habits were not observed to be associated with any of the outcome measures. The Commander's Wellness Program should be scoped to those interventions targeting BMI, composite fitness score, sleep, and tobacco use. Although neither self-reported physical activity nor nutritional habits were associated with the outcomes, it is still worthwhile to include related interventions in the Commander's Wellness Program because of the finding in other studies of a consistent association between the overall number of health risks and productivity outcomes.

Relations between Student Perceptions of Assessment Authenticity, Study Approaches and Learning Outcome

ERIC Educational Resources Information Center

Gulikers, Judith T. M.; Bastiaens, Theo J.; Kirschner, Paul A.; Kester, Liesbeth

2006-01-01

This article examines the relationships between perceptions of authenticity and alignment on study approach and learning outcome. Senior students of a vocational training program performed an authentic assessment and filled in a questionnaire about the authenticity of various assessment characteristics and the alignment between the assessment and…

Outcomes Assessment of Computer-Assisted Behavioral Objectives for Accounting Graduates.

ERIC Educational Resources Information Center

Moore, John W.; Mitchem, Cheryl E.

1997-01-01

Presents behavioral objectives for accounting students and an outcomes assessment plan with five steps: (1) identification and definition of student competencies; (2) selection of valid instruments; (3) integration of assessment and instruction; (4) determination of levels of assessment; and (5) attribution of improvements to the program. (SK)

Down and In: Assessment Practices at the Program Level

ERIC Educational Resources Information Center

Ewell, Peter; Paulson, Karen; Kinzie, Jillian

2011-01-01

Assessing the quality of undergraduate student learning continues to be a priority in U.S. postsecondary education. Although variations in outcome assessment practices have long been suspected, they have not been systematically documented. To follow up the 2009 National Institute for Learning Outcomes Assessment (NILOA) report on institutional…

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program.

PubMed

Britten, Nicole; Wallar, Lauren E; McEwen, Scott A; Papadopoulos, Andrew

2014-07-31

Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students' learning experiences. The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system.

Evaluating the Impact of the U.S. National Toxicology Program: A Case Study on Hexavalent Chromium.

PubMed

Xie, Yun; Holmgren, Stephanie; Andrews, Danica M K; Wolfe, Mary S

2017-02-01

Evaluating the impact of federally funded research with a broad, methodical, and objective approach is important to ensure that public funds advance the mission of federal agencies. We aimed to develop a methodical approach that would yield a broad assessment of National Toxicology Program's (NTP's) effectiveness across multiple sectors and demonstrate the utility of the approach through a case study. A conceptual model was developed with defined activities, outputs (products), and outcomes (proximal, intermediate, distal) and applied retrospectively to NTP's research on hexavalent chromium (CrVI). Proximal outcomes were measured by counting views of and requests for NTP's products by external stakeholders. Intermediate outcomes were measured by bibliometric analysis. Distal outcomes were assessed through Web and LexisNexis searches for documents related to legislation or regulation changes. The approach identified awareness of NTP's work on CrVI by external stakeholders (proximal outcome) and citations of NTP's research in scientific publications, reports, congressional testimonies, and legal and policy documents (intermediate outcome). NTP's research was key to the nation's first-ever drinking water standard for CrVI adopted by California in 2014 (distal outcome). By applying this approach to a case study, the utility and limitations of the approach were identified, including challenges to evaluating the outcomes of a research program. This study identified a broad and objective approach for assessing NTP's effectiveness, including methodological needs for more thorough and efficient impact assessments in the future. Citation: Xie Y, Holmgren S, Andrews DMK, Wolfe MS. 2017. Evaluating the impact of the U.S. National Toxicology Program: a case study on hexavalent chromium. Environ Health Perspect 125:181-188; http://dx.doi.org/10.1289/EHP21.

Measuring the Implementation Fidelity of Student Affairs Programs: A Critical Component of the Outcomes Assessment Cycle

ERIC Educational Resources Information Center

Gerstner, Jerusha J.; Finney, Sara J.

2013-01-01

Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…

Marketing Program Outcomes: The Building Blocks of an Associate Degree Marketing Program.

ERIC Educational Resources Information Center

Ruhland, Sheila; Samson, Harland; Brewer, Jerrilyn; Hague, David

This document contains materials about and from an assessment of Wisconsin's associate degree marketing program. The document begins with a report containing the following: marketing program mission and vision statements; overview, conclusions, and recommendations of an assessment of marketing education needs in which recent graduates of the…

Feasibility of a parenting program to prevent substance use among Latino youth: a community-based participatory research study.

PubMed

Allen, Michele L; Hurtado, Ghaffar A; Yon, Kyu Jin; Okuyemi, Kola S; Davey, Cynthia S; Marczak, Mary S; Stoppa, Patricia; Svetaz, Veronica M

2013-01-01

Family-skills training programs prevent adolescent substance use, but few exist for immigrant Latino families. This study assesses the feasibility of a family-skills training intervention developed using a community-based participatory research framework, and explores parental traditional values as a modifier of preliminary effects. One-group pretest-posttest. Four Latino youth-serving sites (school, clinic, church, social-service agency). Immigrant Latino parents of adolescents aged 10 to 14 years (N  =  83). Eight-session program in Spanish to improve parenting practices and parent-youth interpersonal relations designed with Latino parents and staff from collaborating organizations. Feasibility was assessed through retention, program appropriateness, and group interaction quality. Preliminary outcomes evaluated were (1) parenting self-efficacy, discipline, harsh parenting, monitoring, conflict, attachment, acceptance, and involvement, and (2) parent perception of adolescent internalizing, externalizing, and substance use behaviors. Covariates included sociodemographics and parental endorsement of traditional values. Feasibility outcomes were assessed with descriptive statistics. Paired t-tests measured changes in parenting outcomes. Adjusted multiple regression models were conducted for change in each outcome, and t-tests compared mean changes in outcomes between parents with high and low traditional values scores. Program appropriateness and group interaction scores were positive. Improvement was noted for eight parenting outcomes. Parents perceived that adolescent internalizing behaviors decreased. Parents with lower endorsement of traditional values showed greater pretest-posttest change in attachment, acceptance, and involvement. This intervention is feasible and may influence parenting contributors to adolescent substance use.

Assessing the outcomes of prolonged cessation-induction and aid-to-cessation trials: floating prolonged abstinence.

PubMed

Aveyard, Paul; Wang, Dechao; Connock, Martin; Fry-Smith, Anne; Barton, Pelham; Moore, David

2009-05-01

A Society for Research on Nicotine and Tobacco working group recommended outcome measures for cessation-induction trials and aid-to-cessation trials. Cessation-induction trials aim to motivate unwilling quitters to make a quit attempt. Aid-to-cessation trials give either medication or behavioral interventions to increase the rate at which willing quitters succeed in their attempts. Nicotine-assisted reduction programs combine features of both types of interventions by giving nicotine replacement to unwilling quitters. Treatment can be prolonged more than a year, quit attempts can occur and succeed early or late in the program, and renewed quit attempts are an inherent part of the program. Conventional outcome measures are tied to a fixed but arbitrary point in follow-up and cannot capture the true outcome: Prolonged cessation anchored to the point at which a person makes a successful quit attempt. We propose that the outcome should be counted from the successful quit attempt that began during the treatment period and continues for a defined period, ideally 6 months. In particular, if a trial compared a short reduction program with a long reduction program, it would not be possible to obtain an unbiased assessment of the outcome of such a trial using a measure tied to a fixed point in follow-up. Floating prolonged abstinence could provide such an assessment and is suitable for either prolonged cessation-induction trial or combined cessation-induction and aid-to-cessation trials.

Leadership development programs for physicians: a systematic review.

PubMed

Frich, Jan C; Brewster, Amanda L; Cherlin, Emily J; Bradley, Elizabeth H

2015-05-01

Physician leadership development programs typically aim to strengthen physicians' leadership competencies and improve organizational performance. We conducted a systematic review of medical literature on physician leadership development programs in order to characterize the setting, educational content, teaching methods, and learning outcomes achieved. Articles were identified through a search in Ovid MEDLINE from 1950 through November 2013. We included articles that described programs designed to expose physicians to leadership concepts, outlined teaching methods, and reported evaluation outcomes. A thematic analysis was conducted using a structured data entry form with categories for setting/target group, educational content, format, type of evaluation and outcomes. We identified 45 studies that met eligibility criteria, of which 35 reported on programs exclusively targeting physicians. The majority of programs focused on skills training and technical and conceptual knowledge, while fewer programs focused on personal growth and awareness. Half of the studies used pre/post intervention designs, and four studies used a comparison group. Positive outcomes were reported in all studies, although the majority of studies relied on learner satisfaction scores and self-assessed knowledge or behavioral change. Only six studies documented favorable organizational outcomes, such as improvement in quality indicators for disease management. The leadership programs examined in these studies were characterized by the use of multiple learning methods, including lectures, seminars, group work, and action learning projects in multidisciplinary teams. Physician leadership development programs are associated with increased self-assessed knowledge and expertise; however, few studies have examined outcomes at a system level. Our synthesis of the literature suggests important gaps, including a lack of programs that integrate non-physician and physician professionals, limited use of more interactive learning and feedback to develop greater self-awareness, and an overly narrow focus on individual-level rather than system-level outcomes.

Changes in University Students after Joining a Service Leadership Program in China

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lin, Li

2016-01-01

This study examined the effectiveness of a 4.5-day service leadership program for students from Chinese universities using objective outcome evaluation. The participants were assessed before and after the program, with two post-test measurements (immediate assessment and assessment 12 days after the completion of class learning). At pretest and…

Integrated worker health protection and promotion programs: overview and perspectives on health and economic outcomes.

PubMed

Pronk, Nicolaas P

2013-12-01

To describe integrated worker health protection and promotion (IWHPP) program characteristics, to discuss the rationale for the integration of occupational safety and health and worksite health promotion programs, and to summarize what is known about the impact of these programs on health and economic outcomes. A descriptive assessment of the current state of the IWHPP field and a review of studies on the effectiveness of IWHPP programs on health and economic outcomes were undertaken. Sufficient evidence of effectiveness was found for IWHPP programs when health outcomes were considered. Impact on productivity-related outcomes is considered promising, but inconclusive, whereas insufficient evidence was found for health care expenditures. Existing evidence supports an integrated approach in terms of health outcomes but will benefit significantly from research designed to support the business case for employers of various company sizes and industry types.

Integrated Worker Health Protection and Promotion Programs: Overview and Perspectives on Health and Economic Outcomes

PubMed Central

Pronk, Nicolaas P.

2014-01-01

Objective To describe integrated worker health protection and promotion (IWHPP) program characteristics, to discuss the rationale for integration of OSH and WHP programs, and to summarize what is known about the impact of these programs on health and economic outcomes. Methods A descriptive assessment of the current state of the IWHPP field and a review of studies on the effectiveness of IWHPP programs on health and economic outcomes. Results Sufficient evidence of effectiveness was found for IWHPP programs when health outcomes are considered. Impact on productivity-related outcomes is considered promising, but inconclusive, whereas insufficient evidence was found for health care expenditures. Conclusions Existing evidence supports an integrated approach in terms of health outcomes but will benefit significantly from research designed to support the business case for employers of various company sizes and industry types. PMID:24284747

A Review of Multidisciplinary Interventions in Atopic Dermatitis

PubMed Central

Spielman, Sara C.; LeBovidge, Jennifer S.; Timmons, Karol G.; Schneider, Lynda C.

2015-01-01

Multidisciplinary interventions have been developed for patients with atopic dermatitis (AD) and their families, with the aim of improving outcomes such as disease control, adherence, and quality of life. We reviewed the content of different multidisciplinary approaches to intervention for AD and evidence for their impact on key outcome measures. We also provided data from our multidisciplinary outpatient program for pediatric AD. Studies included in the review suggest benefits of multidisciplinary interventions as models of treatment or adjuncts to standard medical care, with a positive impact on outcomes including disease severity and itching/scratching. There were limitations to existing studies, including heterogeneous methods used to assess quality of life outcomes across studies and lack of controlled studies assessing the outcome of clinical care programs. Further research will be useful in assessing the impact of multidisciplinary interventions on important outcomes such as treatment adherence and sleep, identifying the elements of multidisciplinary interventions that are most critical for improved outcomes, and identifying the best candidates for multidisciplinary intervention approaches. PMID:26239470

Tobacco User Characteristics and Outcomes Related to Intensity of Quitline Program Use: Results From Minnesota and Pennsylvania.

PubMed

Lien, Rebecca K; Schillo, Barbara A; Mast, Jay L; Lukowski, Amy V; Greenseid, Lija O; Keith, Jennifer D; Keller, Paula A

2016-01-01

Tobacco users in all 50 states have access to quitline telephone counseling and cessation medications. While studies show multiple calls relate to quit success, most participants do not complete a full call series. To date, quitline program use studies have analyzed single factors-such as number of calls or counseling minutes. This study combines multiple factors of quitline program use across 2 states to describe how participants use a 5-call program; assess whether intensity of program use is associated with participant subgroups; and assess whether key outcomes (quitting, satisfaction) are associated with intensity. This observational study examines data for quitline participants in Minnesota (n = 2844) and Pennsylvania (n = 14 359) in 2011 and 2012. A subset of participants was surveyed 7 months after registration to assess key outcomes (response rates: Minnesota 65%; Pennsylvania 60%). Quitline utilization data were used to identify program use variables: nicotine replacement therapy provision, number of counseling calls, number of counseling minutes, days from first to last counseling call, and days from registration to first counseling call. Ten program use groups were created using all 5 program use variables, from lowest (1) to highest (10) intensity. Results were similar for both states. Only 11% of Minnesota and 8% of Pennsylvania participants completed all 5 calls. Intensity of quitline program use was associated with several participant characteristics including health conditions and age. Both quit status and program satisfaction were associated with program use intensity. Quit rates peaked in group 9, participants who received the full 5-call program. Quitlines should focus on engaging participants in multiple calls to improve quit outcomes. In addition, it is important to leverage multiple program use factors for a fuller understanding of how quitline participants use a program.

Behavioral Effects Within and Between Individual and Group Reinforcement Procedures.

ERIC Educational Resources Information Center

Reese, Sandra C.; And Others

This paper briefly outlines the outcomes of a large-scale behavioral program, Preparation through Responsive Educational Programs (PREP), involving students with academic and social deficits from a 1350-student junior high school. Overall program effectiveness was assessed by outcome criteria of total school grades, grades in non-PREP classes,…

Systematic review of employer-sponsored wellness strategies and their economic and health-related outcomes.

PubMed

Kaspin, Lisa C; Gorman, Kathleen M; Miller, Ross M

2013-02-01

This review determines the characteristics and health-related and economic outcomes of employer-sponsored wellness programs and identifies possible reasons for their success. PubMed, ABI/Inform, and Business Source Premier databases, and Corporate Wellness Magazine were searched. English-language articles published from 2005 to 2011 that reported characteristics of employer-sponsored wellness programs and their impact on health-related and economic outcomes among US employees were accepted. Data were abstracted, synthesized, and interpreted. Twenty references were accepted. Wellness interventions were classified into health assessments, lifestyle management, and behavioral health. Improved economic outcomes were reported (health care costs, return on investment, absenteeism, productivity, workers' compensation, utilization) as well as decreased health risks. Programs associated with favorable outcomes had several characteristics in common. First, the corporate culture encouraged wellness to improve employees' lives, not only to reduce costs. Second, employees and leadership were strongly motivated to support the wellness programs and to improve their health in general. Third, employees were motivated by a participation-friendly corporate policy and physical environment. Fourth, successful programs adapted to the changing needs of the employees. Fifth, community health organizations provided support, education, and treatment. Sixth, successful wellness programs utilized technology to facilitate health risk assessments and wellness education. Improved health-related and economic outcomes were associated with employer-sponsored wellness programs. Companies with successful programs tended to include wellness as part of their corporate culture and supported employee participation in several key ways.

Maternal health behaviors and infant health outcomes among homeless mothers: U.S. Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) 2000-2007.

PubMed

Richards, Rickelle; Merrill, Ray M; Baksh, Laurie; McGarry, Joanne

2011-01-01

To determine whether participation in the Women, Infants, and Children Program is associated with improved maternal and infant health outcomes among homeless women in the Pregnancy Risk Assessment Monitoring System. Analyses were based on Pregnancy Risk Assessment Monitoring System participants from 31 states/cities in the United States, 2000-2007 (n=272,859). Overall, 4% of women completing the Pregnancy Risk Assessment Monitoring System survey were homeless, with 76% participating in the Women, Infants, and Children Program, a federally-funded supplemental nutrition program for low-income women and children less than 5 years old. Among women in the Pregnancy Risk Assessment Monitoring System survey who reported using the Women, Infants, and Children Program, those experiencing homelessness were older, less educated, less likely to have private health insurance, and more likely to receive government assistance. Homeless women in the Women, Infants, and Children Program compared with those not in the program were significantly more likely to have a higher body mass index, to initiate breastfeeding after delivery, have prenatal care visits, have a longer gestational age, and have a greater infant birth weight. Characteristics of homeless pregnant women choosing to participate in the Women, Infants, and Children Program are consistent with the requirements for program participation for women in general. Homeless women accessing the Women, Infants, and Children Program had better maternal and infant health outcomes. Copyright © 2010 Elsevier Inc. All rights reserved.

Fidelity and outcomes in six integrated dual disorders treatment programs.

PubMed

Chandler, Daniel W

2011-02-01

Fidelity scores and outcomes were measured in six outpatient programs in California which implemented Integrated Dual Disorders Treatment (IDDT). Outcomes were measured for 1 year in four sites and 2 years in two sites; fidelity was assessed at 6 month intervals. Three of the six sites achieved high fidelity (at least a 4 on a 5 point fidelity scale) and three moderate fidelity (at least a 3). Retention in treatment, mental health functioning, stage of substance abuse treatment, abstinence, and psychiatric hospitalization were measured. Outcomes for individual programs were generally positive but not consistent within programs or across programs. Using pooled data in a longitudinal regression model with random effects at person level and adjustment of standard errors for clustering by site, change over time was not statistically significant for the primary outcomes. Fidelity scores had limited association with positive outcomes.

Assessing engineering students' demonstration of workplace competencies in experiential learning environments through internships and cooperative work experiences

NASA Astrophysics Data System (ADS)

Laingen, Mark A.

This study investigates the relationships between supervisor assessments and internship students' self-assessments for 15 workplace competencies, demonstrated in an internship or cooperative work environment. The 15 workplace competencies were developed by Iowa State University in collaboration with over 200 constituents comprised of Iowa State University COE alumni, engineering employers, COE faculty, partnering international faculty, and COE students, to provide clear, independent, and assessable measures for the eleven learning outcomes identified in the ABET Criterion 3 (a-k) outcomes. The study investigated workplace competency assessment data collected over ten years, commencing with the fall 2001 internship assessment term and concluding with the fall 2011 assessment term. The study used three separate methodologies to analyze workplace competency assessments in the COE. Part 1 analyzed data across the fifteen workplace competencies, and across ten programs in the College of Engineering, that have been involved with the workplace competency assessment of internship and cooperative students from the beginning of data collection in 2001. Supervisor assessment ratings were compared to internship student self-assessment ratings across the ten-year span from 2001-11using the non-parametric equivalent of the paired t-test; the Wilcoxon singed rank test for paired data. Part 2 of the study investigated the relationship between supervisor and student self-assessment data across assessment terms related to the 2001-05 and 2006-11 ABET accreditation cycles. The third part investigated how data tracking workplace competency strengths and weaknesses and ABET outcomes achievement percentages have changed between the assessment terms across accreditation cycles. Part 3 included an on-line survey sent to program curriculum committee members involved with workplace competency assessment data that investigated how the engineering programs are utilizing this data in support of continuous improvement of the program curricula. Results of the analysis demonstrate how paired supervisor assessment and student self-assessment ratings for assessment of the internship students' demonstration of workplace competencies can be useful in evaluating student demonstration of competency in COE learning outcomes through the experiential learning environment, and support continuous improvement practices for program curriculum development.

Randomized Trial of Healthy Families Arizona: Quantitative and Qualitative Outcomes

ERIC Educational Resources Information Center

LeCroy, Craig Winston; Davis, Melinda F.

2017-01-01

Home visitation has the potential to improve parent, child, and maternal outcomes and has become a widely implemented prevention program across the United States. The purpose of this research was to use a randomized controlled trial to assess the short-term effectiveness of the Arizona Healthy Families program across a range of outcomes. Two…

Maryland School Performance Assessment Program, 1992. Social Studies List of Outcomes and Indicators.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

The Maryland School Performance Program for 1992 puts forward social studies outcomes and indicators for grades K-3, grades 4-5, and grades 6-8. Specific indicators for each grade grouping further delineate the following seven individual outcomes: (1) political systems--students will demonstrate an understanding of the historical development and…

Multiple Measures of Outcome in Assessing a Prison-Based Drug Treatment Program

ERIC Educational Resources Information Center

Prendergast, Michael L.; Hall, Elizabeth A.; Wexler, Harry K.

2003-01-01

Evaluations of prison-based drug treatment programs typically focus on one or two dichotomous outcome variables related to recidivism. In contrast, this paper uses multiple measures of outcomes related to crime and drug use to examine the impact of prison treatment. Crime variables included self-report data of time to first illegal activity,…

Closing the Loop: How We Better Serve Our Students through a Comprehensive Assessment Process

ERIC Educational Resources Information Center

Arcario, Paul; Eynon, Bret; Klages, Marisa; Polnariev, Bernard A.

2013-01-01

Outcomes assessment is often driven by demands for accountability. LaGuardia Community College's outcomes assessment model has advanced student learning, shaped academic program development, and created an impressive culture of faculty-driven assessment. Our inquiry-based approach uses ePortfolios for collection of student work and demonstrates…

42 CFR 410.49 - Cardiac rehabilitation program and intensive cardiac rehabilitation program: Conditions of coverage.

Code of Federal Regulations, 2011 CFR

2011-10-01

... prescribed exercise, cardiac risk factor modification, psychosocial assessment, and outcomes assessment... rehabilitation items and services are furnished. (ii) Cardiac risk factor modification, including education...

Time to rethink the role of the library in educating doctors: driving information literacy in the clinical environment.

PubMed

Simons, Mary R; Morgan, Michael Kerin; Davidson, Andrew Stewart

2012-10-01

Can information literacy (IL) be embedded into the curriculum and clinical environment to facilitate patient care and lifelong learning? The Australian School of Advanced Medicine (ASAM) provides competence-based programs incorporating patient-centred care and lifelong learning. ASAM librarians use outcomes-based educational theory to embed and assess IL into ASAM's educational and clinical environments. A competence-based IL program was developed where learning outcomes were linked to current patients and assessed with checklists. Weekly case presentations included clinicians' literature search strategies, results, and conclusions. Librarians provided support to clinicians' literature searches and assessed their presentations using a checklist. Outcome data showed clinicians' searching skills improved over time; however, advanced MEDLINE searching remained challenging for some. Recommendations are provided. IL learning that takes place in context using measurable outcomes is more meaningful, is enduring, and likely contributes to patient care. Competence-based assessment drives learning in this environment.

A systems approach for implementing practice-based learning and improvement and systems-based practice in graduate medical education.

PubMed

Varkey, Prathibha; Karlapudi, Sudhakar; Rose, Steven; Nelson, Roger; Warner, Mark

2009-03-01

The Accreditation Council for Graduate Medical Education (ACGME) initiated its Outcome Project to better prepare physicians-in-training to practice in the rapidly changing medical environment and mandated assessment of competency in six outcomes, including Practice-Based Learning and Improvement (PBLI) and Systems-Based Practice (SBP). Before the initiation of the Outcome Project, these competencies were not an explicit element of most graduate medical education training programs. Since 1999, directors of ACGME-accredited programs nationwide have been challenged to teach and assess these competencies. The authors describe an institution-wide curriculum intended to facilitate the teaching and assessment of PBLI and SBP competencies in the 115 ACGME-accredited residency and fellowship programs (serving 1,327 trainees) sponsored by Mayo School of Graduate Medical Education. Strategies to establish the curriculum in 2005 included development of a Quality Improvement (QI) curriculum Web site, one-on-one consultations with program directors, a three-hour program director workshop, and didactic sessions for residents and fellows on core topics. An interim program director self-assessment survey revealed a 13% increase in perceived ability to measure competency in SBP, no change in their perceived ability to measure competence in PBLI, a 15% increase in their ability to provide written documentation of competence in PBLI, and a 35% increase in their ability to provide written documentation of competence in SBP between 2005 and 2007. Nearly 70% of the programs had trainees participating in QI projects. Further research is needed to evaluate the cost-effectiveness of such a program and to measure its impact on learner knowledge, skills, and attitudes and, ultimately, on patient outcomes.

An Improved Database System for Program Assessment

ERIC Educational Resources Information Center

Haga, Wayne; Morris, Gerard; Morrell, Joseph S.

2011-01-01

This research paper presents a database management system for tracking course assessment data and reporting related outcomes for program assessment. It improves on a database system previously presented by the authors and in use for two years. The database system presented is specific to assessment for ABET (Accreditation Board for Engineering and…

Maryland School Performance Program. Outcomes, Standards, & High-Stakes Accountability: Perspectives from Maryland and Kentucky.

ERIC Educational Resources Information Center

Haigh, John A.

This document presents a collection of materials on school performance in Maryland, especially as demonstrated in the Maryland School Performance Assessment Program (MSPAP) and the Independence Mastery Assessment Program (IMAP) for some special needs students. The MSPAP is a testing program administered to third, fifth, and eighth grade students…

Promising outcomes in teen mothers enrolled in a school-based parent support program and child care center.

PubMed

Sadler, Lois S; Swartz, Martha K; Ryan-Krause, Patricia; Seitz, Victoria; Meadows-Oliver, Mikki; Grey, Margaret; Clemmens, Donna A

2007-03-01

This study described a cohort of teen mothers and their children attending an urban high school with a parent support program and school-based child care center. Specific aims of the study were to describe maternal characteristics and outcomes, and child developmental and health outcomes. A volunteer sample of 65 adolescent mothers enrolled in the parent support program and their children were interviewed, surveyed, and assessed. Fifty-three mothers had children enrolled in the school-based child care center and 12 mothers had their children cared for by family members. Maternal characteristics assessed included self-esteem and depressive symptoms, social stressors and support, self-perceived parental competence, parent-child teaching interactions, and subsequent childbearing and maternal educational outcomes. Child outcomes included child developmental assessments and health outcomes. About 33% of teen mothers were mildly to moderately depressed and 39% of the sample had experienced transitional homelessness. Social support networks were small; in the past 12 months, mothers experienced a mean number of 13.2 +/- 11.9 negative life events. Maternal self-report measures and mother-child observation measures indicated positive levels of parental competence. Maternal educational outcomes were positive, and only 6% of mothers had subsequent childbirths within 2 years. The mean scores on developmental assessments of children fell within the normal range, although there were 7 children identified with developmental delays. For at-risk teen mothers, this parent support program and school-based child care setting appears to offer promising opportunities to help young mothers with parenting, avoid rapid subsequent pregnancies, and stay engaged with school, while their children are cared for in a close and safe environment.

A Web-Based Course Assessment Tool with Direct Mapping to Student Outcomes

ERIC Educational Resources Information Center

Ibrahim, Walid; Atif, Yacine; Shuaib, Khaled; Sampson, Demetrios

2015-01-01

The assessment of curriculum outcomes is an essential element for continuous academic improvement. However, the collection, aggregation and analysis of assessment data are notoriously complex and time-consuming processes. At the same time, only few developments of supporting electronic processes and tools for continuous academic program assessment…

Assessment of Learning in Business Education: Standardized or Homegrown?

ERIC Educational Resources Information Center

Djoundourian, Salpie S.

2017-01-01

The author gives an overview of typical learning outcomes in business education and assessment instruments that help measure and test these outcomes. Using data from a recently accredited program the author investigated the determinants of performance on assessment exams to help identify and evaluate differences between homegrown and standardized…

A methodology for evaluating organizational change in community-based chronic disease interventions.

PubMed

Hanni, Krista D; Mendoza, Elsa; Snider, John; Winkleby, Marilyn A

2007-10-01

In 2003, the Monterey County Health Department, serving Salinas, California, was awarded one of 12 grants from the Steps to a HealthierUS Program to implement a 5-year, multiple-intervention community approach to reduce diabetes, asthma, and obesity. National adult and youth surveys to assess long-term outcomes are required by all Steps sites; however, site-specific surveys to assess intermediate outcomes are not required. Salinas is a medically underserved community of primarily Mexican American residents with high obesity rates and other poor health outcomes. The health department's Steps program has partnered with traditional organizations such as schools, senior centers, clinics, and faith-based organizations as well as novel organizations such as employers of agricultural workers and owners of taquerias. The health department and the Stanford Prevention Research Center developed new site-specific, community-focused partner surveys to assess intermediate outcomes to augment the nationally mandated surveys. These site-specific surveys will evaluate changes in organizational practices, policies, or both following the socioecological model, specifically the Spectrum of Prevention. Our site-specific partner surveys helped to 1) identify promising new partners, select initial partners from neighborhoods with the greatest financial need, and identify potentially successful community approaches; and 2) provide data for evaluating intermediate outcomes matched to national long-term outcomes so that policy and organizational level changes could be assessed. These quantitative surveys also provide important context-specific qualitative data, identifying opportunities for strengthening community partnerships. Developing site-specific partner surveys in multisite intervention studies can provide important data to guide local program efforts and assess progress toward intermediate outcomes matched to long-term outcomes from nationally mandated surveys.

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program

PubMed Central

2014-01-01

Background Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. Methods A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. Results The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students’ learning experiences. Conclusions The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system. PMID:25078124

Evaluating participation in water resource management: A review

NASA Astrophysics Data System (ADS)

Carr, G.; BlöSchl, G.; Loucks, D. P.

2012-11-01

Key documents such as the European Water Framework Directive and the U.S. Clean Water Act state that public and stakeholder participation in water resource management is required. Participation aims to enhance resource management and involve individuals and groups in a democratic way. Evaluation of participatory programs and projects is necessary to assess whether these objectives are being achieved and to identify how participatory programs and projects can be improved. The different methods of evaluation can be classified into three groups: (i) process evaluation assesses the quality of participation process, for example, whether it is legitimate and promotes equal power between participants, (ii) intermediary outcome evaluation assesses the achievement of mainly nontangible outcomes, such as trust and communication, as well as short- to medium-term tangible outcomes, such as agreements and institutional change, and (iii) resource management outcome evaluation assesses the achievement of changes in resource management, such as water quality improvements. Process evaluation forms a major component of the literature but can rarely indicate whether a participation program improves water resource management. Resource management outcome evaluation is challenging because resource changes often emerge beyond the typical period covered by the evaluation and because changes cannot always be clearly related to participation activities. Intermediary outcome evaluation has been given less attention than process evaluation but can identify some real achievements and side benefits that emerge through participation. This review suggests that intermediary outcome evaluation should play a more important role in evaluating participation in water resource management.

Utilizing Quality Improvement Methods to Improve Patient Care Outcomes in a Pediatric Residency Program

PubMed Central

Akins, Ralitsa B.; Handal, Gilbert A.

2009-01-01

Objective Although there is an expectation for outcomes-oriented training in residency programs, the reality is that few guidelines and examples exist as to how to provide this type of education and training. We aimed to improve patient care outcomes in our pediatric residency program by using quality improvement (QI) methods, tools, and approaches. Methods A series of QI projects were implemented over a 3-year period in a pediatric residency program to improve patient care outcomes and teach the residents how to use QI methods, tools, and approaches. Residents experienced practice-based learning and systems-based assessment through group projects and review of their own patient outcomes. Resident QI experiences were reviewed quarterly by the program director and were a mandatory part of resident training portfolios. Results Using QI methodology, we were able to improve management of children with obesity, to achieve high compliance with the national patient safety goals, improve the pediatric hotline service, and implement better patient flow in resident continuity clinic. Conclusion Based on our experiences, we conclude that to successfully implement QI projects in residency programs, QI techniques must be formally taught, the opportunities for resident participation must be multiple and diverse, and QI outcomes should be incorporated in resident training and assessment so that they experience the benefits of the QI intervention. The lessons learned from our experiences, as well as the projects we describe, can be easily deployed and implemented in other residency programs. PMID:21975995

Methodological Challenges in International Comparative Post-Secondary Assessment Programs: Lessons Learned and the Road Ahead

ERIC Educational Resources Information Center

Wolf, Raffaela; Zahner, Doris; Benjamin, Roger

2015-01-01

The assessment of student learning outcomes in the tertiary school sector has seen an increase in global popularity in recent years. Measurement instruments that target higher order skills are on the rise, whereas assessments that foster the recall of factual knowledge are declining. The Assessment of Higher Education Learning Outcomes (AHELO)…

Student and community outcomes in service-learning: part 2--community outcomes.

PubMed

Reising, Deanna L; Allen, Patricia N; Hall, Susan G

2006-12-01

This article is the second of a two-part series reporting outcomes from a service-learning program implemented in a bachelor of science in nursing program. Part 1 (on pages 512-515) described students' perceptions of outcomes realized from the program, and Part 2 describes the community outcomes. The purposes of the program were to provide students with history-taking, blood pressure, and heart rate assessment skills, and beginning counseling skills, as well as to provide the university community with blood pressure screening and counseling in a convenient and accessible location. Data on community outcomes were collected on a continual basis during the hypertension screening and counseling program implementation. Clients were anonymously surveyed on health behavior actions taken after their screening and on the screening process. More than 700 client screenings were performed over 2 years, with positive health behavior changes being reported by clients.

Outcomes for youth residential treatment programs using administrative data from the child welfare system: a risk-adjustment application.

PubMed

McMillen, J Curtis; Lee, Bethany R; Jonson-Reid, Melissa

2008-05-01

This study assessed whether administrative data from the public child welfare system could be used to develop risk-adjusted performance reports for residential mental health programs for adolescents. Regression methods were used with 3,759 residential treatment spells for 2,784 children and youth to determine which outcomes could be adequately risk adjusted for case mix. Expected outcomes were created for each residential program given its case mix; then, expected and achieved outcomes were compared. For most programs, achieved results did not differ significantly from expected results for individual outcomes. Overall, outcomes achieved were not impressive. Only one quarter of spells resulted in a youth being maintained in a single less restrictive setting in the year following discharge. Methodological implications of this study suggest further refinements are needed for child welfare administrative data in order to develop risk-adjusted report cards of program performance.

Feasibility of a Parenting Program to Prevent Substance Use Among Latino Youth: A Community-Based Participatory Research Study

PubMed Central

Allen, Michele L.; Hurtado, Ghaffar A.; Yon, Kyu Jin; Okuyemi, Kola S.; Davey, Cynthia S.; Marczak, Mary S.; Stoppa, Patricia; Svetaz, Veronica M.

2014-01-01

Purpose Family-skills training programs prevent adolescent substance use, but few exist for immigrant Latino families. This study assesses the feasibility of a family-skills training intervention developed using a community-based participatory research framework, and explores parental traditional values as a modifier of preliminary effects. Design One-group pretest-posttest. Setting Four Latino youth–serving sites (school, clinic, church, social-service agency). Subjects Immigrant Latino parents of adolescents aged 10 to 14 years (N = 83). Intervention Eight-session program in Spanish to improve parenting practices and parent-youth interpersonal relations designed with Latino parents and staff from collaborating organizations. Measures Feasibility was assessed through retention, program appropriateness, and group interaction quality. Preliminary outcomes evaluated were (1) parenting self-efficacy, discipline, harsh parenting, monitoring, conflict, attachment, acceptance, and involvement, and (2) parent perception of adolescent internalizing, externalizing, and substance use behaviors. Covariates included sociodemographics and parental endorsement of traditional values. Analysis Feasibility outcomes were assessed with descriptive statistics. Paired t-tests measured changes in parenting outcomes. Adjusted multiple regression models were conducted for change in each outcome, and t-tests compared mean changes in outcomes between parents with high and low traditional values scores. Results Program appropriateness and group interaction scores were positive. Improvement was noted for eight parenting outcomes. Parents perceived that adolescent internalizing behaviors decreased. Parents with lower endorsement of traditional values showed greater pretest-posttest change in attachment, acceptance, and involvement. Conclusion This intervention is feasible and may influence parenting contributors to adolescent substance use. (Am J Health Promot 2013;27[4]:240–244.) PMID:23448413

Evaluating a measure of social health derived from two mental health recovery measures: the California Quality of Life (CA-QOL) and Mental Health Statistics Improvement Program Consumer Survey (MHSIP).

PubMed

Carlson, Jordan A; Sarkin, Andrew J; Levack, Ashley E; Sklar, Marisa; Tally, Steven R; Gilmer, Todd P; Groessl, Erik J

2011-08-01

Social health is important to measure when assessing outcomes in community mental health. Our objective was to validate social health scales using items from two broader commonly used measures that assess mental health outcomes. Participants were 609 adults receiving psychological treatment services. Items were identified from the California Quality of Life (CA-QOL) and Mental Health Statistics Improvement Program (MHSIP) outcome measures by their conceptual correspondence with social health and compared to the Social Functioning Questionnaire (SFQ) using correlational analyses. Pearson correlations for the identified CA-QOL and MSHIP items with the SFQ ranged from .42 to .62, and the identified scale scores produced Pearson correlation coefficients of .56, .70, and, .70 with the SFQ. Concurrent validity with social health was supported for the identified scales. The current inclusion of these assessment tools allows community mental health programs to include social health in their assessments.

Out-of-School-Time Academic Programs to Improve School Achievement: A Community Guide Health Equity Systematic Review.

PubMed

Knopf, John A; Hahn, Robert A; Proia, Krista K; Truman, Benedict I; Johnson, Robert L; Muntaner, Carles; Fielding, Jonathan E; Jones, Camara Phyllis; Fullilove, Mindy T; Hunt, Pete C; Qu, Shuli; Chattopadhyay, Sajal K; Milstein, Bobby

2015-01-01

Low-income and minority status in the United States are associated with poor educational outcomes, which, in turn, reduce the long-term health benefits of education. This systematic review assessed the extent to which out-of-school-time academic (OSTA) programs for at-risk students, most of whom are from low-income and racial/ethnic minority families, can improve academic achievement. Because most OSTA programs serve low-income and ethnic/racial minority students, programs may improve health equity. Methods of the Guide to Community Preventive Services were used. An existing systematic review assessing the effects of OSTA programs on academic outcomes (Lauer et al 2006; search period 1985-2003) was supplemented with a Community Guide update (search period 2003-2011). Standardized mean difference. Thirty-two studies from the existing review and 25 studies from the update were combined and stratified by program focus (ie, reading-focused, math-focused, general academic programs, and programs with minimal academic focus). Focused programs were more effective than general or minimal academic programs. Reading-focused programs were effective only for students in grades K-3. There was insufficient evidence to determine effectiveness on behavioral outcomes and longer-term academic outcomes. OSTA programs, particularly focused programs, are effective in increasing academic achievement for at-risk students. Ongoing school and social environments that support learning and development may be essential to ensure the longer-term benefits of OSTA programs.

Comparing effectiveness of generic and disease-specific self-management interventions for people with diabetes in a practice context.

PubMed

Ghahari, Setareh; Packer, Tanya; Boldy, Duncan; Melling, Lauren; Parsons, Richard

2015-10-01

The effectiveness of self-management interventions has been demonstrated. However, the benefits of generic vs. disease-specific programs are unclear, and their efficacy within a practice setting has yet to be fully explored. To compare the outcomes of the diabetes-specific self-management program (Diabetes) and the generic chronic disease Self-management Program (Chronic Condition) and to explore whether program characteristics, evaluated using the Quality Self-Management Assessment Framework (Q-SAF), provide insight into the results of the outcome evaluation. A pragmatic pretest, post-test design with 12-week follow up was used to compare the 2 self-management interventions. Outcomes were quality of life, self-efficacy, loneliness, self-management skills, depression, and health behaviours. People with diabetes self-selected attendance at the Diabetes or Chronic Condition program offered as part of routine practice. Participants with diabetes in the 2 programs (Diabetes=200; Chronic Condition=90) differed significantly in almost all demographic and clinical characteristics. Both programs yielded positive outcomes. Controlling for baseline and demographic characteristics, random effects modelling showed an interaction between time and program for 1 outcome: self-efficacy (p=0.029). Participants in the Chronic Condition group experienced greater improvements over time than did those in the Diabetes group. The Q-SAF analysis showed differences in program content, delivery and workforce capacity. People with diabetes benefited from both programs, but participation in the generic program resulted in greater improvements in self-efficacy for participants who had self-selected that program. Both programs in routine care led to health-related improvements. The Q-SAF can be used to assess the quality of programs. Copyright © 2015 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

What does a Performance Measurement System Tell Us about the National Comprehensive Cancer Control Program?

PubMed Central

Townsend, Julie S.; Moore, Angela R.; Mulder, Tiffani N.; Boyd, Mary

2015-01-01

Context The National Comprehensive Cancer Control Program (NCCCP) performance measurement system seeks to understand both the processes that funded programs undertake with their respective coalitions to implement the objectives of their cancer plans and outcomes of those efforts. Objective To identify areas of achievement and technical assistance needs of NCCCP awardees. Design Program performance was assessed through surveys completed by program directors on performance indicators in 2009 and 2010 and queries from a web-based management information system in 2011 and 2012. Setting Programs funded by CDC’s NCCCP. Participants 69 programs. Main Outcome Measure(s) The key performance measures assessed were: inclusion of diverse partners and key sectors in cancer coalitions; partners’ involvement in activities; receiving in-kind resources from partners; using evidence-based interventions and data for setting priorities; conducting program evaluation; using community- or organization-level strategies to address cancer control efforts; and demonstrating progress toward achieving health outcomes. Results Most programs reported having active coalitions that represent diverse organizational sectors. Nearly all programs routinely assess the burden of cancer. In-kind resources to implement activities peaked at $64,716 in the second year of a five year funding cycle, and declined in subsequent project years. By year 3, over 70% of programs reported having an evaluation plan. While programs reported that nearly two-thirds of their interventions were evidence-based, some programs implemented non-evidence-based interventions. A majority of programs successfully used at least one community- or organization-level change strategy. However, many programs did not incorporate objectives linked to health outcomes as they reported progress in implementing interventions. Conclusions: While NCCCP programs were strong at building and maintaining infrastructure, some programs may need additional technical assistance to increase the adoption of evidence-based interventions, develop solid and responsive evaluation plans, and better link efforts to population-based measures that demonstrate impact toward reducing the burden of cancer. PMID:25136936

Demonstrating Support for the Formative and Summative Assessment Paradigm in a School-Based Intensive Mental Health Program

ERIC Educational Resources Information Center

Puddy, Richard W.; Boles, Richard E.; Dreyer, Meredith L.; Maikranz, Julie; Roberts, Michael C.; Vernberg, Eric M.

2008-01-01

We illustrate the use of formative and summative assessment in evaluating a therapeutic classroom program for children with serious emotional disturbances. Information was analyzed based on data gathered for clinical decision-making during treatment (formative assessment) and measurement of outcomes at discharge (summative assessment) from a…

Evolving from Quantity to Quality: A New Yardstick for Assessment

ERIC Educational Resources Information Center

Fulcher, Keston H.; Orem, Chris D.

2010-01-01

Higher education experts tout learning outcomes assessment as a vehicle for program improvement. To this end the authors share a rubric designed explicitly to evaluate the quality of assessment and how it leads to program improvement. The rubric contains six general assessment areas, which are further broken down into 14 elements. Embedded within…

Leveraging Competency Framework to Improve Teaching and Learning: A Methodological Approach

ERIC Educational Resources Information Center

Shankararaman, Venky; Ducrot, Joelle

2016-01-01

A number of engineering education programs have defined learning outcomes and course-level competencies, and conducted assessments at the program level to determine areas for continuous improvement. However, many of these programs have not implemented a comprehensive competency framework to support the actual delivery and assessment of an…

Using a Quasi-Experimental Research Design to Assess Knowledge in Continuing Medical Education Programs

ERIC Educational Resources Information Center

Markert, Ronald J.; O'Neill, Sally C.; Bhatia, Subhash C.

2003-01-01

Introduction: The objectives of continuing medical education (CME) programs include knowledge acquisition, skill development, clinical reasoning and decision making, and health care outcomes. We conducted a yearlong medical education research study in which knowledge acquisition in our CME programs was assessed. Method: A randomized…

Research-Doctorate Programs in the Biomedical Sciences: Selected Findings from the NRC Assessment

ERIC Educational Resources Information Center

Lorden, Joan F., Ed.; Kuh, Charlotte V., Ed.; Voytuk, James A., Ed.

2011-01-01

"Research Doctorate Programs in the Biomedical Sciences: Selected Findings from the NRC Assessment" examines data on the biomedical sciences programs to gather additional insight about the talent, training environment, outcomes, diversity, and international participation in the biomedical sciences workforce. This report supports an…

Assessment Program Technical Progress Report, 1997-1998.

ERIC Educational Resources Information Center

Eickmeyer, Barbara; Hill, Stephen

This Assessment Program Progress Report (APPR) records the institutional activities that have taken place at Coconino Community College (CCC) during the 1997-98 academic year. It presents models, timelines, accomplishments, and opportunities for improvement in the assessment practices at CCC. Implementation and outcomes information is included for…

Using a Scoring Rubric to Assess the Writing of Bioethics Students.

PubMed

Stoddard, Hugh A; Labrecque, Cory A; Schonfeld, Toby

2016-04-01

Educators in bioethics have struggled to find valid and reliable assessments that transcend the "reproduction of knowledge" to target more important skill sets. This manuscript reports on the process of developing and grading a minimal-competence comprehensive examination in a bioethics master's degree program. We describe educational theory and practice for the creation and deployment of scoring rubrics for high-stakes performance assessments that reduce scoring inconsistencies. The rubric development process can also benefit the program by building consensus among stakeholders regarding program goals and student outcomes. We describe the Structure of the Observed Learning Outcome taxonomy as a mechanism for rubric design and provide an example of how we applied that taxonomy to define pass/fail cut scores. Details about domains of assessment and writing descriptors of performance are also presented. Despite the laborious work required to create a scoring rubric, we found the effort to be worthwhile for our program.

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

ERIC Educational Resources Information Center

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

Student Development in an Experiential Learning Program

ERIC Educational Resources Information Center

Gilbert, Brandi L.; Banks, Julianna; Houser, John H. W.; Rhodes, Simon J.; Lees, N. Douglas

2014-01-01

This study is an outcomes assessment of an experiential learning program for undergraduate students interested in life and health sciences careers enrolled at a public urban research institution. The year-long research and professional experience internships were projected to improve learning outcomes in undergraduates. The study included an…

Is More Always Better in Designing Workplace Wellness Programs?: A Comparison of Wellness Program Components Versus Outcomes.

PubMed

Batorsky, Benjamin; Van Stolk, Christian; Liu, Hangsheng

2016-10-01

Assess whether adding more components to a workplace wellness program is associated with better outcomes by measuring the relationship of program components to one another and to employee participation and perceptions of program effectiveness. Data came from a 2014 survey of 24,393 employees of 81 employers about services offered, leadership, incentives, and promotion. Logistic regressions were used to model the relationship between program characteristics and outcomes. Components individually are related to better outcomes, but this relationship is weaker in the presence of other components and non-significant for incentives. Within components, a moderate level of services and work time participation opportunities are associated with higher participation and effectiveness. The "more of everything" approach does not appear to be advisable for all programs. Programs should focus on providing ample opportunities for employees to participate and initiatives like results-based incentives.

Blending Assessment into Instruction: Practical Applications and Meaningful Results

ERIC Educational Resources Information Center

Wright, Michael T.; van der Mars, Hans

2004-01-01

Since engagement in physical activity is now identified as an important outcome for students, teachers need to assess their students in ways that measure that behavior. Assessment serves many purposes in an educational setting. It can provide feedback, drive instructional needs, and evaluate outcomes of both students and programs. If done…

Posttreatment attrition and its predictors, attrition bias, and treatment efficacy of the anxiety online programs.

PubMed

Al-Asadi, Ali M; Klein, Britt; Meyer, Denny

2014-10-14

Although relatively new, the field of e-mental health is becoming more popular with more attention given to researching its various aspects. However, there are many areas that still need further research, especially identifying attrition predictors at various phases of assessment and treatment delivery. The present study identified the predictors of posttreatment assessment completers based on 24 pre- and posttreatment demographic and personal variables and 1 treatment variable, their impact on attrition bias, and the efficacy of the 5 fully automated self-help anxiety treatment programs for generalized anxiety disorder (GAD), social anxiety disorder (SAD), panic disorder with or without agoraphobia (PD/A), obsessive-compulsive disorder (OCD), and posttraumatic stress disorder (PTSD). A complex algorithm was used to diagnose participants' mental disorders based on the criteria of the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition, Text Revision; DSM-IV-TR). Those who received a primary or secondary diagnosis of 1 of 5 anxiety disorders were offered an online 12-week disorder-specific treatment program. A total of 3199 individuals did not formally drop out of the 12-week treatment cycle, whereas 142 individuals formally dropped out. However, only 347 participants who completed their treatment cycle also completed the posttreatment assessment measures. Based on these measures, predictors of attrition were identified and attrition bias was examined. The efficacy of the 5 treatment programs was assessed based on anxiety-specific severity scores and 5 additional treatment outcome measures. On average, completers of posttreatment assessment measures were more likely to be seeking self-help online programs; have heard about the program from traditional media or from family and friends; were receiving mental health assistance; were more likely to learn best by reading, hearing and doing; had a lower pretreatment Kessler-6 total score; and were older in age. Predicted probabilities resulting from these attrition variables displayed no significant attrition bias using Heckman's method and thus allowing for the use of completer analysis. Six treatment outcome measures (Kessler-6 total score, number of diagnosed disorders, self-confidence in managing mental health issues, quality of life, and the corresponding pre- and posttreatment severity for each program-specific anxiety disorder and for major depressive episode) were used to assess the efficacy of the 5 anxiety treatment programs. Repeated measures MANOVA revealed a significant multivariate time effect for all treatment outcome measures for each treatment program. Follow-up repeated measures ANOVAs revealed significant improvements on all 6 treatment outcome measures for GAD and PTSD, 5 treatment outcome measures were significant for SAD and PD/A, and 4 treatment outcome measures were significant for OCD. Results identified predictors of posttreatment assessment completers and provided further support for the efficacy of self-help online treatment programs for the 5 anxiety disorders. Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).

The measurement of outcomes in the assessment of educational program effectiveness.

PubMed

Kassebaum, D G

1990-05-01

Postsecondary accrediting agencies recognized by the U.S. Secretary of Education and the Council on Postsecondary Accreditation, including the Liaison Committee on Medical Education (LCME), are required to evaluate educational program effectiveness by determining that institutions and programs document the achievement of their students and graduates in verifiable and consistent ways, indicating that institutional and program purposes are met. For the assessment of medical education programs this represents a departure from the traditional method of inferring quality from institutional compliance with standards for program organization and function. In the new assessment calculus, success is measured as the integrated product of the outcomes, the indicators of achievement that medical schools already are collecting from many sources, for instance, data on premedical achievement and attributes, medical school performance, graduate education ratings and test results, specialty certification, licensure, and practice. Although a recent LCME enquiry showed that 80% of U.S. medical schools were collecting outcome data on students and graduates, there was a lack of coherence and system, little integrated analysis, rare longitudinal study, and limited use of the information to evaluate and revise the curriculum or to validate admissions, promotion, and graduation criteria. The longitudinal study of the quantified results of educational programs need not resurrect old controversies about the linkage between learning in medical school and the quality of doctors' later practice. The purpose of examining outcomes is to gain sharper focus on the achievement of distinctive institutional goals, to facilitate program improvement and renewal, and to better assure the competence of graduates within the boundaries of achievement that schools have drawn as their educational objectives.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Cancer-related fatigue management: evaluation of a patient education program with a large-scale randomised controlled trial, the PEPs fatigue study.

PubMed

Bourmaud, A; Anota, A; Moncharmont, C; Tinquaut, F; Oriol, M; Trillet-Lenoir, V; Bajard, A; Parnalland, S; Rotonda, C; Bonnetain, F; Pérol, D; Chauvin, F

2017-03-28

To assess the efficacy of a patient educational program built according to guidelines that aims at reducing cancer-related fatigue (CRF). Randomised controlled trial, multicentre, comparing a patient education program, vs the standard of care. Patients were adult cancer outpatients with any tumour site. The primary outcome was fatigue severity assessed with a visual analogical scale (VAS), between the day of randomisation and week 7. Secondary outcomes were fatigue assessed with other scales, health-related quality of life, anxiety and depression. The time to fatigue severity deterioration was assessed. Analyses were performed in a modified intent-to-treat way, that is, including all patients with at least one baseline and 1 week 7 score. A total of 212 patients were included. Fatigue severity assessment was made on 79 patients in the experimental group and 65 in the control group. Between randomisation and week 7, the fatigue (VAS) improved by 0.96 (2.85) points in the experimental group vs 1.63 (2.63) points in the control group (P=0.15). No differences with the secondary outcomes were highlighted between two groups. No other factors were found to be associated with fatigue severity deterioration. Despite rigorous methodology, this study failed to highlight the program efficacy in fatigue reduction for cancer patients. Other assessment tools should be developed to measure the effect of the program on CRF and behaviour. The implementation of the program should also be explored in order to identify its mechanisms and longer-term impact.

Cancer-related fatigue management: evaluation of a patient education program with a large-scale randomised controlled trial, the PEPs fatigue study

PubMed Central

Bourmaud, A; Anota, A; Moncharmont, C; Tinquaut, F; Oriol, M; Trillet-Lenoir, V; Bajard, A; Parnalland, S; Rotonda, C; Bonnetain, F; Pérol, D; Chauvin, F

2017-01-01

Background: To assess the efficacy of a patient educational program built according to guidelines that aims at reducing cancer-related fatigue (CRF). Methods: Randomised controlled trial, multicentre, comparing a patient education program, vs the standard of care. Patients were adult cancer outpatients with any tumour site. The primary outcome was fatigue severity assessed with a visual analogical scale (VAS), between the day of randomisation and week 7. Secondary outcomes were fatigue assessed with other scales, health-related quality of life, anxiety and depression. The time to fatigue severity deterioration was assessed. Analyses were performed in a modified intent-to-treat way, that is, including all patients with at least one baseline and 1 week 7 score. Results: A total of 212 patients were included. Fatigue severity assessment was made on 79 patients in the experimental group and 65 in the control group. Between randomisation and week 7, the fatigue (VAS) improved by 0.96 (2.85) points in the experimental group vs 1.63 (2.63) points in the control group (P=0.15). No differences with the secondary outcomes were highlighted between two groups. No other factors were found to be associated with fatigue severity deterioration. Conclusions: Despite rigorous methodology, this study failed to highlight the program efficacy in fatigue reduction for cancer patients. Other assessment tools should be developed to measure the effect of the program on CRF and behaviour. The implementation of the program should also be explored in order to identify its mechanisms and longer-term impact. PMID:28196066

Strategies for Increasing Faculty Involvement in Institutional or Program Assessment

ERIC Educational Resources Information Center

Caudle, LeAnn; Hammons, James O.

2018-01-01

This narrative research study was conducted to explore the experiences of full-time community college faculty members involved in student learning outcomes assessment. Prior research documented the need for more community college faculty involvement with assessment at the program and institutional levels (Grunwald & Peterson, 2003; Kinzie,…

Assessing a Faculty Development Program in a Changing Environment

ERIC Educational Resources Information Center

Lockhart, Marilyn S.; Stoop, Chatanika

2018-01-01

The environment in which faculty development centers operate has changed significantly. As a result, centers are asked to play a more important role in contributing to institutional strategic initiatives, assess outcomes of programs, and enhance faculty scholarship success. In the past, assessments have focused on attendance and satisfaction…

Assessing faculty integration of adult learning needs in second-degree nursing education.

PubMed

Robert, Tracey E; Pomarico, Carole A; Nolan, Mary

2011-01-01

The limited research data available on effective teaching strategies for accelerated baccalaureate nursing programs has generated interest in identifying and assessing successful teaching tools and strategies in current programs. Most data have been anecdotal and have not emphasized the effectiveness of accelerated programs. This study used a qualitative research design to determine the effectiveness of an integrative learning model in improving nursing student outcomes of second-degree students. Overall data from focus groups in the beginning and end of the study indicated that the use focus groups enhanced the learning process and outcomes.

Learning Skills Profiles of master's students in nursing administration: assessing the impact of problem-based learning.

PubMed

Baker, Constance M; McDaniel, Anna M; Pesut, Daniel J; Fisher, Mary L

2007-01-01

Attempts to compare graduate student performances before and after introducing new curricula are rare; yet faculties need outcome measures to justify program costs and demonstrate effectiveness. Boyatzis and Kolb's Learning Skills Profile is used to assess the outcomes of a problem-based learning MSN program. Increases were demonstrated among all 12 learning skills; statistically significant increases were found in eight of the personal learning skills and six of the job skill demands. Comparisons are made between scores of students in the MSN program and scores of master's students in business administration.

Barriers to Implementing the ACGME Outcome Project: A Systematic Review of Program Director Surveys.

PubMed

Malik, Mohammad U; Diaz Voss Varela, David A; Stewart, Charles M; Laeeq, Kulsoom; Yenokyan, Gayane; Francis, Howard W; Bhatti, Nasir I

2012-12-01

The Accreditation Council for Graduate Medical Education (ACGME) introduced the Outcome Project in July 2001 to improve the quality of resident education through competency-based learning. The purpose of this systematic review is to determine and explore the perceptions of program directors regarding challenges to implementing the ACGME Outcome Project. We used the PubMed and Web of Science databases and bibliographies for English-language articles published between January 1, 2001, and February 17, 2012. Studies were included if they described program directors' opinions on (1) barriers encountered when attempting to implement ACGME competency-based education, and (2) assessment methods that each residency program was using to implement competency-based education. Articles meeting the inclusion criteria were screened by 2 researchers. The grading criterion was created by the authors and used to assess the quality of each study. The survey-based data reported the opinions of 1076 program directors. Barriers that were encountered include: (1) lack of time; (2) lack of faculty support; (3) resistance of residents to the Outcome Project; (4) insufficient funding; (5) perceived low priority for the Outcome Project; (6) inadequate salary incentive; and (7) inadequate knowledge of the competencies. Of the 6 competencies, those pertaining to patient care and medical knowledge received the most responses from program directors and were given highest priority. The reviewed literature revealed that time and financial constraints were the most important barriers encountered when implementing the ACGME Outcome Project.

Non-Traditional and Interdisciplinary Programs. Proceedings from the Annual Conference (6th, Virginia Beach, Virginia, April 25-27, 1988).

ERIC Educational Resources Information Center

Reithlingshoefer, Sally J., Ed.; Sanford, James F., Ed.

A total of 72 papers on nontraditional and interdisciplinary programs are presented in 11 tracks: (1) Assessing Learning Outcomes and Providing Quality in Non-Traditional Degree Programs (8 papers, including "Assessing the Quality of a Non-Traditional Degree Program: A Case Study," by Solomon Deressa and Mary Sue Simmons); (2) Consortial,…

K-12 Postsecondary Alignment and School Accountability: Investigating High School Responses to California's Early Assessment Program

ERIC Educational Resources Information Center

Jackson, Jacob; Kurlaender, Michal

2016-01-01

State K-12 assessments may soon include measures for college readiness, as California's already do. We seek to understand how California's Early Assessment Program (EAP, designed to assess high school juniors' college readiness in English and math) may have influenced overall school-level college readiness and state accountability outcomes. Using…

Using social-emotional and character development to improve academic outcomes: a matched-pair, cluster-randomized controlled trial in low-income, urban schools

PubMed Central

Lewis, Kendra M.; DuBois, David L.; Acock, Alan; Vuchinich, Samuel; Silverthorn, Naida; Snyder, Frank J.; Day, Joseph; Ji, Peter; Flay, Brian R.

2013-01-01

BACKGROUND School-based social-emotional and character development (SECD) programs can influence not only SECD, but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. METHODS The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. RESULTS PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. CONCLUSIONS A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes. PMID:24138347

Using social-emotional and character development to improve academic outcomes: a matched-pair, cluster-randomized controlled trial in low-income, urban schools.

PubMed

Bavarian, Niloofar; Lewis, Kendra M; Dubois, David L; Acock, Alan; Vuchinich, Samuel; Silverthorn, Naida; Snyder, Frank J; Day, Joseph; Ji, Peter; Flay, Brian R

2013-11-01

School-based social-emotional and character development (SECD) programs can influence not only SECD but also academic-related outcomes. This study evaluated the impact of one SECD program, Positive Action (PA), on educational outcomes among low-income, urban youth. The longitudinal study used a matched-pair, cluster-randomized controlled design. Student-reported disaffection with learning and academic grades, and teacher ratings of academic ability and motivation were assessed for a cohort followed from grades 3 to 8. Aggregate school records were used to assess standardized test performance (for entire school, cohort, and demographic subgroups) and absenteeism (entire school). Multilevel growth-curve analyses tested program effects. PA significantly improved growth in academic motivation and mitigated disaffection with learning. There was a positive impact of PA on absenteeism and marginally significant impact on math performance of all students. There were favorable program effects on reading for African American boys and cohort students transitioning between grades 7 and 8, and on math for girls and low-income students. A school-based SECD program was found to influence academic outcomes among students living in low-income, urban communities. Future research should examine mechanisms by which changes in SECD influence changes in academic outcomes. © 2013, American School Health Association.

Time to rethink the role of the library in educating doctors: driving information literacy in the clinical environment

PubMed Central

Simons, Mary R.; Morgan, Michael Kerin; Davidson, Andrew Stewart

2012-01-01

Question: Can information literacy (IL) be embedded into the curriculum and clinical environment to facilitate patient care and lifelong learning? Setting: The Australian School of Advanced Medicine (ASAM) provides competence-based programs incorporating patient-centred care and lifelong learning. ASAM librarians use outcomes-based educational theory to embed and assess IL into ASAM's educational and clinical environments. Methods: A competence-based IL program was developed where learning outcomes were linked to current patients and assessed with checklists. Weekly case presentations included clinicians' literature search strategies, results, and conclusions. Librarians provided support to clinicians' literature searches and assessed their presentations using a checklist. Main Results: Outcome data showed clinicians' searching skills improved over time; however, advanced MEDLINE searching remained challenging for some. Recommendations are provided. Conclusion: IL learning that takes place in context using measurable outcomes is more meaningful, is enduring, and likely contributes to patient care. Competence-based assessment drives learning in this environment. PMID:23133329

The Assessment of Doctoral Education: Emerging Criteria and New Models for Improving Outcomes

ERIC Educational Resources Information Center

Maki, Peggy L., Ed.; Borkowski, Nancy A., Ed.

2006-01-01

Following the growing commitment to assessment at the undergraduate level, doctoral programs are now grappling with what accountability means for them. This book provides a foundation for faculty and academic leaders of doctoral programs to promote inquiry into the educational practices that define their programs and contribute to graduate…

A Study on the Effectiveness of a Pilot Inquiry-Based Middle School Science Program on Non-Cognitive Outcomes and Academic Achievement

ERIC Educational Resources Information Center

Dionisio, Rui Meira

2017-01-01

The randomized research study assessed the effect of an inquiry-based science (IBS) program on non-cognitive outcomes and academic achievement. The study was the result of a grant that was awarded by Professional Resources in Science and Mathematics (PRISM), a program affiliated with Montclair State University in conjunction with Bristol-Myers…

Evaluation of the 'Fitting to Outcomes eXpert' (FOX®) with established cochlear implant users.

PubMed

Buechner, Andreas; Vaerenberg, Bart; Gazibegovic, Dzemal; Brendel, Martina; De Ceulaer, Geert; Govaerts, Paul; Lenarz, Thomas

2015-01-01

To evaluate the possible impact of 'Fitting to Outcomes eXpert (FOX(®))' on cochlear implant (CI) fitting in a clinic with extensive experience of fitting a range of CI systems, as a way to assess whether a software tool such as FOX is able to complement standard clinical procedures. Ten adult post-lingually deafened and unilateral long-term users of the Advanced Bionics(TM) CI system (Clarion CII or HiRes 90K(TM)) underwent speech perception assessment with their current clinical program. One cycle 'iteration' of FOX optimization was performed and the program adjusted accordingly. After a month of using both clinical and FOX programs, a second iteration of FOX optimization was performed. Following this, the assessments were repeated without further acclimatization. FOX prescribed programming modifications in all subjects. Soundfield-aided thresholds were significantly lower for FOX than the clinical program. Group speech scores in noise were not significantly different between the two programs but three individual subjects had improved speech scores with the FOX MAP, two had worse speech scores, and five were the same. FOX provided a standardized approach to fitting based on outcome measures rather than comfort alone. The results indicated that for this group of well-fitted patients, FOX improved outcomes in some individuals. There were significant changes, both better and worse, in individual speech perception scores but median scores remained unchanged. Soundfield-aided thresholds were significantly improved for the FOX group.

The Role of Twelve-Step-Related Spirituality in Addiction Recovery.

PubMed

Dermatis, Helen; Galanter, Marc

2016-04-01

This paper reviews empirical studies conducted on the role of spirituality and religiosity (S/R) characteristics in 12-step recovery among program members followed up after substance abuse treatment and those assessed independent of formal treatment. Aspects of spiritual functioning that change in relation to program participation and those S/R characteristics that were found to mediate the association between program involvement and drinking-related outcomes are discussed. In addition, a review is provided of 12-step program studies investigating S/R-related predictors of clinical outcomes relevant to risk of relapse among members in long-term recovery. To further examine the role of S/R characteristics in recovery, a study was conducted on long-term AA members to assess the relationship of S/R characteristics and AA program involvement to craving for alcohol and emotional distress after controlling for relevant demographic variables. Feeling God's presence daily, believing in a higher power as a universal spirit, and serving as an AA sponsor were all predictive of positive outcomes.

Patient assessment of diabetes care in a pay-for-performance program.

PubMed

Chiu, Herng-Chia; Hsieh, Hui-Min; Lin, Yi-Chieh; Kuo, Shou-Jen; Kao, Hao-Yun; Yeh, Shu-Chuan Jennifer; Chang, Wen-Hsin; Hsiao, Pi-Jung; Chen, Yao-Shen; Lin, Shoei-Loong; Lo, Gin-Ho; Ker, Chen-Guo; Hung, Yu-Han; Cheng, Hsien-An; Chou, Tiang-Hong; Chou, Sze-Yuan; Wang, Jao-Hsien; Wang, Chien-Fu

2016-04-01

Few studies address quality of care in pay-for-performance (P4P) programs from the perspective of patients' perceptions. This study aimed to examine and compare the patient assessment of diabetes chronic care as perceived by diabetic patients enrolled and not enrolled in a P4P program from the patients' self-reported perspectives. A cross-sectional study with case and comparison group design. A large-scale survey was conducted from February to November 2013 in 18 healthcare institutions in Taiwan. A total of 1458 P4P (n = 1037) and non-P4P (n = 421) diabetic patients participated in this large survey. The Chinese version of the Patient Assessment of Chronic Illness Care (PACIC) instrument was used and patients' clinical outcome data (e.g. HbA1c, LDL) were collected. None. Five subscales from the PACIC were measured, including patient activation, delivery system design/system support, goal setting/tailoring, problem solving/contextual and follow-up/coordination. Patient clinical outcomes were also measured. Multiple linear regression and logistic regression models were used and controlled for patient demographic and health institution characteristics statistically. After adjusting for covariates, P4P patients had higher overall scores on the PACIC and five subscales than non-P4P patients. P4P patients also had better clinical processes of care (e.g. HbA1c test) and intermediate outcomes. Patients who participated in the program likely received better patient-centered care given the original Chronic Care Model. Better perceptions of diabetic care assessment also better clinical outcomes. The PACIC instrument can be used for the patient assessment of chronic care in a P4P program. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

Kentucky's Early Childhood Continuous Assessment and Accountability System: Local Decisions and State Supports

ERIC Educational Resources Information Center

Rous, Beth; McCormick, Katherine; Gooden, Caroline; Townley, Kim F.

2007-01-01

Kentucky has developed an assessment and accountability system that provides outcome data for a set of state early childhood standards for children birth to 5 years of age that are aligned with early childhood outcomes designated by the Office of Special Education Programs (OSEP). Within this flexible and comprehensive state assessment system,…

Evaluating the Impact of the U.S. National Toxicology Program: A Case Study on Hexavalent Chromium

PubMed Central

Xie, Yun; Holmgren, Stephanie; Andrews, Danica M. K.; Wolfe, Mary S.

2016-01-01

Background: Evaluating the impact of federally funded research with a broad, methodical, and objective approach is important to ensure that public funds advance the mission of federal agencies. Objectives: We aimed to develop a methodical approach that would yield a broad assessment of National Toxicology Program’s (NTP’s) effectiveness across multiple sectors and demonstrate the utility of the approach through a case study. Methods: A conceptual model was developed with defined activities, outputs (products), and outcomes (proximal, intermediate, distal) and applied retrospectively to NTP’s research on hexavalent chromium (CrVI). Proximal outcomes were measured by counting views of and requests for NTP’s products by external stakeholders. Intermediate outcomes were measured by bibliometric analysis. Distal outcomes were assessed through Web and LexisNexis searches for documents related to legislation or regulation changes. Results: The approach identified awareness of NTP’s work on CrVI by external stakeholders (proximal outcome) and citations of NTP’s research in scientific publications, reports, congressional testimonies, and legal and policy documents (intermediate outcome). NTP’s research was key to the nation’s first-ever drinking water standard for CrVI adopted by California in 2014 (distal outcome). By applying this approach to a case study, the utility and limitations of the approach were identified, including challenges to evaluating the outcomes of a research program. Conclusions: This study identified a broad and objective approach for assessing NTP’s effectiveness, including methodological needs for more thorough and efficient impact assessments in the future. Citation: Xie Y, Holmgren S, Andrews DMK, Wolfe MS. 2017. Evaluating the impact of the U.S. National Toxicology Program: a case study on hexavalent chromium. Environ Health Perspect 125:181–188; http://dx.doi.org/10.1289/EHP21 PMID:27483499

Long-Term Outcomes of a Dental Postbaccalaureate Program: Increasing Dental Student Diversity and Oral Health Care Access

PubMed Central

Wides, Cynthia D.; Brody, Harvey A.; Alexander, Charles J.; Gansky, Stuart A.; Mertz, Elizabeth A.

2013-01-01

The University of California, San Francisco School of Dentistry established the Dental Postbaccalaureate Program in 1998 to provide reapplication assistance to students from economically and/or educationally disadvantaged backgrounds who were previously denied admission to dental school. The goals were to increase diversity in the dental school student population and improve access to dental services for underserved populations. This article assesses the program’s short-, mid-, and long-term outcomes and is the first to examine long-term practice patterns after a dental postbaccalaureate program. Data collected on all participant (n=94) demographics, pre/post-program DAT scores, and post-program dental school admission results were used to assess short- and mid-term outcomes. Long-term outcomes and practice patterns were assessed using results of a census survey administered between 2009 and 2011 to the participants who had completed dental school and been in practice for at least two years (n=57). The survey had a response rate of 93 percent (n=53). Descriptive statistical techniques were used to examine the responses and to compare them to U.S. Census Bureau data and nationally available practice data for new dental graduates. Program participants’ DAT scores improved by an average of two points, and 98 percent were accepted to dental school. All survey respondents were practicing dentistry, and 81 percent reported serving underserved populations. These participants treat more Medicaid recipients than do most dentists, and their patient population is more diverse than the general population. The outcomes demonstrate that the program’s graduates are increasing diversity in the dental student population and that their practices are providing access to care for underserved populations. PMID:23658398

A Review of Hazard Anticipation Training Programs for Young Drivers

PubMed Central

McDonald, Catherine C.; Goodwin, Arthur H.; Pradhan, Anuj K.; Romoser, Matthew R.E.; Williams, Allan F.

2015-01-01

Purpose Poor hazard anticipation skills are a risk factor associated with high motor vehicle crash rates of young drivers. A number of programs have been developed to improve these skills. The purpose of this review was to assess the empirical literature on hazard anticipation training for young drivers. Methods Studies were included if they: 1) included an assessment of hazard anticipation training outcomes; 2) were published between January 1, 1980 and December 31, 2013 in an English language peer-reviewed journal or conference proceeding; and 3) included at least one group that uniquely comprised a cohort of participants <21 years. Nineteen studies met inclusion criteria. Results Studies used a variety of training methods including interactive computer programs, videos, simulation, commentary driving, or a combination of approaches. Training effects were predominantly measured through computer-based testing and driving simulation with eye tracking. Four studies included an on-road evaluation. Most studies evaluated short-term outcomes (immediate or few days). In all studies, young drivers showed improvement in selected hazard anticipation outcomes, but none investigated crash effects. Conclusions Although there is promise in existing programs, future research should include long-term follow up, evaluate crash outcomes, and assess the optimal timing of hazard anticipation training taking into account the age and experience level of young drivers. PMID:26112734

Maintenance of a smoking cessation program in public health clinics beyond the experimental evaluation period.

PubMed Central

Manfredi, C.; Crittenden, K.; Cho, Y. I.; Engler, J.; Warnecke, R.

2001-01-01

OBJECTIVES: As phase 3 of a study to evaluate a smoking cessation program in public health practice, the authors assess the maintenance and impact of the It's Time smoking cessation program in seven public maternal and child health clinics in Chicago. METHODS: The authors interviewed 404 clinic patients in the study's baseline phase (prior to introduction of the It's Time intervention program), and 610 in the program maintenance phase (in the year after experimental evaluation had ended) to assess exposure to smoking cessation interventions offered at the clinic, and smoking cessation outcomes (quit, actions toward quitting, scores on action, motivation, readiness, and confidence scales). The authors controlled for clustering of smokers within clinics, smokers' characteristics prior to clinic visit, and type of clinic service. They compared outcomes by study group (control or intervention) to which each clinic had been assigned in the earlier experimental phase. RESULTS: Compared to baseline, smokers in the maintenance phase had greater exposure to posters, provider advice and booklet, and better outcomes on seven of eight smoking cessation measures, including quitting. These improvements were larger for clinics with prior experience implementing It's Time. CONCLUSION: Participation in the experimental evaluation of the It's Time program prepared and possibly motivated the clinics to continue the program. Continuing the program resulted in greater delivery of interventions and improved smoking cessation outcomes for smokers in the clinics. PMID:11889280

A model to begin to use clinical outcomes in medical education.

PubMed

Haan, Constance K; Edwards, Fred H; Poole, Betty; Godley, Melissa; Genuardi, Frank J; Zenni, Elisa A

2008-06-01

The latest phase of the Accreditation Council for Graduate Medical Education (ACGME) Outcome Project challenges graduate medical education (GME) programs to select meaningful clinical quality indicators by which to measure trainee performance and progress, as well as to assess and improve educational effectiveness of programs. The authors describe efforts to measure educational quality, incorporating measurable patient-care outcomes to guide improvement. University of Florida College of Medicine-Jacksonville education leaders developed a tiered framework for selecting clinical indicators whose outcomes would illustrate integration of the ACGME competencies and their assessment with learning and clinical care. In order of preference, indicators selected should align with a specialty's (1) national benchmarked consensus standards, (2) national specialty society standards, (3) standards of local, institutional, or regional quality initiatives, or (4) top-priority diagnostic and/or therapeutic categories for the specialty, based on areas of high frequency, impact, or cost. All programs successfully applied the tiered process to clinical indicator selection and then identified data sources to track clinical outcomes. Using clinical outcomes in resident evaluation assesses the resident's performance as reflective of his or her participation in the health care delivery team. Programmatic improvements are driven by clinical outcomes that are shown to be below benchmark across the residents. Selecting appropriate clinical indicators-representative of quality of care and of graduate medical education-is the first step toward tracking educational outcomes using clinical data as the basis for evaluation and improvement. This effort is an important aspect of orienting trainees to using data for monitoring and improving care processes and outcomes throughout their careers.

Assessment Methodology in Technical Courses

ERIC Educational Resources Information Center

Fogle, Ty; Insabella, Mary

2004-01-01

Columbus State Community College is committed to assessment (measurement) of student achievement of academic outcomes. This process addresses the issues of what each student needs to learn in his or her program of study and if each student is learning what they need to learn. The assessment program at Columbus State Community College has four…

Employing continuous quality improvement in community-based substance abuse programs.

PubMed

Chinman, Matthew; Hunter, Sarah B; Ebener, Patricia

2012-01-01

This article aims to describe continuous quality improvement (CQI) for substance abuse prevention and treatment programs in a community-based organization setting. CQI (e.g., plan-do-study-act cycles (PDSA)) applied in healthcare and industry was adapted for substance abuse prevention and treatment programs in a community setting. The authors assessed the resources needed, acceptability and CQI feasibility for ten programs by evaluating CQI training workshops with program staff and a series of three qualitative interviews over a nine-month implementation period with program participants. The CQI activities, PDSA cycle progress, effort, enthusiasm, benefits and challenges were examined. Results indicated that CQI was feasible and acceptable for community-based substance abuse prevention and treatment programs; however, some notable resource challenges remain. Future studies should examine CQI impact on service quality and intended program outcomes. The study was conducted on a small number of programs. It did not assess CQI impact on service quality and intended program outcomes. Practical implications- This project shows that it is feasible to adapt CQI techniques and processes for community-based programs substance abuse prevention and treatment programs. These techniques may help community-based program managers to improve service quality and achieve program outcomes. This is one of the first studies to adapt traditional CQI techniques for community-based settings delivering substance abuse prevention and treatment programs.

Successful Community Nutrition Programming: Lessons from Kenya, Tanzania, and Uganda.

ERIC Educational Resources Information Center

Iannotti, Lora; Gillespie, Stuart

This report on the key findings from a series of assessments of successful community nutrition programming conducted in Kenya, Tanzania, and Uganda between 1999 and 2000. The aim of the assessments was to identify key lessons learned from the successful processes and outcomes in these programs. The report is divided into eight chapters: (1)…

Designing Higher Education Curriculum to Increase Graduate Outcomes and Work Readiness: The Assessment and Mentoring Program (AMP)

ERIC Educational Resources Information Center

Jenkinson, Kate A.; Benson, Amanda C.

2016-01-01

Pre-service teacher programs have a responsibility to equip graduating students with more than the minimum skill sets required by governing bodies. The Assessment and Mentoring Program (AMP) is a four-way collaborative mentoring learning community underpinned by social constructivism. Conducted in Victoria, Australia during the 2014-2016 academic…

Curriculum Mapping: A Before-and-After Look at Faculty Perceptions of Their Courses and the Mapping Process

ERIC Educational Resources Information Center

Joyner, Helen S.

2016-01-01

The increased interest in program- and university-level assessment over the past few decades has led to increased faculty involvement in developing program learning outcomes and performing program assessment activities. Depending on the level of support and encouragement faculty receive from administration and other entities, they may support or…

Faculty and Career Advising: Challenges, Opportunities, and Outcome Assessment

ERIC Educational Resources Information Center

Vespia, Kristin M.; Freis, Stephanie D.; Arrowood, Rebecca M.

2018-01-01

Psychology prioritizes students' professional or career development by including it as one of the five undergraduate learning goals. Faculty advisors are critical to that development but likely feel less prepared for the role. Departments face challenges assessing associated student learning outcomes. We introduce an instrument programs can use to…

76 FR 45271 - Review and Qualification of Clinical Outcome Assessments; Public Workshop

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-28

... announcing a public workshop to discuss measurement principles for clinical outcome assessments (COAs) for... appropriate drug development program. Because the qualification process is separate from the drug marketing... other DDTs. This workshop will focus on FDA review principles specific to all type of COAs, i.e., PRO...

Opportunity Realized: Undergraduate Education within Departments of Communication.

ERIC Educational Resources Information Center

Miller, Dan P.; Kernisky, Debra A.

1999-01-01

Offers three models for educating future public-relations practitioners from a communication point of view: a macro-approach that integrates outcomes, curriculum, pedagogy and assessment at the program level; a micro-approach that adds specifics of outcomes, pedagogy, and assessment strategies for each of five core course-content areas; and a…

Eating disorders in individuals with type 1 diabetes: case series and day hospital treatment outcome.

PubMed

Colton, Patricia Anne; Olmsted, Marion Patricia; Wong, Harmonie; Rodin, Gary Michael

2015-07-01

Women with type 1 diabetes are at high risk for eating disorders (ED), a combination that can increase medical complications and mortality. As little is known about treatment response in this population, clinical presentation and treatment outcome in an extended case series were assessed. A chart review at the Eating Disorders Day Hospital Program at Toronto General Hospital identified a total of 100 individuals with type 1 diabetes assessed 1990-2012. Of 37 who attended day hospital, most experienced improvement in ED symptoms, but only 18.8% had a good immediate treatment outcome, while 43.8% had an intermediate outcome and 37.5% had a poor outcome (meeting diagnostic criteria at discharge). This is poorer than program outcomes in individuals without diabetes (χ(2)  = 12.2, df = 2; p = 0.002). Factors influencing treatment engagement and outcome must be further studied and used to improve treatment results in this high-risk group. Copyright © 2015 John Wiley & Sons, Ltd and Eating Disorders Association.

A new approach to assess student perceptions of gains from an REU program

NASA Astrophysics Data System (ADS)

Houser, C.; Cahill, A. T.; Lemmons, K.

2013-12-01

Research Experience for Undergraduate (REU) programs are designed to recruit students to science and engineering research careers by allowing the students to conduct research with faculty mentors. The success of REU programs is commonly assessed based on student perceptions of gains using a simple Likert scale. Because students tend to be positive about all aspects of their research experience, the results of the Likert scale tend to be meaningless. An alternative assessment technique, similar to Q-analysis, is used to assess the perceived outcomes of an international REU program hosted by Texas A&M University. Students were required to sort commonly identified REU outcomes into a normal distribution, from most agree to least agree, based on what they perceive as their personal gains from the program. Factor analysis reveals 3 groups of students who believe that they gained field and analytical skills (Group 1), greater competence in research and self-confidence (Group 2), and an improved understanding of the scientific method (Group 3). Student perceptions appear to depend on whether the student had previous research experience through classes and/or as a research assistant at their home institution. A comparison to a similar sort of REU outcomes by the faculty mentors suggests that there is a slight disconnect in the perceived gains by the students between the student participants and the faculty mentors.

Aligning Assessments for COSMA Accreditation

ERIC Educational Resources Information Center

Laird, Curt; Johnson, Dennis A.; Alderman, Heather

2015-01-01

Many higher education sport management programs are currently in the process of seeking accreditation from the Commission on Sport Management Accreditation (COSMA). This article provides a best-practice method for aligning student learning outcomes with a sport management program's mission and goals. Formative and summative assessment procedures…

Supporting Intrapersonal Development in Substance Use Disorder Programs: A Conceptual Framework for Client Assessment.

PubMed

Turpin, Aaron; Shier, Micheal L

2017-01-01

Improvements to intrapersonal development of clients involved with substance use disorder treatment programs has widely been recognized as contributing to the intended goal of reducing substance misuse behaviors. This study sought to identify a broad framework of primary outcomes related to the intrapersonal development of clients in treatment for substance misuse. Using qualitative research methods, individual interviews were conducted with program participants (n = 41) at three treatment programs to identify the ways in which respondents experienced intrapersonal development through participation in treatment. The findings support the development of a conceptual model that captures the importance and manifestation of achieving improvements in the following outcomes: self-awareness, coping ability, self-worth, outlook, and self-determination. The findings provide a conceptual framework for client assessment that captures a broad range of the important intrapersonal development factors utilized as indicators for client development and recovery that should be measured in tandem during assessment.

A Complementary Measure of MIS Program Outcomes: Useful Insights from a Student Perspective

ERIC Educational Resources Information Center

Karsten, Rex; Roth, Roberta M.

2015-01-01

Assessing student learning is a critical element in today's higher education environment. Learning assurance programs seek to assess and improve the quality of student learning, and may employ both direct and indirect measures. In this paper, we describe a practical learning assurance assessment measure developed and used as a part of a broader…

Outcomes of a Peer Assessment/Feedback Training Program in an Undergraduate Sports Medicine Course

ERIC Educational Resources Information Center

Marty, Melissa Catherine

2010-01-01

Peer assessment/feedback is clearly occurring in athletic training education programs. However, it remains unclear whether students would improve their ability to assess their peers and provide corrective feedback if they received formal training in how to do so. The purpose of this study was to determine the following: (1) if a peer…

Toward a Capacity Framework for Useful Student Learning Outcomes Assessment in College Foreign Language Programs

ERIC Educational Resources Information Center

Davis, John McEwan

2016-01-01

The educational impacts of mandated assessment in U.S. colleges is part of a growing research agenda focused on how methodologies of program evaluation best enable educators to improve teaching and learning. Accordingly, research has tried to identify the key aspects of evaluation/assessment "capacity" in college language departments…

Multimethod Strategy for Assessing Program Fidelity: The National Evaluation of the Revised G.R.E.A.T. Program

ERIC Educational Resources Information Center

Esbensen, Finn-Aage; Matsuda, Kristy N.; Taylor, Terrance J.; Peterson, Dana

2011-01-01

This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

The Effect of Grouping and Program Type on Scholastic and Affective Outcomes in the Mawhiba Schools Partnership Initiative

ERIC Educational Resources Information Center

Batterjee, Adel A.

2016-01-01

Researchers have struggled for decades to determine whether ability grouping is helpful or harmful; however, study findings have been inconsistent. To assess the effect of grouping and program type on scholastic and affective outcomes, three grouping types (gifted separate-class enrichment, pull-out gifted enrichment, and no enrichment), three…

Outcomes Assessment in Postsecondary Occupational Programs: A Consortial Approach. Project Report.

ERIC Educational Resources Information Center

Winter, Gene M.; Fadale, LaVerna M.

The Two-Year College Development Center, in cooperation with the New York State Education Department and seven community colleges in the Mid-Hudson Region of New York State conducted a 2-year project to determine the outcomes of selected occupational technical programs and feasible ways to measure them. The project operated as a consortium with…

An Examination of the Relationship between Outcomes Assessment and Accreditation in Community College-Based Health Information Technology Programs

ERIC Educational Resources Information Center

Kyriakos, Margaret Helen Gallo

2009-01-01

This study compares the Commission on Accreditation for Health Informatics and Information Management Education (CAHIIM) Board of Commissioner and Panel of Accreditation Reviewer understanding of what constitutes student learning outcomes and an effective program evaluation plan with that of campus-based health information technology (HIT) program…

Long-Term Outcomes of the ATHENA (Athletes Targeting Healthy Exercise & Nutrition Alternatives) Program for Female High School Athletes

ERIC Educational Resources Information Center

Elliot, Diane L.; Goldberg, Linn; Moe, Esther L.; DeFrancesco, Carol A.; Durham, Melissa B.; McGinnis, Wendy; Lockwood, Chondra

2008-01-01

Adolescence and emerging adulthood are critical windows for establishing life-long behaviors. We assessed long-term outcomes of a prospective randomized harm reduction/health promotion program for female high school athletes. The intervention's immediate beneficial effects on diet pill use and unhealthy eating behaviors have been reported;…

Assessment of Undergraduate and Graduate Programs.

ERIC Educational Resources Information Center

Rybacki, Donald; Lattimore, Dan

1999-01-01

Uses data from a national survey and from the 1998 National Communication Association Summer Conference to examine how achievement is measured among public-relations students. Finds that few academic programs assess learning outcomes and used the results to enhance their students' educational experiences. Suggests that educators place too much…

Development and Validity Testing of the Worksite Health Index: An Assessment Tool to Help and Improve Korean Employees' Health-Related Outcome.

PubMed

Yun, Young Ho; Sim, Jin Ah; Lim, Ye Jin; Lim, Cheol Il; Kang, Sung-Choon; Kang, Joon-Ho; Park, Jun Dong; Noh, Dong Young

2016-06-01

The objective of this study was to develop the Worksite Health Index (WHI) and validate its psychometric properties. The development of the WHI questionnaire included item generation, item construction, and field testing. To assess the instrument's reliability and validity, we recruited 30 different Korean worksites. We developed the WHI questionnaire of 136 items categorized into five domains, namely Governance and Infrastructure, Need Assessment and Planning, Health Prevention and Promotion Program, Occupational Safety, and Monitoring and Feedback. All WHI domains demonstrated a high reliability with good internal consistency. The total WHI scores differentiated worksite groups effectively according to firm size. Each domain was associated significantly with employees' health status, absence, and financial outcome. The WHI can assess comprehensive worksite health programs. This tool is publicly available for addressing the growing need for worksite health programs.

Using the Program Sustainability Assessment Tool to Assess and Plan for Sustainability

PubMed Central

Mainor, Avia; Moreland-Russell, Sarah; Maier, Ryan C.; Brossart, Laura; Luke, Douglas A.

2014-01-01

Implementing and growing a public health program that benefits society takes considerable time and effort. To ensure that positive outcomes are maintained over time, program managers and stakeholders should plan and implement activities to build sustainability capacity within their programs. We describe a 3-part sustainability planning process that programs can follow to build their sustainability capacity. First, program staff and stakeholders take the Program Sustainability Assessment Tool to measure their program’s sustainability across 8 domains. Next, managers and stakeholders use results from the assessment to inform and prioritize sustainability action planning. Lastly, staff members implement the plan and keep track of progress toward their sustainability goals. Through this process, staff can more holistically address the internal and external challenges and pressures associated with sustaining a program. We include a case example of a chronic disease program that completed the Program Sustainability Assessment Tool and engaged in program sustainability planning. PMID:24456644

Technical Skill Attainment and Post-Program Outcomes: An Analysis of Pennsylvania Secondary Career and Technical Education Graduates

ERIC Educational Resources Information Center

Staklis, Sandra; Klein, Steven

2010-01-01

Since the mid-1990s, the Pennsylvania Department of Education (PDE) has required all students concentrating in career and technical education (CTE) programs to complete a standardized technical skill assessment at or near the end of their program. Results of technical skill assessments are used for a number of purposes, including recognizing…

Secondary and 2-Year Outcomes of a Sexual Assault Resistance Program for University Women

PubMed Central

Eliasziw, Misha; Hobden, Karen L.; Newby-Clark, Ian R.; Barata, Paula C.; Radtke, H. Lorraine; Thurston, Wilfreda E.

2017-01-01

We report the secondary outcomes and longevity of efficacy from a randomized controlled trial that evaluated a novel sexual assault resistance program designed for first-year women university students. Participants (N = 893) were randomly assigned to receive the Enhanced Assess, Acknowledge, Act (EAAA) program or a selection of brochures (control). Perception of personal risk, self-defense self-efficacy, and rape myth acceptance was assessed at baseline; 1-week postintervention; and 6-, 12-, 18-, and 24-month postrandomization. Risk detection was assessed at 1 week, 6 months, and 12 months. Sexual assault experience and knowledge of effective resistance strategies were assessed at all follow-ups. The EAAA program produced significant increases in women’s perception of personal risk, self-defense self-efficacy, and knowledge of effective (forceful verbal and physical) resistance strategies; the program also produced decreases in general rape myth acceptance and woman blaming over the entire 24-month follow-up period. Risk detection was significantly improved for the intervention group at post-test. The program significantly reduced the risk of completed and attempted rape, attempted coercion, and nonconsensual sexual contact over the entire follow-up period, yielding reductions between 30% and 64% at 2 years. The EAAA program produces long-lasting changes in secondary outcomes and in the incidence of sexual assault experienced by women students. Universities can reduce the harm and the negative health consequences that young women experience as a result of campus sexual assault by implementing this program. Online slides for instructors who want to use this article for teaching are available on PWQ’s website at http://journals.sagepub.com/page/pwq/suppl/index. PMID:29503496

Secondary and 2-Year Outcomes of a Sexual Assault Resistance Program for University Women.

PubMed

Senn, Charlene Y; Eliasziw, Misha; Hobden, Karen L; Newby-Clark, Ian R; Barata, Paula C; Radtke, H Lorraine; Thurston, Wilfreda E

2017-06-01

We report the secondary outcomes and longevity of efficacy from a randomized controlled trial that evaluated a novel sexual assault resistance program designed for first-year women university students. Participants ( N = 893) were randomly assigned to receive the Enhanced Assess, Acknowledge, Act (EAAA) program or a selection of brochures (control). Perception of personal risk, self-defense self-efficacy, and rape myth acceptance was assessed at baseline; 1-week postintervention; and 6-, 12-, 18-, and 24-month postrandomization. Risk detection was assessed at 1 week, 6 months, and 12 months. Sexual assault experience and knowledge of effective resistance strategies were assessed at all follow-ups. The EAAA program produced significant increases in women's perception of personal risk, self-defense self-efficacy, and knowledge of effective (forceful verbal and physical) resistance strategies; the program also produced decreases in general rape myth acceptance and woman blaming over the entire 24-month follow-up period. Risk detection was significantly improved for the intervention group at post-test. The program significantly reduced the risk of completed and attempted rape, attempted coercion, and nonconsensual sexual contact over the entire follow-up period, yielding reductions between 30% and 64% at 2 years. The EAAA program produces long-lasting changes in secondary outcomes and in the incidence of sexual assault experienced by women students. Universities can reduce the harm and the negative health consequences that young women experience as a result of campus sexual assault by implementing this program. Online slides for instructors who want to use this article for teaching are available on PWQ's website at http://journals.sagepub.com/page/pwq/suppl/index .

Retaining minorities in engineering: Assessment of a program prototype

NASA Astrophysics Data System (ADS)

Good, Jennifer Marie (Phillips)

Program assessment is an essential part of healthy program development. Assessment should include multiple considerations, dimensions, and outcomes that match the program's objectives. As a newly formed retention program, the Auburn University Minority Engineering Program, designed to help pre-engineering minority students make the transition into their freshman year of university studies, incorporated evaluation and assessment into all three components of the program (the interactive learning laboratory, critical-thinking workshops, and Sunday-evening tutorials) from the program's inception. If students successfully adapted to the university environment and the demands of the pre-engineering course of study, then retention of minority students in the College of Engineering should improve. Data were gathered on the students involved in the various program components. Students who entered the Minority Engineering Program were pre- and posttested on three standardized subtests (critical thinking, mathematics, and science reasoning) of the Collegiate Assessment of Academic Proficiency. The first-quarter grade-point averages of the students were also gathered to compare their grades to freshman students in previous quarters within the College of Engineering. Qualitative data were also gathered on this same group of students. An analysis of the data revealed that student achievement is affected by involvement in the Minority Engineering Program. Specifically, the first quarter grade point averages of students involved in the program exceeded those of their peers in earlier years of study prior to the program's existence. In addition, mathematics and science reasoning scores on standardized tests increased pre- to postintervention. Comments collected in journals and files also demonstrated use of critical-thinking and problem-solving skills employed by the students. Recommendations for alterations of the program were made based on the outcome of the program evaluation. Further suggestions for research in minority engineering program development and evaluation were also discussed.

Issues in Putting Outcome-Based Education into Practice at the District Level: A Panel Discussion.

ERIC Educational Resources Information Center

Norton, Deborah

This conference presentation describes the AUEN (Addressing Unique Education Needs) system of assessing educational outcomes which is used by the Rochester (Michigan) Community Schools to help establish accountable and effective special education support programs and services. The AUEN provides an innovative and practical approach to assessment,…

Creating an Outcomes-Based Tool for Learning Barrier Assessment in an Outpatient Education Program.

ERIC Educational Resources Information Center

Hernandez, Teri L.; Rupnow, Jana M.; Currie, Kristi A.; Procious, James K.; Adams, Jenny

2003-01-01

An outcomes-based assessment instrument was devised to screen patients for learning problems that would impede patient education in cardiac rehabilitation. Criteria for seven barriers were established: hearing, language, cultural, religious, vision, cognitive, emotional). Points of data collection and a rationale for collection were identified.…

Outcomes Assessment in Postsecondary Occupational Programs: A Consortial Approach. Project Report.

ERIC Educational Resources Information Center

State Univ. of New York, Albany. Two Year Coll. Development Center.

Outcome assessment has come to mean documentation, beyond grades and numbers of graduates, of higher education's results as proof of quality and evidence of improving undergraduate education. This document describes a consortium formed by the Two-Year College Development Center of the State University of New York, the Bureau of Postsecondary…

Effects of Admission and Treatment Strategies of DWI Courts on Offender Outcomes

PubMed Central

Sloan, Frank A.; Chepke, Lindsey M.; Davis, Dontrell V.; Acquah, Kofi; Zold-Kilbourne, Phyllis

2013-01-01

Purpose The purpose of this study is to classify DWI courts on the basis of the mix of difficult cases participating in the court (casemix severity) and the amount of involvement between the court and participant (service intensity). Using our classification typology, we assess how casemix severity and service intensity are associated with program outcomes. We expected that holding other factors constant, greater service intensity would improve program outcomes while a relatively severe casemix would result in worse program outcomes. Methods The study used data from 8 DWI courts, 7 from Michigan and 1 from North Carolina. Using a 2-way classification system based on court casemix severity and program intensity, we selected participants in 1 of the courts, and alternatively 2 courts as reference groups. Reference group courts had relatively severe casemixes and high service intensity. We used propensity score matching to match participants in the other courts to participants in the reference group court programs. Program outcome measures were the probabilities of participants’: failing to complete the court’s program; increasing educational attainment; participants improving employment from time of program enrollment; and re-arrest. Results For most outcomes, our main finding was that higher service intensity is associated with better outcomes for court participants, as anticipated, but a court’s casemix severity was unrelated to study outcomes. Conclusions Our results imply that devoting more resources to increasing duration of treatment is productive in terms of better outcomes, irrespective of the mix of participants in the court’s program PMID:23416679

Disease management 360 degrees: a scorecard approach to evaluating TRICARE's programs for asthma, congestive heart failure, and diabetes.

PubMed

Yang, Wenya; Dall, Timothy M; Zhang, Yiduo; Hogan, Paul F; Arday, David R; Gantt, Cynthia J

2010-08-01

To assess the effect of TRICARE's asthma, congestive heart failure, and diabetes disease management programs using a scorecard approach. EVALUATION MEASURES: Patient healthcare utilization, financial, clinical, and humanistic outcomes. Absolute measures were translated into effect size and incorporated into a scorecard. Actual outcomes for program participants were compared with outcomes predicted in the absence of disease management. The predictive equations were established from regression models based on historical control groups (n = 39,217). Z scores were calculated for the humanistic measures obtained through a mailed survey. Administrative records containing medical claims, patient demographics and characteristics, and program participation status were linked using an encrypted patient identifier (n = 57,489). The study time frame is 1 year prior to program inception through 2 years afterward (October 2005-September 2008). A historical control group was identified with the baseline year starting October 2003 and a 1-year follow-up period starting October 2004. A survey was administered to a subset of participants 6 months after baseline assessment (39% response rate). Within the observation window--24 months for asthma and congestive heart failure, and 15 months for the diabetes program--we observed modest reductions in hospital days and healthcare cost for all 3 programs and reductions in emergency visits for 2 programs. Most clinical outcomes moved in the direction anticipated. The scorecard provided a useful tool to track performance of 3 regional contractors for each of 3 diseases and over time.

Disease management interventions: what's in the black box?

PubMed

Linden, Ariel; Roberts, Nancy

2004-01-01

In discussing evaluation techniques to assess disease management (DM) program outcomes, it is often assumed that DM program interventions are premised on sound clinical judgment, an understanding of the disease process, and knowledge of the psychosocial models of behavioral change that must be used to effect those processes and ultimately improve the health outcomes that are being evaluated. This paper describes eight commonly used behavioral change models applied in the healthcare industry today. They represent programs designed to address individual, interpersonal, and community level factors as well as "packaged" comprehensive approaches. These models illustrate the breadth of approaches to consider when designing or assessing DM program interventions. Careful consideration of the type of behavioral change desired and the theories of how to effect such change should be an integral part of designing disease management program interventions.

A Critical Appraisal of and Recommendations for Faculty Development

PubMed Central

Guglielmo, B. Joseph; Edwards, David J.; Franks, Andrea S.; Naughton, Cynthia A.; Schonder, Kristine S.; Stamm, Pamela L.; Thornton, Phillip; Popovich, Nicholas G.

2011-01-01

The 2009-2010 American Association of Colleges of Pharmacy (AACP) Council of Faculties Faculty Affairs Committee reviewed published literature assessing the scope and outcomes of faculty development for tenure and promotion. Relevant articles were identified via a PubMed search, review of pharmacy education journals, and identification of position papers from major healthcare professions academic organizations. While programs intended to enhance faculty development were described by some healthcare professions, relatively little specific to pharmacy has been published and none of the healthcare professions have adequately evaluated the impact of various faculty-development programs on associated outcomes. The paucity of published information strongly suggests a lack of outcomes-oriented faculty-development programs in colleges and schools of pharmacy. Substantial steps are required toward the development and scholarly evaluation of faculty-development programs. As these programs are developed and assessed, evaluations must encompass all faculty subgroups, including tenure- and nontenure track faculty members, volunteer faculty members, women, and underrepresented minorities. This paper proposes AACP, college and school, and department-level recommendations intended to ensure faculty success in achieving tenure and promotion. PMID:21931460

Social Policy Planning Programs and Prospects.

ERIC Educational Resources Information Center

Todd, Frederick W.

This study, a monitor of four experimental training programs in the field of social policy planning, has as its purpose to assess program development and outcomes and to relate any significant findings useful in educational program development for social policy professionals. The programs are discussed at two levels: individually in terms of their…

A Review of Hazard Anticipation Training Programs for Young Drivers.

PubMed

McDonald, Catherine C; Goodwin, Arthur H; Pradhan, Anuj K; Romoser, Matthew R E; Williams, Allan F

2015-07-01

Poor hazard anticipation skills are a risk factor associated with high motor vehicle crash rates of young drivers. A number of programs have been developed to improve these skills. The purpose of this review was to assess the empirical literature on hazard anticipation training for young drivers. Studies were included if they (1) included an assessment of hazard anticipation training outcomes; (2) were published between January 1, 1980 and December 31, 2013 in an English language peer-reviewed journal or conference proceeding; and (3) included at least one group that uniquely comprised a cohort of participants aged <21 years. Nineteen studies met inclusion criteria. Studies used a variety of training methods including interactive computer programs, videos, simulation, commentary driving, or a combination of approaches. Training effects were predominantly measured through computer-based testing and driving simulation with eye tracking. Four studies included an on-road evaluation. Most studies evaluated short-term outcomes (immediate or few days). In all studies, young drivers showed improvement in selected hazard anticipation outcomes but none investigated crash effects. Although there is promise in existing programs, future research should include long-term follow-up, evaluate crash outcomes, and assess the optimal timing of hazard anticipation training taking into account the age and experience level of young drivers. Copyright © 2015 Society for Adolescent Health and Medicine. All rights reserved.

Evaluation of the Brownfields Program

EPA Pesticide Factsheets

The Evaluation of 2003-2008 Brownfields Assessment, Revolving Loan Fund, and Cleanup Grants is the first national program evaluation of the outcomes, efficiencies, and economic benefits produced by Brownfields grants.

Improving Accreditor's Evaluation of Experiential Learning Programs.

ERIC Educational Resources Information Center

Keeton, Morris T.

1980-01-01

Principles of good practice in assessing experiential learning include better self-evaluation of the learning outcomes of experiential components, systematic program auditing, and training of external evaluators. (SK)

Feasibility and Preliminary Outcomes From a Pilot Study of an Integrated Health-Mental Health Promotion Program in School Mental Health Services

PubMed Central

George, Melissa W.; Trumpeter, Nevelyn N.; Wilson, Dawn K.; McDaniel, Heather L.; Schiele, Bryn; Prinz, Ron; Weist, Mark D.

2014-01-01

The prevalence of unmet health and mental health needs among youth has spurred the growing consensus to develop strategies that integrate services to promote overall well-being. This pilot study reports on the feasibility and outcomes of a theory-driven, family-focused, integrated health-mental health promotion program for underserved adolescents receiving school mental health services. Parent and adolescent assessments conducted prior to and following the brief, 6-session promotion program showed significant improvements in family support, youth self-efficacy, health behaviors, and mental health outcomes. Clinician reports contributed to a characterization of the feasibility, acceptability, and future recommendations for the integrated program. PMID:24297005

Treatment effects model for assessing disease management: measuring outcomes and strengthening program management.

PubMed

Wendel, Jeanne; Dumitras, Diana

2005-06-01

This paper describes an analytical methodology for obtaining statistically unbiased outcomes estimates for programs in which participation decisions may be correlated with variables that impact outcomes. This methodology is particularly useful for intraorganizational program evaluations conducted for business purposes. In this situation, data is likely to be available for a population of managed care members who are eligible to participate in a disease management (DM) program, with some electing to participate while others eschew the opportunity. The most pragmatic analytical strategy for in-house evaluation of such programs is likely to be the pre-intervention/post-intervention design in which the control group consists of people who were invited to participate in the DM program, but declined the invitation. Regression estimates of program impacts may be statistically biased if factors that impact participation decisions are correlated with outcomes measures. This paper describes an econometric procedure, the Treatment Effects model, developed to produce statistically unbiased estimates of program impacts in this type of situation. Two equations are estimated to (a) estimate the impacts of patient characteristics on decisions to participate in the program, and then (b) use this information to produce a statistically unbiased estimate of the impact of program participation on outcomes. This methodology is well-established in economics and econometrics, but has not been widely applied in the DM outcomes measurement literature; hence, this paper focuses on one illustrative application.

Development of a home-based training program for post-ward geriatric rehabilitation patients with cognitive impairment: study protocol of a randomized-controlled trail.

PubMed

Bongartz, Martin; Kiss, Rainer; Ullrich, Phoebe; Eckert, Tobias; Bauer, Jürgen; Hauer, Klaus

2017-09-12

Geriatric patients with cognitive impairment (CI) show an increased risk for a negative rehabilitation outcome and reduced functional recovery following inpatient rehabilitation. Despite this obvious demand, evidence-based training programs at the transition from rehabilitation to the home environments are lacking. The aim of this study is to evaluate the efficacy of a feasible and cost-effective home-based training program to improve motor performance and to promote physical activity, specifically-tailored for post-ward geriatric patients with CI. A sample of 101 geriatric patients with mild to moderate stage CI following ward-based rehabilitation will be recruited for a blinded, randomized controlled trial with two arms. The intervention group will conduct a 12 week home-based training, consisting of (1) Exercises to improve strength/power, and postural control; (2) Individual walking trails to enhance physical activity; (3) Implementation of patient-specific motivational strategies to promote behavioral changes. The control group will conduct 12 weeks of unspecific flexibility exercise. Both groups will complete a baseline measurement before starting the program, at the end of the intervention, and after 24 weeks for follow-up. Sensor-based as well as questionnaire-based measures will be applied to comprehensively assess intervention effects. Primary outcomes document motor performance, assessed by the Short Physical Performance Battery, and level of physical activity (PA), as assessed by duration of active episodes (i.e., sum of standing and walking). Secondary outcomes include various medical, psycho-social, various PA and motor outcomes, including sensor-based assessment as well as cost effectiveness. Our study is among the first to provide home-based training in geriatric patients with CI at the transition from a rehabilitation unit to the home environment. The program offers several unique approaches, e.g., a comprehensive and innovative assessment strategy and the integration of individually-tailored motivational strategies. We expect the program to be safe and feasible in geriatric patients with CI with the potential to enhance the sustainability of geriatric rehabilitation programs in patients with CI. International Standard Randomized Controlled Trial (# ISRCTN82378327 ). Registered: August 10, 2015.

Assessing Study Abroad Programs: Application of the "SLEPT" Framework through Learning Communities

ERIC Educational Resources Information Center

Tajes, Maria; Ortiz, Jamie

2010-01-01

This case study proposes a comprehensive conceptual framework for exploring student learning outcomes of short-term study abroad programs. It uses the Social, Legal, Economic, Political, and Technological framework to assess understanding of the host country before departing and after returning. Participation fostered global literacy and critical…

Emotional Intelligence, Religiosity, and Authoritarianism in Canadian Bible College Students

ERIC Educational Resources Information Center

Boughan, Mark Arthur

2009-01-01

Institutions of higher education are required to initiate student outcomes assessment programs. Such programs are more complex in Bible colleges due to concerns related to spiritual and religious development and the lack of appropriate related assessment tools. Further, as there are indications that religious development may result in increased…

Assessment and Evaluation of Primary Prevention in Spinal Cord Injury

PubMed Central

2013-01-01

Although the incidence of spinal cord injury (SCI) is low, the consequences of this disabling condition are extremely significant for the individual, family, and the community. Sequelae occur in the physical, psychosocial, sexual, and financial arenas, making global prevention of SCI crucial. Understanding how to assess and evaluate primary prevention programs is an important competency for SCI professionals. Assessing a program’s success requires measuring processes, outcomes, and impact. Effective evaluation can lead future efforts for program design while ensuring accountability for the program itself. The intended impact of primary prevention programs for SCI is to decrease the number of individuals who sustain traumatic injury; many programs have process and outcome goals as well. An understanding of the basic types of evaluation, evaluation design, and the overall process of program evaluation is essential for ensuring that these programs are efficacious. All health care professionals have the opportunity to put prevention at the forefront of their practice. With the current paucity of available data, it is important that clinicians share their program design, their successes, and their failures so that all can benefit and future injury can be prevented. PMID:23678281

A Study on The Effectiveness of a Pilot Inquiry-Based Middle School Science Program on Non- Cognitive Outcomes and Academic Achievement

NASA Astrophysics Data System (ADS)

Dionisio, Rui Meira

The randomized research study assessed the effect of an inquiry-based science (IBS) program on non-cognitive outcomes and academic achievement. The study was the result of a grant that was awarded by Professional Resources in Science and Mathematics (PRISM), a program affiliated with Montclair State University in conjunction with Bristol-Myers Squibb, and part of the New Jersey Statewide Systemic Initiative (NJSSI). The NJSSI is a partnership of schools, districts, colleges and universities, science centers, businesses, and museums dedicated to improving the teaching and learning of science, mathematics, and technology in New Jersey. The quantitative research study utilized an IBS instructional program titled Science and Technology Concepts for Middle Schools (STC/MS) and was implemented in two middle schools within the same suburban school district. This study examined the effect of IBS classrooms on learning outcomes specifically related to gender and special education. Evaluation of student learning outcomes was conducted through the administration of three instruments: the Academic Self-Concept (ASC) scale, unit assessments, and NJASK 8 Science. The ASC scale and unit assessments were administered as a pretest and posttest in IBS classrooms. NJASK 8 Science scale scores were obtained through reporting of student performance data from the New Jersey Department of Education to the district. The quantitative analysis in this study provided evidence that IBS classrooms had a positive effect on academic achievement. Overall, students in IBS classrooms performed better than students in traditional classrooms on unit assessments. Additionally, male students and special education students in IBS classrooms outperformed students in traditional classrooms on unit assessments.

Can outcome-based continuing medical education improve performance of immigrant physicians?

PubMed

Castel, Orit Cohen; Ezra, Vered; Alperin, Mordechai; Nave, Rachel; Porat, Tamar; Golan, Avivit Cohen; Vinker, Shlomo; Karkabi, Khaled

2011-01-01

Immigrant physicians are a valued resource for physician workforces in many countries. Few studies have explored the education and training needs of immigrant physicians and ways to facilitate their integration into the health care system in which they work. Using an educational program developed for immigrant civilian physicians working in military primary care clinics at the Israel Defence Force, we illustrate how an outcome-based CME program can address practicing physicians' needs for military-specific primary care education and improve patient care. Following an extensive needs assessment, a 3-year curriculum was developed. The curriculum was delivered by a multidisciplinary educational team. Pre/post multiple-choice examinations, objective structured clinical examinations (OSCE), and end-of-program evaluations were administered for curriculum evaluation. To evaluate change in learners' performance, data from the 2003 (before-program) and 2006 (after-program) work-based assessments were retrieved retrospectively. Change in the performance of program participants was compared with that of immigrant physicians who did not participate in the program. Out of 28 learners, 23 (82%) completed the program. Learners did significantly better in the annual post-tests compared with the pretests (p <.01) and improved their OSCE scores (p <.001). Most program graduates (90%) rated overall satisfaction as very good or excellent. In comparison with nonparticipants, program graduates performed better on work-based assessments (Cohen's d =.63). Our intensive, outcome-based, longitudinal CME program has yielded encouraging results. Other medical educators, facing the challenge of integrating immigrant physicians to fit their health care system, may consider adapting our approach. Copyright © 2011 The Alliance for Continuing Medical Education, the Society for Academic Continuing Medical Education, and the Council on CME, Association for Hospital Medical Education.

Maternal Jail Time, Conviction, and Arrest as Predictors of Children's 15-Year Antisocial Outcomes in the Context of a Nurse Home Visiting Program

ERIC Educational Resources Information Center

Shlafer, Rebecca J.; Poehlmann, Julie; Donelan-McCall, Nancy

2012-01-01

Data from the Nurse-Family Partnership intervention program were analyzed to compare the "selection" versus "unique" effects of maternal jail time on adolescent antisocial and health risk outcomes. Data from 320 women and their firstborn children were available from the prenatal, birth, and 15-year assessments. Consistent with…

The European Innovation Partnership on Active and Healthy Ageing Synergies: Protocol for a Prospective Observational Study to Measure the Impact of a Community-Based Program on Prevention and Mitigation of Frailty (ICP - PMF) in Community-Dwelling Older Adults.

PubMed

Liotta, G; Orfila, F; Vollenbroek-Hutten, M; Roller-Winsberger, R; Illario, M; Musian, D; Alvino, S; O'Caoimh, R; Cano, A; Molloy, W; Iaccarino, G; Marazzi, M C; Inzerilli, M C; Madaro, O; Paul, C; Csonka, P; Vince, A C; Menditto, E; Maggio, M; Scarcella, P; Gilardi, F; Lucaroni, F; Abete, P; Girardi, V; Barra, R; Palombi, L

2016-11-01

Aim of this paper is to describe the protocol of the study "Impact of a Community-based Program on Prevention and Mitigation of Frailty in community-dwelling older adults" developed in the framework of the European Innovation Partnership on Active and Healthy Ageing. This proposal has been developed by the Partnership Action groups on frailty, fall prevention and polypharmacy in older. The proposal wants to assess the impact of community-based programs aimed to counteract three main outcomes related to frailty: hospitalization, institutionalization and death. Bringing together researchers from seven European countries, the proposal aims to achieve the critical mass and the geographical extension enough to provide information useful to all older European citizens. An observational study will be carried out to calculate the incidence of the different outcomes in relation to the various interventions that will be assessed; results will be compared with data coming from already established national, regional and local dataset using the observed/expected approach. The sample will be made up by at least 2000 citizens for each outcome. All the citizens will be assessed at the baseline with two multidimensional questionnaires: the RISC questionnaire and the Short Functional Geriatric Evaluation questionnaire. The outcomes will be assessed every six-twelve months.

Are we measuring what matters in health technology assessment of disease management? Systematic literature review.

PubMed

Steuten, Lotte; Vrijhoef, Bert; Severens, Hans; van Merode, Frits; Spreeuwenberg, Cor

2006-01-01

An overview was produced of indicators currently used to assess disease management programs and, based on these findings, provide a framework regarding sets of indicators that should be used when taking the aims and types of disease management programs into account. A systematic literature review was performed. Thirty-six studies met the inclusion criteria. It appeared that a link between aims of disease management and evaluated structure, process, as well as outcome indicators does not exist in a substantial part of published studies on disease management of diabetes and asthma/chronic obstructive pulmonary disease, especially when efficiency of care is concerned. Furthermore, structure indicators are largely missing from the evaluations, although these are of major importance for the interpretation of outcomes for purposes of decision-making. Efficiency of disease management is mainly evaluated by means of process indicators; the use of outcome indicators is less common. Within a framework, structure, process, and outcome indicators for effectiveness and efficiency are recommended for each type of disease management program. The link between aims of disease management and evaluated structure, process, and outcome indicators does not exist in a substantial part of published studies on disease management. The added value of this study mainly lies in the development of a framework to guide the choice of indicators for health technology assessment of disease management.

Career Preparedness Survey Outcomes of Food Science Graduates--A Follow-Up Assessment

ERIC Educational Resources Information Center

Bohlscheid, Jeffri; Clark, Stephanie

2012-01-01

Fifty-eight recent graduates (1998-2008) from the joint Washington State University (WSU) and University of Idaho (UI) BiState School of Food Science program and 27 of their employers participated in a survey assessing learning outcomes based on the 2001 Institute of Food Technologists (IFT) core competencies for undergraduate food science…

Developing the OBTL Curriculum with Blended Learning to Enhance Student Learning Effectiveness in the Undergraduate ECE Program

ERIC Educational Resources Information Center

Leung, Chi-hung

2012-01-01

Background: The project included continuous assessment, group presentation, self-learning, and individual assignment to assess students' learning outcomes. A self-learning system was set up as e-learning for students to monitor their learning progress during the semester, including two online exercises and a checklist of learning outcomes. The…

The State Agency--College-Mandated Approach.

ERIC Educational Resources Information Center

Capoor, Madan; Morante, Edward

1990-01-01

Describes two state-mandated programs for institutional accountability in New Jersey (i.e., Basic Skills Assessment Program and College Outcomes Evaluation Program), which function through cooperation between the state's higher education agency and its colleges and universities. Highlights research objectives, procedures, responsibilities,…

Effects of a self-management program on antiemetic-induced constipation during chemotherapy among breast cancer patients: a randomized controlled clinical trial.

PubMed

Hanai, Akiko; Ishiguro, Hiroshi; Sozu, Takashi; Tsuda, Moe; Arai, Hidenori; Mitani, Akira; Tsuboyama, Tadao

2016-01-01

Research on patient-reported outcomes indicates that constipation is a common adverse effect of chemotherapy, and the use of 5-hydroxytryptamine (serotonin; 5HT3) receptor antagonists aggravates this condition. As cancer patients take multiple drugs as a part of their clinical management, a non-pharmacological self-management (SM) of constipation would be recommended. We aimed to evaluate the effectiveness of a SM program on antiemetic-induced constipation in cancer patients. Thirty patients with breast cancer, receiving 5HT3 receptor antagonists to prevent emesis during chemotherapy were randomly assigned to the intervention or control group. The SM program consisted of abdominal massage, abdominal muscle stretching, and education on proper defecation position. The intervention group started the program before the first chemotherapy cycle, whereas patients in the wait-list control group received the program on the day before their second chemotherapy cycle. The primary outcome was constipation severity, assessed by the constipation assessment scale (CAS, sum of eight components). The secondary outcome included each CAS component (0-2 points) and mood states. A self-reported assessment of satisfaction with the program was performed. The program produced a statistically and clinically significant alleviation of constipation severity (mean difference in CAS, -3.00; P = 0.02), decrease in the likelihood of a small volume of stool (P = 0.03), and decrease in depression and dejection (P = 0.02). With regards to program satisfaction, 43.6 and 26.4 % patients rated the program as excellent and good, respectively. Our SM program is effective for mitigating the symptoms of antiemetic-induced constipation during chemotherapy.

Primary prevention research: a preliminary review of program outcome studies.

PubMed

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Developing Leadership for Life: Outcomes from a Collegiate Student-Alumni Mentoring Program

ERIC Educational Resources Information Center

Priest, Kerry L.; Donley, Sarah

2014-01-01

This application brief describes the exploratory assessment of a mentoring program between current students and alumni of a leadership studies minor program. We connect leadership education research and practice in two ways: first, we describe a process of qualitative program evaluation to inform program best practices and improvement. In doing…

Program Theory Evaluation: Logic Analysis

ERIC Educational Resources Information Center

Brousselle, Astrid; Champagne, Francois

2011-01-01

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge.…

American Indian Substance Abuse Prevention Efforts: A Review of Programs, 2003-2013.

PubMed

Walsh, Margaret L; Baldwin, Julie A

2015-01-01

The purpose of the review was to assess substance abuse prevention (SAP) efforts in American Indian and Alaska Native (AI/AN) communities from 2003-2013. In the past, many SAP programs were unable to meet the unique cultural needs of AI/AN communities adequately. It has been suggested that a disconnect may exist between the theories that are used to guide development of prevention programs in AI/AN communities and culturally appropriate theoretical constructs of AI/AN worldviews. To explore this possible disconnect further, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used to assess a total of 18 articles (N = 31 programs) on program location and method, participant characteristics, described program cultural elements, use of theory, program outcomes, program measures, and future recommendations. Results indicated that SAP programs in AI/AN communities vary widely in their use of theory, implementation strategies, view and definition of cultural constructs, overall evaluational rigor, and reporting methods. Future research is needed to integrate appropriate theory and cultural elements into SAP programs to tie them to measurable outcomes for AI/AN communities.

The role of the case manager in a disease management program.

PubMed

Huston, Carol J

2002-01-01

Disease management programs provide new opportunities and roles for case managers to provide population-based healthcare to the chronically ill. This article identifies common components of disease management programs and examines roles assumed by case managers in disease management programs such as baseline assessment, performing economic analyses of diseases and their respective associated resource utilization, developing and/or implementing care guidelines or algorithms, educational interventions, disease management program implementation, and outcomes assessment. Areas of expertise needed to be an effective case manager in a disease management program are also identified.

The role of the case manager in a disease management program.

PubMed

Huston, C J

2001-01-01

Disease management programs provide new opportunities and roles for case managers to provide population-based healthcare to the chronically ill. This article identifies common components of disease management programs and examines roles assumed by case managers in disease management programs such as baseline assessment, performing economic analyses of diseases and their respective associated resource utilization, developing and/or implementing care guidelines or algorithms, educational interventions, disease management program implementation, and outcomes assessment. Areas of expertise needed to be an effective case manager in a disease management program are also identified.

Assessment of Students’ Critical-Thinking and Problem-Solving Abilities Across a 6-Year Doctor of Pharmacy Program

PubMed Central

Gaebelein, Claude J.; Grice, Gloria R.; Crannage, Andrew J.; Weck, Margaret A.; Hurd, Peter; Walter, Brenda; Duncan, Wendy

2013-01-01

Objective. To determine the feasibility of using a validated set of assessment rubrics to assess students’ critical-thinking and problem-solving abilities across a doctor of pharmacy (PharmD) curriculum. Methods. Trained faculty assessors used validated rubrics to assess student work samples for critical-thinking and problem-solving abilities. Assessment scores were collected and analyzed to determine student achievement of these 2 ability outcomes across the curriculum. Feasibility of the process was evaluated in terms of time and resources used. Results. One hundred sixty-one samples were assessed for critical thinking, and 159 samples were assessed for problem-solving. Rubric scoring allowed assessors to evaluate four 5- to 7-page work samples per hour. The analysis indicated that overall critical-thinking scores improved over the curriculum. Although low yield for problem-solving samples precluded meaningful data analysis, it was informative for identifying potentially needed curricular improvements. Conclusions. Use of assessment rubrics for program ability outcomes was deemed authentic and feasible. Problem-solving was identified as a curricular area that may need improving. This assessment method has great potential to inform continuous quality improvement of a PharmD program. PMID:24159207

Assessment of students' critical-thinking and problem-solving abilities across a 6-year doctor of pharmacy program.

PubMed

Gleason, Brenda L; Gaebelein, Claude J; Grice, Gloria R; Crannage, Andrew J; Weck, Margaret A; Hurd, Peter; Walter, Brenda; Duncan, Wendy

2013-10-14

To determine the feasibility of using a validated set of assessment rubrics to assess students' critical-thinking and problem-solving abilities across a doctor of pharmacy (PharmD) curriculum. Trained faculty assessors used validated rubrics to assess student work samples for critical-thinking and problem-solving abilities. Assessment scores were collected and analyzed to determine student achievement of these 2 ability outcomes across the curriculum. Feasibility of the process was evaluated in terms of time and resources used. One hundred sixty-one samples were assessed for critical thinking, and 159 samples were assessed for problem-solving. Rubric scoring allowed assessors to evaluate four 5- to 7-page work samples per hour. The analysis indicated that overall critical-thinking scores improved over the curriculum. Although low yield for problem-solving samples precluded meaningful data analysis, it was informative for identifying potentially needed curricular improvements. Use of assessment rubrics for program ability outcomes was deemed authentic and feasible. Problem-solving was identified as a curricular area that may need improving. This assessment method has great potential to inform continuous quality improvement of a PharmD program.

A Review of Quality Measures for Assessing the Impact of Antimicrobial Stewardship Programs in Hospitals

PubMed Central

Akpan, Mary Richard; Ahmad, Raheelah; Shebl, Nada Atef; Ashiru-Oredope, Diane

2016-01-01

The growing problem of antimicrobial resistance (AMR) has led to calls for antimicrobial stewardship programs (ASP) to control antibiotic use in healthcare settings. Key strategies include prospective audit with feedback and intervention, and formulary restriction and preauthorization. Education, guidelines, clinical pathways, de-escalation, and intravenous to oral conversion are also part of some programs. Impact and quality of ASP can be assessed using process or outcome measures. Outcome measures are categorized as microbiological, patient or financial outcomes. The objective of this review was to provide an overview of quality measures for assessing ASP and the reported impact of ASP in peer-reviewed studies, focusing particularly on patient outcomes. A literature search of papers published in English between 1990 and June 2015 was conducted in five databases using a combination of search terms. Primary studies of any design were included. A total of 63 studies were included in this review. Four studies defined quality metrics for evaluating ASP. Twenty-one studies assessed the impact of ASP on antimicrobial utilization and cost, 25 studies evaluated impact on resistance patterns and/or rate of Clostridium difficile infection (CDI). Thirteen studies assessed impact on patient outcomes including mortality, length of stay (LOS) and readmission rates. Six of these 13 studies reported non-significant difference in mortality between pre- and post-ASP intervention, and five reported reductions in mortality rate. On LOS, six studies reported shorter LOS post intervention; a significant reduction was reported in one of these studies. Of note, this latter study reported significantly (p < 0.001) higher unplanned readmissions related to infections post-ASP. Patient outcomes need to be a key component of ASP evaluation. The choice of metrics is influenced by data and resource availability. Controlling for confounders must be considered in the design of evaluation studies to adequately capture the impact of ASP and it is important for unintended consequences to be considered. This review provides a starting point toward compiling standard outcome metrics for assessing ASP. PMID:27025520

Driving Organizational Change From the Bedside: The AACN Clinical Scene Investigator Academy.

PubMed

Lacey, Susan R; Goodyear-Bruch, Caryl; Olney, Adrienne; Hanson, Dave; Altman, Marian S; Varn-Davis, Natasha S; Brinker, Debbie; Lavandero, Ramón; Cox, Karen S

2017-08-01

Staff nurses are pivotal in leading change related to quality improvement efforts, although many lack skills to steer change from the bedside. The American Association of Critical-Care Nurses (AACN) staff nurse leadership program, Clinical Scene Investigator (CSI) Academy, teaches and empowers staff nurses in leadership skills and change concepts to translate evidence into practice affecting patient outcomes. To describe the curriculum of the AACN CSI Academy that provides staff nurses with the leadership skills required to create unit-based change projects that positively impact patient/family outcomes. The curriculum of the Academy included leadership topics, communication, change concepts, quality improvement methods, project management, and data management and analysis. Each team of participants collected project data to show improvements in patient care. The program evaluation used many data sources to assess the program effectiveness, relating to the professional growth of the participant nurses. The participants assessed project patient outcomes, sustainability, and spread. The first cohort of CSI participants included 164 direct care nurses from 42 hospitals in 6 cities. They rated the Academy highly in the program evaluation, and they reported that the Academy contributed to their professional development. The individual hospital quality improvement projects resulted in positive patient and estimated fiscal outcomes that were generally sustained 1 year after the program. With the skills, tools, and support obtained from participation in the CSI Academy, staff nurses can make substantial contributions to their organizations in clinical and possibly fiscal outcomes. ©2017 American Association of Critical-Care Nurses.

Using adaptive processes and adverse outcome pathways to develop meaningful, robust, and actionable environmental monitoring programs.

PubMed

Arciszewski, Tim J; Munkittrick, Kelly R; Scrimgeour, Garry J; Dubé, Monique G; Wrona, Fred J; Hazewinkel, Rod R

2017-09-01

The primary goals of environmental monitoring are to indicate whether unexpected changes related to development are occurring in the physical, chemical, and biological attributes of ecosystems and to inform meaningful management intervention. Although achieving these objectives is conceptually simple, varying scientific and social challenges often result in their breakdown. Conceptualizing, designing, and operating programs that better delineate monitoring, management, and risk assessment processes supported by hypothesis-driven approaches, strong inference, and adverse outcome pathways can overcome many of the challenges. Generally, a robust monitoring program is characterized by hypothesis-driven questions associated with potential adverse outcomes and feedback loops informed by data. Specifically, key and basic features are predictions of future observations (triggers) and mechanisms to respond to success or failure of those predictions (tiers). The adaptive processes accelerate or decelerate the effort to highlight and overcome ignorance while preventing the potentially unnecessary escalation of unguided monitoring and management. The deployment of the mutually reinforcing components can allow for more meaningful and actionable monitoring programs that better associate activities with consequences. Integr Environ Assess Manag 2017;13:877-891. © 2017 The Authors. Integrated Environmental Assessment and Management Published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC). © 2017 The Authors. Integrated Environmental Assessment and Management Published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC).

Improving Electrical Engineering Education at the American University of Sharjah through Continuous Assessment

ERIC Educational Resources Information Center

Al-Nashash, Hasan; Khaliq, Abdul; Qaddoumi, Nasser; Al-Assaf, Yousef; Assaleh, Khaled; Dhaouadi, Rached; El-Tarhuni, Mohamed

2009-01-01

The electrical engineering (ELE) program at the American University of Sharjah (AUS) is designed to fulfill the ABET criteria. Several assessment tools are used to qualitatively and quantitatively measure the level of achievement of the program's educational objectives and outcomes. These tools include alumni, employer, and graduate advisor…

Curricular Innovation in an Undergraduate Medical Program: What Is "Appropriate" Assessment?

ERIC Educational Resources Information Center

Ruhe, Valerie; Boudreau, J. Donald

2011-01-01

In post-secondary education, there is a widely-held belief in a "gold standard" for evaluative studies of curricular innovations. In this context, "appropriate" assessment is understood to refer to experimental designs and statistically significant differences in group outcomes. Yet in our evaluative study of a medical undergraduate program, we…

A Model for Evaluating Programs for the Gifted under Non-Experimental Conditions.

ERIC Educational Resources Information Center

Carter, Kyle R.

1992-01-01

The article presents and illustrates use of an evaluation model for assessing programs for the gifted where tight experimental control is not possible. The model consists of four components: ex post factor designs including intact groups; comparative evaluation; strength of treatment; and multiple outcome assessment from flexible data sources. (DB)

Student Outcomes Assessment of a Logistics and Supply Chair Management Major

ERIC Educational Resources Information Center

Walter, Clyde Kenneth

2012-01-01

Assessment of specialized programs, such as logistics and supply chain management program described here, may pose challenges because previous experience are less widely shared than in the more mainline subjects. This case study provides one model that may guide other faculties facing a similar assignment. The report detailed the steps followed to…

Correlation of United States Medical Licensing Examination and Internal Medicine In-Training Examination Performance

ERIC Educational Resources Information Center

Perez, Jose A., Jr.; Greer, Sharon

2009-01-01

The Internal Medicine In-Training Examination (ITE) is administered during residency training in the United States as a self-assessment and program assessment tool. Performance on this exam correlates with outcome on the American Board of Internal Medicine Certifying examination. Internal Medicine Program Directors use the United States Medical…

Community Jobs Outcomes Assessment & Program Evaluation.

ERIC Educational Resources Information Center

Case, Annette; Burchfield, Erin; Sommers, Paul

Unemployment wage data were evaluated to assess employment, job retention, and wage progression for graduates of Community Jobs (CJ), a short-term public job creation program for the hard to employ in the state of Washington. The following were among the findings: (1) 66% of all participants were employed after graduating from CJ; (2) 53% were…

Social Validity Assessment of Mindfulness Education and Practices among High School Students

ERIC Educational Resources Information Center

Luiselli, James K.; Worthen, Douglas; Carbonell, Lauren; Queen, Alexander H.

2017-01-01

The authors describe social validity assessment of mindfulness education and practices among high school students (N = 84) participating in a 10-week instructional program. The participants rated their satisfaction with and acceptance of several program components, content areas, and outcomes, as well as their engagement in specific mindfulness…

Design and Implementation of Performance Metrics for Evaluation of Assessments Data

ERIC Educational Resources Information Center

Ahmed, Irfan; Bhatti, Arif

2016-01-01

Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though…

Education Abroad and the Making of Global Citizens: Assessing Learning Outcomes of Course-Embedded, Faculty-Led International Programming

ERIC Educational Resources Information Center

Ogden, Anthony C.

2010-01-01

This study builds on education abroad, global citizenship and academic development literatures by assessing the extent to which embedding brief international travel experiences into residentially-taught courses enhances academic development and promotes global citizenship. Such faculty-led, education abroad programs are referred to as…

Measuring Success in Obesity Prevention: A Synthesis of Health Promotion Switzerland's Long-Term Monitoring and Evaluation Strategy

PubMed Central

Ackermann, Günter; Kirschner, Michael; Guggenbühl, Lisa; Abel, Bettina; Klohn, Axel; Mattig, Thomas

2015-01-01

Aims Since 2007, Health Promotion Switzerland has implemented a national priority program for a healthy body weight. This article provides insight into the methodological challenges and results of the program evaluation. Methods Evaluation of the long-term program required targeted monitoring and evaluation projects addressing different outcome levels. The evaluation was carried out according to the Swiss Model for Outcome Classification (SMOC), a model designed to classify the effects of health promotion and prevention efforts. Results The results presented in this article emphasize both content and methods. The national program successfully achieved outcomes on many different levels within complex societal structures. The evaluation system built around the SMOC enabled assessment of program progress and the development of key indicators. However, it is not possible to determine definitively to what extent the national program helped stabilize the prevalence of obesity in Switzerland. Conclusion The model has shown its utility in providing a basis for evaluation and monitoring of the national program. Continuous analysis of data from evaluation and monitoring has made it possible to check the plausibility of suspected causal relationships as well as to establish an overall perspective and assessment of effectiveness supported by a growing body of evidence. PMID:25765161

SPECS 2. Component Two: Program Budgeting and Cost Accounting.

ERIC Educational Resources Information Center

DuVall, Lloyd A.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. Component…

Implementing a Successful Faculty, Data Driven Model for Program Review.

ERIC Educational Resources Information Center

Beal, Suzanne; Davis, Shirley

Frederick Community College (Maryland) utilizes both the Instructional Accountability Program Review (IAPR) and the Career Program Review (CPR) to assess program outcomes and determine progress in meeting goals and objectives. The IAPR is a comprehensive review procedure conducted by faculty and associate deans to evaluate all transfer, career,…

An Integrative Review of the Quality and Outcomes of Diabetes Education Programs for Children and Adolescents.

PubMed

Colson, Sébastien; Côté, José; Gentile, Stéphanie; Hamel, Valérie; Sapuppo, Cédric; Ramirez-Garcia, Pilar; Reynaud, Rachel; Lagouanelle-Simeoni, Marie-Claude

2016-10-01

The purpose of this study was twofold: (1) to describe the content of recent diabetes education programs and their outcomes in terms of glycemic control, disease management, and psychosocial criteria for children and adolescents with type 1 diabetes and (2) to gauge the match between these programs and the recommendations of the International Society for Pediatric and Adolescent Diabetes (ISPAD). The integrative review was carried out according to the Cochrane recommendations. Thirteen databases were searched for evaluations of education programs published from 2009 to 2014. Program characteristics and outcomes were described. Quality of studies was assessed, and program match with ISPAD recommendations was gauged. Of 2528 studies found, 43 covering 36 education programs intended for youth with type 1 diabetes were retained for review. Nine of these centered on self-care competencies, 18 on psychosocial competencies, and 9 on both types of competency (mixed program). Programs varied widely in terms of organization, procedure, and content. Glycemic control was an indicator assessed in the majority of programs, but only half of these (for the most part, self-care programs) reported positive findings in this regard. Few programs seemed to affect psychosocial indicators. An online mixed program, which was the program that best met the ISPAD recommendations, proved to have an influence on glycemic control and several psychosocial criteria. Various avenues can be considered to improve participant engagement in education programs and to align these programs more closely with international recommendations. Further research is required to enhance knowledge in this field. © 2016 The Author(s).

Transition from early intervention program to primary school in children with autism spectrum disorder

PubMed Central

Eapen, Valsamma; Grove, Rachel; Aylward, Elizabeth; Joosten, Annette V; Miller, Scott I; Van Der Watt, Gerdamari; Fordyce, Kathryn; Dissanayake, Cheryl; Maya, Jacqueline; Tucker, Madonna; DeBlasio, Antonia

2017-01-01

AIM To evaluate the characteristics that are associated with successful transition to school outcomes in preschool aged children with autism. METHODS Twenty-one participants transitioning from an early intervention program were assessed at two time points; at the end of their preschool placement and approximately 5 mo later following their transition to school. Child characteristics were assessed using the Mullen Scales of Early Learning, Vineland Adaptive Behaviour Scales, Social Communication Questionnaire and the Repetitive Behaviour Scale. Transition outcomes were assessed using Teacher Rating Scale of School Adjustment and the Social Skills Improvement System Rating Scales to provide an understanding of each child’s school adjustment. The relationship between child characteristics and school outcomes was evaluated. RESULTS Cognitive ability and adaptive behaviour were shown to be associated with successful transition to school outcomes including participation in the classroom and being comfortable with the classroom teacher. These factors were also associated with social skills in the classroom including assertiveness and engagement. CONCLUSION Supporting children on the spectrum in the domains of adaptive behaviour and cognitive ability, including language skills, is important for a successful transition to school. Providing the appropriate support within structured transition programs will assist children on the spectrum with this important transition, allowing them to maximise their learning and behavioural potential. PMID:29259892

Transition from early intervention program to primary school in children with autism spectrum disorder.

PubMed

Eapen, Valsamma; Grove, Rachel; Aylward, Elizabeth; Joosten, Annette V; Miller, Scott I; Van Der Watt, Gerdamari; Fordyce, Kathryn; Dissanayake, Cheryl; Maya, Jacqueline; Tucker, Madonna; DeBlasio, Antonia

2017-11-08

To evaluate the characteristics that are associated with successful transition to school outcomes in preschool aged children with autism. Twenty-one participants transitioning from an early intervention program were assessed at two time points; at the end of their preschool placement and approximately 5 mo later following their transition to school. Child characteristics were assessed using the Mullen Scales of Early Learning, Vineland Adaptive Behaviour Scales, Social Communication Questionnaire and the Repetitive Behaviour Scale. Transition outcomes were assessed using Teacher Rating Scale of School Adjustment and the Social Skills Improvement System Rating Scales to provide an understanding of each child's school adjustment. The relationship between child characteristics and school outcomes was evaluated. Cognitive ability and adaptive behaviour were shown to be associated with successful transition to school outcomes including participation in the classroom and being comfortable with the classroom teacher. These factors were also associated with social skills in the classroom including assertiveness and engagement. Supporting children on the spectrum in the domains of adaptive behaviour and cognitive ability, including language skills, is important for a successful transition to school. Providing the appropriate support within structured transition programs will assist children on the spectrum with this important transition, allowing them to maximise their learning and behavioural potential.

Clinical audit project in undergraduate medical education curriculum: an assessment validation study

PubMed Central

Steketee, Carole; Mak, Donna

2016-01-01

Objectives To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. Methods A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). Results The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students’ and examiners’ response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach’s alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. Conclusions This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.  PMID:27716612

Clinical audit project in undergraduate medical education curriculum: an assessment validation study.

PubMed

Tor, Elina; Steketee, Carole; Mak, Donna

2016-09-24

To evaluate the merit of the Clinical Audit Project (CAP) in an assessment program for undergraduate medical education using a systematic assessment validation framework. A cross-sectional assessment validation study at one medical school in Western Australia, with retrospective qualitative analysis of the design, development, implementation and outcomes of the CAP, and quantitative analysis of assessment data from four cohorts of medical students (2011- 2014). The CAP is fit for purpose with clear external and internal alignment to expected medical graduate outcomes.  Substantive validity in students' and examiners' response processes is ensured through relevant methodological and cognitive processes. Multiple validity features are built-in to the design, planning and implementation process of the CAP.  There is evidence of high internal consistency reliability of CAP scores (Cronbach's alpha > 0.8) and inter-examiner consistency reliability (intra-class correlation>0.7). Aggregation of CAP scores is psychometrically sound, with high internal consistency indicating one common underlying construct.  Significant but moderate correlations between CAP scores and scores from other assessment modalities indicate validity of extrapolation and alignment between the CAP and the overall target outcomes of medical graduates.  Standard setting, score equating and fair decision rules justify consequential validity of CAP scores interpretation and use. This study provides evidence demonstrating that the CAP is a meaningful and valid component in the assessment program. This systematic framework of validation can be adopted for all levels of assessment in medical education, from individual assessment modality, to the validation of an assessment program as a whole.

Outcomes of an Elementary School-Based Vision Screening Program in North Carolina

ERIC Educational Resources Information Center

Kemper, Alex R.; Helfrich, Anya; Talbot, Jennifer; Patel, Nita

2012-01-01

School nurses can play a key role in the detection of significant refractive error. The purpose of this study was to assess the impact of a statewide school nurse vision screening program by evaluating the outcomes of screening among first, third, and fifth graders in 10 schools in North Carolina during the 2009-2010 school year. Of the 2,726…

Promoting Undergraduate Interest, Preparedness, and Professional Pursuit in the Sciences: An Outcomes Evaluation of the SURE Program at Emory University

ERIC Educational Resources Information Center

Junge, Benjamin; Quinones, Catherine; Kakietek, Jakub; Teodorescu, Daniel; Marsteller, Pat

2010-01-01

We report on an outcomes assessment of the Summer Undergraduate Research Experience (SURE) Program at Emory University in Atlanta, GA. Using follow-up survey data and academic transcripts, we gauge SURE's impact on levels of interest in, preparedness for, and actual pursuit of graduate study and professional careers in the sciences for the…

Antidepressant medicine use and risk of developing diabetes during the diabetes prevention program and diabetes prevention program outcomes study.

PubMed

Rubin, Richard R; Ma, Yong; Peyrot, Mark; Marrero, David G; Price, David W; Barrett-Connor, Elizabeth; Knowler, William C

2010-12-01

To assess the association between antidepressant medicine use and risk of developing diabetes during the Diabetes Prevention Program (DPP) and Diabetes Prevention Program Outcomes Study (DPPOS). DPP/DPPOS participants were assessed for diabetes every 6 months and for antidepressant use every 3 months in DPP and every 6 months in DPPOS for a median 10.0-year follow-up. Controlled for factors associated with diabetes risk, continuous antidepressant use compared with no use was associated with diabetes risk in the placebo (adjusted hazard ratio 2.34 [95% CI 1.32-4.15]) and lifestyle (2.48 [1.45-4.22]) arms, but not in the metformin arm (0.55 [0.25-1.19]). Continuous antidepressant use was significantly associated with diabetes risk in the placebo and lifestyle arms. Measured confounders and mediators did not account for this association, which could represent a drug effect or reflect differences not assessed in this study between antidepressant users and nonusers.

Program Performance Inventory: Six Juvenile Offender Programs.

ERIC Educational Resources Information Center

Thomalla, Terri Groff; Dougherty, Victoria J.

This report describes the performance of 6 Connecticut juvenile justice alternative sanction programs in 14 qualitative areas: community reintegration; outcomes and evaluation; assessment methods; risk factors; escalation of criminal activity; family involvement; community involvement; work ethic and vocational training; education and life skills;…

TESTING AN INTEGRATED MODEL OF PROGRAM IMPLEMENTATION: THE FOOD, HEALTH & CHOICES SCHOOL-BASED CHILDHOOD OBESITY PREVENTION INTERVENTION PROCESS EVALUATION

PubMed Central

Gray, Heewon Lee; Tipton, Elizabeth; Contento, Isobel; Koch, Pamela

2016-01-01

Childhood obesity is a complex, worldwide problem. Significant resources are invested in its prevention, and high-quality evaluations of these efforts are important. Conducting trials in school settings is complicated, making process evaluations useful for explaining results. Intervention fidelity has been demonstrated to influence outcomes, but others have suggested that other aspects of implementation, including participant responsiveness, should be examined more systematically. During Food, Health & Choices (FHC), a school-based childhood obesity prevention trial designed to test a curriculum and wellness policy taught by trained FHC instructors to fifth grade students in 20 schools during 2012–2013, we assessed relationships among facilitator behaviors (i.e., fidelity and teacher interest), participant behaviors (i.e., student satisfaction and recall), and program outcomes (i.e., energy balance-related behaviors) using hierarchical linear models, controlling for student, class, and school characteristics. We found positive relationships between student satisfaction and recall and program outcomes, but not fidelity and program outcomes. We also found relationships between teacher interest and fidelity when teachers participated in implementation. Finally, we found a significant interaction between fidelity and satisfaction on behavioral outcomes. These findings suggest that individual students in the same class responded differently to the same intervention. They also suggest the importance of teacher buy-in for successful intervention implementation. Future studies should examine how facilitator and participant behaviors together are related to both outcomes and implementation. Assessing multiple aspects of implementation using models that account for contextual influences on behavioral outcomes is an important step forward for prevention intervention process evaluations. PMID:27921200

Testing an Integrated Model of Program Implementation: the Food, Health & Choices School-Based Childhood Obesity Prevention Intervention Process Evaluation.

PubMed

Burgermaster, Marissa; Gray, Heewon Lee; Tipton, Elizabeth; Contento, Isobel; Koch, Pamela

2017-01-01

Childhood obesity is a complex, worldwide problem. Significant resources are invested in its prevention, and high-quality evaluations of these efforts are important. Conducting trials in school settings is complicated, making process evaluations useful for explaining results. Intervention fidelity has been demonstrated to influence outcomes, but others have suggested that other aspects of implementation, including participant responsiveness, should be examined more systematically. During Food, Health & Choices (FHC), a school-based childhood obesity prevention trial designed to test a curriculum and wellness policy taught by trained FHC instructors to fifth grade students in 20 schools during 2012-2013, we assessed relationships among facilitator behaviors (i.e., fidelity and teacher interest); participant behaviors (i.e., student satisfaction and recall); and program outcomes (i.e., energy balance-related behaviors) using hierarchical linear models, controlling for student, class, and school characteristics. We found positive relationships between student satisfaction and recall and program outcomes, but not fidelity and program outcomes. We also found relationships between teacher interest and fidelity when teachers participated in implementation. Finally, we found a significant interaction between fidelity and satisfaction on behavioral outcomes. These findings suggest that individual students in the same class responded differently to the same intervention. They also suggest the importance of teacher buy-in for successful intervention implementation. Future studies should examine how facilitator and participant behaviors together are related to both outcomes and implementation. Assessing multiple aspects of implementation using models that account for contextual influences on behavioral outcomes is an important step forward for prevention intervention process evaluations.

Toward an Evaluation Framework for Doctoral Education in Social Work: A 10-Year Retrospective of One PhD Program's Assessment Experiences

ERIC Educational Resources Information Center

Bentley, Kia J.

2013-01-01

This article presents a framework for evaluation in social work doctoral education and details 10 years of successes and challenges in one PhD program's use of the framework, including planning and implementing specific assessment activities around student learning outcomes and larger program goals. The article argues that a range of…

Portfolios: An Alternative Method of Student and Program Assessment

PubMed Central

Hannam, Susan E.

1995-01-01

The use of performance-based evaluation and alternative assessment techniques has become essential for curriculum programs seeking Commission of Accreditation of Allied Health Education Programs (CAAHEP) accreditation. In athletic training education, few assessment models exist to assess student performance over the entire course of their educational program. This article describes a model of assessment-a student athletic training portfolio of “best works.” The portfolio can serve as a method to assess student development and to assess program effectiveness. The goals of the program include purposes specific to the five NATA performance domains. In addition, four types of portfolio evidence are described: artifacts, attestations, productions, and reproductions. Quality assignments and projects completed by students as they progress through a six-semester program are identified relative to the type of evidence and the domain(s) they represent. The portfolio assists with student development, provides feedback for curriculum planning, allows for student/faculty collaboration and “coaching” of the student, and assists with job searching. This information will serve as a useful model for those athletic training programs looking for an alternative method of assessing student and program outcomes. PMID:16558359

Principles of disease management in neonatology.

PubMed

Bowen, F W; Gwiazdowski, S

1998-06-01

This article emphasizes the emerging facets of disease-management practice that impact directly on establishing a measured care system that can produce the information needed to establish a continuous quality improvement program. The areas discussed are risk assessment, clinical management guidelines and carepaths, and the measurement of system output known as clinical outcomes. The remainder of the article details the aspects of risk assessment, guideline function, and outcome assessment, critical in a disease-managed measured care system.

Predictors of doctoral student success in professional psychology: characteristics of students, programs, and universities.

PubMed

Graham, James M; Kim, Yang-Hyang

2011-04-01

In the face of the rising number of doctoral recipients in professional psychology, many have voiced concerns about the quality of nontraditional training programs. Past research suggests that, on a variety of outcomes, graduates from clinical PhD programs outperform graduates from clinical PsyD and, to a lesser extent, counseling PhD programs. We examine an aggregate archival dataset to determine whether student or university characteristics account for the differences in outcomes among programs. The data show meaningful differences in the outcomes of clinical PhD, PsyD, and counseling PhD programs. Furthermore, graduates from research-intensive universities perform better on the psychology licensure exam and are more likely to become American Board of Professional Psychology diplomates. The available data support the notion that the ability to conduct research is an essential component of graduate education. In this light, PsyD programs represent a unique opportunity to train students in the types of evaluation and outcomes assessments used by practicing psychologists. We discuss implications for graduate-level training in professional psychology. © 2011 Wiley Periodicals, Inc.

Start Making Sense: Practical Approaches to Outcomes Assessment for Libraries.

ERIC Educational Resources Information Center

Rabine, Julie; Cardwell, Catherine

2000-01-01

Discussion of the accountability of university libraries and assessment methods to show library effectiveness focuses on two assessment tools developed at Bowling Green State University: one program-level assessment which involved a student library skills assessment survey; and one class-level assessment which involved one-shot library instruction…

The immediate and long-term effects of exercise and patient education on physical, functional, and quality-of-life outcome measures after single-level lumbar microdiscectomy: a randomized controlled trial protocol.

PubMed

Selkowitz, David M; Kulig, Kornelia; Poppert, Elizabeth M; Flanagan, Sean P; Matthews, Ndidiamaka D; Beneck, George J; Popovich, John M; Lona, Jose R; Yamada, Kimiko A; Burke, Wendy S; Ervin, Carolyn; Powers, Christopher M

2006-08-25

Low back pain remains a costly quality-of-life-related health problem. Microdiscectomy is often the surgical procedure of choice for a symptomatic, single-level, lumbar disc herniation in younger and middle-aged adults. The question of whether a post-microdiscectomy exercise program enhances function, quality of life, and disability status has not been systematically explored. Thus, the overall purpose of this study is to assess immediate and long-term outcomes of an exercise program, developed at University of Southern California (USC), targeting the trunk and lower extremities (USC Spine Exercise Program) for persons who have undergone a single-level microdiscectomy for the first time. One hundred individuals between the ages of 18 and 60 who consent to undergo lumbar microdiscectomy will be recruited to participate in this study. Subjects will be randomly assigned to one of two groups: 1) one session of back care education, or 2) a back care education session followed by the 12-week USC Spine Exercise Program. The outcome examiners (evaluators), as well as the data managers, will be blinded to group allocation. Education will consist of a one-hour "one-on-one" session with the intervention therapist, guided by an educational booklet specifically designed for post-microdiscectomy care. This session will occur four to six weeks after surgery. The USC Spine Exercise Program consists of two parts: back extensor strength and endurance, and mat and upright therapeutic exercises. This exercise program is goal-oriented, performance-based, and periodized. It will begin two to three days after the education session, and will occur three times a week for 12 weeks. Primary outcome measures include the Oswestry Disability Questionnaire, Roland-Morris Disability Questionnaire, SF-36 quality of life assessment, Subjective Quality of Life Scale, 50-foot Walk, Repeated Sit-to-Stand, and a modified Sorensen test. The outcome measures in the study will be assessed before and after the 12-week post-surgical intervention program. Long-term follow up assessments will occur every six months beginning one year after surgery and ending five years after surgery. Immediate and long-term effects will be assessed using repeated measures multivariate analysis of variance (MANOVA). If significant interactions are found, one-way ANOVAs will be performed followed by post-hoc testing to determine statistically significant pairwise comparisons. We have presented the rationale and design for a randomized controlled trial evaluating the effectiveness of a treatment regimen for people who have undergone a single-level lumbar microdiscectomy.

An Assessment of Learning Outcomes in Short-Term Study Abroad and Human Rights Education

ERIC Educational Resources Information Center

Nagengast, Emil

2017-01-01

How does short-term study abroad affect students' attitudes toward human rights? What role does study abroad play in human rights education? This study assesses the learning outcomes of two study abroad programs that aimed to promote human rights education. I applied a mixed methods approach to measure the changes in the opinions of students who…

Technical Assistance and Changes in Nutrition and Physical Activity Practices in the National Early Care and Education Learning Collaboratives Project, 2015-2016.

PubMed

Chiappone, Alethea; Smith, Teresa M; Estabrooks, Paul A; Rasmussen, Cristy Geno; Blaser, Casey; Yaroch, Amy L

2018-04-26

The National Early Care and Education Learning Collaboratives Project (ECELC) aims to improve best practices in early care and education (ECE) programs in topic areas of the Nutrition and Physical Activity Self-Assessment in Child Care (NAP SACC). Technical assistance is a component of the ECELC, yet its effect on outcomes is unclear. Beyond dose and duration of technical assistance, limited research exists on characteristics of technical assistance that contribute to outcomes. The objective of this study was to identify and describe technical assistance characteristics and explore associations with NAP SACC outcomes. We collected data from 10 collaboratives comprising 84 ECE programs in 2 states in 2015-2016. The objective of technical assistance was to support programs in improving best practices. Technical assistance was provided to programs via on-site, telephone, or email and was tailored to program needs. We used a mixed-methods design to examine associations between technical assistance and NAP SACC outcomes. We used multiple regression analysis to assess quantitative data and qualitative comparative analysis to determine necessary and sufficient technical assistance conditions supporting NAP SACC outcomes. We also conducted a document review to describe technical assistance that referred conditions identified by the qualitative comparative analysis. Regression analyses detected an inverse relationship between changes in NAP SACC scores and hours of technical assistance. No clear pattern emerged in the qualitative comparative analysis, leaving no necessary and sufficient conditions. However, the qualitative comparative analysis identified feedback as a potentially important component of technical assistance, whereas resource sharing and frequent email were characteristics that seemed to reduce the likelihood of improved outcomes. Email and resource sharing were considered primarily general information rather than tailored technical assistance. Technical assistance may be used in programs and made adaptable to program needs. The inclusion and evaluation of technical assistance, especially tailored approaches, is warranted for environmental interventions, including ECE settings.

The Social and Productive Impacts of Zambia's Child Grant.

PubMed

Handa, Sudhanshu; Seidenfeld, David; Davis, Benjamin; Tembo, Gelson

2016-01-01

Accumulated evidence from dozens of cash transfer programs across the world suggest that there are few interventions that can match the range of impacts and cost-effectiveness of a small, predictable monetary transfer to poor families in developing countries. However, individual published impact assessments typically focus on only one program and one outcome. This article presents two-year impacts of the Zambian Government's Child Grant, an unconditional cash transfer to families with children under age five, across a wide range of domains including consumption, productive activity and women and children's outcomes, making this one of the first studies to assess both protective and productive impacts of a national unconditional cash transfer program. We show strong impacts on consumption, food security, savings and productive activity. However, impacts in areas such as child nutritional status and schooling depend on initial conditions of the household, suggesting that cash alone is not enough to solve all constraints faced by these poor, rural households. Nevertheless, the apparent transformative effects of this program suggest that unconditional transfers in very poor settings can contribute to both protection and development outcomes.

The Avahan Transition: Effects of Transition Readiness on Program Institutionalization and Sustained Outcomes

PubMed Central

Singh, Suneeta; Singh, Kriti; Chhabra, Vibha; Bennett, Sara

2016-01-01

Background With declines in development assistance for health and growing interest in country ownership, donors are increasingly faced with the task of transitioning health programs to local actors towards a path to sustainability. Yet there is little available guidance on how to measure and evaluate the success of a transition and its subsequent effects. This study assesses the transition of the Avahan HIV/AIDS prevention program in India to investigate how preparations for transition affected continuation of program activities post-transition. Methods Two rounds of two surveys were conducted and supplemented by data from government and Avahan Computerized Management Information Systems (CMIS). Exploratory factor analysis was used to develop two measures: 1) transition readiness pre-transition, and 2) institutionalization (i.e. integration of initial program systems into organizational procedures and behaviors) post-transition. A fixed effects model was built to examine changes in key program delivery outcomes over time. An ordinary least square regression was used to assess the relationship between transition readiness and sustainability of service outcomes both directly, and indirectly through institutionalization. Results Transition readiness data revealed 3 factors (capacity, alignment and communication), on a 15-item scale with adequate internal consistency (alpha 0.73). Institutionalization was modeled as a unidimensional construct, and a 12-item scale demonstrated moderate internal consistency (alpha 0.60). Coverage of key populations and condom distribution were sustained compared to pre-transition levels (p<0.01). Transition readiness, but not institutionalization, predicted sustained outcomes post-transition. Transition readiness did not necessarily lead to institutionalization of key program elements one year after transition. Conclusion Greater preparedness prior to transition is important to achieve better service delivery outcomes post-transition. This paper illustrates a methodology to measure transition readiness pre-transition to identify less ready organizations or program components in advance, improving the likelihood of service sustainability. Further research is needed around the conceptualization and development of measures of institutionalization and its effects on long-term program sustainability. PMID:27434542

Outcome evaluation of a 3-year senior health and wellness initiative.

PubMed

Kuczmarksi, Marie Fanelli; Cotugna, Nancy

2009-02-01

The Wilmington Senior Center developed a 3-year multidisciplinary health and wellness initiative entitled The Time of Your Life to promote healthy aging for participants attending countywide senior centers. The purpose of this paper is to describe the development and implementation of the evaluation methodology and outcomes of this senior health and wellness project that consisted of 11 programs in total. Long-term programming can present several challenges in both implementation and evaluation, but assessing outcomes is critical to documenting program value and accountability. Participant-completed surveys and post-series focus groups were utilized as the evaluation tools. Our findings indicate that the program's objectives of increasing knowledge and motivating adoption or maintenance of a healthy lifestyle were met to varying degrees, while a third objective of assessing the usefulness of resources to inform health-related decisions was unable to be evaluated due to the cross-sectional nature of the data collection. Post-series focus groups indicated that topics of most interest to seniors were money management, medications and staying mentally and physically fit. The evaluations showed that long-term programming, while challenging, can be a successful and sustainable format for senior health education.

Assessment of Quality Vocational Education in State Prisons. Executive Summary. Final Report.

ERIC Educational Resources Information Center

Rice, Eric; And Others

A study explored the relationship of program components and variables within successful correctional vocational education programs in adult state prisons, and the outcomes of those programs, leading to in-depth descriptions of exemplary programs in the full document on this project (see note). Program success was determined by the following data:…

For the Children's Sake: How To Develop a Tribal Teacher Education Program.

ERIC Educational Resources Information Center

Barden, Jack; Davis, Carol

1999-01-01

Describes the development of a teacher preparation program at Turtle Mountain Community College, which tries to balance pedagogy, subject matter, and culture in a holistic way. States that the program seeks to assess students in the program based on the outcomes they have achieved. Asserts that the hallmark of this embryonic program is…

Feasibility and Effectiveness of a Pilot Health Promotion Program for Adults With Type 2 Diabetes

PubMed Central

Kluding, Patricia M.; Singh, Rupali; Goetz, Jeanine; Rucker, Jason; Bracciano, Sarah; Curry, Natasha

2013-01-01

Purpose The purpose of this pilot study was to assess the feasibility and effectiveness of an intense health promotion program in older adults with diabetes. The program combined individually prescribed and supervised exercise with nutrition and education programs on glycemic control and aerobic fitness. Methods Various recruitment and retention strategies were analyzed for effectiveness. Out of 28 potential subjects assessed for eligibility, 6 subjects with type 2 diabetes (2 male and 4 female; all white; age, 60.2 ± 4.7 years) participated in the 10-week intervention. Aerobic and resistance exercise was performed on alternate days (3-4 days per week), with individualized nutrition counseling and diabetes health education sessions once weekly. The primary outcome measures were aerobic fitness and glycemic control (A1C), and secondary outcome measures included body mass index (BMI), self-efficacy, and symptoms of neuropathy. Changes in outcomes were assessed using descriptive statistics and paired t test analysis (α = .05). Results Following the intervention, subjects had improvements that approached significance in A1C and pain, with significant improvements in self-efficacy. Conclusions A systematic approach to analysis of feasibility revealed issues with recruitment and retention that would need to be addressed for future studies or clinical implementation of this program. However, for the subset of subjects who did complete the intervention, adherence was excellent, and satisfaction with the program was confirmed by exit interview comments. Following participation in this pilot health promotion program, subjects had meaningful improvements in glycemic control, pain, and self-efficacy. PMID:20530663

Evaluation of functional outcomes of physical rehabilitation and medical complications in spinal cord injury victims of the Sichuan earthquake.

PubMed

Li, Yongqiang; Reinhardt, Jan D; Gosney, James E; Zhang, Xia; Hu, Xiaorong; Chen, Sijing; Ding, Mingpu; Li, Jianan

2012-06-01

To characterize a spinal cord injury (SCI) population from the 2008 Sichuan earthquake in China; to evaluate functional outcomes of physical rehabilitation interventions; to assess potential determinants of rehabilitation effectiveness; and to assess medical complications and management outcomes. A total of 51 earthquake victims with SCI were enrolled and underwent rehabilitation programming. Functional rehabilitation outcomes included ambulation ability, wheelchair mobility and activities of daily living (ADL) assessed with the Modified Barthel Index at the beginning and end of rehabilitation. Effectiveness of rehabilitation and the effect of other predictors were evaluated by mixed effects regression. Outcomes of medical complication management were determined by comparison of the incidence of respective complications at the beginning and end of rehabilitation. Ambulation, wheelchair mobility and ADL were significantly improved with rehabilitation programming. Both earlier rescue and earlier onset of rehabilitation were significant positive predictors of rehabilitation effectiveness, whereas delayed onset of rehabilitation combined with prolonged time to rescue resulted in a lesser positive effect. Medical complications were managed effectively in 63% (pressure ulcers) to 85% (deep vein thrombosis) of patients during rehabilitation. Earthquake victims with SCI may achieve significantly improved functional rehabilitation functional outcomes on a formal, institutional-based physical rehabilitation programme.

Evaluating Willingness-to-Pay Thresholds for Dementia Caregiving Interventions: Application to the Tailored Activity Program

PubMed Central

Jutkowitz, Eric; Gitlin, Laura N.; Pizzi, Laura T.

2017-01-01

Objectives The study aims to apply willingness-to-pay (WTP) values derived from the literature to inform decision-makers of the cost-effectiveness of the Tailored Activity Program (TAP), an intervention proven to reduce caregiver burden. Methods TAP and other caregiver interventions employ an individual perspective and non–quality-adjusted life-year (QALY) outcome measure where the primary objective is to determine caregiver burden from an individual perspective. Therefore, standard cost/QALY thresholds are not appropriate. To identify relevant WTP values, we searched for studies that: 1) were published in the past 5 years and used contingent valuation methodology to identify WTP; 2) assessed WTP for a dementia-related intervention requiring out-of-pocket expenditure; and 3) asked caregivers their WTP for an outcome related to reducing caregiver burden. Three studies were identified utilizing four WTP values. We also assessed potential financial savings that caregivers could achieve from purchasing TAP. To assess the probability of TAP being cost-effective, we built a Monte Carlo simulation to test the four WTP values applied to two TAP outcome measures: reduction in caregiver hours “on duty;” and “doing things.” Results For outcome measure “on duty,” WTP varied between $1.06/hour and $4.58/hour. For outcome measure “doing things,” WTP varied between $2.21/hour and $9.57/hour. Applying the four identified WTP values from the literature to TAP outcomes resulted in TAP cost-effectiveness varying between 50% and 80% for both outcome measures. Conclusions When WTP data are not collected prospectively or conventional metrics cannot be applied, retrospectively assessing literature-derived WTP may be acceptable for informing decision-makers of potential cost-effectiveness of a proven program. Application of WTP to TAP shows potential cost-effectiveness that can be expected under the tested WTP scenarios. PMID:20561331

A concept for performance management for Federal science programs

USGS Publications Warehouse

Whalen, Kevin G.

2017-11-06

The demonstration of clear linkages between planning, funding, outcomes, and performance management has created unique challenges for U.S. Federal science programs. An approach is presented here that characterizes science program strategic objectives by one of five “activity types”: (1) knowledge discovery, (2) knowledge development and delivery, (3) science support, (4) inventory and monitoring, and (5) knowledge synthesis and assessment. The activity types relate to performance measurement tools for tracking outcomes of research funded under the objective. The result is a multi-time scale, integrated performance measure that tracks individual performance metrics synthetically while also measuring progress toward long-term outcomes. Tracking performance on individual metrics provides explicit linkages to root causes of potentially suboptimal performance and captures both internal and external program drivers, such as customer relations and science support for managers. Functionally connecting strategic planning objectives with performance measurement tools is a practical approach for publicly funded science agencies that links planning, outcomes, and performance management—an enterprise that has created unique challenges for public-sector research and development programs.

Further Validation of the Pathways Housing First Fidelity Scale.

PubMed

Goering, Paula; Veldhuizen, Scott; Nelson, Geoffrey B; Stefancic, Ana; Tsemberis, Sam; Adair, Carol E; Distasio, Jino; Aubry, Tim; Stergiopoulos, Vicky; Streiner, David L

2016-01-01

This study examined whether Housing First fidelity ratings correspond to program operation descriptions from administrative data and predict client outcomes. A multisite, randomized controlled trial (At Home/Chez Soi) in five Canadian cities included two assessments of 12 programs over two years. Outcomes for 1,158 clients were measured every six months. Associations between fidelity ratings and administrative data (Spearman correlations) and participant outcomes (mixed-effects modeling) were examined. Fidelity ratings were generally good (mean ± SD=136.6 ± 10.3 out of a possible range of 38-152; 87% of maximum value). Fidelity was significantly associated with three of four measures of program operation, with correlations between .55 and .60. Greater program fidelity was associated with improvement in housing stability, community functioning, and quality of life. Variation in program fidelity was associated with operations and outcomes, supporting scale validity and intervention effectiveness. These findings reinforced the value of using fidelity monitoring to conduct quality assurance and technical assistance activities.

Educational Effectiveness Review

DTIC Science & Technology

2010-08-01

Capstone Initiative ...................................................24 Student Engagement Initiative...Program ɢ Extending Direct Assessments – The Capstone Initiative ɢ Student Engagement Initiative ɢ Leveraging Professional Accreditation Practices...time graduation Student Outcomes • Quality Point Ratings (QPRs) • Capstone assessments • Employer, Sponsor assessments Student Engagement • Challenge

Assessment of the Joint Food Science Curriculum of Washington State University and the University of Idaho by Graduates and Their Employers

ERIC Educational Resources Information Center

Clark, Stephanie; McCurdy, Alan; Roy, Sharon; Smith, Denise

2006-01-01

Thirty-two recent graduates from the joint food science program of Washington State Univ. (WSU) and The Univ. of Idaho (UI) and 12 of their employers participated in a survey study to assess food science program outcomes. The objective of this study was to assess the joint curriculum in its ability to prepare undergraduate students for critical…

Study protocol: the Fueling Learning through Exercise (FLEX) study - a randomized controlled trial of the impact of school-based physical activity programs on children's physical activity, cognitive function, and academic achievement.

PubMed

Wright, Catherine M; Duquesnay, Paula J; Anzman-Frasca, Stephanie; Chomitz, Virginia R; Chui, Kenneth; Economos, Christina D; Langevin, Elizabeth G; Nelson, Miriam E; Sacheck, Jennifer M

2016-10-13

Physical activity (PA) is critical to preventing childhood obesity and contributes to children's overall physical and cognitive health, yet fewer than half of all children achieve the recommended 60 min per day of moderate-to-vigorous physical activity (MVPA). Schools are an ideal setting to meeting PA guidelines, but competing demands and limited resources have impacted PA opportunities. The Fueling Learning through Exercise (FLEX) Study is a randomized controlled trial that will evaluate the impact of two innovative school-based PA programs on children's MVPA, cognitive function, and academic outcomes. Twenty-four public elementary schools from low-income, ethnically diverse communities around Massachusetts were recruited and randomized to receive either 100 Mile Club® (walking/running program) or Just Move™ (classroom-based PA program) intervention, or control. Schoolchildren (grades 3-4, approximately 50 per school) were recruited to participate in evaluation. Primary outcome measures include PA via 7-day accelerometry (Actigraph GT3X+ and wGT3X-BT), cognitive assessments, and academic achievement via state standardized test scores. Additional measures include height and weight, surveys assessing psycho-social factors related to PA, and dietary intake. School-level surveys assess PA infrastructure and resources and intervention implementation. Data are collected at baseline, mid-point (5-6 months post-baseline), and post-intervention (approximately 1.5 years post-baseline). Demographic data were collected by parents/caregivers at baseline. Mixed-effect models will test the short- and long-term effects of both programs on minutes spent in MVPA, as well as secondary outcomes including cognitive and academic outcomes. The FLEX study will evaluate strategies for increasing children's MVPA through two innovative, low-cost, school-based PA programs as well as their impact on children's cognitive functioning and academic success. Demonstration of a relationship between school-based MVPA with neutral or improved, rather than diminished, academic outcomes in a naturalistic environment has the potential to positively influence investment in school PA programs and initiatives. ClinicalTrials.gov Identifier: NCT02810834 . Registered May 11, 2015. (Retrospectively registered).

Linking Essential Learning Outcomes and Interprofessional Collaborative Practice Competency in Health Science Undergraduates

ERIC Educational Resources Information Center

Reed, Carole-Rae; Garcia, Luis Ivan; Slusser, Margaret M.; Konowitz, Sharon; Yep, Jewelry

2017-01-01

Assessing student learning outcomes and determining achievement of the Interprofessional Collaborative Practice (IPCEP) Core Competency of Values/Ethics in a generic pre-professional Bachelor of Science in Health Science (BSHS) program is challenging. A course level Student Learning Outcome (SLO) is: "….articulate the impact of personal…

Outdoor Behavioral Health Care: Client and Treatment Characteristics Effects on Young Adult Outcomes

ERIC Educational Resources Information Center

Roberts, Sean D.; Stroud, Daniel; Hoag, Matthew J.; Combs, Katie M.

2016-01-01

A lack of clarity exists regarding how different clients respond to outdoor behavioral health care (OBH). In this study, specific client and treatment characteristics were assessed for 186 young adults completing an OBH therapeutic wilderness program. Clinical outcomes were measured with the Outcome Questionnaire-45.2. Hierarchical linear modeling…

A Case Study of Student Assessment Programs in a College of Business Administration at a Southern HBCU

ERIC Educational Resources Information Center

Bell Haynes, Janel Elizabeth

2013-01-01

The purpose of this mixed method sequential explanatory case study was to describe the relationship of a student outcomes assessment program, as measured by the Peregrine Academic Leveling Course, (ALC), to the academic performance, determined by scores on the Peregrine Common Professional Component (CPC) examination, of students enrolled during…

Assessing Impact of Physical Activity-Based Youth Development Programs: Validation of the "Life Skills Transfer Survey" (LSTS)

ERIC Educational Resources Information Center

Weiss, Maureen R.; Bolter, Nicole D.; Kipp, Lindsay E.

2014-01-01

Purpose: A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of…

A Needs Assessment for the Introduction of a Food Science Program at the Univ. of Guyana

ERIC Educational Resources Information Center

Morrison, Donna

2012-01-01

This research describes the outcome of a needs assessment to determine whether the Univ. of Guyana should introduce a Food Science program. The research design utilized interviews and questionnaires to large manufacturing organizations and agroprocessors to determine if the required skills are available for the manufacturing process. Results…

Developing a Deep Brain Stimulation Neuromodulation Network for Parkinson Disease, Essential Tremor, and Dystonia: Report of a Quality Improvement Project

PubMed Central

O’Suilleabhain, Padraig E.; Sanghera, Manjit; Patel, Neepa; Khemani, Pravin; Lacritz, Laura H.; Chitnis, Shilpa; Whitworth, Louis A.; Dewey, Richard B.

2016-01-01

Objective To develop a process to improve patient outcomes from deep brain stimulation (DBS) surgery for Parkinson disease (PD), essential tremor (ET), and dystonia. Methods We employed standard quality improvement methodology using the Plan-Do-Study-Act process to improve patient selection, surgical DBS lead implantation, postoperative programming, and ongoing assessment of patient outcomes. Results The result of this quality improvement process was the development of a neuromodulation network. The key aspect of this program is rigorous patient assessment of both motor and non-motor outcomes tracked longitudinally using a REDCap database. We describe how this information is used to identify problems and to initiate Plan-Do-Study-Act cycles to address them. Preliminary outcomes data is presented for the cohort of PD and ET patients who have received surgery since the creation of the neuromodulation network. Conclusions Careful outcomes tracking is essential to ensure quality in a complex therapeutic endeavor like DBS surgery for movement disorders. The REDCap database system is well suited to store outcomes data for the purpose of ongoing quality assurance monitoring. PMID:27711133

Developing a Deep Brain Stimulation Neuromodulation Network for Parkinson Disease, Essential Tremor, and Dystonia: Report of a Quality Improvement Project.

PubMed

Dewey, Richard B; O'Suilleabhain, Padraig E; Sanghera, Manjit; Patel, Neepa; Khemani, Pravin; Lacritz, Laura H; Chitnis, Shilpa; Whitworth, Louis A; Dewey, Richard B

2016-01-01

To develop a process to improve patient outcomes from deep brain stimulation (DBS) surgery for Parkinson disease (PD), essential tremor (ET), and dystonia. We employed standard quality improvement methodology using the Plan-Do-Study-Act process to improve patient selection, surgical DBS lead implantation, postoperative programming, and ongoing assessment of patient outcomes. The result of this quality improvement process was the development of a neuromodulation network. The key aspect of this program is rigorous patient assessment of both motor and non-motor outcomes tracked longitudinally using a REDCap database. We describe how this information is used to identify problems and to initiate Plan-Do-Study-Act cycles to address them. Preliminary outcomes data is presented for the cohort of PD and ET patients who have received surgery since the creation of the neuromodulation network. Careful outcomes tracking is essential to ensure quality in a complex therapeutic endeavor like DBS surgery for movement disorders. The REDCap database system is well suited to store outcomes data for the purpose of ongoing quality assurance monitoring.

Client Assessment in an Industrial Setting: A Cross-Sectional Method.

ERIC Educational Resources Information Center

Yamatani, Hide

1988-01-01

Used cross-sectional method for evaluating social service programs in industrial setting to estimate numbers of workers needing social services, levels of program use, and penetration and to examine program outcome. Workers served by social service or employee assistance programs can be examined to determine additional services needed, adequacy of…

Eight Weeks of Strength and Power Training Improves Club Head Speed in Collegiate Golfers.

PubMed

Oranchuk, Dustin J; Mannerberg, Jason M; Robinson, Tracey L; Nelson, Megan C

2018-02-14

Club head speed (CHS) is a major determinant of drive distance, a key component of golf performance. The purpose of this study was to determine the indirect effects of an eight-week strength and power program on CHS. Twelve (6 male, 6 female) NCAA Division II golfers (20.3±1.5 years) randomly assigned to an intervention or control group, underwent either a periodized strength and power program consisting of high-load barbell movements or a bodyweight and rotational movement focused resistance training program. Outcomes were CHS, countermovement jump (CMJ) height, and 1RM back squat (BS), power clean (PC), and deadlift (DL). Dependent t-tests were utilized to assess differences in outcome variables pre-to-post for each group, independent t-tests were utilized to assess differences between groups, and Pearson correlations were utilized to assess associations between CHS and outcome variables. On average, the intervention group experienced improvements in all outcome variables except peak CHS (p=0.60); the control group displayed no changes in any outcome variable except a decrease in average CHS (p=0.028). Compared to the control group, the intervention group experienced greater improvements in average CHS, BS, PC, and average and peak CMJ height (p<0.05). Additionally, CHS had large associations with PC (r=0.70, p=0.012), BS (r=0.64, p=0.025), DL (r=0.54, p=0.068) and CMJ (r=0.73, p=0.007). These results suggest improving muscular strength and power by increasing PC, BS, and CMJ is associated with increased CHS in collegiate golfers. Integrating a high-load, barbell-focused strength and power program may be beneficial for improving CHS and indirectly, golf performance.

Using Alumni Research To Assess a Veterinary Curriculum and Alumni Employment and Reward Patterns.

ERIC Educational Resources Information Center

Bristol, David G.

2002-01-01

Surveyed alumni of North Carolina State University's veterinary program to ascertain outcomes of their education. Findings included career path, earnings, satisfaction with the program, and gender differences. (EV)

The effect of the AED and AED programs on survival of individuals, groups and populations.

PubMed

Stokes, Nathan Allen; Scapigliati, Andrea; Trammell, Antoine R; Parish, David C

2012-10-01

The automated external defibrillator (AED) is a tool that contributes to survival with mixed outcomes. This review assesses the effectiveness of the AED, consistencies and variations among studies, and how varying outcomes can be resolved. A worksheet for the International Liaison Committee on Resuscitation (ILCOR) 2010 science review focused on hospital survival in AED programs was the foundation of the articles reviewed. Articles identified in the search covering a broader range of topics were added. All articles were read by at least two authors; consensus discussions resolved differences. AED use developed sequentially. Use of AEDs by emergency medical technicians (EMTs) compared to manual defibrillators showed equal or superior survival. AED use was extended to trained responders likely to be near victims, such as fire/rescue, police, airline attendants, and casino security guards, with improvement in all venues but not all programs. Broad public access initiatives demonstrated increased survival despite low rates of AED use. Home AED programs have not improved survival; in-hospital trials have had mixed results. Successful programs have placed devices in high-risk sites, maintained the AEDs, recruited a team with a duty to respond, and conducted ongoing assessment of the program. The AED can affect survival among patients with sudden ventricular fibrillation (VF). Components of AED programs that affect outcome include the operator, location, the emergency response system, ongoing maintenance and evaluation. Comparing outcomes is complicated by variations in definitions of populations and variables. The effect of AEDs on individuals can be dramatic, but the effect on populations is limited.

The Development and Assessment of an NIH-Funded Research Ethics Training Program

PubMed Central

DuBois, James M.; Dueker, Jeffrey M.; Anderson, Emily E.; Campbell, Jean

2015-01-01

In an effort to increase the number of researchers with skills “in identifying and addressing the ethical, legal, and social implications of their research,” the National Institutes of Health (NIH) solicited training grant proposals from 1999 to 2004 and subsequently funded approved programs. The authors describe the content, format, and outcomes of one such training program that ran from 2002–2006 and shares key lessons learned about program formats and assessment methods. Jointly developed by the Saint Louis University Center for Health Care Ethics and the Missouri Institute of Mental Health Continuing Education department, the training program focused on mental health research and adopted a train-the-trainer model. It was offered in onsite and distance-learning formats. Key outcomes of the program included educational products (such as 70 case studies posted on the course website, a textbook, and an instructional DVD) and program completion by 40 trainees. Assessment involved pre- and post-testing focused on knowledge of research ethics, ethical problem-solving skills, and levels of confidence in addressing ethical issues in mental health research. The program succeeded in increasing participants’ knowledge of ethical issues and their beliefs that they could identify issues, identify problem-solving resources, and solve ethical problems. However, scores on the case-based problem-solving assessment dropped in post-testing, apparently due to diminished confidence about the right course of action in the specific dilemma presented; the implications of this finding for ethics assessment are discussed. Overall satisfaction was high and dropout rates were low, but 3 times higher for distance-learners than onsite participants. PMID:18520469

Assessment in the context of licensure and certification.

PubMed

Norcini, John J; Lipner, Rebecca S; Grosso, Louis J

2013-01-01

Over the past 25 years, three major forces have had a significant influence on licensure and certification: the shift in focus from educational process to educational outcomes, the increasing recognition of the need for learning and assessment throughout a physician's career, and the changes in technology and psychometrics that have opened new vistas for assessment. These forces have led to significant changes in assessment for licensure and certification. To respond to these forces, licensure and certification programs have improved the ways in which their examinations are constructed, scored, and delivered. In particular, we note the introduction of adaptive testing; automated item creation, scoring, and test assembly; assessment engineering; and data forensics. Licensure and certification programs have also expanded their repertoire of assessments with the rapid development and adoption of simulation and workplace-based assessment. Finally, they have invested in research intended to validate their programs in four ways: (a) the acceptability of the program to stakeholders, (b) the extent to which stakeholders are encouraged to learn and improve, (c) the extent to which there is a relationship between performance in the programs and external measures, and (d) the extent to which there is a relationship between performance as measured by the assessment and performance in practice. Over the past 25 years, changes in licensure and certification have been driven by the educational outcomes movement, the need for lifelong learning, and advances in technology and psychometrics. Over the next 25 years, we expect these forces to continue to exert pressure for change which will lead to additional improvement and expansion in examination processes, methods of assessment, and validation research.

Validity of surveys to assess safe routes to school programs

USDA-ARS?s Scientific Manuscript database

Safe Routes to School programs are designed to make walking and bicycling to school safe and accessible for children. These programs promote children's physical activity and show promise for obesity prevention. However, there are few validated surveys to measure important outcomes such as student tr...

Preschool Education Programs for Children with Autism.

ERIC Educational Resources Information Center

Harris, Sandra L., Ed.; Handleman, Jan S., Ed.

This book highlights 10 preschool education programs for children with autism, focusing on each program's structure and content, diagnosis and assessment, staffing and administration, curriculum, integration, use of aversive behavior modification techniques, family involvement, and outcomes. The book consists of 11 chapters, the first of which is…

Implementation and outcomes of commercial disease management programs in the United States: the disease management outcomes consolidation survey.

PubMed

Fitzner, Karen; Fox, Kathe; Schmidt, Joseph; Roberts, Mark; Rindress, Donna; Hay, Joel

2005-08-01

Despite widespread adoption of disease management (DM) programs by US health plans, gaps remain in the evidence for their benefit. The Disease Management Outcomes Consolidation Survey was designed to gather data on DM programs for commercial health plans, to assess program success and DM effectiveness. The questionnaire was mailed to 292 appropriate health plan contacts; 26 plans covering more than 14 million commercial members completed and returned the survey. Respondents reported that DM plays a significant and increasing role in their organizations. Key reasons for adopting DM were improving clinical outcomes, reducing medical costs and utilization, and improving member satisfaction. More respondents were highly satisfied with clinical results than with utilization or cost outcomes of their programs (46%, 17%, and 13%, respectively). Detailed results were analyzed for 57 DM programs with over 230,000 enrollees. Most responding plans offered DM programs for diabetes and asthma, with return on investment (ROI) ranging from 0.16:1 to 4:1. Weighted by number of enrollees per DM program, average ROI was 2.56:1 for asthma (n = 1,136 enrollees) and 1.98:1 for diabetes (n = 25,364). Most (but not all) respondents reported reduced hospital admissions, increasing rates of preventive care, and improved clinical measures. Few respondents provided detailed information about DM programs for other medical conditions, but most that did reported positive outcomes. Lack of standardized methodology was identified as a major barrier to in-house program evaluation. Although low response rate precluded drawing many general conclusions, a clear need emerged for more rigorous evaluation methods and greater standardization of outcomes measurement.

Redesigning care for patients at increased hospitalization risk: the Comprehensive Care Physician model.

PubMed

Meltzer, David O; Ruhnke, Gregory W

2014-05-01

Patients who have been hospitalized often experience care coordination problems that worsen outcomes and increase costs. One reason is that hospital care and ambulatory care are often provided by different physicians. However, interventions to improve care coordination for hospitalized patients have not consistently improved outcomes and generally have not reduced costs. We describe the rationale for the Comprehensive Care Physician model, in which physicians focus their practice on patients at increased risk of hospitalization so that they can provide both inpatient and outpatient care to their patients. We also describe the design and implementation of a study supported by the Center for Medicare and Medicaid Innovation to assess the model's effects on costs and outcomes. Evidence concerning the effectiveness of the program is expected by 2016. If the program is found to be effective, the next steps will be to assess the durability of its benefits and the model's potential for dissemination; evidence to the contrary will provide insights into how to alter the program to address sources of failure.

Using Q Methodology to Assess Learning Outcomes Following the Implementation of a Concept-Based Curriculum.

PubMed

Hensel, Desiree

The use of a concept-based curriculum in nursing education is increasing, but assessing its impact remains challenging. This project discusses how Q methodology was used to evaluate our prelicensure program's outcome of creating practitioners who were ready to practice in diverse environments before and after a concept-based curricular revision. The successes and challenges of the revision are discussed.

Telephone screening, outreach, and care management for depressed workers and impact on clinical and work productivity outcomes: a randomized controlled trial

PubMed Central

Wang, Philip S.; Simon, Gregory E.; Avorn, Jerry; Azocar, Francisca; Ludman, Evette J.; McCulloch, Joyce; Petukhova, Maria Z.; Kessler, Ronald C.

2010-01-01

Context Although guideline-concordant depression treatment is clearly effective, treatment often falls short of evidence-based recommendations. Organized depression care programs significantly improve treatment quality, but employer-purchasers have been slow to demand these programs based on lack of evidence for cost-effectiveness from their perspective. Objective To evaluate the effects of a depression outreach-treatment program on workplace outcomes of concern to employers. Design Randomized controlled trial with allocation concealment and blinded assessment of depression severity and work performance at 6 and 12 months. Setting and Participants Two-stage screening of employees covered by a managed behavioral health plan identified 604 with clinically significant depression (excluding those with lifetime bipolar disorder, substance disorder, recent mental health specialty care, or suicidality). Intervention A telephonic outreach and care management program encouraged workers to enter outpatient treatment (psychotherapy and/or antidepressant medication), monitored treatment quality-continuity, and attempted to improve treatment by giving recommendations to providers. Participants reluctant to enter treatment were offered a structured telephone cognitive-behavioral psychotherapy. Main Outcome Measures Depression severity (Quick Inventory of Depressive Symptomatology, QIDS-SR) and work performance (WHO Health and Productivity Questionnaire, HPQ, a validated self-report instrument assessing job retention, time missed from work, work performance, and critical workplace incidents). Results Combining data across 6-month and 12-month assessments, the intervention group had significantly lower QIDS-SR scores (1.4 relative-odds of recovery), significantly higher job retention (1.7 relative-odds), and significantly more hours worked among the employed (equivalent to an annualized effect of approximately 2.5 weeks of work) than usual care subjects. Conclusions A systematic program to identify depression and promote effective treatment significantly improves not only clinical outcomes but also workplace outcomes. The financial value of the latter to employers in terms of recovered hiring-training and salary costs suggests that many employers would experience a positive return on investment from outreach and enhanced treatment of depressed workers. PMID:17895456

Building Faculty Community: Fellowship in Graduate Medical Education Administration

PubMed Central

Edler, Alice A.; Dohn, Ann; Davidson, Heather A.; Grewal, Daisy; Behravesh, Bardia; Piro, Nancy

2009-01-01

Introduction The Department of Graduate Medical Education at Stanford Hospital and Clinics has developed a professional training program for program directors. This paper outlines the goals, structure, and expected outcomes for the one-year Fellowship in Graduate Medical Education Administration program. Background The skills necessary for leading a successful Accreditation Council for Graduate Medical Education (ACGME) training program require an increased level of curricular and administrative expertise. To meet the ACGME Outcome Project goals, program directors must demonstrate not only sophisticated understanding of curricular design but also competency-based performance assessment, resource management, and employment law. Few faculty-development efforts adequately address the complexities of educational administration. As part of an institutional-needs assessment, 41% of Stanford program directors indicated that they wanted more training from the Department of Graduate Medical Education. Intervention To address this need, the Fellowship in Graduate Medical Education Administration program will provide a curriculum that includes (1) readings and discussions in 9 topic areas, (2) regular mentoring by the director of Graduate Medical Education (GME), (3) completion of a service project that helps improve GME across the institution, and (4) completion of an individual scholarly project that focuses on education. Results The first fellow was accepted during the 2008–2009 academic year. Outcomes for the project include presentation of a project at a national meeting, internal workshops geared towards disseminating learning to peer program directors, and the completion of a GME service project. The paper also discusses lessons learned for improving the program. PMID:21975722

77 FR 32952 - Notice of Proposed Collection Requests; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-04

... has two main components: (1) A review of recent research on the identification of ELs with special... descriptive in nature. The study is not a program evaluation and does not purport to assess program outcomes...

Final Report on the Multicultural/Diversity Assessment Project.

ERIC Educational Resources Information Center

Ambrosio, Anthony L.

The Emporia State University Multicultural/Diversity Project developed a set of assessment instruments and a model evaluation plan to assess multicultural/diversity (MCD) outcomes in teacher education and general education programs. Assessment instruments and techniques were constructed to evaluate the impact of coursework on student attitudes,…

Applications and Challenges in Dynamic Assessment.

ERIC Educational Resources Information Center

Haywood, H. Carl; Tzuriel, David

2002-01-01

Reviews what is known about dynamic assessment, offering examples of its utility as a tool for research and clinical work in psychopathology, neuropsychology, education, the study of cultural differences, and developmental research. After discussing the use of dynamic assessment in assessing outcomes of cognitive education programs, the paper…

Measuring Assessment Climate: A Developmental Perspective

ERIC Educational Resources Information Center

Stevenson, John F.; Finan, Elaine; Martel, Michael

2017-01-01

Externally imposed assessment requirements in higher education call for documented attention to using assessment results for program improvement. Although this systematic process promises to lead to better learning outcomes it has also been challenged as ineffective and even harmful. What can make assessment truly meaningful and move beyond the…

A Framework for Authentic Literacy Assessment.

ERIC Educational Resources Information Center

Paris, Scott G.; And Others

1992-01-01

Presents a framework for literacy assessment that can be adapted to suit the assessment needs of particular schools and districts. Describes a process of decision making about authentic literacy assessments that schools should emulate to achieve consensus about literacy outcomes and processes. Discusses the Kamehameha Elementary Education Program.…

Tapping the potential of alternative medicine.

PubMed

La Puma, J; Eiler, G

1998-04-01

Interest in alternative medicine is growing among healthcare consumers. Health plans and healthcare organizations may be able to improve clinical outcomes and benefit financially by providing patients with access to alternative services. Organizations that can assess their communities' particular needs, draw on interested professional staff to help develop alternative medicine programs and protocols, and study quality outcomes will stand a better chance of making such programs successful. Educating medical staff, designing a credible program, and forging strategic alliances with respected partners can help organizations create a sharply focused brand identity in the community.

The Log Handwriting Program improved children's writing legibility: a pretest-posttest study.

PubMed

Mackay, Nadine; McCluskey, Annie; Mayes, Rachel

2010-01-01

We determined the feasibility and outcomes of the Log Handwriting Program (Raynal, 1990), an 8-week training program based on task-specific practice of handwriting. We used a pretest-posttest design involving 16 first- and second-grade Australian students. Handwriting training sessions occurred in schools for 45 min per week over 8 weeks, in groups of 2 or 3. Weekly homework was provided. The primary outcome measure was the Minnesota Handwriting Assessment (range = 0 to 34; Reisman, 1999). Legibility, form, alignment, size, spacing, and speed were measured. All six assessment subscales showed statistically significant differences. Legibility improved by a mean of 4.1 points (95% confidence interval = 2.5 to 5.7); form, 5.3 points; alignment, 7.8 points; size, 7.9 points; and space, 5.3 points. Speed decreased by 3.9 points. Preliminary evidence indicates that an 8-week Log Handwriting Program is feasible and improved handwriting in primary school children.

The Economic Return on PCCD's Investment in Research-Based Programs: A Cost-Benefit Assessment of Delinquency Prevention in Pennsylvania

ERIC Educational Resources Information Center

Jones, Damon; Bumbarger, Brian K.; Greenberg, Mark T.; Greenwood, Peter; Kyler, Sandee

2008-01-01

This report considers the cost-effectiveness potential for seven research-based programs funded by the Pennsylvania Commission on Crime and Delinquency (PCCD). These programs are highlighted because they represent the bulk of the PCCD's investment in prevention programming and because there are existing longitudinal data on program outcomes from…

Comprehensive Outpatient Rehabilitation Program: Hospital-Based Stroke Outpatient Rehabilitation.

PubMed

Rice, Danielle; Janzen, Shannon; McIntyre, Amanda; Vermeer, Julianne; Britt, Eileen; Teasell, Robert

2016-05-01

Few studies have considered the effectiveness of outpatient rehabilitation programs for stroke patients. The objective of this study was to assess the effectiveness of a hospital-based interdisciplinary outpatient stroke rehabilitation program with respect to physical functioning, mobility, and balance. The Comprehensive Outpatient Rehabilitation Program provides a hospital-based interdisciplinary approach to stroke rehabilitation in Southwestern Ontario. Outcome measures from physiotherapy and occupational therapy sessions were available at intake and discharge from the program. A series of paired sample t-tests were performed to assess patient changes between time points for each outcome measure. A total of 271 patients met the inclusion criteria for analysis (56.1% male; mean age = 62.9 ± 13.9 years). Significant improvements were found between admission and discharge for the Functional Independence Measure, grip strength, Chedoke-McMaster Stroke Assessment, two-minute walk test, maximum walk test, Timed Up and Go, Berg Balance Scale, and one-legged stance (P < .003 for all). The findings indicate that an interdisciplinary rehabilitation program was effective at improving the physical functioning, mobility, and balance of individuals after a stroke. A hospital-based, stroke-specific rehabilitation program should be considered when patients continue to experience deficits after inpatient rehabilitation. Copyright © 2016 National Stroke Association. Published by Elsevier Inc. All rights reserved.

A pilot study of a combined group and individual functional remediation program for patients with bipolar I disorder.

PubMed

Zyto, Susan; Jabben, Nienke; Schulte, Peter F J; Regeer, Barbara J; Kupka, Ralph W

2016-04-01

Bipolar disorder has been associated with a decrease in cognitive functioning affecting the functional outcome of patients independent of mood states. However, there have only been few attempts to investigate the effects of functional remediation for patients with bipolar disorder. The current study investigates the feasibility and effectiveness of a combined group and individual functional remediation program for bipolar disorder, including both patients and their caregivers. Twelve participants diagnosed with bipolar I disorder, and their caregivers, were treated with a combined group and individual functional remediation program. The feasibility of the program was evaluated by dropout rates and participants' evaluations of the program. The effectiveness of the program was explored through the assessment of functional outcome at baseline, immediately post-treatment, and follow-up three months later. The results indicate a high degree of satisfaction and a low dropout rate with the current program. Assessment of outcomes suggests improved functioning in the areas of autonomy and occupational functioning, evolving from baseline to follow-up. Due to a small sample size and the lack of a control group the results are preliminary. This relatively brief intervention offers a more tailor-made approach to functional remediation and shows good feasibility, acceptability and improvement of functioning in patients with bipolar I disorder. Copyright © 2016 Elsevier B.V. All rights reserved.

Suicide prevention as a community development process: understanding circumpolar youth suicide prevention through community level outcomes.

PubMed

Allen, James; Mohatt, Gerald; Fok, Carlotta Ching Ting; Henry, David

2009-06-01

Community-based models have become increasingly prominent in prevention, and have special relevance for suicide prevention in circumpolar Indigenous communities. It follows that outcomes from circumpolar suicide prevention programs might be more completely understood at the community level. We present here a methodology for analysis at this level. This paper seeks to understand a cultural prevention program for rural Yup'ik youth in Alaska targeting suicide and co-occurring alcohol abuse as a community development process through changes at the community level. Quasi-experimental design with assessment at pre- and post-intervention or at 4 time points. The community development process for this project began in October 2004. The first program baseline assessment began in November 2006, prior to prevention activities with youth and parents, and the post-intervention assessment concluded in March 2008. Five key informants pre- and post-intervention completed a community readiness assessment, which is a structured procedure assessing a community's awareness of suicide as an issue and its, organizational readiness for prevention programming. Forty-three adult caregivers or sponsors of youth in the prevention program completed an assessment of behaviours that contributed to community protective factors from youth suicide and alcohol abuse at 4 time points before, during and after the intervention. The 54 youth who participated in the prevention program completed an assessment of community protective factors, also at 4 time points before, during and after the intervention. The community protective factors from suicide that were assessed included safety, enforcement of alcohol prohibitions, role models, support and opportunities for youth. Community readiness for the prevention efforts increased to new developmental stages of readiness post-intervention, and a trend in the data suggested community protective factors increased in the amount of protective behaviours performed by adults (slope estimate = 0.0162, 95% CI--0.0028-0.0351, d=.55) and in the perceptions of youth (slope estimate=0.0148, 95% CI--0.0004-0.0291, d=.45), in a dose response relationship to the number of prevention program sessions attended by adults and youth. Using data from a feasibility study, this paper demonstrates the feasibility and potential utility of methodological approaches that use community-level variables beyond individual level outcomes in circumpolar suicide prevention research.

Health benefits of aerobic training programs in adults aged 70 and over: a systematic review.

PubMed

Bouaziz, Walid; Vogel, Thomas; Schmitt, Elise; Kaltenbach, Georges; Geny, Bernard; Lang, Pierre Olivier

Aging is intrinsically associated with a progressive decline in muscle strength and mass, and aerobic capacity. This contributes to reduced mobility and impaired quality of life (QoL) among seniors. Regular physical activity, and more particularly aerobic training (AT), has demonstrated benefits on adults' health. The aim of this review was to assess the current level of evidence regarding the health benefits of AT in the population aged 70 years and over. A comprehensive, systematic database search for manuscripts was performed. Two reviewers independently assessed interventional studies for potential inclusion. Cardiovascular, metabolic, functional, cognitive, and QoL outcomes were targeted. Fifty-three studies were included totalling 2051 seniors aged 70 years and over. Studies selected were divided into 5 categories according to their main outcomes: cardiovascular function (34 studies), metabolic outcomes (26 studies), functional fitness (19 studies), cognitive functions (8 studies), and QoL (3 studies). With a good level of evidence but a wide heterogeneity between study designs, a significant and beneficial effect of AT was measured on the 5 outcomes. For QoL results showed a significant but slighter improvement. This systematic review highlights the benefits of AT on seniors' health outcome such as cardiovascular, functional, metabolic, cognitive, and QoL outcomes although the optimal program remains unclear. When more studies regarding this specific population are needed to determine the most favourable exercise program, clinicians should nevertheless encourage older adults over 70 to participate in AT programs to favour active and healthy ageing. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating a Nutrition Education Program for Pregnant Teen-Agers: Cognitive vs. Behavioral Outcomes.

ERIC Educational Resources Information Center

Perkin, Judy

1983-01-01

A manual on nutrition during pregnancy and lactation was developed and used with pregnant teenagers. Evaluation of the program showed that, while participants' knowledge of nutrition improved, their eating habits did not. The need for behavioral assessment of nutrition education programs is pointed out. (Author/PP)

Approaches for Evaluating the NRC Resident Research Associateship Program at NIST

ERIC Educational Resources Information Center

Sislin, John, Ed.

2007-01-01

The NRC Resident Research Associateship Program at NIST provides two-year temporary appointments for outstanding scientists and engineers. This book describes program applicants and awardees and offers suggestions for an in-depth assessment of career outcomes. Preliminary investigation indicates that outreach efforts produce more qualified…

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

Reliability of questionnaires to assess the healthy eating and activity environment of a child's home and school.

PubMed

Wilson, Annabelle; Magarey, Anthea; Mastersson, Nadia

2013-01-01

Childhood overweight and obesity are a growing concern globally, and environments, including the home and school, can contribute to this epidemic. This paper assesses the reliability of two questionnaires (parent and teacher) used in the evaluation of a community-based childhood obesity prevention intervention, the eat well be active (ewba) Community Programs. Parents and teachers were recruited from two primary schools and they completed the same questionnaire twice in 2008 and 2009. Data from both questionnaires were classified into outcomes relevant to healthy eating and activity, and target outcomes, based on the goals of the ewba Community Programs, were identified. Fourteen and 12 outcomes were developed from the parent and teacher questionnaires, respectively. Sixty parents and 28 teachers participated in the reliability study. Intraclass correlation coefficients for outcomes ranged from 0.37 to 0.92 (parent) (P < 0.05) and from 0.42 to 0.86 (teacher) (P < 0.05). Internal consistency, measured by Cronbach's alpha, of teacher scores ranged from 0.11 to 0.91 and 0.13 to 0.78 for scores from the parent questionnaire. The parent and teacher questionnaires are moderately reliable tools for simultaneously assessing child intakes, environments, attitudes, and knowledge associated with healthy eating and physical activity in the home and school and may be useful for evaluation of similar programs.

Policy and System Change and Community Coalitions: Outcomes from Allies against Asthma

ERIC Educational Resources Information Center

Clark, Noreen M.; Lachance, Laurie; Doctor, Linda Jo; Gilmore, Lisa; Kelly, Cindy; Krieger, James; Lara, Marielena; Meurer, John; Friedman Milanovich, Amy; Nicholas, Elisa; Rosenthal, Michael; Stoll, Shelley C.; Wilkin, Margaret

2014-01-01

Objectives: We assessed policy and system changes and health outcomes produced by the Allies Against Asthma program, a 5-year collaborative effort by 7 community coalitions to address childhood asthma. We also explored associations between community engagement and outcomes. Methods: We interviewed a sample of 1,477 parents of children with asthma…

Psychological Assessment Training in Clinical Psychology Doctoral Programs.

PubMed

Mihura, Joni L; Roy, Manali; Graceffo, Robert A

2017-01-01

We surveyed American Psychological Association-accredited clinical psychology doctoral programs' (n = 83) training in psychological assessment-specifically, their coverage of various assessment topics and tests in courses and practica, and whether the training was optional or required. We report results overall and separately per training model (clinical science, scientist-practitioner, and practitioner-focused). Overall, our results suggest that psychological assessment training is as active, or even more active, than in previous years. Areas of increased emphasis include clinical interviewing and psychometrics; multimethod, outcomes, health, and collaborative or therapeutic assessment; and different types of cognitive and self-report personality tests. All or almost all practice-focused programs offered training with the Thematic Apperception Test and Rorschach compared to about half of the scientist-practitioner programs and a third of the clinical science programs. Although almost all programs reported teaching multimethod assessment, what constitutes different methods of assessing psychopathology should be clarified in future studies because many programs appear to rely on one method-self-report (especially clinical science programs). Although doctoral programs covered many assessment topics and tests in didactic courses, there appears to be a shortage of program-run opportunities for students to obtain applied assessment training. Finally, we encourage doctoral programs to be familiar with (a) internships' assessment expectations and opportunities, (b) the professional guidelines for assessment training, and (c) the American Psychological Association's requirements for preinternship assessment competencies.

Assessment of Student and Faculty Mentor Perceptions of an International Undergraduate Research Program in Physical Geography

ERIC Educational Resources Information Center

Houser, Chris; Cahill, Anthony; Lemmons, Kelly

2014-01-01

In this study, we assess whether students and their faculty mentors in a Research Experience for Undergraduates program have similar perceptions about the relative importance of different outcomes of their study abroad experience. Results of a Q-analysis reveal a significant difference of opinion between the students and the faculty mentors. It is…

Design and Development of Rubrics to Improve Assessment Outcomes: A Pilot Study in a Master's Level Business Program in India

ERIC Educational Resources Information Center

Reddy, Malini Y.

2011-01-01

Purpose: This paper seeks to discuss the characteristics that describe a rubric. It aims to propose a systematic method for developing curriculum wide rubrics and to discuss their potential utility for program quality assessment. Design/methodology/approach: Implementation of rubrics is a recent phenomenon in higher education. Prior research and…

Effects of Participation in after-School Programs for Middle School Students: A Randomized Trial

ERIC Educational Resources Information Center

Gottfredson, Denise; Cross, Amanda Brown; Wilson, Denise; Rorie, Melissa; Connell, Nadine

2010-01-01

This study assessed the effects of attending an after-school program (ASP) on a range of outcomes for middle school youths. The program operated for 9 hr per week for 30 weeks and included attendance monitoring and reinforcement, academic assistance, a prevention curriculum, and recreational programming. Participants were 447 students randomly…

Assessing Fidelity of Core Components in a Mindfulness and Yoga Intervention for Urban Youth: Applying the CORE Process

ERIC Educational Resources Information Center

Gould, Laura Feagans; Mendelson, Tamar; Dariotis, Jacinda K.; Ancona, Matthew; Smith, Ali S. R.; Gonzalez, Andres A.; Smith, Atman A.; Greenberg, Mark T.

2014-01-01

In the past years, the number of mindfulness-based intervention and prevention programs has increased steadily. In order to achieve the intended program outcomes, program implementers need to understand the essential and indispensable components that define a program's success. This chapter describes the complex process of identifying the core…

An Evaluation of On-Line, Interactive Tutorials Designed to Teach Practice Concepts

ERIC Educational Resources Information Center

Seabury, Brett A.

2005-01-01

This paper presents an evaluation of two on-line-based programs designed to teach practice skills. One program teaches crisis intervention and the other teaches suicide assessment. The evaluation of the use of these programs compares outcomes for two groups of students, one using the interactive program outside a class context and the other using…

Is voluntary certification of tropical agricultural commodities achieving sustainability goals for small-scale producers? A review of the evidence

NASA Astrophysics Data System (ADS)

DeFries, Ruth S.; Fanzo, Jessica; Mondal, Pinki; Remans, Roseline; Wood, Stephen A.

2017-03-01

Over the last several decades, voluntary certification programs have become a key approach to promote sustainable supply chains for agricultural commodities. These programs provide premiums and other benefits to producers for adhering to environmental and labor practices established by the certifying entities. Following the principles of Cochrane Reviews used in health sciences, we assess evidence to evaluate whether voluntary certification of tropical agricultural commodities (bananas, cocoa, coffee, oil palm, and tea) has achieved environmental benefits and improved economic and social outcomes for small-scale producers at the level of the farm household. We reviewed over 2600 papers in the peer-review literature and identified 24 cases of unique combinations of study area, certification program, and commodity in 16 papers that rigorously analyzed differences between treatment (certified households) and control groups (uncertified households) for a wide range of response variables. Based on analysis of 347 response variables reported in these papers, we conclude that certification is associated on average with positive outcomes for 34% of response variables, no significant difference for 58% of variables, and negative outcomes for 8% of variables. No significant differences were observed for different categories of responses (environmental, economic and social) or for different commodities (banana, coffee and tea), except negative outcomes were significantly less for environmental than other outcome categories (p = 0.01). Most cases (20 out of 24) investigated coffee certification and response variables were inconsistent across cases, indicating the paucity of studies to conduct a conclusive meta-analysis. The somewhat positive results indicate that voluntary certification programs can sometimes play a role in meeting sustainable development goals and do not support the view that such programs are merely greenwashing. However, results also indicate that certification is not a panacea to improve social outcomes or overall incomes of smallholder farmers. Rigorous analysis, standardized criteria, and independent evaluation are needed to assess effectiveness of certification programs in the future.

Residents-as-Teachers Publications: What Can Programs Learn From the Literature When Starting a New or Refining an Established Curriculum?

PubMed

Bree, Kelly K; Whicker, Shari A; Fromme, H Barrett; Paik, Steve; Greenberg, Larrie

2014-06-01

Teaching residents how to teach is a critical part of resident education because residents are often the major teachers of medical students. The importance of formal residents-as-teachers (RAT) curricula has been emphasized throughout the literature, yet not all residency programs have such a curriculum in place. The purpose of our study was to (1) review the medical education literature for established RAT curricula, (2) assess published curricula's reproducibility, (3) evaluate the type of outcomes achieved using the Kirkpatrick model of evaluation, and (4) identify curricula that training programs could feasibly adopt. We performed a literature review using PubMed, Medline, Scopus, PsycINFO, ERIC, and Embase. Key search words included residents, residents as teachers, teaching, internship and residency, and curriculum. In addition, a search of MedEdPORTAL was performed using the same key terms. Articles were evaluated based on the reproducibility of curricula and the assessment tools. Evaluation of educational outcomes was performed using the Kirkpatrick model. Thirty-nine articles were deemed appropriate for review. Interventions and evaluation techniques varied greatly. Only 1 article from the literature was deemed to have both curricula and assessments that would be fully reproducible by other programs. A literature review on RAT curricula found few articles that would be easily reproduced for residency programs that want to start or improve their own RAT curricula. It also demonstrated the difficulty and lack of rigorous outcome measurements for most curricula.

Intermediate outcomes of a tribal community public health infrastructure assessment.

PubMed

English, Kevin C; Wallerstein, Nina; Chino, Michelle; Finster, Carolyn E; Rafelito, Alvin; Adeky, Sarah; Kennedy, Marianna

2004-01-01

The purpose of this collaborative participatory project was to assess the strengths and needs of a tribal community as part of a larger public health capacity building program. Key project partners included: the Ramah Band of Navajo Indians, the Albuquerque Area Indian Health Board, the University of New Mexico Masters in Public Health Program, and the University of Nevada, Las Vegas, American Indian Research and Education Center. Principal intervention steps entailed: 1) relationship-building activities among tribal programs and between the Tribe and the scientific community; 2) an orientation to public health; 3) a comprehensive public health infrastructure assessment, utilizing a standardized CDC instrument; and 4) a prioritization of identified needs. The direct outcome was the development and beginning implementation of a community specific public health strategic action plan. Broader results included: 1) increased comprehension of public health within the Tribe; 2) the creation of a community public health task force; 3) the design of a tribally applicable assessment instrument; and 4) improved collaboration between the Tribe and the scientific community. This project demonstrated that public health assessment in tribal communities is feasible and valuable. Further, the development of a tribally applicable instrument highlights a significant tribal contribution to research and assessment.

[Not Available].

PubMed

Turcotte, Geneviève; Chamberland, Claire; Lemay, Louise; Sanchez, Isabelle

2016-03-14

MAP (mothers with power) is a program that proposes a comprehensive approach to promote social and professional integration of low income single mothers with children under six years old. Using the results of a qualitative evaluation of the program 's outcomes and the contextual factors that produced them, this article aims to identify the aspects of the program that are the most promising for practise. To assess the program's outcomes, the study uses two monitoring tools and an information sheet on each participant. An in-depth analysis of the connections between the program's outcomes and the contextual factors that produced them is conducted using 16 case studies, a case being defined as the integration path of each participant during the participation in the program. For each case, four data sources were used: in addition to the monitoring tools, semi-structured interviews were conducted with the participants and the case workers at two points in time. Data show positive outcomes of this program. After three years, a majority of participants went back to school, finished high school, started collegial studies or found a job. These outcomes resulted from a set of factors: structuring actions on the life environment, support from an intervention team working closely with the participants and personalized references to programs and services in the community. The results support the relevance of an integrated and comprehensive approach to the social and professional integration of low-income single mothers.

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Workforce Professionalism in Drug Treatment Services: Impact of California’s Proposition 36

PubMed Central

Wu, Fei; Hser, Yih-Ing

2011-01-01

This article investigates whether California’s Proposition 36 has promoted the workforce professionalism of drug treatment services during its first five years of implementation. Program surveys inquiring about organizational information, Proposition 36 implementation, and staffing were conducted in 2003 and 2005 among all treatment providers serving Proposition 36 clients in five selected California counties (San Diego, Riverside, Kern, Sacramento, and San Francisco). A one-hour self-administered questionnaire was completed by 118 treatment providers representing 102 programs. This article examines five topics that are relevant to drug treatment workforce professionalism: resources and capability, standardized intake assessment and outcome evaluation, staff qualification, program accreditation, and information technology. Results suggest that Proposition 36 had a positive influence on the drug treatment workforce’s professionalism. Improvements have been observed in program resources, client intake assessment and outcome evaluation databases, staff professionalization, program accreditation, and information technology system. However, some areas remain problematic, including, for example, the consistent lack of adequate resources serving women with children. PMID:21036513

Assess/Mitigate Risk through the Use of Computer-Aided Software Engineering (CASE) Tools

NASA Technical Reports Server (NTRS)

Aguilar, Michael L.

2013-01-01

The NASA Engineering and Safety Center (NESC) was requested to perform an independent assessment of the mitigation of the Constellation Program (CxP) Risk 4421 through the use of computer-aided software engineering (CASE) tools. With the cancellation of the CxP, the assessment goals were modified to capture lessons learned and best practices in the use of CASE tools. The assessment goal was to prepare the next program for the use of these CASE tools. The outcome of the assessment is contained in this document.

Improvements in Negative Symptoms and Functional Outcome After a New Generation Cognitive Remediation Program: A Randomized Controlled Trial

PubMed Central

Ojeda, Natalia

2014-01-01

Cognitive remediation improves cognition in patients with schizophrenia, but its effect on other relevant factors such as negative symptoms and functional outcome has not been extensively studied. In this hospital-based study, 84 inpatients with chronic schizophrenia were recruited from Alava Hospital (Spain). All of the subjects underwent a baseline and a 3-month assessment that examined neurocognition, clinical symptoms, insight, and functional outcome according to the Global Assessment of Functioning (GAF) scale and Disability Assessment Schedule from World Health Organization (DAS-WHO). In addition to receiving standard treatment, patients were randomly assigned either to receive neuropsychological rehabilitation (REHACOP) or to a control group. REHACOP is an integrative program that taps all basic cognitive functions. The program included experts’ latest suggestions about positive feedback and activities of daily living in the patients’ environment. The REHACOP group showed significantly greater improvements at 3 months in the areas of neurocognition, negative symptoms, disorganization, and emotional distress compared with the control group (Cohen’s effect size for these changes ranged from d = 0.47 for emotional distress to d = 0.58 for disorganization symptoms). The REHACOP group also improved significantly in both the GAF (d = 0.61) and DAS-WHO total scores (d = 0.57). Specifically, the patients showed significant improvement in vocational outcomes (d = 0.47), family contact (d = 0.50), and social competence (d = 0.56). In conclusion, neuropsychological rehabilitation may be useful for the reduction of negative symptoms and functional disability in schizophrenia. These findings support the integration of neuropsychological rehabilitation into standard treatment programs for patients with schizophrenia. PMID:23686130

Integrating Health Education in Core Curriculum Classrooms: Successes, Challenges, and Implications for Urban Middle Schools.

PubMed

Rajan, Sonali; Roberts, Katherine J; Guerra, Laura; Pirsch, Moira; Morrell, Ernest

2017-12-01

School-based health education efforts can positively affect health behaviors and learning outcomes; however, there is limited available time during the school day for separate health education classes. The purpose of this study was to assess the feasibility and sustainability of implementing a classroom-based health education program that integrates skill development with health learning. A wait-list control study design was conducted among 168 6th graders in 2 urban schools. Data on program implementation, feasibility, and health outcomes were collected from students at 3 time points and from 5 teachers across the implementation of the 10-week program. There were barriers to implementation, including time limitations, unexpected school-wide disruptions, and variations in student reading ability and teacher preparedness. However, analyses revealed there were significant increases in self-efficacy regarding fruit and vegetable consumption and outcome expectations following program implementation, which were also sustained post-program implementation. Despite inconsistent implementation in the wait-list control school, small gains were also noted following the completion of the program. Integrating health education efforts within core curricula classes can lead to favorable outcomes. However, implementation barriers must be actively addressed by schools and program developers to improve program fidelity and maximize the sustainability of program gains. © 2017, American School Health Association.

Validity of the Medical College Admission Test for predicting MD-PhD student outcomes.

PubMed

Bills, James L; VanHouten, Jacob; Grundy, Michelle M; Chalkley, Roger; Dermody, Terence S

2016-03-01

The Medical College Admission Test (MCAT) is a quantitative metric used by MD and MD-PhD programs to evaluate applicants for admission. This study assessed the validity of the MCAT in predicting training performance measures and career outcomes for MD-PhD students at a single institution. The study population consisted of 153 graduates of the Vanderbilt Medical Scientist Training Program (combined MD-PhD program) who matriculated between 1963 and 2003 and completed dual-degree training. This population was divided into three cohorts corresponding to the version of the MCAT taken at the time of application. Multivariable regression (logistic for binary outcomes and linear for continuous outcomes) was used to analyze factors associated with outcome measures. The MCAT score and undergraduate GPA (uGPA) were treated as independent variables; medical and graduate school grades, time-to-PhD defense, USMLE scores, publication number, and career outcome were dependent variables. For cohort 1 (1963-1977), MCAT score was not associated with any assessed outcome, although uGPA was associated with medical school preclinical GPA and graduate school GPA (gsGPA). For cohort 2 (1978-1991), MCAT score was associated with USMLE Step II score and inversely correlated with publication number, and uGPA was associated with preclinical GPA (mspGPA) and clinical GPA (mscGPA). For cohort 3 (1992-2003), the MCAT score was associated with mscGPA, and uGPA was associated with gsGPA. Overall, MCAT score and uGPA were inconsistent or weak predictors of training metrics and career outcomes for this population of MD-PhD students.

Effect of programmed intermittent epidural boluses and continuous epidural infusion on labor analgesia and obstetric outcomes: a randomized controlled trial.

PubMed

Ferrer, Leopoldo E; Romero, David J; Vásquez, Oscar I; Matute, Ednna C; Van de Velde, Marc

2017-11-01

Continuous epidural infusion and programmed intermittent epidural boluses are analgesic techniques routinely used for pain relief in laboring women. We aimed to assess both techniques and compare them with respect to labor analgesia and obstetric outcomes. After Institutional Review Board approval, 132 laboring women aged between 18 and 45 years were randomized to epidural analgesia of 10 mL of a mixture of 0.1% bupivacaine plus 2 µg/mL of fentanyl either by programmed intermittent boluses or continuous infusion (66 per group). Primary outcome was quality of analgesia. Secondary outcomes were duration of labor, total drug dose used, maternal satisfaction, sensory level, motor block level, presence of unilateral motor block, hemodynamics, side effects, mode of delivery, and newborn outcome. Patients in the programmed intermittent epidural boluses group received statistically less drug dose than those with continuous epidural infusion (24.9 vs 34.4 mL bupivacaine; P = 0.01). There was no difference between groups regarding pain control, characteristics of block, hemodynamics, side effects, and Apgar scores. Our study evidenced a lower anesthetic consumption in the programmed intermittent boluses group with similar labor analgesic control, and obstetric and newborn outcomes in both groups.

Learning from internships in gerontology and geriatrics: assessment and program evaluation.

PubMed

Karasik, Rona J

2009-01-01

Internships are an essential component of gerontological education. Harvesting the learning from internships, however, requires careful attention to assessing an intern's work. In addition to providing feedback to students, internship assessment can also yield data useful for academic program evaluation. Drawing on internship assessment data collected from undergraduate and graduate gerontology interns and their community preceptors over a period of seven semesters, this article explores (1) concerns regarding how to assess what interns are learning, (2) ways to provide students with additional opportunities for learning from their internships, and (3) how information from these student-learning outcomes may be used to evaluate the effectiveness of the overall academic program.

Providing Tobacco Treatment in a Community Mental Health Setting: A Pilot Study.

PubMed

Okoli, Chizimuzo T C; Mason, Dia A; Brumley-Shelton, Angela; Robertson, Heather

Individuals with mental illnesses (MIs) are disproportionately affected by tobacco-related disease burden because of higher tobacco use prevalence and poor tobacco treatment outcomes. This pilot study examines the outcomes of delivering an evidence-based tobacco treatment program (the Cooper-Clayton program) in a community mental health setting. A prospective nonequivalent group design was used to assess outcomes. This study included 47 participants, of which 19 were in a community mental health setting and 28 were from two non-mental-health settings. Information on sociodemographic (gender, age, educational level, and current life stressors) and medical, MI, substance use, and tobacco use and cessation histories were obtained. Program completion and smoking cessation at the end of treatment (verified with expired carbon monoxide monitoring) were assessed. The program consists of combining behavioral counseling with nicotine replacement therapy for 12 weeks. Participants from the mental health setting were significantly less educated, had greater medical comorbidities, had greater psychiatric and mental health histories, and had greater perceived secondhand tobacco smoke exposure as compared with those from the non-mental-health settings. Thirty-two percent of the participants (6/19) completed the program in the mental health site as compared with 68% (19/28) from the non-mental-health site. None of those from the mental health site achieved cessation as compared with 68% of those from non-mental-health sites. The differential outcomes of evidence-based tobacco treatment programs in non-mental-health versus mental health settings may suggest the need to modify existing tobacco treatment approaches for those with MIs in community settings.

NPEC Sourcebook on Assessment: Definitions and Assessment Methods for Communication, Leadership, Information Literacy, Quantitative Reasoning, and Quantitative Skills. NPEC 2005-0832

ERIC Educational Resources Information Center

Jones, Elizabeth A.; RiCharde, Stephen

2005-01-01

Faculty, instructional staff, and assessment professionals are interested in student outcomes assessment processes and tools that can be used to improve learning experiences and academic programs. How can students' skills be assessed effectively? What assessments measure skills in communication? Leadership? Information literacy? Quantitative…

Process evaluation of a promotora de salud intervention for improving hypertension outcomes for Latinos living in a rural U.S.-Mexico border region.

PubMed

Sánchez, Victoria; Cacari Stone, Lisa; Moffett, Maurice L; Nguyen, PhoungGiang; Muhammad, Michael; Bruna-Lewis, Sean; Urias-Chauvin, Rita

2014-05-01

Hypertension is a growing public health problem for U.S.-Mexico border Latinos, who commonly experience low levels of awareness, treatment, and control. We report on a process evaluation that assessed the delivery of Corazón por la Vida, a 9-week promotora de salud-led curriculum to help Latinos manage and reduce hypertension risks in two rural/frontier counties in the New Mexico border region. Ninety-six adults participated in the program, delivered in three waves and in three communities. We assessed program delivery and quality, adherence, exposure, and participant responsiveness. Participant outcome measures included self-reported eating and physical activities and assessment of community resources. Findings suggest that the program was fully delivered (99%) and that most participants (81.7%) were very satisfied with the educational sessions. The average participant attendance for educational sessions was 77.47%. We found significant differences in self-reported behavioral changes depending on the number of sessions completed: The higher the dose of sessions, the better the self-reported outcomes. These findings suggest that a promotora-led curriculum may be useful for promoting self-management of chronic disease in rural/frontier border Latino populations. Future evaluation should focus on training and implementation adaptations within evidence-based chronic disease programs for diverse Latino communities.

Health economics and outcomes research fellowship practices reviewed.

PubMed

Suh, Kangho; Gabriel, Susan; Adams, Michelle A; Arcona, Steve

2015-01-01

The guidelines for health economics and outcomes research (HEOR) fellowship training programs devised by the American College of Clinical Pharmacy (ACCP) and the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) suggest that continuous improvements are made to ensure that postgraduate training through didactic and professional experiences prepare fellows for HEOR research careers. The HEOR Fellowship Program at Novartis Pharmaceuticals Corporation was standardized to enhance the fellows' HEOR research understanding and align professional skill sets with the ACCP-ISPOR Fellowship Program Guidelines. Based on feedback from an internal task force comprised of HEOR employees and current and former fellows, the HEOR Fellowship Program was normatively and qualitatively assessed to evaluate the current curricular program. Fellowship program activities were instituted to ensure that the suggested minimum level requirements established by the guidelines were being met. Research opportunities enabling fellows to work hand-in-hand with other fellows and HEOR professionals were emphasized. Curricular enhancements in research methodology and professional training and development, and materials for a structured journal club focusing on specific methodological and HEOR research topics were developed. A seminar series (e.g., creating SMART Goals, StrengthsFinder 2.0) and professional courses (e.g., ISPOR short courses, statistics.com) were included to enhance the fellows' short- and long-term professional experience. Additional program attributes include an online reference library developed to enrich the current research facilities and a Statistical Analysis Software training program. Continuously assessing and updating HEOR fellowship programs keeps programs up-to-date in the latest HEOR concepts and approaches used to evaluate health care, both professionally and educationally. Copyright © 2015 Elsevier Inc. All rights reserved.

Advancing Resident Assessment in Graduate Medical Education

PubMed Central

Swing, Susan R.; Clyman, Stephen G.; Holmboe, Eric S.; Williams, Reed G.

2009-01-01

Background The Outcome Project requires high-quality assessment approaches to provide reliable and valid judgments of the attainment of competencies deemed important for physician practice. Intervention The Accreditation Council for Graduate Medical Education (ACGME) convened the Advisory Committee on Educational Outcome Assessment in 2007–2008 to identify high-quality assessment methods. The assessments selected by this body would form a core set that could be used by all programs in a specialty to assess resident performance and enable initial steps toward establishing national specialty databases of program performance. The committee identified a small set of methods for provisional use and further evaluation. It also developed frameworks and processes to support the ongoing evaluation of methods and the longer-term enhancement of assessment in graduate medical education. Outcome The committee constructed a set of standards, a methodology for applying the standards, and grading rules for their review of assessment method quality. It developed a simple report card for displaying grades on each standard and an overall grade for each method reviewed. It also described an assessment system of factors that influence assessment quality. The committee proposed a coordinated, national-level infrastructure to support enhancements to assessment, including method development and assessor training. It recommended the establishment of a new assessment review group to continue its work of evaluating assessment methods. The committee delivered a report summarizing its activities and 5 related recommendations for implementation to the ACGME Board in September 2008. PMID:21975993

Substance Use, Education, Employment, and Criminal Activity Outcomes of Adolescents in Outpatient Chemical Dependency Programs

PubMed Central

Balsa, Ana I.; Homer, Jenny F.; French, Michael T.; Weisner, Constance M.

2010-01-01

Although the primary outcome of interest in clinical evaluations of addiction treatment programs is usually abstinence, participation in these programs can have a wide range of consequences. This study evaluated the effects of treatment initiation on substance use, school attendance, employment, and involvement in criminal activity at 12 months post-admission for 419 adolescents (aged 12 to 18) enrolled in chemical dependency recovery programs in a large managed care health plan. Instrumental variables estimation methods were used to account for unobserved selection into treatment by jointly modeling the likelihood of participation in treatment and the odds of attaining a certain outcome or level of an outcome. Treatment initiation significantly increased the likelihood of attending school, promoted abstinence, and decreased the probability of adolescent employment, but it did not significantly affect participation in criminal activity at the 12-month follow-up. These findings highlight the need to address selection in a non-experimental study and demonstrate the importance of considering multiple outcomes when assessing the effectiveness of adolescent treatment. PMID:18064572

A comprehensive examination of the influence of state tobacco control programs and policies on youth smoking.

PubMed

Farrelly, Matthew C; Loomis, Brett R; Han, Beth; Gfroerer, Joe; Kuiper, Nicole; Couzens, G Lance; Dube, Shanta; Caraballo, Ralph S

2013-03-01

We examined the influence of tobacco control policies (tobacco control program expenditures, smoke-free air laws, youth access law compliance, and cigarette prices) on youth smoking outcomes (smoking susceptibility, past-year initiation, current smoking, and established smoking). We combined data from the 2002 to 2008 National Surveys on Drug Use and Health with state and municipality population data from the US Census Bureau to assess the associations between state tobacco control policy variables and youth smoking outcomes, focusing on youths aged 12 to 17 years. We also examined the influence of policy variables on youth access when these variables were held at 2002 levels. Per capita funding for state tobacco control programs was negatively associated with all 4 smoking outcomes. Smoke-free air laws were negatively associated with all outcomes except past-year initiation, and cigarette prices were associated only with current smoking. We found no association between these outcomes and retailer compliance with youth access laws. Smoke-free air laws and state tobacco control programs are effective strategies for curbing youth smoking.

A Comprehensive Examination of the Influence of State Tobacco Control Programs and Policies on Youth Smoking

PubMed Central

Loomis, Brett R.; Han, Beth; Gfroerer, Joe; Kuiper, Nicole; Couzens, G. Lance; Dube, Shanta; Caraballo, Ralph S.

2013-01-01

Objectives. We examined the influence of tobacco control policies (tobacco control program expenditures, smoke-free air laws, youth access law compliance, and cigarette prices) on youth smoking outcomes (smoking susceptibility, past-year initiation, current smoking, and established smoking). Methods. We combined data from the 2002 to 2008 National Surveys on Drug Use and Health with state and municipality population data from the US Census Bureau to assess the associations between state tobacco control policy variables and youth smoking outcomes, focusing on youths aged 12 to 17 years. We also examined the influence of policy variables on youth access when these variables were held at 2002 levels. Results. Per capita funding for state tobacco control programs was negatively associated with all 4 smoking outcomes. Smoke-free air laws were negatively associated with all outcomes except past-year initiation, and cigarette prices were associated only with current smoking. We found no association between these outcomes and retailer compliance with youth access laws. Conclusions. Smoke-free air laws and state tobacco control programs are effective strategies for curbing youth smoking. PMID:23327252

Evaluation of Pillars4life: a virtual coping skills program for cancer survivors.

PubMed

Smith, Sophia K; O'Donnell, Jonathan D; Abernethy, Amy P; MacDermott, Kristin; Staley, Tina; Samsa, Gregory P

2015-11-01

Pillars4Life is an educational program that teaches coping skills to cancer patients in a virtual group setting; it was recently implemented at 17 hospitals across the USA. The cost-effective, scalable, and assessable Pillars4Life curriculum targets psychosocial resources (e.g., self-efficacy and coping skills) as a means to reduce symptoms (e.g., depression, anxiety, and posttraumatic stress) and enhance quality of life. Cancer patients were recruited from hospitals that received the LIVESTRONG Community Impact Project Award to enroll in a pilot study of Pillars4Life. Consenting participants met with a certified instructor weekly for 10 weeks in a virtual environment; the manualized intervention trained participants in personal coping skills. Longitudinal assessments over 6 months were assessed using validated instruments to determine changes in Pillars4Life targeted resources and outcomes. Multiple linear regression models examined the relationship between changes in targeted resources and changes in outcome from baseline to 3 months post-intervention. Participants (n = 130) had the following characteristics: mean age of 56 ± 11 years, 87% women, 11% non-Caucasian, and 77% with college degree. At 3- and 6-month follow-up, mean scores improved on all key outcome measures such as depression (Patient Health Questionnaire), anxiety (Generalized Anxiety Disorder), posttraumatic stress (Posttraumatic Stress Disorder Checklist), fatigue (Functional Assessment of Chronic Illness Therapy-Fatigue), and well-being (Functional Assessment of Cancer Therapy-General) from baseline (all p < 0.01); results were most pronounced among participants who reported ≥4/10 on the Distress Thermometer at baseline (all p < 0.001). Changes in each targeted resource were associated with 3-month improvements in at least one outcome. Participation in the Pillars4Life program was associated with statistically and clinically significant improvements in scores on pre-specified outcomes and targeted resources. Copyright © 2015 John Wiley & Sons, Ltd.

Improving the outcome of infants born at <30 weeks' gestation - a randomized controlled trial of preventative care at home

PubMed Central

2009-01-01

Background Early developmental interventions to prevent the high rate of neurodevelopmental problems in very preterm children, including cognitive, motor and behavioral impairments, are urgently needed. These interventions should be multi-faceted and include modules for caregivers given their high rates of mental health problems. Methods/Design We have designed a randomized controlled trial to assess the effectiveness of a preventative care program delivered at home over the first 12 months of life for infants born very preterm (<30 weeks of gestational age) and their families, compared with standard medical follow-up. The aim of the program, delivered over nine sessions by a team comprising a physiotherapist and psychologist, is to improve infant development (cognitive, motor and language), behavioral regulation, caregiver-child interactions and caregiver mental health at 24 months' corrected age. The infants will be stratified by severity of brain white matter injury (assessed by magnetic resonance imaging) at term equivalent age, and then randomized. At 12 months' corrected age interim outcome measures will include motor development assessed using the Alberta Infant Motor Scale and the Neurological Sensory Motor Developmental Assessment. Caregivers will also complete a questionnaire at this time to obtain information on behavior, parenting, caregiver mental health, and social support. The primary outcomes are at 24 months' corrected age and include cognitive, motor and language development assessed with the Bayley Scales of Infant and Toddler Development (Bayley-III). Secondary outcomes at 24 months include caregiver-child interaction measured using an observational task, and infant behavior, parenting, caregiver mental health and social support measured via standardized parental questionnaires. Discussion This paper presents the background, study design and protocol for a randomized controlled trial in very preterm infants utilizing a preventative care program in the first year after discharge home designed to improve cognitive, motor and behavioral outcomes of very preterm children and caregiver mental health at two-years' corrected age. Clinical Trial Registration Number ACTRN12605000492651 PMID:19954550

Impact of the Higgins Nutrition Intervention Program on birth weight: a within-mother analysis.

PubMed

Higgins, A C; Moxley, J E; Pencharz, P B; Mikolainis, D; Dubois, S

1989-08-01

A study was conducted to evaluate the impact of the Higgins Nutrition Intervention Program of individual nutritional assessment and rehabilitation on pregnancy outcome in a group of urban low-income women. Developed as an adjunct to routine prenatal care, the Higgins program utilizes an individualized approach to dietary treatment that combines an assessment of the risk profile for the presenting pregnancy with the application of specific nutritional rehabilitation allowances to compensate for the negative impact of diagnosed risks. This report presents results of analyses evaluating differences in birth outcomes between 552 sibling pairs; each mother had participated in the Higgins program during the pregnancy of the second-born, but not of the first-born, member of her pair. After adjustment for parity and sex, the intervention infants weighed an average of 107 gm more than their matched siblings at birth (p less than .01). The rate of low birth weight was 50% lower among the intervention infants than among their siblings (p less than .01); rates of intra-uterine growth retardation and perinatal mortality were also lower in the intervention group. The high risk of poor pregnancy outcome in this group of urban low-income women was reduced by the Higgins program.

The Agora

ERIC Educational Resources Information Center

Berkich, Don

2013-01-01

Student Learning Outcomes are increasingly de rigueur in US higher education. Usually defined as statements of what students will be able to measurably demonstrate upon completing a course or program, proponents argue that they are essential to objective assessment and quality assurance. Critics contend that Student Learning Outcomes are a…

75 FR 42081 - Proposed Information Collection; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-20

.... This study uses an experimental design to assess the outcomes associated with participation in national... reduce paperwork and respondent burden, conducts a pre-clearance consultation program to provide the... participation in youth corps may lead to measurable outcomes for participants. The study uses an experimental...

Creating a learning healthcare system in surgery: Washington State’s Surgical Care and Outcomes Assessment Program (SCOAP) at 5 years

PubMed Central

Kwon, Steve; Florence, Michael; Grigas, Peter; Horton, Marc; Horvath, Karen; Johnson, Morrie; Jurkovich, Gregory; Klamp, Wendy; Peterson, Kristin; Quigley, Terence; Raum, William; Rogers, Terry; Thirlby, Richard; Farrokhi, Ellen T.; Flum, David R.

2014-01-01

There are increasing efforts towards improving the quality and safety of surgical care while decreasing the costs. In Washington state, there has been a regional and unique approach to surgical quality improvement. The development of the Surgical Care and Outcomes Assessment Program (SCOAP) was first described 5 years ago. SCOAP is a peer-to-peer collaborative that engages surgeons to determine the many process of care metrics that go into a “perfect” operation, track on risk adjusted outcomes that are specific to a given operation, and create interventions to correct under performance in both the use of these process measures and outcomes. SCOAP is a thematic departure from report card oriented QI. SCOAP builds off the collaboration and trust of the surgical community and strives for quality improvement by having peers change behaviors of one another. We provide, here, the progress of the SCOAP initiative and highlight its achievements and challenges. PMID:22129638

Translating Theory Into Practice: Implementing a Program of Assessment.

PubMed

Hauer, Karen E; O'Sullivan, Patricia S; Fitzhenry, Kristen; Boscardin, Christy

2018-03-01

A program of assessment addresses challenges in learner assessment using a centrally planned, coordinated approach that emphasizes assessment for learning. This report describes the steps taken to implement a program of assessment framework within a medical school. A literature review on best practices in assessment highlighted six principles that guided implementation of the program of assessment in 2016-2017: (1) a centrally coordinated plan for assessment aligns with and supports a curricular vision; (2) multiple assessment tools used longitudinally generate multiple data points; (3) learners require ready access to information-rich feedback to promote reflection and informed self-assessment; (4) mentoring is essential to facilitate effective data use for reflection and learning planning; (5) the program of assessment fosters self-regulated learning behaviors; and (6) expert groups make summative decisions about grades and readiness for advancement. Implementation incorporated stakeholder engagement, use of multiple assessment tools, design of a coaching program, and creation of a learner performance dashboard. The assessment team monitors adherence to principles defining the program of assessment and gathers and responds to regular feedback from key stakeholders, including faculty, staff, and students. Next steps include systematically collecting evidence for validity of individual assessments and the program overall. Iterative review of student performance data informs curricular improvements. The program of assessment also highlights technology needs that will be addressed with information technology experts. The outcome ultimately will entail showing evidence of validity that the program produces physicians who engage in lifelong learning and provide high-quality patient care.

An exploratory study of an assessment tool derived from the competencies of the interprofessional education collaborative.

PubMed

Dow, Alan W; DiazGranados, Deborah; Mazmanian, Paul E; Retchin, Sheldon M

2014-07-01

Linking the outcomes from interprofessional education to improvements in patient care has been hampered by educational assessments that primarily measure the short-term benefits of specific curricular interventions. Competencies, recently published by the Interprofessional Education Collaborative (IPEC), elaborate overarching goals for interprofessional education by specifying desired outcomes for graduating health professions students. The competencies define a transition point between the prescribed and structured educational experience of a professional degree program and the more self-directed, patient-oriented learning associated with professional practice. Drawing on the IPEC competencies for validity, we created a 42-item questionnaire to assess outcomes related to collaborative practice at the degree program level. To establish the usability and psychometric properties of the questionnaire, it was administered to all the students on a health science campus at a large urban university in the mid-Atlantic of the United States. The student responses (n = 481) defined four components aligned in part with the four domains of the IPEC competencies. In addition, the results demonstrated differences in scores by domain that can be used to structure future curricula. These findings suggest a questionnaire based on the IPEC competencies might provide a measure to assess programmatic outcomes related to interprofessional education. We discuss directions for future research, such as a comparison of results within and between institutions, and how these results could provide valuable insights about the effect of different curricular approaches to interprofessional education and the success of various educational programs at preparing students for collaborative practice.

AN EXPLORATORY STUDY OF AN ASSESSMENT TOOL DERIVED FROM THE COMPETENCIES OF THE INTERPROFESSIONAL EDUCATION COLLABORATIVE

PubMed Central

Dow, Alan W.; DiazGranados, Deborah; Mazmanian, Paul E.; Retchin, Sheldon M.

2015-01-01

Linking the outcomes from interprofessional education to improvements in patient care has been hampered by educational assessments that primarily measure the short-term benefits of specific curricular interventions. Competencies, recently published by the Interprofessional Education Collaborative (IPEC), elaborate overarching goals for interprofessional education by specifying desired outcomes for graduating health professions students. The competencies define a transition point between the prescribed and structured educational experience of a professional degree program and the more self-directed, patient-oriented learning associated with professional practice. Drawing on the IPEC competencies for validity, we created a 42-item questionnaire to assess outcomes related to collaborative practice at the degree program level. To establish the usability and psychometric properties of the questionnaire, it was administered to all the students on a health science campus at a large urban university in the mid-Atlantic of the United States. The student responses (n = 481) defined four components aligned in part with the four domains of the IPEC competencies. In addition, the results demonstrated differences in scores by domain that can be used to structure future curricula. These findings suggest a questionnaire based on the IPEC competencies might provide a measure to assess programmatic outcomes related to interprofessional education. We discuss directions for future research, such as a comparison of results within and between institutions, and how these results could provide valuable insights about the effect of different curricular approaches to interprofessional education and the success of various educational programs at preparing students for collaborative practice. PMID:24593327

The Development of NOAA Education Common Outcome Performance Measures (Invited)

NASA Astrophysics Data System (ADS)

Baek, J.

2013-12-01

The National Oceanic and Atmospheric Administration (NOAA) Education Council has embarked on an ambitious Monitoring and Evaluation (M&E) project that will allow it to assess education program outcomes and impacts across the agency, line offices, and programs. The purpose of this internal effort is to link outcome measures to program efforts and to evaluate the success of the agency's education programs in meeting the strategic goals. Using an outcome-based evaluation approach, the NOAA Education Council is developing two sets of common outcome performance measures, environmental stewardship and professional development. This presentation will examine the benefits and tradeoffs of common outcome performance measures that collect program results across a portfolio of education programs focused on common outcomes. Common outcome performance measures have a few benefits to our agency and to the climate education field at large. The primary benefit is shared understanding, which comes from our process for writing common outcome performance measures. Without a shared and agreed upon set of definitions for the measure of an outcome, the reported results may not be measuring the same things and would incorrectly indicate levels of performance. Therefore, our writing process relies on a commitment to developing a shared set of definitions based on consensus. We hope that by taking the time to debate and coming to agreement across a diverse set of programs, the strength of our common measures can indicate real progress towards outcomes we care about. An additional benefit is that these common measures can be adopted and adapted by other agencies and organizations that share similar theories of change. The measures are not without their drawbacks, and we do make tradeoffs as part of our process in order to continue making progress. We know that any measure is necessarily a narrow slice of performance. A slice that may not best represent the unique and remarkable contribution of an individual program, but does reflect a variety of contributions along a single dimension across a large portfolio of programs. The process has ended up pushing our working group to call for even more measures, to capture an increasing number of dimensions that reflect the nature of the portfolio of programs. This past year we have been working on developing two sets of common outcome performance measures for professional development (PD) and stewardship education programs. The outcome we chose for PD programs was the use of what was learned in the educator's practice. The outcome we chose for stewardship programs was the stewardship behaviors that participants learn and practice. The measurement of these outcomes will inform whether our strategies are having their intended impact. By knowing how and how much these outcomes are occurring as a result of our program, we can improve program performance over time. The common outcome performance measures help demonstrate how these programs engage audiences in supporting NOAA's mission. As AGU climate literacy community continues to grow, it is important to consider an approach to demonstrate the community's contribution to the Nation's climate literacy. Development of common outcome performance measures is one approach that could help focus the community in meeting its goals.

Reviewing New Chemicals under the Toxic Substances Control Act (TSCA)

EPA Pesticide Factsheets

This microsite will provide information on how EPA’s new chemicals review program works, on the assessment tools and policies EPA uses in this program, and on the regulatory outcomes of EPA’s review of new chemicals notifications.

Experimental impacts of a teacher professional development program in Chile on preschool classroom quality and child outcomes.

PubMed

Yoshikawa, Hirokazu; Leyva, Diana; Snow, Catherine E; Treviño, Ernesto; Barata, M Clara; Weiland, Christina; Gomez, Celia J; Moreno, Lorenzo; Rolla, Andrea; D'Sa, Nikhit; Arbour, Mary Catherine

2015-03-01

We assessed impacts on classroom quality and on 5 child language and behavioral outcomes of a 2-year teacher professional-development program for publicly funded prekindergarten and kindergarten in Chile. This cluster-randomized trial included 64 schools (child N = 1,876). The program incorporated workshops and in-classroom coaching. We found moderate to large positive impacts on observed emotional and instructional support as well as classroom organization in prekindergarten classrooms after 1 year of the program. After 2 years of the program, moderate positive impacts were observed on emotional support and classroom organization. No significant program impacts on child outcomes were detected at posttest (1 marginal effect, an increase in a composite of self-regulation and low problem behaviors, was observed). Professional development for preschool teachers in Chile can improve classroom quality. More intensive curricular approaches are needed for these improvements to translate into effects on children. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

A chronicle of BScN honours/ non-honours outcomes and experiences post-graduation.

PubMed

Gillis, Angela

2007-01-01

This paper reports on a graduate follow-up of the outcomes of participation in an honours BScN program, two to seven years post-graduation. It compares two groups of graduates with high GPA scores, both initially eligible to complete the honours program. One group completed the honours program; the other group completed the regular BScN program. In phase 1 of the study, a self-administered mailed questionnaire was sent to participants to assess their involvement in research activities, occupancy of leadership positions, enrollment in graduate studies and demonstration of liberal education competencies in their professional lives after graduation. In phase two, personal interviews were held with a purposive subsample of participants to explore early career workplace experiences with research-based activities and participants' perceptions of factors influencing their decision to complete or not to complete the honours program. Graduates with high GPA scores from both programs demonstrated expected professional outcomes post-graduation. Follow up at 10-12 years post-graduation and replication with larger samples are recommended.

Improving Outcome Assessment in Information Technology Program Accreditation

ERIC Educational Resources Information Center

Goda, Bryan S.; Reynolds, Charles

2010-01-01

As of March 2010, there were fourteen Information Technology programs accredited by the Accreditation Board for Engineering and Technology, known as ABET, Inc (ABET Inc. 2009). ABET Inc. is the only recognized institution for the accreditation of engineering, computing, and technology programs in the U.S. There are currently over 128 U.S. schools…

Exposure to Fictional Medical Television and Health: A Systematic Review

ERIC Educational Resources Information Center

Hoffman, Beth L.; Shensa, Ariel; Wessel, Charles; Hoffman, Robert; Primack, Brian A.

2017-01-01

Fictional medical television programs have long been a staple of television programming, and they remain popular today. We aimed to examine published literature assessing the influence of medical television programs on health outcomes. We conducted systematic literature searches in PubMed, PsychINFO and CINAHL. Selected studies had to be scholarly…

Mental health issues in the workplace: a case for a new managerial approach.

PubMed

Dunnagan, T; Peterson, M; Haynes, G

2001-12-01

Anger, stress, and depression in the workplace are growing concerns among management. Traditionally, health outcomes have functioned under the realm of workplace health professionals. This study assessed whether a traditional worksite health promotion program had an impact on mental health factors. The results suggested that worksite health promotion programs play a limited role in ameliorating work-related mental health outcomes. Rather, management must play a greater role in addressing workplace stress, anger, and depression.

Veterans Justice Outreach Program: VA Could Improve Management by Establishing Performance Measures and Fully Assessing Risks

DTIC Science & Technology

2016-04-01

Assessing Risks Report to Congressional Requesters April 2016 GAO-16-393 United States Government Accountability Office United States...Government Accountability Office Highlights of GAO-16-393, a report to congressional requesters April 2016 VETERANS JUSTICE OUTREACH PROGRAM...quality, timeliness, efficiency, cost of service, and outcome. GAO, Tax Administration: IRS Needs to Further Refine Its Tax Filing Season

Assessment of Graduate Teaching Assistant (GTA) Training: A Case Study of a Training Program and Its Impact on GTAs

ERIC Educational Resources Information Center

Young, Stacy L.; Bippus, Amy M.

2008-01-01

Graduate teaching associates (GTAs) play a vital role as instructors at many universities but often are not confident in their ability to perform their job-related duties. Based on Bandura's (1997) theory of self-efficacy, this project examined a teacher-training program for GTAs and assessed its outcomes. Our results revealed that GTAs reported…

The Council on Quality and Leadership in Supports for People with Disabilities: Personal Outcomes Chart Book.

ERIC Educational Resources Information Center

National Center on Outcomes Research, Council on Quality and Leadership, Towson, MD.

This report describes the genesis, definition and use of the Personal Outcomes database, a database designed to assess whether programs and services are being effective in helping individuals with disabilities. The database is based on 25 outcome measures in seven domains, including: (1) identity, which is designed to provide a sense of how people…

Getting Ready for College: An Implementation and Early Impacts Study of Eight Texas Developmental Summer Bridge Programs. NCPR Brief

ERIC Educational Resources Information Center

Wathington, Heather D.; Barnett, Elisabeth A.; Weissman, Evan; Teres, Jedediah; Pretlow, Joshua; Nakanishi, Aki

2011-01-01

In 2009, the National Center for Postsecondary Research (NCPR) launched an evaluation of eight developmental summer bridge programs in Texas to assess whether these programs reduce the need for developmental coursework and improve student outcomes in college. The evaluation uses an experimental design to measure the effects of these programs on…

The Mount Sinai international enhancement of social work leadership program: The past and the future.

PubMed

Gordon, Elisa; Green, Karen; Whitwam, Louisa; Epstein, Irwin; Bernstein, Susan

2018-07-01

Developed in 1988, the Mount Sinai International Enhancement of Social Work Leadership Program brings 4-6 social workers from several countries each year to the Mount Sinai Hospital in New York City, where they meet with leaders from the hospital, community based organizations and graduate schools of social work, to enhance their leadership ability, strengthen management and research skills, and build upon global social work relationships. This article reviews the results of a survey conducted in 2016 to assess whether the visiting scholars met established learning objectives of the Program. Survey outcomes, presented in quantitative and qualitative terms, show positive results, and the scholars reported that the Program was extremely beneficial. The Program is viewed through the lens of two select adult learning theories: Social Learning Theory, which incorporates collaboration and learning from others, and Transformative Learning Theory, which is comprised of self-reflection and individualized learning. The inclusion of these theories in the implementation of the Program will be discussed. An analysis of the survey's outcomes, through pre- and post-Program participation and learning, facilitates assessment of potential programmatic adjustments to help evaluate long-term viability of the Program and potential duplication by other academic medical centers.

The immediate and long-term effects of a walking-skill program compared to usual physiotherapy care in patients who have undergone total knee arthroplasty (TKA): a randomized controlled trial.

PubMed

Bruun-Olsen, Vigdis; Heiberg, Kristi Elisabeth; Wahl, Astrid Klopstad; Mengshoel, Anne Marit

2013-01-01

To examine the immediate and long-term effects of a walking-skill program compared with usual physiotherapy on physical function, pain and perceived self-efficacy in patients after total knee arthroplasty (TKA). A single blind randomized controlled trial design was applied. Fifty-seven patients with primary TKA, mean age of 69 years (SD ± 9), were randomly assigned to a walking-skill program emphasizing weight-bearing exercises or usual physiotherapy. Outcomes were assessed before the interventions started at 6 weeks postoperatively (T1), directly after the interventions at 12-14 weeks (T2) and 9 months after the interventions (T3). Walking was the primary outcome, assessed by the 6 min walk test (6MWT). The secondary outcomes were timed stair climbing, timed stands, Figure-of-eight test, Index of muscle function, active knee range of motion, Knee Injury and Osteoarthritis Outcome Score and self-efficacy score. From T1 to T2, a better 6MWT score was found in favor of the walking-skill program of 39 m (2-76), p = 0.04. The difference between the groups in 6MWT persisted at T3, 44 m (8-80), p = 0.02. No differences in other outcome measures were found. The walking-skill program had better effect on walking than usual physiotherapy. Weight bearing was tolerated. Implications for Rehabilitation Weight-bearing exercises are tolerated by the patients in the early stage after TKA. Physiotherapy that focuses on learning different ways of walking through practice may be a plausible way to train patients after TKA.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deason, Jeff

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impactsmore » of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation« less

Pregnant Employee Protection Program in a Large Chemical Company.

PubMed

Frey, Gunild; Schuster, Michael; Oberlinner, Christoph; Queier-Wahrendorf, Annette; Lang, Stefan; Yong, Mei

2015-09-01

To assess whether a structured employee protection program for pregnant workers at a chemical company has an impact on pregnancy outcomes. Reported pregnancies (n = 1402) between 2003 and 2010 and their outcomes were documented using questionnaires at the time of pregnancy report, end of pregnancy, and 1 year later. Potential maternal exposures were assessed using job histories, workplace inspections, and questionnaires. Participation was 86% overall and was consistently high across subgroups.Pregnancy losses (10.9%), pregnancy complications, and preterm births (8.1%) were in agreement with rates in the general population and were independent of type of work and maternal exposure category. Pregnancy complication rates in this chemical company are not statistically elevated than that in the general population, as suggested in a previous study. The protection program may play a role in preventing complications that may have occurred.

Using program impact pathways to understand and improve program delivery, utilization, and potential for impact of Helen Keller International's homestead food production program in Cambodia.

PubMed

Olney, Deanna K; Vicheka, Sao; Kro, Meng; Chakriya, Chhom; Kroeun, Hou; Hoing, Ly Sok; Talukder, Aminzzaman; Quinn, Victoria; Iannotti, Lora; Becker, Elisabeth; Roopnaraine, Terry

2013-06-01

Evidence of the impact of homestead food production programs on nutrition outcomes such as anemia and growth is scant. In the absence of information on program impact pathways, it is difficult to understand why these programs, which have been successful in increasing intake of micronutrient-rich foods, have had such limited documented impact on nutrition outcomes. To conduct a process evaluation of Helen Keller International's (HKI's) homestead food production program in Cambodia to assess whether the program was operating as planned (in terms of design, delivery, and utilization) and to identify ways in which the program might need to be strengthened in order to increase its potential for impact. A program theory framework, which laid out the primary components along the hypothesized program impact pathways, was developed in collaboration with HKI and used to design the research. Semistructured interviews and focus group discussions with program beneficiaries (n = 36 and 12, respectively), nonbeneficiaries (n = 12), and program implementers (n = 17 and 2, respectively) and observations of key program delivery points, including health and nutrition training sessions (n = 6), village model farms (n = 6), and household gardens of beneficiaries (n = 36) and nonbeneficiaries (n = 12), were conducted to assess the delivery and utilization of the primary program components along the impact pathways. The majority of program components were being delivered and utilized as planned. However, challenges with some of the key components posited to improve outcomes such as anemia and growth were noted. Among these were a gap in the expected pathway from poultry production to increased intake of eggs and poultry meat, and some weaknesses in the delivery of the health and nutrition training sessions and related improvements in knowledge among the village health volunteers and beneficiaries. Although the program has been successful in delivering the majority of the program components as planned and has documented achievements in improving household production and intake of micronutrient-rich foods, it is likely that strengthening delivery and increasing utilization of some program components would increase its potential for nutritional impacts. This research has highlighted the importance of designing a program theory framework and assessing the components that lie along the primary program impact pathways to optimize program service delivery and utilization and, in turn, potential for impact.

An evaluation of pharmacology curricula in Australian science and health-related degree programs.

PubMed

Lloyd, Hilary; Hinton, Tina; Bullock, Shane; Babey, Anna-Marie; Davis, Elizabeth; Fernandes, Lynette; Hart, Joanne; Musgrave, Ian; Ziogas, James

2013-11-19

Pharmacology is a biomedical discipline taught in basic science and professional degree programs. In order to provide information that would facilitate pharmacology curricula to be refined and developed, and approaches to teaching to be updated, a national survey was undertaken in Australia that investigated pharmacology course content, teaching and summative assessment methods. Twenty-two institutions participated in a purpose-built online questionnaire, which enabled an evaluation of 147 courses taught in 10 different degrees. To enable comparison, degrees were grouped into four major degree programs, namely science, pharmacy, medicine and nursing. The pharmacology content was then classified into 16 lecture themes, with 2-21 lecture topics identified per theme. The resultant data were analysed for similarities and differences in pharmacology curricula across the degree programs. While all lecture themes were taught across degree programs, curriculum content differed with respect to the breadth and hours of coverage. Overall, lecture themes were taught most broadly in medicine and with greatest coverage in pharmacy. Reflecting a more traditional approach, lectures were a dominant teaching method (at least 90% of courses). Sixty-three percent of science courses provided practical classes but such sessions occurred much less frequently in other degree programs, while tutorials were much more common in pharmacy degree programs (70%). Notably, problem-based learning was common across medical programs. Considerable diversity was found in the types of summative assessment tasks employed. In science courses the most common form of in-semester assessment was practical reports, whereas in other programs pen-and-paper quizzes predominated. End-of-semester assessment contributed 50-80% to overall assessment across degree programs. The similarity in lecture themes taught across the four different degree programs shows that common knowledge- and competency-based learning outcomes can be defined for pharmacology. The authors contend that it is the differences in breadth and coverage of material for each lecture theme, and the differing teaching modes and assessment that characterise particular degree programs. Adoption of pharmacology knowledge-based learning outcomes that could be tailored to suit individual degree programs would better facilitate the sharing of expertise and teaching practice than the current model where pharmacology curricula are degree-specific.

Behavioral Assessment and Interventions in Youth Sports.

ERIC Educational Resources Information Center

Smith, Ronald E.; And Others

1996-01-01

Discusses the use of behavioral assessment for both descriptive and program evaluation purposes. Notes the use of behavioral assessment to study coaching behaviors and their effects on young athletes. Operant and cognitive-behavioral interventions have proven effective in both athletic and psychosocial outcomes. Discusses unresolved issues and…

Technical Assistance and Changes in Nutrition and Physical Activity Practices in the National Early Care and Education Learning Collaboratives Project, 2015–2016

PubMed Central

Smith, Teresa M.; Estabrooks, Paul A.; Rasmussen, Cristy Geno; Blaser, Casey; Yaroch, Amy L

2018-01-01

Purpose and Objectives The National Early Care and Education Learning Collaboratives Project (ECELC) aims to improve best practices in early care and education (ECE) programs in topic areas of the Nutrition and Physical Activity Self-Assessment in Child Care (NAP SACC). Technical assistance is a component of the ECELC, yet its effect on outcomes is unclear. Beyond dose and duration of technical assistance, limited research exists on characteristics of technical assistance that contribute to outcomes. The objective of this study was to identify and describe technical assistance characteristics and explore associations with NAP SACC outcomes. Intervention Approach We collected data from 10 collaboratives comprising 84 ECE programs in 2 states in 2015–2016. The objective of technical assistance was to support programs in improving best practices. Technical assistance was provided to programs via on-site, telephone, or email and was tailored to program needs. Evaluation Methods We used a mixed-methods design to examine associations between technical assistance and NAP SACC outcomes. We used multiple regression analysis to assess quantitative data and qualitative comparative analysis to determine necessary and sufficient technical assistance conditions supporting NAP SACC outcomes. We also conducted a document review to describe technical assistance that referred conditions identified by the qualitative comparative analysis. Results Regression analyses detected an inverse relationship between changes in NAP SACC scores and hours of technical assistance. No clear pattern emerged in the qualitative comparative analysis, leaving no necessary and sufficient conditions. However, the qualitative comparative analysis identified feedback as a potentially important component of technical assistance, whereas resource sharing and frequent email were characteristics that seemed to reduce the likelihood of improved outcomes. Email and resource sharing were considered primarily general information rather than tailored technical assistance. Implications for Public Health Technical assistance may be used in programs and made adaptable to program needs. The inclusion and evaluation of technical assistance, especially tailored approaches, is warranted for environmental interventions, including ECE settings. PMID:29704371

Web-Based Portfolio Assessment: Validation of an Open Source Platform

ERIC Educational Resources Information Center

Collins, Regina; Elliot, Norbert; Klobucar, Andrew; Deek, Fadi P.

2013-01-01

Assessment of educational outcomes through purchased tests is commonplace in the evaluation of individual student ability and of educational programs. Focusing on the assessment of writing performance in a longitudinal study of first-time, full-time students (n = 598), this research describes the design, use, and assessment of an open-source…

Development of Visualization of Learning Outcomes Using Curriculum Mapping

ERIC Educational Resources Information Center

Ikuta, Takashi; Gotoh, Yasushi

2012-01-01

Niigata University has started to develop the Niigata University Bachelor Assessment System (NBAS). The objective is to have groups of teachers belonging to educational programs discuss whether visualized learning outcomes are comprehensible. Discussions based on teachers' subjective judgments showed in general that visualized learning outcomes…

Communicating Learning Outcomes and Student Performance through the Student Transcript

ERIC Educational Resources Information Center

Kenyon, George; Barnes, Cynthia

2010-01-01

The university accreditation process now puts more emphasis on self assessment. This change requires universities to identify program objectives, performance indicators, and areas for improvement. Many accrediting institutions are requiring that institutions communicate clearly to constituents: 1) what learning outcomes were achieved by students,…

Cardiovascular self-management support program for preventing cardiovascular complication behaviors and clinical outcomes in the elderly with poorly controlled type 2 diabetes mellitus in Indonesia: A pilot study.

PubMed

Hisni, Dayan; Rukmaini, Rukmaini; Saryono, Saryono; Chinnawong, Tippamas; Thaniwattananon, Ploenpit

2018-03-06

The aim of the study was to determine the feasibility, and to evaluate the effect of, a cardiovascular self-management support program by applying the 5A's self-management support program on preventing cardiovascular complication behaviors and to assess the clinical outcomes in the elderly with poorly controlled type 2 diabetes mellitus (DM). This pilot study used a quasi-experimental study design. Twelve elderly persons with poorly controlled type 2 DM were assigned into either a control or experimental group, with six participants in each group. The Preventing Cardiovascular Complication Behaviors (PCCB) was measured by the Preventing Cardiovascular Complication Behaviors Questionnaire, while the clinical outcomes were measured by clinical devices that were provided. These measurements were conducted and compared at baseline and 6 weeks after the completion of the program. The self-management support program was a 6 week program with several implementation methods, based on the 5A's self-management support program. The participants who received the cardiovascular self-management support program reported a significant improvement in their PCCB and clinical outcomes, compared to those receiving the usual care. This study revealed that a cardiovascular self-management support program that applies the 5A's self-management support program is feasible for implementation. © 2018 Japan Academy of Nursing Science.

Overview of Faculty Development Programs for Interprofessional Education.

PubMed

Ratka, Anna; Zorek, Joseph A; Meyer, Susan M

2017-06-01

Objectives. To describe characteristics of faculty development programs designed to facilitate interprofessional education, and to compile recommendations for development, delivery, and assessment of such faculty development programs. Methods. MEDLINE, CINAHL, ERIC, and Web of Science databases were searched using three keywords: faculty development, interprofessional education, and health professions. Articles meeting inclusion criteria were analyzed for emergent themes, including program design, delivery, participants, resources, and assessment. Results. Seventeen articles were identified for inclusion, yielding five characteristics of a successful program: institutional support; objectives and outcomes based on interprofessional competencies; focus on consensus-building and group facilitation skills; flexibility based on institution- and participant-specific characteristics; and incorporation of an assessment strategy. Conclusion. The themes and characteristics identified in this literature overview may support development of faculty development programs for interprofessional education. An advanced evidence base for interprofessional education faculty development programs is needed.

A continuous quality improvement approach to improving clinical practice in the areas of sedation, analgesia, and neuromuscular blockade.

PubMed

Arbour, Richard

2003-01-01

Practice concerns associated with the medical prescription and nurses' administration and monitoring of sedatives, analgesics, and neuromuscular blocking agents were identified by the clinical nurse specialist within a surgical intensive care unit of a large, tertiary-care referral center. These concerns were identified using a variety of needs assessment strategies. Results of the needs assessment were used to develop a program of care, including a teaching initiative, specific to these practice areas. The teaching initiative incorporated principles of andragogy, the theory of adult learning. Educational techniques included inservice education, bedside instruction using "teaching moments," competency-based education modules, and integration of instruction into critical care orientation. Content and approach were based on the background and level of experience of participants. Educational program outcomes included increased consistency in monitoring neuromuscular blockade by clinical assessment and peripheral nerve stimulation. A second outcome was more accurate patient assessment leading to the provision of drug therapy specific to the patients' clinical states, including anxiety or pain. The continuous quality improvement approach offers a model for improving patient care using individualized needs assessment, focused educational interventions, and program evaluation strategies.

Performance Funding in Tennessee: Stimulus for Program Improvement.

ERIC Educational Resources Information Center

Banta, Trudy W.; Moffett, Marian S.

1987-01-01

All postsecondary institutions in Tennessee have the opportunity to earn an annual budget supplement for instruction from the state if certain criteria, based on educational outcomes, are obtained. A comprehensive assessment program at the University of Tennessee at Knoxville is described. (MLW)

77 FR 28360 - Notice of Proposed Information Collection Requests; Office of Planning, Evaluation and Policy...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-14

... study has two main components: (1) A review of recent research on the identification of ELs with special... descriptive in nature. The study is not a program evaluation and does not purport to assess program outcomes...

The National Cross-Site Evaluation of High-Risk Youth Programs. Preventing Substance Abuse: Major Findings from the National Cross-Site Evaluation of High-Risk Youth Programs. Monograph Series.

ERIC Educational Resources Information Center

Springer, J. Fred; Sambrano, Soledad; Sale, Elizabeth; Kasim, Rafa; Herman, Jack

This multiple-site study assessed 48 prevention programs for high-risk youth funded by the Center for Substance Abuse Prevention, identifying program characteristics associated with strong substance abuse prevention outcomes. Data analysis indicated that substance abuse programs reduced rates of substance use, and the positive effects of program…

Evaluation of Project P.A.T.H.S. (Secondary 1 Program) by the Program Participants: Findings Based on the Full Implementation Phase

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Sun, Rachel C. F.

2008-01-01

A total of 207 schools (N = 33,693 students) participated in the Secondary 1 Program of Project P.A.T.H.S. in the Full Implementation Phase (2006-07). Participants responded to a Subjective Outcome Evaluation Form (Form A) to assess their views of the program, instructors, and perceived effectiveness after program completion. Utilizing the…

The Blue Cross Blue Shield of Michigan Cardiovascular Consortium (BMC2) collaborative quality improvement initiative in percutaneous coronary interventions.

PubMed

Moscucci, Mauro; Share, David; Kline-Rogers, Eva; O'Donnell, Michael; Maxwell-Eward, Ann; Meengs, William L; Clark, Vivian L; Kraft, Phillip; De Franco, Anthony C; Chambers, James L; Patel, Kirit; McGinnity, John G; Eagle, Kim A

2002-10-01

The past decade has been characterized by increased scrutiny of outcomes of surgical and percutaneous coronary interventions (PCIs). This increased scrutiny has led to the development of regional, state, and national databases for outcome assessment and for public reporting. This report describes the initial development of a regional, collaborative, cardiovascular consortium and the progress made so far by this collaborative group. In 1997, a group of hospitals in the state Michigan agreed to create a regional collaborative consortium for the development of a quality improvement program in interventional cardiology. The project included the creation of a comprehensive database of PCIs to be used for risk assessment, feedback on absolute and risk-adjusted outcomes, and sharing of information. To date, information from nearly 20,000 PCIs have been collected. A risk prediction tool for death in the hospital and additional risk prediction tools for other outcomes have been developed from the data collected, and are currently used by the participating centers for risk assessment and for quality improvement. As the project enters into year 5, the participating centers are deeply engaged in the quality improvement phase, and expansion to a total of 17 hospitals with active PCI programs is in process. In conclusion, the Blue Cross Blue Shield of Michigan Cardiovascular Consortium is an example of a regional collaborative effort to assess and improve quality of care and outcomes that overcome the barriers of traditional market and academic competition.

An interactive multimedia program to prevent HIV transmission in men with intellectual disability.

PubMed

Wells, Jennifer; Clark, Khaya; Sarno, Karen

2014-05-01

The efficacy of a computer-based interactive multimedia HIV/AIDS prevention program for men with intellectual disability (ID) was examined using a quasi-experimental within-subjects design. Thirty-seven men with mild to moderate intellectual disability evaluated the program. The pretest and posttest instruments assessed HIV/AIDS knowledge (high-risk fluids, HIV transmission, and condom facts) and condom application skills. All outcome measures showed statistically significant gains from pretest to posttest, with medium to large effect sizes. In addition, a second study was conducted with twelve service providers who work with men with ID. Service providers reviewed the HIV/AIDS prevention program, completed a demographics questionnaire, and a program satisfaction survey. Overall, service providers rated the program highly on several outcome measures (stimulation, relevance, and usability).

Needs Assessment: Who Needs It?

ERIC Educational Resources Information Center

Hays, Donald G.; Linn, Joan K.

This monograph addresses the issue of needs assessment in the educational process and how it applies to the school counselor's role. The authors provide information on the process of needs assessment, from the initial step of obtaining commitment to the final outcome of improved program planning and development. Using an example common to many…

Developing a Competency-Based Assessment Approach for Student Learning

ERIC Educational Resources Information Center

Dunning, Pamela T.

2014-01-01

Higher education accrediting bodies are increasing the emphasis on assessing student learning outcomes as opposed to teaching methodology. The purpose of this article is to describe the process used by Troy University's Master of Public Administration program to change their assessment approach from a course learning objective perspective to a…

Ten Things Every Professor Should Know about Assessment

ERIC Educational Resources Information Center

Wolf, Kenneth; Dunlap, Joanna; Stevens, Ellen

2012-01-01

This article describes ten key assessment practices for advancing student learning that all professors should be familiar with and strategically incorporate in their classrooms and programs. Each practice or concept is explained with examples and guidance for putting it into practice. The ten are: learning outcomes, performance assessments,…

Diagnostic and Value-Added Assessment of Business Writing

ERIC Educational Resources Information Center

Fraser, Linda; Harich, Katrin; Norby, Joni; Brzovic, Kathy; Rizkallah, Teeanna; Loewy, Dana

2005-01-01

To assess students' business writing abilities upon entry into the business program and exit from the capstone course, a multitiered assessment package was developed that measures students' achievement of specific learning outcomes and provides "value-added" scores. The online segment of the test measures five competencies across three process…

Impacts of Professional Development in Classroom Assessment on Teacher and Student Outcomes

ERIC Educational Resources Information Center

Randel, Bruce; Apthorp, Helen; Beesley, Andrea D.; Clark, Tedra F.; Wang, Xin

2016-01-01

The authors describe an impact study of Classroom Assessment for Student Learning (CASL), a widely used professional development program in classroom and formative assessment. Researchers randomly assigned 67 elementary schools to receive CASL materials or continue with regularly scheduled professional development. Teachers in CASL schools formed…

No Pain, No Gain: The Learning Curve in Assessing Collaboratives.

ERIC Educational Resources Information Center

Rendon, Laura I.; Gans, Wendy L.; Calleroz, Mistalene D.

1998-01-01

Presents a case study of an assessment project designed to evaluate the Ford Foundation's Urban Partnership Program (UPP). Discusses UPP's assessment model and theory, and documents the project's yearly progress since its inception in 1992. Details UPP's goals and outcomes in assisting at-risk students. (EMH)

Teacher Thoughts on Infographics as Alternative Assessment: A Post-Secondary Educational Exploration

ERIC Educational Resources Information Center

Gover, Glen Bruce

2017-01-01

This qualitative phenomenological case study is designed to investigate the learning outcomes, lived experiences, and perceptions of eight post-secondary teachers participating in a sketch-based infographic development training program. This research is designed to assess the viability of infographics as a learning and assessment strategy,…

Drug Treatment Service Utilization and Outcomes for Hispanic and White Methamphetamine Abusers

PubMed Central

Niv, Noosha; Hser, Yih-Ing

2006-01-01

Objective To examine differences in drug treatment service needs, utilization, satisfaction, and outcomes between Hispanic and white methamphetamine (meth) abusers. Data Sources Intake assessments and follow-up interviews of 128 Hispanic and 371 non-Hispanic white meth abusers admitted during 2000–2001 to 43 drug treatment programs in 13 counties across California. Study Design A prospective longitudinal study comparing ethnic differences in problem severity during pre- and posttreatment periods, as well as in services received during treatment. Data Collection/Extraction Methods The Addiction Severity Index (ASI) was administered at both intake and the 9-month follow-up to assess clients' problem severity in a number of domains. Service utilization and satisfaction were assessed 3 months following treatment admission. Principal Findings Hispanics were less educated and reported more employment difficulties than whites. Whites were more likely to be treated in residential programs than Hispanics despite similar severity in drug and alcohol use, legal, medical and family/social problems, and psychiatric status. Significantly more whites than Hispanics received psychiatric services, likely because more of them were treated in residential programs. Whites also reported receiving greater numbers of total services and services addressing alcohol and psychiatric problems. While no ethnic differences were found in treatment satisfaction and several other outcomes, Hispanics demonstrated better family and social outcomes than whites. Conclusions Both Hispanic and white meth abusers improved after treatment, although benefits from treatment can be further enhanced if services underscore different facets of their psychosocial problems. PMID:16899005

Quality of care for patients with type 2 diabetes mellitus in the Netherlands and the United States: a comparison of two quality improvement programs.

PubMed

Valk, Gerlof D; Renders, Carry M; Kriegsman, Didi M W; Newton, Katherine M; Twisk, Jos W R; van Eijk, Jacques Th M; van der Wal, Gerrit; Wagner, Edward H

2004-08-01

To assess differences in diabetes care and patient outcomes by comparing two multifaceted quality improvement programs in two different countries, and to increase knowledge of effective elements of such programs. Primary care in the ExtraMural Clinic (EMC) of the Department of General Practice of the Vrije Universiteit in Amsterdam, the Netherlands, and the Group Health Cooperative (GHC), a group-model health maintenance organization (HMO) in western Washington State in the United States. Data were collected from 1992 to 1997. In this observational study two diabetes cohorts in which a quality improvement program was implemented were compared. Both programs included a medical record system, clinical practice guidelines, physician educational meetings, audit, and feedback. Only the Dutch program (EMC) included guidelines on the structure of diabetes care and a recall system. Only the GHC program included educational outreach visits, formation of multidisciplinary teams, and patient self-management support. Included were 379 EMC patients, and 2,119 GHC patients with type 2 diabetes mellitus. Main process outcomes were: annual number of diabetes visits, and number of HbA1c and blood lipid measurements. Main patient outcomes were HbA1c and blood lipid levels. Multilevel analysis was used to adjust for dependency between repeated observations within one patient and for clustering of patients within general practices. In the EMC process outcomes and glycemic control improved more than at GHC, however, GHC had better baseline measures. There were no differences between programs on blood lipid control. During follow-up, intensification of pharmacotherapy was noted at both sites. Differences noted between programs were in line with differences in diabetes guidelines. Following implementation of guidelines and organizational improvement efforts, change occurred primarily in the process outcomes, rather than in the patient outcomes. Although much effort was put into improving process and patient outcomes, both complex programs still showed only moderate effects.

The association between sarcopenia and functional outcomes among older patients with hip fracture undergoing in-hospital rehabilitation.

PubMed

Landi, F; Calvani, R; Ortolani, E; Salini, S; Martone, A M; Santoro, L; Santoliquido, A; Sisto, A; Picca, A; Marzetti, E

2017-05-01

This study evaluates the prevalence of sarcopenia among older people admitted to a rehabilitation unit after hip fracture and the association between sarcopenia and functional outcomes. The results show that sarcopenia had a negative impact on functional recovery. The assessment of sarcopenia among older adults receiving rehabilitation programs is crucial. Sarcopenia is a highly prevalent geriatric syndrome associated with adverse outcomes, including falls, disability, institutionalization, and mortality. Few studies assessed sarcopenia among older adults receiving rehabilitation programs. Patients aged 70 years or more consecutively admitted to in-hospital rehabilitation programs that had suffered from hip fracture entered the study. Sarcopenia was defined according to the Foundation for National Institutes of Health (FNIH) criteria. Multivariable linear regression models were used to analyze the association between the sarcopenia and functional recovery. The recruited population was composed of 127 patients, with a mean age of 81.3 ± 4.8 years, predominantly females (64.6%). Using the criteria proposed by the FNIH, patients with a diagnosis of sarcopenia were 43 (33.9%). After adjustment for potential confounders, participants with sarcopenia had a significant increased risk of incomplete functional recovery compared with non-sarcopenic patients (OR 3.07, 95% CI 1.07-8.75). Compared with participants without sarcopenia, those with sarcopenia showed lower Barthel index scores at the time of discharge from the rehabilitation unit (69.2 versus 58.9, respectively; p < 0.001) and after 3 months of follow-up (90.9 versus 80.5, respectively; p = 0.02). These findings support the systematic assessment of sarcopenia among older adults receiving rehabilitation programs to assist in the development of personalized treatment plans aimed at improving functional outcomes.

Barbershop Talk With Brothers: using community-based participatory research to develop and pilot test a program to reduce HIV risk among Black heterosexual men.

PubMed

Wilson, Tracey E; Fraser-White, Marilyn; Williams, Kim M; Pinto, Angelo; Agbetor, Francis; Camilien, Brignel; Henny, Kirk; Browne, Ruth C; Gousse, Yolene; Taylor, Tonya; Brown, Humberto; Taylor, Raekiela; Joseph, Michael A

2014-10-01

There is a need for feasible, evidence-based interventions that support HIV risk reduction among heterosexual Black men. In this article, we describe the process for development of the Barbershop Talk With Brothers (BTWB) program and evaluation. The BTWB program is a theoretically grounded and community-based HIV prevention program that seeks to improve individual skills and motivation to decrease sexual risk, and that builds men's interest in and capacity for improving their community's health. Formative data collection included barbershop observations and barber focus groups, brief behavioral risk assessments of men in barbershops, and focus groups and individual interviews. Based on this information and in consultation with our steering committee, we developed the BTWB program and accompanying program evaluation. From April through November 2011, 80 men were recruited and completed a baseline assessment of a pilot test of the program; 78 men completed the program and 71 completed a 3-month assessment. The pilot evaluation procedures were feasible to implement, and assessments of pre- and post-test measures indicate that key behavioral outcomes and proposed mediators of those outcomes changed in hypothesized directions. Specifically, attitudes and self-efficacy toward consistent condom use improved, and respondents reported lower levels of sexual risk behavior from baseline to follow-up (all p < 0.05). Perceptions of community empowerment also increased (p = 0.06). While HIV stigma decreased, this difference did not reach statistical significance. Our approach to community-engaged program development resulted in an acceptable, feasible approach to reaching and educating heterosexual Black men about HIV prevention in community settings.

The American Burn Association/Shriners Hospitals for Children Burn Outcomes Program: a progress report at 15 years.

PubMed

Tompkins, Ronald G; Liang, Matthew H; Lee, Austin F; Kazis, Lewis E

2012-09-01

The American Burn Association and the Shriners Hospitals for Children Outcomes Program has been in development for more than 15 years. Many of the tools and important findings are described in this special issue of The Journal of Trauma. This unique program in outcomes research introduces a model for outcome assessments from the patient-centered perspective with a cohort of 1,140 children with burn injury after hospitalization for up to 4 years. The findings represent a fundamental contribution to the field of burn care for monitoring outcomes from the perspective of the parent or child/adolescent. The Multi-Center Benchmarking Study of four burn centers serve as a model for collecting empiric scientific data on the variation and the expected trajectories of recovery in the most important domains of patient outcomes and can inform clinical decisions and the conduct of health service research. The dramatic progress in survival of children with severe burn injury and other advances in burn management can now move into a new phase of understanding the most cost-effective components of this care.

Stakeholders' perceptions on competency and assessment program of entry-level pharmacists in developing countries.

PubMed

Asante, Isaac; Andoh, Irene; Muijtjens, Arno M M; Donkers, Jeroen

2017-05-01

To assess the stakeholders' perceptions on the competency of entry-level pharmacists and the use of written licensure examination as the primary assessment for licensure decisions on entry-level pharmacists who have completed the Pharmacy Internship Program 1 (PIP) in developing countries. A cross-sectional survey was conducted among stakeholders in which they completed a web-based 21-item pre-tested questionnaire to determine their views regarding the competency outcomes and assessment program for entry-level pharmacist. The stakeholders rated the entry-level pharmacists to possess all competencies except research skills. Stakeholders suggested improvement of the program by defining the competency framework and training preceptors. However, stakeholders disagree on using written examination as the primary assessment for licensure decision and suggested the incorporation of other performance-based assessments like preceptor's assessment reports. Stakeholders are uncertain on entry-level pharmacists in developing countries possessing adequate research competencies and think their assessment program for licensure need more than written examination to assess all required competencies. Copyright © 2017 Elsevier Inc. All rights reserved.

The From Survivor to Thriver Program: RCT of an online therapist-facilitated program for rape-related PTSD

PubMed Central

Littleton, Heather; Grills, Amie E.; Kline, Katherine D.; Schoemann, Alexander M.; Dodd, Julia C.

2016-01-01

This study evaluated the efficacy of the From Survivor to Thriver program, an interactive, online therapist-facilitated cognitive-behavioral program for rape-related PTSD. Eighty-seven college women with rape-related PTSD were randomized to complete the interactive program (n = 46) or a psycho-educational self-help website (n = 41). Both programs led to large reductions in interview-assessed PTSD at post-treatment (interactive d = 2.22, psycho-educational d = 1.10), which were maintained at three month follow-up. Both also led to medium- to large-sized reductions in self-reported depressive and general anxiety symptoms. Follow-up analyses supported that the therapist-facilitated interactive program led to superior outcomes among those with higher pre-treatment PTSD whereas the psycho-educational self-help website led to superior outcomes for individuals with lower pre-treatment PTSD. Future research should examine the efficacy and effectiveness of online interventions for rape-related PTSD including whether treatment intensity matching could be utilized to maximize outcomes and therapist resource efficiency. PMID:27513363

The From Survivor to Thriver program: RCT of an online therapist-facilitated program for rape-related PTSD.

PubMed

Littleton, Heather; Grills, Amie E; Kline, Katherine D; Schoemann, Alexander M; Dodd, Julia C

2016-10-01

This study evaluated the efficacy of the From Survivor to Thriver program, an interactive, online therapist-facilitated cognitive-behavioral program for rape-related PTSD. Eighty-seven college women with rape-related PTSD were randomized to complete the interactive program (n=46) or a psycho-educational self-help website (n=41). Both programs led to large reductions in interview-assessed PTSD at post-treatment (interactive d=2.22, psycho-educational d=1.10), which were maintained at three month follow-up. Both also led to medium- to large-sized reductions in self-reported depressive and general anxiety symptoms. Follow-up analyses supported that the therapist-facilitated interactive program led to superior outcomes among those with higher pre-treatment PTSD whereas the psycho-educational self-help website led to superior outcomes for individuals with lower pre-treatment PTSD. Future research should examine the efficacy and effectiveness of online interventions for rape-related PTSD including whether treatment intensity matching could be utilized to maximize outcomes and therapist resource efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Program Outcomes and Soldier Perceptions of the Army Pregnancy and Postpartum Physical Training (P3T) Program

DTIC Science & Technology

2014-07-24

assessments, have higher body fat percentage, have higher incidents of illness and injury, and other poor health and fitness outcomes (91). A pilot study...failed to meet fitness and body composition standards may be a source of shame for some participants, particularly given the prevalence of weight-related...been difficult for those experiencing a high level of shame about their performance. It is possible that many of the individuals reporting “Not

Vignette Question Design for the Assessment of Graduate Sustainability Learning Outcomes

ERIC Educational Resources Information Center

Sandri, Orana; Holdsworth, Sarah; Thomas, Ian

2018-01-01

The development of university wide graduate attributes has become an important mechanism for setting generic learning outcomes across higher education institutions. Many universities around the world have developed sets of graduate attributes that they aim to develop through degree programs. Sustainability related attributes have been included in…

School Climate Assessment Programs. Technical Assistance Bulletin 38.

ERIC Educational Resources Information Center

National School Resource Network, Washington, DC.

Numerous studies indicate that climate, the prevailing "feeling" of the environment, not only contributes to behavioral and situational outcomes, but that climate can be changed to help bring about the behaviors and outcomes desired. Researchers have identified characteristics of positive school climates and ways of determining the presence or…

Competency Analytics Tool: Analyzing Curriculum Using Course Competencies

ERIC Educational Resources Information Center

Gottipati, Swapna; Shankararaman, Venky

2018-01-01

The applications of learning outcomes and competency frameworks have brought better clarity to engineering programs in many universities. Several frameworks have been proposed to integrate outcomes and competencies into course design, delivery and assessment. However, in many cases, competencies are course-specific and their overall impact on the…

Assessing Child Welfare Outcomes in Central and Eastern Europe.

ERIC Educational Resources Information Center

Herczog, Maria

1998-01-01

Discusses the need to examine effectiveness of services to children and families in central and eastern Europe, focusing on programs in Hungary. Notes that financial considerations and differences in objectives have increased the importance of outcomes measurement. Reports that the pilot implementation of "Looking After Children"…

Impact of Competency-Based Education and Assessment on Program Outcomes

ERIC Educational Resources Information Center

Konkoth, Shanthi

2016-01-01

Since the publication of the "College Scorecard" by The U.S. Department of Education in 2015, comparisons between college attendance costs and institutional outcomes (i.e., graduation rates, post-graduation earnings) have come into sharp focus. This increased scrutiny requires institutions of higher learning to be more transparent about…

Maryland Learning Outcomes: Maryland School Performance Assessment Program for Social Studies.

ERIC Educational Resources Information Center

Maryland State Dept. of Education, Baltimore.

This document outlines six learning outcomes for social studies students in grades PreK-8 in Maryland schools: (1) "Social Studies Skills" (students will demonstrate an understanding of historical and current events using chronological and spatial thinking, develop historical interpretations, and frame questions that include collecting…

Child and Family Predictors of Therapy Outcome for Children with Behavioral and Emotional Problems

ERIC Educational Resources Information Center

Hemphill, Sheryl A.; Littlefield, Lyn

2006-01-01

This study investigated the characteristics of 106 children primarily referred for externalizing behavior problems and their families, and assessed the prediction of treatment outcome following a standardized short-term, cognitive behavioral group program. "Exploring Together" comprised a children's group (anger management, problem-solving and…

A Virtual Patient Software Program to Improve Pharmacy Student Learning in a Comprehensive Disease Management Course

PubMed Central

Casale, Jillian P.; Skirvin, J. Andrew; DiVall, Margarita V.

2013-01-01

Objective. To implement and assess the impact of a virtual patient pilot program on pharmacy students’ clinical competence skills. Design. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessment. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students’ posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Conclusion. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes. PMID:24159213

The National Assessment of Educational Progress and the Longitudinal Studies Program: Together or Apart? Report of a Planning Conference (Washington, D.C., December 11, 1986).

ERIC Educational Resources Information Center

Brown, George H.; Faupel, Elizabeth M.

The National Assessment of Educational Progress (NAEP) and the Longitudinal Studies Program (LSP) are major survey projects on educational outcomes performed by the Center for Education Statistics. NAEP is a continuing cross-sectional survey of young Americans' skills, knowledge, and attitudes. The LSP studies follow a sample of students as they…

BBN-Based Portfolio Risk Assessment for NASA Technology R&D Outcome

NASA Technical Reports Server (NTRS)

Geuther, Steven C.; Shih, Ann T.

2016-01-01

The NASA Aeronautics Research Mission Directorate (ARMD) vision falls into six strategic thrusts that are aimed to support the challenges of the Next Generation Air Transportation System (NextGen). In order to achieve the goals of the ARMD vision, the Airspace Operations and Safety Program (AOSP) is committed to developing and delivering new technologies. To meet the dual challenges of constrained resources and timely technology delivery, program portfolio risk assessment is critical for communication and decision-making. This paper describes how Bayesian Belief Network (BBN) is applied to assess the probability of a technology meeting the expected outcome. The network takes into account the different risk factors of technology development and implementation phases. The use of BBNs allows for all technologies of projects in a program portfolio to be separately examined and compared. In addition, the technology interaction effects are modeled through the application of object-oriented BBNs. The paper discusses the development of simplified project risk BBNs and presents various risk results. The results presented include the probability of project risks not meeting success criteria, the risk drivers under uncertainty via sensitivity analysis, and what-if analysis. Finally, the paper shows how program portfolio risk can be assessed using risk results from BBNs of projects in the portfolio.

Diverse characteristics of wetlands restored under the Wetlands Reserve Program in the Southeastern United States

Treesearch

Diane De Steven; Joel M. Gramling

2012-01-01

The Wetlands Reserve Program (WRP) restores converted or degraded wetlands on private working lands; however, the nature and outcomes of such efforts are undocumented in the Southeastern U.S. Identification of wetland types is needed to assess the program's conservation benefits, because ecological functions differ with hydrogeomorphic (HGM) type. We reviewed...

Changing the Legacy of Divorce: Evidence from Prevention Programs and Future Directions.

ERIC Educational Resources Information Center

Haine, Rachel A.; Sandler, Irwin N.; Wolchik, Sharlene A.; Tein, Jenn-Yun; Dawson-McClure, Spring R.

2003-01-01

Assesses efforts to prevent mental health problems in children of divorce by highlighting the importance of using theory in the design and evaluation of prevention programs and by reviewing the empirical research on the efficacy of programs to improve outcomes for children of divorce. Also proposes two future directions for advancing theory-based…

Goal Attainment Scaling as an Effective Strategy to Assess the Outcomes of Mentoring Programs for Troubled Youth

ERIC Educational Resources Information Center

Balcazar, Fabricio E.; Davies, Gethin L.; Viggers, Dave; Tranter, Gary

2006-01-01

Mentoring programs are increasingly popular as preventive and/or supportive interventions for youth with various needs. A meta-analysis of mentoring program effects conducted by DuBois, Holloway, Valentine, and Cooper (2002) suggests that youth from backgrounds of risk (defined broadly) have the capacity to benefit from mentoring, especially when…

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

ERIC Educational Resources Information Center

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

Welcome Home and Early Start: An Assessment of Program Quality and Outcomes

ERIC Educational Resources Information Center

Daro, Deborah, Howard, Eboni; Tobin, Jennifer; Harden, Allen

2005-01-01

Chapin Hall Center for Children at the University of Chicago, in collaboration with Westat Associates, designed and implemented a comprehensive evaluation of the Early Childhood Initiative's (ECI) two home visitation programs: Welcome Home, a universal home visitation program that provides a single home visit to all first-time and teen parents,…

SSAIS: A Program to Assess Adverse Impact in Multistage Selection Decisions

ERIC Educational Resources Information Center

De Corte, Wilfried

2004-01-01

The article describes a Windows program to estimate the expected value and sampling distribution function of the adverse impact ratio for general multistage selections. The results of the program can also be used to predict the risk that a future selection decision will result in an outcome that reflects the presence of adverse impact. The method…

Measuring public health practice and outcomes in chronic disease: a call for coordination.

PubMed

Porterfield, Deborah S; Rogers, Todd; Glasgow, LaShawn M; Beitsch, Leslie M

2015-04-01

A strategic opportunity exists to coordinate public health systems and services researchers' efforts to develop local health department service delivery measures and the efforts of divisions within the Centers for Disease Control and Prevention's National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP) to establish outcome indicators for public health practice in chronic disease. Several sets of outcome indicators developed by divisions within NCCDPHP and intended for use by state programs can be tailored to assess outcomes of interventions within smaller geographic areas or intervention settings. Coordination of measurement efforts could potentially allow information to flow from the local to the state to the federal level, enhancing program planning, accountability, and even subsequent funding for public health practice.

Quantifying the process and outcomes of person-centered planning.

PubMed

Holburn, S; Jacobson, J W; Vietze, P M; Schwartz, A A; Sersen, E

2000-09-01

Although person-centered planning is a popular approach in the field of developmental disabilities, there has been little systematic assessment of its process and outcomes. To measure person-centered planning, we developed three instruments designed to assess its various aspects. We then constructed variables comprising both a Process and an Outcome Index using a combined rational-empirical method. Test-retest reliability and measures of internal consistency appeared adequate. Variable correlations and factor analysis were generally consistent with our conceptualization and resulting item and variable classifications. Practical implications for intervention integrity, program evaluation, and organizational performance are discussed.

Outcomes of Career Counseling with Women.

ERIC Educational Resources Information Center

Seligman, Linda

1981-01-01

Describes a career counseling program for adult females. Reports questionnaire results used to assess the effectiveness of that program. Male as well as female clients seemed to derive both attitudinal and occupational benefits from career counseling and expressed positive views of the career counseling process. (Author)

Current state of high-risk infant follow-up care in the United States: results of a national survey of academic follow-up programs.

PubMed

Kuppala, V S; Tabangin, M; Haberman, B; Steichen, J; Yolton, K

2012-04-01

High-risk infant follow-up programs have the potential to act as multipurpose clinics by providing continuity of clinical care, education of health care trainees and facilitating outcome data research. Currently there are no nationally representative data on high-risk infant follow-up practices in the United States. The objective of this study is to collect information about the composition of high-risk infant follow-up programs associated with academic centers in the United States, with respect to their structure, function, funding resources and developmental assessment practices, and to identify the barriers to establishment of such programs. Staff neonatologists, follow-up program directors and division directors of 170 Neonatal Intensive Care Units (NICU) associated with pediatric residency programs were invited to participate in an anonymous online survey from October 2009 to January 2010. The overall response rate was 84%. Ninety three percent of the respondents have a follow-up program associated with their NICU. Birth weight, gestational age and critical illness in the NICU were the major criteria for follow-up care. Management of nutrition and neurodevelopmental assessments was the most common service provided. Over 70% have health care trainees in the clinic. About 75% of the respondents have the neurodevelopmental outcome data available. Most of the respondents reported multiple funding sources. Lack of personnel and funding were the most common causes for not having a follow-up program. High-risk infant follow-up programs associated with academic centers in the United States are functioning as multidisciplinary programs providing clinical care, trainee education and facilitating outcomes research.

New technologies and surgical innovation: five years of a local health technology assessment program in a surgical department.

PubMed

Poulin, Paule; Austen, Lea; Kortbeek, John B; Lafrenière, René

2012-06-01

There is pressure for surgical departments to introduce new and innovative health technologies in an evidence-based manner while ensuring that they are safe and effective and can be managed with available resources. A local health technology assessment (HTA) program was developed to systematically integrate research evidence with local operational management information and to make recommendations for subsequent decision by the departmental executive committee about whether and under what conditions the technology will be used. The authors present a retrospective analysis of the outcomes of this program as used by the Department of Surgery & Surgical Services in the Calgary Health Region over a 5-year period from December 2005 to December 2010. Of the 68 technologies requested, 15 applications were incomplete and dropped, 12 were approved, 3 were approved for a single case on an urgent/emergent basis, 21 were approved for "clinical audit" for a restricted number of cases with outcomes review, 14 were approved for research use only, and 3 were referred to additional review bodies. Subsequent outcome reports resulted in at least 5 technologies being dropped for failure to perform. Decisions based on local HTA program recommendations were rarely "yes" or "no." Rather, many technologies were given restricted approval with full approval contingent on satisfying certain conditions such as clinical outcomes review, training protocol development, or funding. Thus, innovation could be supported while ensuring safety and effectiveness. This local HTA program can be adapted to a variety of settings and can help bridge the gap between evidence and practice.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

PubMed

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

The impact of cooking classes on food-related preferences, attitudes, and behaviors of school-aged children: a systematic review of the evidence, 2003-2014.

PubMed

Hersch, Derek; Perdue, Laura; Ambroz, Teresa; Boucher, Jackie L

2014-11-06

Cooking programs have been used to promote healthful eating among people of all ages. This review assesses the evidence on childhood cooking programs and their association with changes in food-related preferences, attitudes, and behaviors of school-aged children. We systematically searched PubMed, Ovid-Medline, and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases. We included primary research articles that involved cooking education programs for children and searched reference lists for eligible articles. Studies considered for review contained a hands-on cooking intervention; had participants aged 5 to 12 years; were published in a peer-reviewed journal on or after January 1, 2003; and were written in English. We used the Effective Public Health Practice Project Quality Assessment Tool for Quantitative Studies to rate the strength of each article and assess bias. The following information was extracted from each study: study design, sample size, location, duration, intervention components, data collection methods, and outcomes. Eight studies met the inclusion criteria and used cooking education to influence children's food-related preferences, attitudes, and behaviors. Programs varied in duration, evaluation methods, and outcomes of interest. Self-reported food preparation skills, dietary intake, cooking confidence, fruit and vegetable preferences, attitudes toward food and cooking, and food-related knowledge were among the outcomes measured. Program exposure ranged from 2 sessions to regular instruction over 2 years, and the effect of cooking programs on children's food-related preferences, attitudes, and behaviors varied among the reviewed studies. Findings suggest that cooking programs may positively influence children's food-related preferences, attitudes, and behaviors. However, because study measurements varied widely, determining best practices was difficult. Further research is needed to fill knowledge gaps on ideal program length, long-term effects, and usefulness of parent engagement, tasting lessons, and other intervention components.

The Impact of Cooking Classes on Food-Related Preferences, Attitudes, and Behaviors of School-Aged Children: A Systematic Review of the Evidence, 2003–2014

PubMed Central

Perdue, Laura; Ambroz, Teresa; Boucher, Jackie L.

2014-01-01

Introduction Cooking programs have been used to promote healthful eating among people of all ages. This review assesses the evidence on childhood cooking programs and their association with changes in food-related preferences, attitudes, and behaviors of school-aged children. Methods We systematically searched PubMed, Ovid-Medline, and CINAHL (Cumulative Index to Nursing and Allied Health Literature) databases. We included primary research articles that involved cooking education programs for children and searched reference lists for eligible articles. Studies considered for review contained a hands-on cooking intervention; had participants aged 5 to 12 years; were published in a peer-reviewed journal on or after January 1, 2003; and were written in English. We used the Effective Public Health Practice Project Quality Assessment Tool for Quantitative Studies to rate the strength of each article and assess bias. The following information was extracted from each study: study design, sample size, location, duration, intervention components, data collection methods, and outcomes. Results Eight studies met the inclusion criteria and used cooking education to influence children’s food-related preferences, attitudes, and behaviors. Programs varied in duration, evaluation methods, and outcomes of interest. Self-reported food preparation skills, dietary intake, cooking confidence, fruit and vegetable preferences, attitudes toward food and cooking, and food-related knowledge were among the outcomes measured. Program exposure ranged from 2 sessions to regular instruction over 2 years, and the effect of cooking programs on children’s food-related preferences, attitudes, and behaviors varied among the reviewed studies. Conclusions Findings suggest that cooking programs may positively influence children’s food-related preferences, attitudes, and behaviors. However, because study measurements varied widely, determining best practices was difficult. Further research is needed to fill knowledge gaps on ideal program length, long-term effects, and usefulness of parent engagement, tasting lessons, and other intervention components. PMID:25376015

An Investigation of the Relationship Between the Alliance Negotiation Scale and Psychotherapy Process and Outcome.

PubMed

Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

2017-04-01

This study examines the validity of the Alliance Negotiation Scale (ANS) in a psychotherapy research program. Analyses were designed to evaluate the relationship between the ANS and psychotherapy process and outcome variables. Data were collected in a metropolitan psychotherapy research program. Participants completed 30 sessions of therapy, postsession assessments, and a battery of measures at intake and termination. Relationships were found between the ANS and session outcome, working alliance, and the presence of ruptures and their resolution. Relationships emerged between the ANS and treatment outcome on measures of psychiatric distress and interpersonal problems. The ANS demonstrated relationships with several psychotherapy process and outcome variables. The ANS was the most differentiated from the working alliance on measures of interpersonal functioning and in discriminating personality disorder pathology. These results extend previous findings on the ANS' psychometric integrity, and offer new data on the relationship between negotiation and treatment outcome. © 2016 Wiley Periodicals, Inc.

An Investigation of Teaching and Learning Programs in Pharmacy Education

PubMed Central

Baia, Patricia

2016-01-01

Objective. To investigate published, peer-reviewed literature on pharmacy teaching and learning development programs and to synthesize existing data, examine reported efficacy and identify future areas for research. Methods. Medline and ERIC databases were searched for studies on teaching development programs published between 2001 and 2015. Results. Nineteen publications were included, representing 21 programs. Twenty programs were resident teaching programs, one program described faculty development. The majority of programs spanned one year and delivered instruction on teaching methodologies and assessment measures. All except one program included experiential components. Thirteen publications presented outcomes data; most measured satisfaction and self-perceived improvement. Conclusion. Published literature on teacher development in pharmacy is focused more on training residents than on developing faculty members. Although programs are considered important and highly valued by program directors and participants, little data substantiates that these programs improve teaching. Future research could focus on measurement of program outcomes and documentation of teaching development for existing faculty members. PMID:27293226

An Investigation of Teaching and Learning Programs in Pharmacy Education.

PubMed

Strang, Aimee F; Baia, Patricia

2016-05-25

Objective. To investigate published, peer-reviewed literature on pharmacy teaching and learning development programs and to synthesize existing data, examine reported efficacy and identify future areas for research. Methods. Medline and ERIC databases were searched for studies on teaching development programs published between 2001 and 2015. Results. Nineteen publications were included, representing 21 programs. Twenty programs were resident teaching programs, one program described faculty development. The majority of programs spanned one year and delivered instruction on teaching methodologies and assessment measures. All except one program included experiential components. Thirteen publications presented outcomes data; most measured satisfaction and self-perceived improvement. Conclusion. Published literature on teacher development in pharmacy is focused more on training residents than on developing faculty members. Although programs are considered important and highly valued by program directors and participants, little data substantiates that these programs improve teaching. Future research could focus on measurement of program outcomes and documentation of teaching development for existing faculty members.

mobile Digital Access to a Web-enhanced Network (mDAWN): Assessing the Feasibility of Mobile Health Tools for Self-Management of Type-2 Diabetes.

PubMed

Ho, Kendall; Newton, Lana; Boothe, Allison; Novak-Lauscher, Helen

2015-01-01

The mobile Digital Access to a Web-enhanced Network (mDAWN) program was implemented as an online, mobile self-management system to support patients with type-2 diabetes and their informal caregivers. Patients used wireless physiological sensors, received text messages, and had access to a secure web platform with health resources and semi-facilitated discussion forum. Outcomes were evaluated using (1) pre and post self-reported health behavior measures, (2) physiological outcomes, (3) program cost, and (4) in-depth participant interviews. The group had significantly decreased health distress, HbA1c levels, and systolic blood pressure. Participants largely saw the mDAWN as providing good value for the costs involved and found the program to be empowering in gaining control over their diabetes. mHealth programs have the potential to improve clinical outcomes through cost effective patient-led care for chronic illness. Further evaluation needs to examine integration of similar mHealth programs into the patient-physician relationship.

An exploratory study of live vs. web-based delivery of a phlebotomy program.

PubMed

Fydryszewski, Nadine A; Scanlan, Craig; Guiles, H Jesse; Tucker, Ann

2010-01-01

Changes in student population and increased Web-based education offerings provided the impetus to assess pedagogy, cognitive outcomes and perceptions of course quality. This study explored cognitive outcomes and students' perception of course quality related to the Seven Principles for Good Practice in Undergraduate Education between live classroom delivery, compared to a Web-based delivery of a phlebotomy program. Quasi-experimental; students self-selected to enroll in live or Web-based program. For cognitive outcomes, no significant difference was found between the groups. Student perception of course quality differed only for Principle One (student-instructor contact). Students in the live classroom rated Principle One higher for the Part I course compared to the Web-based group. For the Part II course, there was no significant difference in perception of course quality related to any of the Seven Principles. The more constructivist pedagogy in the Part II course did not improve cognitive outcomes however, it may have contributed to knowledge retention. The live group rated Principle One in the Part II course evaluation relatively the same as they did for the Part I course evaluation. However, the Web-based group rated Principle One considerable higher for the Part II course than for Part I course. Future studies with a larger sample could explore improved course quality assessment instruments.

Comparison of native versus nonnative English-speaking nurses on critical thinking assessments at entry and exit.

PubMed

Whitehead, Tanya D

2006-01-01

Diversity of language among healthcare employees and nursing students is growing as diversity increases among the general population. Institutions have begun to develop systems to accommodate diversity and to assimilate workers. One barrier to nonnative English-speaking nurse hires may be posed by readiness for the licensure exam and the critical thinking assessments that are now an expected outcome of nursing programs, and act as a gatekeeper to graduation and to employment. To assist in preparing for high-stakes testing, the Assessment Technologies Institute Critical Thinking Assessment was developed in compliance with credentialing bodies' educational outcomes criteria. This pilot study of 209 nursing students was designed to reveal any possible language bias that might act as a barrier to nonnative English speakers. Nursing students were entered as whole classes to the study to control for selection bias. A sample representative of national nursing enrollment was obtained from 21 universities, with 192 (92%) native English-speaking students and 17 (8%) nonnative English speakers participating in the study. All students were given the Assessment Technologies Institute Critical Thinking Assessment at entry and exit to their nursing program. Average scores on entry were 66% for nonnative speakers and 72% for native speakers. At exit, the nonnative speakers had closed the gap in academic outcomes. They had an average score of 72% compared to 73% for native speakers. The study found that the slight differences between the native and nonnative speakers on 2 exit outcome measures-National Council licensure examination (NCLEX-RN) pass rates and Critical Thinking Assessment-were not statistically significant, demonstrating that nonnative English speakers achieved parity with native English-speaking peers on the Critical Thinking Assessment tool, which is often believed to be related to employment readiness.

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

PubMed Central

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271

Assessment and Continuous Quality Improvement: A North American Case Study.

ERIC Educational Resources Information Center

Tait, Jo; Knight, Peter

1995-01-01

Examines a five-stage assessment model used at James Madison University (Virginia) to assess student learning and to guide policy. Includes identification of program objectives, selection or design of methods that measure those outcomes, analysis of assessment data, application of data for decision making, and use of data to bid for state funding.…

Assessing the effectiveness of Australian early childhood education and care experiences: study protocol.

PubMed

Tayler, Collette; Cloney, Daniel; Adams, Ray; Ishimine, Karin; Thorpe, Karen; Nguyen, Thi Kim Cuc

2016-04-21

In Australia, 61.5 % of children aged 3-4 attend Early Childhood Education and Care (ECEC) programs. Children's experiences within these programs vary widely and impact directly on educational wellbeing and social development. Research has shown that higher quality programs enhance children's learning and developmental outcomes, foster social participation and have long-lasting effects on their productivity as adults. Quality matters, yet we do not know what components of ECEC result in a quality program. Effective Early Educational Experiences (E4Kids) is a 5-year longitudinal study designed to identify and assess the impact of mainstream ECEC programs and program components on children's learning, development, social inclusion and well-being. E4Kids sets out to measure quality ECEC; identify components that add value and positively impact children's outcomes; evaluate the effects of child, family, community and environment characteristics on programs; and provide evidence on how best to invest in ECEC. E4Kids follows a sample of 2,494 children who have experienced a variety of approved care programs (long day care, kindergarten, family day care and occasional care), as well as 157 children who have not accessed such programs. Children are tracked to the first point of National Assessment Program - Literacy and Numeracy (NAPLAN) testing at Year 3. The study presents a multi-level design in which ECEC programs were sampled from two states - Queensland and Victoria - then randomly sampled from two greater metropolitan regions and two regional and remote locations. Parents, centre directors, educators and carers complete questionnaires to provide information on demographics and children's progress. Data collected also include the make-up and organisation of ECEC programs and schools children attended. The quality of adult-child interactions is directly assessed using the Classroom Assessment Scoring System (CLASS) and direct testing of children's cognitive abilities and achievements is undertaken over 3 years and linked with NAPLAN scores. Findings from the E4Kids study have the potential to influence the quality of ECEC available in Australia by providing up-to-date evidence on the impact of ECEC programs and program components to inform future policy decisions and research.

Overview of Faculty Development Programs for Interprofessional Education

PubMed Central

Zorek, Joseph A.; Meyer, Susan M.

2017-01-01

Objectives. To describe characteristics of faculty development programs designed to facilitate interprofessional education, and to compile recommendations for development, delivery, and assessment of such faculty development programs. Methods. MEDLINE, CINAHL, ERIC, and Web of Science databases were searched using three keywords: faculty development, interprofessional education, and health professions. Articles meeting inclusion criteria were analyzed for emergent themes, including program design, delivery, participants, resources, and assessment. Results. Seventeen articles were identified for inclusion, yielding five characteristics of a successful program: institutional support; objectives and outcomes based on interprofessional competencies; focus on consensus-building and group facilitation skills; flexibility based on institution- and participant-specific characteristics; and incorporation of an assessment strategy. Conclusion. The themes and characteristics identified in this literature overview may support development of faculty development programs for interprofessional education. An advanced evidence base for interprofessional education faculty development programs is needed. PMID:28720924

Depression Predicts Functional Outcome in Geriatric Inpatient Rehabilitation.

PubMed

Shahab, Saba; Nicolici, Diana-Felicia; Tang, Alva; Katz, Paul; Mah, Linda

2017-03-01

To evaluate the effect of depression on functional recovery in geriatric patients who have completed an inpatient rehabilitation program. Prospective cohort study. Inpatient rehabilitation unit of a university-affiliated geriatric hospital. Convenience sample of patients (N=65; mean age, 81.6y; 25 men) admitted to rehabilitation over a 10-month period. Patients >60 years of age who were proficient in English and capable of providing informed consent were eligible to participate in the study. Depression was assessed using both the Geriatric Depression Scale-short form (GDS-15) and the Patient Health Questionnaire (9-item screen for depression) (PHQ-9). Measures of well-established predictors of rehabilitation outcome, which may interact with depression, were also obtained, and multiple regression linear modeling was used to evaluate the relation between depression and functional outcome over and above the contribution of these other factors. FIM (Functional Independence Measure) at discharge from the rehabilitation program. Depression, as assessed by the GDS-15, but not the PHQ-9, was predictive of functional outcome (standardized beta=-.151, P=.030) after controlling for other significant predictors, which included baseline disability, pain, cognition, and educational level. Participation in recreational, but not physio- or occupational, therapy additionally contributed to a small amount of variance in the functional outcome. Our findings suggest that self-report of depression is an independent predictor of functional outcome in high-tolerance, short-duration geriatric rehabilitation. Routine assessment of depressive symptoms in older adults using an instrument (eg, GDS-15) may help identify those at risk for poorer outcomes in rehabilitation. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Comparing data collected by computerized and written surveys for adolescence health research.

PubMed

Wu, Ying; Newfield, Susan A

2007-01-01

This study assessed whether data-collection formats, computerized versus paper-and-pencil, affect response patterns and descriptive statistics for adolescent health assessment surveys. Youth were assessed as part of a health risk reduction program. Baseline data from 1131 youth were analyzed. Participants completed the questionnaire either by computer (n = 390) or by paper-and-pencil (n = 741). The rate of returned surveys meeting inclusion requirements was 90.6% and did not differ by methods. However, the computerized method resulted in significantly less incompleteness but more identical responses. Multiple regression indicated that the survey methods did not contribute to problematic responses. The two survey methods yielded similar scale internal reliability and descriptive statistics for behavioral and psychological outcomes, although the computerized method elicited higher reports of some risk items such as carrying a knife, beating up a person, selling drugs, and delivering drugs. Overall, the survey method did not produce a significant difference in outcomes. This provides support for program personnel selecting survey methods based on study goals with confidence that the method of administration will not have a significant impact on the outcome.

Does an outcome-based approach to continuing medical education improve physicians' competences in rational prescribing?

PubMed

Esmaily, Hamideh M; Savage, Carl; Vahidi, Rezagoli; Amini, Abolghasem; Dastgiri, Saeed; Hult, Hakan; Dahlgren, Lars Owe; Wahlstrom, Rolf

2009-11-01

Continuing medical education (CME) is compulsory in Iran, and traditionally it is lecture-based, which is mostly not successful. Outcome-based education has been proposed for CME programs. To evaluate the effectiveness of an outcome-based educational intervention with a new approach based on outcomes and aligned teaching methods, on knowledge and skills of general physicians (GPs) working in primary care compared with a concurrent CME program in the field of "Rational prescribing". The method used was cluster randomized controlled design. All GPs working in six cities in one province in Iran were invited to participate. The cities were matched and randomly divided into an intervention arm for education on rational prescribing with an outcome-based approach, and a control arm for a traditional program on the same topic. Knowledge and skills were assessed using a pre- and post-test, including case scenarios. In total, 112 GPs participated. There were significant improvements in knowledge and prescribing skills after the training in the intervention arm as well as in comparison with the changes in the control arm. The overall intervention effect was 26 percentage units. The introduction of an outcome-based approach in CME appears to be effective when creating programs to improve GPs' knowledge and skills.

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

Assessing the effectiveness of a place-based conservation education program by applying utilization-focused evaluation

NASA Astrophysics Data System (ADS)

Flowers, Alice Blood

Lack of personal connection to the natural world by most American youth builds reason for assessing effectiveness of conservation education programs. Place-based learning is important in helping youth understand how their personal and societal well-being are linked and dependent upon their local habitats. Across Montana 2277 students in grades 3--10 participate in an interactive year long fishing education program with their teachers called Hooked on Fishing (HOF). The purpose of my study was to assess the effectiveness of HOF, a place-based conservation education program established in 1996, and modeled after the national Hooked on Fishing, Not on Drugs program. Using a quasi-experimental nonequivalent group study design, students received a pre-survey during the beginning of the program, a post-survey after the program, and an extended post-survey 12 to 14 weeks later. Teachers voluntarily participated in an Internet survey during May 2006, and program instructors voluntarily participated in a structured open-ended telephone interview in June 2006. A key component of my study was the decision to conduct the evaluation process using an approach which included stakeholders in the development of the instruments to measure student outcomes. This approach is called utilization-focused evaluation and was developed by Michael Q. Patton. The motive of this approach is to promote the usability of the evaluation results. The results are considered to have a better chance to be applied by the program stakeholders to not only gauge program effectiveness, but to be used to improve the program. Two research questions were: (1) does the frequency of outdoor experiences have significant affects on students' knowledge, skills, attitudes, and intended stewardship behaviors; and (2) does improved knowledge of local natural resources have significant affects on students' skills, attitudes and intended stewardship behavior. Nonparametric statistical analyses calculated statistical significant results for most knowledge and skill outcomes in a positive direction of change with 2--3 HOF outdoor experiences. Attitudinal and intended behavior outcomes did not show similar results. Internet teacher survey and instructor interviews provided qualitative depth and insight to student self-reported responses.

Models for Theory-Based M.A. and Ph.D. Programs.

ERIC Educational Resources Information Center

Botan, Carl; Vasquez, Gabriel

1999-01-01

Presents work accomplished at the 1998 National Communication Association Summer Conference. Outlines reasons for theory-based education in public relations. Presents an integrated model of student outcomes, curriculum, pedagogy, and assessment for theory-based master's and doctoral programs, including assumptions made and rationale for such…

The utility of the FIM+FAM for assessing traumatic brain injury day program outcomes.

PubMed

Seel, Ronald T; Wright, Greg; Wallace, Tracey; Newman, Sary; Dennis, Leanne

2007-01-01

To evaluate the effectiveness of the FIM+FAM as a primary outcome measure for traumatic brain injury (TBI) comprehensive day programs. Retrospective data analysis. Single center, TBI comprehensive day program facility. A demographically and regionally diverse sample of 105 persons with moderate or severe TBI admitted to the Shepherd Pathways comprehensive TBI day rehabilitation program. Functional Independence Measure + Functional Assessment Measure (FIM+FAM). Twenty-eight percent or fewer of participants reached ceiling effects on 25 of the 30 FIM+FAM items at day program admission with only 2% of clients rated above ceiling score levels on the FIM+FAM total score. The criteria of Guyatt et al showed that 20 of the 30 FIM+FAM items showed clinically meaningful improvements in 60% or more of clients. On average, clients with TBI improved over 27 points on the FIM+FAM total score. Fifteen of 30 items showed ceiling effects of 33% or less at discharge where only 25% of clients exceeded the FIM+FAM total score ceiling threshold. Discharge FIM+FAM motor scale was a very good predictor of the need for additional single service physical therapy. However, reaching ceiling rating on the FIM+FAM cognitive scale demonstrated poor specificity (0.28) and negative predictive power (0.42) for the need for additional speech/cognitive therapy services. The FIM+FAM demonstrated utility as an outcome measure for TBI comprehensive day program treatment in the current milieu. Future research is required to replicate and extend the current findings.

A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course.

PubMed

Douglass, Mark A; Casale, Jillian P; Skirvin, J Andrew; DiVall, Margarita V

2013-10-14

To implement and assess the impact of a virtual patient pilot program on pharmacy students' clinical competence skills. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students' posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes.

77 FR 33563 - Applications for New Awards; Comprehensive Centers Program

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-06

... career-ready standards and aligned, high-quality assessments for all students; (2) identifying... outcomes for all students; close achievement gaps; and improve the quality of instruction. Regional...)) established Regional Advisory Committees (RACs) and charged them with conducting educational needs assessments...

Generalizability and Validity of a Mathematics Performance Assessment.

ERIC Educational Resources Information Center

Lane, Suzanne; And Others

1996-01-01

Evidence from test results of 3,604 sixth and seventh graders is provided for the generalizability and validity of the Quantitative Understanding: Amplifying Student Achievement and Reasoning (QUASAR) Cognitive Assessment Instrument, which is designed to measure program outcomes and growth in mathematics. (SLD)

Implementing and Evaluating a Multicomponent Inpatient Diabetes Management Program: Putting Research into Practice

PubMed Central

Munoz, Miguel; Pronovost, Peter; Dintzis, Joanne; Kemmerer, Theresa; Wang, Nae-Yuh; Chang, Yi-Ting; Efird, Leigh; Berenholtz, Sean M.; Golden, Sherita Hill

2013-01-01

Background Strategies for successful implementation of hospitalwide glucose control efforts were addressed in a conceptual model for the development and implementation of an institutional inpatient glucose management program. Conceptual Model Components The Glucose Steering Committee incrementally developed and implemented hospitalwide glucose policies, coupled with targeted education and clinical decision support to facilitate policy acceptance and uptake by staff while incorporating process and outcome measures to objectively assess the effectiveness of quality improvement efforts. The model includes four components: (1) engaging staff and hospital executives in the importance of inpatient glycemic management, (2) educating staff involved in the care of patients with diabetes through structured knowledge dissemination, (3) executing evidence-based inpatient glucose management through development of policies and clinical decision aids, and (4) evaluating intervention effectiveness through assessing process measures, intermediary glucometric outcomes, and clinical and economic outcomes. An educational curriculum for nursing, provider, and pharmacist diabetes education programs and current glucometrics were also developed. Outcomes Overall the average patient-day–weighted mean blood glucose (PDWMBG) was below the currently recommended maximum of 180 mg/dL in patients with diabetes and hyperglycemia, with a significant decrease in PDWMBG of 7.8 mg/dL in patients with hyperglycemia. The program resulted in an 18.8% reduction in hypoglycemia event rates, which was sustained. Conclusion Inpatient glucose management remains an important area for patient safety, quality improvement, and clinical research, and the implementation model should guide other hospitals in their glucose management initiatives. PMID:22649859

National Cancer Institute Patient Navigation Research Program: methods, protocol, and measures.

PubMed

Freund, Karen M; Battaglia, Tracy A; Calhoun, Elizabeth; Dudley, Donald J; Fiscella, Kevin; Paskett, Electra; Raich, Peter C; Roetzheim, Richard G

2008-12-15

Patient, provider, and systems barriers contribute to delays in cancer care, a lower quality of care, and poorer outcomes in vulnerable populations, including low-income, underinsured, and racial/ethnic minority populations. Patient navigation is emerging as an intervention to address this problem, but navigation requires a clear definition and a rigorous testing of its effectiveness. Pilot programs have provided some evidence of benefit, but have been limited by evaluation of single-site interventions and varying definitions of navigation. To overcome these limitations, a 9-site National Cancer Institute Patient Navigation Research Program (PNRP) was initiated. The PNRP is charged with designing, implementing, and evaluating a generalizable patient navigation program targeting vulnerable populations. Through a formal committee structure, the PNRP has developed a definition of patient navigation and metrics to assess the process and outcomes of patient navigation in diverse settings, compared with concurrent continuous control groups. The PNRP defines patient navigation as support and guidance offered to vulnerable persons with abnormal cancer screening or a cancer diagnosis, with the goal of overcoming barriers to timely, quality care. Primary outcomes of the PNRP are 1) time to diagnostic resolution; 2) time to initiation of cancer treatment; 3) patient satisfaction with care; and 4) cost effectiveness, for breast, cervical, colon/rectum, and/or prostate cancer. The metrics to assess the processes and outcomes of patient navigation have been developed for the NCI-sponsored PNRP. If the metrics are found to be valid and reliable, they may prove useful to other investigators.

Health Outcomes for Clients of Needle and Syringe Programs in Prisons.

PubMed

Lazarus, Jeffrey V; Safreed-Harmon, Kelly; Hetherington, Kristina L; Bromberg, Daniel J; Ocampo, Denise; Graf, Niels; Dichtl, Anna; Stöver, Heino; Wolff, Hans

2018-04-12

High levels of drug dependence have been observed in the prison population globally, and the sharing of injecting drug equipment in prisons has contributed to higher prevalence of bloodborne diseases in prisoners than in the general population. Few prison needle and syringe programs (PNSPs) exist. We conducted a systematic review to assess evidence regarding health outcomes of PNSPs. We searched peer-reviewed databases for data relating to needle and syringe programs in prisons. The search methodology was conducted in accordance with accepted guidelines. Five studies met review inclusion criteria, and all presented evidence associating PNSPs with one or more health benefits, but the strength of the evidence was low. The outcomes for which the studies collectively demonstrated the strongest evidence were prevention of human immunodeficiency virus and viral hepatitis. Few negative consequences from PNSPs were observed, consistent with previous evidence assessments. More research is needed on PNSP effectiveness, and innovative study designs are needed to overcome methodological limitations of previous research. Until stronger evidence becomes available, policymakers are urged to recognize that not implementing PNSPs has the potential to cause considerable harm, in light of what is currently known about the risks and benefits of needle and syringe programs and PNSPs and about the high prevalence of human immunodeficiency virus and viral hepatitis in prisons.

Evaluation of a home-based exercise program in the treatment of Alzheimer's disease: the Maximizing Independence in Dementia (MIND) study.

PubMed

Steinberg, Martin; Leoutsakos, Jeannie-Marie Sheppard; Podewils, Laura Jean; Lyketsos, C G

2009-07-01

To determine the feasibility and efficacy of a home-based exercise intervention program to improve the functional performance of patients with Alzheimer's Disease (AD). Twenty-seven home-dwelling patients with AD were randomized to either an exercise intervention program delivered by their caregivers or a home safety assessment control. Measures of functional performance (primary), cognition, neuropsychiatric symptoms, quality of life and caregiver burden (secondary) were obtained at baseline and at 6 and 12 weeks following randomization. For each outcome measure, intent-to-treat analyses using linear random effects models were performed. Feasibility and adverse events were also assessed. Adherence to the exercise program was good. On the primary outcomes (functional performance) patients in the exercise group demonstrated a trend for improved performance on measures of hand function and lower extremity strength. On secondary outcome measures, trends toward worse depression and lower quality of life ratings were noted. The physical exercise intervention developed for the study, delivered by caregivers to home-dwelling patients with AD, was feasible and was associated with a trend for improved functional performance in this group of frail patients. Given the limited efficacy to date of pharmacotherapies for AD, further study of exercise intervention, in a variety of care setting, is warranted.

Understanding Students' Needs: A Guide for Developing and Implementing Assessment Procedures for Students Encountering Educational Challenges.

ERIC Educational Resources Information Center

Samuels, Marilyn T.

This manual, intended to help administrators, specialists, and teachers in Alberta, Canada, understand a problem-solving, process-based approach to assessment of special needs students using multiple sources of information. Assessment outcomes are viewed as describing needs and influencing education programs, rather than being used to provide…

An Integrated Model of Influence: Use of Assessment Data in Higher Education

ERIC Educational Resources Information Center

Jonson, Jessica L.; Guetterman, Tim; Thompson, Robert J., Jr.

2014-01-01

A fundamental goal of student learning outcomes assessment in higher education is to use student learning evidence in decision making to improve educational programs. Such use of assessment findings, however, is atypical. This article argues that a narrow conception of use contributes to this conclusion and an accurate appraisal of the…

Value-Added Assessment of Teacher Preparation: An Illustration of Emerging Technology

ERIC Educational Resources Information Center

Noell, George H.; Burns, Jeanne L.

2006-01-01

Broad-based empirical outcomes assessment is an increasingly evident part of governmental services and this trend is particularly apparent in education. The clearest manifestation of this trend in education has been the advent of high-stakes broad-based testing and accountability programs in K-12 education. Although this assessment regime has not…

A Is for Assessment: The Other Scarlet Letter

ERIC Educational Resources Information Center

Halpern, Diane F.

2013-01-01

This is a personalized review of programs designed to assess student learning outcomes (SLOs) in higher education. In the last 30+ years, there have been few changes in the basic principles and premises. We assess SLOs for the purpose of improving teaching and learning. Although content area knowledge is important, other goals such as enhancing…

Institutional Effectiveness Assessment Process, 1992-93. Executive Summary. Hospitality and Service Occupations Division, Food Sciences Department, Food Production Program, Food Production Management Program, Pastry and Specialty Baking Program.

ERIC Educational Resources Information Center

South Seattle Community Coll., Washington.

In the 1992-93 academic year, the Hospitality and Food Sciences Department at South Seattle Community College conducted surveys of current and former students and local foodservice employers to determine the level of satisfaction with Department programs. Specifically, the surveys focused on four key outcomes: determining the extent to which…

Vietnam as a Case Example of School-Based Mental Health Services in Low and Middle Income Countries: Efficacy and Effects of Risk Status

ERIC Educational Resources Information Center

Dang, Hoang-Minh; Weiss, Bahr; Nguyen, Cao Minh; Tran, Nam; Pollack, Amie

2017-01-01

The purposes of this study were to (a) assess the efficacy of a universal classroom-based mental health and social skills program for primary school students in Vietnam, and (b) given the universal nature of the intervention, assess outcomes as a function of risk status (high versus low). RECAP-VN is a semi-structured program that provides…

Examination of Attitude and Interest Measures for 4-H Science Evaluation

ERIC Educational Resources Information Center

Lewis, Kendra M.; Worker, Steven M.

2015-01-01

Science education research has demonstrated the influence of affect on learning. The National 4-H Science Logic Model outlines outcomes from youth participation in 4-H science programs, which includes attitude and interest outcomes. The associated measure, the National 4-H Science Common Measure, assesses these attitude constructs and not other…

Research on the Outcomes of Elementary School Physical Education

ERIC Educational Resources Information Center

Shephard, Roy J.; Trudeau, Francois

2008-01-01

The purpose of this article is to provide an overview of objective assessments of the short- and long-term outcomes of elementary school physical education programs. Evaluations have used a variety of designs, including longitudinal and tracking studies as well as correlational analyses. The short-term effect of physical education on health and…

What's Working (and What's Not). A Summary of Research on the Economic Impacts of Employment and Training Programs.

ERIC Educational Resources Information Center

Department of Labor, Washington, DC.

The effectiveness of employment and training (E&T) programs in improving labor market outcomes can be assessed by measuring the impact on the future success of participants. The program with the greatest success in reducing dropout rates among at-risk youth is the Quantum Opportunities Project. Comprehensive Employment and Training Act (CETA)…

Evaluation of an Early Childhood Preschool Program in Rural Bangladesh

ERIC Educational Resources Information Center

Aboud, Frances E.

2006-01-01

A preschool program in rural Bangladesh was evaluated in terms of cognitive and social outcomes of children. The preschools provided a half-day program, 6 days a week, with free play, stories, and instruction in literacy and math. Four hundred children between 4.5 and 6.5 years were assessed, half in preschools and half in villages where there…

Just What Are Rural Premedical Students Thinking? A Report of the First 6 Years of a Pathways Program

ERIC Educational Resources Information Center

Crump, William J.; Fricker, R. Steve; Crump, Allison M.

2010-01-01

Purpose: To assess outcomes of the first 6 years of a program designed to facilitate medical school admission for rural premedical students. Methods: Students completing the University of Louisville School of Medicine Trover Rural Scholar program were surveyed using a 23-item survey. Findings: Twenty-two of the 24 (92%) students responded.…

Developing the IT Workforce: Certification Programs, Participants and Outcomes in High Schools and Two-Year Colleges. Final Report

ERIC Educational Resources Information Center

Haimson, Joshua; VanNoy, Michelle

2004-01-01

Many high school and two-year college vocational programs are exploring new ways to help students develop and document skills valued in the labor market. Over the past decade, some efforts to improve vocational programs have focused on reorganizing curricula around skill standards and assessments formulated by employers. One recent example of this…

Exemplar Practices for Department of Defense Technology Transfer

DTIC Science & Technology

2013-01-01

2):176–183. Ruegg, R. 2000. “Delivering Public Benefits with Private-Sector Efficiency.” In Advanced Technology Program : Assessing Outcomes, edited ...The literature identified the following critical factors for a successful technology transfer program : an effective ORTA, engaged researchers, well...experts, and stakeholders. These interviews were held between June and September 2012. Programs and processes identified during the discussions

The Impacts of an Integrated Community Development Program in Southern Ethiopia--A Propensity Score Analysis

ERIC Educational Resources Information Center

Rui, Ning

2013-01-01

With funding through grants and donations, an international development organization has provided developmental services to a woreda in southern Ethiopia since the early 1980s. This study is intended to assess the outcome and impact of the program and address the following questions: (1) Did direct beneficiaries of the CDTP program exhibit better…

Health care use and costs for participants in a diabetes disease management program, United States, 2007-2008.

PubMed

Dall, Timothy M; Roary, Mary; Yang, Wenya; Zhang, Shiping; Chen, Yaozhu J; Arday, David R; Gantt, Cynthia J; Zhang, Yiduo

2011-05-01

The Disease Management Association of America identifies diabetes as one of the chronic conditions with the greatest potential for management. TRICARE Management Activity, which administers health care benefits for US military service personnel, retirees, and their dependents, created a disease management program for beneficiaries with diabetes. The objective of this study was to determine whether participation intensity and prior indication of uncontrolled diabetes were associated with health care use and costs for participants enrolled in TRICARE's diabetes management program. This ongoing, opt-out study used a quasi-experimental approach to assess program impact for beneficiaries (n = 37,370) aged 18 to 64 living in the United States. Inclusion criteria were any diabetes-related emergency department visits or hospitalizations, more than 10 diabetes-related ambulatory visits, or more than twenty 30-day prescriptions for diabetes drugs in the previous year. Beginning in June 2007, all participants received educational mailings. Participants who agreed to receive a baseline telephone assessment and telephone counseling once per month in addition to educational mailings were considered active, and those who did not complete at least the baseline telephone assessment were considered passive. We categorized the diabetes status of each participant as "uncontrolled" or "controlled" on the basis of medical claims containing diagnosis codes for uncontrolled diabetes in the year preceding program eligibility. We compared observed outcomes to outcomes predicted in the absence of diabetes management. Prediction equations were based on regression analysis of medical claims for a historical control group (n = 23,818) that in October 2004 met the eligibility criteria for TRICARE's program implemented June 2007. We conducted regression analysis comparing historical control group patient outcomes after October 2004 with these baseline characteristics. Per-person total annual medical savings for program participants, calculated as the difference between observed and predicted outcomes, averaged $783. Active participants had larger reductions in inpatient days and emergency department visits, larger increases in ambulatory visits, and larger increases in receiving retinal examinations, hemoglobin A1c tests, and urine microalbumin tests compared with passive participants. Participants with prior indication of uncontrolled diabetes had higher per-person total annual medical savings, larger reduction in inpatient days, and larger increases in ambulatory visits than did participants with controlled diabetes. Greater intensity of participation in TRICARE's diabetes management program was associated with lower medical costs and improved receipt of recommended testing. That patients who were categorized as having uncontrolled diabetes realized greater program benefits suggests diabetes management programs should consider indication of uncontrolled diabetes in their program candidate identification criteria.

Stakeholder involvement in the design of a patient-centered comparative effectiveness trial of the “On the Move” group exercise program in community-dwelling older adults

PubMed Central

Brach, Jennifer S.; Perera, Subashan; Gilmore, Sandra; VanSwearingen, Jessie M.; Brodine, Deborah; Wert, David; Nadkarni, Neelesh K.; Ricci, Edmund

2016-01-01

Background Group exercise programs for older adults often exclude the timing and coordination of movement. Stakeholder involvement in the research process is strongly encouraged and improves the relevance and adoption of findings. We describe stakeholder involvement in the design of a clinical trial of a group-based exercise program that incorporates timing and coordination of movement into the exercises. Methods The study was a cluster randomized, single-blind intervention trial to compare the effects on function, disability and mobility of a standard group exercise program and the “On the Move” group exercise program in older adults residing in independent living facilities and senior apartment buildings, and attending community centers. Exercise classes were twice weekly for 12 weeks delivered by study exercise leaders and facility activity staff personnel. Outcomes The primary outcomes function, disability and mobility were assessed at baseline and post-intervention. Function and disability were assessed using the Late Life Function and Disability Instrument, and mobility using the Six-Minute Walk Test and gait speed. Stakeholders Patient and provider stakeholders had significant input into the study aims, design, sample, intervention, outcomes and operational considerations. Summary A community-based exercise program to improve walking can be developed to address both investigator identified missing components in current exercise to improve walking and stakeholder defined needs and interest for the activity program. Involvement of stakeholders substantially improves the relevance of research questions, increases the transparency of research activities and may accelerate the adoption of research into practice. PMID:27521806

Association of total serum cholesterol with functional outcome following home care rehabilitation in Italian patients with stroke.

PubMed

Cataldo, Maria Concetta; Calcara, Maria Luisa; Caputo, Giuseppe; Mammina, Caterina

2012-04-01

Stroke is a disabling disease. In elderly populations, stroke is the third leading cause of death and the primary cause of reduction in or loss of functional ability and personal autonomy. Possible associations between levels of total serum cholesterol (TC) and both incidence of stroke and functional outcomes after rehabilitation are still under study. To detect positive and negative prognostic factors associated with functional outcomes in first-time stroke patients admitted to an integrated home care rehabilitative program. This study enrolled 141 patients with a first-time stroke who were admitted to a home care rehabilitation program. Primary outcome measures were the Barthel activities of daily living (ADL) and mobility indices at the beginning and end of the rehabilitative treatment. The impact of TC and other demographic and clinical variables was analyzed using bivariate and multivariate logistic regression analyses. Age and Short Portable Mental Status Questionnaire (SPMSQ) score were negatively associated with functional outcome. In contrast, elevated TC was positively associated with a better home rehabilitative treatment outcome. Barthel index score at admission was negatively associated with outcomes assessed by the Barthel ADL index and age with outcomes assessed by the Barthel mobility index. In a multivariate logistic regression analysis, SPMSQ score and elevated TC were significantly associated with outcome. Specifically, higher SPMSQ scores were negatively associated with better rehabilitative treatment outcomes, whereas elevated TC was positively associated. Elevated TC seems to be associated with better functional outcomes in patients with first-time stroke. Copyright © 2012 Elsevier Inc. All rights reserved.

A randomized trial to evaluate the effectiveness of an individual, education-based safe transport program for drivers aged 75 years and older

PubMed Central

2013-01-01

Background There are concerns over safety of older drivers due to increased crash involvement and vulnerability to injury. However, loss of driving privileges can dramatically reduce independence and quality of life for older members of the community. The aim of this trial is to examine the effectiveness of a safe transport program for drivers aged 75 years and older at reducing driving exposure but maintaining mobility. Methods and design A randomised trial will be conducted, involving 380 drivers aged 75 years and older, resident in urban and semi-rural areas of North-West Sydney. The intervention is an education program based on the Knowledge Enhances Your Safety (KEYS) program, adapted for the Australian context. Driving experience will be measured objectively using an in-vehicle monitoring device which includes a global positioning system (GPS) to assess driving exposure and an accelerometer to detect rapid deceleration events. Participation will be assessed using the Keele Assessment of Participation (KAP). Data will be analysed on an intention-to-treat basis; the primary outcomes include driving exposure, rapid deceleration events and scores for KAP. Secondary outcomes include self-reported measures of driving, socialisation, uptake of alternative forms of transport, depressive symptoms and mood. A detailed process evaluation will be conducted, including examination of the delivery of the program and uptake of alternative forms of transport. A subgroup analysis is planned for drivers with reduced function as characterized by established cut-off scores on the Drivesafe assessment tool. Discussion This randomised trial is powered to provide an objective assessment of the efficacy of an individually tailored education and alternative transportation program to promote safety of older drivers but maintain mobility. Trial registration: Australian New Zealand Clinical Trials Registry ACTRN12612000543886. PMID:23379593

Routine outcome measurement in mental health service consumers: who should provide support for the self-assessments?

PubMed

Gelkopf, Marc; Pagorek-Eshel, Shira; Trauer, Tom; Roe, David

2015-06-01

This study examined whether mental health community service users completed outcome self-reports differently when assessments were supervised by internal vs. external staff. The examination of potential differences between the two has useful implications for mental health systems that take upon themselves the challenge of Routine Outcome Measurement (ROM), as it might impact allocation of public resources and managed care program planning. 73 consumers completed the Manchester Short Assessment of Quality of Life (MANSA), a shortened version of the Recovery Assessment Scale (RAS), and a functioning questionnaire. Questionnaires were administered, once using support provided by internal staff and once using support provided by external professional staff, with a one-month time interval and in random order. A MANOVA Repeated Measures showed no differences in outcomes of quality of life and recovery between internal and external support. Functioning scores were higher for the internal support when the internal assessments were performed first. Overall, except for the differences in functioning assessment, outcome scores were not determined by the supporting agency. This might indicate that when measuring quality of life and recovery, different supporting methods can be used to gather outcome measures and internal staff might be a good default agency to do this. Differences found in functioning assessment are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Social-Emotional Effects of Early Childhood Education Programs in Tulsa

ERIC Educational Resources Information Center

Gormley, William T., Jr.; Phillips, Deborah A.; Newmark, Katie; Welti, Kate; Adelstein, Shirley

2011-01-01

This article assesses the effects of Tulsa, Oklahoma's early childhood education programs on social-emotional outcomes, examining teacher ratings of children's behavior from the Adjustment Scales for Preschool Intervention and a measure of attentiveness using fixed effects regressions with propensity score matching. The sample includes 2,832…

Assessing Leader Development: Lessons from a Historical Review of MBA Outcomes

ERIC Educational Resources Information Center

Passarelli, Angela M.; Boyatzis, Richard E.; Wei, Hongguo

2018-01-01

Graduate management education seeks to enhance the likelihood that graduates will be effective leaders, managers, or professionals. This requires programs that are designed to enable students to develop the related competencies, and increasing regulatory pressures require programs to document evidence of success. However, both the design of…

PESTICIDE EXPOSURE AND POTENTIAL HEALTH EFFECTS IN YOUNG CHILDREN ALONG THE U.S.-MEXICO BORDER

EPA Science Inventory

The purpose of the Pesticides in Young Children - Border States Program is to assess the relationship of health outcomes in children living along the United States and Mexico border to repeated pesticide exposures via multiple sources and pathways. The present research program ...

Holistic Approach to Learning and Teaching Introductory Object-Oriented Programming

ERIC Educational Resources Information Center

Thota, Neena; Whitfield, Richard

2010-01-01

This article describes a holistic approach to designing an introductory, object-oriented programming course. The design is grounded in constructivism and pedagogy of phenomenography. We use constructive alignment as the framework to align assessments, learning, and teaching with planned learning outcomes. We plan learning and teaching activities,…

Study Abroad Program Design, Personal Development and Intercultural Effectiveness

ERIC Educational Resources Information Center

Wiedenhoeft, Margaret Davis

2011-01-01

Research on study abroad focuses on the development of learning outcomes and assessment (Bolen, 2007) or program design, such as level of integration with local student population, housing situation, and level of interaction with host culture (Brecht & Robinson, 1993; Engle & Engle, 2004; Georgetown Consortium Research Project, n.d.;…

A Multicultural Assessment of Adolescent Connectedness: Testing Measurement Invariance across Gender and Ethnicity

ERIC Educational Resources Information Center

Karcher, Michael J.; Sass, Daniel

2010-01-01

Counselors, psychologists, and evaluators of intervention programs for youth increasingly view the promotion of connectedness as an important intervention outcome. When evaluating these programs, researchers frequently test whether the treatment effects differ across gender and ethnic or racial groups. Doing so necessitates the availability of…

Using Partnerships to Promote Health and Physical Education

ERIC Educational Resources Information Center

Hicks, Lisa; Hancher-Rauch, Heidi; Casselman, Katelin

2012-01-01

School and higher education partnerships are an excellent opportunity for all involved to receive mutually beneficial outcomes. This article describes the benefits of a P-12-university partnership, as well as specific examples of projects and assignments that can serve as advocacy resources, creative programming, program assessment, or to meet…

34 CFR 660.10 - What activities does the Secretary assist?

Code of Federal Regulations, 2010 CFR

2010-07-01

... assessing the outcomes and effectiveness of supported programs. (g) Comparative studies of the effectiveness... POSTSECONDARY EDUCATION, DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM What Kinds of...? An applicant may apply for funds to carry out any of the following types of activities: (a) Studies...

34 CFR 660.10 - What activities does the Secretary assist?

Code of Federal Regulations, 2014 CFR

2014-07-01

... assessing the outcomes and effectiveness of supported programs. (g) Comparative studies of the effectiveness... POSTSECONDARY EDUCATION, DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM What Kinds of...? An applicant may apply for funds to carry out any of the following types of activities: (a) Studies...

34 CFR 660.10 - What activities does the Secretary assist?

Code of Federal Regulations, 2012 CFR

2012-07-01

... assessing the outcomes and effectiveness of supported programs. (g) Comparative studies of the effectiveness... POSTSECONDARY EDUCATION, DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM What Kinds of...? An applicant may apply for funds to carry out any of the following types of activities: (a) Studies...

34 CFR 660.10 - What activities does the Secretary assist?

Code of Federal Regulations, 2013 CFR

2013-07-01

... assessing the outcomes and effectiveness of supported programs. (g) Comparative studies of the effectiveness... POSTSECONDARY EDUCATION, DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM What Kinds of...? An applicant may apply for funds to carry out any of the following types of activities: (a) Studies...

34 CFR 660.10 - What activities does the Secretary assist?

Code of Federal Regulations, 2011 CFR

2011-07-01

... assessing the outcomes and effectiveness of supported programs. (g) Comparative studies of the effectiveness... POSTSECONDARY EDUCATION, DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM What Kinds of...? An applicant may apply for funds to carry out any of the following types of activities: (a) Studies...

42 CFR 416.43 - Conditions for coverage-Quality assessment and performance improvement.

Code of Federal Regulations, 2011 CFR

2011-10-01

... outcomes, patient safety, and quality of care. (2) Performance improvement activities must track adverse... patient safety by using quality indicators or performance measures associated with improved health... that includes care and services furnished in the ASC. (b) Standard: Program data. (1) The program must...

Professional Skills as Cornerstones of Liberal Education: Moving Students from Theory to Action

ERIC Educational Resources Information Center

Nitkin, Mindell Reiss; White, Shelley K.; Shapiro, Mary

2016-01-01

This article presents the Simmons World Challenge curriculum, an intensive, interdisciplinary program for sophomore undergraduate students that emphasizes student-directed collaborative learning and skills development. The authors present the curricular approach and assessment outcomes, and they relate this program to goals of the AAC&U's…

Planning Adolescent Mental Health Promotion Programming in Saskatoon

ERIC Educational Resources Information Center

Cushon, Jennifer; Waldner, Cheryl; Scott, Christina; Neudorf, Cordell

2016-01-01

Background: We assessed associations between key demographic risk factors and the outcome of depressed mood in Saskatoon, Saskatchewan, to inform the planning and implementation of mental health promotion programming in schools. Methods: In the 2008/2009 school year, 3,958 students from grades 5 through 8 from 76 elementary schools completed…

Assessing the reach and effectiveness of mHealth: evidence from a reproductive health program for adolescent girls in Ghana.

PubMed

Rokicki, Slawa; Fink, Günther

2017-12-20

While mobile health (mHealth) programs are increasingly used to provide health information and deliver interventions, little is known regarding the relative reach and effectiveness of these programs across sociodemographic characteristics. We use data from a recent trial of a text-messaging intervention on adolescent sexual and reproductive health (SRH) to assess the degree to which mHealth programs reach target adolescent subpopulations who may be at higher risk of poor SRH outcomes. The study was conducted among girls aged 14-24 in 22 secondary schools in Accra, Ghana. The mHealth intervention was an interactive mobile phone quiz in which participants could win phone credit for texting correct answers to SRH questions. We use detailed data on individuals' level of engagement with the program, SRH knowledge scores, and self-reported pregnancy collected as part of the original trial to assess the extent to which engagement and program impact vary across parental education, sexual experience, SRH knowledge deficit, and parental support. Eighty-one percent of participants engaged with the mHealth program, with no evidence that the program disproportionally reached better-off groups. The program was effective at increasing knowledge of SRH across all strata. Higher levels of engagement were associated with higher knowledge scores up to year later. There was no significant impact of the program on self-reported pregnancy within subgroups. mHealth programs for adolescents have the potential to engage and increase SRH knowledge of adolescent girls across sociodemographic strata, including those who may be at higher risk of poor SRH outcomes. ClinicalTrials.gov NCT02031575 . Registered 07 Jan 2014.

The Comparison of School-Age Children's Performance on Two Motor Assessments: The Test of Gross Motor Development and the Movement Assessment Battery for Children

ERIC Educational Resources Information Center

Logan, Samuel W.; Robinson, Leah E.; Rudisill, Mary E.; Wadsworth, Danielle D.; Morera, Maria

2014-01-01

Background: Competence in the motor domain is associated with positive, health-related outcomes. Physical education teachers often administer assessments into their programs to measure motor competence for a variety of reasons. Recently, researchers have questioned the relatedness of performance on different assessments. Purpose: The purpose of…

Assessing and Improving Student Organizations: Student Workbook. The Assessing and Improving Student Organization (AISO) Program

ERIC Educational Resources Information Center

Nolfi, Tricia; Ruben, Brent D.

2010-01-01

This "Workbook" is intended for student participants during the AISO (Assessing and Improving Student Organization) assessment and planning sessions, and to be used in tandem with the "Guide for Students". Each page presents an action or reflection slide from the "Guide" with a space below for participants to note their own ideas, outcomes of…

Creating a Culture of Continuous Assessment to Improve Student Learning through Curriculum Review

ERIC Educational Resources Information Center

Kalu, Frances; Dyjur, Patti

2018-01-01

This chapter describes a curriculum review framework that fosters continuous assessment through collaboration with multiple stakeholders, alignment with program level learning outcomes, evaluation based on multiple sources of evidence, and facilitated development of action plans to improve student learning.

Development and Assessment of a Horizontally Integrated Biological Sciences Course Sequence for Pharmacy Education

PubMed Central

Wright, Nicholas J.D.; Alston, Gregory L.

2015-01-01

Objective. To design and assess a horizontally integrated biological sciences course sequence and to determine its effectiveness in imparting the foundational science knowledge necessary to successfully progress through the pharmacy school curriculum and produce competent pharmacy school graduates. Design. A 2-semester course sequence integrated principles from several basic science disciplines: biochemistry, molecular biology, cellular biology, anatomy, physiology, and pathophysiology. Each is a 5-credit course taught 5 days per week, with 50-minute class periods. Assessment. Achievement of outcomes was determined with course examinations, student lecture, and an annual skills mastery assessment. The North American Pharmacist Licensure Examination (NAPLEX) results were used as an indicator of competency to practice pharmacy. Conclusion. Students achieved course objectives and program level outcomes. The biological sciences integrated course sequence was successful in providing students with foundational basic science knowledge required to progress through the pharmacy program and to pass the NAPLEX. The percentage of the school’s students who passed the NAPLEX was not statistically different from the national percentage. PMID:26430276

Research to support optimization of prescription drug monitoring programs.

PubMed

Doyle, Sheri; Leichtling, Gillian; Hildebran, Christi; Reilly, Cynthia

2017-11-01

Research is needed to evaluate the impact of prescription drug monitoring programs (PDMPs). This paper describes research priorities for PDMPs that were initially discussed at a 2015 meeting of PDMP administrators, researchers, public health officials, and other stakeholders. Meeting participants defined the current landscape of PDMP research and identified research gaps. Research priorities were grouped by theme. Prescription drug monitoring program research priorities were identified for 3 key areas: individual patient health outcomes, prescriber use and decision making, and population-level outcomes. Research areas for individual patient outcomes include examining drug-use thresholds that best predict risk for overdose or substance use disorder and unintended consequences of PDMP use. Proposed research on prescriber PDMP use include evaluating how enhancements to the content and format of PDMP reports informs clinical decision making and optimal clinician actions in response to a concerning PDMP report. Finally, research topics related to population-level outcomes include measuring the impact of PDMP policies on the incidence of substance misuse and harms and assessing the return on investment for these databases. The clinical, public health, and economic impacts of PDMPs must be evaluated, using both quantitative and qualitative methods. In addition to assessing patient outcomes, qualitative research should examine how clinicians use and interpret PDMP information. Research should also examine the impact of PDMP features and policies on prescriber utilization. Comparative analyses across states with differing PDMP policies should be conducted to inform best practices. Copyright © 2017 John Wiley & Sons, Ltd.

Long-term prevalence and predictors of urinary incontinence among women in the Diabetes Prevention Program Outcomes Study.

PubMed

Phelan, Suzanne; Kanaya, Alka M; Ma, Yong; Vittinghoff, Eric; Barrett-Connor, Elizabeth; Wing, Rena; Kusek, John W; Orchard, Trevor J; Crandall, Jill P; Montez, Maria G; Brown, Jeanette S

2015-02-01

To examine the long-term prevalence and predictors of weekly urinary incontinence in the Diabetes Prevention Program Outcomes Study, a follow-up study of the Diabetes Prevention Program randomized clinical trial of overweight adults with impaired glucose tolerance. This analysis included 1778 female participants of the Diabetes Prevention Program Outcomes Study who had been randomly assigned during the Diabetes Prevention Program to intensive lifestyle intervention (n = 582), metformin (n = 589) or placebo (n = 607). The study participants completed semi-annual assessments after the final Diabetes Prevention Program visit and for 6 years until October 2008. At the study entry, the prevalence of weekly urinary incontinence was lower in the intensive lifestyle intervention group compared with the metformin and placebo groups (44.2% vs 51.8%, 48.0% urinary incontinence/week, P = 0.04); during the 6-year follow-up period, these lower rates in intensive lifestyle intervention were maintained (46.7%, 53.1%, 49.9% urinary incontinence/week; P = 0.03). Statistically adjusting for urinary incontinence prevalence at the end of the Diabetes Prevention Program, the treatment arm no longer had a significant impact on urinary incontinence during the Diabetes Prevention Program Outcomes Study. Independent predictors of lower urinary incontinence during the Diabetes Prevention Program Outcomes Study included lower body mass index (odds ratio 0.988, 95% confidence interval 0.982-0.994) and greater physical activity (odds ratio 0.999, 95% confidence interval 0.998-1.000) at the Diabetes Prevention Program Outcomes Study entry, and greater reductions in body mass index (odds ratio 0.75, 95% confidence interval 0.60-0.94) and waist circumference (odds ratio 0.998, 95% confidence interval 0.996-1.0) during the Diabetes Prevention Program Outcomes Study. Diabetes was not significantly related to urinary incontinence. Intensive lifestyle intervention has a modest positive and enduring impact on urinary incontinence, and should be considered for the long-term prevention and treatment of urinary incontinence in overweight/obese women with glucose intolerance. © 2014 The Japanese Urological Association.

An empowerment intervention for Indigenous communities: an outcome assessment.

PubMed

Kinchin, Irina; Jacups, Susan; Tsey, Komla; Lines, Katrina

2015-08-21

Empowerment programs have been shown to contribute to increased empowerment of individuals and build capacity within the community or workplace. To-date, the impact of empowerment programs has yet to be quantified in the published literature in this field. This study assessed the Indigenous-developed Family Wellbeing (FWB) program as an empowerment intervention for a child safety workforce in remote Indigenous communities by measuring effect sizes. The study also assessed the value of measurement tools for future impact evaluations. A three-day FWB workshop designed to promote empowerment and workplace engagement among child protection staff was held across five remote north Queensland Indigenous communities. The FWB assessment tool comprised a set of validated surveys including the Growth and Empowerment Measure (GEM), Australian Unity Wellbeing Index, Kessler psychological distress scale (K10) and Workforce engagement survey. The assessment was conducted pre-intervention and three months post-intervention. The analysis of pre-and post-surveys revealed that the GEM appeared to be the most tangible measure for detecting positive changes in communication, conflict resolution, decision making and life skill development. The GEM indicated a 17 % positive change compared to 9 % for the Australian Unity Wellbeing Index, 5 % for the workforce engagement survey and less than 1 % for K10. This study extended qualitative research and identified the best measurement tool for detecting the outcomes of empowerment programs. The GEM was found the most sensitive and the most tangible measure that captures improvements in communication, conflict resolution, decision making and life skill development. The GEM and Australian Unity Wellbeing Index could be recommended as routine measures for empowerment programs assessment among similar remote area workforce.

Does harm reduction programming make a difference in the lives of highly marginalized, at-risk drug users?

PubMed Central

Rogers, Susan J; Ruefli, Terry

2004-01-01

Harm reduction is a controversial model for treating drug users, with little formal research available on its operation and effectiveness. In order to advance the field, we first conducted participatory research of harm reduction with 120 clients using nominal-group technique to develop culturally relevant outcomes to measure progress. Second, we conducted focus group interviews with a different group of clients to help validate the outcomes. Third, we used the outcomes in an evaluation of the largest harm reduction program in New York City, which involved a representative sample of 261 and entailed baseline, post, and six follow-up assessments. The participatory research resulted in outcomes of 10 life areas important to drug users. Evaluation results showed that program participants made positive improvements across most outcomes, with the most substantial progress made in how clients dealt with drug-use problems. Along with their participation in the program, progress in some outcomes was also associated with clients' type of drug use (i.e., stable vs. chaotic), where more stable drug use was associated with better ways of making an income and types of housing. Surprisingly, progress was not associated with the kinds or numbers of services received or the length of time in the program. This was attributed to the service delivery model of harm reduction, in which clients are less inclined to associate their success with a single staff person or with a single service or intervention received than with the program as a whole. PMID:15171790

Pathways to Improve Student Pharmacists’ Experience in Research

PubMed Central

McClendon, Katie S.; Bell, Allison M.; Ellis, Ashley; Adcock, Kim G.; Hogan, Shirley; Ross, Leigh Ann

2015-01-01

Objective. To describe the implementation of a student research program and to provide outcomes from the initial 4 years’ experience. Design. Students conducted individual research projects in a 4-year longitudinal program (known as Pathway), with faculty member advising and peer mentoring. A prospective assessment compared perceptions of those who completed the Pathway program with those of students who did not. Descriptive statistics, t tests, and analysis of variance (ANOVA) were used. Assessment. The class of 2013 was the first to complete the Pathway program. In the Pathway assessment project, 59% (n=47) of students who responded reached self-set goals. Pathway students agreed that this research experience improved their ability to work/think independently, evaluate literature, and distinguish themselves from other students. Conclusion. The Pathway program helped students understand the research process and reach other self-set goals. PMID:26089567

[The German program for disease management guidelines: evaluation by use of quality indicators].

PubMed

Kopp, Ina B; Geraedts, Max; Jäckel, Wilfried H; Altenhofen, Lutz; Thomeczek, Christian; Ollenschläger, Günter

2007-08-15

The Program for National Disease Management Guidelines (German DM-CPG Program) in Germany aims at the implementation of best-practice recommendations for prevention, acute care, rehabilitation and chronic care in the setting of disease management programs and integrated health-care systems. Like other guidelines, DM-CPG need to be assessed regarding their influence on structures, processes and outcomes of care. However, quality assessment in integrated health-care systems is challenging. On the one hand, a multitude of potential domains for measurement, actors and perspectives need to be considered. On the other hand, measures need to be identified that assess the function of the diagnostic and therapeutic chain in terms of cooperation and coordination of care. The article reviews methods and use of quality indicators in the context of the German DM-CPG Program.

The Effects of Pay-for-Performance Programs on Health, Health Care Use, and Processes of Care: A Systematic Review.

PubMed

Mendelson, Aaron; Kondo, Karli; Damberg, Cheryl; Low, Allison; Motúapuaka, Makalapua; Freeman, Michele; O'Neil, Maya; Relevo, Rose; Kansagara, Devan

2017-03-07

The benefits of pay-for-performance (P4P) programs are uncertain. To update and expand a prior review examining the effects of P4P programs targeted at the physician, group, managerial, or institutional level on process-of-care and patient outcomes in ambulatory and inpatient settings. PubMed from June 2007 to October 2016; MEDLINE, PsycINFO, CINAHL, Business Economics and Theory, Business Source Elite, Scopus, Faculty of 1000, and Gartner Research from June 2007 to February 2016. Trials and observational studies in ambulatory and inpatient settings reporting process-of-care, health, or utilization outcomes. Two investigators extracted data, assessed study quality, and graded the strength of the evidence. Among 69 studies, 58 were in ambulatory settings, 52 reported process-of-care outcomes, and 38 reported patient outcomes. Low-strength evidence suggested that P4P programs in ambulatory settings may improve process-of-care outcomes over the short term (2 to 3 years), whereas data on longer-term effects were limited. Many of the positive studies were conducted in the United Kingdom, where incentives were larger than in the United States. The largest improvements were seen in areas where baseline performance was poor. There was no consistent effect of P4P on intermediate health outcomes (low-strength evidence) and insufficient evidence to characterize any effect on patient health outcomes. In the hospital setting, there was low-strength evidence that P4P had little or no effect on patient health outcomes and a positive effect on reducing hospital readmissions. Few methodologically rigorous studies; heterogeneous population and program characteristics and incentive targets. Pay-for-performance programs may be associated with improved processes of care in ambulatory settings, but consistently positive associations with improved health outcomes have not been demonstrated in any setting. U.S. Department of Veterans Affairs.

Knowledge outcomes within rotational models of social work field education.

PubMed

Birkenmaier, Julie; Curley, Jami; Rowan, Noell L

2012-01-01

This study assessed knowledge outcomes among concurrent, concurrent/sequential, and sequential rotation models of field instruction. Posttest knowledge scores of students ( n = 231) in aging-related field education were higher for students who participated in the concurrent rotation model, and for those who completed field education at a long-term care facility. Scores were also higher for students in programs that infused a higher number of geriatric competencies in their curriculum. Recommendations are provided to programs considering rotation models of field education related to older adults.

Faculty role modeling of professional writing: one baccalaureate nursing program's experience.

PubMed

Newton, Sarah E

2008-01-01

According to The Essentials of Baccalaureate Education for Professional Nursing Practice (American Association of Colleges of Nursing, 1998), professional writing is an important outcome of baccalaureate nursing education. Most baccalaureate nursing programs in the United States expect formally written student papers to adhere to the style requirements outlined in the Publication Manual of the American Psychological Association (APA, 2001). It is essential for the baccalaureate nursing faculty members who evaluate student papers to be role models for the desired writing behaviors to facilitate student attainment of professional writing outcomes. However, to what extent nursing faculty members' writing behaviors and knowledge of the APA style requirements impact student writing outcomes is not known because the issue has not been addressed in the literature. The purpose of this article is to describe one Midwestern baccalaureate nursing program's faculty development efforts to assess faculty familiarity with the APA style requirements and how such knowledge may impact baccalaureate nursing students' writing outcomes.

Evaluation of a standardized patient education program for inpatient asthma rehabilitation: Impact on patient-reported health outcomes up to one year.

PubMed

Bäuerle, Kathrin; Feicke, Janine; Scherer, Wolfgang; Spörhase, Ulrike; Bitzer, Eva-Maria

2017-05-01

To modify and evaluate a patient education program for adult asthma patients in consideration of quality criteria for teaching. This was a prospective single-center controlled trial in an inpatient rehabilitation center. The control group (n=215) received the usual lecture-based education program, and the intervention group (n=209) the modified patient education program. Data were assessed at admission, discharge, 6 and 12 months post discharge. The primary outcome was asthma control, the secondary outcomes were asthma knowledge, quality of life, and program acceptance. Analysis of change was performed by ANCOVA for each follow-up, adjusting for baseline values. Statistically significant increases in all health outcomes and in asthma control were maintained in both groups at 12 months: CG: +1.9 (95%-CI 1.3-2.6) IG: +1.6 (95%-CI 0.8-2.3). We observed no significant differences between the programs for asthma control and quality of life. Regarding practical asthma knowledge, after 12 months, a group*time interaction emerged with a small effect size (P=0.06, η2=0.01). The modified program was not superior to traditional patient education concerning asthma control. It permanently increased self-management knowledge. Structured and behavioral patient education fosters patient's disease management ability. Possible ways of improving asthma control need to be explored. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

The Stanford Medical Youth Science Program: educational and science-related outcomes.

PubMed

Crump, Casey; Ned, Judith; Winkleby, Marilyn A

2015-05-01

Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program that reaches out to low-income and underrepresented ethnic minority high school students. Five annual surveys were used to assess educational outcomes and science-related experience among 96 SRP participants and a comparison group of 192 youth who applied but were not selected to participate in the SRP, using ~2:1 matching on sociodemographic and academic background to control for potential confounders. SRP participants were more likely than the comparison group to enter college (100.0 vs. 84.4 %, p = 0.002), and both of these matriculation rates were more than double the statewide average (40.8 %). In most areas of science-related experience, SRP participants reported significantly more experience (>twofold odds) than the comparison group at 1 year of follow-up, but these differences did not persist after 2-4 years. The comparison group reported substantially more participation in science or college preparatory programs, more academic role models, and less personal adversity than SRP participants, which likely influenced these findings toward the null hypothesis. SRP applicants, irrespective of whether selected for participation, had significantly better educational outcomes than population averages. Short-term science-related experience was better among SRP participants, although longer-term outcomes were similar, most likely due to college and science-related opportunities among the comparison group. We discuss implications for future evaluations of other biomedical pipeline programs.

A randomized controlled trial targeting alcohol use and sexual assault risk among college women at high risk for victimization.

PubMed

Gilmore, Amanda K; Lewis, Melissa A; George, William H

2015-11-01

Sexual assault risk reduction programs do not target alcohol use despite the widespread knowledge that alcohol use is a risk factor for being victimized. The current study assessed the effectiveness of a web-based combined sexual assault risk and alcohol use reduction program using a randomized control trial. A total of 207 college women between the ages of 18 and 20 who engaged in heavy episodic drinking were randomized to one of five conditions: full assessment only control condition, sexual assault risk reduction condition, alcohol use reduction condition, combined sexual assault risk and alcohol use reduction condition, and a minimal assessment only condition. Participants completed a 3-month follow-up survey on alcohol-related sexual assault outcomes, sexual assault outcomes, and alcohol use outcomes. Significant interactions revealed that women with higher severity of sexual assault at baseline experienced less incapacitated attempted or completed rapes, less severity of sexual assaults, and engaged in less heavy episodic drinking compared to the control condition at the 3-month follow-up. Web-based risk reduction programs targeting both sexual assault and alcohol use may be the most effective way to target the highest risk sample of college students for sexual assault: those with a sexual assault history and those who engage in heavy episodic drinking. Copyright © 2015 Elsevier Ltd. All rights reserved.

A Randomized Controlled Trial Targeting Alcohol Use and Sexual Assault Risk among College Women at High Risk for Victimization

PubMed Central

Gilmore, Amanda K.; Lewis, Melissa A.; George, William H.

2015-01-01

Current sexual assault risk reduction programs do not target alcohol use despite the widespread knowledge that alcohol use is a risk factor for being victimized. The current study assessed the effectiveness of a web-based combined sexual assault risk and alcohol use reduction program using a randomized control trial. A total of 207 college women between the ages of 18 and 20 who engaged in heavy episodic drinking were randomized to one of five conditions: full assessment only control condition, sexual assault risk reduction condition, alcohol use reduction condition, combined sexual assault risk and alcohol use reduction condition, and a minimal assessment only condition. Participants completed a 3-month follow-up survey on alcohol-related sexual assault outcomes, sexual assault outcomes, and alcohol use outcomes. Significant interactions revealed that women with higher incidence and severity of sexual assault at baseline experienced less incapacitated attempted or completed rapes, less incidence/severity of sexual assaults, and engaged in less heavy episodic drinking compared to the control condition at the 3-month follow-up. Web-based risk reduction programs targeting both sexual assault and alcohol use may be the most effective way to target the highest risk sample of college students for sexual assault: those with a sexual assault history and those who engage in heavy episodic drinking. PMID:26408290

Adult Bronchoscopy Training

PubMed Central

Wahidi, Momen M.; Read, Charles A.; Buckley, John D.; Addrizzo-Harris, Doreen J.; Shah, Pallav L.; Herth, Felix J. F.; de Hoyos Parra, Alberto; Ornelas, Joseph; Yarmus, Lonny; Silvestri, Gerard A.

2015-01-01

BACKGROUND: The determination of competency of trainees in programs performing bronchoscopy is quite variable. Some programs provide didactic lectures with hands-on supervision, other programs incorporate advanced simulation centers, whereas others have a checklist approach. Although no single method has been proven best, the variability alone suggests that outcomes are variable. Program directors and certifying bodies need guidance to create standards for training programs. Little well-developed literature on the topic exists. METHODS: To provide credible and trustworthy guidance, rigorous methodology has been applied to create this bronchoscopy consensus training statement. All panelists were vetted and approved by the CHEST Guidelines Oversight Committee. Each topic group drafted questions in a PICO (population, intervention, comparator, outcome) format. MEDLINE data through PubMed and the Cochrane Library were systematically searched. Manual searches also supplemented the searches. All gathered references were screened for consideration based on inclusion criteria, and all statements were designated as an Ungraded Consensus-Based Statement. RESULTS: We suggest that professional societies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. Bronchoscopy training programs should incorporate multiple tools, including simulation. We suggest that ongoing quality and process improvement systems be introduced and that certifying agencies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. We also suggest that assessment of skill maintenance and improvement in practice be evaluated regularly with ongoing quality and process improvement systems after initial skill acquisition. CONCLUSIONS: The current methods used for bronchoscopy competency in training programs are variable. We suggest that professional societies and certifying agencies move from a volume- based certification system to a standardized skill acquisition and knowledge-based competency assessment for pulmonary and thoracic surgery trainees. PMID:25674901

Motivation for Different Types and Doses of Exercise During Breast Cancer Chemotherapy: a Randomized Controlled Trial.

PubMed

Courneya, Kerry S; Segal, Roanne J; Vallerand, James R; Forbes, Cynthia C; Crawford, Jennifer J; Dolan, Lianne B; Friedenreich, Christine M; Reid, Robert D; Gelmon, Karen; Mackey, John R; McKenzie, Donald C

2016-08-01

Exercise is beneficial for breast cancer patients during chemotherapy, but their motivation to perform different types and doses of exercise is unknown. The purpose of this study was to examine the anticipated and experienced motivation of breast cancer patients before and after three different exercise programs during chemotherapy. Breast cancer patients initiating chemotherapy (N = 301) were randomized to a standard dose of 25-30 min of aerobic exercise, a higher dose of 50-60 min of aerobic exercise, or a combined dose of 50-60 min of aerobic and resistance exercise. Patient preference and motivational outcomes from the theory of planned behavior (i.e., perceived benefit, enjoyment, support, difficulty, and motivation) were assessed before and after the interventions. At pre-randomization, breast cancer patients were significantly (p < 0.001) more likely to prefer the combined program (80.1 %); however, after the interventions there was a significant (p < 0.001) increase in the number of patients preferring the high volume program and having no preference. At pre-randomization, breast cancer patients anticipated more favorable motivational outcomes for the combined program and less favorable motivational outcomes for the high volume program (all p < 0.001). After the interventions, the motivational outcomes experienced exceeded the anticipated motivational outcomes significantly more in the high volume group than the standard or combined groups. Anticipated motivational outcomes for different types and doses of exercise during chemotherapy varied considerably at pre-randomization, but the motivational outcomes experienced after the three interventions were similar. Clinicians can recommend any of the three exercise interventions to breast cancer patients knowing that positive motivational outcomes will result. Clinicaltrials.gov identifier: NCT00249015 .

Three-year follow-up results of a residential community reintegration program for patients with chronic acquired brain injury.

PubMed

Geurtsen, Gert J; van Heugten, Caroline M; Martina, Juan D; Rietveld, Antonius C; Meijer, Ron; Geurts, Alexander C

2012-05-01

To evaluate outcomes of a residential community reintegration program 3 years after treatment on independent living, societal participation, emotional well-being, and quality of life in patients with chronic acquired brain injury and psychosocial problems hampering societal participation. A follow-up assessment 3 years after treatment was compared with the 1-year follow-up assessment in a prospective cohort study. A tertiary rehabilitation center for acquired brain injury. Of the 67 patients assessed at the 1-year follow-up, 63 subjects (94%; 42 men; mean age at admission to treatment 24.7y; mean time postonset 5.1y) were available at the 3-year follow-up and taken into account in the analyses. A structured residential treatment program directed at improving independence in domestic life, work, leisure time, and social interactions. Community Integration Questionnaire, Employability Rating Scale, living situation, school, work situation, work hours, Center for Epidemiological Studies-Depression scale, and the World Health Organization Quality of Life Scale Abbreviated (5 scales). There were no significant differences for any of the outcome measures between the 1-year and 3-year follow-up assessment. These results indicate that the established significant and clinically relevant improvements after a residential community reintegration program remain stable in the long term. Copyright © 2012 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Association of housing first implementation and key outcomes among homeless persons with problematic substance use.

PubMed

Davidson, Clare; Neighbors, Charles; Hall, Gerod; Hogue, Aaron; Cho, Richard; Kutner, Bryan; Morgenstern, Jon

2014-11-01

Housing First is a supportive housing model for persons with histories of chronic homelessness that emphasizes client-centered services, provides immediate housing, and does not require treatment for mental illness or substance abuse as a condition of participation. Previous studies of Housing First have found reduced governmental costs and improved personal well-being among participants. However, variations in real-world program implementation require better understanding of the relationship between implementation and outcomes. This study investigated the effects of Housing First implementation on housing and substance use outcomes. Study participants were 358 individuals with histories of chronic homelessness and problematic substance use. Clients were housed in nine scatter-site Housing First programs in New York City. Program fidelity was judged across a set of core Housing First components. Client interviews at baseline and 12 months were used to assess substance use. Clients in programs with greater fidelity to consumer participation components of Housing First were more likely to be retained in housing and were less likely to report using stimulants or opiates at follow-up. Consistently implemented Housing First principles related to consumer participation were associated with superior housing and substance use outcomes among chronically homeless individuals with a history of substance use problems. The study findings suggest that program implementation is central to understanding the potential of Housing First to help clients achieve positive housing and substance use outcomes.

Interdisciplinary Studies and the Real World: A Practical Rationale for and Guide to Postgraduation Evaluation and Assessment

ERIC Educational Resources Information Center

Brooks, Benjamin; Widders, Evan

2012-01-01

This article is an outgrowth of the evaluation and assessment process in a large interdisciplinary studies (IDS) program at West Virginia University. We argue for the importance of collecting and assessing quantitative and qualitative data concerning learning outcomes, student satisfaction, career choice and development, and graduate education…

Course-Specific Motivated Learning and Outcomes: The Role of the Perceived Task Value of Course-Specific Assignments

ERIC Educational Resources Information Center

Ling-yee, Esther Li

2011-01-01

Although the internationalization of curricula has increased steadily over the past 30 years, most universities and business schools have concentrated their efforts on program assessment activities, leaving course-level assessment as a gap in most international business assessment portfolios. To address the gap in aligning course-specific designs…

Validity of instruments to assess students' travel and pedestrian safety

USDA-ARS?s Scientific Manuscript database

Safe Routes to School (SRTS) programs are designed to make walking and bicycling to school,safe and accessible for children. Despite their growing popularity, few validated measures exist for assessing important outcomes such as type of student transport or pedestrian safety behaviors. This research...

Improving HIV outcomes in resource-limited countries: the importance of quality indicators.

PubMed

Ahonkhai, Aima A; Bassett, Ingrid V; Ferris, Timothy G; Freedberg, Kenneth A

2012-11-24

Resource-limited countries increasingly depend on quality indicators to improve outcomes within HIV treatment programs, but indicators of program performance suitable for use at the local program level remain underdeveloped. Using the existing literature as a guide, we applied standard quality improvement (QI) concepts to the continuum of HIV care from HIV diagnosis, to enrollment and retention in care, and highlighted critical service delivery process steps to identify opportunities for performance indicator development. We then identified existing indicators to measure program performance, citing examples used by pivotal donor agencies, and assessed their feasibility for use in surveying local program performance. Clinical delivery steps without existing performance measures were identified as opportunities for measure development. Using National Quality Forum (NQF) criteria as a guide, we developed measurement concepts suitable for use at the local program level that address existing gaps in program performance assessment. This analysis of the HIV continuum of care identified seven critical process steps providing numerous opportunities for performance measurement. Analysis of care delivery process steps and the application of NQF criteria identified 24 new measure concepts that are potentially useful for improving operational performance in HIV care at the local level. An evidence-based set of program-level quality indicators is critical for the improvement of HIV care in resource-limited settings. These performance indicators should be utilized as treatment programs continue to grow.

Intervention mapping protocol for developing a theory-based diabetes self-management education program.

PubMed

Song, Misoon; Choi, Suyoung; Kim, Se-An; Seo, Kyoungsan; Lee, Soo Jin

2015-01-01

Development of behavior theory-based health promotion programs is encouraged with the paradigm shift from contents to behavior outcomes. This article describes the development process of the diabetes self-management program for older Koreans (DSME-OK) using intervention mapping (IM) protocol. The IM protocol includes needs assessment, defining goals and objectives, identifying theory and determinants, developing a matrix to form change objectives, selecting strategies and methods, structuring the program, and planning for evaluation and pilot testing. The DSME-OK adopted seven behavior objectives developed by the American Association of Diabetes Educators as behavioral outcomes. The program applied an information-motivation-behavioral skills model, and interventions were targeted to 3 determinants to change health behaviors. Specific methods were selected to achieve each objective guided by IM protocol. As the final step, program evaluation was planned including a pilot test. The DSME-OK was structured as the 3 determinants of the IMB model were intervened to achieve behavior objectives in each session. The program has 12 weekly 90-min sessions tailored for older adults. Using the IM protocol in developing a theory-based self-management program was beneficial in terms of providing a systematic guide to developing theory-based and behavior outcome-focused health education programs.

Effectiveness of home visiting programs on child outcomes: a systematic review

PubMed Central

2013-01-01

Background The effectiveness of paraprofessional home-visitations on improving the circumstances of disadvantaged families is unclear. The purpose of this paper is to systematically review the effectiveness of paraprofessional home-visiting programs on developmental and health outcomes of young children from disadvantaged families. Methods A comprehensive search of electronic databases (e.g., CINAHL PLUS, Cochrane, EMBASE, MEDLINE) from 1990 through May 2012 was supplemented by reference lists to search for relevant studies. Through the use of reliable tools, studies were assessed in duplicate. English language studies of paraprofessional home-visiting programs assessing specific outcomes for children (0-6 years) from disadvantaged families were eligible for inclusion in the review. Data extraction included the characteristics of the participants, intervention, outcomes and quality of the studies. Results Studies that scored 13 or greater out of a total of 15 on the validity tool (n = 21) are the focus of this review. All studies are randomized controlled trials and most were conducted in the United States. Significant improvements to the development and health of young children as a result of a home-visiting program are noted for particular groups. These include: (a) prevention of child abuse in some cases, particularly when the intervention is initiated prenatally; (b) developmental benefits in relation to cognition and problem behaviours, and less consistently with language skills; and (c) reduced incidence of low birth weights and health problems in older children, and increased incidence of appropriate weight gain in early childhood. However, overall home-visiting programs are limited in improving the lives of socially high-risk children who live in disadvantaged families. Conclusions Home visitation by paraprofessionals is an intervention that holds promise for socially high-risk families with young children. Initiating the intervention prenatally and increasing the number of visits improves development and health outcomes for particular groups of children. Future studies should consider what dose of the intervention is most beneficial and address retention issues. PMID:23302300

Enhancing Youth Outcomes Following Parental Divorce: A Longitudinal Study of the Effects of the New Beginnings Program on Educational and Occupational Goals

ERIC Educational Resources Information Center

Sigal, Amanda B.; Wolchik, Sharlene A.; Tein, Jenn-Yun; Sandler, Irwin N.

2012-01-01

This study examined whether the New Beginnings Program for divorced families led to improvements in youth's educational goals and job aspirations 6 years following participation and tested whether several parenting and youth variables mediated the program effects. Participants were 240 youth aged 9 to 12 years at the initial assessment, and data…

Efficacy of the California Bureau of Land Management Community Assistance and Hazardous Fuels Programs

Treesearch

David J. Ganz; David S. Saah; Matthew A. Wilson; Austin Troy

2007-01-01

This study provides a framework for assessing the social and environmental benefits and public education outcomes associated with the U.S. Department of the Interior, Bureau of Land Management’s Community Assistance and Hazardous Fuel Programs in California. Evaluations of fire hazard mitigation programs tend to focus primarily on the number of acres treated and...

A Supplement to the Component Four Implementation Booklet. Broad Goal Definition in Emerald School District. SPECS: School Planning, Evaluation, and Communication System.

ERIC Educational Resources Information Center

Nagle, John M.; Walker, Harold E.

The School Planning, Evaluation, and Communication System (SPECS) is an overall design for districtwide program assessment and development. It is both a way of interrelating planning and evaluation of individual programs and a way of comparing the outcomes of all district programs with the district's community-defined educational goals. This…