Sample records for rigorous program evaluation

  1. Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

    PubMed Central

    Burrus, Barri B.; Scott, Alicia Richmond

    2012-01-01

    Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541

  2. Application of Crossover Design for Conducting Rigorous Extension Evaluations

    ERIC Educational Resources Information Center

    Jayaratne, K. S. U.; Bird, Carolyn L.; McClelland, Jacquelyn W.

    2013-01-01

    With the increasing demand for accountability of Extension programming, Extension professionals need to apply rigorous evaluation designs. Randomized designs are useful to eliminate selection biases of program participants and to improve the accuracy of evaluation. However, randomized control designs are not practical to apply in Extension program…

  3. Characteristics of School Districts That Participate in Rigorous National Educational Evaluations

    ERIC Educational Resources Information Center

    Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.

    2017-01-01

    Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to…

  4. Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

    PubMed

    Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

    2018-06-01

    Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

  5. Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

    PubMed

    Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

    2016-04-01

    Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

  6. Lessons from the trenches: meeting evaluation challenges in school health education.

    PubMed

    Young, Michael; Denny, George; Donnelly, Joseph

    2012-11-01

    Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.

  7. Beyond the RCT: Integrating Rigor and Relevance to Evaluate the Outcomes of Domestic Violence Programs

    ERIC Educational Resources Information Center

    Goodman, Lisa A.; Epstein, Deborah; Sullivan, Cris M.

    2018-01-01

    Programs for domestic violence (DV) victims and their families have grown exponentially over the last four decades. The evidence demonstrating the extent of their effectiveness, however, often has been criticized as stemming from studies lacking scientific rigor. A core reason for this critique is the widespread belief that credible evidence can…

  8. Which Interventions Have the Greatest Effect on Student Learning in Sub-Saharan Africa? "A Meta-Analysis of Rigorous Impact Evaluations"

    ERIC Educational Resources Information Center

    Conn, Katharine

    2014-01-01

    In the last three decades, there has been a large increase in the number of rigorous experimental and quasi-experimental evaluations of education programs in developing countries. These impact evaluations have taken place all over the globe, including a large number in Sub-Saharan Africa (SSA). The fact that the developing world is socially and…

  9. An Evaluation of Knowledge Transfer from Microworld Programming to Conventional Programming

    ERIC Educational Resources Information Center

    Xinogalos, Stelios

    2012-01-01

    Programming microworlds are being used for introducing students to programming for many years. Although many professors and school teachers report positive results from using programming microwords, these results are usually based on anecdotal evidence rather than rigorous empirical evaluation. A question that has not been answered yet with…

  10. The Stanford Medical Youth Science Program: Educational and Science-Related Outcomes

    ERIC Educational Resources Information Center

    Crump, Casey; Ned, Judith; Winkleby, Marilyn A.

    2015-01-01

    Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer…

  11. Evaluating Extension Based Leadership Development Programs in the Southern United States

    ERIC Educational Resources Information Center

    Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

    2016-01-01

    The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

  12. Characteristics of School Districts That Participate in Rigorous National Educational Evaluations

    PubMed Central

    Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.

    2017-01-01

    Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to potential target populations for the interventions that were evaluated. Utilizing a list of the actual districts that participated in 11 large-scale rigorous educational evaluations, we compare those districts to several different target populations of districts that could potentially be affected by policy decisions regarding the interventions under study. We find that school districts that participated in the 11 rigorous educational evaluations differ from the interventions’ target populations in several ways, including size, student performance on state assessments, and location (urban/rural). These findings raise questions about whether, as currently implemented, the results from rigorous impact studies in education are likely to generalize to the larger set of school districts—and thus schools and students—of potential interest to policymakers, and how we can improve our study designs to retain strong internal validity while also enhancing external validity. PMID:29276552

  13. A review of the evaluation of 47 drug abuse prevention curricula available nationally.

    PubMed

    Dusenbury, L; Falco, M; Lake, A

    1997-04-01

    This review determined how many drug prevention curricula available to schools have been shown in rigorous research studies to reduce substance use behavior. Forty-seven curricula which met the following criteria were included: 1) they focused on primary prevention of alcohol and/or drug use, 2) they were classroom-based curricula designed for any grade level P-12, 3) they were nationally and currently available, and 4) program distributors were willing to provide samples of curriculum materials to determine drug abuse prevention content. Of the 47 drug abuse prevention curricula identified, 10 (21%) had been subjected to sufficiently rigorous evaluations. At least eight of the 10 programs have been shown effective at reducing tobacco or drug use, in at least some studies. The remaining two programs did not appear to have sustained effects on drug use, although they had variable success at reducing substance use early on. One of the 10 programs has been shown to have positive effects lasting into young adulthood. Six of the 10 curricula have been shown to have effects lasting for at least two years after the pretest. Two curricula have not been evaluated beyond the post-test, so it is impossible to know whether their effectiveness will last. Recommendations to increase the number of programs rigorously evaluated are offered.

  14. 76 FR 74076 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Final Notice

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-11-30

    ... Evaluate the YouthBuild Program; Final Notice AGENCY: Employment and Training Administration (ETA), Labor... rigorous, nationally-representative estimates of the net impacts of the YouthBuild program. The Department... study. In the sites randomly selected to participate in this evaluation, all applicants for YouthBuild...

  15. Evaluation of Mental Health Programs for the Aged.

    ERIC Educational Resources Information Center

    Kahn, Robert L.; Zarit, Steven H.

    This paper highlights what the authors believe are the important issues and directions of change in the evaluation of mental health programs. The rationale for such evaluation is twofold. First, it provides a scientifically rigorous method of determining the therapeutic efficacy of the treatment or program, and secondly, these results can exercise…

  16. A systematic review of primary prevention strategies for sexual violence perpetration☆

    PubMed Central

    DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K.; Massetti, Greta M.; Matjasko, Jennifer L.; Tharp, Andra Teten

    2018-01-01

    This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003). PMID:29606897

  17. A systematic review of primary prevention strategies for sexual violence perpetration.

    PubMed

    DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K; Massetti, Greta M; Matjasko, Jennifer L; Tharp, Andra Teten

    2014-01-01

    This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003).

  18. The Economic Cost of Substance Abuse Treatment in the State of Florida

    ERIC Educational Resources Information Center

    Alexandre, Pierre K.; Beulaygue, Isabelle C.; French, Michael T.; McCollister, Kathryn E.; Popovici, Ioana; Sayed, Bisma A.

    2012-01-01

    Objective: Public and private stakeholders of substance abuse treatment services require economic cost data to guide program evaluations and funding decisions. Background: Rigorous cost assessments have been conducted for several treatment programs across the United States, but a systematic and comprehensive evaluation of programs in a particular…

  19. Comprehensive Adolescent Health Programs That Include Sexual and Reproductive Health Services: A Systematic Review

    PubMed Central

    Parekh, Jenita; Tunçalp, Özge; Turke, Shani; Blum, Robert William

    2014-01-01

    We systematically reviewed peer-reviewed and gray literature on comprehensive adolescent health (CAH) programs (1998–2013), including sexual and reproductive health services. We screened 36 119 records and extracted articles using predefined criteria. We synthesized data into descriptive characteristics and assessed quality by evidence level. We extracted data on 46 programs, of which 19 were defined as comprehensive. Ten met all inclusion criteria. Most were US based; others were implemented in Egypt, Ethiopia, and Mexico. Three programs displayed rigorous evidence; 5 had strong and 2 had modest evidence. Those with rigorous or strong evidence directly or indirectly influenced adolescent sexual and reproductive health. The long-term impact of many CAH programs cannot be proven because of insufficient evaluations. Evaluation approaches that take into account the complex operating conditions of many programs are needed to better understand mechanisms behind program effects. PMID:25320876

  20. 76 FR 338 - Notice of Proposed Information Collection Requests

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-01-04

    ... feasibility of a promising practices study of Upward Bound that uses a rigorous quasi-experimental design. The design and feasibility report will develop a set of design options for conducting a study of Upward Bound and examine their applicability to studies of other TRIO programs. If a rigorous evaluation design...

  1. How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations.

    PubMed Central

    Ennett, S T; Tobler, N S; Ringwalt, C L; Flewelling, R L

    1994-01-01

    OBJECTIVES. Project DARE (Drug Abuse Resistance Education) is the most widely used school-based drug use prevention program in the United States, but the findings of rigorous evaluations of its effectiveness have not been considered collectively. METHODS. We used meta-analytic techniques to review eight methodologically rigorous DARE evaluations. Weighted effect size means for several short-term outcomes also were compared with means reported for other drug use prevention programs. RESULTS. The DARE effect size for drug use behavior ranged from .00 to .11 across the eight studies; the weighted mean for drug use across studies was .06. For all outcomes considered, the DARE effect size means were substantially smaller than those of programs emphasizing social and general competencies and using interactive teaching strategies. CONCLUSIONS. DARE's short-term effectiveness for reducing or preventing drug use behavior is small and is less than for interactive prevention programs. PMID:8092361

  2. A Review of Out-of-School Time Program Quasi-Experimental and Experimental Evaluation Results. Out-of-School Time Evaluation Snapshot.

    ERIC Educational Resources Information Center

    Little, Priscilla M. D.; Harris, Erin

    As the amount of resources allocated to out-of-school (OST) programming and policymakers' demands for research-based results increase, there is increasing interest in rigorous research designs to examine OST program outcomes. This issue of "Out-of-School Time Evaluation Snapshots" reviews 27 quasi-experimental and experimental OST…

  3. Teaching MBA Students Teamwork and Team Leadership Skills: An Empirical Evaluation of a Classroom Educational Program

    ERIC Educational Resources Information Center

    Hobson, Charles J.; Strupeck, David; Griffin, Andrea; Szostek, Jana; Rominger, Anna S.

    2014-01-01

    A comprehensive educational program for teaching behavioral teamwork and team leadership skills was rigorously evaluated with 148 MBA students enrolled at an urban regional campus of a Midwestern public university. Major program components included (1) videotaped student teams in leaderless group discussion (LGD) exercises at the course beginning…

  4. Collaborative Evaluation of a High School Prevention Curriculum: How Methods of Collaborative Evaluation Enhanced a Randomized Control Trial to Inform Program Improvement

    ERIC Educational Resources Information Center

    Orsini, Muhsin Michael; Wyrick, David L.; Milroy, Jeffrey J.

    2012-01-01

    Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

  5. Evaluation of the Academy of Math, Science, and Engineering at Luther Burbank High School During the 1984-85 School Year. Evaluation Report No. 21.

    ERIC Educational Resources Information Center

    Sacramento City Unified School District, CA.

    The Academy of Math, Science, and Engineering was established at the Luther Burbank High School of Sacramento, California as a rigorous and competitive academic alternative program. This report contains an evaluation of the second year (1984-85) of the program. Program accomplishments are reviewed in the categories of: (1) student enrollment; (2)…

  6. Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

    PubMed

    Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

    2012-04-01

    Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.

  7. Evaluation of the Tennessee Voluntary Prekindergarten Program: Kindergarten and First Grade Follow-Up Results from the Randomized Control Design. Research Report

    ERIC Educational Resources Information Center

    Lipsey, Mark W.; Hofer, Kerry G.; Dong, Nianbo; Farran, Dale C.; Bilbrey, Carol

    2013-01-01

    In 2009, Vanderbilt University's Peabody Research Institute, with the assistance of the Tennessee Department of Education's Division of Curriculum and Instruction, initiated a rigorous, independent evaluation of the state's Voluntary Prekindergarten program (TN- VPK). TN-VPK is a full-day prekindergarten program for four-year-old children expected…

  8. Three Independent Evaluations of Healthy Kids Programs Find Substantial Gains in Children's Dental Health Care. In Brief, September 2008, Number 2

    ERIC Educational Resources Information Center

    Hughes, Dana; Howell, Embry; Trenholm, Christopher; Hill, Ian; Dubay, Lisa

    2008-01-01

    This brief presents highlights from rigorous, independent evaluations of the Healthy Kids programs in three California counties: Los Angeles, San Mateo, and Santa Clara. Launched by Children's Health Initiatives (CHIs) in these counties between 2001 and 2003, the three Healthy Kids programs provide children with comprehensive health insurance…

  9. Practice guidelines for program evaluation in community-based rehabilitation.

    PubMed

    Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

    2017-06-01

    This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.

  10. Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

    ERIC Educational Resources Information Center

    Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

    2012-01-01

    This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…

  11. Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

    ERIC Educational Resources Information Center

    Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

    2015-01-01

    When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…

  12. Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

    ERIC Educational Resources Information Center

    Kingsbury, Nancy

    2011-01-01

    Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…

  13. An Evaluation of the Instructional Effects of the We the People... The Citizen and the Constitution Program using "With Liberty and Justice for All."

    ERIC Educational Resources Information Center

    Social Studies Development Center, Bloomington, IN.

    Reinforcing earlier conclusions of the Educational Testing Service, this evaluation highlights the success of the "We the People" program using the "Justice for All" textbook produced by the Center for Civic Education (CCE), the program involves students in a rigorous study of the Constitution and Bill of Rights and supports…

  14. Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children. Report from the Social and Character Development Research Program. NCER 2011-2001

    ERIC Educational Resources Information Center

    Ruby, Allen; Doolittle, Emily

    2010-01-01

    The Institute of Education Sciences (IES) and the Division of Violence Prevention in the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention (CDC) collaborated to conduct a rigorous impact evaluation of programs aimed at improving students' behavior. For this evaluation, such programs were termed Social…

  15. Culturally Sensitive Risk Behavior Prevention Programs for African American Adolescents: A Systematic Analysis

    ERIC Educational Resources Information Center

    Metzger, Isha; Cooper, Shauna M.; Zarrett, Nicole; Flory, Kate

    2013-01-01

    The current review conducted a systematic assessment of culturally sensitive risk prevention programs for African American adolescents. Prevention programs meeting the inclusion and exclusion criteria were evaluated across several domains: (1) theoretical orientation and foundation; (2) methodological rigor; (3) level of cultural integration; (4)…

  16. Effective Dropout Prevention and College Attendance Programs for Latino Students.

    ERIC Educational Resources Information Center

    Fashola, Olatokunbo S.; Slavin, Robert E.

    This paper reviews research related to effective secondary school programs aimed at dropout prevention and increasing college enrollment rates for at-risk Latino youth. The review identifies programs that have demonstrated a significant impact on dropout rates, college attendance, school performance, or related outcomes in rigorous evaluations;…

  17. Career Decision Making and Its Evaluation.

    ERIC Educational Resources Information Center

    Miller-Tiedeman, Anna

    1979-01-01

    The author discusses a career decision-making program which she designed and implemented using a pyramidal model of exploration, crystallization, choice, and classification. Her article outlines the value of rigorous evaluation techniques applied by the local practitioner. (MF)

  18. EVALUATION OF THE NEW YORK STATE EDUCATION DEPARTMENT CONFERENCE, NUMBER 1.

    ERIC Educational Resources Information Center

    GREEN, ROBERT L.

    THE MAJOR PROBLEM FACING EDUCATION, ACCORDING TO THIS REVIEW OF THE CONFERENCE, IS TO DEVELOP THE MOST EFFECTIVE LEARNING PROGRAMS FOR DISADVANTAGED YOUTH, WHICH SHOULD BE EVALUATED SCIENTIFICALLY. RIGOROUS STUDY IS NEEDED OF SUCH ISSUES AS (1) THE NATURE OF THE MOST EFFECTIVE PROGRAM FOR THE DISADVANTAGED LEARNER, (2) THE ASSESSMENT OF THE BASIC…

  19. Guiding Math Students to Campus Services: An Impact Evaluation of the Beacon Program at South Texas College

    ERIC Educational Resources Information Center

    Visher, Mary; Butcher, Kristin F.; Cerna, Oscar S.

    2011-01-01

    This research rigorously evaluates whether a low-cost intervention can improve students' performance in developmental math. The "Beacon Mentoring Program" was developed at South Texas College by professors, administrators, and staff at the college. Surveys of students revealed that many did not have someone on campus whom they felt they…

  20. 76 FR 51056 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Request for Comment

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-08-17

    ... assigned to the control group can re-apply to the YouthBuild program. The Department is soliciting comments... ``utilize appropriate methodology and research designs, including the use of control groups chosen by.... Accordingly, ETA is conducting a multisite control group evaluation to provide rigorous estimates [[Page 51058...

  1. Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

    ERIC Educational Resources Information Center

    Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

    2014-01-01

    Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…

  2. 75 FR 28287 - Final Plan for Fiscal Year 2010

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-05-20

    ... Federal agencies. In keeping with OJJDP's mission, these programs are designed to help strengthen the.../intervention based on sound theory and evaluative literature, which has yet to be evaluated rigorously. OJJDP..., and research and evaluation projects designed to improve juvenile justice systems and delinquency...

  3. The CAEP Standards and Research on Educator Preparation Programs: Linking Clinical Partnerships with Program Impact

    ERIC Educational Resources Information Center

    Heafner, Tina; McIntyre, Ellen; Spooner, Melba

    2014-01-01

    Responding to the challenge of more rigorous and outcome-oriented program evaluation criteria of the Council for the Accreditation of Educator Preparation (CAEP), authors take a critical look at the intersection of two standards: Clinical Partnerships and Practice (Standard 2) and Program Impact (Standard 4). Illustrating one aspect of a secondary…

  4. Technology Proliferation: Acquisition Strategies and Opportunities for an Uncertain Future

    DTIC Science & Technology

    2018-04-20

    The large programs of record characteristic of federal acquisition consist of rigorous research, development, testing, and evaluation (RDT&E...and evaluation (IOT&E) activities drive the program toward the decision to enter full rate production (FRP). Finally, in the sustainment phase, the...the new feature by a full release at a later date, or halt the development altogether. As stated by the Director of Operational Test and Evaluation

  5. Literacy and Workplace Change: Evaluation Findings from Eighteen Workplace Literacy Programs

    ERIC Educational Resources Information Center

    Benseman, John

    2012-01-01

    Many Western governments are looking to workplace literacy, language, and numeracy programs to address general skill improvement with a longterm aim of improving labor productivity. Rigorous research on these programs' effectiveness for both of these agendas, however, remains sparse and limited in scope. This article reports the findings of an…

  6. Rigorous Program Evaluations on a Budget: How Low-Cost Randomized Controlled Trials Are Possible in Many Areas of Social Policy

    ERIC Educational Resources Information Center

    Coalition for Evidence-Based Policy, 2012

    2012-01-01

    The increasing ability of social policy researchers to conduct randomized controlled trials (RCTs) at low cost could revolutionize the field of performance-based government. RCTs are widely judged to be the most credible method of evaluating whether a social program is effective, overcoming the demonstrated inability of other, more common methods…

  7. Exploring the barriers to rigorous monitoring and evaluation of health systems strengthening activities: qualitative evidence from international development partners.

    PubMed

    Wisniewski, Janna M; Yeager, Valerie A; Diana, Mark L; Hotchkiss, David R

    2016-10-01

    The number of health systems strengthening (HSS) programs has increased in the last decade. However, a limited number of studies providing robust evidence for the value and impact of these programs are available. This study aims to identify knowledge gaps and challenges that impede rigorous monitoring and evaluation (M&E) of HSS, and to ascertain the extent to which these efforts are informed by existing technical guidance. Interviews were conducted with HSS advisors at United States Agency for International Development-funded missions as well as senior M&E advisors at implementing partner and multilateral organizations. Findings showed that mission staff do not use existing technical resources, either because they do not know about them or do not find them useful. Barriers to rigorous M&E included a lack suitable of indicators, data limitations, difficulty in demonstrating an impact on health, and insufficient funding and resources. Consensus and collaboration between international health partners and local governments may mitigate these challenges. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

  8. The Rigors of Training Evaluation: A Discussion and Field Demonstration

    ERIC Educational Resources Information Center

    Bunker, Kerry A.; Cohen, Stephen L.

    1977-01-01

    The objectives of this research are to report an application of a complex evaluation design, the classic Solomon 4-group, to an organizational training program and to demonstrate the necessity and feasibility of conducting research of this type. (Author/RK)

  9. Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review.

    PubMed

    Gotovac, Sandra; Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

    2018-04-01

    The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families.

  10. Program Evaluation: A Variety of Rigorous Methods Can Help Identify Effective Interventions. Report to Congressional Requesters. GAO-10-30

    ERIC Educational Resources Information Center

    Kingsbury, Nancy

    2009-01-01

    Recent congressional initiatives seek to focus funds for certain federal social programs on interventions for which randomized experiments show sizable, sustained benefits to participants or society. The private, nonprofit Coalition for Evidence-Based Policy undertook the Top Tier Evidence initiative to help federal programs identify interventions…

  11. MOE vs. M&E: considering the difference between measuring strategic effectiveness and monitoring tactical evaluation.

    PubMed

    Diehl, Glen; Major, Solomon

    2015-01-01

    Measuring the effectiveness of military Global Health Engagements (GHEs) has become an area of increasing interest to the military medical field. As a result, there have been efforts to more logically and rigorously evaluate GHE projects and programs; many of these have been based on the Logic and Results Frameworks. However, while these Frameworks are apt and appropriate planning tools, they are not ideally suited to measuring programs' effectiveness. This article introduces military medicine professionals to the Measures of Effectiveness for Defense Engagement and Learning (MODEL) program, which implements a new method of assessment, one that seeks to rigorously use Measures of Effectiveness (vs. Measures of Performance) to gauge programs' and projects' success and fidelity to Theater Campaign goals. While the MODEL method draws on the Logic and Results Frameworks where appropriate, it goes beyond their planning focus by using the latest social scientific and econometric evaluation methodologies to link on-the-ground GHE "lines of effort" to the realization of national and strategic goals and end-states. It is hoped these methods will find use beyond the MODEL project itself, and will catalyze a new body of rigorous, empirically based work, which measures the effectiveness of a broad spectrum of GHE and security cooperation activities. We based our strategies on the principle that it is much more cost-effective to prevent conflicts than it is to stop one once it's started. I cannot overstate the importance of our theater security cooperation programs as the centerpiece to securing our Homeland from the irregular and catastrophic threats of the 21st Century.-GEN James L. Jones, USMC (Ret.). Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.

  12. Rigorous Measures of Implementation: A Methodological Framework for Evaluating Innovative STEM Programs

    ERIC Educational Resources Information Center

    Cassata-Widera, Amy; Century, Jeanne; Kim, Dae Y.

    2011-01-01

    The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

  13. Evidence-Based Practices Project for Suicide Prevention

    ERIC Educational Resources Information Center

    Rodgers, Philip L.; Sudak, Howard S.; Silverman, Morton M.; Litts, David A.

    2007-01-01

    Suicide continues to be a serious public health problem. In response to this problem, a myriad of suicide prevention programs have been developed and employed across the United States. Unfortunately, the effectiveness of many of these programs is unknown because they have not been evaluated using rigorous methods. The Evidence-Based Practices…

  14. Three-Year Longitudinal Study of School Behavior and Academic Outcomes: Results from a Comprehensive Expanded School Mental Health Program

    ERIC Educational Resources Information Center

    Daly, Brian P.; Sander, Mark A.; Nicholls, Elizabeth G.; Medhanie, Amanuel; Vanden Berk, Eric; Johnson, James

    2014-01-01

    While there has been encouraging growth in the number of expanded school mental health programs (ESMH) across the country, few programs rigorously evaluate long-term academic outcomes associated with receipt of these services. This study examined the effects of services from an ESMH program on school behavior (number of out-of-school suspensions…

  15. Early Childhood Development through an Integrated Program: Evidence from the Philippines. Impact Evaluation Series No. 2. World Bank Policy Research Working Paper 3922-IE

    ERIC Educational Resources Information Center

    Armecin, Graeme; Behrman, Jere R.; Ghuman, Sharon; Gultiano, Socorro; King, Elizabeth M.; Lee, Nanette

    2006-01-01

    More attention and resources have been devoted in recent years to early childhood development (ECD) in low- and middle-income countries. Rigorous studies on the effectiveness of ECD-related programs for improving children's development in various dimensions in the developing world are scant. The authors evaluate an important ECD initiative of the…

  16. The Economic Payoffs to Workplace Literacy. Upjohn Institute Staff Working Paper 93-21.

    ERIC Educational Resources Information Center

    Hollenbeck, Kevin

    Although a substantial literature has addressed workplace literacy programs, only two studies have attempted to evaluate rigorously the economic benefits to workplace education. A multivariate model has been suggested that provides evidence about the productivity impacts of participation in a workplace literacy program. The data used in this paper…

  17. A Federal Perspective on Improving Practices, Programs, and Policies in Special Education.

    ERIC Educational Resources Information Center

    Kaufman, Martin; And Others

    1993-01-01

    Unification of objective and subjective models is suggested as a means for contributing to a professional knowledge base for special education. The knowledge production, access, and use activities of the Office of Special Education programs are user oriented, while incorporating the empirical rigor of the initial research and evaluation. (SLD)

  18. A Randomized Crossover Study of Web-Based Media Literacy to Prevent Smoking

    ERIC Educational Resources Information Center

    Shensa, Ariel; Phelps-Tschang, Jane; Miller, Elizabeth; Primack, Brian A.

    2016-01-01

    Feasibly implemented Web-based smoking media literacy (SML) programs have been associated with improving SML skills among adolescents. However, prior evaluations have generally had weak experimental designs. We aimed to examine program efficacy using a more rigorous crossover design. Seventy-two ninth grade students completed a Web-based SML…

  19. Enhancing Women's Resistance to Sexual Coercion: A Randomized Controlled Trial of the DATE Program

    ERIC Educational Resources Information Center

    Simpson Rowe, Lorelei; Jouriles, Ernest N.; McDonald, Renee; Platt, Cora G.; Gomez, Gabriella S.

    2012-01-01

    Objective: Despite extensive efforts to develop sexual assault prevention programs for college women, few have been rigorously evaluated, and fewer have demonstrable effects on victimization. This study pilots the Dating Assertiveness Training Experience (DATE), designed to train young women in assertiveness skills for responding to sexual…

  20. Integrating Pharmacology Topics in High School Biology and Chemistry Classes Improves Performance

    ERIC Educational Resources Information Center

    Schwartz-Bloom, Rochelle D.; Halpin, Myra J.

    2003-01-01

    Although numerous programs have been developed for Grade Kindergarten through 12 science education, evaluation has been difficult owing to the inherent problems conducting controlled experiments in the typical classroom. Using a rigorous experimental design, we developed and tested a novel program containing a series of pharmacology modules (e.g.,…

  1. Exploring the Role of Executive Functioning Measures for Social Competence Research

    ERIC Educational Resources Information Center

    Stichter, Janine P.; Christ, Shawn E.; Herzog, Melissa J.; O'Donnell, Rose M.; O'Connor, Karen V.

    2016-01-01

    Numerous research groups have consistently called for increased rigor within the evaluation of social programming to better understand pivotal factors to treatment outcomes. The underwhelming data on the essential features of social competence programs for students with behavior challenges may, in part, be attributed to the manner by which…

  2. Building Their Futures: How Early Head Start Programs Are Enhancing the Lives of Infants and Toddlers in Low-Income Families. Volume I: Technical Report.

    ERIC Educational Resources Information Center

    Love, John M.; Kisker, Ellen Eliason; Ross, Christine M.; Schochet, Peter Z.; Brooks-Gunn, Jeanne; Boller, Kimberly; Paulsell, Diane; Fuligni, Allison Sidle; Berlin, Lisa J.

    Early Head Start began with 68 programs in 1995 and today, almost 650 programs serve some 55,000 low-income families with infants and toddlers. This two-generation program provides high-quality child and family development services, a focus on staff development, and a commitment to community partnerships. A rigorous national evaluation, including…

  3. Law-Related Education and Delinquency Prevention. ERIC Digest.

    ERIC Educational Resources Information Center

    Parrini, Michelle

    Evidence from research/evaluation studies indicates that the principles underlying law-related education (LRE) programs address the factors that put youth at risk for delinquency. Although rigorous evaluations of LRE are limited, what evidence exists suggests that LRE has potential to prevent delinquency and problem behavior. This digest…

  4. 77 FR 26764 - Submission for OMB Review; Comment Request

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-05-07

    ... two sites, with the random assignment of AFI-eligible cases to program and control groups. The... Families (ACF) is proposing a data collection activity as part of an experimental evaluation of the Assets... outcomes? While some evaluations suggest that IDAs help low-income families save, rigorous experimental...

  5. Reporting Randomized Controlled Trials in Education

    ERIC Educational Resources Information Center

    Mayo-Wilson, Evan; Grant, Sean; Montgomery, Paul

    2014-01-01

    Randomized controlled trials (RCTs) are increasingly used to evaluate programs and interventions in order to inform education policy and practice. High quality reports of these RCTs are needed for interested readers to understand the rigor of the study, the interventions tested, and the context in which the evaluation took place (Mayo-Wilson et…

  6. Pay for performance programs in Australia: a need for guiding principles.

    PubMed

    Scott, Ian A

    2008-11-01

    Pay-for-performance (P4P) programs which reward clinical providers with incentive payments based on one or more measures of quality of care are now common in the United States and the United Kingdom and it is likely they will attract increasing interest in Australia. However, empirical evidence demonstrating effectiveness of such programs is limited and many existing programs have not had rigorous outcome evaluation. To maximise success, future P4P programs should incorporate the lessons and insights obtained from previous experience. Based on a review of published trials, program evaluations and position statements, the following principles that may guide future program design and implementation were synthesised: 1) formulate a rationale and a business case for P4P; 2) use established evidence-based performance measures; 3) use rigorous and verifiable methods of data collection and analysis; 4) define performance targets using absolute and relative thresholds; 5) use rewards that are sufficient, equitable and transparent; 6) address appropriateness of provider responses and avoid perverse incentives; 7) implement communication and feedback strategies; 8) use existing organisational structures to implement P4P programs; 9) attribute credit for performance to participants in ways that foster population-based perspectives; and 10) invest in outcomes and health service research. Recommendations flowing from these principles relevant to Australian settings are provided.

  7. Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review

    PubMed Central

    Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

    2018-01-01

    Introduction The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. Methods A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Results Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Discussion Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Conclusion Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families. PMID:29662521

  8. Clinical and cost outcomes of multifactorial, cardiovascular risk management interventions in worksites: a comprehensive review and analysis.

    PubMed

    Pelletier, K R

    1997-12-01

    This paper is a critical review of the clinical and cost outcome evaluation studies of multifactorial, comprehensive, cardiovascular risk management programs in worksites. A comprehensive international literature search conducted under the auspices of the National Heart, Lung and Blood Institute identified 17 articles based on 12 studies that examined the clinical outcomes of multifactorial, comprehensive programs. These articles were identified through MEDLINE, manual searches of recent journals, and through direct inquiries to worksite health promotion researchers. All studies were conducted between 1978 and 1995, with 1978 being the date of the first citation of a methodologically rigorous evaluation. Of the 12 research studies, only 8 utilized the worksite as both the unit of assignment and as the unit of analysis. None of the studies analyzed adequately for cost effectiveness. Given this limitation, this review briefly considers the relevant worksite research that has demonstrated cost outcomes. Worksite-based, multifactorial cardiovascular intervention programs reviewed for this article varied widely in the comprehensiveness, intensity, and duration of both the interventions and evaluations. Results from randomized trials suggest that providing opportunities for individualized, cardiovascular risk reduction counseling for high-risk employees within the context of comprehensive programming may be the critical component of an effective worksite intervention. Despite the many limitations of the current methodologies of the 12 studies, the majority of the research to date indicates the following: (1) favorable clinical and cost outcomes; (2) that more recent and more rigorously designed research tends to support rather than refute earlier and less rigorously designed studies; and (3) that rather than interpreting the methodological flaws and diversity as inherently negative, one may consider it as indicative of a robust phenomena evident in many types of worksites, with diverse employees, differing interventions, and varying degrees of methodological sophistication. Results of these studies reviewed provide both cautious optimism about the effectiveness of these worksite programs and insights regarding the essential components and characteristics of successful programs.

  9. Evaluative Assessment for NASA/GSFC Equal Opportunity Programs Office Sponsored Programs

    NASA Technical Reports Server (NTRS)

    Jarrell, H. Judith

    1995-01-01

    The purpose of PREP (Pre-College Minority Engineering Program) is to upgrade skills of minority students who have shown an interest in pursuing academic degrees in electrical engineering. The goal is to upgrade skills needed for successful completion of the rigorous curriculum leading to a Bachelor of Science degree in engineering through a comprehensive upgrade of academic, study and interpersonal skills.

  10. 34 CFR 691.16 - Rigorous secondary school program of study.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2011-07-01 2011-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

  11. 34 CFR 691.16 - Rigorous secondary school program of study.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2013-07-01 2013-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

  12. 34 CFR 691.16 - Rigorous secondary school program of study.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2014-07-01 2014-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

  13. 34 CFR 691.16 - Rigorous secondary school program of study.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ...: biology, chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than... 34 Education 4 2012-07-01 2012-07-01 false Rigorous secondary school program of study. 691.16... Procedures § 691.16 Rigorous secondary school program of study. (a)(1) For each award year commencing with...

  14. 2014 Wind Program Peer Review Report

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    none,

    The Wind Program Peer Review Meeting was held March 24-28, 2014 in Arlington, VA. Principle investigators from the Energy Department, National Laboratories, academic, and industry representatives presented the progress of their DOE-funded research. This report documents the formal, rigorous evaluation process and findings of nine independent reviewers who examined the technical, scientific, and business results of Wind Program funded projects, as well as the productivity and management effectiveness of the Wind Program itself.

  15. Evidence Summary for First-Grade Classroom Prevention Program (Good Behavior Game Plus Enhanced Academic Curriculum). Top Tier Evidence Initiative

    ERIC Educational Resources Information Center

    Coalition for Evidence-Based Policy, 2010

    2010-01-01

    U.S. social programs, set up to address important problems, often fall short by funding specific models/strategies ("interventions") that are not effective. When evaluated in scientifically-rigorous studies, social interventions in K-12 education, job training, crime prevention, and other areas are frequently found ineffective or…

  16. Cost-Effectiveness Analysis of Early Reading Programs: A Demonstration with Recommendations for Future Research

    ERIC Educational Resources Information Center

    Hollands, Fiona M.; Kieffer, Michael J.; Shand, Robert; Pan, Yilin; Cheng, Henan; Levin, Henry M.

    2016-01-01

    We review the value of cost-effectiveness analysis for evaluation and decision making with respect to educational programs and discuss its application to early reading interventions. We describe the conditions for a rigorous cost-effectiveness analysis and illustrate the challenges of applying the method in practice, providing examples of programs…

  17. Lessons from the Social Innovation Fund: Supporting Evaluation to Assess Program Effectiveness and Build a Body of Research Evidence

    ERIC Educational Resources Information Center

    Zandniapour, Lily; Deterding, Nicole M.

    2018-01-01

    Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…

  18. Manufacturing Educational Change: Impact Evaluation of the Lansing Area Manufacturing Partnership Pilot Program. Executive Summary.

    ERIC Educational Resources Information Center

    MacAllum, Keith; Taylor, Susan Hubbard; Johnson, Amy Bell

    The Lansing Area Manufacturing Partnership (LAMP) is an academically rigorous, business/labor-driven school-to-career program in Lansing, Michigan, that includes business, union, school, and parent partners and provides participating students with work-based learning experiences for 2.5 hours every day throughout their senior year. LAMP's…

  19. Defining, Measuring and Supporting Success: Meeting the Challenges of Comprehensive School Reform Research. CSR Connection.

    ERIC Educational Resources Information Center

    Appelbaum, Deborah; Schwartzbeck, Terri Duggan

    Many educators believe that comprehensive school reform (CSR) holds real promise for improving schools, as many CSR programs are based in research and have documented success. However, in the past year, there has been increased emphasis on CSR programs' evidence of effectiveness and scrutiny of CSR evaluations' degree of rigor. Questions exist…

  20. Assessing face validity of a physical activity questionnaire for Spanish-speaking women in California

    USDA-ARS?s Scientific Manuscript database

    Background: A review of the literature produced no rigorously tested and validated Spanish-language physical activity survey or evaluation tools for use by USDA’s food assistance and education programs. The purpose of the current study was to develop and evaluate the face validity of a visually enha...

  1. Designing Studies to Evaluate Parent-Mediated Interventions for Toddlers with Autism Spectrum Disorder

    ERIC Educational Resources Information Center

    Siller, Michael; Morgan, Lindee; Turner-Brown, Lauren; Baggett, Kathleen M.; Baranek, Grace T.; Brian, Jessica; Bryson, Susan E.; Carter, Alice S.; Crais, Elizabeth R.; Estes, Annette; Kasari, Connie; Landa, Rebecca J.; Lord, Catherine; Messinger, Daniel S.; Mundy, Peter; Odom, Samuel L.; Reznick, J. Steven; Roberts, Wendy; Rogers, Sally J.; Schertz, Hannah H.; Smith, Isabel M.; Stone, Wendy L.; Watson, Linda R.; Wetherby, Amy M.; Yoder, Paul J.; Zwaigenbaum, Lonnie

    2013-01-01

    Given recent advances in science, policy, and practice of early identification in autism spectrum disorder (ASD), questions about the effectiveness of early intervention have far-reaching service and policy implications. However, rigorous research evaluating the efficacy and effectiveness of intervention programs for toddlers with ASD faces a…

  2. Seizing the Future: How Ohio's Career-Technical Education Programs Fuse Academic Rigor and Real-World Experiences to Prepare Students for College and Careers

    ERIC Educational Resources Information Center

    Guarino, Heidi; Yoder, Shaun

    2015-01-01

    "Seizing the Future: How Ohio's Career and Technical Education Programs Fuse Academic Rigor and Real-World Experiences to Prepare Students for College and Work," demonstrates Ohio's progress in developing strong policies for career and technical education (CTE) programs to promote rigor, including college- and career-ready graduation…

  3. The Development of a Service-Learning Program for First-Year Students Based on the Hallmarks of High Quality Service-Learning and Rigorous Program Evaluation

    ERIC Educational Resources Information Center

    Smith, Bradley H.; Gahagan, James; McQuillin, Samuel; Haywood, Benjamin; Cole, Caroline Pender; Bolton, Clay; Wampler, Mary Katherine

    2011-01-01

    We describe six hallmarks of high quality service-learning and explain how these considerations guided the development of a Transitional Coaching Program (TCP) during the first three years of implementation. We have demonstrated that the TCP is acceptable, feasible, and sustainable. Improvements have been seen in the degree of impact on learning…

  4. Rewarding Progress, Reducing Debt: Early Results from Ohio's Performance-Based Scholarship Demonstration for Low-Income Parents

    ERIC Educational Resources Information Center

    Cha, Paulette; Patel, Reshma

    2010-01-01

    This report presents early results from a rigorous evaluation of a performance-based scholarship program that was implemented at three community colleges in Ohio during the 2008-2009 academic year. The program in Ohio that is the subject of this report is part of MDRC's national Performance-Based Scholarship (PBS) Demonstration, which was launched…

  5. 'SINAMI': a tool for the economic evaluation of forest fire management programs in Mediterranean ecosystems

    Treesearch

    Francisco Rodriguez y Silva; Armando Gonzalez-Caban

    2010-01-01

    Historically, in Spain and most European countries, forest fire budgets have never been subjected to an objective and rigorous economic analysis indicative of the returns on investments in fire management protection programs. Thus far we have witnessed expansive growth of costs without any investment planning. New economic realities and more focussed oversight by...

  6. The Effects of Universal Pre-K in Oklahoma: Research Highlights and Policy Implications. CROCUS Working Paper.

    ERIC Educational Resources Information Center

    Gormley, William T., Jr.; Phillips, Deborah

    Oklahoma is one of three states to offer a free prekindergarten (pre-K) program to all students in participating school districts on a voluntary basis. Fortuitous circumstances in Tulsa, Oklahoma, the state's largest school district, permitted an unusually rigorous evaluation of the pre-K program in Tulsa. Because 4-year-olds beginning pre-K and…

  7. Estimates of Intraclass Correlation Coefficients from Longitudinal Group-Randomized Trials of Adolescent HIV/STI/Pregnancy Prevention Programs

    ERIC Educational Resources Information Center

    Glassman, Jill R.; Potter, Susan C.; Baumler, Elizabeth R.; Coyle, Karin K.

    2015-01-01

    Introduction: Group-randomized trials (GRTs) are one of the most rigorous methods for evaluating the effectiveness of group-based health risk prevention programs. Efficiently designing GRTs with a sample size that is sufficient for meeting the trial's power and precision goals while not wasting resources exceeding them requires estimates of the…

  8. Providing Home Visiting to High-Risk Pregnant and Postpartum Families: The Development and Evaluation of the MOMobile® Program

    ERIC Educational Resources Information Center

    Hadley, Barbara; Rudolph, Kara E.; Mogul, Marjie; Perry, Deborah F.

    2014-01-01

    Maternal, Infant, and Early Childhood Home Visiting legislation permits states to fund "promising practices"--with the understanding that these models will have a rigorous evaluation component. This article describes an innovative, low cost paraprofessional home visiting model developed in Pennsylvania by the Maternity Care Coalition. In…

  9. Primary prevention research: a preliminary review of program outcome studies.

    PubMed

    Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

    1980-07-01

    This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

  10. Collaborative evaluation of a high school prevention curriculum: How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement.

    PubMed

    Orsini, Muhsin Michael; Wyrick, David L; Milroy, Jeffrey J

    2012-11-01

    Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome variables that can be used for program improvement. Throughout this project there were many examples of client learning from evaluator and evaluator learning from client. This article presents convincing evidence that collaborative evaluation can improve the design, implementation, and findings of the randomized control trial. Throughout this paper, we discuss many examples of good science, good evaluation, and other practical benefits of practicing collaborative evaluation. Ultimately, the authors created the term pre-formative evaluation to describe the period prior to data collection and before program implementation, when collaborative evaluation can inform program improvement. Copyright © 2012 Elsevier Ltd. All rights reserved.

  11. Pedagogy and Academic Success in Prelicensure Nursing Education.

    PubMed

    Murray, Teri A

    2016-01-01

    The purpose of this article is to provide a brief description of the New Careers in Nursing (NCIN) program; highlight the features of the NCIN Preentry Immersion program designed to help students achieve academic success; introduce two NCIN innovation teaching projects that used active learning strategies to foster student engagement; and conduct an integrative review on the pedagogies used to foster academic success in nursing education. The integrative review revealed that interactive pedagogies fostered student engagement and increased the students' knowledge acquisition, competence, confidence, and satisfaction. Significant variations in the methodological rigor for the studies included in this review were noted in addition to nebulousness between nursing education research and evaluation. The review validated the need for more rigorous research in nursing education to improve the students' academic experience and subsequent success of all nursing students, including those from underrepresented or disadvantaged backgrounds, enrolled in prelicensure nursing education programs. Copyright © 2016 Elsevier Inc. All rights reserved.

  12. Payoffs and Pitfalls of a Minority Outreach Program: An Alaskan Example

    NASA Astrophysics Data System (ADS)

    Hanks, C. L.; Fowell, S. J.; Wartes, D.; Owens, G.

    2004-12-01

    The Rural Alaska Honors Institute (RAHI) is a summer bridging program for college-bound high school students from remote Alaskan communities. In the 20+ years since its initiation, more than 50% of RAHI graduates eventually obtained post-secondary degrees. The success of the RAHI program provides insights into how an outreach program can achieve its goals and avoid potential pitfalls. Instrumental to the success of the RAHI program are: longevity; small size (40-45 students per summer); support from the Alaska Native community; academic rigor; aggressive recruiting; establishment of a sense of community amongst participants; and individual mentoring and support. Potential pitfalls include: overextending the program to include too many students; failure to maintain academic rigor in all courses; recruitment of students and staff who do not embrace the program's methods and goals; and attempts to evaluate the program on the basis of short-term results. Alaska Natives in Geosciences introduces college-bound Alaska Native students to the geosciences by teaching a college-level introductory geoscience class as a RAHI elective. By collaborating with RAHI, Alaska Natives in Geosciences takes advantage of RAHI's effective recruitment efforts and proven mentoring program. However, maintaining scientific rigor has been difficult due to large differences in the students' scientific backgrounds, the demands of other courses in the RAHI program and the brevity of the summer session. Immediate post-course survey responses suggest that many RAHI students thought the geoscience class was interesting but too difficult and much too time-consuming. However, surveys of RAHI geoscience students a year later suggest that many found the course a very positive experience. An unanticipated result was that RAHI students who did not take the class also gained some insight into the geosciences.

  13. An Evaluation of the Savannah Early College Program: An Action Oriented Research Approach

    ERIC Educational Resources Information Center

    Kearse, Douglas

    2013-01-01

    The Savannah Early College Program (SECP) opened its doors in August 2007 to make a difference in the lives of all students who enrolled. Its primary mission was to combine academic rigor and support to help students enter college early and graduate from high school with up to 2 years of college credit. Since SECP joined the Early College High…

  14. Reading Partners: The Implementation and Effectiveness of a One-on-One Tutoring Program Delivered by Community Volunteers. Policy Brief

    ERIC Educational Resources Information Center

    Jacob, Robin Tepper; Smith, Thomas J.; Willard, Jacklyn A.; Rifkin, Rachel E.

    2014-01-01

    This policy brief summarizes the positive results of a rigorous evaluation of Reading Partners, a widely used program that offers one-on-one tutoring provided by community volunteers to struggling readers in low-income elementary schools. A total of 1,265 students in 19 schools in three states were randomly assigned to receive Reading…

  15. Mental health interventions in Myanmar: a review of the academic and gray literature.

    PubMed

    Nguyen, A J; Lee, C; Schojan, M; Bolton, P

    2018-01-01

    Recent political changes in Myanmar provide opportunities to expand mental health (MH) services. Given Myanmar's unique situation, we felt a need to assemble and interpret available local information on MH in Myanmar to inform service design, rather than simply drawing lessons from other countries. We reviewed academic and gray literature on the experience of MH problems in Myanmar and the suitability, availability, and effectiveness of MH and psychosocial programming. We searched: (1) Google Scholar; (2) PubMed; (3) PsychInfo; (4) English-language Myanmar journals and databases; (5) the Mental Health and Psychosocial Support (MHPSS) Network resources website; (6) websites and (7) local contacts of organizations identified during 2010 and 2013 mapping exercise of MHPSS providers; (8) the Myanmar Information Management Unit (MIMU) website; (9) University libraries in Yangon and Mandalay; and (10) identified local MH professionals. Qualitative data suggest that MH conditions resulting from stress are similar to those experienced elsewhere. Fourteen intervention evaluations were identified: three on community-level interventions, three on adult religion-based practice (meditation), four adult psychotherapeutic interventions, and four child-focused interventions. Support for the acceptability and effectiveness of interventions is mostly anecdotal. With the exception of two rigorous, randomized control trials, most evaluations had serious methodologic limitations. Few evaluations of psychotherapeutic or psychosocial programs for people from Myanmar have been published in the black or gray literature. Incorporating rigorous evaluations into existing and future programs is imperative for expanding the evidence base for psychotherapeutic and psychosocial programs in this context.

  16. 34 CFR 643.22 - How does the Secretary evaluate prior experience?

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... school enrollment of participants. (3) (3 points) Secondary school graduation (regular secondary school diploma). Whether the applicant met or exceeded its objective regarding the graduation of participants... standard number of years. (4) (1.5 points) Secondary school graduation (rigorous secondary school program...

  17. 34 CFR 643.22 - How does the Secretary evaluate prior experience?

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... school enrollment of participants. (3) (3 points) Secondary school graduation (regular secondary school diploma). Whether the applicant met or exceeded its objective regarding the graduation of participants... standard number of years. (4) (1.5 points) Secondary school graduation (rigorous secondary school program...

  18. 34 CFR 643.22 - How does the Secretary evaluate prior experience?

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... school enrollment of participants. (3) (3 points) Secondary school graduation (regular secondary school diploma). Whether the applicant met or exceeded its objective regarding the graduation of participants... standard number of years. (4) (1.5 points) Secondary school graduation (rigorous secondary school program...

  19. 34 CFR 643.22 - How does the Secretary evaluate prior experience?

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... school enrollment of participants. (3) (3 points) Secondary school graduation (regular secondary school diploma). Whether the applicant met or exceeded its objective regarding the graduation of participants... standard number of years. (4) (1.5 points) Secondary school graduation (rigorous secondary school program...

  20. 76 FR 39860 - Proposed Agency Information Collection

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-07-07

    ... ``Broad Program Area Categories'' (BPACs) for purposes of conducting the research. For each evaluation... data collection methods than those prescribed for high-rigor. For example, data may be collected by... methods to produce energy savings and outcome estimates. A range of qualitative, quantitative (survey), on...

  1. An ex post facto evaluation framework for place-based police interventions.

    PubMed

    Braga, Anthony A; Hureau, David M; Papachristos, Andrew V

    2011-12-01

    A small but growing body of research evidence suggests that place-based police interventions generate significant crime control gains. While place-based policing strategies have been adopted by a majority of U.S. police departments, very few agencies make a priori commitments to rigorous evaluations. Recent methodological developments were applied to conduct a rigorous ex post facto evaluation of the Boston Police Department's Safe Street Team (SST) hot spots policing program. A nonrandomized quasi-experimental design was used to evaluate the violent crime control benefits of the SST program at treated street segments and intersections relative to untreated street segments and intersections. Propensity score matching techniques were used to identify comparison places in Boston. Growth curve regression models were used to analyze violent crime trends at treatment places relative to control places. UNITS OF ANALYSIS: Using computerized mapping and database software, a micro-level place database of violent index crimes at all street segments and intersections in Boston was created. Yearly counts of violent index crimes between 2000 and 2009 at the treatment and comparison street segments and intersections served as the key outcome measure. The SST program was associated with a statistically significant reduction in violent index crimes at the treatment places relative to the comparison places without displacing crime into proximate areas. To overcome the challenges of evaluation in real-world settings, evaluators need to continuously develop innovative approaches that take advantage of new theoretical and methodological approaches.

  2. The Supporting Healthy Marriage Evaluation: Early Lessons from the Implementation of a Relationship and Marriage Skills Program for Low-Income Married Couples

    ERIC Educational Resources Information Center

    Gaubert, Jennifer Miller; Knox, Virginia; Alderson, Desiree Principe; Dalton, Christopher; Fletcher, Kate; McCormick, Meghan

    2010-01-01

    This report presents early implementation and operational lessons from the Supporting Healthy Marriage (SHM) evaluation. Funded by the Administration for Children and Families, SHM uses a rigorous research design to test the effectiveness of a new approach to improving outcomes for low-income children: strengthening the marriages and relationships…

  3. 75 FR 29732 - Career and Technical Education Program-Promoting Rigorous Career and Technical Education Programs...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-05-27

    ... DEPARTMENT OF EDUCATION Career and Technical Education Program--Promoting Rigorous Career and Technical Education Programs of Study Catalog of Federal Domestic Assistance (CFDA) Number: 84.051C. AGENCY: Office of Vocational and Adult Education, Department of Education. ACTION: Notice of proposed priorities...

  4. 2014 Water Power Program Peer Review Report

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    none,

    2014-08-18

    The Water Power Peer Review Meeting was held February 24-28, 2014 in Arlington, VA. Principle investigators from the Energy Department National Laboratories, academic, and industry representatives presented the progress of their DOE-funded research. This report documents the formal, rigorous evaluation process and findings of nine independent reviewers who examined the technical, scientific, and business results of 96 projects of the Water Power Program, as well as the productivity and management effectiveness of the Water Power Program itself.

  5. Program Manager: Journal of the Defense Systems Management College. Volume 16, Number 3, May-June 1987

    DTIC Science & Technology

    1987-06-01

    redress a growingstrategic imbalance and provide an en- test pilots conducted a rigorous flight test during capability to penetrate Soviet program...ment career path for rated officers vidual rotates through assignments in ( pilots and navigators) is different from engineering, test and evaluation...pain. Acquiring the B-1B, or any other weapon system for that matter, entails developing, testing ard producing new technology. In any high-tech en

  6. Historical context for the creation of the Office of Adolescent Health and the Teen Pregnancy Prevention Program.

    PubMed

    Kappeler, Evelyn M; Farb, Amy Feldman

    2014-03-01

    In Fiscal Year 2010, Federal funds were dedicated to support evidence-based approaches to effectively target teen pregnancy prevention and resulted in the establishment of the Office of Adolescent Health (OAH) and the Teen Pregnancy Prevention (TPP) Program. Through the tiered TPP Program, OAH supports replication and evaluation of programs using models whose effectiveness has been demonstrated through rigorous evaluation and the development and testing of promising or innovative pregnancy prevention strategies and approaches. This article documents the creation of OAH and the development of the TPP Program, the identification of a TPP evidence base, current program and evaluation efforts at OAH, and government coordination and partnerships related to reducing teen pregnancy. This article is of interest to those working to improve the health and wellbeing of adolescents. Published by Elsevier Inc.

  7. Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

    PubMed

    Chen, Huey T

    2016-12-01

    Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

  8. Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

    PubMed

    Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

    2018-03-03

    Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.

  9. 34 CFR 645.6 - What definitions apply to the Upward Bound Program?

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ..., chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than English... by the individual's State. Rigorous secondary school program of study means a program of study that... recognized as a rigorous secondary school program of study by the Secretary through the process described in...

  10. 34 CFR 645.6 - What definitions apply to the Upward Bound Program?

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ..., chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than English... by the individual's State. Rigorous secondary school program of study means a program of study that... recognized as a rigorous secondary school program of study by the Secretary through the process described in...

  11. 34 CFR 645.6 - What definitions apply to the Upward Bound Program?

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ..., chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than English... by the individual's State. Rigorous secondary school program of study means a program of study that... recognized as a rigorous secondary school program of study by the Secretary through the process described in...

  12. 34 CFR 645.6 - What definitions apply to the Upward Bound Program?

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ..., chemistry, and physics. (iv) Three years of social studies. (v) One year of a language other than English... by the individual's State. Rigorous secondary school program of study means a program of study that... recognized as a rigorous secondary school program of study by the Secretary through the process described in...

  13. Rigor in electronic health record knowledge representation: Lessons learned from a SNOMED CT clinical content encoding exercise.

    PubMed

    Monsen, Karen A; Finn, Robert S; Fleming, Thea E; Garner, Erin J; LaValla, Amy J; Riemer, Judith G

    2016-01-01

    Rigor in clinical knowledge representation is necessary foundation for meaningful interoperability, exchange and reuse of electronic health record (EHR) data. It is critical for clinicians to understand principles and implications of using clinical standards for knowledge representation within EHRs. To educate clinicians and students about knowledge representation and to evaluate their success of applying the manual lookups method for assigning Systematized Nomenclature of Medicine Clinical Terms (SNOMED CT) concept identifiers using formally mapped concepts from the Omaha System interface terminology. Clinicians who were students in a doctoral nursing program conducted 21 lookups for Omaha System terms in publicly available SNOMED CT browsers. Lookups were deemed successful if results matched exactly with the corresponding code from the January 2013 SNOMED CT-Omaha System terminology cross-map. Of the 21 manual lookups attempted, 12 (57.1%) were successful. Errors were due to semantic gaps differences in granularity and synonymy or partial term matching. Achieving rigor in clinical knowledge representation across settings, vendors and health systems is a globally recognized challenge. Cross-maps have potential to improve rigor in SNOMED CT encoding of clinical data. Further research is needed to evaluate outcomes of using of terminology cross-maps to encode clinical terms with SNOMED CT concept identifiers based on interface terminologies.

  14. Commentary on Foubert, Godin, & Tatum (2010): the evolution of sexual violence prevention and the urgency for effectiveness.

    PubMed

    Tharp, Andra Teten; DeGue, Sarah; Lang, Karen; Valle, Linda Anne; Massetti, Greta; Holt, Melissa; Matjasko, Jennifer

    2011-11-01

    Foubert, Godin, and Tatum describe qualitative effects among college men of The Men's Program, a one-session sexual violence prevention program. This article and the program it describes are representative of many sexual violence prevention programs that are in practice and provide an opportunity for a brief discussion of the development and evaluation of sexual violence prevention approaches. In this commentary, we will focus on two considerations for an evolving field: the adherence to the principles of prevention and the use of rigorous evaluation methods to demonstrate effectiveness. We argue that the problem of sexual violence has created urgency for effective prevention programs and that scientific and prevention standards provide the best foundation to meet this need.

  15. Creating a Novel Online Digital Badge-Awarding Program in Patient Navigation to Address Healthcare Access.

    PubMed

    Rohan, Annie J; Fullerton, Judith; Escallier, Lori A; Pati, Susmita

    A novel, sustainable digital badge-awarding online course was developed to prepare learners with familiarity of patient navigation. Learners offered favorable endorsement of essentially all elements of the program, especially the utility of the Blackboard learning management software program. Quality Matters standards provided a rigorous framework for the challenges of designing, implementing, and evaluating online curricula. Online education is an effective method for meeting the professional development needs of those seeking careers in care coordination/patient navigation.

  16. Adding a Time-Series Design Element to the Success Case Method to Improve Methodological Rigor: An Application for Nonprofit Program Evaluation

    ERIC Educational Resources Information Center

    Coryn, Chris L. S.; Schroter, Daniela C.; Hanssen, Carl E.

    2009-01-01

    Brinkerhoff's Success Case Method (SCM) was developed with the specific purpose of assessing the impact of organizational interventions (e.g., training and coaching) on business goals by analyzing extreme groups using case study techniques and storytelling. As an efficient and cost-effective method of evaluative inquiry, SCM is attractive in other…

  17. Making the Transition: Interim Results of the National Guard Youth ChalleNGe Evaluation

    ERIC Educational Resources Information Center

    Millenky, Megan; Bloom, Dan; Dillon, Colleen

    2010-01-01

    Young people who drop out of high school face long odds of success in a labor market that increasingly values education and skills. This report presents interim results from a rigorous, ongoing evaluation of the National Guard Youth ChalleNGe Program, which aims to "reclaim the lives of at-risk youth" who have dropped out of high school.…

  18. Making the Transition: Interim Results of the National Guard Youth ChalleNGe Evaluation. [Executive Summary

    ERIC Educational Resources Information Center

    Millenky, Megan; Bloom, Dan; Dillon, Colleen

    2010-01-01

    Young people who drop out of high school face long odds of success in a labor market that increasingly values education and skills. This report presents interim results from a rigorous, ongoing evaluation of the National Guard Youth ChalleNGe Program, which aims to "reclaim the lives of at-risk youth" who have dropped out of high school. ChalleNGe…

  19. Students Training for Academic Readiness (STAR): Year Four Evaluation Report

    ERIC Educational Resources Information Center

    Rainey, Katharine; Maloney, Catherine; Sheehan, Daniel; Lopez, Omar

    2011-01-01

    The federal Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, project strives to equalize low-income students' access to higher education by increasing their participation in rigorous coursework, providing expanded opportunities for low-income students and parents to learn about postsecondary educational opportunities…

  20. Students Training for Academic Readiness (STAR): Year Two Evaluation Report

    ERIC Educational Resources Information Center

    Maloney, Catherine; Sheehan, Daniel; Rainey, Katie; Whipple, Allyson

    2008-01-01

    The federal Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, project strives to equalize low-income students' access to higher education by increasing their participation in rigorous coursework, providing expanded opportunities for low-income students and parents to learn about postsecondary educational opportunities…

  1. Students Training for Academic Readiness (STAR): Year Four Evaluation Report. Executive Summary

    ERIC Educational Resources Information Center

    Texas Center for Educational Research, 2011

    2011-01-01

    The federal Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, project strives to equalize low-income students' access to higher education by increasing their participation in rigorous coursework, providing expanded opportunities for low-income students and parents to learn about postsecondary educational opportunities…

  2. 75 FR 35881 - Smaller Learning Communities Program

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-06-23

    ..., particularly if the evaluations are rigorous and use, for example, an experimental design. For this reason, in..., are designed to enable grantees to develop strategies to improve student outcomes. For example, among... students. We have designed this priority to apply to both teachers who share the same students and teachers...

  3. 75 FR 13515 - Office of Innovation and Improvement (OII); Overview Information; Ready-to-Learn Television...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-03-22

    ... on rigorous scientifically based research methods to assess the effectiveness of a particular... activities and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw... or observational methods that provide reliable and valid data across evaluators and observers, across...

  4. Students Training for Academic Readiness (STAR): Year Two Evaluation Report. Executive Summary

    ERIC Educational Resources Information Center

    Maloney, Catherine; Sheehan, Daniel; Rainey, Katie; Whipple, Allyson

    2008-01-01

    The federal Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, project strives to equalize low-income students' access to higher education by increasing their participation in rigorous coursework, providing expanded opportunities for low-income students and parents to learn about postsecondary educational opportunities…

  5. Students Training for Academic Readiness (STAR): Year One Evaluation Report. Executive Summary

    ERIC Educational Resources Information Center

    Maloney, Catherine; Caranikas-Walker, Fanny; Sheehan, Daniel

    2007-01-01

    The federal Gaining Early Awareness and Readiness for Undergraduate Programs, or GEAR UP, strives to equalize low-income students' access to higher education by increasing their participation in rigorous coursework, providing expanded opportunities for low-income students and parents to learn about postsecondary educational opportunities and…

  6. Rigorous evaluation of a pregnancy prevention program for American Indian youth and adolescents: study protocol for a randomized controlled trial.

    PubMed

    Tingey, Lauren; Chambers, Rachel; Goklish, Novalene; Larzelere, Francene; Lee, Angelita; Suttle, Rosemarie; Rosenstock, Summer; Lake, Kristin; Barlow, Allison

    2017-02-27

    American Indian adolescents have one of the highest rates of teen pregnancy and repeat teen births in the US. Substance use is a significant risk factor for unprotected sex, and American Indian adolescents have the highest substance use-related morbidity and mortality of any US racial group. Despite these disparities, there are no existing, evidence-based programs for pregnancy prevention that have been rigorously evaluated among American Indian teens. The proposed study is a randomized controlled trial to test the efficacy of a comprehensive sexual and reproductive health program developed in partnership with an American Indian community. Participants will be American Indians ages 11-19 and their parent or trusted adult, randomized to receive the control condition or intervention called Respecting the Circle of Life: Mind, Body and Spirit. The intervention includes eight lessons delivered to self-selected peer groups during a summer basketball camp and one lesson delivered to the youth and parent/trusted adult together within 3 months after camp. All lessons are administered by trained community health workers from the participating American Indian community. Youth and parent/trusted adult participants will complete assessments at baseline, 3, 9, 12, 24 and 36 months post-intervention completion. The primary outcome variables are sexual/reproductive health knowledge, sexual initiation, condom use self-efficacy and intent to use a condom at next sex as changed from baseline to post-intervention between intervention and control participants. Selected primary outcomes are applicable to all study participants. Currently there are no sexual and reproductive health programs designed specifically for American Indian youth that have been rigorously evaluated and found to have an evidence base. Respecting the Circle of Life is highly innovative by incorporating lesson delivery into a summer basketball camp and involving parents or other trusted adults in curriculum administration. If found successful, it will be the first evidence-based program for teen pregnancy prevention for American Indian youth and adolescents. Clinicaltrials.gov, NCT02904629 . Retrospectively registered on 23 September 2016.

  7. Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

    PubMed

    Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

    2014-12-01

    Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.

  8. Practical experience from the Office of Adolescent Health's large scale implementation of an evidence-based Teen Pregnancy Prevention Program.

    PubMed

    Margolis, Amy Lynn; Roper, Allison Yvonne

    2014-03-01

    After 3 years of experience overseeing the implementation and evaluation of evidence-based teen pregnancy prevention programs in a diversity of populations and settings across the country, the Office of Adolescent Health (OAH) has learned numerous lessons through practical application and new experiences. These lessons and experiences are applicable to those working to implement evidence-based programs on a large scale. The lessons described in this paper focus on what it means for a program to be implementation ready, the role of the program developer in replicating evidence-based programs, the importance of a planning period to ensure quality implementation, the need to define and measure fidelity, and the conditions necessary to support rigorous grantee-level evaluation. Published by Elsevier Inc.

  9. Optimal design and evaluation of a color separation grating using rigorous coupled wave analysis

    NASA Astrophysics Data System (ADS)

    Nagayoshi, Mayumi; Oka, Keiko; Klaus, Werner; Komai, Yuki; Kodate, Kashiko

    2006-02-01

    In recent years, the technology which separates white light into the three primary colors of Red (R), Green (G) and Blue (B) and adjusts each optical intensity and composites R, G and B to display various colors is required in the development and spread of color visual equipments. Various color separation devices have been proposed and have been put to practical use in color visual equipments. We have focused on a small and light grating-type device which has the possibility of reduction in cost and large-scale production and generates only the three primary colors of R, G and B so that a high saturation level can be obtained. To perform a rigorous analysis and design of color separation gratings, our group has developed a program that is based on the Rigorous Coupled Wave Analysis (RCWA). We then calculated the parameters to obtain a diffraction efficiency of higher than 70% and the color gamut of about 70%. We will report on the design, fabrication and evaluation of color separation gratings that have been optimized for fabrication by laser drawing.

  10. 76 FR 32971 - Proposed Priority for the Disability and Rehabilitation Research Projects and Centers Program

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-06-07

    ... and systematic search of the research literature on a topic for relevant studies, which are then evaluated using pre-determined, objective criteria for relevance and methodological rigor. In a systematic review, the evidence from relevant studies that meet the pre-determined criteria is then analyzed and...

  11. Practice Brief: Assessing Impact of Inclusive Postsecondary Education Using the Think College Standards

    ERIC Educational Resources Information Center

    Lynch, Kathleen Bodisch; Getzel, Elizabeth Evans

    2013-01-01

    Increasingly across the United States, institutions of higher education (IHE) are offering a wide array of postsecondary educational (PSE) opportunities for students with intellectual disabilities (ID). As more students with ID aspire to college, it is incumbent upon IHEs to engage in rigorous program evaluation to assess student outcomes and…

  12. Evidence Summary for H&R Block College Financial Aid Application Assistance. Top Tier Evidence Initiative

    ERIC Educational Resources Information Center

    Coalition for Evidence-Based Policy, 2012

    2012-01-01

    U.S. social programs, set up to address important problems, often fall short by funding specific models/strategies ("interventions") that are not effective. When evaluated in scientifically-rigorous studies, social interventions in K-12 education, job training, crime prevention, and other areas are frequently found ineffective or…

  13. Teaching Children Well: New Evidence-Based Approaches to Teacher Professional Development and Training

    ERIC Educational Resources Information Center

    Pianta, Robert C.

    2011-01-01

    There is widespread acknowledgement that the production of effective teaching and teachers is perhaps the critical component of education reform and innovation for improvement of student learning. This aim requires a serious investment of time, rigor, and evaluation to produce professional-development programs that actually work. This report…

  14. New Beginnings: Using Federal Title I Funds to Support Local Pre-K Efforts. Federal Policy Series

    ERIC Educational Resources Information Center

    Gayl, Chrisanne L.; Young, Marci; Patterson, Kathy

    2009-01-01

    High-quality, voluntary pre-kindergarten has emerged as an important policy to improve the nation's education system. Based on strong evidence from rigorous longitudinal research and recent program evaluations, reform-minded principals, superintendents, school board members and other leaders have embraced early education as an effective strategy…

  15. Evidence Summary for New York City's Small Schools of Choice. Top Tier Evidence Initiative

    ERIC Educational Resources Information Center

    Coalition for Evidence-Based Policy, 2015

    2015-01-01

    U.S. social programs, set up to address important problems, often fall short by funding specific models/strategies ("interventions") that are not effective. When evaluated in scientifically-rigorous studies, social interventions in K-12 education, job training, crime prevention, and other areas are frequently found ineffective or…

  16. Garfield Latin Grammar Magnet Elementary Schools: 1990-1991. Formative Evaluation.

    ERIC Educational Resources Information Center

    Robinson-Lewis, G.

    The second year of implementation of the Garfield Latin Grammar Magnet Elementary School in Kansas City, Missouri, is reported. The Latin grammar program operates in a traditional setting that includes strong emphasis on discipline and behavior, systemative and rigorous homework policies, and the strong commitment of staff, students, and parents.…

  17. Can a workbook work? Examining whether a practitioner evaluation toolkit can promote instrumental use.

    PubMed

    Campbell, Rebecca; Townsend, Stephanie M; Shaw, Jessica; Karim, Nidal; Markowitz, Jenifer

    2015-10-01

    In large-scale, multi-site contexts, developing and disseminating practitioner-oriented evaluation toolkits are an increasingly common strategy for building evaluation capacity. Toolkits explain the evaluation process, present evaluation design choices, and offer step-by-step guidance to practitioners. To date, there has been limited research on whether such resources truly foster the successful design, implementation, and use of evaluation findings. In this paper, we describe a multi-site project in which we developed a practitioner evaluation toolkit and then studied the extent to which the toolkit and accompanying technical assistance was effective in promoting successful completion of local-level evaluations and fostering instrumental use of the findings (i.e., whether programs directly used their findings to improve practice, see Patton, 2008). Forensic nurse practitioners from six geographically dispersed service programs completed methodologically rigorous evaluations; furthermore, all six programs used the findings to create programmatic and community-level changes to improve local practice. Implications for evaluation capacity building are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

  18. Obesity and the US Military Family

    PubMed Central

    Tanofsky-Kraff, Marian; Sbrocco, Tracy; Theim, Kelly R.; Cohen, L. Adelyn; Mackey, Eleanor R.; Stice, Eric; Henderson, Jennifer L.; McCreight, Sarah J.; Bryant, Edny J.; Stephens, Mark B.

    2014-01-01

    Objective This review discusses the current knowledge and future directions regarding obesity within the US military family (i.e., active-duty servicemembers, as well as military spouses, children, retirees, and veterans). The increasing rates of overweight and obesity within the US military adversely impact military readiness, limit recruitment, and place a significant financial burden on the Department of Defense. Design and Methods The following topics are reviewed: 1) The prevalence of and the financial, physical, and psychological costs associated with overweight in military communities; 2) military weight regulations, and challenges faced by the military family related to overweight and disordered eating; 3) the continued need for rigorous program evaluations and new intervention development. Results Overweight and its associated sequelae impact the entire military family. Military families share many similarities with their civilian counterparts, but they face unique challenges (e.g., stress related to deployments and relocations). Although the military has weight management resources, there is an urgent need for rigorous program evaluation and the development of enhanced obesity prevention programs across the lifespan of the military family–several of which are proposed herein. Conclusions Interdisciplinary and collaborative research efforts and team-based interventions will continue to inform understanding of obesity treatment and prevention within military and civilian populations. PMID:23836452

  19. Clinical and translational scientist career success: metrics for evaluation.

    PubMed

    Lee, Linda S; Pusek, Susan N; McCormack, Wayne T; Helitzer, Deborah L; Martina, Camille A; Dozier, Ann M; Ahluwalia, Jasjit S; Schwartz, Lisa S; McManus, Linda M; Reynolds, Brian D; Haynes, Erin N; Rubio, Doris M

    2012-10-01

    Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. © 2012 Wiley Periodicals, Inc.

  20. Using qualitative methods to improve questionnaires for Spanish speakers: assessing face validity of a food behavior checklist.

    PubMed

    Banna, Jinan C; Vera Becerra, Luz E; Kaiser, Lucia L; Townsend, Marilyn S

    2010-01-01

    Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture's food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. Copyright 2010 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

  1. Using Qualitative Methods to Improve Questionnaires for Spanish Speakers: Assessing Face Validity of a Food Behavior Checklist

    PubMed Central

    BANNA, JINAN C.; VERA BECERRA, LUZ E.; KAISER, LUCIA L.; TOWNSEND, MARILYN S.

    2015-01-01

    Development of outcome measures relevant to health nutrition behaviors requires a rigorous process of testing and revision. Whereas researchers often report performance of quantitative data collection to assess questionnaire validity and reliability, qualitative testing procedures are often overlooked. This report outlines a procedure for assessing face validity of a Spanish-language dietary assessment tool. Reviewing the literature produced no rigorously validated Spanish-language food behavior assessment tools for the US Department of Agriculture’s food assistance and education programs. In response to this need, this study evaluated the face validity of a Spanish-language food behavior checklist adapted from a 16-item English version of a food behavior checklist shown to be valid and reliable for limited-resource English speakers. The English version was translated using rigorous methods involving initial translation by one party and creation of five possible versions. Photos were modified based on client input and new photos were taken as necessary. A sample of low-income, Spanish-speaking women completed cognitive interviews (n=20). Spanish translation experts (n=7) fluent in both languages and familiar with both cultures made minor modifications but essentially approved client preferences. The resulting checklist generated a readability score of 93, indicating low reading difficulty. The Spanish-language checklist has adequate face validity in the target population and is ready for further validation using convergent measures. At the conclusion of testing, this instrument may be used to evaluate nutrition education interventions in California. These qualitative procedures provide a framework for designing evaluation tools for low-literate audiences participating in the US Department of Agriculture food assistance and education programs. PMID:20102831

  2. Improved methods for distribution loss evaluation. Volume 1: analytic and evaluative techniques. Final report

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Flinn, D.G.; Hall, S.; Morris, J.

    This volume describes the background research, the application of the proposed loss evaluation techniques, and the results. The research identified present loss calculation methods as appropriate, provided care was taken to represent the various system elements in sufficient detail. The literature search of past methods and typical data revealed that extreme caution in using typical values (load factor, etc.) should be taken to ensure that all factors were referred to the same time base (daily, weekly, etc.). The performance of the method (and computer program) proposed in this project was determined by comparison of results with a rigorous evaluation ofmore » losses on the Salt River Project system. This rigorous evaluation used statistical modeling of the entire system as well as explicit enumeration of all substation and distribution transformers. Further tests were conducted at Public Service Electric and Gas of New Jersey to check the appropriateness of the methods in a northern environment. Finally sensitivity tests indicated data elements inaccuracy of which would most affect the determination of losses using the method developed in this project.« less

  3. 77 FR 23764 - Comment Request for Information Collection for Site Visit Data Collection; American Recovery and...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-04-20

    ... data will affect our ability to conduct rigorous evaluations of these grants. For example, site visits are the only way the research team can observe the training programs in operation and collect real... Development and Research, Room N-5641, Employment and Training Administration, U.S. Department of Labor, 200...

  4. Growing a Professional Identity: A Grounded Theory of the Educational Experience of Baccalaureate Nursing Students

    ERIC Educational Resources Information Center

    Goodolf, Dawn M.

    2013-01-01

    Nursing students experience high levels of stress while enrolled in baccalaureate nursing programs. Research has focused on the contributors of stress such as the responsibilities of patient care, the overwhelming amount of information, high stakes methods of evaluation, and rigorous course schedules. Little research has been found on the personal…

  5. Grades of Evidence: Variability in Quality of Findings in Effectiveness Studies of Complex Field Interventions

    ERIC Educational Resources Information Center

    Chatterji, Madhabi

    2007-01-01

    This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

  6. Developing Empirical Benchmarks of Teacher Knowledge Effect Sizes in Studies of Professional Development Effectiveness

    ERIC Educational Resources Information Center

    Phelps, Geoffrey; Jones, Nathan; Kelcey, Ben; Liu, Shuangshuang; Kisa, Zahid

    2013-01-01

    Growing interest in teaching quality and accountability has focused attention on the need for rigorous studies and evaluations of professional development (PD) programs. However, the study of PD has been hampered by a lack of suitable instruments. The authors present data from the Teacher Knowledge Assessment System (TKAS), which was designed to…

  7. Augmented assessment as a means to augmented reality.

    PubMed

    Bergeron, Bryan

    2006-01-01

    Rigorous scientific assessment of educational technologies typically lags behind the availability of the technologies by years because of the lack of validated instruments and benchmarks. Even when the appropriate assessment instruments are available, they may not be applied because of time and monetary constraints. Work in augmented reality, instrumented mannequins, serious gaming, and similar promising educational technologies that haven't undergone timely, rigorous evaluation, highlights the need for assessment methodologies that address the limitations of traditional approaches. The most promising augmented assessment solutions incorporate elements of rapid prototyping used in the software industry, simulation-based assessment techniques modeled after methods used in bioinformatics, and object-oriented analysis methods borrowed from object oriented programming.

  8. Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

    PubMed

    Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

    2016-08-01

    Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

  9. Taking Stock of Parent Education in the Family Courts: Envisioning a Public Health Model

    PubMed Central

    Salem, Peter; Sandler, Irwin; Wolchik, Sharlene

    2012-01-01

    The paper reviewed the development and current status of the parent education movement in the Family Courts. Parent education programs are now being implemented in courts throughout the United States and have a high level of public acceptance; however, a stronger research methodology to evaluate the effects and continued work to align the goals with the content and teaching strategies of these programs are needed. A new conceptual framework is proposed for parent education, which views divorce as a public health problem for children as well as a legal issue. The three-level framework uses concepts from public health to align the goals, content and format of parent education programs and to enable rigorous evaluations of the outcomes achieved by these programs. PMID:23641191

  10. An Assessment of Cost Improvements in the NASA COTS - CRS Program and Implications for Future NASA Missions

    NASA Technical Reports Server (NTRS)

    Zapata, Edgar

    2017-01-01

    This review brings rigorous life cycle cost (LCC) analysis into discussions about COTS program costs. We gather publicly available cost data, review the data for credibility, check for consistency among sources, and rigorously define and analyze specific cost metrics.

  11. Evaluating a De-Centralized Regional Delivery System for Breast Cancer Screening and Patient Navigation for the Rural Underserved.

    PubMed

    Inrig, Stephen J; Tiro, Jasmin A; Melhado, Trisha V; Argenbright, Keith E; Craddock Lee, Simon J

    2014-01-01

    Providing breast cancer screening services in rural areas is challenging due to the fractured nature of healthcare delivery systems and complex reimbursement mechanisms that create barriers to access for the under- and uninsured. Interventions that reduce structural barriers to mammography, like patient navigation programs, are effective and recommended, especially for minority and underserved women. Although the literature on rural healthcare is significant, the field lacks studies of adaptive service delivery models and rigorous evaluation of evidence-based programs that facilitate routine screening and appropriate follow-up across large geographic areas. To better understand how to implement a decentralized regional delivery "hub & spoke" model for rural breast cancer screening and patient navigation, we have designed a rigorous, structured, multi-level and mixed-methods evaluation based on Glasgow's RE-AIM model (Reach, Effectiveness, Adoption, Implementation, and Maintenance). The program is comprised of three core components: 1) Outreach to underserved women by partnering with county organizations; 2) Navigation to guide patients through screening and appropriate follow-up; and 3) Centralized Reimbursement to coordinate funding for screening services through a central contract with Medicaid Breast and Cervical Cancer Services (BCCS). Using Glasgow's RE-AIM model, we will: 1) assess which counties have the resources and capacity to implement outreach and/or navigation components, 2) train partners in each county on how to implement components, and 3) monitor process and outcome measures in each county at regular intervals, providing booster training when needed. This evaluation strategy will elucidate how the heterogeneity of rural county infrastructure impacts decentralized service delivery as a navigation program expands. In addition to increasing breast cancer screening access, our model improves and maintains time to diagnostic resolution and facilitates timely referral to local cancer treatment services. We offer this evaluation approach as an exemplar for scientific methods to evaluate the translation of evidence-based federal policy into sustainable health services delivery in a rural setting.

  12. Evaluating a De-Centralized Regional Delivery System for Breast Cancer Screening and Patient Navigation for the Rural Underserved

    PubMed Central

    Inrig, Stephen J.; Tiro, Jasmin A.; Melhado, Trisha V.; Argenbright, Keith E.; Craddock Lee, Simon J.

    2017-01-01

    Providing breast cancer screening services in rural areas is challenging due to the fractured nature of healthcare delivery systems and complex reimbursement mechanisms that create barriers to access for the under- and uninsured. Interventions that reduce structural barriers to mammography, like patient navigation programs, are effective and recommended, especially for minority and underserved women. Although the literature on rural healthcare is significant, the field lacks studies of adaptive service delivery models and rigorous evaluation of evidence-based programs that facilitate routine screening and appropriate follow-up across large geographic areas. Objectives To better understand how to implement a decentralized regional delivery “hub & spoke” model for rural breast cancer screening and patient navigation, we have designed a rigorous, structured, multi-level and mixed-methods evaluation based on Glasgow’s RE-AIM model (Reach, Effectiveness, Adoption, Implementation, and Maintenance). Methods and Design The program is comprised of three core components: 1) Outreach to underserved women by partnering with county organizations; 2) Navigation to guide patients through screening and appropriate follow-up; and 3) Centralized Reimbursement to coordinate funding for screening services through a central contract with Medicaid Breast and Cervical Cancer Services (BCCS). Using Glasgow’s RE-AIM model, we will: 1) assess which counties have the resources and capacity to implement outreach and/or navigation components, 2) train partners in each county on how to implement components, and 3) monitor process and outcome measures in each county at regular intervals, providing booster training when needed. Discussion This evaluation strategy will elucidate how the heterogeneity of rural county infrastructure impacts decentralized service delivery as a navigation program expands. In addition to increasing breast cancer screening access, our model improves and maintains time to diagnostic resolution and facilitates timely referral to local cancer treatment services. We offer this evaluation approach as an exemplar for scientific methods to evaluate the translation of evidence-based federal policy into sustainable health services delivery in a rural setting. PMID:28713882

  13. Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity.

    PubMed

    Walker, Sarah Cusworth; Bumbarger, Brian K; Phillippi, Stephen W

    2015-10-01

    Evidence-based programs (EBPs) are an increasingly visible aspect of the treatment landscape in juvenile justice. Research demonstrates that such programs yield positive returns on investment and are replacing more expensive, less effective options. However, programs are unlikely to produce expected benefits when they are not well-matched to community needs, not sustained and do not reach sufficient reach and scale. We argue that achieving these benchmarks for successful implementation will require states and county governments to invest in data-driven decision infrastructure in order to respond in a rigorous and flexible way to shifting political and funding climates. We conceptualize this infrastructure as diagnostic capacity and evaluative capacity: Diagnostic capacity is defined as the process of selecting appropriate programing and evaluative capacity is defined as the ability to monitor and evaluate progress. Policy analyses of Washington State, Pennsylvania and Louisiana's program implementation successes are used to illustrate the benefits of diagnostic and evaluate capacity as a critical element of EBP implementation. Copyright © 2015 Elsevier Ltd. All rights reserved.

  14. Evaluating adolescent pregnancy programs: rethinking our priorities.

    PubMed

    Stahler, G J; DuCette, J P

    1991-01-01

    Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

  15. Accelerating Research Impact in a Learning Health Care System

    PubMed Central

    Elwy, A. Rani; Sales, Anne E.; Atkins, David

    2017-01-01

    Background: Since 1998, the Veterans Health Administration (VHA) Quality Enhancement Research Initiative (QUERI) has supported more rapid implementation of research into clinical practice. Objectives: With the passage of the Veterans Access, Choice and Accountability Act of 2014 (Choice Act), QUERI further evolved to support VHA’s transformation into a Learning Health Care System by aligning science with clinical priority goals based on a strategic planning process and alignment of funding priorities with updated VHA priority goals in response to the Choice Act. Design: QUERI updated its strategic goals in response to independent assessments mandated by the Choice Act that recommended VHA reduce variation in care by providing a clear path to implement best practices. Specifically, QUERI updated its application process to ensure its centers (Programs) focus on cross-cutting VHA priorities and specify roadmaps for implementation of research-informed practices across different settings. QUERI also increased funding for scientific evaluations of the Choice Act and other policies in response to Commission on Care recommendations. Results: QUERI’s national network of Programs deploys effective practices using implementation strategies across different settings. QUERI Choice Act evaluations informed the law’s further implementation, setting the stage for additional rigorous national evaluations of other VHA programs and policies including community provider networks. Conclusions: Grounded in implementation science and evidence-based policy, QUERI serves as an example of how to operationalize core components of a Learning Health Care System, notably through rigorous evaluation and scientific testing of implementation strategies to ultimately reduce variation in quality and improve overall population health. PMID:27997456

  16. Public Policies and Interventions for Diabetes in Latin America: a Scoping Review.

    PubMed

    Kaselitz, Elizabeth; Rana, Gurpreet K; Heisler, Michele

    2017-08-01

    Successful interventions are needed to diagnose and manage type 2 diabetes (T2DM) in Latin America, a region that is experiencing a significant rise in rates of T2DM. Complementing an earlier review exploring diabetes prevention efforts in Latin America, this scoping review examines the literature on (1) policies and governmental programs intended to improve diabetes diagnosis and treatment in Latin America and (2) interventions to improve diabetes management in Latin America. It concludes with a brief discussion of promising directions for future research. Governmental policies and programs for the diagnosis and treatment of diabetes in different Latin American countries have been implemented, but their efficacy to date has not been rigorously evaluated. There are some promising intervention approaches in Latin America to manage diabetes that have been evaluated. Some of these utilize multidisciplinary teams, a relatively resource-intensive approach difficult to replicate in low-resource settings. Other evaluated interventions in Latin America have successfully leveraged mobile health tools, trained peer volunteers, and community health workers (CHWs) to improve diabetes management and outcomes. There are some promising approaches and large-scale governmental efforts underway to curb the growing burden of type 2 diabetes in Latin America. While some of these interventions have been rigorously evaluated, further research is warranted to determine their effectiveness, cost, and scalability in this region.

  17. Evaluation of training programs and entry-level qualifications for nuclear-power-plant control-room personnel based on the systems approach to training

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Haas, P M; Selby, D L; Hanley, M J

    1983-09-01

    This report summarizes results of research sponsored by the US Nuclear Regulatory Commission (NRC) Office of Nuclear Regulatory Research to initiate the use of the Systems Approach to Training in the evaluation of training programs and entry level qualifications for nuclear power plant (NPP) personnel. Variables (performance shaping factors) of potential importance to personnel selection and training are identified, and research to more rigorously define an operationally useful taxonomy of those variables is recommended. A high-level model of the Systems Approach to Training for use in the nuclear industry, which could serve as a model for NRC evaluation of industrymore » programs, is presented. The model is consistent with current publically stated NRC policy, with the approach being followed by the Institute for Nuclear Power Operations, and with current training technology. Checklists to be used by NRC evaluators to assess training programs for NPP control-room personnel are proposed which are based on this model.« less

  18. Dynamic programming algorithms for biological sequence comparison.

    PubMed

    Pearson, W R; Miller, W

    1992-01-01

    Efficient dynamic programming algorithms are available for a broad class of protein and DNA sequence comparison problems. These algorithms require computer time proportional to the product of the lengths of the two sequences being compared [O(N2)] but require memory space proportional only to the sum of these lengths [O(N)]. Although the requirement for O(N2) time limits use of the algorithms to the largest computers when searching protein and DNA sequence databases, many other applications of these algorithms, such as calculation of distances for evolutionary trees and comparison of a new sequence to a library of sequence profiles, are well within the capabilities of desktop computers. In particular, the results of library searches with rapid searching programs, such as FASTA or BLAST, should be confirmed by performing a rigorous optimal alignment. Whereas rapid methods do not overlook significant sequence similarities, FASTA limits the number of gaps that can be inserted into an alignment, so that a rigorous alignment may extend the alignment substantially in some cases. BLAST does not allow gaps in the local regions that it reports; a calculation that allows gaps is very likely to extend the alignment substantially. Although a Monte Carlo evaluation of the statistical significance of a similarity score with a rigorous algorithm is much slower than the heuristic approach used by the RDF2 program, the dynamic programming approach should take less than 1 hr on a 386-based PC or desktop Unix workstation. For descriptive purposes, we have limited our discussion to methods for calculating similarity scores and distances that use gap penalties of the form g = rk. Nevertheless, programs for the more general case (g = q+rk) are readily available. Versions of these programs that run either on Unix workstations, IBM-PC class computers, or the Macintosh can be obtained from either of the authors.

  19. Dividing by Zero: Exploring Null Results in a Mathematics Professional Development Program

    ERIC Educational Resources Information Center

    Hill, Heather C.; Corey, Douglas Lyman; Jacob, Robin T.

    2018-01-01

    Background/Context: Since 2002, U.S. federal funding for educational research has favored the development and rigorous testing of interventions designed to improve student outcomes. However, recent reviews suggest that a large fraction of the programs developed and rigorously tested in the past decade have shown null results on student outcomes…

  20. Encouraging Evidence on a Sector-Focused Advancement Strategy: Two-Year Impacts from the WorkAdvance Demonstration

    ERIC Educational Resources Information Center

    Hendra, Richard; Greenberg, David H.; Hamilton, Gayle; Oppenheim, Ari; Pennington, Alexandra; Schaberg, Kelsey; Tessler, Betsy L.

    2016-01-01

    This report summarizes the two-year findings of a rigorous random assignment evaluation of the WorkAdvance model, a sectoral training, and advancement initiative. Launched in 2011, WorkAdvance goes beyond the previous generation of employment programs by introducing demand-driven skills training and a focus on jobs that have career pathways. The…

  1. Evaluation of Delaware Stars for Early Success: Year 1 Report. Research Report

    ERIC Educational Resources Information Center

    Schwartz, Heather L.; Karoly, Lynn A.; Le, Vi-Nhuan; Tamargo, Jennifer; Setodji, Claude Messan

    2014-01-01

    Delaware was in the first group of states to receive a federal grant in 2012 to improve early care and education services and increase the number of infants, toddlers, and preschool-age children in high-quality programs. One component of the state's grant is a rigorous validation process for Delaware Stars for Early Success, a voluntary quality…

  2. Evaluation of Quality Teaching for English Learners (QTEL) Professional Development. Final Report. NCEE 2012-4005

    ERIC Educational Resources Information Center

    Bos, Johannes M.; Sanchez, Raquel C.; Tseng, Fannie; Rayyes, Nada; Ortiz, Lorena; Sinicrope, Castle

    2012-01-01

    To add to the evidence base on effective strategies for teaching English language learner students, the 2006-2011 REL West at WestEd conducted a rigorous study, using an intent-to-treat model, of the impact on middle grades student achievement of offering teachers the opportunity to participate in a teacher professional development program. The…

  3. Encouraging Evidence on a Sector-Focused Advancement Strategy: Two-Year Impacts from the WorkAdvance Demonstration. Preview Summary

    ERIC Educational Resources Information Center

    Hendra, Richard; Greenberg, David H.; Hamilton, Gayle; Oppenheim, Ari; Pennington, Alexandra; Schaberg, Kelsey; Tessler, Betsy L.

    2016-01-01

    This report summarizes the two-year findings of a rigorous random assignment evaluation of the WorkAdvance model, a sectoral training and advancement initiative. Launched in 2011, WorkAdvance goes beyond the previous generation of employment programs by introducing demand-driven skills training and a focus on jobs that have career pathways. The…

  4. Validating the Use of AP® Exam Scores for College Course Placement. Research Report 2013-2

    ERIC Educational Resources Information Center

    Patterson, Brian F.; Ewing, Maureen

    2013-01-01

    The Advanced Placement Program® (AP®) was created to provide access to rigorous, college-level curricula to motivated and prepared high school students. This study evaluated whether the AP Exam scores from the summative exams associated with 10 courses were valid for the placement of students into higher-level college courses in the subject area…

  5. Clinical and Translational Scientist Career Success: Metrics for Evaluation

    PubMed Central

    Lee, Linda S.; Pusek, Susan N.; McCormack, Wayne T.; Helitzer, Deborah L.; Martina, Camille A.; Dozier, Ann M.; Ahluwalia, Jasjit S.; Schwartz, Lisa S.; McManus, Linda M.; Reynolds, Brian D.; Haynes, Erin N.; Rubio, Doris M.

    2012-01-01

    Abstract Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. Clin Trans Sci 2012; Volume 5: 400–407 PMID:23067352

  6. Interventions Using Regular Activities to Engage High-Risk School-Age Youth: a Review of After-School Programs in Latin America and the Caribbean.

    PubMed

    Cid, Alejandro

    2017-10-01

    In this paper, I review an issue that is an urgent challenge in the development field-the effectiveness of after-school programs for preventing school-age youth violence in vulnerable settings in Latin American and the Caribbean. These programs have proliferated in the region and include sports, recreation, music, tutoring, and other focused activities. Given their popularity and because they target known risk factors for violence (such as drop-out from school, poor academic performance, lack of motivation, too much idle time, low quality and quantity of adult supervision, and social isolation), it is critical to examine empirically whether they can be effective prevention strategies. Unfortunately, most rigorous trials of after-school interventions to prevent youth violence have been conducted in developed countries, with far fewer in Latin America. In this review, a broad range of databases was searched systematically. Only six studies in five Latin American and Caribbean countries were identified. Reported results indicate at least some benefits for youth behavior, although not across all youth. Additional concerns regarding how these programs are implemented and whether specific components can be tied to violence prevention are noted. The need for more rigorous evaluation of these programs is noted.

  7. Realistic evaluation of an emergency department-based mental health nurse practitioner outpatient service in Australia.

    PubMed

    Wand, Timothy; White, Kathryn; Patching, Joanna

    2011-06-01

    Evaluation of new models of care requires consideration of the complexity inherent within health care programs and their sensitivity to local contextual factors as well as broader community, social and political influences. Evaluation frameworks that are flexible and responsive while maintaining research rigor are therefore required. Realistic evaluation was adopted as the methodology for the implementation and evaluation of an emergency department-based mental health nurse practitioner outpatient service in Sydney, Australia. The aim of realistic evaluation is to generate, test and refine theories of how programs work within a given context. This paper represents the final methodological step from the completed evaluation. A summary of quantitative and qualitative findings from the mixed-methods evaluation is presented, which is transformed into a set of overarching statements or "middle range theories". Middle range theory statements seek to explain the success of a program and provide transferable lessons for practitioners wishing to implement similar programs elsewhere. For example, the research team consider that early consultation with key local stakeholders and emergency department ownership of the project was pivotal to the implementation process. © 2011 Blackwell Publishing Asia Pty Ltd.

  8. Effectiveness of Parent-Child Mediation in Improving Family Functioning and Reducing Adolescent Problem Behavior: Results from a Pilot Randomized Controlled Trial.

    PubMed

    Tucker, Joan S; Edelen, Maria Orlando; Huang, Wenjing

    2017-03-01

    Parent-child mediation programs are intended to resolve or manage disputes and improve family functioning, but rigorous evaluations of their effectiveness are lacking. Families referred to a community-based mediation program (N = 111) were randomized to an intervention or wait-list control group, and completed three surveys over a 12-week period. With the exception of parent-reported child delinquency (which decreased more in the intervention group), this evaluation provides little support for the short-term effectiveness of parent-child mediation for improving family functioning and reducing child problem behaviors in general. Given that this is the first randomized controlled trial of a parent-child mediation program, additional evaluations involving larger samples and longer follow-ups are needed before firm conclusions can be drawn about the effectiveness of this intervention.

  9. Effectiveness of Parent-Child Mediation in Improving Family Functioning and Reducing Adolescent Problem Behavior: Results from a Pilot Randomized Controlled Trial

    PubMed Central

    Tucker, Joan S.; Edelen, Maria Orlando; Huang, Wenjing

    2016-01-01

    Parent-child mediation programs are intended to resolve or manage disputes and improve family functioning, but rigorous evaluations of their effectiveness are lacking. Families referred to a community-based mediation program (N=111) were randomized to an intervention or wait-list control group, and completed three surveys over a 12-week period. With the exception of parent-reported child delinquency (which decreased more in the intervention group), this evaluation provides little support for the short-term effectiveness of parent-child mediation for improving family functioning and reducing child problem behaviors in general. Given that this is the first randomized controlled trial of a parent-child mediation program, additional evaluations involving larger samples and longer follow-ups are needed before firm conclusions can be drawn about the effectiveness of this intervention. PMID:26762375

  10. Paths to Work in Rural Places: Key Findings and Lessons from the Impact Evaluation of the Future Steps Rural Welfare-to-Work Program. Final Report

    ERIC Educational Resources Information Center

    Meckstroth, Alicia; Burwick, Andrew; Ponza, Michael; Marsh, Shawn; Novak, Tim; Phillips, Shannon; Diaz-Tena, Nuria; Ng, Judy

    2006-01-01

    Helping low-income families in rural areas find gainful employment and achieve economic self-sufficiency is an ongoing policy concern. The Rural Welfare-to-Work Strategies demonstration is using rigorous experimental designs to build knowledge about how to help low-income families in rural areas strive toward sustained employment and…

  11. Not so Fast My Friend: The Rush to R and the Need for Rigorous Evaluation of Data Analysis and Software in Education

    ERIC Educational Resources Information Center

    Harwell, Michael

    2014-01-01

    Commercial data analysis software has been a fixture of quantitative analyses in education for more than three decades. Despite its apparent widespread use there is no formal evidence cataloging what software is used in educational research and educational statistics classes, by whom and for what purpose, and whether some programs should be…

  12. Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Rigorous Impact Evaluations

    ERIC Educational Resources Information Center

    Conn, Katharine

    2014-01-01

    The aim of this dissertation is to identify effective educational interventions in Sub-Saharan African with an impact on student learning. This is the first meta-analysis in the field of education conducted for Sub-Saharan Africa. This paper takes an in-depth look at twelve different types of education interventions or programs and attempts to not…

  13. Does a gatekeeper suicide prevention program work in a school setting? Evaluating training outcome and moderators of effectiveness.

    PubMed

    Tompkins, Tanya L; Witt, Jody; Abraibesh, Nadia

    2009-12-01

    The current study sought to evaluate the suicide prevention gatekeeper training program QPR (Question, Persuade, and Refer) among school personnel using a non-equivalent control group design. Substantial gains were demonstrated from pre- to post-test for attitudes, knowledge, and beliefs regarding suicide and suicide prevention. Exploratory analyses revealed the possible moderating effects of age, professional role, prior training, and recent contact with suicidal youth on QPR participants' general knowledge, questioning, attitudes toward suicide and suicide prevention, QPR quiz scores, and self-efficacy. The need for replication using a more rigorous experimental design in the context of strong community collaboration is discussed.

  14. Impact of cooking and home food preparation interventions among adults: outcomes and implications for future programs

    PubMed Central

    Reicks, Marla; Trofholz, Amanda C.; Stang, Jamie S; Laska, Melissa N.

    2014-01-01

    Objective Cooking programs are growing in popularity; however an extensive review has not examined overall impact. Therefore, this study reviewed previous research on cooking/home food preparation interventions and diet and health-related outcomes among adults and identified implications for practice and research. Design Literature review and descriptive summative method. Main outcome measures Dietary intake, knowledge/skills, cooking attitudes and self-efficacy/confidence, health outcomes. Analysis Articles evaluating effectiveness of interventions that included cooking/home food preparation as the primary aim (January 1980 through December 2011) were identified via OVID MEDLINE, Agricola and Web of Science databases. Studies grouped according to design and outcomes were reviewed for validity using an established coding system. Results were summarized for several outcome categories. Results Of 28 studies identified, 12 included a control group with six as non-randomized and six as randomized controlled trials. Evaluation was done post-intervention for five studies, pre- and post-intervention for 23 and beyond post-intervention for 15. Qualitative and quantitative measures suggested a positive influence on main outcomes. However, non-rigorous study designs, varying study populations, and use of non-validated assessment tools limited stronger conclusions. Conclusions and Implications Well-designed studies are needed that rigorously evaluate long-term impact on cooking behavior, dietary intake, obesity and other health outcomes. PMID:24703245

  15. Health promotion in small business: a systematic review of factors influencing adoption and effectiveness of worksite wellness programs.

    PubMed

    McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S

    2014-06-01

    To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study's rigor using the WHO-adapted GRADEprofiler "quality of evidence" criteria. Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs.

  16. Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting.

    PubMed

    Harris, Claire; Garrubba, Marie; Allen, Kelly; King, Richard; Kelly, Cate; Thiagarajan, Malar; Castleman, Beverley; Ramsey, Wayne; Farjou, Dina

    2015-12-28

    This paper reports the process of establishing a transparent, accountable, evidence-based program for introduction of new technologies and clinical practices (TCPs) in a large Australian healthcare network. Many countries have robust evidence-based processes for assessment of new TCPs at national level. However many decisions are made by local health services where the resources and expertise to undertake health technology assessment (HTA) are limited and a lack of structure, process and transparency has been reported. An evidence-based model for process change was used to establish the program. Evidence from research and local data, experience of health service staff and consumer perspectives were incorporated at each of four steps: identifying the need for change, developing a proposal, implementation and evaluation. Checklists assessing characteristics of success, factors for sustainability and barriers and enablers were applied and implementation strategies were based on these findings. Quantitative and qualitative methods were used for process and outcome evaluation. An action research approach underpinned ongoing refinement to systems, processes and resources. A Best Practice Guide developed from the literature and stakeholder consultation identified seven program components: Governance, Decision-Making, Application Process, Monitoring and Reporting, Resources, Administration, and Evaluation and Quality Improvement. The aims of transparency and accountability were achieved. The processes are explicit, decisions published, outcomes recorded and activities reported. The aim of ascertaining rigorous evidence-based information for decision-making was not achieved in all cases. Applicants proposing new TCPs provided the evidence from research literature and local data however the information was often incorrect or inadequate, overestimating benefits and underestimating costs. Due to these limitations the initial application process was replaced by an Expression of Interest from applicants followed by a rigorous HTA by independent in-house experts. The program is generalisable to most health care organisations. With one exception, the components would be achievable with minimal additional resources; the lack of skills and resources required for HTA will limit effective application in many settings. A toolkit containing details of the processes and sample materials is provided to facilitate replication or local adaptation by those wishing to establish a similar program.

  17. Green Marine: An environmental program to establish sustainability in marine transportation.

    PubMed

    Walker, Tony R

    2016-04-15

    European maritime companies have adopted programs to limit operational impacts on the environment. For maritime companies in North America, the Green Marine Environmental Program (GMEP) offers a framework to establish and reduce environmental footprints. Green Marine (GM) participants demonstrate annual improvements of specific environmental performance indicators (e.g., reductions in air pollution emissions) to maintain certification. Participants complete annual self-evaluations with results determining rankings for performance indicators on a 1-to-5 scale. Self-evaluations are independently verified every two years to ensure rigor and individual results are made publicly available annually to achieve transparency. GM benefits the marine industry across North America by encouraging sustainable development initiatives. GM's credibility is reflected through a diverse network of environmental groups and government agencies that endorse and help shape the program. Merits of this relatively new maritime certification (not previously described in the academic literature), are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

  18. Maximizing the U.S. Army’s Future Contribution to Global Security Using the Capability Portfolio Analysis Tool (CPAT)

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Davis, Scott J.; Edwards, Shatiel B.; Teper, Gerald E.

    We report that recent budget reductions have posed tremendous challenges to the U.S. Army in managing its portfolio of ground combat systems (tanks and other fighting vehicles), thus placing many important programs at risk. To address these challenges, the Army and a supporting team developed and applied the Capability Portfolio Analysis Tool (CPAT) to optimally invest in ground combat modernization over the next 25–35 years. CPAT provides the Army with the analytical rigor needed to help senior Army decision makers allocate scarce modernization dollars to protect soldiers and maintain capability overmatch. CPAT delivers unparalleled insight into multiple-decade modernization planning usingmore » a novel multiphase mixed-integer linear programming technique and illustrates a cultural shift toward analytics in the Army’s acquisition thinking and processes. CPAT analysis helped shape decisions to continue modernization of the $10 billion Stryker family of vehicles (originally slated for cancellation) and to strategically reallocate over $20 billion to existing modernization programs by not pursuing the Ground Combat Vehicle program as originally envisioned. Ultimately, more than 40 studies have been completed using CPAT, applying operations research methods to optimally prioritize billions of taxpayer dollars and allowing Army acquisition executives to base investment decisions on analytically rigorous evaluations of portfolio trade-offs.« less

  19. Maximizing the U.S. Army’s Future Contribution to Global Security Using the Capability Portfolio Analysis Tool (CPAT)

    DOE PAGES

    Davis, Scott J.; Edwards, Shatiel B.; Teper, Gerald E.; ...

    2016-02-01

    We report that recent budget reductions have posed tremendous challenges to the U.S. Army in managing its portfolio of ground combat systems (tanks and other fighting vehicles), thus placing many important programs at risk. To address these challenges, the Army and a supporting team developed and applied the Capability Portfolio Analysis Tool (CPAT) to optimally invest in ground combat modernization over the next 25–35 years. CPAT provides the Army with the analytical rigor needed to help senior Army decision makers allocate scarce modernization dollars to protect soldiers and maintain capability overmatch. CPAT delivers unparalleled insight into multiple-decade modernization planning usingmore » a novel multiphase mixed-integer linear programming technique and illustrates a cultural shift toward analytics in the Army’s acquisition thinking and processes. CPAT analysis helped shape decisions to continue modernization of the $10 billion Stryker family of vehicles (originally slated for cancellation) and to strategically reallocate over $20 billion to existing modernization programs by not pursuing the Ground Combat Vehicle program as originally envisioned. Ultimately, more than 40 studies have been completed using CPAT, applying operations research methods to optimally prioritize billions of taxpayer dollars and allowing Army acquisition executives to base investment decisions on analytically rigorous evaluations of portfolio trade-offs.« less

  20. An operations-partnered evaluation of care redesign for high-risk patients in the Veterans Health Administration (VHA): Study protocol for the PACT Intensive Management (PIM) randomized quality improvement evaluation.

    PubMed

    Chang, Evelyn T; Zulman, Donna M; Asch, Steven M; Stockdale, Susan E; Yoon, Jean; Ong, Michael K; Lee, Martin; Simon, Alissa; Atkins, David; Schectman, Gordon; Kirsh, Susan R; Rubenstein, Lisa V

    2018-06-01

    Patient-centered medical homes have made great strides providing comprehensive care for patients with chronic conditions, but may not provide sufficient support for patients at highest risk for acute care use. To address this, the Veterans Health Administration (VHA) initiated a five-site demonstration project to evaluate the effectiveness of augmenting the VA's Patient Aligned Care Team (PACT) medical home with PACT Intensive Management (PIM) teams for Veterans at highest risk for hospitalization. Researchers partnered with VHA leadership to design a mixed-methods prospective multi-site evaluation that met leadership's desire for a rigorous evaluation conducted as quality improvement rather than research. We conducted a randomized QI evaluation and assigned high-risk patients to participate in PIM and compared them with high-risk Veterans receiving usual care through PACT. The summative evaluation examines whether PIM: 1) decreases VHA emergency department and hospital use; 2) increases satisfaction with VHA care; 3) decreases provider burnout; and 4) generates positive returns on investment. The formative evaluation aims to support improved care for high-risk patients at demonstration sites and to inform future initiatives for high-risk patients. The evaluation was reviewed by representatives from the VHA Office of Research and Development and the Office of Research Oversight and met criteria for quality improvement. VHA aims to function as a learning organization by rapidly implementing and rigorously testing QI innovations prior to final program or policy development. We observed challenges and opportunities in designing an evaluation consistent with QI standards and operations priorities, while also maintaining scientific rigor. This trial was retrospectively registered at ClinicalTrials.gov on April 3, 2017: NCT03100526. Protocol v1, FY14-17. Copyright © 2018 Elsevier Inc. All rights reserved.

  1. Research into Theory into Practice: An Overview of Family Based Interventions for Child Antisocial Behavior Developed at the Oregon Social Learning Center

    PubMed Central

    Fisher, Philip A.; Gilliam, Kathryn S.

    2017-01-01

    Although many psychotherapeutic approaches exist for treating troubled children and their families, not all have been evaluated to be effective through research. Moreover, among those that have been determined to be “evidence-based,” few have followed as coherent and rigorous a path of rigorous scientific investigation as the interventions that have been developed at the Oregon Social Learning Center. As such, these interventions serve as a model of “research to theory to practice” that may not only be employed to support families with children in need of treatment, but may also guide other programs of treatment development. This is the story of how this work has unfolded over the past four decades. PMID:29225459

  2. Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

    PubMed

    Schmidt, Jessica N; Kendall, John; Smalley, Courtney

    2015-11-01

    Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.

  3. The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis.

    PubMed

    Bourgeois, Isabelle; Whynot, Jane

    2018-06-01

    Evaluation recommendations are sometimes included in evaluation reports to highlight specific actions to be taken to improve a program or to make other changes to its operational context. This preliminary study sought to examine evaluation recommendations drawn from 25 evaluation reports published by Canadian federal government departments and agencies, in order to examine the evaluation issues covered and the focus of the recommendations. Our results show that in keeping with policy requirements, the evaluation recommendations focused on program relevance, effectiveness and efficiency and economy. Furthermore, a significant number of recommendations also focused on the implementation of more rigorous performance measurement strategies. The focus of the recommendations did not vary by publication date, recommendation type, and organizational sector. The findings also show that for the most part, the management responses produced as part of the broader evaluation process support the recommendations included in the report and identify specific timelines for implementation. Copyright © 2018 Elsevier Ltd. All rights reserved.

  4. Workplace wellness recognition for optimizing workplace health: a presidential advisory from the American Heart Association.

    PubMed

    Fonarow, Gregg C; Calitz, Chris; Arena, Ross; Baase, Catherine; Isaac, Fikry W; Lloyd-Jones, Donald; Peterson, Eric D; Pronk, Nico; Sanchez, Eduardo; Terry, Paul E; Volpp, Kevin G; Antman, Elliott M

    2015-05-19

    The workplace is an important setting for promoting cardiovascular health and cardiovascular disease and stroke prevention in the United States. Well-designed, comprehensive workplace wellness programs have the potential to improve cardiovascular health and to reduce mortality, morbidity, and disability resulting from cardiovascular disease and stroke. Nevertheless, widespread implementation of comprehensive workplace wellness programs is lacking, and program composition and quality vary. Several organizations provide worksite wellness recognition programs; however, there is variation in recognition criteria, and they do not specifically focus on cardiovascular disease and stroke prevention. Although there is limited evidence to suggest that company performance on employer health management scorecards is associated with favorable healthcare cost trends, these data are not currently robust, and further evaluation is needed. As a recognized national leader in evidence-based guidelines, care systems, and quality programs, the American Heart Association/American Stroke Association is uniquely positioned and committed to promoting the adoption of comprehensive workplace wellness programs, as well as improving program quality and workforce health outcomes. As part of its commitment to improve the cardiovascular health of all Americans, the American Heart Association/American Stroke Association will promote science-based best practices for comprehensive workplace wellness programs and establish benchmarks for a national workplace wellness recognition program to assist employers in applying the best systems and strategies for optimal programming. The recognition program will integrate identification of a workplace culture of health and achievement of rigorous standards for cardiovascular health based on Life's Simple 7 metrics. In addition, the American Heart Association/American Stroke Association will develop resources that assist employers in meeting these rigorous standards, facilitating access to high-quality comprehensive workplace wellness programs for both employees and dependents, and fostering innovation and additional research. © 2015 American Heart Association, Inc.

  5. Health Promotion in Small Business

    PubMed Central

    McCoy, Kira; Stinson, Kaylan; Scott, Kenneth; Tenney, Liliana; Newman, Lee S.

    2015-01-01

    Objective To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses. Methods Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study’s rigor using the WHO-adapted GRADEprofiler “quality of evidence” criteria. Results Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor. Conclusions Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs. PMID:24905421

  6. Meta-analysis of the effectiveness of school substance abuse prevention programs in Spain.

    PubMed

    Espada, José P; Gonzálvez, María T; Orgilés, Mireia; Lloret, Daniel; Guillén-Riquelme, Alejandro

    2015-01-01

    There has been an increase in adolescent substance use that has led to the development and implementation of prevention programs. New evidence is needed in order to improve them and optimize the resources. The aim of this paper is to use a meta-analysis to analyze the effectiveness of school drug prevention programs in Spain. Twenty-one studies that evaluated drug abuse prevention programs in schools, were published between 2002 and 2013, and that met the selection criteria were identified. Preventive program effectiveness was low ( d = 0.16), although it was higher at the follow-up ( d = 0.30). The programs were most effective in changing attitudes ( d = 0.44) towards drugs. The models of health education ( d = 0.48) and social learning ( d = 0.20) were also very effective, especially in combination with oral, written, and audiovisual support material ( d = 0.21) and the implementation of joint programs by health education professionals and faculty members ( d = 0.25). Is possible to determine the need for more rigorous evaluations of interventions to establish useful programs.

  7. A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

    PubMed Central

    Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

    2018-01-01

    Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

  8. The Center For Medicare And Medicaid Innovation's blueprint for rapid-cycle evaluation of new care and payment models.

    PubMed

    Shrank, William

    2013-04-01

    The Affordable Care Act established the Center for Medicare and Medicaid Innovation to test innovative payment and service delivery models. The goal is to reduce program expenditures while preserving or improving the quality of care provided to beneficiaries of Medicare, Medicaid, and the Children's Health Insurance Program. Central to the success of the Innovation Center is a new, rapid-cycle approach to evaluation. This article describes that approach--setting forth how the Rapid Cycle Evaluation Group aims to deliver frequent feedback to providers in support of continuous quality improvement, while rigorously evaluating the outcomes of each model tested. This article also describes the relationship between the group's work and that of the Office of the Actuary at the Centers for Medicare and Medicaid Services, which plays a central role in the assessment of new models.

  9. Programs and policies to assist high school dropouts in the transition to adulthood.

    PubMed

    Bloom, Dan

    2010-01-01

    Dan Bloom of MDRC examines policies and programs designed to help high school dropouts improve their educational attainment and labor market outcomes. So called "second-chance" programs, he says, have long provided some combination of education, training, employment, counseling, and social services. But the research record on their effectiveness is fairly thin, he says, and the results are mixed. Bloom describes eleven employment- or education-focused programs serving high school dropouts that have been rigorously evaluated over the past thirty years. Some relied heavily on paid work experience, while others focused more on job training or education. Some programs, especially those that offered paid work opportunities, generated significant increases in employment or earnings in the short term, but none of the studies that followed participants for more than a couple of years found lasting improvements in economic outcomes. Nevertheless, the findings provide an important foundation on which to build. Because of the high individual and social costs of ignoring high school dropouts, the argument for investing more public funds in services, systems, and research for these young people is strong. The paucity of conclusive evidence, however, makes it hard to know how to direct resources and magnifies the importance of ensuring that all new initiatives provide for rigorous evaluation of their impacts. Bloom concludes with recommendations for policy and research aimed at building on current efforts to expand and improve effective programs for dropouts while simultaneously developing and testing new approaches that might be more effective and strengthening local systems to support vulnerable young people. He stresses the importance of identifying and disseminating strategies to engage young people who are more seriously disconnected and unlikely to join programs. A recurring theme is that providing young people with opportunities for paid work may be useful both as an engagement tool and as a strategy for improving long-term labor market outcomes.

  10. House fire injury prevention update. Part II. A review of the effectiveness of preventive interventions

    PubMed Central

    Warda, L.; Tenenbein, M.; Moffatt, M.

    1999-01-01

    Objective—To evaluate and summarize the house fire injury prevention literature. Methods—MEDLINE (1983 to March 1997) was searched by keyword: fire, burn, etiology, cause, prevention, epidemiology, and smoke detector/alarm. ERIC (1966 to March 1997) and PSYCLIT (1974 to June 1997) were searched by keyword: as above, and safety, skills, education, and training. Other sources included references of retrieved publications, review articles, and books; Injury Prevention hand search; government documents; and internet sources. Sources relevant to residential fire injury prevention were selected, evaluated, and summarized. Results—Forty three publications were selected for review, including seven randomized controlled trials, nine quasiexperiments, two natural experiments, 21 prospective cohort studies, two cross sectional surveys, one case report, and one program evaluation. These studies examined the following types of interventions: school (9), preschool (1), and community based educational programs (5); fire response training programs for children (7), blind adolescents (2), and mentally retarded adults (5) and children (1); office based counseling (4); home inspection programs (3); smoke detector giveaway campaigns (5); and smoke detector legislation (1). Conclusions—This review of house fire prevention interventions underscores the importance of program evaluation. There is a need for more rigorous evaluation of educational programs, particularly those targeted at schools. An evidence based, coordinated approach to house fire injury prevention is critical, given current financial constraints and the potential for program overload for communities and schools. PMID:10518271

  11. Leveraging Rigorous Local Evaluations to Understand Contradictory Findings

    ERIC Educational Resources Information Center

    Boulay, Beth; Martin, Carlos; Zief, Susan; Granger, Robert

    2013-01-01

    Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

  12. MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES.

    PubMed

    Semple, Randye J; Droutman, Vita; Reid, Brittany Ann

    2017-01-01

    Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment , and Wellness and Resilience Program . We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations.

  13. MINDFULNESS GOES TO SCHOOL: THINGS LEARNED (SO FAR) FROM RESEARCH AND REAL-WORLD EXPERIENCES

    PubMed Central

    Semple, Randye J.; Droutman, Vita; Reid, Brittany Ann

    2016-01-01

    Mindfulness-based curricula are being implemented in K-12 schools across the nation. Many of these programs, although well-considered and implemented, have little or no research support for their effectiveness. Recognizing the paucity of published research in this area, a sampling of school-based programs currently being implemented in the schools is reviewed. The programs reviewed are Inner Explorer, Master Mind and Moment Program, Mindfulness and Mind-Body Skills for Children, Mindful Schools, Resilient Kids, Still Quiet Place, Stress Reduction and Mindfulness Curriculum and Mindful Moment, and Wellness and Resilience Program. We offer a summary of research support for each program and discussion of unpublished, mostly qualitative indicators of feasibility, acceptability, efficacy, and effectiveness. Strengths and limitations of each program are described, along with suggestions for bolstering informative and useful research. We encourage researchers, educators, and mindfulness practitioners to work collaboratively to conduct rigorous program evaluations. PMID:28458403

  14. Fifteen Years of Collaborative Innovation and Achievement: NASA Nebraska Space Grant Consortium 15-Year Program Performance and Results Report

    NASA Technical Reports Server (NTRS)

    Schaaf, Michaela M. (Editor); Bowen, Brent D.; Fink, Mary M.; Nickerson, Jocelyn S.; Avery Shelly; Calamaio, Caprice; Carstenson, Larry; Dugan, James; Farr, Lynne; Farritor, Shane

    2003-01-01

    This 15-year evaluation serves as a summary document highlighting the numerous and complete successes of the Nebraska Space Grant Program. Innovation has been highlighted through significant new endeavors during this 5-year period, such as placement of students and faculty at NASA Centers and the expansion of NSGC Native American Outreach Programs. While the last national program evaluation resulted in Nebraska s ranking as the top Capability Enhancement Consortium, and 5th best overall, Nebraska felt there was room for significant growth and development. This has been validated through the recent competitive attainment of Designated Grant status and has allowed for the exploration of new initiatives, as well as the expansion of already successful programs. A comprehensive strategic planning effort has involved all Nebraska representative entities and has guided Nebraska Space Grant through the evaluation period, providing a basis for continual advancement. Nebraska rigorously employs evaluation techniques to ensure that stated outcomes and metrics are achieved and that weaknesses are identified and corrected. With this coordinated approach, Nebraska expects that the next 5 years will yield new opportunities for significant achievement. Nebraska Space Grant will embrace new national endeavors, including the integration of Pender Public Schools -Nebraska s NASA Explorer School, geospatial initiatives, and the National Student Satellite Program.

  15. Innovation in a Learning Health Care System: Veteran-Directed Home- and Community-Based Services.

    PubMed

    Garrido, Melissa M; Allman, Richard M; Pizer, Steven D; Rudolph, James L; Thomas, Kali S; Sperber, Nina R; Van Houtven, Courtney H; Frakt, Austin B

    2017-11-01

    A path-breaking example of the interplay between geriatrics and learning healthcare systems is the Veterans Health Administration's (VHA's) planned roll-out of a program for providing participant-directed home- and community-based services to veterans with cognitive and functional limitations. We describe the design of a large-scale, stepped-wedge, cluster-randomized trial of the Veteran-Directed Home- and Community-Based Services (VD-HCBS) program. From March 2017 through December 2019, up to 77 Veterans Affairs Medical Centers will be randomized to times to begin offering VD-HCBS to veterans at risk of nursing home placement. Services will be provided to community-dwelling participants with support from Aging and Disability Network Agencies. The VHA Partnered Evidence-based Policy Resource Center (PEPReC) is coordinating the evaluation, which includes collaboration from operational stakeholders from the VHA and Administration for Community Living and interdisciplinary researchers from the Center of Innovation in Long-Term Services and Supports and the Center for Health Services Research in Primary Care. For older veterans with functional limitations who are eligible for VD-HCBS, we will evaluate health outcomes (hospitalizations, emergency department visits, nursing home admissions, days at home) and healthcare costs associated with VD-HCBS availability. Learning healthcare systems facilitate diffusion of innovation while enabling rigorous evaluation of effects on patient outcomes. The VHA's randomized rollout of VD-HCBS to veterans at risk of nursing home placement is an example of how to achieve these goals simultaneously. PEPReC's experience designing an evaluation with researchers and operations stakeholders may serve as a framework for others seeking to develop rapid, rigorous, large-scale evaluations of delivery system innovations targeted to older adults. © 2017, Copyright the Authors Journal compilation © 2017, The American Geriatrics Society.

  16. Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

    PubMed

    Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

    2015-01-01

    US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.

  17. Education and social inclusion of people with disabilities in five countries in West Africa: a literature review.

    PubMed

    Jolley, Emma; Lynch, Paul; Virendrakumar, Bhavisha; Rowe, Stacy; Schmidt, Elena

    2017-07-14

    An estimated 1 billion people worldwide live with some form of disability. With the adoption of the Sustainable Development Goals and the "Leave no one behind" agenda, there is a global momentum to ensure that disadvantaged groups, not least people with disabilities, are included and accounted for, in mainstream development efforts. However, in many low-income settings little is known about disability and the policies and programs in place to improve the lives of those affected. This literature review describes the extent and quality of published and unpublished literature on education and social inclusion of people with disabilities in five West African countries: Cameroon, Liberia, Mali, Sierra Leone and Senegal. Fifty-four unique documents met inclusion criteria of the review and described related policy and legislation; national and international stakeholders; intervention programs and primary research related to disability and inclusion. The majority of documents were from Sierra Leone (19); and four described more than one country. Primary research included mainly qualitative studies and cross-sectional surveys; 33 sources were critically appraised with the majority being attributed unclear risk of bias (20). The findings call for (i) standardized tools for monitoring the implementation of programs and policies at national level; (ii) improved stakeholder coordination mechanisms; (iii) development and adoption of coordinated approaches to measuring disability and social exclusion; (iv) rigorous evaluations of the effectiveness of disability programs and (v) disaggregation of routine data by disability. Implication for Rehabilitation There is a need for standardized tools for monitoring the implementation of programs and policies at national level. Countries that have not yet ratified the UNCRPD or the protocol should be supported to do so. Stakeholder coordination mechanisms need to be improved. Improved coordination between stakeholders involved in disability at the country level could help improve the quality of services delivered. Development and adoption of coordinated approaches is key to measuring disability and social exclusion. There are few, if any, rigorous evaluation of the effectiveness of disability-specific evaluations in the five countries. There is a need for disaggregation of routine data from development programs by disability to inform implementation.

  18. Do men need empowering too? A systematic review of entrepreneurial education and microenterprise development on health disparities among inner-city black male youth.

    PubMed

    Jennings, Larissa

    2014-10-01

    Economic strengthening through entrepreneurial and microenterprise development has been shown to mitigate poverty-based health disparities in developing countries. Yet, little is known regarding the impact of similar approaches on disadvantaged U.S. populations, particularly inner-city African-American male youth disproportionately affected by poverty, unemployment, and adverse health outcomes. A systematic literature review was conducted to guide programming and research in this area. Eligible studies were those published in English from 2003 to 2014 which evaluated an entrepreneurial and microenterprise initiative targeting inner-city youth, aged 15 to 24, and which did not exclude male participants. Peer-reviewed publications were identified from two electronic bibliographic databases. A manual search was conducted among web-based gray literature and registered trials not yet published. Among the 26 papers retrieved for review, six met the inclusion criteria and were retained for analysis. None of the 16 registered microenterprise trials were being conducted among disadvantaged populations in the U.S. The available literature suggests that entrepreneurial and microenterprise programs can positively impact youth's economic and psychosocial functioning and result in healthier decision-making. Young black men specifically benefited from increased autonomy, engagement, and risk avoidance. However, such programs are vastly underutilized among U.S. minority youth, and the current evidence is insufficiently descriptive or rigorous to draw definitive conclusions. Many programs described challenges in securing adequate resources, recruiting minority male youth, and sustaining community buy-in. There is an urgent need to increase implementation and evaluation efforts, using innovative and rigorous designs, to improve the low status of greater numbers of African-American male youth.

  19. Is voluntary certification of tropical agricultural commodities achieving sustainability goals for small-scale producers? A review of the evidence

    NASA Astrophysics Data System (ADS)

    DeFries, Ruth S.; Fanzo, Jessica; Mondal, Pinki; Remans, Roseline; Wood, Stephen A.

    2017-03-01

    Over the last several decades, voluntary certification programs have become a key approach to promote sustainable supply chains for agricultural commodities. These programs provide premiums and other benefits to producers for adhering to environmental and labor practices established by the certifying entities. Following the principles of Cochrane Reviews used in health sciences, we assess evidence to evaluate whether voluntary certification of tropical agricultural commodities (bananas, cocoa, coffee, oil palm, and tea) has achieved environmental benefits and improved economic and social outcomes for small-scale producers at the level of the farm household. We reviewed over 2600 papers in the peer-review literature and identified 24 cases of unique combinations of study area, certification program, and commodity in 16 papers that rigorously analyzed differences between treatment (certified households) and control groups (uncertified households) for a wide range of response variables. Based on analysis of 347 response variables reported in these papers, we conclude that certification is associated on average with positive outcomes for 34% of response variables, no significant difference for 58% of variables, and negative outcomes for 8% of variables. No significant differences were observed for different categories of responses (environmental, economic and social) or for different commodities (banana, coffee and tea), except negative outcomes were significantly less for environmental than other outcome categories (p = 0.01). Most cases (20 out of 24) investigated coffee certification and response variables were inconsistent across cases, indicating the paucity of studies to conduct a conclusive meta-analysis. The somewhat positive results indicate that voluntary certification programs can sometimes play a role in meeting sustainable development goals and do not support the view that such programs are merely greenwashing. However, results also indicate that certification is not a panacea to improve social outcomes or overall incomes of smallholder farmers. Rigorous analysis, standardized criteria, and independent evaluation are needed to assess effectiveness of certification programs in the future.

  20. Adult asthma disease management: an analysis of studies, approaches, outcomes, and methods.

    PubMed

    Maciejewski, Matthew L; Chen, Shih-Yin; Au, David H

    2009-07-01

    Disease management has been implemented for patients with asthma in various ways. We describe the approaches to and components of adult asthma disease-management interventions, examine the outcomes evaluated, and assess the quality of published studies. We searched the MEDLINE, EMBASE, CINAHL, PsychInfo, and Cochrane databases for studies published in 1986 through 2008, on adult asthma management. With the studies that met our inclusion criteria, we examined the clinical, process, medication, economic, and patient-reported outcomes reported, and the study designs, provider collaboration during the studies, and statistical methods. Twenty-nine articles describing 27 studies satisfied our inclusion criteria. There was great variation in the content, extent of collaboration between physician and non-physician providers responsible for intervention delivery, and outcomes examined across the 27 studies. Because of limitations in the design of 22 of the 27 studies, the differences in outcomes assessed, and the lack of rigorous statistical adjustment, we could not draw definitive conclusions about the effectiveness or cost-effectiveness of the asthma disease-management programs or which approach was most effective. Few well-designed studies with rigorous evaluations have been conducted to evaluate disease-management interventions for adults with asthma. Current evidence is insufficient to recommend any particular intervention.

  1. Designing an evaluation for a multiple-strategy community intervention: the North Coast Stay on Your Feet program.

    PubMed

    van Beurden, E; Kempton, A; Sladden, T; Garner, E

    1998-02-01

    Evaluation of the North Coast Stay on Your Feet falls prevention program is described as a case study of a comprehensive evaluation design for multi-strategic community interventions. Qualitative and quantitative methods were used to evaluate the program at formative, process and outcome levels. Formative evaluation used literature review, focus groups, mail-out and telephone survey methods to gather evidence from publications, older people, health workers, local business, media and government bodies. It included an analysis of demographic and hospital databases and identified incidence, causal pathways, knowledge, attitudes, behaviour, consequences and effectiveness of potential strategies. Process evaluation employed auditing, monitoring and telephone surveys to maintain an inventory of intervention activities and to track the reach of the program. Outcome evaluation involved a longitudinal study of intervention and control cohorts, surveyed before, during and after the intervention by telephone to monitor changes in knowledge, attitudes, risk and falls incidence. The survey instrument was designed for both formative and outcome evaluation, and analysis reflected the research design by incorporating repeat measures and adjusting for bias and confounding. Outcome validity was cross-checked via hospital admission rates. A novel, integrated framework for presenting inputs, activities and outcomes from all stages of the program is described. This framework facilitated feedback to stakeholders and enabled subsequent rapid adjustment of the intervention. Rigorous evaluation combined with clear presentation of findings helped to engender intersectoral support and obtain funding grants for extended implementation and evaluation. It also helped Stay on Your Feet to become a model for other falls prevention programs within Australia and internationally.

  2. The COMPASS study: a longitudinal hierarchical research platform for evaluating natural experiments related to changes in school-level programs, policies and built environment resources.

    PubMed

    Leatherdale, Scott T; Brown, K Stephen; Carson, Valerie; Childs, Ruth A; Dubin, Joel A; Elliott, Susan J; Faulkner, Guy; Hammond, David; Manske, Steve; Sabiston, Catherine M; Laxer, Rachel E; Bredin, Chad; Thompson-Haile, Audra

    2014-04-08

    Few researchers have the data required to adequately understand how the school environment impacts youth health behaviour development over time. COMPASS is a prospective cohort study designed to annually collect hierarchical longitudinal data from a sample of 90 secondary schools and the 50,000+ grade 9 to 12 students attending those schools. COMPASS uses a rigorous quasi-experimental design to evaluate how changes in school programs, policies, and/or built environment (BE) characteristics are related to changes in multiple youth health behaviours and outcomes over time. These data will allow for the quasi-experimental evaluation of natural experiments that will occur within schools over the course of COMPASS, providing a means for generating "practice based evidence" in school-based prevention programming. COMPASS is the first study with the infrastructure to robustly evaluate the impact that changes in multiple school-level programs, policies, and BE characteristics within or surrounding a school might have on multiple youth health behaviours or outcomes over time. COMPASS will provide valuable new insight for planning, tailoring and targeting of school-based prevention initiatives where they are most likely to have impact.

  3. The efficacy of interventions to reduce adolescent childbearing in low- and middle-income countries: a systematic review.

    PubMed

    McQueston, Kate; Silverman, Rachel; Glassman, Amanda

    2013-12-01

    This study reviews the scope and quality of existing literature regarding the interventions to reduce adolescent childbearing in low- and middle-income countries and compiles findings concerning their effectiveness. A total of 737 studies published between 2000 and 2011 were reviewed; 19 were identified as meeting eligibility criteria. Studies were included that: evaluated program effects on adolescents and young people, either as the primary target population or as a subset of a broader target group; evaluated an intervention intended to reduce adolescent fertility or generate improvements on a related outcome; and reported childbearing-related outcomes. Evidence indicates that a variety of interventions may be successful at reducing fertility, including school-based programs, health counseling, and cash transfers. An overview of evaluation efforts to date is provided, and potential best practices are highlighted. Conclusions are that funding for adolescent fertility initiatives should be directed toward programs for which a sound evidence base exists, such as cash transfers or other interventions that encourage school enrollment, and that programs of unknown effectiveness should be conducted in tandem with rigorous evaluation. © 2013 The Population Council, Inc.

  4. Excellence in Physics Education Award Talk: Evolving Evaluation and Evidence

    NASA Astrophysics Data System (ADS)

    Matsler, Karen

    2011-04-01

    AAPT/PTRA institutes were part of the first NSF projects encouraged to design rigorous evaluations to determine the characteristic of effective professional development. The evaluation of the AAPT/PTRA program has evolved from documenting the number of teachers attending daily workshops to documenting gains in content understanding and confidence by conducting comparison study groups for over 30 institutes across the nation. Components of the current AAPT/PTRA evaluation model include documentation of teacher gains in content understanding, confidence, use of technology, changes in classroom practice, and student achievement. This talk will reflect on the evaluation components, the inherent challenges, components that were successful, and lessons learned. Results of the data collected on over 1000 teachers since 2003 will be shared.

  5. The MIXED framework: A novel approach to evaluating mixed-methods rigor.

    PubMed

    Eckhardt, Ann L; DeVon, Holli A

    2017-10-01

    Evaluation of rigor in mixed-methods (MM) research is a persistent challenge due to the combination of inconsistent philosophical paradigms, the use of multiple research methods which require different skill sets, and the need to combine research at different points in the research process. Researchers have proposed a variety of ways to thoroughly evaluate MM research, but each method fails to provide a framework that is useful for the consumer of research. In contrast, the MIXED framework is meant to bridge the gap between an academic exercise and practical assessment of a published work. The MIXED framework (methods, inference, expertise, evaluation, and design) borrows from previously published frameworks to create a useful tool for the evaluation of a published study. The MIXED framework uses an experimental eight-item scale that allows for comprehensive integrated assessment of MM rigor in published manuscripts. Mixed methods are becoming increasingly prevalent in nursing and healthcare research requiring researchers and consumers to address issues unique to MM such as evaluation of rigor. © 2017 John Wiley & Sons Ltd.

  6. Motivation for Evaluation: A roadmap for Improving Program Efficacy

    NASA Astrophysics Data System (ADS)

    Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

    2016-12-01

    Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.

  7. Space radiator simulation manual for computer code

    NASA Technical Reports Server (NTRS)

    Black, W. Z.; Wulff, W.

    1972-01-01

    A computer program that simulates the performance of a space radiator is presented. The program basically consists of a rigorous analysis which analyzes a symmetrical fin panel and an approximate analysis that predicts system characteristics for cases of non-symmetrical operation. The rigorous analysis accounts for both transient and steady state performance including aerodynamic and radiant heating of the radiator system. The approximate analysis considers only steady state operation with no aerodynamic heating. A description of the radiator system and instructions to the user for program operation is included. The input required for the execution of all program options is described. Several examples of program output are contained in this section. Sample output includes the radiator performance during ascent, reentry and orbit.

  8. Evaluating Rigor in Qualitative Methodology and Research Dissemination

    ERIC Educational Resources Information Center

    Trainor, Audrey A.; Graue, Elizabeth

    2014-01-01

    Despite previous and successful attempts to outline general criteria for rigor, researchers in special education have debated the application of rigor criteria, the significance or importance of small n research, the purpose of interpretivist approaches, and the generalizability of qualitative empirical results. Adding to these complications, the…

  9. Outcomes of a Suicide Prevention Gatekeeper Training Program Among School Personnel.

    PubMed

    Lamis, Dorian A; Underwood, Maureen; D'Amore, Nicole

    2017-03-01

    Gatekeeper suicide prevention programs train staff to increase the identification and referral of suicidal individuals to the appropriate resources. We evaluated Act on FACTS: Making Educators Partners in Youth Suicide Prevention (MEP), which is an online training program designed to enhance the knowledge of suicide risk factors and warning signs as well as improve participants' attitudes and self-efficacy/confidence. School personnel (N = 700) completed a survey administered before and immediately after the training to assess gains in training outcomes and to evaluate participants' satisfaction with the training. Results indicated that MEP participants demonstrated significant increases in suicide knowledge, attitudes, and self-efficacy. Moreover, exploratory analyses revealed moderating effects of professional role on pre-/posttest changes in self-efficacy, but not suicide knowledge or attitudes. Specifically, guidance counselors demonstrated significantly smaller increases in self-efficacy/confidence compared with teachers and classroom aids, whereas teachers demonstrated significantly larger increases in self-efficacy/confidence compared with administrators. The majority of school personnel who completed the MEP program were satisfied with the training content and experience. Although the current findings are promising, more rigorous evaluations employing randomized controlled research designs are warranted to adequately determine the effectiveness of the MEP program.

  10. Program evaluation of remote heart failure monitoring: healthcare utilization analysis in a rural regional medical center.

    PubMed

    Riley, William T; Keberlein, Pamela; Sorenson, Gigi; Mohler, Sailor; Tye, Blake; Ramirez, A Susana; Carroll, Mark

    2015-03-01

    Remote monitoring for heart failure (HF) has had mixed and heterogeneous effects across studies, necessitating further evaluation of remote monitoring systems within specific healthcare systems and their patient populations. "Care Beyond Walls and Wires," a wireless remote monitoring program to facilitate patient and care team co-management of HF patients, served by a rural regional medical center, provided the opportunity to evaluate the effects of this program on healthcare utilization. Fifty HF patients admitted to Flagstaff Medical Center (Flagstaff, AZ) participated in the project. Many of these patients lived in underserved and rural communities, including Native American reservations. Enrolled patients received mobile, broadband-enabled remote monitoring devices. A matched cohort was identified for comparison. HF patients enrolled in this program showed substantial and statistically significant reductions in healthcare utilization during the 6 months following enrollment, and these reductions were significantly greater compared with those who declined to participate but not when compared with a matched cohort. The findings from this project indicate that a remote HF monitoring program can be successfully implemented in a rural, underserved area. Reductions in healthcare utilization were observed among program participants, but reductions were also observed among a matched cohort, illustrating the need for rigorous assessment of the effects of HF remote monitoring programs in healthcare systems.

  11. Automatic Estimation of Verified Floating-Point Round-Off Errors via Static Analysis

    NASA Technical Reports Server (NTRS)

    Moscato, Mariano; Titolo, Laura; Dutle, Aaron; Munoz, Cesar A.

    2017-01-01

    This paper introduces a static analysis technique for computing formally verified round-off error bounds of floating-point functional expressions. The technique is based on a denotational semantics that computes a symbolic estimation of floating-point round-o errors along with a proof certificate that ensures its correctness. The symbolic estimation can be evaluated on concrete inputs using rigorous enclosure methods to produce formally verified numerical error bounds. The proposed technique is implemented in the prototype research tool PRECiSA (Program Round-o Error Certifier via Static Analysis) and used in the verification of floating-point programs of interest to NASA.

  12. Evaluated community fire safety interventions in the United States: a review of current literature.

    PubMed

    Ta, Van M; Frattaroli, Shannon; Bergen, Gwendolyn; Gielen, Andrea Carlson

    2006-06-01

    The purpose of the study was to assess the state of fire prevention research, provide an updated synthesis of evaluated fire prevention programs, and discuss the role of fire fighters and data systems in prevention efforts. The review included all evaluations of U.S. based fire prevention interventions published between January 1998 and September 2004 and any earlier articles about U.S. fire prevention interventions not included in two prior review articles. We retrieved information from each identified study including evaluation findings, involvement of fire service personnel and use of existing data systems. We identified twelve articles: seven reported on smoke alarm interventions, three on multi-faceted programs, and two other programs. Five programs involved fire service personnel in the design, implementation, and/or evaluation, and three used existing data systems. Studies reviewed suggest that canvassing and smoke alarm installations are the most effective means of distributing alarms and increasing the functional status of distributed alarms. The functionality of smoke alarms, an issue noted in earlier reviews, remains a problem. Programs involving partnerships with fire departments have indicated success in preventing fires and deaths, improving smoke alarm ownership and functional status, and improving children's fire safety knowledge. Using existing data systems to target and to evaluate interventions was effective. In the years since prior reviews, some improvements in the rigor of evaluation designs have been made, but there is still a need for high quality evaluations that will inform fire injury prevention efforts.

  13. Experimental evaluation of rigor mortis. V. Effect of various temperatures on the evolution of rigor mortis.

    PubMed

    Krompecher, T

    1981-01-01

    Objective measurements were carried out to study the evolution of rigor mortis on rats at various temperatures. Our experiments showed that: (1) at 6 degrees C rigor mortis reaches full development between 48 and 60 hours post mortem, and is resolved at 168 hours post mortem; (2) at 24 degrees C rigor mortis reaches full development at 5 hours post mortem, and is resolved at 16 hours post mortem; (3) at 37 degrees C rigor mortis reaches full development at 3 hours post mortem, and is resolved at 6 hours post mortem; (4) the intensity of rigor mortis grows with increase in temperature (difference between values obtained at 24 degrees C and 37 degrees C); and (5) and 6 degrees C a "cold rigidity" was found, in addition to and independent of rigor mortis.

  14. Systemic Planning: An Annotated Bibliography and Literature Guide. Exchange Bibliography No. 91.

    ERIC Educational Resources Information Center

    Catanese, Anthony James

    Systemic planning is an operational approach to using scientific rigor and qualitative judgment in a complementary manner. It integrates rigorous techniques and methods from systems analysis, cybernetics, decision theory, and work programing. The annotated reference sources in this bibliography include those works that have been most influential…

  15. Identification and validation of nebulized aerosol devices for sputum induction

    PubMed Central

    Davidson, Warren J; Dennis, John; The, Stephanie; Litoski, Belinda; Pieron, Cora; Leigh, Richard

    2014-01-01

    Induced sputum cell count measurement has proven reliability for evaluating airway inflammation in patients with asthma and other airway diseases. Although the use of nebulizer devices for sputum induction is commonplace, they are generally labelled as single-patient devices by the manufacturer and, therefore, cannot be used for multiple patients in large clinical sputum induction programs due to infect ion-control requirements. Accordingly, this study investigated the aerosol characteristics of alternative devices that could be used in such programs. BACKGROUND: Induced sputum cell counts are a noninvasive and reliable method for evaluating the presence, type and degree of airway inflammation in patients with asthma. Currently, standard nebulizer devices used for sputum induction in multiple patients are labelled as single-patient devices by the manufacturer, which conflicts with infection prevention and control requirements. As such, these devices cannot feasibly be used in a clinical sputum induction program. Therefore, there is a need to identify alternative nebulizer devices that are either disposable or labelled for multi-patient use. OBJECTIVE: To apply validated rigorous, scientific testing methods to identify and validate commercially available nebulizer devices appropriate for use in a clinical sputum induction program. METHODS: Measurement of nebulized aerosol output and size for the selected nebulizer designs followed robust International Organization for Standardization methods. Sputum induction using two of these nebulizers was successfully performed on 10 healthy adult subjects. The cytotechnologist performing sputum cell counts was blinded to the type of nebulizer used. RESULTS: The studied nebulizers had variable aerosol outputs. The AeroNeb Solo (Aerogen, Ireland), Omron NE-U17 (Omron, Japan) and EASYneb II (Flaem Nuova, Italy) systems were found to have similar measurements of aerosol size. There was no significant difference in induced sputum cell results between the AeroNeb Solo and EASYneb II devices. DISCUSSION: There is a need for rigorous, scientific evaluation of nebulizer devices for clinical applications, including sputum induction, for measurement of cell counts. CONCLUSION: The present study was the most comprehensive analysis of different nebulizer devices for sputum induction to measure cell counts, and provides a framework for appropriate evaluation of nebulizer devices for induced sputum testing. PMID:24288700

  16. Methodological Considerations for Use of Routine Health Information System Data to Evaluate Malaria Program Impact in an Era of Declining Malaria Transmission

    PubMed Central

    Ashton, Ruth A.; Bennett, Adam; Yukich, Joshua; Bhattarai, Achuyt; Keating, Joseph; Eisele, Thomas P.

    2017-01-01

    Abstract. Coverage of malaria control interventions is increasing dramatically across endemic countries. Evaluating the impact of malaria control programs and specific interventions on health indicators is essential to enable countries to select the most effective and appropriate combination of tools to accelerate progress or proceed toward malaria elimination. When key malaria interventions have been proven effective under controlled settings, further evaluations of the impact of the intervention using randomized approaches may not be appropriate or ethical. Alternatives to randomized controlled trials are therefore required for rigorous evaluation under conditions of routine program delivery. Routine health management information system (HMIS) data are a potentially rich source of data for impact evaluation, but have been underused in impact evaluation due to concerns over internal validity, completeness, and potential bias in estimates of program or intervention impact. A range of methodologies were identified that have been used for impact evaluations with malaria outcome indicators generated from HMIS data. Methods used to maximize internal validity of HMIS data are presented, together with recommendations on reducing bias in impact estimates. Interrupted time series and dose-response analyses are proposed as the strongest quasi-experimental impact evaluation designs for analysis of malaria outcome indicators from routine HMIS data. Interrupted time series analysis compares the outcome trend and level before and after the introduction of an intervention, set of interventions or program. The dose-response national platform approach explores associations between intervention coverage or program intensity and the outcome at a subnational (district or health facility catchment) level. PMID:28990915

  17. Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

    PubMed

    McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

    2012-10-01

    To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management of the program.

  18. Evaluate styrene production

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Hagopian, C.R.; Lewis, P.J.; McDonald, J.J.

    1983-02-01

    Improvements and innovations in styrene production since 1966 are outlined. Rigorous process models are attributed to the changes. Such models are used to evaluate the effects of changing raw material costs, utility costs, and available catalyst choices. The process model can also evaluate the best operating configuration and catalyst choice for a plant. All specified innovations are incorporated in the Mobil/Badger ethylbenzene and the Cosden/Badger styrene processes (both of which are schematicized). Badger's training programs are reviewed. Badger's Styrenics Business Team converts information into plant design basis. A reaction model with input derived from isothermal and adiabatic pilot plant unitsmore » is at the heart of complete computer simulation of ethylbenzene and styrene processes.« less

  19. Empowerment evaluation: An approach that has literally altered the landscape of evaluation.

    PubMed

    Donaldson, Stewart I

    2017-08-01

    The quest for credible and actionable evidence to improve decision making, foster improvement, enhance self-determination, and promote social betterment is now a global phenomenon. Evaluation theorists and practitioners alike have responded to and overcome the challenges that limited the effectiveness and usefulness of traditional evaluation approaches primarily focused on seeking rigorous scientific knowledge about social programs and policies. No modern evaluation approach has received a more robust welcome from stakeholders across the globe than empowerment evaluation. Empowerment evaluation has been a leader in the development of stakeholder involvement approaches to evaluation, setting a high bar. In addition, empowerment evaluation's respect for community knowledge and commitment to the people's right to build their own evaluation capacity has influenced the evaluation mainstream, particularly concerning evaluation capacity building. Empowerment evaluation's most significant contributions to the field have been to improving evaluation use and knowledge utilization. Copyright © 2016. Published by Elsevier Ltd.

  20. Designing cost effective water demand management programs in Australia.

    PubMed

    White, S B; Fane, S A

    2002-01-01

    This paper describes recent experience with integrated resource planning (IRP) and the application of least cost planning (LCP) for the evaluation of demand management strategies in urban water. Two Australian case studies, Sydney and Northern New South Wales (NSW) are used in illustration. LCP can determine the most cost effective means of providing water services or alternatively the cheapest forms of water conservation. LCP contrasts to a traditional approach of evaluation which looks only at means of increasing supply. Detailed investigation of water usage, known as end-use analysis, is required for LCP. End-use analysis allows both rigorous demand forecasting, and the development and evaluation of conservation strategies. Strategies include education campaigns, increasing water use efficiency and promoting wastewater reuse or rainwater tanks. The optimal mix of conservation strategies and conventional capacity expansion is identified based on levelised unit cost. IRP uses LCP in the iterative process, evaluating and assessing options, investing in selected options, measuring the results, and then re-evaluating options. Key to this process is the design of cost effective demand management programs. IRP however includes a range of parameters beyond least economic cost in the planning process and program designs, including uncertainty, benefit partitioning and implementation considerations.

  1. Experimental evaluation of rigor mortis. VI. Effect of various causes of death on the evolution of rigor mortis.

    PubMed

    Krompecher, T; Bergerioux, C; Brandt-Casadevall, C; Gujer, H R

    1983-07-01

    The evolution of rigor mortis was studied in cases of nitrogen asphyxia, drowning and strangulation, as well as in fatal intoxications due to strychnine, carbon monoxide and curariform drugs, using a modified method of measurement. Our experiments demonstrated that: (1) Strychnine intoxication hastens the onset and passing of rigor mortis. (2) CO intoxication delays the resolution of rigor mortis. (3) The intensity of rigor may vary depending upon the cause of death. (4) If the stage of rigidity is to be used to estimate the time of death, it is necessary: (a) to perform a succession of objective measurements of rigor mortis intensity; and (b) to verify the eventual presence of factors that could play a role in the modification of its development.

  2. Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

    PubMed

    Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

    2018-03-01

    The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

  3. Stakeholders' Perspectives About and Priorities for Economic Evaluation of Health and Safety Programs in Healthcare.

    PubMed

    Tompa, Emile; de Boer, Henriette; Macdonald, Sara; Alamgir, Hasanat; Koehoorn, Mieke; Guzman, Jaime

    2016-04-01

    This study identified and prioritized resources and outcomes that should be considered in more comprehensive and scientifically rigorous health and safety economic evaluations according to healthcare sector stakeholders. A literature review and stakeholder interviews identified candidate resources and outcomes and then a Delphi panel ranked them. According to the panel, the top five resources were (a) health and safety staff time; (b) training workers; (c) program planning, promotion, and evaluation costs; (d) equipment purchases and upgrades; and (e) administration costs. The top five outcomes were (a) number of injuries, illnesses, and general sickness absences; (b) safety climate; (c) days lost due to injuries, illnesses, and general sickness absences; (d) job satisfaction and engagement; and (e) quality of care and patient safety. These findings emphasize stakeholders' stated priorities and are useful as a benchmark for assessing the quality of health and safety economic evaluations and the comprehensiveness of these findings. © 2016 The Author(s).

  4. When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments.

    PubMed

    Cook, David A; Kuper, Ayelet; Hatala, Rose; Ginsburg, Shiphra

    2016-10-01

    Quantitative scores fail to capture all important features of learner performance. This awareness has led to increased use of qualitative data when assessing health professionals. Yet the use of qualitative assessments is hampered by incomplete understanding of their role in forming judgments, and lack of consensus in how to appraise the rigor of judgments therein derived. The authors articulate the role of qualitative assessment as part of a comprehensive program of assessment, and translate the concept of validity to apply to judgments arising from qualitative assessments. They first identify standards for rigor in qualitative research, and then use two contemporary assessment validity frameworks to reorganize these standards for application to qualitative assessment.Standards for rigor in qualitative research include responsiveness, reflexivity, purposive sampling, thick description, triangulation, transparency, and transferability. These standards can be reframed using Messick's five sources of validity evidence (content, response process, internal structure, relationships with other variables, and consequences) and Kane's four inferences in validation (scoring, generalization, extrapolation, and implications). Evidence can be collected and evaluated for each evidence source or inference. The authors illustrate this approach using published research on learning portfolios.The authors advocate a "methods-neutral" approach to assessment, in which a clearly stated purpose determines the nature of and approach to data collection and analysis. Increased use of qualitative assessments will necessitate more rigorous judgments of the defensibility (validity) of inferences and decisions. Evidence should be strategically sought to inform a coherent validity argument.

  5. [A new formula for the measurement of rigor mortis: the determination of the FRR-index (author's transl)].

    PubMed

    Forster, B; Ropohl, D; Raule, P

    1977-07-05

    The manual examination of rigor mortis as currently used and its often subjective evaluation frequently produced highly incorrect deductions. It is therefore desirable that such inaccuracies should be replaced by the objective measuring of rigor mortis at the extremities. To that purpose a method is described which can also be applied in on-the-spot investigations and a new formula for the determination of rigor mortis--indices (FRR) is introduced.

  6. Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

    PubMed

    Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

    2016-10-01

    Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

  7. Grading Rigor in Counselor Education: A Specifications Grading Framework

    ERIC Educational Resources Information Center

    Bonner, Matthew W.

    2016-01-01

    According to accreditation and professional bodies, evaluation and grading are a high priority in counselor education. Specifications grading, an evaluative tool, can be used to increase grading rigor. This article describes the components of specifications grading and applies the framework of specifications grading to a counseling theories course.

  8. Improving Education in Developing Countries: Lessons From Rigorous Impact Evaluations

    ERIC Educational Resources Information Center

    Ganimian, Alejandro J.; Murnane, Richard J.

    2016-01-01

    In this article, we reviewed and interpreted the evidence from 223 rigorous impact evaluations of educational initiatives conducted in 56 low- and middle-income countries. We considered for inclusion in our review all studies in recent syntheses that have reached seemingly conflicting conclusions about which interventions improve educational…

  9. Bringing scientific rigor to community-developed programs in Hong Kong.

    PubMed

    Fabrizio, Cecilia S; Hirschmann, Malia R; Lam, Tai Hing; Cheung, Teresa; Pang, Irene; Chan, Sophia; Stewart, Sunita M

    2012-12-31

    This paper describes efforts to generate evidence for community-developed programs to enhance family relationships in the Chinese culture of Hong Kong, within the framework of community-based participatory research (CBPR). The CBPR framework was applied to help maximize the development of the intervention and the public health impact of the studies, while enhancing the capabilities of the social service sector partners. Four academic-community research teams explored the process of designing and implementing randomized controlled trials in the community. In addition to the expected cultural barriers between teams of academics and community practitioners, with their different outlooks, concerns and languages, the team navigated issues in utilizing the principles of CBPR unique to this Chinese culture. Eventually the team developed tools for adaptation, such as an emphasis on building the relationship while respecting role delineation and an iterative process of defining the non-negotiable parameters of research design while maintaining scientific rigor. Lessons learned include the risk of underemphasizing the size of the operational and skills shift between usual agency practices and research studies, the importance of minimizing non-negotiable parameters in implementing rigorous research designs in the community, and the need to view community capacity enhancement as a long term process. The four pilot studies under the FAMILY Project demonstrated that nuanced design adaptations, such as wait list controls and shorter assessments, better served the needs of the community and led to the successful development and vigorous evaluation of a series of preventive, family-oriented interventions in the Chinese culture of Hong Kong.

  10. Developments in REDES: The rocket engine design expert system

    NASA Technical Reports Server (NTRS)

    Davidian, Kenneth O.

    1990-01-01

    The Rocket Engine Design Expert System (REDES) is being developed at the NASA-Lewis to collect, automate, and perpetuate the existing expertise of performing a comprehensive rocket engine analysis and design. Currently, REDES uses the rigorous JANNAF methodology to analyze the performance of the thrust chamber and perform computational studies of liquid rocket engine problems. The following computer codes were included in REDES: a gas properties program named GASP, a nozzle design program named RAO, a regenerative cooling channel performance evaluation code named RTE, and the JANNAF standard liquid rocket engine performance prediction code TDK (including performance evaluation modules ODE, ODK, TDE, TDK, and BLM). Computational analyses are being conducted by REDES to provide solutions to liquid rocket engine thrust chamber problems. REDES is built in the Knowledge Engineering Environment (KEE) expert system shell and runs on a Sun 4/110 computer.

  11. Developments in REDES: The Rocket Engine Design Expert System

    NASA Technical Reports Server (NTRS)

    Davidian, Kenneth O.

    1990-01-01

    The Rocket Engine Design Expert System (REDES) was developed at NASA-Lewis to collect, automate, and perpetuate the existing expertise of performing a comprehensive rocket engine analysis and design. Currently, REDES uses the rigorous JANNAF methodology to analyze the performance of the thrust chamber and perform computational studies of liquid rocket engine problems. The following computer codes were included in REDES: a gas properties program named GASP; a nozzle design program named RAO; a regenerative cooling channel performance evaluation code named RTE; and the JANNAF standard liquid rocket engine performance prediction code TDK (including performance evaluation modules ODE, ODK, TDE, TDK, and BLM). Computational analyses are being conducted by REDES to provide solutions to liquid rocket engine thrust chamber problems. REDES was built in the Knowledge Engineering Environment (KEE) expert system shell and runs on a Sun 4/110 computer.

  12. Using Data to Effectively Manage a National Screening Program

    PubMed Central

    Yancy, Brandie; Royalty, Janet E.; Marroulis, Steve; Mattingly, Cindy; Benard, Vicki B.; DeGroff, Amy

    2015-01-01

    The National Breast and Cervical Cancer Early Detection Program (NBCCEDP) of the Centers for Disease Control and Prevention (CDC) is implemented through cooperative agreements with state health departments, US territories, and tribal health organizations (grantees). Grantees typically contract with clinicians and other providers to deliver breast and cervical cancer screening and diagnostic services. As required by the CDC, grantees report biannually a subset of patient and clinical level program data known as the Minimum Data Elements. Rigorous processes are in place to ensure the completeness and quality of program data collection. In this article, the authors describe the NBCCEDP data-collection processes and data management system and discusses how data are used for 1) program monitoring and improvement, 2) evaluation and research, and 3) policy development and analysis. They also provide 2 examples of how grantees use data to improve their performance. PMID:25099900

  13. Self-management programs for Aboriginal and Torres Strait Islander Peoples with chronic conditions: A rapid review.

    PubMed

    Moore, Ellie; Lawn, Sharon; Oster, Candice; Morello, Andrea

    2017-01-01

    Objectives Review the evidence for the effectiveness of chronic condition self-management programs applied to Aboriginal and Torres Strait Islander Peoples. Methods A rapid review methodology was followed to develop an evidence summary from peer-reviewed and grey literature. Results Only seven peer-reviewed studies were identified. The evidence indicated that group programs, particularly the Stanford Program, and structured individual chronic condition self-management programs were of good quality for Aboriginal and Torres Strait Islander Peoples, although these need to be integrated into practice in order to see the greatest benefits. The Flinders Program showed promise as a standardised program with content designed specifically with and for these populations. Numerous grey literature sources were identified, many using strong participatory approaches developed locally within Aboriginal and Torres Strait Islander Peoples. However, few of these programs have been subject to rigorous evaluation. Discussion Despite the significant focus on chronic condition self-management programs to help address the burden of disease for Aboriginal and Torres Strait Islander Peoples, few studies exist that have been properly evaluated. The Closing the Gap Principles developed by the Australian Institute of Health and Welfare offer important guidance for how to proceed to maximise engagement, cultural appropriateness and ownership of program initiatives.

  14. Tactics for mechanized reasoning: a commentary on Milner (1984) ‘The use of machines to assist in rigorous proof’

    PubMed Central

    Gordon, M. J. C.

    2015-01-01

    Robin Milner's paper, ‘The use of machines to assist in rigorous proof’, introduces methods for automating mathematical reasoning that are a milestone in the development of computer-assisted theorem proving. His ideas, particularly his theory of tactics, revolutionized the architecture of proof assistants. His methodology for automating rigorous proof soundly, particularly his theory of type polymorphism in programing, led to major contributions to the theory and design of programing languages. His citation for the 1991 ACM A.M. Turing award, the most prestigious award in computer science, credits him with, among other achievements, ‘probably the first theoretically based yet practical tool for machine assisted proof construction’. This commentary was written to celebrate the 350th anniversary of the journal Philosophical Transactions of the Royal Society. PMID:25750147

  15. The US Air Force suicide prevention program: implications for public health policy.

    PubMed

    Knox, Kerry L; Pflanz, Steven; Talcott, Gerald W; Campise, Rick L; Lavigne, Jill E; Bajorska, Alina; Tu, Xin; Caine, Eric D

    2010-12-01

    We evaluated the effectiveness of the US Air Force Suicide Prevention Program (AFSPP) in reducing suicide, and we measured the extent to which air force installations implemented the program. We determined the AFSPP's impact on suicide rates in the air force by applying an intervention regression model to data from 1981 through 2008, providing 16 years of data before the program's 1997 launch and 11 years of data after launch. Also, we measured implementation of program components at 2 points in time: during a 2004 increase in suicide rates, and 2 years afterward. Suicide rates in the air force were significantly lower after the AFSPP was launched than before, except during 2004. We also determined that the program was being implemented less rigorously in 2004. The AFSPP effectively prevented suicides in the US Air Force. The long-term effectiveness of this program depends upon extensive implementation and effective monitoring of implementation. Suicides can be reduced through a multilayered, overlapping approach that encompasses key prevention domains and tracks implementation of program activities.

  16. Healthy Steps: a systematic review of a preventive practice-based model of pediatric care.

    PubMed

    Piotrowski, Caroline C; Talavera, Gregory A; Mayer, Joni A

    2009-02-01

    The preventive role of anticipatory guidance in pediatric practice has gained increasing importance over the last two decades, resulting in the development of competing models of practice-based care. Our goal was to systematically evaluate and summarize the literature pertaining to the Healthy Steps Program for Young Children, a widely cited and utilized preventive model of care and anticipatory guidance, Medline and the bibliographies of review articles for relevant studies were searched using the keywords: Healthy Steps, preventive care, pediatric practice and others. Other sources included references of retrieved publications, review articles, and books; government documents; and Internet sources. Relevant sources were selected on the basis of their empirical evaluation of some component of care (e.g., child outcomes, parent outcomes, quality of care). From 21 identified articles, 13 met the inclusion criteria of empirical evaluation. These evaluations were summarized and compared. Results indicated that the Healthy Steps program has been rigorously evaluated and shown to be effective in preventing negative child and parent outcomes and enhancing positive outcomes. Despite limited information concerning cost effectiveness, the Healthy Steps Program provides clear benefit through early screening, family-centered care, and evidence-based anticipatory guidance. It is recommended that the Healthy Steps program be more widely disseminated to relevant stakeholders, and further enhanced by improved linguistic and cultural sensitivity and long term evaluation of cost effectiveness.

  17. The Keys to Success in Doctoral Studies: A Preimmersion Course.

    PubMed

    Salani, Deborah; Albuja, Laura Dean; Azaiza, Khitam

    2016-01-01

    This article will review an innovative on-line preimmersion course for a hybrid doctor of nursing practice (DNP) program and a traditional face-to-face doctor of philosophy nursing program. The doctoral candidates include both postbaccalaureate and postmaster's students. The authors of the preimmersion course developed and initiated the course in order to address various issues that have surfaced in discussions between students and faculty. Examples of common themes identified include writing skills, statistics, life-work-school balance, and navigating instructional technology. Doctoral studies may pose challenges to students studying nursing, in regard to academic rigor and experiencing on-line education for the first time, especially for students who have been out of school for an extended amount of time or are not accustomed to a nontraditional classroom; thus, having a preimmersion course established may facilitate a smooth transition to rigorous academic studies in a hybrid program. The course, which was developed and delivered through Blackboard, a learning management system, includes the following 9 preimmersion modules: academic strategies (learning styles, creating an effective PowerPoint presentation), library support (introduction to the university library, literature review tutorial, and citation styles), mindfulness, wellness, statistics essentials, writing express, DNP capstone, netiquette, and DNP/doctor of philosophy mentorship. Each module consists of various tools that may promote student success in specific courses and the programs in general. The purpose of designing the preimmersion course is to decrease attrition rates and increase success of the students. While the majority of students have succeeded in their coursework and been graduated from the program, the authors of this article found that many students struggled with the work, life, and school balance. Future work will include the evaluation of results from graduate students enrolled in the program. Copyright © 2016 Elsevier Inc. All rights reserved.

  18. Prenatal attitudes and parity predict selection into a U.S. child health program: a short report.

    PubMed

    Martin-Anderson, Sarah

    2013-10-01

    Public policies are a determinant of child health disparities; sound evaluation of these programs is essential for good governance. It is impossible in most countries to randomize assignment into child health programs that directly offer benefits. In the absence of this, researchers face the threat of selection bias-the idea that there are innate, immeasurable differences between those who take-up treatment and those who don't. In the field of Program Evaluation we are most concerned with the differences between the eligible people who take-up a program and the eligible people who choose not to enroll. Using a case study of a large U.S. nutrition program, this report illustrates how the perceived benefits of participation may affect the decision to take-up a program. In turn, this highlights sources of potential selection bias. Using data from a longitudinal study of mothers and infants conducted between May and December of 2005, I show that attitudes and beliefs prenatally toward breastfeeding determine enrollment in a U.S nutrition program that offers free Infant Formula. I also find that the significance of the selection bias differs by parity. Analysis reveals that maternal attitudinal responses are more highly predictive of future behavior, compared to standard demographic variables. In sum, this paper makes a case for rigorously understanding the factors that determine take-up of a program and how those factors can modify the results of a program evaluation. Copyright © 2013 Elsevier Ltd. All rights reserved.

  19. [Evaluation of our psycho-educative program by participating caregivers].

    PubMed

    Bier, J C; Van den Berge, D; de Wouters d'Oplinter, N; Bosman, N; Fery, P

    2010-09-01

    Facing difficulties due to dementia syndromes, systemic care is necessary. Amongst therapies assessed specifically to caregivers, psychoeducative steps seem to be the strongest effective one on neuropsychiatrics symptoms. Psychoeducations tend to teach the caregivers to modify their interactions with patients via a better understanding of illnesses and patients. Our training "Pour mieux vivre avec la maladie d'Alzheimer", applied in groups of eight to twelve persons, consists in twelve sessions of two hours each. To assure the biggest possible availability, we recently incorporated the concomitant coverage of patients into artistic workshops. These sessions of art-therapy realized in parallel to our psychoeducative program will thus be estimated according to the same rigorous methodology. The critical evaluations realized by participants at the end of our program reflect the outcome of our main objective (to teach to modify interactions with the patients) while contributing to the improvement of social contacts and to the learning of calling to existing helps. These preliminary results strongly argue for the pursuit and even extension of this kind of caregiver's management.

  20. Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

    PubMed Central

    Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

    2015-01-01

    Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271

  1. Communicating to Policymakers: What to Do with Ambiguous Results from Three Impact Studies of the Same Education Program

    ERIC Educational Resources Information Center

    Hartry, Ardice

    2013-01-01

    This paper considers one challenge from recent emphasis on rigorous research for decision-making in education: the interpretation of non-replicated findings. Under Clinton and Bush, the federal government called for and funded highly rigorous research. The "gold-standard" for research was randomized-control trials (RCTs), which…

  2. NGA/ACT Pilot Project: Increasing Course Rigor. Final Report

    ERIC Educational Resources Information Center

    ACT, Inc., 2008

    2008-01-01

    The Increasing Course Rigor Pilot Project, a joint initiative of the National Governors Association (NGA) Center for Best Practices and ACT, Inc., is one component of Phase Two of the NGA Center for Best Practices Honor States Grant Program. The project, which began in winter 2006 and concluded in summer 2007, was designed to improve the quality…

  3. Implementation of new clinical programs in the VHA healthcare system: the importance of early collaboration between clinical leadership and research.

    PubMed

    Wu, R Ryanne; Kinsinger, Linda S; Provenzale, Dawn; King, Heather A; Akerly, Patricia; Barnes, Lottie K; Datta, Santanu K; Grubber, Janet M; Katich, Nicholas; McNeil, Rebecca B; Monte, Robert; Sperber, Nina R; Atkins, David; Jackson, George L

    2014-12-01

    Collaboration between policy, research, and clinical partners is crucial to achieving proven quality care. The Veterans Health Administration has expended great efforts towards fostering such collaborations. Through this, we have learned that an ideal collaboration involves partnership from the very beginning of a new clinical program, so that the program is designed in a way that ensures quality, validity, and puts into place the infrastructure necessary for a reliable evaluation. This paper will give an example of one such project, the Lung Cancer Screening Demonstration Project (LCSDP). We will outline the ways that clinical, policy, and research partners collaborated in design, planning, and implementation in order to create a sustainable model that could be rigorously evaluated for efficacy and fidelity. We will describe the use of the Donabedian quality matrix to determine the necessary characteristics of a quality program and the importance of the linkage with engineering, information technology, and clinical paradigms to connect the development of an on-the-ground clinical program with the evaluation goal of a learning healthcare organization. While the LCSDP is the example given here, these partnerships and suggestions are salient to any healthcare organization seeking to implement new scientifically proven care in a useful and reliable way.

  4. Which Kind of Mathematics for Quantum Mechanics? the Relevance of H. Weyl's Program of Research

    NASA Astrophysics Data System (ADS)

    Drago, Antonino

    In 1918 Weyl's book Das Kontinuum planned to found anew mathematics upon more conservative bases than both rigorous mathematics and set theory. It gave birth to the so-called Weyl's elementary mathematics, i.e. an intermediate mathematics between the mathematics rejecting at all actual infinity and the classical one including it almost freely. The present paper scrutinises the subsequent Weyl's book Gruppentheorie und Quantenmechanik (1928) as a program for founding anew theoretical physics - through quantum theory - and at the same time developing his mathematics through an improvement of group theory; which, according to Weyl, is a mathematical theory effacing the old distinction between discrete and continuous mathematics. Evidence from Weyl's writings is collected for supporting this interpretation. Then Weyl's program is evaluated as unsuccessful, owing to some crucial difficulties of both physical and mathematical nature. The present clear-cut knowledge of Weyl's elementary mathematics allows us to re-evaluate Weyl's program in order to look for more adequate formulations of quantum mechanics in any weaker kind of mathematics than the classical one.

  5. Experimental evaluation of rigor mortis. VII. Effect of ante- and post-mortem electrocution on the evolution of rigor mortis.

    PubMed

    Krompecher, T; Bergerioux, C

    1988-01-01

    The influence of electrocution on the evolution of rigor mortis was studied on rats. Our experiments showed that: (1) Electrocution hastens the onset of rigor mortis. After an electrocution of 90 s, a complete rigor develops already 1 h post-mortem (p.m.) compared to 5 h p.m. for the controls. (2) Electrocution hastens the passing of rigor mortis. After an electrocution of 90 s, the first significant decrease occurs at 3 h p.m. (8 h p.m. in the controls). (3) These modifications in rigor mortis evolution are less pronounced in the limbs not directly touched by the electric current. (4) In case of post-mortem electrocution, the changes are slightly less pronounced, the resistance is higher and the absorbed energy is lower as compared with the ante-mortem electrocution cases. The results are completed by two practical observations on human electrocution cases.

  6. Evaluating Fidelity: Predictive Validity for a Measure of Competent Adherence to the Oregon Model of Parent Management Training

    PubMed Central

    Forgatch, Marion S.; Patterson, Gerald R.; DeGarmo, David S.

    2006-01-01

    When efficacious interventions are implemented in real-world conditions, it is important to evaluate whether or not the programs are practiced as intended. This article presents the Fidelity of Implementation Rating System (FIMP), an observation-based measure assessing competent adherence to the Oregon model of Parent Management Training (PMTO). FIMP evaluates 5 dimensions of competent adherence to PMTO (i.e., knowledge, structure, teaching skill, clinical skill, and overall effectiveness) specified in the intervention model. Predictive validity for FIMP was evaluated with a subsample of stepfamilies participating in a preventive PMTO intervention. As hypothesized, high FIMP ratings predicted change in observed parenting practices from baseline to 12 months. The rigor and scope of adherence measures are discussed. PMID:16718302

  7. Evaluation of powder metallurgy superalloy disk materials

    NASA Technical Reports Server (NTRS)

    Evans, D. J.

    1975-01-01

    A program was conducted to develop nickel-base superalloy disk material using prealloyed powder metallurgy techniques. The program included fabrication of test specimens and subscale turbine disks from four different prealloyed powders (NASA-TRW-VIA, AF2-1DA, Mar-M-432 and MERL 80). Based on evaluation of these specimens and disks, two alloys (AF2-1DA and Mar-M-432) were selected for scale-up evaluation. Using fabricating experience gained in the subscale turbine disk effort, test specimens and full scale turbine disks were formed from the selected alloys. These specimens and disks were then subjected to a rigorous test program to evaluate their physical properties and determine their suitability for use in advanced performance turbine engines. A major objective of the program was to develop processes which would yield alloy properties that would be repeatable in producing jet engine disks from the same powder metallurgy alloys. The feasibility of manufacturing full scale gas turbine engine disks by thermomechanical processing of pre-alloyed metal powders was demonstrated. AF2-1DA was shown to possess tensile and creep-rupture properties in excess of those of Astroloy, one of the highest temperature capability disk alloys now in production. It was determined that metallographic evaluation after post-HIP elevated temperature exposure should be used to verify the effectiveness of consolidation of hot isostatically pressed billets.

  8. Effects of rigor status during high-pressure processing on the physical qualities of farm-raised abalone (Haliotis rufescens).

    PubMed

    Hughes, Brianna H; Greenberg, Neil J; Yang, Tom C; Skonberg, Denise I

    2015-01-01

    High-pressure processing (HPP) is used to increase meat safety and shelf-life, with conflicting quality effects depending on rigor status during HPP. In the seafood industry, HPP is used to shuck and pasteurize oysters, but its use on abalones has only been minimally evaluated and the effect of rigor status during HPP on abalone quality has not been reported. Farm-raised abalones (Haliotis rufescens) were divided into 12 HPP treatments and 1 unprocessed control treatment. Treatments were processed pre-rigor or post-rigor at 2 pressures (100 and 300 MPa) and 3 processing times (1, 3, and 5 min). The control was analyzed post-rigor. Uniform plugs were cut from adductor and foot meat for texture profile analysis, shear force, and color analysis. Subsamples were used for scanning electron microscopy of muscle ultrastructure. Texture profile analysis revealed that post-rigor processed abalone was significantly (P < 0.05) less firm and chewy than pre-rigor processed irrespective of muscle type, processing time, or pressure. L values increased with pressure to 68.9 at 300 MPa for pre-rigor processed foot, 73.8 for post-rigor processed foot, 90.9 for pre-rigor processed adductor, and 89.0 for post-rigor processed adductor. Scanning electron microscopy images showed fraying of collagen fibers in processed adductor, but did not show pressure-induced compaction of the foot myofibrils. Post-rigor processed abalone meat was more tender than pre-rigor processed meat, and post-rigor processed foot meat was lighter in color than pre-rigor processed foot meat, suggesting that waiting for rigor to resolve prior to processing abalones may improve consumer perceptions of quality and market value. © 2014 Institute of Food Technologists®

  9. A systematic review of mentorship programs to facilitate transition to post-secondary education and employment for youth and young adults with disabilities.

    PubMed

    Lindsay, Sally; R Hartman, Laura; Fellin, Melissa

    2016-07-01

    Youth with disabilities experience barriers in transitioning to Post-Secondary Education (PSE) and employment. Mentorship programs provide a promising approach to supporting youth through those transitions. This paper aims to identify the effective components of mentorship programs and describe participants' experiences. We undertook a systematic review of mentorship interventions for youth and young adults with disabilities. We searched seven electronic databases for peer-reviewed articles published in English between 1980 and 2014. We included articles that examined mentorship interventions focused on PSE or employment outcomes among youth, aged thirty or younger, with physical, developmental, or cognitive disabilities. Of the 5068 articles identified, 22 met the inclusion criteria. For seven mentorship interventions, at least one significant improvement was reported in school- or work-related outcomes. Mentorship programs with significant outcomes were often structured, delivered in group-based or mixed formats, and longer in duration (>6 months). Mentors acted as role models, offered advice, and provided mentees with social and emotional support. Evidence suggests that mentorship programs may be effective for helping youth with disabilities transition to PSE or employment. More rigorously designed studies are needed to document the impact of mentorship programs on school and vocational outcomes for youth with disabilities. Implications for Rehabilitation Mentorship interventions have the potential to effectively support youth with disabilities as they transition to post-secondary education and employment. Youth should consider participating in formal mentorship interventions, and clinicians and educators should encourage them to do so, to enhance social, educational, and vocational outcomes. When developing interventions, clinicians should consider incorporating the effective components (i.e. duration, content, format) of mentorship interventions identified in this paper. Future mentorship programs should also contain a rigorous evaluation component. Clinicians can help to create (build content, consult on accessibility), connect (youth to program, program to community agencies), and contribute to mentorship interventions.

  10. A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

    ERIC Educational Resources Information Center

    Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

    2016-01-01

    Restorative practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this article describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI)…

  11. Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

    ERIC Educational Resources Information Center

    Vaade, Elizabeth; McCready, Bo

    2012-01-01

    Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…

  12. Residents-as-Teachers Publications: What Can Programs Learn From the Literature When Starting a New or Refining an Established Curriculum?

    PubMed

    Bree, Kelly K; Whicker, Shari A; Fromme, H Barrett; Paik, Steve; Greenberg, Larrie

    2014-06-01

    Teaching residents how to teach is a critical part of resident education because residents are often the major teachers of medical students. The importance of formal residents-as-teachers (RAT) curricula has been emphasized throughout the literature, yet not all residency programs have such a curriculum in place. The purpose of our study was to (1) review the medical education literature for established RAT curricula, (2) assess published curricula's reproducibility, (3) evaluate the type of outcomes achieved using the Kirkpatrick model of evaluation, and (4) identify curricula that training programs could feasibly adopt. We performed a literature review using PubMed, Medline, Scopus, PsycINFO, ERIC, and Embase. Key search words included residents, residents as teachers, teaching, internship and residency, and curriculum. In addition, a search of MedEdPORTAL was performed using the same key terms. Articles were evaluated based on the reproducibility of curricula and the assessment tools. Evaluation of educational outcomes was performed using the Kirkpatrick model. Thirty-nine articles were deemed appropriate for review. Interventions and evaluation techniques varied greatly. Only 1 article from the literature was deemed to have both curricula and assessments that would be fully reproducible by other programs. A literature review on RAT curricula found few articles that would be easily reproduced for residency programs that want to start or improve their own RAT curricula. It also demonstrated the difficulty and lack of rigorous outcome measurements for most curricula.

  13. Conclusion: Agency in the face of complexity and the future of assumption-aware evaluation practice.

    PubMed

    Morrow, Nathan; Nkwake, Apollo M

    2016-12-01

    This final chapter in the volume pulls together common themes from the diverse set of articles by a group of eight authors in this issue, and presents some reflections on the next steps for improving the ways in which evaluators work with assumptions. Collectively, the authors provide a broad overview of existing and emerging approaches to the articulation and use of assumptions in evaluation theory and practice. The authors reiterate the rationale and key terminology as a common basis for working with assumption in program design and evaluation. They highlight some useful concepts and categorizations to promote more rigorous treatment of assumptions in evaluation. A three-tier framework for fostering agency for assumption-aware evaluation practice is proposed-agency for themselves (evaluators); agency for others (stakeholders); and agency for standards and principles. Copyright © 2016 Elsevier Ltd. All rights reserved.

  14. Using ecological theory to evaluate the effectiveness of an indigenous community intervention: A study of Sexual Assault Nurse Examiner (SANE) programs.

    PubMed

    Campbell, Rebecca; Patterson, Debra; Fehler-Cabral, Giannina

    2010-12-01

    In recent years, there has been renewed interest among community psychologists in indigenous interventions, which are programs created by local practitioners (rather than researchers) already rooted in their communities. Indigenous interventions have strong ecological validity, but their effectiveness is often unknown because so few are rigorously evaluated. The goal of this project was to use Kelly and Trickett's ecological theory as a conceptual framework for evaluating an indigenous intervention and its mediating mechanisms of effectiveness. The focal intervention was a midwestern Sexual Assault Nurse Examiner (SANE) program, which provides post-assault medical care, crisis intervention, and medical forensic exams for sexual assault survivors. Prior studies of SANE programs have suggested that these interventions may help increase sexual assault prosecution rates. In this case example, we used a mixed methods design to determine if this program contributed to increased prosecution rates, and if so, why. Based on qualitative interviews with key stakeholders, we found substantial evidence for the Principle of Interdependence such that the SANE program strengthened the interconnections between the legal and medical systems, which contributed to increased prosecution. The intervention was effective in these outcomes because it promoted Cycling of Resources throughout the systems and fostered Adaptation of new roles for legal and medical personnel. Moving beyond this specific case example, this paper also examines cross-cutting advantages and struggles of using an ecological approach in the evaluation of indigenous community interventions.

  15. Evaluations of reproductive health programs in humanitarian settings: a systematic review

    PubMed Central

    2015-01-01

    Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and the results must be shared. The papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality. PMID:25685183

  16. American Indian Substance Abuse Prevention Efforts: A Review of Programs, 2003-2013.

    PubMed

    Walsh, Margaret L; Baldwin, Julie A

    2015-01-01

    The purpose of the review was to assess substance abuse prevention (SAP) efforts in American Indian and Alaska Native (AI/AN) communities from 2003-2013. In the past, many SAP programs were unable to meet the unique cultural needs of AI/AN communities adequately. It has been suggested that a disconnect may exist between the theories that are used to guide development of prevention programs in AI/AN communities and culturally appropriate theoretical constructs of AI/AN worldviews. To explore this possible disconnect further, Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used to assess a total of 18 articles (N = 31 programs) on program location and method, participant characteristics, described program cultural elements, use of theory, program outcomes, program measures, and future recommendations. Results indicated that SAP programs in AI/AN communities vary widely in their use of theory, implementation strategies, view and definition of cultural constructs, overall evaluational rigor, and reporting methods. Future research is needed to integrate appropriate theory and cultural elements into SAP programs to tie them to measurable outcomes for AI/AN communities.

  17. On the Cutting Edge Workshop on Effective and Innovative Course Design: A Model for Designing Rigorous Introductory Courses

    NASA Astrophysics Data System (ADS)

    Tewksbury, B. J.; MacDonald, R. H.

    2004-12-01

    As part of a professional development program for faculty in the geosciences, the NSF-funded program On the Cutting Edge (http://serc.carleton.edu/NAGTWorkshops/) has developed and offered workshops for geoscience faculty that guide participants through a stimulating process designed to help faculty members articulate goals and design effective and innovative courses that both meet those goals and assess outcomes. Of approximately 150 faculty members who have participated in the workshops, more than 120 have designed introductory courses in topics ranging from physical geology to Earth systems to historical geology to oceanography. The method of course design taught through these workshops leads to the development of rigorous, student-centered introductory courses. Our method of course design begins, not with a list of content items, but with setting goals by answering the question, "What do I want my students to be able to do on their own when they are done with my class?", rather than the question, "What do I want my students to know in this subject?" Focusing on what faculty members want students to be able to do, rather than on what topics should be covered by the faculty member, promotes designing courses in which students are actively engaged in doing geoscience. This course design method emphasizes setting goals for students involving higher order thinking skills (e.g., analysis, synthesis, design, formulation, prediction, interpretation, evaluation), rather than lower order thinking skills (e.g., identification, description, recognition, classification). For example, the goal of having students be able to evaluate the geologic hazards in an unfamiliar region involves higher order thinking skills and engages the student in deeper analysis than simply asking students to recall and describe examples of geologic hazards covered in class. This goal also has imbedded in it many lower order thinking skills tasks (e.g., identification, description). Rigor comes in having the students involved in doing significant and meaningful geologic tasks. Long-term value comes from improving students' abilities for future challenges, rather focusing on having students pass the final exam. Goals for courses of many different types can be found in the Cutting Edge goals/syllabus database at http://serc.carleton.edu/NAGTWorkshops/coursedesign/browse.html. The workshop also introduces participants to a wide range of teaching and assessment tools so that faculty members will leave the workshop with a larger toolbox of techniques to choose from when deciding how to give students practice during the semester in tasks relevant to the goals of the course and how to evaluate students' progress toward the goals. Most of the techniques emphasize student engagement, which promotes development of more rigorous courses. Over 100 institutions now have introductory geoscience courses designed by faculty members who have participated in our course design workshops. Participants have stated repeatedly in evaluations that the workshop transformed their views of the course design process and that they will carry the focus on goals, student engagement, and rigor into designing other courses and assessing curricula in their departments. On the Cutting Edge is in the process of developing a web-based course design workshop so that faculty who cannot attend our face-to-face workshops can go through our course design process.

  18. Unequal Access to Rigorous High School Curricula: An Exploration of the Opportunity to Benefit from the International Baccalaureate Diploma Programme (IBDP)

    ERIC Educational Resources Information Center

    Perna, Laura W.; May, Henry; Yee, April; Ransom, Tafaya; Rodriguez, Awilda; Fester, Rachél

    2015-01-01

    This study explores whether students from low-income families and racial/ethnic minority groups have the opportunity to benefit in what is arguably the most rigorous type of credit-based transition program: the International Baccalaureate Diploma Programme (IBDP). The analyses first describe national longitudinal trends in characteristics of…

  19. Going Global, for Rich and Poor

    ERIC Educational Resources Information Center

    Mathews, Jay; Mathews, Linda

    2012-01-01

    International Baccalaureate (IB) programs are turning up in a diverse mix of school districts, an attempt to add rigor and depth. For rich and for poor, for big schools and small ones, IB has become a way to add rigor and depth to public school curricula. But each school district has adapted IB for its own needs. Some use it in all schools for all…

  20. Implementation and process evaluation of a workplace colorectal cancer screening program in eastern Washington.

    PubMed

    Hannon, Peggy A; Vu, Thuy; Ogdon, Sara; Fleury, Emily M; Yette, Emily; Wittenberg, Reva; Celedonia, Megan; Bowen, Deborah J

    2013-03-01

    Colorectal cancer screening is a life-saving intervention, but screening rates are low. The authors implemented and evaluated the Spokane Colorectal Cancer Screening Program-a novel worksite intervention to promote colorectal cancer screening that used a combination of evidence-based strategies recommended by the Guide to Community Preventive Services, as well as additional strategies. Over a period of approximately 3 months, participating worksites held one or more physician-led seminars about colorectal cancer screening for employees. They also distributed free fecal immunochemical tests at the worksite to employees 50 years and older, and they provided test results to employees and their primary care physician. The authors measured attendance at seminars, test kits taken and returned, employee awareness of the program, and colorectal cancer screening rates in participating and comparison worksites. It is estimated that 9% of eligible employees received kits at the worksite, and 4% were screened with these kits. The Spokane Colorectal Cancer Screening Program was a promising pilot test of an innovative worksite screening program that successfully translated evidence-based strategies into practical use in a brief period of time, and it merits a larger study to be able to test its effects more rigorously.

  1. Prevalence, effectiveness, and characteristics of pharmacy-based medication synchronization programs.

    PubMed

    Krumme, Alexis A; Isaman, Danielle L; Stolpe, Samuel F; Dougherty, Samantha; Choudhry, Niteesh K

    2016-03-01

    The burden of visiting pharmacies to fill medications is a central contributor to nonadherence to maintenance medications. Recently, pharmacies have begun offering services that align prescription fill dates to allow patients to pick up all medications on a single visit. We evaluated the prevalence and structure of synchronization programs and evidence of their impact on adherence and clinical outcomes. Mixed-methods approach consisting of semi-structured interviews, data from surveillance activities, and a systematic literature review. We conducted interviews with opinion leaders from nonprofit advocacy organizations and exemplary synchronization programs. Program prevalence was determined using data from regular surveillance efforts. A literature review included Medline, EMBASE, Google Scholar, and general Internet searches. Synchronization programs exist in approximately 10% of independent, 6% of stand-alone chain, and 11% of retail store pharmacies. The majority of programs include a monthly pharmacist appointment and reminder communication. Programs reported the importance of pharmacist buy-in, technology to track and recruit patients, links to other healthcare services, and flexible solutions for managing costs and communication preferences. Although existing peer-reviewed literature suggests that synchronization improves adherence, more evidence is needed to evaluate its impact on patient-centered outcomes. As medication synchronization programs shift directions and compete for patients and payer resources, it will be more important than ever to rigorously evaluate their ability to improve clinical outcomes while also providing the growing number of patients managing multiple chronic conditions with the highest level of patient engagement and consumer choice.

  2. Effects of Pre and Post-Rigor Marinade Injection on Some Quality Parameters of Longissimus Dorsi Muscles

    PubMed Central

    Fadıloğlu, Eylem Ezgi; Serdaroğlu, Meltem

    2018-01-01

    Abstract This study was conducted to evaluate the effects of pre and post-rigor marinade injections on some quality parameters of Longissimus dorsi (LD) muscles. Three marinade formulations were prepared with 2% NaCl, 2% NaCl+0.5 M lactic acid and 2% NaCl+0.5 M sodium lactate. In this study marinade uptake, pH, free water, cooking loss, drip loss and color properties were analyzed. Injection time had significant effect on marinade uptake levels of samples. Regardless of marinate formulation, marinade uptake of pre-rigor samples injected with marinade solutions were higher than post rigor samples. Injection of sodium lactate increased pH values of samples whereas lactic acid injection decreased pH. Marinade treatment and storage period had significant effect on cooking loss. At each evaluation period interaction between marinade treatment and injection time showed different effect on free water content. Storage period and marinade application had significant effect on drip loss values. Drip loss in all samples increased during the storage. During all storage days, lowest CIE L* value was found in pre-rigor samples injected with sodium lactate. Lactic acid injection caused color fade in pre-rigor and post-rigor samples. Interaction between marinade treatment and storage period was found statistically significant (p<0.05). At day 0 and 3, the lowest CIE b* values obtained pre-rigor samples injected with sodium lactate and there were no differences were found in other samples. At day 6, no significant differences were found in CIE b* values of all samples. PMID:29805282

  3. Effects of Pre and Post-Rigor Marinade Injection on Some Quality Parameters of Longissimus Dorsi Muscles.

    PubMed

    Fadıloğlu, Eylem Ezgi; Serdaroğlu, Meltem

    2018-04-01

    This study was conducted to evaluate the effects of pre and post-rigor marinade injections on some quality parameters of Longissimus dorsi (LD) muscles. Three marinade formulations were prepared with 2% NaCl, 2% NaCl+0.5 M lactic acid and 2% NaCl+0.5 M sodium lactate. In this study marinade uptake, pH, free water, cooking loss, drip loss and color properties were analyzed. Injection time had significant effect on marinade uptake levels of samples. Regardless of marinate formulation, marinade uptake of pre-rigor samples injected with marinade solutions were higher than post rigor samples. Injection of sodium lactate increased pH values of samples whereas lactic acid injection decreased pH. Marinade treatment and storage period had significant effect on cooking loss. At each evaluation period interaction between marinade treatment and injection time showed different effect on free water content. Storage period and marinade application had significant effect on drip loss values. Drip loss in all samples increased during the storage. During all storage days, lowest CIE L* value was found in pre-rigor samples injected with sodium lactate. Lactic acid injection caused color fade in pre-rigor and post-rigor samples. Interaction between marinade treatment and storage period was found statistically significant ( p <0.05). At day 0 and 3, the lowest CIE b* values obtained pre-rigor samples injected with sodium lactate and there were no differences were found in other samples. At day 6, no significant differences were found in CIE b* values of all samples.

  4. Considering Research Outcomes as Essential Tools for Medical Education Decision Making.

    PubMed

    Miller, Karen Hughes; Miller, Bonnie M; Karani, Reena

    2015-11-01

    As medical educators face the challenge of incorporating new content, learning methods, and assessment techniques into the curriculum, the need for rigorous medical education research to guide efficient and effective instructional planning increases. When done properly, well-designed education research can provide guidance for complex education decision making. In this Commentary, the authors consider the 2015 Research in Medical Education (RIME) research and review articles in terms of the critical areas in teaching and learning that they address. The broad categories include (1) assessment (the largest collection of RIME articles, including both feedback from learners and instructors and the reliability of learner assessment), (2) the institution's impact on the learning environment, (3) what can be learned from program evaluation, and (4) emerging issues in faculty development. While the articles in this issue are broad in scope and potential impact, the RIME committee noted few studies of sufficient rigor focusing on areas of diversity and diverse learners. Although challenging to investigate, the authors encourage continuing innovation in research focused on these important areas.

  5. Experimental evaluation of rigor mortis. III. Comparative study of the evolution of rigor mortis in different sized muscle groups in rats.

    PubMed

    Krompecher, T; Fryc, O

    1978-01-01

    The use of new methods and an appropriate apparatus has allowed us to make successive measurements of rigor mortis and a study of its evolution in the rat. By a comparative examination on the front and hind limbs, we have determined the following: (1) The muscular mass of the hind limbs is 2.89 times greater than that of the front limbs. (2) In the initial phase rigor mortis is more pronounced in the front limbs. (3) The front and hind limbs reach maximum rigor mortis at the same time and this state is maintained for 2 hours. (4) Resolution of rigor mortis is accelerated in the front limbs during the initial phase, but both front and hind limbs reach complete resolution at the same time.

  6. Effectiveness of HIV prevention social marketing with injecting drug users.

    PubMed

    Gibson, David R; Zhang, Guili; Cassady, Diana; Pappas, Les; Mitchell, Joyce; Kegeles, Susan M

    2010-10-01

    Social marketing involves applying marketing principles to promote social goods. In the context of health behavior, it has been used successfully to reduce alcohol-related car crashes, smoking among youths, and malaria transmission, among other goals. Features of social marketing, such as audience segmentation and repeated exposure to prevention messages, distinguish it from traditional health promotion programs. A recent review found 8 of 10 rigorously evaluated social marketing interventions responsible for changes in HIV-related behavior or behavioral intentions. We studied 479 injection drug users to evaluate a community-based social marketing campaign to reduce injection risk behavior among drug users in Sacramento, California. Injecting drugs is associated with HIV infection in more than 130 countries worldwide.

  7. Towards an operational definition of pharmacy clinical competency

    NASA Astrophysics Data System (ADS)

    Douglas, Charles Allen

    The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

  8. Development of a Computer-Assisted Instrumentation Curriculum for Physics Students: Using LabVIEW and Arduino Platform

    NASA Astrophysics Data System (ADS)

    Kuan, Wen-Hsuan; Tseng, Chi-Hung; Chen, Sufen; Wong, Ching-Chang

    2016-06-01

    We propose an integrated curriculum to establish essential abilities of computer programming for the freshmen of a physics department. The implementation of the graphical-based interfaces from Scratch to LabVIEW then to LabVIEW for Arduino in the curriculum `Computer-Assisted Instrumentation in the Design of Physics Laboratories' brings rigorous algorithm and syntax protocols together with imagination, communication, scientific applications and experimental innovation. The effectiveness of the curriculum was evaluated via statistical analysis of questionnaires, interview responses, the increase in student numbers majoring in physics, and performance in a competition. The results provide quantitative support that the curriculum remove huge barriers to programming which occur in text-based environments, helped students gain knowledge of programming and instrumentation, and increased the students' confidence and motivation to learn physics and computer languages.

  9. Preventing Sexual Violence in Adolescence: Comparison of a Scientist-Practitioner Program and a Practitioner Program Using a Cluster-Randomized Design.

    PubMed

    Muck, Christoph; Schiller, Eva-Maria; Zimmermann, Maria; Kärtner, Joscha

    2018-02-01

    Numerous school-based prevention programs have been developed by scientists and practitioners to address sexual violence in adolescence. However, such programs struggle with two major challenges. First, the effectiveness of many well-established practitioner programs has not been rigorously evaluated. Second, effective scientific programs may be hard to implement into everyday school practice. Combining the knowledge of scientists and practitioners in a scientist-practitioner program could be a helpful compromise. The aim of the present study is to evaluate the effects of a scientist-practitioner program and a practitioner program using a cluster-randomized experimental design. Twenty-seven school classes were randomly assigned to either one of two programs or a control group. Outcome variables (knowledge, attitudes, behavior, and iatrogenic effects) were assessed at pretest, posttest, and a 6-month follow-up for 453 adolescents (55% female, Mage = 14.18). Short-term effects were found in both programs regarding general knowledge, knowledge of professional help, and victim-blaming attitudes. Long-term effects were found in both programs regarding general knowledge and knowledge of professional help and, in the practitioner program, in a reduction of victimization. No other effects were found on attitudes and behavior. No iatrogenic effects in the form of increased anxiety were found. Both the scientist-practitioner and the practitioner program show promise for the prevention of sexual violence in adolescence; in particular, the practitioner program may be a more cost-effective method.

  10. Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles.

    PubMed

    Kim, Hyun-Wook; Hwang, Ko-Eun; Song, Dong-Heon; Kim, Yong-Jae; Ham, Youn-Kyung; Yeo, Eui-Joo; Jeong, Tae-Jun; Choi, Yun-Sang; Kim, Cheon-Jei

    2015-01-01

    This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle.

  11. Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles

    PubMed Central

    Choi, Yun-Sang

    2015-01-01

    This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle. PMID:26761884

  12. A program to increase seat belt use along the Texas-Mexico border.

    PubMed

    Cohn, Lawrence D; Hernandez, Delia; Byrd, Theresa; Cortes, Miguel

    2002-12-01

    A school-based, bilingual intervention was developed to increase seat belt use among families living along the Texas-Mexico border. The intervention sought to increase seat belt use by changing perceived norms within the community (i.e., making the nonuse of seat belts less socially acceptable). The intervention was implemented in more than 110 classrooms and involved more than 2100 children. Blind coding, validity checks, and reliability estimates contributed to a rigorous program evaluation. Seat belt use increased by 10% among children riding in the front seat of motor vehicles in the intervention community, as compared with a small but nonsignificant decline in use among control community children. Seat belt use among drivers did not increase.

  13. GSA's Green Proving Ground: Identifying, Testing and Evaluating Innovative Technologies; Preprint

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Kandt, A.; Lowell, M.

    2012-05-01

    This paper will provide an overview of the GPG program and its objectives as well as a summary and status update of the 16 technologies selected for enhanced testing and evaluation in 2011. The federal government's General Services Administration's (GSA) Public Buildings Service (PBS) acquires space on behalf of the federal government through new construction and leasing, and acts as a caretaker for federal properties across the country. PBS owns or leases 9,624 assets and maintains an inventory of more than 370.2 million square feet of workspace, and as such has enormous potential for implementing energy efficient and renewable energymore » technologies to reduce energy and water use and associated emissions. The Green Proving Ground (GPG) program utilizes GSA's real estate portfolio to test and evaluate innovative and underutilized sustainable building technologies and practices. Findings are used to support the development of GSA performance specifications and inform decision making within GSA, other federal agencies, and the real estate industry. The program aims to drive innovation in environmental performance in federal buildings and help lead market transformation through deployment of new technologies. In 2011, the GPG program selected 16 technologies or practices for rigorous testing and evaluation. Evaluations are currently being performed in collaboration with the Department of Energy's National Laboratories, and a steady stream of results will be forthcoming throughout 2012. This paper will provide an overview of the GPG program and its objectives as well as a summary and status update of the 16 technologies selected for enhanced testing and evaluation in 2011. Lastly, it provides a general overview of the 2012 program.« less

  14. Summer at Oxford Requires Academic Rigor from U.S. Adults.

    ERIC Educational Resources Information Center

    Palmer, Stacy E.

    1987-01-01

    American universities are sponsoring overseas academic programs designed for their alumni and other adults. The programs last for 2 or 3 weeks, make money and cement cross-cultural academic ties. A program run by the University of California at Berkeley is described. (MLW)

  15. 34 CFR 691.16 - Rigorous secondary school program of study.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... MATHEMATICS ACCESS TO RETAIN TALENT GRANT (NATIONAL SMART GRANT) PROGRAMS Application Procedures § 691.16..., 2009. (Approved by the Office of Management and Budget under control number 1845-0078] (Authority: 20 U...

  16. Adapting Animal-Assisted Therapy Trials to Prison-Based Animal Programs.

    PubMed

    Allison, Molly; Ramaswamy, Megha

    2016-09-01

    Prison-based animal programs have shown promise when it comes to increased sociability, responsibility, and levels of patience for inmates who participate in these programs. Yet there remains a dearth of scientific research that demonstrates the impact of prison-based animal programs on inmates' physical and mental health. Trials of animal-assisted therapy interventions, a form of human-animal interaction therapy most often used with populations affected by depression/anxiety, mental illness, and trauma, may provide models of how prison-based animal program research can have widespread implementation in jail and prison settings, whose populations have high rates of mental health problems. This paper reviews the components of prison-based animal programs most commonly practiced in prisons today, presents five animal-assisted therapy case studies, evaluates them based on their adaptability to prison-based animal programs, and discusses the institutional constraints that act as barriers for rigorous prison-based animal program research implementation. This paper can serve to inform the development of a research approach to animal-assisted therapy that nurses and other public health researchers can use in working with correctional populations. © 2016 Wiley Periodicals, Inc.

  17. The US Air Force Suicide Prevention Program: Implications for Public Health Policy

    PubMed Central

    Pflanz, Steven; Talcott, Gerald W.; Campise, Rick L.; Lavigne, Jill E.; Bajorska, Alina; Tu, Xin; Caine, Eric D.

    2010-01-01

    Objectives. We evaluated the effectiveness of the US Air Force Suicide Prevention Program (AFSPP) in reducing suicide, and we measured the extent to which air force installations implemented the program. Methods. We determined the AFSPP's impact on suicide rates in the air force by applying an intervention regression model to data from 1981 through 2008, providing 16 years of data before the program's 1997 launch and 11 years of data after launch. Also, we measured implementation of program components at 2 points in time: during a 2004 increase in suicide rates, and 2 years afterward. Results. Suicide rates in the air force were significantly lower after the AFSPP was launched than before, except during 2004. We also determined that the program was being implemented less rigorously in 2004. Conclusions. The AFSPP effectively prevented suicides in the US Air Force. The long-term effectiveness of this program depends upon extensive implementation and effective monitoring of implementation. Suicides can be reduced through a multilayered, overlapping approach that encompasses key prevention domains and tracks implementation of program activities. PMID:20466973

  18. Increasing the use of evaluation data collection in an EPO program

    NASA Astrophysics Data System (ADS)

    Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

    2017-12-01

    Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.

  19. Unmet Need: Improving mHealth Evaluation Rigor to Build the Evidence Base.

    PubMed

    Mookherji, Sangeeta; Mehl, Garrett; Kaonga, Nadi; Mechael, Patricia

    2015-01-01

    mHealth-the use of mobile technologies for health-is a growing element of health system activity globally, but evaluation of those activities remains quite scant, and remains an important knowledge gap for advancing mHealth activities. In 2010, the World Health Organization and Columbia University implemented a small-scale survey to generate preliminary data on evaluation activities used by mHealth initiatives. The authors describe self-reported data from 69 projects in 29 countries. The majority (74%) reported some sort of evaluation activity, primarily nonexperimental in design (62%). The authors developed a 6-point scale of evaluation rigor comprising information on use of comparison groups, sample size calculation, data collection timing, and randomization. The mean score was low (2.4); half (47%) were conducting evaluations with a minimum threshold (4+) of rigor, indicating use of a comparison group, while less than 20% had randomized the mHealth intervention. The authors were unable to assess whether the rigor score was appropriate for the type of mHealth activity being evaluated. What was clear was that although most data came from mHealth projects pilots aimed for scale-up, few had designed evaluations that would support crucial decisions on whether to scale up and how. Whether the mHealth activity is a strategy to improve health or a tool for achieving intermediate outcomes that should lead to better health, mHealth evaluations must be improved to generate robust evidence for cost-effectiveness assessment and to allow for accurate identification of the contribution of mHealth initiatives to health systems strengthening and the impact on actual health outcomes.

  20. Post-Baccalaureate Teacher Certification Programs: Strategies for Enhancement, Improvement, and Peaceful Co-existence with Traditional Teacher Certification Programs.

    ERIC Educational Resources Information Center

    Duhon-Haynes, Gwendolyn; And Others

    This paper examines alternative certification programs in terms of entrance requirements, supervision and mentoring, and post-certification professional support. A good alternative program uses rigorous screening processes to ensure the selection of qualified teacher interns; provides high-quality preservice training in methodology, classroom…

  1. 75 FR 47573 - Career and Technical Education Program-Promoting Rigorous Career and Technical Education Programs...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-08-06

    ... program is to use 10 key components based on the ``Program of Study Design Framework'' [[Page 47574...., the States' Career Clusters \\2\\), and offer students the opportunities to earn postsecondary credits... extent to which students are attaining necessary knowledge and skills, we agree that administrators...

  2. Evaluation of a large healthy lifestyle program: informing program implementation and scale-up in the prevention of obesity.

    PubMed

    Kozica, S L; Lombard, C B; Harrison, C L; Teede, H J

    2016-11-24

    The Healthy Lifestyle Program for women (HeLP-her) is a low-intensity, self-management program which has demonstrated efficacy in preventing excess weight gain in women. However, little is known about the implementation, reach, and sustainability of low-intensity prevention programs in rural settings, where risk for obesity in women is higher than urban settings. We aimed to evaluate a low-intensity healthy lifestyle program delivered to women in a rural setting to inform development of effective community prevention programs. A mixed method hybrid implementation and evaluation study, guided by the RE-AIM framework (addressing the Reach, Effectiveness, Adoption, Implementation, and Maintenance), was undertaken. Data collection tools included anthropometric measures, program checklists, questionnaires, and semi-structured interviews with participants and local stakeholders. The RE-AIM self-audit tool was applied to assess evaluation rigor. Six hundred and forty-nine women from 41 relatively socio-economic disadvantaged communities in Australia participated: mean age 39.6 years (±SD 6.7) and body mass index of 28.8 kg/m 2 (±SD 6.9). A between-group weight difference of -0.92 kg (95% CI -1.67 to -0.16) showed program effectiveness. Reach was broad across 41 towns with 62% of participants reporting influencing some of the health behaviors of their families. Strong implementation fidelity was achieved with good retention rates at 1 year (76%) and high participant satisfaction (82% of participants willing to recommend this program). Over 300 multi-level community partnerships were established supporting high adoption. Stakeholders reported potential capacity to implement and sustain the prevention program in resource poor rural settings, due to the low-intensity design and minimal resources required. Our comprehensive RE-AIM evaluation demonstrates that an evidence-based obesity prevention program can be successfully implemented in real-world settings. The program achieved broad reach, effectiveness, and satisfaction at the community and stakeholder level, revealing potential for program sustainability. The evaluation addressed implementation knowledge gaps to support future obesity prevention program scale-up. Australian and New Zealand Clinical Trial Registry ACTRN 12612000115831 [ http://www.anzctr.org.au/ ].

  3. A participatory approach to evaluating a national training and institutional change initiative: the BUILD longitudinal evaluation.

    PubMed

    Davidson, Pamela L; Maccalla, Nicole M G; Afifi, Abdelmonem A; Guerrero, Lourdes; Nakazono, Terry T; Zhong, Shujin; Wallace, Steven P

    2017-01-01

    The National Institutes of Health (NIH) funds training programs to increase the numbers and skills of scientists who obtain NIH research grants, but few programs have been rigorously evaluated. The sizeable recent NIH investment in developing programs to increase the diversity of the NIH-funded workforce, implemented through the Diversity Program Consortium (DPC), is unusual in that it also funds a Consortium-wide evaluation plan, which spans the activities of the 10 BUilding Infrastructure Leading to Diversity (BUILD) awardees and the National Research Mentoring Network (NRMN). The purpose of this article is to describe the evaluation design and innovations of the BUILD Program on students, faculty, and institutions of the 10 primarily undergraduate BUILD sites. Our approach to this multi-methods quasi-experimental longitudinal evaluation emphasizes stakeholder participation and collaboration. The evaluation plan specifies the major evaluation questions and key short- to long-term outcome measures (or Hallmarks of Success). The Coordination and Evaluation Center (CEC) embarked on a comprehensive evaluation strategy by developing a set of logic models that incorporate the Hallmarks of Success and other outcomes that were collaboratively identified by the DPC. Data were collected from each BUILD site through national surveys from the Higher Education Research Institute at UCLA (HERI), annual followup surveys that align with the HERI instruments, site visits and case studies, program encounter data ("tracker" data), and institutional data. The analytic approach involves comparing changes in Hallmarks (key outcomes) within institutions for biomedical students who participated versus those who did not participate in the BUILD program at each institution, as well as between institution patterns of biomedical students at the BUILD sites, and matched institutions that were not BUILD grantees. Case studies provide insights into the institutionalization of these new programs and help to explain the processes that lead to the observed outcomes. Ultimately, the results of the consortium-wide evaluation will be used to inform national policy in higher education and will provide relevant examples of institutional and educational programmatic changes required to diversify the biomedical workforce in the USA.

  4. A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation.

    PubMed

    Acosta, Joie D; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S

    2016-01-01

    Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014-2015 school year. The study's rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area.

  5. Increased scientific rigor will improve reliability of research and effectiveness of management

    USGS Publications Warehouse

    Sells, Sarah N.; Bassing, Sarah B.; Barker, Kristin J.; Forshee, Shannon C.; Keever, Allison; Goerz, James W.; Mitchell, Michael S.

    2018-01-01

    Rigorous science that produces reliable knowledge is critical to wildlife management because it increases accurate understanding of the natural world and informs management decisions effectively. Application of a rigorous scientific method based on hypothesis testing minimizes unreliable knowledge produced by research. To evaluate the prevalence of scientific rigor in wildlife research, we examined 24 issues of the Journal of Wildlife Management from August 2013 through July 2016. We found 43.9% of studies did not state or imply a priori hypotheses, which are necessary to produce reliable knowledge. We posit that this is due, at least in part, to a lack of common understanding of what rigorous science entails, how it produces more reliable knowledge than other forms of interpreting observations, and how research should be designed to maximize inferential strength and usefulness of application. Current primary literature does not provide succinct explanations of the logic behind a rigorous scientific method or readily applicable guidance for employing it, particularly in wildlife biology; we therefore synthesized an overview of the history, philosophy, and logic that define scientific rigor for biological studies. A rigorous scientific method includes 1) generating a research question from theory and prior observations, 2) developing hypotheses (i.e., plausible biological answers to the question), 3) formulating predictions (i.e., facts that must be true if the hypothesis is true), 4) designing and implementing research to collect data potentially consistent with predictions, 5) evaluating whether predictions are consistent with collected data, and 6) drawing inferences based on the evaluation. Explicitly testing a priori hypotheses reduces overall uncertainty by reducing the number of plausible biological explanations to only those that are logically well supported. Such research also draws inferences that are robust to idiosyncratic observations and unavoidable human biases. Offering only post hoc interpretations of statistical patterns (i.e., a posteriorihypotheses) adds to uncertainty because it increases the number of plausible biological explanations without determining which have the greatest support. Further, post hocinterpretations are strongly subject to human biases. Testing hypotheses maximizes the credibility of research findings, makes the strongest contributions to theory and management, and improves reproducibility of research. Management decisions based on rigorous research are most likely to result in effective conservation of wildlife resources. 

  6. Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

    PubMed

    McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

    2017-01-01

    The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.

  7. Development of a Clinical Pharmacology Graduate Program at the University of Kentucky.

    ERIC Educational Resources Information Center

    Blouin, Robert A.; And Others

    1994-01-01

    The structure, components, and anticipated outcomes of a University of Kentucky doctoral program in pharmacology are described. The program is designed to develop pharmacy-trained specialists who are interested in rigorous, intensive clinical experience, state-of-the-art coursework, and integrated laboratory-based and clinical dissertation…

  8. Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

    NASA Technical Reports Server (NTRS)

    Staats, Matt; Whalen, Michael W.; Heindahl, Mats P. E.; Rajan, Ajitha

    2010-01-01

    In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

  9. Resolving Issues in Innovative Graduate Degree Programs: The Metropolitan State University Doctor of Business Administration Experience

    ERIC Educational Resources Information Center

    Delmont, Tim

    2011-01-01

    Applied Master's Degree and doctoral programs have been criticized widely for their lack of relevance, rigor and quality. New graduate degree programs have responded to these criticisms by implementing innovative academic policies, program curriculum, and student services. A case study of the Metropolitan State University Doctor of Business…

  10. Dipping Your Toes into Evaluation in Five Easy Steps: Tips, Tricks, and Lessons Learned

    NASA Astrophysics Data System (ADS)

    Martin, A. M.

    2013-04-01

    With limited funding, staffing, and resources for STEM education projects, the push for rigorous evaluation of our efforts offers up significant challenges, but opportunities as well. Evaluative thinking can enrich and improve the entire life cycle of an education, communication, or outreach project, and can take many forms other than a final, summative evaluation report. The community of attendees at the Astronomical Society of the Pacific will share an abundance of evaluation expertise, approaches, and results, but where does one turn if evaluation is a new concept or responsibility? This session will briefly highlight five tips, tricks, and lessons learned from the perspective of a novice and from a NASA project new to evaluation. The resources and ideas shared in the session will represent the concrete advice and driving ideas that put the author on firmer evaluative footing. Themes explored will include: (1) strategies for incorporating evaluative thinking early in the development of a project and throughout its life cycle; (2) the benefit of taking the time to elucidate a program's logic model of theory of action; (3) linking program activities to outcomes that are SMART (specific, measurable, attainable, relevant, and timely); (4) working with an external or internal evaluator; and (5) taking evaluation beyond the formal, final report. Finally, we'll close with resources to help individuals and their organizations learn more about evaluation and build their evaluation capacity.

  11. Yearning for the Vastness of the Sea: Reflections and Commentary on Professional Training in Hypnosis.

    PubMed

    Baker, Elgan L

    2017-01-01

    Educational programs are a major focus of most professional hypnosis societies. Many of these programs rely on traditional curricula and teaching strategies with variable success. The articles in this special issue examine and critique these training models and suggest innovative approaches to professional education with an emphasis on more uniform course content and goals and more dynamic and effective educational processes. A convergence of themes is noted and examined including the need to continue to expand the acceptance and utilization of clinical hypnosis, the importance of attending to broader clinical competence beyond hypnosis skills, the need for faculty development and evaluation, and the imperative that course content reflects academic rigor and contemporary science as well as providing for demonstration and supervised clinical practice. These themes are explicated for the development of new training paradigms and for continued programs in the field of clinical hypnosis.

  12. [Should disease management be feared? (1): hospital care].

    PubMed

    Gaspoz, J M; Rutschmann, O

    2005-11-23

    The goals of disease management are: (1) an integrated health care delivery system; (2) knowledge-based care; (3) elaborate information systems; (4) continuous quality improvement. In-hospital disease management and, more specifically, critical pathways, establish standardized care plans, set goals and time actions to reach these goals. They can reduce variations in practice patterns and resource utilization without compromising quality of care. Such strategies participate to quality improvement programs in hospitals when they involve and empower all actors of a given process of care, are not imposed from outside, and use sound and rigorous development and evaluation methods.

  13. Pharmaceuticals in Australia: priorities in a teaching hospital.

    PubMed

    Kearney, B J

    1993-01-01

    In spite of rigorous government programs for control of the pricing and dissemination of pharmaceutical products in Australia, the list of new drugs continues to grow and prices to increase. To regain control over drug usage at Royal Adelaide Hospital, the Hospital Drug Committee developed a rating method that judged drugs on the basis of their cost-benefit to patients. The ratio of a total quality score to a total cost score becomes the determinant of additions to the hospital formulary. The background for the Australian approach to pharmaceuticals and the new evaluation technique at the teaching hospital are described in this report.

  14. Effectiveness of HIV Prevention Social Marketing With Injecting Drug Users

    PubMed Central

    Zhang, Guili; Cassady, Diana; Pappas, Les; Mitchell, Joyce; Kegeles, Susan M.

    2010-01-01

    Social marketing involves applying marketing principles to promote social goods. In the context of health behavior, it has been used successfully to reduce alcohol-related car crashes, smoking among youths, and malaria transmission, among other goals. Features of social marketing, such as audience segmentation and repeated exposure to prevention messages, distinguish it from traditional health promotion programs. A recent review found 8 of 10 rigorously evaluated social marketing interventions responsible for changes in HIV-related behavior or behavioral intentions. We studied 479 injection drug users to evaluate a community-based social marketing campaign to reduce injection risk behavior among drug users in Sacramento, California. Injecting drugs is associated with HIV infection in more than 130 countries worldwide. PMID:20724686

  15. Creating developmentally auspicious school environments for African American boys.

    PubMed

    Barbarin, Oscar A; Chinn, Lisa; Wright, Yamanda F

    2014-01-01

    African American (AA) boys face serious barriers to academic success, many of which are uncommon--or absent--in the lives of AA girls, other children of color, and European American children. In this chapter, we identify nine critical challenges to the successful education of AA boys and review possible solutions. In addition, we evaluate one particular reform, public single-sex schooling, as a possible solution to the challenges facing AA boys. Considering the evidence, we argue that recent efforts to expand the existence of public single-sex schools are rarely grounded in empirical findings. Given the lack of compelling evidence and the high stakes for AA boys, we call for more rigorous evaluations of the outcomes of sex-segregated programs that specifically target AA boys.

  16. School-based violence prevention strategy: a pilot evaluation.

    PubMed

    Thakore, Rachel V; Apfeld, Jordan C; Johnson, Ronald K; Sathiyakumar, Vasanth; Jahangir, A Alex; Sethi, Manish K

    2015-07-01

    Violence has recently been reported among a primarily young, minority population in Nashville, Tennessee. School-based programs have been proven as effective methods of reducing violent behavior, beliefs, and actions that lead to violence among adolescents. Investigators implemented a rigorous search for an appropriate school-based violence prevention program for Metropolitan Nashville middle school students utilizing a systematic review and discussion group with victims of violence. 27 programs nation-wide were reviewed and 2 discussion groups with African American males under the age of 25 admitted to a level 1 trauma center for assault-related injuries were conducted. Our findings led to a single, evidence-based conflict resolution program. In conjunction with educators, we evaluated the program's effectiveness in a pilot study in a Nashville middle school with high rates of violence. 122 students completed the conflict resolution program and described their behavior and experiences with violence in a pre-test/post-test self-rate questionnaire. Results showed a significant decrease in violent behavior and an increase in students' competencies to deal with violence (p less than 0.05). This study shows that a reduction in violent behavior and beliefs among middle school students can be achieved through the implementation of a targeted violence intervention program. A larger-scale intervention is needed to develop more conclusive evidence of effectiveness. © 2015 KUMS, All rights reserved.

  17. Gerontological Competencies among MSW Students: Evaluation of a Gerontology Specialization Program.

    PubMed

    Wilks, Scott E; Cain, Daphne S; Reed-Ashcraft, Kellie B; Geiger, Jen

    2017-01-01

    The purpose of this study was to conduct a preliminary evaluation of a gerontology specialization program (GSP) within a Council on Social Work Education (CSWE)-accredited master of social work (MSW) program. This study utilized a pretest/posttest design with a three-group comparison: group 1-GSP students; group 2-students from the group 1 program but not in GSP; and group 3-students at two external MSW programs with no GSPs. The overall sample comprised 220 advanced year students. A CSWE Gero-Ed Center/Hartford Partnership empirical measure was used to assess overall, gero social work practice competency. Within-group analyses revealed a significant increase in gero competency scores from pretest to posttest among all groups, with GSP students showing the largest increase. Between-group analysis at pretest revealed that the GSP group showed lower gero competency scores than both non-GSP groups. At posttest, these results overturned: GSP students scored significantly higher gero competency scores than both non-GSP groups. These preliminary findings suggest that the GSP offers an impactful, positive role in development of practice skills for the next generation of gero social work practitioners and scholars. A follow-up study with additional years of data will increase longitudinal rigor and confidence in the long-range efficacy of this GSP.

  18. Effect Of A Large-Scale Social Franchising And Telemedicine Program On Childhood Diarrhea And Pneumonia Outcomes In India.

    PubMed

    Mohanan, Manoj; Babiarz, Kimberly S; Goldhaber-Fiebert, Jeremy D; Miller, Grant; Vera-Hernández, Marcos

    2016-10-01

    Despite the rapid growth of social franchising, there is little evidence on its population impact in the health sector. Similar in many ways to private-sector commercial franchising, social franchising can be found in sectors with a social objective, such as health care. This article evaluates the World Health Partners (WHP) Sky program, a large-scale social franchising and telemedicine program in Bihar, India. We studied appropriate treatment for childhood diarrhea and pneumonia and associated health care outcomes. We used multivariate difference-in-differences models to analyze data on 67,950 children ages five and under in 2011 and 2014. We found that the WHP-Sky program did not improve rates of appropriate treatment or disease prevalence. Both provider participation and service use among target populations were low. Our results do not imply that social franchising cannot succeed; instead, they underscore the importance of understanding factors that explain variation in the performance of social franchises. Our findings also highlight, for donors and governments in particular, the importance of conducting rigorous impact evaluations of new and potentially innovative health care delivery programs before investing in scaling them up. Published by Project HOPE—The People-to-People Health Foundation, Inc.

  19. A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

    PubMed Central

    Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

    2017-01-01

    Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014–2015 school year. The study’s rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area. PMID:28936104

  20. Translational Educational Research

    PubMed Central

    Issenberg, S. Barry; Cohen, Elaine R.; Barsuk, Jeffrey H.; Wayne, Diane B.

    2012-01-01

    Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research. PMID:23138127

  1. Update on child abuse prevention.

    PubMed

    Krugman, Scott D; Lane, Wendy G; Walsh, Christina M

    2007-12-01

    Child abuse remains a significant problem in the United States with 2.9 million reports and 825 000 indicated cases in 2005. This report will highlight recent efforts toward child abuse prevention, focusing on home visiting programs, abusive head trauma primary prevention, parent training programs, sexual abuse prevention, and the effectiveness of laws banning corporal punishment. Most home visitation programs have demonstrated a lack of effectiveness in recent randomized trials. One exception is the Nurse Family Partnership, which remains the most effective and longest enduring intervention for high-risk families. Child sexual abuse prevention programs and parent training programs need further evaluation with more rigorous methodology and outcome measures. Providing universal parent education about coping with crying infants appears to be effective in lowering the incidence of abusive head trauma. Although advocated for, further study will determine the effectiveness of laws banning corporal punishment or mandating abusive head trauma education to parents of newborns. Pediatricians play an important role in the prevention of child maltreatment. Their knowledge of the effectiveness of different programs can help guide parents toward appropriate services.

  2. Strategies used by community-based organizations to evaluate their locally developed HIV prevention interventions: Lessons learned from the CDC's innovative interventions project.

    PubMed

    Painter, Thomas M; Ngalame, Paulyne M; Lucas, Basil; Lauby, Jennifer L; Herbst, Jeffrey H

    2010-10-01

    Community-based organizations (CBOs) play an important role in health promotion efforts and the delivery of HIV prevention interventions for at-risk minority populations. CBOs may also develop their own interventions but often lack the capacity or funds to rigorously evaluate them. The Innovative Interventions project of the Centers for Disease Control and Prevention (CDC) funded three CBOs to rigorously evaluate the efficacy of interventions they had developed and were delivering to Black women, Black men who have sex with men (MSM), and adolescent males in juvenile justice settings, respectively. The evaluation results have been reported elsewhere. This article describes operational issues that the CBOs identified as being particularly salient to their evaluations and the strategies they developed to address the issues and successfully complete their evaluations. These issues included the development of organizational capacity to conduct a rigorous outcome evaluation, difficulties with recruitment and retention of evaluation participants, and the use of process monitoring data to improve intervention delivery. The strategies described in this article can be used by CBOs when evaluating their locally developed HIV prevention interventions and may be of interest to funding agencies and researchers that collaborate with CBOs to evaluate their interventions.

  3. A narrative literature review to direct spinal cord injury patient education programming.

    PubMed

    van Wyk, Kim; Backwell, Amber; Townson, Andrea

    2015-01-01

    To summarize the evidence on SCI-related education literature, while looking at potential barriers, solutions, benefits, and patient preferences regarding SCI patient education. A literature review was conducted using 5 electronic databases. Quality appraisal instruments were designed to determine the methodological rigor of the quantitative and qualitative studies found. Selected articles were read in their entirety and themes were abstracted. Fourteen articles met the inclusion criteria for this narrative literature review, all of which were based on research studies. Seven of these 14 were quantitative studies, 3 were qualitative studies, and 4 were mixed-methods studies. To improve SCI education during rehabilitation, programs should maximize the receptiveness of newly injured patients to SCI-related information, optimize the delivery of SCI education, increase the number of opportunities for learning, promote and support lifelong learning, and include patient and program evaluation. How these strategies are specifically implemented needs to be determined by program management in consultation with various stakeholders, whilst considering the unique characteristics of the rehabilitation facility.

  4. Seriously Implementing Health Capacity Strengthening Programs in Africa: Comment on "Implementation of a Health Management Mentoring Program: Year-1 Evaluation of Its Impact on Health System Strengthening in Zambézia Province, Mozambique".

    PubMed

    Lapão, Luís Velez

    2015-07-14

    Faced with the challenges of healthcare reform, skills and new capabilities are needed to support the reform and it is of crucial importance in Africa where shortages affects the health system resilience. Edwards et al provides a good example of the challenge of implementing a mentoring program in one province in a sub-Saharan country. From this example, various aspects of strengthening the capacity of managers in healthcare are examined based on our experience in action-training in Africa, as mentoring shares many characteristics with action-training. What practical lessons can be drawn to promote the strengthening so that managers can better intervene in complex contexts? Deeper involvement of health authorities and more rigorous approaches are seriously desirable for the proper development of health capacity strengthening programs in Africa. © 2015 by Kerman University of Medical Sciences.

  5. New Wine in New Bottles: Transforming Vocational Education into Career and Technical Education. Practice Application Brief No. 21.

    ERIC Educational Resources Information Center

    Brown, Bettina Lankard

    Teachers responsible for transforming their vocational education programs into career and technical education (CTE) programs need to concentrate on ensuring programs' technical and academic rigor, engaging in collaboration in school and in the community, keeping current through professional development experiences, and extending learning beyond…

  6. Mature Programs of Study: Examining Policy Implementation at the Local Level. Final Report

    ERIC Educational Resources Information Center

    Alfeld, Corinne; Bhattacharya, Sharika

    2013-01-01

    The 2006 Carl D. Perkins Career and Technical Education Act required that all career technical education (CTE) programs offer secondary to postsecondary programs of study (POS), which integrate rigorous academics, offer dual enrollment options, and lead to an industry-recognized degree or credential. Focused on improving students' transition to…

  7. Redesigning a Special Education Teacher-Preparation Program: The Rationale, Process, and Outcomes

    ERIC Educational Resources Information Center

    Fuchs, Wendy W.; Fahsl, Allison J.; James, Susanne M.

    2014-01-01

    Teacher-preparation programs across the nation are faced with multiple mandates that aim to increase rigor and effectiveness of future educators. In the state of Illinois, all teacher-preparation programs must revise and redesign their coursework to align with the new professional teaching standards and licensure requirements. This article will…

  8. You've Shown the Program Model Is Effective. Now What?

    ERIC Educational Resources Information Center

    Ellickson, Phyllis L.

    2014-01-01

    Rigorous tests of theory-based programs require faithful implementation. Otherwise, lack of results might be attributable to faulty program delivery, faulty theory, or both. However, once the evidence indicates the model works and merits broader dissemination, implementation issues do not fade away. How can developers enhance the likelihood that…

  9. Rigorous Tests of Student Outcomes in CTE Programs of Study: Final Report

    ERIC Educational Resources Information Center

    Castellano, Marisa; Sundell, Kirsten E.; Overman, Laura T.; Richardson, George B.; Stone, James R., III

    2014-01-01

    This study was designed to investigate the relationship between participation in federally mandated college and career-preparatory programs--known as programs of study (POS)--and high school achievement outcomes. POS are an organized approach to college and career readiness that offer an aligned sequence of courses spanning secondary and…

  10. Building Better Bridges into STEM: A Synthesis of 25 Years of Literature on STEM Summer Bridge Programs

    ERIC Educational Resources Information Center

    Ashley, Michael; Cooper, Katelyn M.; Cala, Jacqueline M.; Brownell, Sara E.

    2017-01-01

    Summer bridge programs are designed to help transition students into the college learning environment. Increasingly, bridge programs are being developed in science, technology, engineering, and mathematics (STEM) disciplines because of the rigorous content and lower student persistence in college STEM compared with other disciplines. However, to…

  11. Evaluation of physical dimension changes as nondestructive measurements for monitoring rigor mortis development in broiler muscles.

    PubMed

    Cavitt, L C; Sams, A R

    2003-07-01

    Studies were conducted to develop a non-destructive method for monitoring the rate of rigor mortis development in poultry and to evaluate the effectiveness of electrical stimulation (ES). In the first study, 36 male broilers in each of two trials were processed at 7 wk of age. After being bled, half of the birds received electrical stimulation (400 to 450 V, 400 to 450 mA, for seven pulses of 2 s on and 1 s off), and the other half were designated as controls. At 0.25 and 1.5 h postmortem (PM), carcasses were evaluated for the angles of the shoulder, elbow, and wing tip and the distance between the elbows. Breast fillets were harvested at 1.5 h PM (after chilling) from all carcasses. Fillet samples were excised and frozen for later measurement of pH and R-value, and the remainder of each fillet was held on ice until 24 h postmortem. Shear value and pH means were significantly lower, but R-value means were higher (P < 0.05) for the ES fillets compared to the controls, suggesting acceleration of rigor mortis by ES. The physical dimensions of the shoulder and elbow changed (P < 0.05) during rigor mortis development and with ES. These results indicate that physical measurements of the wings maybe useful as a nondestructive indicator of rigor development and for monitoring the effectiveness of ES. In the second study, 60 male broilers in each of two trials were processed at 7 wk of age. At 0.25, 1.5, 3.0, and 6.0 h PM, carcasses were evaluated for the distance between the elbows. At each time point, breast fillets were harvested from each carcass. Fillet samples were excised and frozen for later measurement of pH and sacromere length, whereas the remainder of each fillet was held on ice until 24 h PM. Shear value and pH means (P < 0.05) decreased, whereas sarcomere length means (P < 0.05) increased over time, indicating rigor mortis development. Elbow distance decreased (P < 0.05) with rigor development and was correlated (P < 0.01) with shear value (r = 0.2581), sarcomere length (r = -0.3079), and pH (r = 0.6303). These results suggest that elbow distance could be used in conjunction with other detection methods for optically automating measurement of rigor mortis development in broiler carcasses.

  12. Modeling technology innovation: how science, engineering, and industry methods can combine to generate beneficial socioeconomic impacts.

    PubMed

    Stone, Vathsala I; Lane, Joseph P

    2012-05-16

    Government-sponsored science, technology, and innovation (STI) programs support the socioeconomic aspects of public policies, in addition to expanding the knowledge base. For example, beneficial healthcare services and devices are expected to result from investments in research and development (R&D) programs, which assume a causal link to commercial innovation. Such programs are increasingly held accountable for evidence of impact-that is, innovative goods and services resulting from R&D activity. However, the absence of comprehensive models and metrics skews evidence gathering toward bibliometrics about research outputs (published discoveries), with less focus on transfer metrics about development outputs (patented prototypes) and almost none on econometrics related to production outputs (commercial innovations). This disparity is particularly problematic for the expressed intent of such programs, as most measurable socioeconomic benefits result from the last category of outputs. This paper proposes a conceptual framework integrating all three knowledge-generating methods into a logic model, useful for planning, obtaining, and measuring the intended beneficial impacts through the implementation of knowledge in practice. Additionally, the integration of the Context-Input-Process-Product (CIPP) model of evaluation proactively builds relevance into STI policies and programs while sustaining rigor. The resulting logic model framework explicitly traces the progress of knowledge from inputs, following it through the three knowledge-generating processes and their respective knowledge outputs (discovery, invention, innovation), as it generates the intended socio-beneficial impacts. It is a hybrid model for generating technology-based innovations, where best practices in new product development merge with a widely accepted knowledge-translation approach. Given the emphasis on evidence-based practice in the medical and health fields and "bench to bedside" expectations for knowledge transfer, sponsors and grantees alike should find the model useful for planning, implementing, and evaluating innovation processes. High-cost/high-risk industries like healthcare require the market deployment of technology-based innovations to improve domestic society in a global economy. An appropriate balance of relevance and rigor in research, development, and production is crucial to optimize the return on public investment in such programs. The technology-innovation process needs a comprehensive operational model to effectively allocate public funds and thereby deliberately and systematically accomplish socioeconomic benefits.

  13. Modeling technology innovation: How science, engineering, and industry methods can combine to generate beneficial socioeconomic impacts

    PubMed Central

    2012-01-01

    Background Government-sponsored science, technology, and innovation (STI) programs support the socioeconomic aspects of public policies, in addition to expanding the knowledge base. For example, beneficial healthcare services and devices are expected to result from investments in research and development (R&D) programs, which assume a causal link to commercial innovation. Such programs are increasingly held accountable for evidence of impact—that is, innovative goods and services resulting from R&D activity. However, the absence of comprehensive models and metrics skews evidence gathering toward bibliometrics about research outputs (published discoveries), with less focus on transfer metrics about development outputs (patented prototypes) and almost none on econometrics related to production outputs (commercial innovations). This disparity is particularly problematic for the expressed intent of such programs, as most measurable socioeconomic benefits result from the last category of outputs. Methods This paper proposes a conceptual framework integrating all three knowledge-generating methods into a logic model, useful for planning, obtaining, and measuring the intended beneficial impacts through the implementation of knowledge in practice. Additionally, the integration of the Context-Input-Process-Product (CIPP) model of evaluation proactively builds relevance into STI policies and programs while sustaining rigor. Results The resulting logic model framework explicitly traces the progress of knowledge from inputs, following it through the three knowledge-generating processes and their respective knowledge outputs (discovery, invention, innovation), as it generates the intended socio-beneficial impacts. It is a hybrid model for generating technology-based innovations, where best practices in new product development merge with a widely accepted knowledge-translation approach. Given the emphasis on evidence-based practice in the medical and health fields and “bench to bedside” expectations for knowledge transfer, sponsors and grantees alike should find the model useful for planning, implementing, and evaluating innovation processes. Conclusions High-cost/high-risk industries like healthcare require the market deployment of technology-based innovations to improve domestic society in a global economy. An appropriate balance of relevance and rigor in research, development, and production is crucial to optimize the return on public investment in such programs. The technology-innovation process needs a comprehensive operational model to effectively allocate public funds and thereby deliberately and systematically accomplish socioeconomic benefits. PMID:22591638

  14. Mourning dove hunting regulation strategy based on annual harvest statistics and banding data

    USGS Publications Warehouse

    Otis, D.L.

    2006-01-01

    Although managers should strive to base game bird harvest management strategies on mechanistic population models, monitoring programs required to build and continuously update these models may not be in place. Alternatively, If estimates of total harvest and harvest rates are available, then population estimates derived from these harvest data can serve as the basis for making hunting regulation decisions based on population growth rates derived from these estimates. I present a statistically rigorous approach for regulation decision-making using a hypothesis-testing framework and an assumed framework of 3 hunting regulation alternatives. I illustrate and evaluate the technique with historical data on the mid-continent mallard (Anas platyrhynchos) population. I evaluate the statistical properties of the hypothesis-testing framework using the best available data on mourning doves (Zenaida macroura). I use these results to discuss practical implementation of the technique as an interim harvest strategy for mourning doves until reliable mechanistic population models and associated monitoring programs are developed.

  15. Improving the Enrollment and Retention of Students in the Associate in Arts Program at the University of Delaware

    ERIC Educational Resources Information Center

    Bacon, J. Richard

    2010-01-01

    The University of Delaware established the Associate in Arts Program to ensure that students on branch campuses were prepared for the rigors of the University. However, enrollment and retention in the Program remained below expectations. High school seniors, guidance counselors, Program faculty and staff, and both enrolled students and students…

  16. Toward the Development of a Program Quality Framework for Career and Technical Education Programs: A Researcher-Practitioner Collaborative Project

    ERIC Educational Resources Information Center

    Brodersen, R. Marc; Yanoski, David; Hyslop, Alisha; Imperatore, Catherine

    2016-01-01

    Career and technical education (CTE) programs of study are subject to rigorous state and federal accountability systems that provide information on key student outcomes. However, while these outcome measures can form a basis for identifying high- and low-performing programs, they are insufficient for answering underlying questions about how or why…

  17. The Ed.D. Program at the University of Illinois at Chicago: Using Continuous Improvement to Promote School Leadership Preparation

    ERIC Educational Resources Information Center

    Cosner, Shelby; Tozer, Steve; Smylie, Mark

    2012-01-01

    This article describes the process of replacing a modest Master's level school leader preparation program with an innovative Ed.D. program at the University of Illinois at Chicago (UIC). The new doctoral program is intensive, highly selective, intellectually rigorous, and field-based. The authors provide side-by-side comparisons of the difference…

  18. A New Model for a Multi-Disciplinary Engineering Summer Research Program for High School Seniors: Program Overview, Effectiveness, and Outcomes

    ERIC Educational Resources Information Center

    Kittur, H.; Shaw, L.; Herrera, W.

    2017-01-01

    The High School Summer Research Program (HSSRP) is a rigorous eight-week research experience that challenges high school students to a novel scientific question in an engineering laboratory at the Henry Samueli School of Engineering and Applied Science (HSSEAS) at the University of California, Los Angeles (UCLA). The program collates highly…

  19. Systematic review of positive youth development programs for adolescents with chronic illness.

    PubMed

    Maslow, Gary R; Chung, Richard J

    2013-05-01

    The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.

  20. The Stanford Medical Youth Science Program: educational and science-related outcomes.

    PubMed

    Crump, Casey; Ned, Judith; Winkleby, Marilyn A

    2015-05-01

    Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer Residential Program (SRP), a 25-year-old university-based biomedical pipeline program that reaches out to low-income and underrepresented ethnic minority high school students. Five annual surveys were used to assess educational outcomes and science-related experience among 96 SRP participants and a comparison group of 192 youth who applied but were not selected to participate in the SRP, using ~2:1 matching on sociodemographic and academic background to control for potential confounders. SRP participants were more likely than the comparison group to enter college (100.0 vs. 84.4 %, p = 0.002), and both of these matriculation rates were more than double the statewide average (40.8 %). In most areas of science-related experience, SRP participants reported significantly more experience (>twofold odds) than the comparison group at 1 year of follow-up, but these differences did not persist after 2-4 years. The comparison group reported substantially more participation in science or college preparatory programs, more academic role models, and less personal adversity than SRP participants, which likely influenced these findings toward the null hypothesis. SRP applicants, irrespective of whether selected for participation, had significantly better educational outcomes than population averages. Short-term science-related experience was better among SRP participants, although longer-term outcomes were similar, most likely due to college and science-related opportunities among the comparison group. We discuss implications for future evaluations of other biomedical pipeline programs.

  1. Use of a business excellence model to improve conservation programs.

    PubMed

    Black, Simon; Groombridge, Jim

    2010-12-01

    The current shortfall in effectiveness within conservation biology is illustrated by increasing interest in "evidence-based conservation," whose proponents have identified the need to benchmark conservation initiatives against actions that lead to proven positive effects. The effectiveness of conservation policies, approaches, and evaluation is under increasing scrutiny, and in these areas models of excellence used in business could prove valuable. Typically, conservation programs require years of effort and involve rigorous long-term implementation processes. Successful balance of long-term efforts alongside the achievement of short-term goals is often compromised by management or budgetary constraints, a situation also common in commercial businesses. "Business excellence" is an approach many companies have used over the past 20 years to ensure continued success. Various business excellence evaluations have been promoted that include concepts that could be adapted and applied in conservation programs. We describe a conservation excellence model that shows how scientific processes and results can be aligned with financial and organizational measures of success. We applied the model to two well-documented species conservation programs. In the first, the Po'ouli program, several aspects of improvement were identified, such as more authority for decision making in the field and better integration of habitat management and population recovery processes. The second example, the black-footed ferret program, could have benefited from leadership effort to reduce bureaucracy and to encourage use of best-practice species recovery approaches. The conservation excellence model enables greater clarity in goal setting, more-effective identification of job roles within programs, better links between technical approaches and measures of biological success, and more-effective use of resources. The model could improve evaluation of a conservation program's effectiveness and may be used to compare different programs, for example during reviews of project performance by sponsoring organizations. © 2010 Society for Conservation Biology.

  2. Toward rigorous idiographic research in prevention science: comparison between three analytic strategies for testing preventive intervention in very small samples.

    PubMed

    Ridenour, Ty A; Pineo, Thomas Z; Maldonado Molina, Mildred M; Hassmiller Lich, Kristen

    2013-06-01

    Psychosocial prevention research lacks evidence from intensive within-person lines of research to understand idiographic processes related to development and response to intervention. Such data could be used to fill gaps in the literature and expand the study design options for prevention researchers, including lower-cost yet rigorous studies (e.g., for program evaluations), pilot studies, designs to test programs for low prevalence outcomes, selective/indicated/adaptive intervention research, and understanding of differential response to programs. This study compared three competing analytic strategies designed for this type of research: autoregressive moving average, mixed model trajectory analysis, and P-technique. Illustrative time series data were from a pilot study of an intervention for nursing home residents with diabetes (N = 4) designed to improve control of blood glucose. A within-person, intermittent baseline design was used. Intervention effects were detected using each strategy for the aggregated sample and for individual patients. The P-technique model most closely replicated observed glucose levels. ARIMA and P-technique models were most similar in terms of estimated intervention effects and modeled glucose levels. However, ARIMA and P-technique also were more sensitive to missing data, outliers and number of observations. Statistical testing suggested that results generalize both to other persons as well as to idiographic, longitudinal processes. This study demonstrated the potential contributions of idiographic research in prevention science as well as the need for simulation studies to delineate the research circumstances when each analytic approach is optimal for deriving the correct parameter estimates.

  3. Toward Rigorous Idiographic Research in Prevention Science: Comparison Between Three Analytic Strategies for Testing Preventive Intervention in Very Small Samples

    PubMed Central

    Pineo, Thomas Z.; Maldonado Molina, Mildred M.; Lich, Kristen Hassmiller

    2013-01-01

    Psychosocial prevention research lacks evidence from intensive within-person lines of research to understand idiographic processes related to development and response to intervention. Such data could be used to fill gaps in the literature and expand the study design options for prevention researchers, including lower-cost yet rigorous studies (e.g., for program evaluations), pilot studies, designs to test programs for low prevalence outcomes, selective/indicated/ adaptive intervention research, and understanding of differential response to programs. This study compared three competing analytic strategies designed for this type of research: autoregressive moving average, mixed model trajectory analysis, and P-technique. Illustrative time series data were from a pilot study of an intervention for nursing home residents with diabetes (N=4) designed to improve control of blood glucose. A within-person, intermittent baseline design was used. Intervention effects were detected using each strategy for the aggregated sample and for individual patients. The P-technique model most closely replicated observed glucose levels. ARIMA and P-technique models were most similar in terms of estimated intervention effects and modeled glucose levels. However, ARIMA and P-technique also were more sensitive to missing data, outliers and number of observations. Statistical testing suggested that results generalize both to other persons as well as to idiographic, longitudinal processes. This study demonstrated the potential contributions of idiographic research in prevention science as well as the need for simulation studies to delineate the research circumstances when each analytic approach is optimal for deriving the correct parameter estimates. PMID:23299558

  4. Stakeholder Participation in Freshwater Monitoring and Evaluation Programs: Applying Thresholds of Potential Concern within Environmental Flows

    NASA Astrophysics Data System (ADS)

    Conallin, John; McLoughlin, Craig A.; Campbell, Josh; Knight, Roger; Bright, Troy; Fisher, Ian

    2018-03-01

    The complex nature of freshwater systems provides challenges for incorporating evidence-based techniques into management. This paper investigates the potential of participatory evidence-based techniques to involve local stakeholders and make decisions based on different "knowledge" sources within adaptive management programs. It focuses on the application of thresholds of potential concern (TPC) within strategic adaptive management (SAM) for facilitating inclusive decision-making. The study is based on the case of the Edward-Wakool (E-W) "Fish and Flows" SAM project in the Murray-Darling River Basin, Australia. We demonstrate the application of TPCs for improving collaborative decision-making within the E-W, associated with environmental watering requirements, and other natural resource management programs such as fish stocking. The development of TPCs in the E-W fish and flows SAM project helped improve stakeholder involvement and understanding of the system, and also the effectiveness of the implemented management interventions. TPCs ultimately helped inform environmental flow management activities. The TPC process complemented monitoring that was already occurring in the system and provided a mechanism for linking formal and informal knowledge to form explicit and measurable endpoints from objectives. The TPC process faced challenges due to the perceived reduction in scientific rigor within initial TPC development and use. However, TPCs must remain tangible to managers and other stakeholders, in order to aid in the implementation of adaptive management. Once accepted by stakeholders, over time TPCs should be reviewed and refined in order to increase their scientific rigor, as new information is generated.

  5. Is the 'driving test' a robust quality indicator of colonoscopy performance?

    PubMed

    Kelly, Nicholas M; Moorehead, John; Tham, Tony

    2010-04-16

    Colorectal cancer is a major cause of death in the western world and is currently the second commonest cause of death from malignant disease in the UK. Recently a "driving test" for colonoscopists wishing to take part in the National Health Service Bowel Cancer Screening Program has been introduced, with the aim of improving quality in colonoscopy. We describe the accreditation process and have reviewed the published evidence for its use. We compared this method of assessment to what occurs in other developed countries. To the authors' knowledge no other countries have similar methods of assessment of practicing colonoscopists, and instead use critical evaluation of key quality criteria. The UK appears to have one of the most rigorous accreditation processes, although this still has flaws. The published evidence suggests that the written part of the accreditation is not a good discriminating test and it needs to be improved or abandoned. Further work is needed on the best methods of assessing polypectomy skills. Rigorous systems need to be in place for the colonoscopist who fails the assessment.

  6. 77 FR 12651 - Approval of Air Quality Implementation Plans; California; San Joaquin Valley; Attainment Plan for...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-03-01

    ... standards for which EPA has issued the waiver. CARB has as long a history of enforcement of vehicle/engine... program. The history and rigor of CARB's enforcement program lends assurance to California SIP revisions...

  7. CTE's Role in Urban Education. Issue Brief

    ERIC Educational Resources Information Center

    Association for Career and Technical Education (ACTE), 2012

    2012-01-01

    This Issue Brief explores the promising role that career and technical education programs play in addressing key student achievement issues facing urban schools. CTE programs engage urban students by providing rigorous and relevant coursework, fostering positive relationships, establishing clear pathways and connecting education and…

  8. Short-term evaluation of a skill-development sexual education program for Spanish adolescents compared with a well-established program.

    PubMed

    Espada, José P; Morales, Alexandra; Orgilés, Mireia; Jemmott, John B; Jemmott, Loretta S

    2015-01-01

    The Centers for Disease Control and Prevention highlights the importance of evaluating interventions rigorously and recommends evaluating new interventions against interventions with established efficacy. Competencias para adolescentes con una sexualidad saludable (COMPAS) is a school-based HIV prevention program that has been shown to be effective in reducing sexual risk behaviors among adolescents in Spain. This study evaluates the efficacy of COMPAS program compared with a Spanish-culture adapted version of ¡Cuídate! (Take Care of Yourself), an evidence-based HIV prevention curriculum designed for Latino adolescents in the US. This cluster randomized controlled trial involved 1,563 adolescents attending 18 public high schools located in 5 provinces of Spain. The schools invited to participate were enrolled and randomly assigned to the three experimental conditions: COMPAS, ¡Cuídate!, and control group (CG; no intervention). Generalized estimating equation analyses revealed that both interventions improved attitudes toward people living with human immunodeficiency syndrome (HIV)/AIDS and the HIV test and increased HIV/sexually transmitted infection knowledge and intention to engage in safer sex behaviors compared with the CG. Although only COMPAS increased participants' sexual risk perception and attitude toward condom use compared with the CG, the two interventions did not significantly differ on any outcome. When compared with an established program, COMPAS was at least as effective at increasing the intention to engage in safer sex behaviors as the evidence-based intervention. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

  9. Teaching and assessment of ethics and professionalism: a survey of pediatric program directors.

    PubMed

    Cook, Alyssa F; Sobotka, Sarah A; Ross, Lainie F

    2013-01-01

    The Accreditation Council for Graduate Medical Education requires residency programs to provide instruction in and evaluation of competency in ethics and professionalism. We examined current practices and policies in ethics and professionalism in pediatric training programs, utilization of newly available resources on these topics, and recent concerns about professional behavior raised by social media. From May to August 2012, members of the Association of Pediatric Program Directors identified as categorical program directors in the APPD database were surveyed regarding ethics and professionalism practices in their programs, including structure of their curricula, methods of trainee assessment, use of nationally available resources, and policies regarding social media. The response rate was 61% (122 of 200). Most pediatric programs continue to teach ethics and professionalism in an unstructured manner. Many pediatric program directors are unaware of available ethics and professionalism resources. Although most programs lack rigorous evaluation of trainee competency in ethics and professionalism, 30% (35 of 116) of program directors stated they had not allowed a trainee to graduate or sit for an examination because of unethical or unprofessional conduct. Most programs do not have formal policies regarding social media use by trainees, and expectations vary widely. Pediatric training programs are slowly adopting the educational mandates for ethics and professionalism instruction. Resources now exist that can facilitate curriculum development in both traditional content areas such as informed consent and privacy as well as newer content areas such as social media use. Copyright © 2013 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

  10. Process evaluation of a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus.

    PubMed

    Odgers-Jewell, Kate; Isenring, Elisabeth; Thomas, Rae; Reidlinger, Dianne P

    2017-07-01

    The present study developed and evaluated a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus. Two frameworks, the Medical Research Council (MRC) framework for developing and evaluating complex interventions and the RE-AIM framework were followed. Data to develop the intervention were sourced from scoping of the literature and formative evaluation. Program evaluation comprised analysis of primary recruitment of participants through general practitioners, baseline and end-point measures of anthropometry, four validated questionnaires, contemporaneous facilitator notes and telephone interviews with participants. A total of 16 participants enrolled in the intervention. Post-intervention results were obtained from 13 participants, with an estimated mean change from baseline in weight of -0.72 kg (95%CI -1.44 to -0.01), body mass index of -0.25 kg/m 2 (95%CI -0.49 to -0.01) and waist circumference of -1.04 cm (95%CI -4.52 to 2.44). The group education program was acceptable to participants. The results suggest that recruitment through general practitioners is ineffective, and alternative recruitment strategies are required. This patient-centred, patient-directed, group-based intervention for the management of type 2 diabetes mellitus was both feasible and acceptable to patients. Health professionals should consider the combined use of the MRC and RE-AIM frameworks in the development of interventions to ensure a rigorous design process and to enable the evaluation of all phases of the intervention, which will facilitate translation to other settings. Further research with a larger sample trialling additional recruitment strategies, evaluating further measures of effectiveness and utilising lengthier follow-up periods is required. © 2016 Dietitians Association of Australia.

  11. School-based violence prevention strategy: a pilot evaluation

    PubMed Central

    Thakore, Rachel V.; Apfeld, Jordan C.; Johnson, Ronald K.; Sathiyakumar, Vasanth; Jahangir, A. Alex; Sethi, Manish K.

    2015-01-01

    Abstract: Background: Violence has recently been reported among a primarily young, minority population in Nashville, Tennessee. School-based programs have been proven as effective methods of reducing violent behavior, beliefs, and actions that lead to violence among adolescents. Methods: Investigators implemented a rigorous search for an appropriate school-based violence prevention program for Metropolitan Nashville middle school students utilizing a systematic review and discussion group with victims of violence. 27 programs nation-wide were reviewed and 2 discussion groups with African American males under the age of 25 admitted to a level 1 trauma center for assault-related injuries were conducted. Our findings led to a single, evidence-based conflict resolution program. In conjunction with educators, we evaluated the program’s effectiveness in a pilot study in a Nashville middle school with high rates of violence. Results: 122 students completed the conflict resolution program and described their behavior and experiences with violence in a pre-test/post-test self-rate questionnaire. Results showed a significant decrease in violent behavior and an increase in students’ competencies to deal with violence (p less than 0.05). Conclusions: This study shows that a reduction in violent behavior and beliefs among middle school students can be achieved through the implementation of a targeted violence intervention program. A larger-scale intervention is needed to develop more conclusive evidence of effectiveness. PMID:24879077

  12. Curricula for teaching clinical practice guidelines in US psychiatry residency and child and adolescent fellowship programs: a survey study.

    PubMed

    Bannister, Elizabeth; Nakonezny, Paul; Byerly, Matthew

    2014-04-01

    To determine the characteristics of curricula for teaching the content of clinical practice guidelines (CPGs) in psychiatric residency and child and adolescent fellowship programs as well as to determine if and how the learning of CPG content is applied in clinical care settings. We conducted a national online survey of directors of general psychiatry residency and child and adolescent fellowship programs in the USA. The survey questionnaire included 13 brief questions about the characteristics used to teach CPGs in the programs, as well as two demographic questions about each program and director. Descriptive statistics were reported for each questionnaire item by program classification (i.e., child and adolescent vs. general psychiatry). The survey response rate was 49.8% (146 out of 293). Just 23% of programs reported having written goals and objectives related to teaching CPGs. The most frequently taught aspect of CPGs was their content (72% of programs). Didactic sessions were the most frequently employed teaching strategy (79% of programs). Regarding the application of CPG learning in treatment care settings, just 16% of programs applied algorithms in care settings, and 15% performed evaluations to determine consistency between CPG recommendations and care delivery. Only 8% of programs utilized audit and feedback to residents about their adherence to CPGs. Faculty time constraints and insufficient interest were the leading barriers (39% and 33% of programs, respectively) to CPG teaching, although 38% reported no barriers. However, child and adolescent programs less commonly identified insufficient interest among faculty as a barrier to teaching CPGs compared to general programs (20% vs. 43%). Moreover, compared to general programs, child and adolescent fellowship programs taught more aspects of CPGs, used more educational activities to teach the content of specific CPGs, and used more methods to evaluate the teaching of CPGs. Although the majority of programs provided some teaching of CPGs, the rigorousness of the teaching approaches was limited, especially attempts to evaluate the extent and effectiveness of their use in clinical care. Child and adolescent fellowship programs provided more extensive teaching and evaluation related to CPGs.

  13. The US Food and Drug Administration's expedited approval programs: Evidentiary standards, regulatory trade-offs, and potential improvements.

    PubMed

    Wallach, Joshua D; Ross, Joseph S; Naci, Huseyin

    2018-06-01

    The US Food and Drug Administration has several regulatory programs and pathways to expedite the development and approval of therapeutic agents aimed at treating serious or life-debilitating conditions. A common feature of these programs is the regulatory flexibility, which allows for a customized approval approach that enables market authorization on the basis of less rigorous evidence, in exchange for requiring postmarket evidence generation. An increasing share of therapeutic agents approved by the Food and Drug Administration in recent years are associated with expedited programs. In this article, we provide an overview of the evidentiary standards required by the Food and Drug Administration's expedited development and review programs, summarize the findings of the recent academic literature demonstrating some of the limitations of these programs, and outline potential opportunities to address these limitations. Recent evidence suggests that therapeutic agents in the Food and Drug Administration's expedited programs are approved on the basis of fewer and smaller studies that may lack comparator groups and random allocation, and rather than focusing on clinical outcomes for study endpoints, rely instead on surrogate markers of disease. Once on the market, agents receiving expedited approvals are often quickly incorporated into clinical practice, and evidence generated in the postmarket period may not necessarily address the evidentiary limitations at the time of market entry. Furthermore, not all pathways require additional postmarket studies. Evidence suggests that drugs in expedited approval programs are associated with a greater likelihood that the Food and Drug Administration will take a safety action following market entry. There are several opportunities to improve the timeliness, information value, and validity of the pre- and postmarket studies of therapeutic agents receiving expedited approvals. When use of nonrandomized and uncontrolled studies cannot be avoided prior to market entry, randomized trials should be mandatory in the postmarket period, unless there are strong justifications for not carrying out such studies. In the premarket period, validity of the surrogate markers can be improved by more rigorously evaluating their correlation with patient-relevant clinical outcomes. Opportunities to reduce the duration, complexity, and cost of postmarket randomized trials should not compromise their validity and instead incorporate pragmatic "real-world" design elements. Despite recent enthusiasm for widely using real-world evidence, adaptive designs, and pragmatic trials in the regulatory setting, caution is warranted until large-scale empirical evaluations demonstrate their validity compared to more traditional trial designs.

  14. Assessing the present state and potential of Medicaid controlled substance lock-in programs.

    PubMed

    Roberts, Andrew W; Skinner, Asheley Cockrell

    2014-05-01

    Nonmedical use of prescription medications--particularly controlled substances--has risen dramatically in recent decades, resulting in alarming increases in overdose-related health care utilization, costs, and mortality. The Centers for Disease Control and Prevention estimate that 80% of abused and misused controlled substances originate as legal prescriptions. As such, policymakers and payers have the opportunity to combat nonmedical use by regulating controlled substance accessibility within legal prescribing and dispensing processes. One common policy strategy is found in Medicaid controlled substance lock-in programs. Lock-in programs identify Medicaid beneficiaries exhibiting high-risk controlled substance seeking behavior and "lock in" these patients to, typically, a single prescriber and pharmacy from which they may obtain Medicaid-covered controlled substance prescriptions. Lock-in restrictions are intended to improve care coordination between providers, reduce nonmedical use behaviors, and limit Medicaid costs stemming from nonmedical use and diversion. Peer-reviewed and gray literature have been examined to assess the current prevalence and design of Medicaid lock-in programs, as well as the current evidence base for informing appropriate program design and understanding program effectiveness. Forty-six state Medicaid agencies currently operate lock-in programs. Program design varies widely between states in terms of defining high-risk controlled substance use, the scope of actual lock-in restrictions, and length of program enrollment. Additionally, there is a remarkable dearth of peer-reviewed literature evaluating the design and effectiveness of Medicaid lock-in programs. Nearly all outcomes evidence stemmed from publicly accessible internal Medicaid program evaluations, which largely investigated cost savings to the state. Lock-in programs are highly prevalent and poised to play a meaningful role in curbing the prescription drug abuse epidemic. However, achieving these ends requires a concerted effort from the academic and policy communities to rigorously evaluate the effect of lock-in programs on patient outcomes, determine optimal program design, and explore opportunities to enhance lock-in program impact through coordination with parallel controlled substance policy efforts, namely prescription drug-monitoring programs.

  15. NASA Collaborative Approach Mitigates Environmentally-Driven Obsolescence

    NASA Technical Reports Server (NTRS)

    Greene, Brian; Leeney, Bob; Richards, Joni

    2016-01-01

    National Aeronautics and Space Administration (NASA) missions, like Department of Defense (DoD) organizations, require the rigorous testing and qualification of critical materials. Obsolescence supply risks created by environmental requirements can affect the cost, schedule and performance of NASA missions and the resilience of critical infrastructure. The NASA Technology Evaluation for Environmental Risk Mitigation (TEERM) Principal Center helps to identify obsolescence supply risks driven by environmental requirements and works proactively with NASA Centers and Programs, the DoD, the European Space Agency (ESA) and other agencies and partners to identify and evaluate environmentally friendly alternatives. TEERM tracks environmental regulations, identifies the potential loss of material availability and works with NASA programs and Centers to evaluate potential impacts through a risk assessment approach. TEERM collaborative projects identify, demonstrate and evaluate commercially viable alternative technologies and materials. A major focus during the Space Shuttle Program was the need to replace ozone depleting substances that were used in spray foam and cleaning applications. The potential obsolescence of coatings containing hexavalent chromium and the risks associated with lead free solder were also of concern for the Space Shuttle and present ongoing risks to new programs such as the Space Launch System. One current project teams NASA and ESA in the evaluation and testing of individual coatings and coating systems as replacements for hexavalent chromium coatings in aerospace applications. The proactive, collaborative approach used by TEERM helps reduce the cost burden on any one team partner, reduces duplication of effort, and enhances the technical quality and overall applicability of the testing and analysis.

  16. Television camera as a scientific instrument

    NASA Technical Reports Server (NTRS)

    Smokler, M. I.

    1970-01-01

    Rigorous calibration program, coupled with a sophisticated data-processing program that introduced compensation for system response to correct photometry, geometric linearity, and resolution, converted a television camera to a quantitative measuring instrument. The output data are in the forms of both numeric printout records and photographs.

  17. 3 CFR 8761 - Proclamation 8761 of November 30, 2011. National Impaired Driving Prevention Month, 2011

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... take action by promoting rigorous enforcement measures and effective substance abuse prevention programs. During National Impaired Driving Prevention Month, we recommit to preventing tragedy before it... efforts, implement more effective legislation, and support successful, evidence-based prevention programs...

  18. The American Science Pipeline: Sustaining Innovation in a Time of Economic Crisis

    ERIC Educational Resources Information Center

    Hue, Gillian; Sales, Jessica; Comeau, Dawn; Lynn, David G.; Eisen, Arri

    2010-01-01

    Significant limitations have emerged in America's science training pipeline, including inaccessibility, inflexibility, financial limitations, and lack of diversity. We present three effective programs that collectively address these challenges. The programs are grounded in rigorous science and integrate through diverse disciplines across…

  19. More than Just a Lack of Uniformity: Exploring the Evolution of Public Relations Master's Programs

    ERIC Educational Resources Information Center

    Briones, Rowena L.; Shen, Hongmei; Parrish, Candace; Toth, Elizabeth L.; Russell, Maria

    2017-01-01

    Public relations is well known for its adaptability through continual change, and as a result, public relations master's programs have been re-conceptualized to remain rigorous and competitive. To further assess both the state and changes of these programs, 20 in-depth interviews were conducted with administrators of public relations master's…

  20. From Stress to Success: How Stress Coping Strategies and Emotional Intelligence Affect Student Success in Healthcare Programs

    ERIC Educational Resources Information Center

    Barnhardt, Wendy K.

    2017-01-01

    Healthcare programs attract a large number of students but can only accept limited numbers into academically rigorous and demanding courses that lead to sometimes stressful careers. The purpose of this study was to determine the perceived stressors of healthcare program students and the extent to which these students demonstrated emotional…

  1. Expanding Opportunities for High Academic Achievement: An International Baccalaureate Diploma Program in an Urban High School

    ERIC Educational Resources Information Center

    Mayer, Anysia P.

    2008-01-01

    Students of color are consistently underrepresented in honors and gifted programs nationwide, and even high-achieving students share many of the risk factors with their low-achieving peers. The study presented in this paper employed mixed methods to investigate the relationship between the design of a rigorous college preparatory program, the…

  2. Communicating the Value of Program-Level Accreditation for Information Systems in a College of Business

    ERIC Educational Resources Information Center

    Babb, Jeffry S.; Abdullat, Amjad

    2014-01-01

    Undergraduate programs in Information Systems are challenged to offer a curriculum that is both rigorous and relevant. Specialized college-level accreditation, such as AACSB, and program-level accreditation, such as ABET, offer an opportunity to signal quality in academics while also remaining relevant to local stakeholders and constituents.…

  3. The International Baccalaureate Diploma Program's Impacting High School Culture and Climate

    ERIC Educational Resources Information Center

    Duarte, George

    2013-01-01

    School reformers are often searching for a program that will have a positive and far-reaching effect on a school campus. Researchers and writers have described the International Baccalaureate Diploma Program (IB DP) as a largely positive influence on a school campus, providing a rigorous and standards-based curriculum to IB DP students. However,…

  4. New Challenges Facing Small Undergraduate Departments And The Role Of Faculty And Administrators.

    NASA Astrophysics Data System (ADS)

    El-Shazly, A. K.

    2003-12-01

    Small geoscience departments with 5 faculty members or less in undergraduate institutions are facing serious challenges that will have a profound impact on their future, as well as the future of geoscience education. In addition to past and future budget cuts that affect all departments, small departments are more vulnerable to such problems as (i) decreased enrollments in introductory level classes, (ii) small number of geology majors, (iii) small number of graduates per year (iv) lack or paucity of equipment necessary for faculty and student research, (v) limited opportunities for external funding, (vi) need to offer upper division classes on an alternate year basis, (vii) difficulty in recruiting and retaining students, (viii) high teaching loads for faculty, and (ix) designing rigorous curricula based on 120 credit hours with a significant component of liberal art classes. These problems pose new challenges for faculty, department chairs and administrators. Faculty need to design curricula tailored to the need of the job market, without compromising rigor or the quality of the program. New classes/ concentrations in environmental science, hydrogeology and geographical information systems should be offered, and traditional classes in petrology, geophysics and tectonics should be maintained. Classes in Physics, Chemistry and Math should be core requirements. Student involvement in research should be encouraged at an early stage (sophomore/ junior levels). Department chairs need to assign duties in their department carefully to capitalize on the strengths of their faculty: faculty with strong research backgrounds should be helped in their efforts to pursue external funding opportunities, whereas those with strong teaching abilities should be evaluated primarily on their performance in the classroom. Student credit hour production should not be used as a criterion for evaluating faculty. Administrators should evaluate programs and departments based on the success of their graduates in the workplace/ graduate school, not their numbers, and the quality of faculty research and its impact on attracting new majors and acquisition of funds.

  5. Two food-assisted maternal and child health nutrition programs helped mitigate the impact of economic hardship on child stunting in Haiti.

    PubMed

    Donegan, Shannon; Maluccio, John A; Myers, Caitlin K; Menon, Purnima; Ruel, Marie T; Habicht, Jean-Pierre

    2010-06-01

    Rigorous evaluations of food-assisted maternal and child health and nutrition programs are stymied by the ethics of randomizing recipients to a control treatment. Using nonexperimental matching methods, we evaluated the effect of 2 such programs on child linear growth in Haiti. The 2 well-implemented programs offered the same services (food assistance, behavior change communication, and preventive health services) to pregnant and lactating women and young children. They differed in that one (the preventive program) used blanket targeting of all children 6-23 mo, whereas the other (the recuperative program) targeted underweight (weight-for-age Z score < -2) children 6-59 mo, as traditionally done. We estimated program effects on height-for-age Z scores (HAZ) and stunting (HAZ < -2) by comparing outcomes of children in program areas with matched children from comparable populations in the Haiti Demographic and Health Survey. Children 12-41 mo in the preventive and recuperative program areas had lower prevalence of stunting than those in the matched control group [16 percentage points (pp) lower in preventive and 11 pp in recuperative]. Children in the 2 program areas also were more likely than those in the matched control group to be breast-fed up to 24 mo (25 pp higher in preventive, 22 in recuperative) and children 12 mo and older were more likely to have received the recommended full schedule of vaccinations (32 pp higher in preventive, 31 in recuperative). Both programs improved targeted behaviors and protected child growth in a time of deteriorating economic circumstances.

  6. Interventions to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review.

    PubMed

    Clifford, Anton; McCalman, Janya; Bainbridge, Roxanne; Tsey, Komla

    2015-04-01

    This article describes the characteristics and reviews the methodological quality of interventions designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, Canada and the USA. A total of 17 electronic databases and 13 websites for the period of 2002-13. Studies were included if they evaluated an intervention strategy designed to improve cultural competency in health care for Indigenous peoples of Australia, New Zealand, the USA or Canada. Information on the characteristics and methodological quality of included studies was extracted using standardized assessment tools. Sixteen published evaluations of interventions to improve cultural competency in health care for Indigenous peoples were identified: 11 for Indigenous peoples of the USA and 5 for Indigenous Australians. The main types of intervention strategies were education and training of the health workforce, culturally specific health programs and recruitment of an Indigenous health workforce. Main positive outcomes reported were improvements in health professionals' confidence, and patients' satisfaction with and access to health care. The methodological quality of evaluations and the reporting of key methodological criteria were variable. Particular problems included weak study designs, low or no reporting of consent rates, confounding and non-validated measurement instruments. There is a lack of evidence from rigorous evaluations on the effectiveness of interventions for improving cultural competency in health care for Indigenous peoples. Future evaluations should employ more rigorous study designs and extend their measurement of outcomes beyond those relating to health professionals, to those relating to the health of Indigenous peoples. © The Author 2015. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

  7. Research on Captive Broodstock Programs for Pacific Salmon, 2001-2002 Annual Report.

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Berejikian, Barry A.; Tezak, E.P.; Endicott, Rick

    In the 2000 Federal Columbia River Power System (FCRPS) Biological Opinion, NMFS identified six populations of steelhead and several salmon populations that had dropped to critically low levels and continue to decline. Following thorough risk-benefit analyses, captive propagation programs for some or all of the steelhead (Oncorhynchus mykiss) populations may be required to reduce the risk of extinction, and more programs may be required in the future. Thus, captive propagation programs designed to maintain or rebuild steelhead populations require intensive and rigorous scientific evaluation, much like the other objectives of BPA Project 1993-056-00 currently underway for chinook (O. tshawytscha) andmore » sockeye salmon (O. nerka). Pacific salmon reared to the adult stage in captivity exhibit poor reproductive performance when released to spawn naturally. Poor fin quality and swimming performance, incomplete development of secondary sex characteristics, changes in maturation timing, and other factors may contribute to reduced spawning success. Improving natural reproductive performance is critical for the success of captive broodstock programs in which adult-release is a primary reintroduction strategy for maintaining ESA-listed populations.« less

  8. Spatial scaling and multi-model inference in landscape genetics: Martes americana in northern Idaho

    Treesearch

    Tzeidle N. Wasserman; Samuel A. Cushman; Michael K. Schwartz; David O. Wallin

    2010-01-01

    Individual-based analyses relating landscape structure to genetic distances across complex landscapes enable rigorous evaluation of multiple alternative hypotheses linking landscape structure to gene flow. We utilize two extensions to increase the rigor of the individual-based causal modeling approach to inferring relationships between landscape patterns and gene flow...

  9. Soil moisture and temperature algorithms and validation

    USDA-ARS?s Scientific Manuscript database

    Passive microwave remote sensing of soil moisture has matured over the past decade as a result of the Advanced Microwave Scanning Radiometer (AMSR) program of JAXA. This program has resulted in improved algorithms that have been supported by rigorous validation. Access to the products and the valida...

  10. All Children Deserve Uninterrupted Learning!

    ERIC Educational Resources Information Center

    Brown, Fred

    2015-01-01

    Teachers often start a new school year working extremely hard to reteach last year's content, particularly for their lower income students. According to "Making Summer Count," a report commissioned by The Wallace Foundation and written by researchers at Rand, rigorous studies of voluntary summer programs, mandatory summer programs, and…

  11. Translational educational research: a necessity for effective health-care improvement.

    PubMed

    McGaghie, William C; Issenberg, S Barry; Cohen, Elaine R; Barsuk, Jeffrey H; Wayne, Diane B

    2012-11-01

    Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research.

  12. [Regulatory Program for Medical Devices in Cuba: experiences and current challenges].

    PubMed

    Pereira, Dulce María Martínez; Rodríguez, Yadira Álvarez; Valdés, Yamila Cedeño; Ribas, Silvia Delgado

    2016-05-01

    Regulatory control of medical devices in Cuba is conducted through a system based on the Regulatory Program for Medical Devices as a way to ensure the safety, efficacy, and effectiveness of these technologies, which are in use by the National Health System. This program was launched in 1992, when the Regulations for State Evaluation and Registration of Medical Devices were approved. Its successive stages and the merging of regulatory activities for drugs and medical equipment have meant progress toward stronger, more transparent strategies and greater control of industry and the National Health System. Throughout its course the Cuban program has met with challenges and difficulties that it has addressed by drawing on its own experiences. During the new period, the greatest challenges revolve around ensuring that regulatory systems incorporate scientific evaluation, risk levels, maximum rigor through the use of technical standards, and the implementation of international recommendations, together with the application of the ISO 13485 certification scheme, enhanced market monitoring, and classification of medical devices in accordance with their relevance to the country's national health policies. From the regional standpoint, the greatest challenge lies in working toward regulatory convergence. The Collaborating Centre for the Regulation of Health Technologies will support the proposed regulatory strategy and established regional priorities, in particular in connection with the implementation of actions involving medical devices.

  13. Quasi-experimental study designs series-paper 13: realizing the full potential of quasi-experiments for health research.

    PubMed

    Rockers, Peter C; Tugwell, Peter; Røttingen, John-Arne; Bärnighausen, Till

    2017-09-01

    Although the number of quasi-experiments conducted by health researchers has increased in recent years, there clearly remains unrealized potential for using these methods for causal evaluation of health policies and programs globally. This article proposes five prescriptions for capturing the full value of quasi-experiments for health research. First, new funding opportunities targeting proposals that use quasi-experimental methods should be made available to a broad pool of health researchers. Second, administrative data from health programs, often amenable to quasi-experimental analysis, should be made more accessible to researchers. Third, training in quasi-experimental methods should be integrated into existing health science graduate programs to increase global capacity to use these methods. Fourth, clear guidelines for primary research and synthesis of evidence from quasi-experiments should be developed. Fifth, strategic investments should be made to continue to develop new innovations in quasi-experimental methodologies. Tremendous opportunities exist to expand the use of quasi-experimental methods to increase our understanding of which health programs and policies work and which do not. Health researchers should continue to expand their commitment to rigorous causal evaluation with quasi-experimental methods, and international institutions should increase their support for these efforts. Copyright © 2017 Elsevier Inc. All rights reserved.

  14. Doctor coach: a deliberate practice approach to teaching and learning clinical skills.

    PubMed

    Gifford, Kimberly A; Fall, Leslie H

    2014-02-01

    The rapidly evolving medical education landscape requires restructuring the approach to teaching and learning across the continuum of medical education. The deliberate practice strategies used to coach learners in disciplines beyond medicine can also be used to train medical learners. However, these deliberate practice strategies are not explicitly taught in most medical schools or residencies. The authors designed the Doctor Coach framework and competencies in 2007-2008 to serve as the foundation for new faculty development and resident-as-teacher programs. In addition to teaching deliberate practice strategies, the programs model a deliberate practice approach that promotes the continuous integration of newly developed coaching competencies by participants into their daily teaching practice. Early evaluation demonstrated the feasibility and efficacy of implementing the Doctor Coach framework across the continuum of medical education. Additionally, the Doctor Coach framework has been disseminated through national workshops, which have resulted in additional institutions applying the framework and competencies to develop their own coaching programs. Design of a multisource evaluation tool based on the coaching competencies will enable more rigorous study of the Doctor Coach framework and training programs and provide a richer feedback mechanism for participants. The framework will also facilitate the faculty development needed to implement the milestones and entrustable professional activities in medical education.

  15. The case for addressing gender and power in sexuality and HIV education: a comprehensive review of evaluation studies.

    PubMed

    Haberland, Nicole A

    2015-03-01

    Curriculum-based sexuality and HIV education is a mainstay of interventions to prevent STIs, HIV and unintended pregnancy among young people. Evidence links traditional gender norms, unequal power in sexual relationships and intimate partner violence with negative sexual and reproductive health outcomes. However, little attention has been paid to analyzing whether addressing gender and power in sexuality education curricula is associated with better outcomes. To explore whether the inclusion of content on gender and power matters for program efficacy, electronic and hand searches were conducted to identify rigorous sexuality and HIV education evaluations from developed and developing countries published between 1990 and 2012. Intervention and study design characteristics of the included interventions were disaggregated by whether they addressed issues of gender and power. Of the 22 interventions that met the inclusion criteria, 10 addressed gender or power, and 12 did not. The programs that addressed gender or power were five times as likely to be effective as those that did not; fully 80% of them were associated with a significantly lower rate of STIs or unintended pregnancy. In contrast, among the programs that did not address gender or power, only 17% had such an association. Addressing gender and power should be considered a key characteristic of effective sexuality and HIV education programs.

  16. DEVELOPMENT OF IMPROVED FABRICATION METHODS, PROCESS AND TECHNIQUES FOR PRODUCING TYPICAL AIRCRAFT SHAPES FROM BERYLLIUM. Interim Technical Documentary Progress Report for the Period ending October 31, 1962

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Jenkins, R.G.; Siergiej, J.M.

    1962-12-28

    In a program to develop a complete manufacturing process for ihe production of beryllium channels, techniques are being sought for drawing to obtain a flnal product meeting specifications more rigorous than are obtainable by direct extrusion. Progress in designing and procuring the special tooling required to draw complex shapes at elevated temperature is described, and the flrst set of draw dies is evaluated with respect to design and quality. Three experimental draw attempts have been made on U-channels, in addition to draw tests on flats. (auth)

  17. Keys to the House: Unlocking Residential Savings With Program Models for Home Energy Upgrades

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Grevatt, Jim; Hoffman, Ian; Hoffmeyer, Dale

    After more than 40 years of effort, energy efficiency program administrators and associated contractors still find it challenging to penetrate the home retrofit market, especially at levels commensurate with state and federal goals for energy savings and emissions reductions. Residential retrofit programs further have not coalesced around a reliably successful model. They still vary in design, implementation and performance, and they remain among the more difficult and costly options for acquiring savings in the residential sector. If programs are to contribute fully to meeting resource and policy objectives, administrators need to understand what program elements are key to acquiring residentialmore » savings as cost effectively as possible. To that end, the U.S. Department of Energy (DOE) sponsored a comprehensive review and analysis of home energy upgrade programs with proven track records, focusing on those with robustly verified savings and constituting good examples for replication. The study team reviewed evaluations for the period 2010 to 2014 for 134 programs that are funded by customers of investor-owned utilities. All are programs that promote multi-measure retrofits or major system upgrades. We paid particular attention to useful design and implementation features, costs, and savings for nearly 30 programs with rigorous evaluations of performance. This meta-analysis describes program models and implementation strategies for (1) direct install retrofits; (2) heating, ventilating and air-conditioning (HVAC) replacement and early retirement; and (3) comprehensive, whole-home retrofits. We analyze costs and impacts of these program models, in terms of both energy savings and emissions avoided. These program models can be useful guides as states consider expanding their strategies for acquiring energy savings as a resource and for emissions reductions. We also discuss the challenges of using evaluations to create program models that can be confidently applied in multiple jurisdictions.« less

  18. A randomized controlled evaluation of a secondary school mindfulness program for early adolescents: Do we have the recipe right yet?

    PubMed

    Johnson, Catherine; Burke, Christine; Brinkman, Sally; Wade, Tracey

    2017-12-01

    Mindfulness is being promoted in schools as a prevention program despite a current small evidence base. The aim of this research was to conduct a rigorous evaluation of the .b ("Dot be") mindfulness curriculum, with or without parental involvement, compared to a control condition. In a randomized controlled design, students (M age 13.44, SD 0.33; 45.4% female) across a broad range of socioeconomic indicators received the nine lesson curriculum delivered by an external facilitator with (N = 191) or without (N = 186) parental involvement, or were allocated to a usual curriculum control group (N = 178). Self-report outcome measures were anxiety, depression, weight/shape concerns, wellbeing and mindfulness. There were no differences in outcomes between any of the three groups at post-intervention, six or twelve month follow-up. Between-group effect sizes (Cohen's d) across the variables ranged from 0.002 to 0.37. A wide range of moderators were examined but none impacted outcome. Further research is required to identify the optimal age, content and length of mindfulness programs for adolescents in universal prevention settings. ACTRN12615001052527. Copyright © 2017 Elsevier Ltd. All rights reserved.

  19. Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

    PubMed

    Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

    2017-01-01

    Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

  20. The Advanced Placement Program Benefits Mainly Well-Prepared Students Who Pass AP Exams. Issues in College Readiness

    ERIC Educational Resources Information Center

    National Center for Educational Achievement, 2010

    2010-01-01

    Many policymakers and education leaders have embraced the Advanced Placement (AP) Program as a tool to strengthen the high school curriculum and prepare students for college. The popularity of the AP program among these policy leaders reflects their belief that the traditional high school curriculum has often failed to provide rigorous courses…

  1. Who Chooses, Who Uses? Initial Evidence from the D.C. Opportunity Scholarship Program

    ERIC Educational Resources Information Center

    Wolf, Patrick; Eissa, Nada; Gutmann, Babette

    2006-01-01

    The federal government recently enacted its first school voucher program as a pilot project in the District of Columbia. To be eligible, students need to be entering grades K-12 and have a family income at or below 185 percent of the poverty level. Although a rigorous analysis of the Opportunity Scholarship Program's impact on student achievement…

  2. Increasing Academic Rigor through Comprehensive, Ongoing Professional Development in Rural Special Education: A Description of the SPLASH Program

    ERIC Educational Resources Information Center

    Courtade, Ginevra R.; Shipman, Stacy D.; Williams, Rachel

    2017-01-01

    SPLASH is a 3-year professional development program designed to work with classroom teachers of students with moderate and severe disabilities. The program targets new teachers and employs methods aimed at supporting rural classrooms. The training content focuses on evidence-based practices in English language arts, mathematics, and science, as…

  3. Test Scores Soar: A Comparision Study of 7th Grade Students with Disabilities Math Achievement in Full Inclusion and Self-Contained Special Education Programs

    ERIC Educational Resources Information Center

    Floyd, Donise

    2014-01-01

    Educational institutions are placing students with disabilities in inclusive programming to meet legislative requirements. School districts have been mandated to develop rigorous programs that can increase the academic achievement of students with disabilities, as well as their participation in general education classrooms. Many school districts,…

  4. Underprepared Students' Performance on Algebra in a Double-Period High School Mathematics Program

    ERIC Educational Resources Information Center

    Martinez, Mara V.; Bragelman, John; Stoelinga, Timothy

    2016-01-01

    The primary goal of the Intensified Algebra I (IA) program is to enable mathematically underprepared students to successfully complete Algebra I in 9th grade and stay on track to meet increasingly rigorous high school mathematics graduation requirements. The program was designed to bring a range of both cognitive and non-cognitive supports to bear…

  5. Better Service through Data: Wai Sze (Lacey) Chan--Queens Borough Public Library, Jamaica, NY

    ERIC Educational Resources Information Center

    Library Journal, 2004

    2004-01-01

    The New Americans Program at Queens Borough Public Library (QBPL) is well known for the innovative collections and programs it provides to one of the nation's most diverse communities. What is less known is the rigorous analysis of demographic data that provides direction to the program. Wai Sze (Lacey) Chan uses demographics to create as complete…

  6. A Profile of School-Based Enterprises within CTE Disciplines

    ERIC Educational Resources Information Center

    Haltinner, Urs; Mooney, Carol; Stanislawski, Debbie

    2012-01-01

    It is imperative that career and technical education (CTE) utilize research-proven pedagogy. Pushing on relevance to arrive at rigor provides an opportunity for "limited" and "perpetual duration" real-world learning experiences to be implemented within every contemporary CTE program. This study describes how secondary CTE programs are currently…

  7. A Novel Approach to Physiology Education for Biomedical Engineering Students

    ERIC Educational Resources Information Center

    DiCecco, J.; Wu, J.; Kuwasawa, K.; Sun, Y.

    2007-01-01

    It is challenging for biomedical engineering programs to incorporate an indepth study of the systemic interdependence of cells, tissues, and organs into the rigorous mathematical curriculum that is the cornerstone of engineering education. To be sure, many biomedical engineering programs require their students to enroll in anatomy and physiology…

  8. Review of "A New Agenda: Research to Build a Better Teacher Preparation Program"

    ERIC Educational Resources Information Center

    Cochran-Smith, Marilyn; Burton, Stephani; Carney, Molly Cummings; Sánchez, Juan Gabriel; Miller, Andrew F.

    2017-01-01

    Bellwether Education Partners' report, "A New Agenda," calls for a "rational" and "rigorous" research agenda for teacher education. Although the report's rationale is not fully explicated, it asserts that programs are "blindly swinging from one popular reform to the next" and that decades of input- and…

  9. Exploring in Aeronautics. An Introduction to Aeronautical Sciences.

    ERIC Educational Resources Information Center

    National Aeronautics and Space Administration, Cleveland, OH. Lewis Research Center.

    This curriculum guide is based on a year of lectures and projects of a contemporary special-interest Explorer program intended to provide career guidance and motivation for promising students interested in aerospace engineering and scientific professions. The adult-oriented program avoids technicality and rigorous mathematics and stresses real…

  10. 75 FR 13745 - Office of Innovation and Improvement Overview Information; Ready To Teach Program-General...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-03-23

    ... on rigorous, scientifically based research methods to assess the effectiveness of a particular... and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw on... hypotheses and justify the general conclusions drawn; (iii) Relies on measurements or observational methods...

  11. Putting Paraeducators on the Path to Teacher Certification

    ERIC Educational Resources Information Center

    Morrison, Judith; Lightner, Lindsay

    2017-01-01

    In response to local districts' needs for certified teachers with community roots who understand local schools and students, the authors developed an innovative alternative route for paraprofessionals based on a traditional bachelor's program. Their goals were to provide a rigorous, research-based program that allows paraprofessionals to get a…

  12. GCOM-W soil moisture and temperature algorithms and validation

    USDA-ARS?s Scientific Manuscript database

    Passive microwave remote sensing of soil moisture has matured over the past decade as a result of the Advanced Microwave Scanning Radiometer (AMSR) program of JAXA. This program has resulted in improved algorithms that have been supported by rigorous validation. Access to the products and the valida...

  13. Balancing Stakeholders' Interests in Evolving Teacher Education Accreditation Contexts

    ERIC Educational Resources Information Center

    Elliott, Alison

    2008-01-01

    While Australian teacher education programs have long had rigorous accreditation pathways at the University level they have not been subject to the same formal public or professional scrutiny typical of professions such as medicine, nursing or engineering. Professional accreditation for teacher preparation programs is relatively new and is linked…

  14. Educating Women Leaders for the Twenty-First Century

    ERIC Educational Resources Information Center

    Trigg, Mary K.

    2006-01-01

    The Leadership Scholars Certificate Program at Rutgers University is an intellectually rigorous program that draws on the rich scholarship in gender studies to reimagine leadership, accelerate young women to leadership, and prepare them as educated citizens who will make a difference in the world. This article describes a leadership development…

  15. Perceptions of Secondary School Teachers and Administrators on Effective Professional Development Programs

    ERIC Educational Resources Information Center

    Sherrod, Ginnie

    2014-01-01

    Effective professional development programs have been linked with rigorous state standards and district school improvement goals. Despite efforts of local districts to meet state standards and district school improvement goals, there has been limited research at the local level that has compared administrators' and teachers' perceptions of…

  16. ARCHITECTURAL PROGRAMMING--STATE OF THE ART.

    ERIC Educational Resources Information Center

    EVANS, BENJAMIN H.

    IN RESPONSE TO A NEED FOR A MORE THOROUGH AND RIGOROUS STUDY AND ANALYSIS PROCESS IN ENVIRONMENTAL FUNCTIONS PRIOR TO THE DESIGN OF NEW BUILDINGS, A STUDY WAS UNDERTAKEN TO IDENTIFY THE EMERGING TECHNIQUES OF ARCHITECTURAL PROGRAMING PRACTICE. THE STUDY INCLUDED CORRESPONDENCE AND REVIEW OF PERIODICALS, QUESTIONNAIRES AND VISITATIONS, AND A…

  17. 34 CFR 668.2 - General definitions.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    .... (Authority: 20 U.S.C. 1078-1) Federal Work Study (FWS) program: The part-time employment program for students... degree; and (3) Has completed the equivalent of at least three years of full-time study either prior to... of study to eligible financially needy undergraduate students who successfully complete rigorous...

  18. Continuing Care in High Schools: A Descriptive Study of Recovery High School Programs

    ERIC Educational Resources Information Center

    Finch, Andrew J.; Moberg, D. Paul; Krupp, Amanda Lawton

    2014-01-01

    Data from 17 recovery high schools suggest programs are dynamic and vary in enrollment, fiscal stability, governance, staffing, and organizational structure. Schools struggle with enrollment, funding, lack of primary treatment accessibility, academic rigor, and institutional support. Still, for adolescents having received treatment for substance…

  19. International Review of the Development and Implementation of Energy Efficiency Standards and Labeling Programs

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Zhou, Nan; Zheng, Nina; Fridley, David

    2012-02-28

    Appliance energy efficiency standards and labeling (S&L) programs have been important policy tools for regulating the efficiency of energy-using products for over 40 years and continue to expand in terms of geographic and product coverage. The most common S&L programs include mandatory minimum energy performance standards (MEPS) that seek to push the market for efficient products, and energy information and endorsement labels that seek to pull the market. This study seeks to review and compare some of the earliest and most well-developed S&L programs in three countries and one region: the U.S. MEPS and ENERGY STAR, Australia MEPS and Energymore » Label, European Union MEPS and Ecodesign requirements and Energy Label and Japanese Top Runner programs. For each program, key elements of S&L programs are evaluated and comparative analyses across the programs undertaken to identify best practice examples of individual elements as well as cross-cutting factors for success and lessons learned in international S&L program development and implementation. The international review and comparative analysis identified several overarching themes and highlighted some common factors behind successful program elements. First, standard-setting and programmatic implementation can benefit significantly from a legal framework that stipulates a specific timeline or schedule for standard-setting and revision, product coverage and legal sanctions for non-compliance. Second, the different MEPS programs revealed similarities in targeting efficiency gains that are technically feasible and economically justified as the principle for choosing a standard level, in many cases at a level that no product on the current market could reach. Third, detailed survey data such as the U.S. Residential Energy Consumption Survey (RECS) and rigorous analyses provide a strong foundation for standard-setting while incorporating the participation of different groups of stakeholders further strengthen the process. Fourth, sufficient program resources for program implementation and evaluation are critical to the effectiveness of standards and labeling programs and cost-sharing between national and local governments can help ensure adequate resources and uniform implementation. Lastly, check-testing and punitive measures are important forms of enforcement while the cancellation of registration or product sales-based fines have also proven effective in reducing non-compliance. The international comparative analysis also revealed the differing degree to which the level of government decentralization has influenced S&L programs and while no single country has best practices in all elements of standards and labeling development and implementation, national examples of best practices for specific elements do exist. For example, the U.S. has exemplified the use of rigorous analyses for standard-setting and robust data source with the RECS database while Japan's Top Runner standard-setting principle has motivated manufacturers to exceed targets. In terms of standards implementation and enforcement, Australia has demonstrated success with enforcement given its long history of check-testing and enforcement initiatives while mandatory information-sharing between EU jurisdictions on compliance results is another important enforcement mechanism. These examples show that it is important to evaluate not only the drivers of different paths of standards and labeling development, but also the country-specific context for best practice examples in order to understand how and why certain elements of specific S&L programs have been effective.« less

  20. Monitoring and Evaluating the Transition of Large-Scale Programs in Global Health

    PubMed Central

    Bao, James; Rodriguez, Daniela C; Paina, Ligia; Ozawa, Sachiko; Bennett, Sara

    2015-01-01

    Purpose: Donors are increasingly interested in the transition and sustainability of global health programs as priorities shift and external funding declines. Systematic and high-quality monitoring and evaluation (M&E) of such processes is rare. We propose a framework and related guiding questions to systematize the M&E of global health program transitions. Methods: We conducted stakeholder interviews, searched the peer-reviewed and gray literature, gathered feedback from key informants, and reflected on author experiences to build a framework on M&E of transition and to develop guiding questions. Findings: The conceptual framework models transition as a process spanning pre-transition and transition itself and extending into sustained services and outcomes. Key transition domains include leadership, financing, programming, and service delivery, and relevant activities that drive the transition in these domains forward include sustaining a supportive policy environment, creating financial sustainability, developing local stakeholder capacity, communicating to all stakeholders, and aligning programs. Ideally transition monitoring would begin prior to transition processes being implemented and continue for some time after transition has been completed. As no set of indicators will be applicable across all types of health program transitions, we instead propose guiding questions and illustrative quantitative and qualitative indicators to be considered and adapted based on the transition domains identified as most important to the particular health program transition. The M&E of transition faces new and unique challenges, requiring measuring constructs to which evaluators may not be accustomed. Many domains hinge on measuring “intangibles” such as the management of relationships. Monitoring these constructs may require a compromise between rigorous data collection and the involvement of key stakeholders. Conclusion: Monitoring and evaluating transitions in global health programs can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Further investment and stronger methodological work are needed. PMID:26681706

  1. A Generalizability Investigation of Cognitive Demand and Rigor Ratings of Items and Standards in an Alignment Study

    ERIC Educational Resources Information Center

    Lombardi, Allison; Seburn, Mary; Conley, David; Snow, Eric

    2010-01-01

    In alignment studies, expert raters evaluate assessment items against standards and ratings are used to compute various alignment indices. Questions about rater reliability, however, are often ignored or inadequately addressed. This paper reports the results of a generalizability theory study of cognitive demand and rigor ratings of assessment…

  2. An intensive primary-literature-based teaching program directly benefits undergraduate science majors and facilitates their transition to doctoral programs.

    PubMed

    Kozeracki, Carol A; Carey, Michael F; Colicelli, John; Levis-Fitzgerald, Marc; Grossel, Martha

    2006-01-01

    UCLA's Howard Hughes Undergraduate Research Program (HHURP), a collaboration between the College of Letters and Science and the School of Medicine, trains a group of highly motivated undergraduates through mentored research enhanced by a rigorous seminar course. The course is centered on the presentation and critical analysis of scientific journal articles as well as the students' own research. This article describes the components and objectives of the HHURP and discusses the results of three program assessments: annual student evaluations, interviews with UCLA professors who served as research advisors for HHURP scholars, and a survey of program alumni. Students indicate that the program increased their ability to read and present primary scientific research and to present their own research and enhanced their research experience at UCLA. After graduating, they find their involvement in the HHURP helped them in securing admission to the graduate program of their choice and provided them with an advantage over their peers in the interactive seminars that are the foundation of graduate education. On the basis of the assessment of the program from 1998-1999 to 2004-2005, we conclude that an intensive literature-based training program increases student confidence and scientific literacy during their undergraduate years and facilitates their transition to postgraduate study.

  3. A Program Manager’s Guide for Program Improvement in Ongoing Psychological Health and Traumatic Brain Injury Programs. The RAND Toolkit, Volume 4

    DTIC Science & Technology

    2014-01-01

    Hughes EFX, Boerstler H, O’Connor EJ. “Assessing the Impact of Continuous Quality Improvement/ Total Quality Management : Concept versus...facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity. Gery...RAND Program Manager’s Guide helps managers assess program performance, consider options for improvement, implement solutions, then assess whether the

  4. Differential rigor development in red and white muscle revealed by simultaneous measurement of tension and stiffness.

    PubMed

    Kobayashi, Masahiko; Takemori, Shigeru; Yamaguchi, Maki

    2004-02-10

    Based on the molecular mechanism of rigor mortis, we have proposed that stiffness (elastic modulus evaluated with tension response against minute length perturbations) can be a suitable index of post-mortem rigidity in skeletal muscle. To trace the developmental process of rigor mortis, we measured stiffness and tension in both red and white rat skeletal muscle kept in liquid paraffin at 37 and 25 degrees C. White muscle (in which type IIB fibres predominate) developed stiffness and tension significantly more slowly than red muscle, except for soleus red muscle at 25 degrees C, which showed disproportionately slow rigor development. In each of the examined muscles, stiffness and tension developed more slowly at 25 degrees C than at 37 degrees C. In each specimen, tension always reached its maximum level earlier than stiffness, and then decreased more rapidly and markedly than stiffness. These phenomena may account for the sequential progress of rigor mortis in human cadavers.

  5. The pillars of well-constructed simulated patient programs: A qualitative study with experienced educators.

    PubMed

    Pritchard, Shane A; Blackstock, Felicity C; Keating, Jennifer L; Nestel, Debra

    2017-11-01

    The inclusion of simulated patients (SPs) in health professional education is growing internationally. However, there is limited evidence for best practice in SP methodology. This study investigated how experienced SP educators support SPs in providing SP-based education for health professional students. Experienced SP educators were identified via relevant professional associations, peer-reviewed publications, and peer referral. Semi-structured individual interviews were conducted via telephone. Data were analyzed independently by three researchers using principles of inductive thematic analysis. Four themes were identified that represent the key structural components of SP programs considered by educators seeking to optimize learning for health professional students in SP programs: managing SPs by operationalizing an effective program, selecting SPs by rigorously screening for suitability, preparing SPs by educating for a specific scenario, and directing SPs by leading safe and meaningful interactions. Within these components, subthemes were described, with considerable variation in approaches. Key structural components to SP programs were consistently described by experienced SP educators who operationalize them. A framework has been proposed to assist educators in designing high-quality SP programs that support SPs and learners. Future research is required to evaluate and refine this framework and other evidence-based resources for SP educators.

  6. Outcome of intensive inpatient treatment for combat-related posttraumatic stress disorder.

    PubMed

    Johnson, D R; Rosenheck, R; Fontana, A; Lubin, H; Charney, D; Southwick, S

    1996-06-01

    This study analyzed the outcome of a 4-month intensive inpatient program for combat-related posttraumatic stress disorder (PTSD) among Vietnam veterans. The subjects were 51 male veterans with PTSD who completed the inpatient treatment program. Comprehensive measures of PTSD and psychiatric symptoms, as well as social functioning, were assessed at admission, discharge, and 6, 12, and 18 months after discharge. The overall study group showed an increase in symptoms from admission to follow-up and a decrease in violent actions and thoughts and legal problems. Family and interpersonal relationships and overall morale were improved at discharge but then returned to pretreatment levels at 18 months. Patient evaluations also indicated that the program affected morale and interpersonal relationships but not symptoms. The chronic nature of combat-related PTSD among Vietnam veterans is evident. The study raises the possibility that long-term intensive inpatient treatment is not effective, and other forms of treatment should be considered after rigorous study of such variables as length of stay, trauma versus rehabilitation focus, and patient characteristics.

  7. Improving the outcomes of children affected by parental substance abuse: a review of randomized controlled trials

    PubMed Central

    Calhoun, Stacy; Conner, Emma; Miller, Melodi; Messina, Nena

    2015-01-01

    Substance abuse is a major public health concern that impacts not just the user but also the user’s family. The effect that parental substance abuse has on children has been given substantial attention over the years. Findings from the literature suggest that children of substance-abusing parents have a high risk of developing physical and mental health and behavioral problems. A number of intervention programs have been developed for parents who have a substance abuse problem. There have also been a number of interventions that have been developed for children who have at least one parent with a substance abuse problem. However, it remains unclear how we can best mitigate the negative effects that parental substance abuse has on children due to the scarcity of evaluations that utilize rigorous methodologies such as experimental designs. The purpose of this study is to review randomized controlled trials of intervention programs targeting parents with substance abuse problems and/or children with at least one parent with a substance abuse problem in order to identify programs that show some promise in improving the behavioral and mental health outcomes of children affected by parental substance abuse. Four randomized controlled trials that met our eligibility criteria were identified using major literature search engines. The findings from this review suggest that interventions that focus on improving parenting practices and family functioning may be effective in reducing problems in children affected by parental substance abuse. However, further research utilizing rigorous methodologies are needed in order to identify other successful interventions that can improve the outcomes of these children long after the intervention has ended. PMID:25670915

  8. A novel framework for analyzing conservation impacts: evaluation, theory, and marine protected areas.

    PubMed

    Mascia, Michael B; Fox, Helen E; Glew, Louise; Ahmadia, Gabby N; Agrawal, Arun; Barnes, Megan; Basurto, Xavier; Craigie, Ian; Darling, Emily; Geldmann, Jonas; Gill, David; Holst Rice, Susie; Jensen, Olaf P; Lester, Sarah E; McConney, Patrick; Mumby, Peter J; Nenadovic, Mateja; Parks, John E; Pomeroy, Robert S; White, Alan T

    2017-07-01

    Environmental conservation initiatives, including marine protected areas (MPAs), have proliferated in recent decades. Designed to conserve marine biodiversity, many MPAs also seek to foster sustainable development. As is the case for many other environmental policies and programs, the impacts of MPAs are poorly understood. Social-ecological systems, impact evaluation, and common-pool resource governance are three complementary scientific frameworks for documenting and explaining the ecological and social impacts of conservation interventions. We review key components of these three frameworks and their implications for the study of conservation policy, program, and project outcomes. Using MPAs as an illustrative example, we then draw upon these three frameworks to describe an integrated approach for rigorous empirical documentation and causal explanation of conservation impacts. This integrated three-framework approach for impact evaluation of governance in social-ecological systems (3FIGS) accounts for alternative explanations, builds upon and advances social theory, and provides novel policy insights in ways that no single approach affords. Despite the inherent complexity of social-ecological systems and the difficulty of causal inference, the 3FIGS approach can dramatically advance our understanding of, and the evidentiary basis for, effective MPAs and other conservation initiatives. © 2017 New York Academy of Sciences.

  9. Measuring the Impact of Longitudinal Faculty Development: A Study of Academic Achievement.

    PubMed

    Newman, Lori R; Pelletier, Stephen R; Lown, Beth A

    2016-12-01

    Although faculty development programs in medical education have increased over the past two decades, there is a lack of rigorous program evaluation. The aim of this study was to determine quantifiable outcomes of Harvard Medical School's (HMS's) Fellowship in Medical Education and evaluate attainment of its goals. In 2005 and 2009 the authors collected curricula vitae (CVs) and conducted within-subject analysis of 42 fellowship graduates and also conducted comparison analysis between 12 academic year 2005 fellows and 12 faculty who did not participate in the program. The authors identified 10 metrics of academic advancement. CV analysis for the 42 graduates started 2 years prior to fellowship enrollment and continued for 2-year intervals until June 2009 (10 years of data collection). CV analysis for the comparison group was from 2003 to 2009. The authors also analyzed association between gender and academic outcomes. Fellowship graduates demonstrated significant changes in 4 of 10 academic metrics by the end of the fellowship year: academic promotion, educational leadership, education committees, and education funding. Two metrics-educational leadership and committees-showed increased outcomes two years post fellowship, with a positive trend for promotions. Fellowship graduates significantly outpaced the comparison group in 6 of 10 metrics. Women did significantly more committee work, secured more education funding, and were promoted more often than men. Findings indicate that the HMS Fellowship in Medical Education meets programmatic goals and produces positive, measurable academic outcomes. Standardized evaluation metrics of longitudinal faculty development programs would aid cross-institutional comparisons.

  10. A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand

    PubMed Central

    2013-01-01

    Background Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. Methods A systematic search of 17 electronic databases and 13 websites for the period 1981–2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Results Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. Conclusions There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise. PMID:23663493

  11. A systematic review of suicide prevention interventions targeting indigenous peoples in Australia, United States, Canada and New Zealand.

    PubMed

    Clifford, Anton C; Doran, Christopher M; Tsey, Komla

    2013-05-13

    Indigenous peoples of Australia, Canada, United States and New Zealand experience disproportionately high rates of suicide. As such, the methodological quality of evaluations of suicide prevention interventions targeting these Indigenous populations should be rigorously examined, in order to determine the extent to which they are effective for reducing rates of Indigenous suicide and suicidal behaviours. This systematic review aims to: 1) identify published evaluations of suicide prevention interventions targeting Indigenous peoples in Australia, Canada, United States and New Zealand; 2) critique their methodological quality; and 3) describe their main characteristics. A systematic search of 17 electronic databases and 13 websites for the period 1981-2012 (inclusive) was undertaken. The reference lists of reviews of suicide prevention interventions were hand-searched for additional relevant studies not identified by the electronic and web search. The methodological quality of evaluations of suicide prevention interventions was assessed using a standardised assessment tool. Nine evaluations of suicide prevention interventions were identified: five targeting Native Americans; three targeting Aboriginal Australians; and one First Nation Canadians. The main intervention strategies employed included: Community Prevention, Gatekeeper Training, and Education. Only three of the nine evaluations measured changes in rates of suicide or suicidal behaviour, all of which reported significant improvements. The methodological quality of evaluations was variable. Particular problems included weak study designs, reliance on self-report measures, highly variable consent and follow-up rates, and the absence of economic or cost analyses. There is an urgent need for an increase in the number of evaluations of preventive interventions targeting reductions in Indigenous suicide using methodologically rigorous study designs across geographically and culturally diverse Indigenous populations. Combining and tailoring best evidence and culturally-specific individual strategies into one coherent suicide prevention program for delivery to whole Indigenous communities and/or population groups at high risk of suicide offers considerable promise.

  12. Jog Your Mind: methodology and challenges of conducting evaluative research in partnership with community organizations.

    PubMed

    Bier, Nathalie; Lorthios-Guilledroit, Agathe; Nour, Kareen; Parisien, Manon; Ellemberg, Dave; Laforest, Sophie

    2015-01-01

    Jog Your Mind is a community-based program aiming at empowering elderly people to maintain their cognitive abilities using a multi-strategic approach including cognitively stimulating activities, mnemonic strategies, and strategies to promote healthy behaviors. It is offered to elderly individuals without known or diagnosed cognitive impairment by volunteers or community practitioners over ten weekly sessions. This paper describes the protocol of a quasi-experimental study designed to evaluate Jog Your Mind. Community responsible to recruit participants were either assigned to the experimental group (participating in the Jog Your Mind program) or to the control group (one-year waiting list). All participants were interviewed at baseline (T1), after the program (T2), and 12 months after the baseline (T3). Primary outcomes were the use of everyday memory strategies and aids and subjective memory functioning in daily life. Secondary outcomes included attitudes, knowledge, and behaviors related to cognitive vitality and cognitive abilities (memory and executive functions). Program delivery, organizational and environmental variables were recorded to document the implementation process. Twenty-three community organizations recruited 294 community-dwelling elderly individuals in total at T1. Between T1 and T3, an attrition rate of 15.2% was obtained. Jog Your Mind is one of the only programs targeting cognition among older adults being offered in community settings by community practitioners. The protocol described was designed with a focus on maximizing broad generalizations of the results while achieving scientific rigor. It can serve as an example to guide future research aiming to evaluate health interventions under natural conditions.

  13. The SOS Suicide Prevention Program: Further Evidence of Efficacy and Effectiveness.

    PubMed

    Schilling, Elizabeth A; Aseltine, Robert H; James, Amy

    2016-02-01

    This study replicated and extended previous evaluations of the Signs of Suicide (SOS) prevention program in a high school population using a more rigorous pre-test post-test randomized control design than used in previous SOS evaluations in high schools (Aseltine and DeMartino 2004; Aseltine et al. 2007). SOS was presented to an ethnically diverse group of ninth grade students in technical high schools in Connecticut. After controlling for the pre-test reports of suicide behaviors, exposure to the SOS program was associated with significantly fewer self-reported suicide attempts in the 3 months following the program. Ninth grade students in the intervention group were approximately 64% less likely to report a suicide attempt in the past 3 months compared with students in the control group. Similarly, exposure to the SOS program resulted in greater knowledge of depression and suicide and more favorable attitudes toward (1) intervening with friends who may be exhibiting signs of suicidal intent and (2) getting help for themselves if they were depressed or suicidal. In addition, high-risk SOS participants, defined as those with a lifetime history of suicide attempt, were significantly less likely to report planning a suicide in the 3 months following the program compared to lower-risk participants. Differential attrition is the most serious limitation of the study; participants in the intervention group who reported a suicide attempt in the previous 3 months at baseline were more likely to be missing at post-test than their counterparts in the control group.

  14. Directions in implementation research methods for behavioral and social science.

    PubMed

    Irwin, Molly; Supplee, Lauren H

    2012-10-01

    There is a growing interest, by researchers, policymakers, and practitioners, in evidence-based policy and practice. As a result, more dollars are being invested in program evaluation in order to establish "what works," and in some cases, funding is specifically tied to those programs found to be effective. However, reproducing positive effects found in research requires more than simply adopting an evidence-based program. Implementation research can provide guidance on which components of an intervention matter most for program impacts and how implementation components can best be implemented. However, while the body of rigorous research on effective practices continues to grow, research on implementation lags behind. To address these issues, the Administration for Children and Families and federal partners convened a roundtable meeting entitled, Improving Implementation Research Methods for Behavioral and Social Science, in the fall of 2010. This special section of the Journal of Behavioral Health Services & Research includes papers from the roundtable and highlights the role implementation science can play in shedding light on the difficult task of taking evidence-based practices to scale.

  15. Insights from Smart Meters. Ramp-up, dependability, and short-term persistence of savings from Home Energy Reports

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Todd, Annika; Perry, Michael; Smith, Brian

    Smart meters, smart thermostats, and other new technologies provide previously unavailable high-frequency and location-specific energy usage data. Many utilities are now able to capture real-time, customer specific hourly interval usage data for a large proportion of their residential and small commercial customers. These vast, constantly growing streams of rich data (or, “big data”) have the potential to provide novel insights into key policy questions about how people make energy decisions. The richness and granularity of these data enable many types of creative and cutting-edge analytics. Technically sophisticated and rigorous statistical techniques can be used to pull useful insights out ofmore » this high-frequency, human-focused data. In this series, we call this “behavior analytics.” This kind of analytics has the potential to provide tremendous value to a wide range of energy programs. For example, disaggregated and heterogeneous information about actual energy use allows energy efficiency (EE) and/or demand response (DR) program implementers to target specific programs to specific households; enables evaluation, measurement and verification (EM&V) of energy efficiency programs to be performed on a much shorter time horizon than was previously possible; and may provide better insights into the energy and peak hour savings associated with EE and DR programs (e.g., behavior-based (BB) programs). The goal of this series is to enable evidence-based and data-driven decision making by policy makers and industry stakeholders, including program planners, program administrators, utilities, state regulatory agencies, and evaluators. We focus on research findings that are immediately relevant.« less

  16. STAR Graduate and GRO Undergraduate Fellowship Recipient List

    EPA Pesticide Factsheets

    EPA's STAR graduate fellowship program supports masters and doctoral candidates in environmental studies. Each year, students in the United States compete for STAR fellowships through a rigorous review process.

  17. A Neonatal Resuscitation Curriculum in Malawi, Africa: Did It Change In-Hospital Mortality?

    PubMed Central

    Hole, Michael K.; Olmsted, Keely; Kiromera, Athanase; Chamberlain, Lisa

    2012-01-01

    Objective. The WHO estimates that 99% of the 3.8 million neonatal deaths occur in developing countries. Neonatal resuscitation training was implemented in Namitete, Malawi. The study's objective was to evaluate the training's impact on hospital staff and neonatal mortality rates. Study Design. Pre-/postcurricular surveys of trainee attitude, knowledge, and skills were analyzed. An observational, longitudinal study of secondary data assessed neonatal mortality. Result. All trainees' (n = 18) outcomes improved, (P = 0.02). Neonatal mortality did not change. There were 3449 births preintervention, 3515 postintervention. Neonatal mortality was 20.9 deaths per 1000 live births preintervention and 21.9/1000 postintervention, (P = 0.86). Conclusion. Short-term pre-/postintervention evaluations frequently reveal positive results, as ours did. Short-term pre- and postintervention evaluations should be interpreted cautiously. Whenever possible, clinical outcomes such as in-hospital mortality should be additionally assessed. More rigorous evaluation strategies should be applied to training programs requiring longitudinal relationships with international community partners. PMID:22164184

  18. A rigorous test of the accuracy of USGS digital elevation models in forested areas of Oregon and Washington.

    Treesearch

    Ward W. Carson; Stephen E. Reutebuch

    1997-01-01

    A procedure for performing a rigorous test of elevational accuracy of DEMs using independent ground coordinate data digitized photogrammetrically from aerial photography is presented. The accuracy of a sample set of 23 DEMs covering National Forests in Oregon and Washington was evaluated. Accuracy varied considerably between eastern and western parts of Oregon and...

  19. Advanced Placement Academy: Case Study of a Program within a School

    ERIC Educational Resources Information Center

    Swanson, Julie Dingle; Nagy, Steven

    2014-01-01

    The focus of this study was the first year of implementation of the Advanced Placement Academy (APA), a program within a high school providing honors and Advanced Placement coursework for high-ability African American students with previously limited access to rigorous courses. The qualitative investigation explores practical solutions from…

  20. Reminder: NCI Requests Cancer Targets for Monoclonal Antibody Production and Characterization | Office of Cancer Clinical Proteomics Research

    Cancer.gov

    In an effort to improve rigor and reproducibility, the National Cancer Institute (NCI) Antibody Characterization Program requests cancer-related protein targets for monoclonal antibody production and distribution to the scientific community. The program from The Office of Cancer Clinical Proteomics Research provides well-characterized

  1. USOE And The Library Role.

    ERIC Educational Resources Information Center

    Ottina, John R.

    In light of today's inflation and the changing priorities of the present Administration, the Office of Education (OE) has taken careful stock of its inventory of programs and has attempted to plan rigorously for the needs of the present and the future. Over the years, OE expenditures on library programs have had significant impact on public,…

  2. Assessing Student Achievement in Large-Scale Educational Programs Using Hierarchical Propensity Scores

    ERIC Educational Resources Information Center

    Vaughan, Angela L.; Lalonde, Trent L.; Jenkins-Guarnieri, Michael A.

    2014-01-01

    Many researchers assessing the efficacy of educational programs face challenges due to issues with non-randomization and the likelihood of dependence between nested subjects. The purpose of the study was to demonstrate a rigorous research methodology using a hierarchical propensity score matching method that can be utilized in contexts where…

  3. Kindergarten Readiness Impacts of the Arkansas Better Chance State Prekindergarten Initiative

    ERIC Educational Resources Information Center

    Hustedt, Jason T.; Jung, Kwanghee; Barnett, W. Steven; Williams, Tonya

    2015-01-01

    Enrollment in state-funded pre-K programs prior to kindergarten entry has become increasingly common. As each state develops its own model for pre-K, rigorous studies of the impacts of state-specific programs are needed. This study investigates impacts of the Arkansas Better Chance (ABC) initiative at kindergarten entry using a…

  4. The Art of Learning: A Guide to Outstanding North Carolina Arts in Education Programs.

    ERIC Educational Resources Information Center

    Herman, Miriam L.

    The Arts in Education programs delineated in this guide complement the rigorous arts curriculum taught by arts specialists in North Carolina schools and enable students to experience the joy of the creative process while reinforcing learning in other curricula: language arts, mathematics, social studies, science, and physical education. Programs…

  5. The Role of Data Analysis Software in Graduate Programs in Education and Post-Graduate Research

    ERIC Educational Resources Information Center

    Harwell, Michael

    2018-01-01

    The importance of data analysis software in graduate programs in education and post-graduate educational research is self-evident. However the role of this software in facilitating supererogated statistical practice versus "cookbookery" is unclear. The need to rigorously document the role of data analysis software in students' graduate…

  6. Alberta Biodiversity Monitoring Program - monitoring effectiveness of sustainable forest management planning

    Treesearch

    J. John Stadt; Jim Schieck; Harry Stelfox

    2006-01-01

    The Alberta Biodiversity Monitoring Program is a rigorous science-based initiative that is being developed to monitor and report on biodiversity status and trends throughout the province of Alberta, Canada. Forest management plans in Alberta are required to monitor and report on the achievement of stated sustainable forest management objectives; however, the...

  7. Virginia Standards Predated the Common Core Initiative

    ERIC Educational Resources Information Center

    Knowledge Quest, 2014

    2014-01-01

    The Virginia Board of Education is committed to the Virginia Standards of Learning (SOL) program and opposed to adoption of the newly developed Common Core State Standards as a prerequisite for participation in federal competitive grant and entitlement programs. The Standards of Learning are clear and rigorous and have won the acceptance and trust…

  8. Faculty Perceptions of Web-Based Distance Education in Agriculture.

    ERIC Educational Resources Information Center

    Born, Kevin A.; Miller, Greg

    1999-01-01

    A survey of 42 agronomy faculty showed their perceptions of Web-based distance education were higher when they were familiar with the master of science in agronomy program or had viewed a lesson. Their concerns included the value and rigor of Web-based degree programs and the effectiveness of online student-teacher interaction. (SK)

  9. Academic Competitiveness and National SMART Grant Programs: 2006-07 and 2007-08

    ERIC Educational Resources Information Center

    Choy, Susan P.; Berkner, Lutz; Li, Xiaojie; Woo, Jennie; Lee, John; Topper, Amy

    2010-01-01

    The Department of Education is vitally interested in whether the financial incentives provided by the grants affect student behavior. That is, will the Academic Competitiveness Grant (ACGs) induce more economically disadvantaged high school students to complete a rigorous high school program and enroll and succeed in postsecondary education? Will…

  10. Validation of the GCOM-W SCA and JAXA soil moisture algorithms

    USDA-ARS?s Scientific Manuscript database

    Satellite-based remote sensing of soil moisture has matured over the past decade as a result of the Global Climate Observing Mission-Water (GCOM-W) program of JAXA. This program has resulted in improved algorithms that have been supported by rigorous validation. Access to the products and the valida...

  11. "We Don't Recruit, We Educate": High School Program Marketing and International Baccalaureate Programmes

    ERIC Educational Resources Information Center

    Donovan, Martha K.; Lakes, Richard D.

    2017-01-01

    Public education reformers have created a widespread expectation of school choice among school consumers. School leaders adopt rigorous academic programs, like the International Baccalaureate (IB) Diploma Programme (DP) and Career Programme (CP), to improve their market position in the competitive landscape. While ample research has investigated…

  12. Human-rated Safety Certification of a High Voltage Robonaut Lithium-ion Battery

    NASA Technical Reports Server (NTRS)

    Jeevarajan, Judith; Yayathi, S.; Johnson, M.; Waligora, T.; Verdeyen, W.

    2013-01-01

    NASA's rigorous certification process is being followed for the R2 high voltage battery program for use of R2 on International Space Station (ISS). Rigorous development testing at appropriate levels to credible off-nominal conditions and review of test data led to design improvements for safety at the virtual cell, cartridge and battery levels. Tests were carried out at all levels to confirm that both hardware and software controls work. Stringent flight acceptance testing of the flight battery will be completed before launch for mission use on ISS.

  13. Effects of chopping time, meat source and storage temperature on the colour of New Zealand type fresh beef sausages.

    PubMed

    Boles, J A; Mikkelsen, V L; Swan, J E

    1998-05-01

    The colour stability of finely chopped fresh sausages made from post-rigor, pre-rigor salt added (1.5% w/w) or pre-rigor no salt added beef mince was evaluated using a Hunter Miniscan (L (∗) a (∗) b (∗)) and sensory colour panel. Batters were chopped for various times and sausages stored at -1.5 °, + 4.0 ° and + 8.0 °C. Regardless of meat source or chopping time, colour stability was greatest at -1.5 °C. Panellists found the colour of all sausages stored at -1.5 °C acceptable for at least six days. Sausages made from unsalted pre-rigor mince had markedly better colour stability than those made from the other meats, especially when stored at 4 °C or 8 °C.

  14. A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

    PubMed Central

    Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

    2013-01-01

    Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020

  15. Using Small-Scale Randomized Controlled Trials to Evaluate the Efficacy of New Curricular Materials

    PubMed Central

    Bass, Kristin M.; Stark, Louisa A.

    2014-01-01

    How can researchers in K–12 contexts stay true to the principles of rigorous evaluation designs within the constraints of classroom settings and limited funding? This paper explores this question by presenting a small-scale randomized controlled trial (RCT) designed to test the efficacy of curricular supplemental materials on epigenetics. The researchers asked whether the curricular materials improved students’ understanding of the content more than an alternative set of activities. The field test was conducted in a diverse public high school setting with 145 students who were randomly assigned to a treatment or comparison condition. Findings indicate that students in the treatment condition scored significantly higher on the posttest than did students in the comparison group (effect size: Cohen's d = 0.40). The paper discusses the strengths and limitations of the RCT, the contextual factors that influenced its enactment, and recommendations for others wishing to conduct small-scale rigorous evaluations in educational settings. Our intention is for this paper to serve as a case study for university science faculty members who wish to employ scientifically rigorous evaluations in K–12 settings while limiting the scope and budget of their work. PMID:25452482

  16. Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP).

    PubMed

    Davis, Robert L

    2010-01-01

    Knowledge about safe medication use during pregnancy is limited, yet about two of every three women take at least one prescription medication during pregnancy, furthermore, there is a lack of rigorous studies evaluating birth outcomes associated with in utero exposure to medications. The Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP) is intended to provide a mechanism for collaborative pharmacoepidemiological research to address the safety of pharmaceutical product exposure during pregnancy, through the development of standardized data requirements and of the necessary data linkages of mother-infant pairs to conduct multi-site investigations. This presentation will describe the program, the types of data collected, and progress to date. The current MEPREP population includes female health plan members of 11 distinct health management entities within three research centres who have delivered an infant between January 1, 2001 and December 31, 2007, along with the administrative and birth certificate data on over one million children linked to mothers. There is information on all the medications those mothers took, as well as most of the outcomes of the babies. One of the benefits of this dataset is the information that could be investigated, such as birth weight, fetal growth, congenital anomalies, perinatal conditions, etc., against various demographics of the women in the dataset. The population size within the dataset suggests that various parameters could be studied with at least a modest degree of power.

  17. Collaboratory for the Study of Earthquake Predictability

    NASA Astrophysics Data System (ADS)

    Schorlemmer, D.; Jordan, T. H.; Zechar, J. D.; Gerstenberger, M. C.; Wiemer, S.; Maechling, P. J.

    2006-12-01

    Earthquake prediction is one of the most difficult problems in physical science and, owing to its societal implications, one of the most controversial. The study of earthquake predictability has been impeded by the lack of an adequate experimental infrastructure---the capability to conduct scientific prediction experiments under rigorous, controlled conditions and evaluate them using accepted criteria specified in advance. To remedy this deficiency, the Southern California Earthquake Center (SCEC) is working with its international partners, which include the European Union (through the Swiss Seismological Service) and New Zealand (through GNS Science), to develop a virtual, distributed laboratory with a cyberinfrastructure adequate to support a global program of research on earthquake predictability. This Collaboratory for the Study of Earthquake Predictability (CSEP) will extend the testing activities of SCEC's Working Group on Regional Earthquake Likelihood Models, from which we will present first results. CSEP will support rigorous procedures for registering prediction experiments on regional and global scales, community-endorsed standards for assessing probability-based and alarm-based predictions, access to authorized data sets and monitoring products from designated natural laboratories, and software to allow researchers to participate in prediction experiments. CSEP will encourage research on earthquake predictability by supporting an environment for scientific prediction experiments that allows the predictive skill of proposed algorithms to be rigorously compared with standardized reference methods and data sets. It will thereby reduce the controversies surrounding earthquake prediction, and it will allow the results of prediction experiments to be communicated to the scientific community, governmental agencies, and the general public in an appropriate research context.

  18. Reintegration of child soldiers in Burundi: a tracer study

    PubMed Central

    2012-01-01

    Background Substantial attention and resources are aimed at the reintegration of child soldiers, yet rigorous evaluations are rare. Methods This tracer study was conducted among former child soldiers (N=452) and never-recruited peers (N=191) who participated in an economic support program in Burundi. Socio-economic outcome indicators were measured retrospectively for the period before receiving support (T1; 2005–06); immediately afterwards (T2; 2006–07); and at present (T3; 2010). Participants also rated present functional impairment and mental health indicators. Results Participants reported improvement on all indicators, especially economic opportunity and social integration. At present no difference existed between both groups on any of the outcome indicators. Socio-economic functioning was negatively related with depression- and, health complaints and positively with intervention satisfaction. Conclusion The present study demonstrates promising reintegration trajectories of former child soldiers after participating in a support program. PMID:23095403

  19. Implementation and outcomes of commercial disease management programs in the United States: the disease management outcomes consolidation survey.

    PubMed

    Fitzner, Karen; Fox, Kathe; Schmidt, Joseph; Roberts, Mark; Rindress, Donna; Hay, Joel

    2005-08-01

    Despite widespread adoption of disease management (DM) programs by US health plans, gaps remain in the evidence for their benefit. The Disease Management Outcomes Consolidation Survey was designed to gather data on DM programs for commercial health plans, to assess program success and DM effectiveness. The questionnaire was mailed to 292 appropriate health plan contacts; 26 plans covering more than 14 million commercial members completed and returned the survey. Respondents reported that DM plays a significant and increasing role in their organizations. Key reasons for adopting DM were improving clinical outcomes, reducing medical costs and utilization, and improving member satisfaction. More respondents were highly satisfied with clinical results than with utilization or cost outcomes of their programs (46%, 17%, and 13%, respectively). Detailed results were analyzed for 57 DM programs with over 230,000 enrollees. Most responding plans offered DM programs for diabetes and asthma, with return on investment (ROI) ranging from 0.16:1 to 4:1. Weighted by number of enrollees per DM program, average ROI was 2.56:1 for asthma (n = 1,136 enrollees) and 1.98:1 for diabetes (n = 25,364). Most (but not all) respondents reported reduced hospital admissions, increasing rates of preventive care, and improved clinical measures. Few respondents provided detailed information about DM programs for other medical conditions, but most that did reported positive outcomes. Lack of standardized methodology was identified as a major barrier to in-house program evaluation. Although low response rate precluded drawing many general conclusions, a clear need emerged for more rigorous evaluation methods and greater standardization of outcomes measurement.

  20. Research that Helps Move Us Closer to a World where Each Child Thrives

    PubMed Central

    Diamond, Adele

    2015-01-01

    Schools are curtailing programs in arts, physical exercise, and play so more time and resources can be devoted to academic instruction. Yet indications are that the arts (e.g., music, dance, or theatre) and physical activity (e.g., sports, martial arts, or youth circus) are crucial for all aspects of children’s development – including success in school. Thus in cutting those activities, schools may be impeding academic success, not aiding it. Correlational and retrospective studies have laid the groundwork, as have moving personal accounts, case studies, and theoretical arguments. The time is ripe for rigorous studies to investigate causality (Do arts and physical activities actually produce academic benefits or would kids in those activities have succeeded anyway?) and what characteristics of programs account for the benefits. Instead of simply claiming that the arts and/or physical activities can transform kids’ lives, that needs to be demonstrated, and granting agencies need to be more open to funding rigorous research of real-world arts and physical-activity programs. PMID:26635510

  1. A framework for learning about improvement: embedded implementation and evaluation design to optimize learning

    PubMed Central

    Barry, Danika; Kimble, Leighann E; Nambiar, Bejoy; Parry, Gareth; Jha, Ashish; Chattu, Vijay Kumar; Massoud, M Rashad; Goldmann, Don

    2018-01-01

    Abstract Improving health care involves many actors, often working in complex adaptive systems. Interventions tend to be multi-factorial, implementation activities diverse, and contexts dynamic and complicated. This makes improvement initiatives challenging to describe and evaluate as matching evaluation and program designs can be difficult, requiring collaboration, trust and transparency. Collaboration is required to address important epidemiological principles of bias and confounding. If this does not take place, results may lack credibility because the association between interventions implemented and outcomes achieved is obscure and attribution uncertain. Moreover, lack of clarity about what was implemented, how it was implemented, and the context in which it was implemented often lead to disappointment or outright failure of spread and scale-up efforts. The input of skilled evaluators into the design and conduct of improvement initiatives can be helpful in mitigating these potential problems. While evaluation must be rigorous, if it is too rigid necessary adaptation and learning may be compromised. This article provides a framework and guidance on how improvers and evaluators can work together to design, implement and learn about improvement interventions more effectively. PMID:29873794

  2. A Problem Based Learning Project Analyzing Rubrics Used to Evaluate Elementary STEM Immersion Programs

    NASA Astrophysics Data System (ADS)

    Pearson, Roxanne N.

    In 2010, the President's Council of Advisors on Science and Technology recommended that eight hundred new STEM focused elementary and middle schools be established. Unfortunately, districts may be slow to implement STEM at the elementary level because they do not understand how to do so effectively (Zimny, 2017). School administrators need a framework for decision-making and supervisory feedback related to the process of managing these programs (Zimny, 2017). To support administrators in implementing elementary STEM immersion programs, this project explored three questions: What criteria are common among existing STEM immersion program rubrics? What criteria should be included in a comprehensive rubric for managing elementary STEM immersion programs at the district level? What do district documents show about how elementary STEM immersion programs develop, implement, and evaluate those programs? The team developed a comprehensive STEM program review instrument including criteria for effective elementary STEM curriculum and the professional development and administrative support necessary to implement such curriculum. These criteria were organized into three stages, including the planning and development of elementary STEM immersion programs, the implementation of these programs, and the evaluation of these programs after they had been implemented for a significant period of time. The team synthesized best practice indicators relevant to elementary STEM programs from existing K-12 guides, then validated those indicators against current best practice research and feedback from STEM education experts. District documents from seven elementary STEM immersion programs in Missouri and Colorado were examined using the team's rubric. Scores were higher in the areas of program planning, content alignment, and ongoing refinement of curriculum, and lower in the areas of professional development for professional skills and STEM-specific pedagogy, two-way communication with stakeholders, and data collection for program refinement. Scores were lowest for those schools with inadequate documentation of their program management processes. The team recommended districts institute a more rigorous documentation process for managing innovative programs such as STEM immersion. Communication plans should include procedures for two-way communication with all stakeholders. Data collection and refinement efforts should increase, as should professional development opportunities related to professional skills and STEM-specific pedagogy; this should include administrators.

  3. Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques

    PubMed Central

    Jones, Kelly W.; Lewis, David J.

    2015-01-01

    Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented—from protected areas to payments for ecosystem services (PES)—to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing ‘matching’ to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods—an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators—due to the presence of unobservable bias—that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs. PMID:26501964

  4. Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques.

    PubMed

    Jones, Kelly W; Lewis, David J

    2015-01-01

    Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented--from protected areas to payments for ecosystem services (PES)--to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing 'matching' to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods--an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators--due to the presence of unobservable bias--that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs.

  5. Experimental evaluation of rigor mortis IX. The influence of the breaking (mechanical solution) on the development of rigor mortis.

    PubMed

    Krompecher, Thomas; Gilles, André; Brandt-Casadevall, Conception; Mangin, Patrice

    2008-04-07

    Objective measurements were carried out to study the possible re-establishment of rigor mortis on rats after "breaking" (mechanical solution). Our experiments showed that: *Cadaveric rigidity can re-establish after breaking. *A significant rigidity can reappear if the breaking occurs before the process is complete. *Rigidity will be considerably weaker after the breaking. *The time course of the intensity does not change in comparison to the controls: --the re-establishment begins immediately after the breaking; --maximal values are reached at the same time as in the controls; --the course of the resolution is the same as in the controls.

  6. Letter to the editor regarding "GRAS from the ground up: Review of the Interim Pilot Program for GRAS notification" by.

    PubMed

    Sewalt, Vincent; LaMarta, James; Shanahan, Diane; Gregg, Lori; Carrillo, Roberto

    2017-09-01

    Present letter is aimed at clarifying some critical points highlighted by Hanlon et al. regarding the common knowledge element of the safety of food enzymes in support of their GRAS designation. Particularly, we outline the development of peer-reviewed, generally recognized safety evaluation methodology for microbial enzymes and its adoption by the enzyme industry, which provides the US FDA with a review framework for enzyme GRAS Notices. This approach may serve as a model to other food ingredient categories for a scientifically sound, rigorous, and transparent application of the GRAS concept. Copyright © 2017 Elsevier Ltd. All rights reserved.

  7. NEW Planetarium Programs for Polar Informal Science Education

    NASA Astrophysics Data System (ADS)

    Sumners, C.; Schloss, A. L.; Reiff, P.

    2007-12-01

    The modern planetarium is an immersive full-dome theater that can take audiences to Polar Regions in the past, present, or future and can simulate dynamic polar events. With the goal of public engagement and education, we are producing two programs: Night of the Titanic and Ice Worlds. Night of the Titanic uses a famous tragedy to uncover the science that could have saved the ship and the changing conditions in the North Atlantic over the last century. This program also fosters discussion about how humans evaluate data and make critical decisions related to the changing condition of polar ice. Ice Worlds uses comparative planetology themes to present Earth in the context of all ice worlds in the solar system, thus providing a broader perspective for analysis of changes in Earth's Polar Regions. Both programs rely on themes of high public interest to drive attendance and engagement. Both programs are being developed for the large dome theater or planetarium market and for portable Discovery Domes, which can reach urban and rural audiences throughout the world. This paper focuses on techniques for presentation of rigorous science content in a context that will engage the general public as well as school groups over a wide age range.

  8. Improving the evidence base for services working with youth at-risk of involvement in the criminal justice system: developing a standardised program approach.

    PubMed

    Knight, Alice; Maple, Myfanwy; Shakeshaft, Anthony; Shakehsaft, Bernie; Pearce, Tania

    2018-04-16

    Young people who engage in multiple risk behaviour (high-risk young people) such as substance abuse, antisocial behaviour, low engagement in education and employment, self-harm or suicide ideation are more likely to experience serious harms later in life including homelessness, incarceration, violence and premature death. In addition to personal disadvantage, these harms represent an avoidable social and economic cost to society. Despite these harms, there is insufficient evidence about how to improve outcomes for high-risk young people. A key reason for this is a lack of standardisation in the way in which programs provided by services are defined and evaluated. This paper describes the development of a standardised intervention model for high-risk young people. The model can be used by service providers to achieve greater standardisation across their programs, outcomes and outcome measures. To demonstrate its feasibility, the model is applied to an existing program for high-risk young people. The development and uptake of a standardised intervention model for these programs will help to more rapidly develop a larger and more rigorous evidence-base to improve outcomes for high-risk young people.

  9. Perceived Factors Influencing High School Student Participation in an Integrated Statewide Dual Credit Program: An Examination of Program Success and Student Higher Education Selection Decisions

    ERIC Educational Resources Information Center

    Touchstone, Allison J. L.

    2010-01-01

    Dual credit programs have become increasingly popular with 71% U.S. public high schools offering dual credit courses in 2002-2003. As this popularity has grown, so have concerns regarding academic rigor, course quality, parity with college courses, and effects on higher education. Determining actual dual credit course equivalent in higher…

  10. Assessing Weapon System Acquisition Cycle Times: Setting Program Schedules

    DTIC Science & Technology

    2015-06-01

    additional research, focused as follows: 1 . Acquisition schedule development: How are schedules for acquisition programs actually set and how are they...the germinating requirements documents specific to systems reviewed. A clear statement was found for only one system (Air and Missile Defense Radar...AMDR) when specific threat capabilities were projected to be operational. • Program schedule setting varies in rigor: 1 Up to the interim version of

  11. A national analytical quality assurance program: Developing guidelines and analytical tools for the forest inventory and analysis program

    Treesearch

    Phyllis C. Adams; Glenn A. Christensen

    2012-01-01

    A rigorous quality assurance (QA) process assures that the data and information provided by the Forest Inventory and Analysis (FIA) program meet the highest possible standards of precision, completeness, representativeness, comparability, and accuracy. FIA relies on its analysts to check the final data quality prior to release of a State’s data to the national FIA...

  12. Partnership Among Peers: Lessons Learned From the Development of a Community Organization–Academic Research Training Program

    PubMed Central

    Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J.; Borawski, Elaine A.

    2017-01-01

    Background Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization–academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. Methods The PEER program was developed and guided by a community–academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows’ pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. Objectives The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. Conclusion PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions. PMID:28230553

  13. Partnership Among Peers: Lessons Learned From the Development of a Community Organization-Academic Research Training Program.

    PubMed

    Jewett-Tennant, Jeri; Collins, Cyleste; Matloub, Jacqueline; Patrick, Alison; Chupp, Mark; Werner, James J; Borawski, Elaine A

    2016-01-01

    Community engagement and rigorous science are necessary to address health issues. Increasingly, community health organizations are asked to partner in research. To strengthen such community organization-academic partnerships, increase research capacity in community organizations, and facilitate equitable partnered research, the Partners in Education Evaluation and Research (PEER) program was developed. The program implements an 18-month structured research curriculum for one mid-level employee of a health-focused community-based organization with an organizational mentor and a Case Western Reserve University faculty member as partners. The PEER program was developed and guided by a community-academic advisory committee and was designed to impact the research capacity of organizations through didactic modules and partnered research in the experiential phase. Active participation of community organizations and faculty during all phases of the program provided for bidirectional learning and understanding of the challenges of community-engaged health research. The pilot program evaluation used qualitative and quantitative data collection techniques, including experiences of the participants assessed through surveys, formal group and individual interviews, phone calls, and discussions. Statistical analysis of the change in fellows' pre-test and post-test survey scores were conducted using paired sample t tests. The small sample size is recognized by the authors as a limitation of the evaluation methods and would potentially be resolved by including more cohort data as the program progresses. Qualitative data were reviewed by two program staff using content and narrative analysis to identify themes, describe and assess group phenomena and determine program improvements. The objective of PEER is to create equitable partnerships between community organizations and academic partners to further research capacity in said organizations and develop mutually beneficial research partnerships between academia and community organizations. PEER demonstrates a commitment to successfully developing sustainable research capacity growth in community organizations, and improved partnered research with academic institutions.

  14. A rigorous approach to self-checking programming

    NASA Technical Reports Server (NTRS)

    Hua, Kien A.; Abraham, Jacob A.

    1986-01-01

    Self-checking programming is shown to be an effective concurrent error detection technique. The reliability of a self-checking program however relies on the quality of its assertion statements. A self-checking program written without formal guidelines could provide a poor coverage of the errors. A constructive technique for self-checking programming is presented. A Structured Program Design Language (SPDL) suitable for self-checking software development is defined. A set of formal rules, was also developed, that allows the transfromation of SPDL designs into self-checking designs to be done in a systematic manner.

  15. The Medical Education Partnership Initiative (MEPI), a collaborative paradigm for institutional and human resources capacity building between high- and low- and middle-income countries: the Mozambique experience

    PubMed Central

    Noormahomed, Emilia Virginia; Carrilho, Carla; Ismail, Mamudo; Noormahomed, Sérgio; Nguenha, Alcido; Benson, Constance A.; Mocumbi, Ana Olga; Schooley, Robert T.

    2017-01-01

    ABSTRACT Background: Collaborations among researchers based in lower and middle income countries (LMICs) and high income countries (HICs) have made major discoveries related to diseases disproportionately affecting LMICs and have been vital to the development of research communities in LMICs. Such collaborations have generally been scientifically and structurally driven by HICs. Objectives: In this report we outline a paradigm shift in collaboration, exemplified by the Medical Education Partnership Initiative (MEPI), in which the formulation of priorities and administrative infrastructure reside in the LMIC. Methods: This descriptive report outlines the critical features of the MEPI partnership. Results: In the MEPI, LMIC program partners translate broad program goals and define metrics into priorities that are tailored to local conditions. Program funds flow to a LMIC-based leadership group that contracts with peers from HICs to provide technical and scientific advice and consultation in a 'reverse funds flow' model. Emphasis is also placed on strengthening administrative capacity within LMIC institutions. A rigorous monitoring and evaluation process modifies program priorities on the basis of evolving opportunities to maximize program impact. Conclusions: Vesting LMIC partners with the responsibility for program leadership, and building administrative and fiscal capacity in LMIC institutions substantially enhances program relevance, impact and sustainability. PMID:28452653

  16. Monitoring programs to assess reintroduction efforts: A critical component in recovery

    USGS Publications Warehouse

    Muths, E.; Dreitz, V.

    2008-01-01

    Reintroduction is a powerful tool in our conservation toolbox. However, the necessary follow-up, i.e. long-term monitoring, is not commonplace and if instituted may lack rigor. We contend that valid monitoring is possible, even with sparse data. We present a means to monitor based on demographic data and a projection model using the Wyoming toad (Bufo baxten) as an example. Using an iterative process, existing data is built upon gradually such that demographic estimates and subsequent inferences increase in reliability. Reintroduction and defensible monitoring may become increasingly relevant as the outlook for amphibians, especially in tropical regions, continues to deteriorate and emergency collection, captive breeding, and reintroduction become necessary. Rigorous use of appropriate modeling and an adaptive approach can validate the use of reintroduction and substantially increase its value to recovery programs. ?? 2008 Museu de Cie??ncies Naturals.

  17. Addressing intimate partner violence and sexual violence among adolescents: emerging evidence of effectiveness.

    PubMed

    Lundgren, Rebecka; Amin, Avni

    2015-01-01

    Intimate partner violence (IPV) and sexual violence (SV) are widespread among adolescents and place them on a lifelong trajectory of violence, either as victims or perpetrators. The aim of this review was to identify effective approaches to prevent adolescent IPV and SV and to identify critical knowledge gaps. The interventions reviewed in this article reflect the global focus on interventions addressing violence perpetrated by men against women in the context of heterosexual relationships. Interventions for girls and boys (10-19 years) were identified through electronic searches for peer-reviewed and gray literature such as reports and research briefs. Studies were excluded if they were published before 1990 or did not disaggregate participants and results by age. Programs were classified as "effective," "emerging," "ineffective," or "unclear" based on the strength of evidence, generalizability of results to developing country settings, and replication beyond the initial pilot. Programs were considered "effective" if they were evaluated with well-designed studies, which controlled for threats to validity through randomization of participants. A review of 142 articles and documents yielded 61 interventions, which aimed to prevent IPV and SV among adolescents. These were categorized as "parenting" (n = 8), "targeted interventions for children and adolescents subjected to maltreatment" (n = 3), "school based" (n = 31; including 10 interventions to prevent sexual assault among university students), "community based" (n = 16), and "economic empowerment" (n = 2). The rigor of the evaluations varies greatly. A good number have relatively weak research designs, short follow-up periods, and low or unreported retention rates. Overall, there is a lack of robust standardized measures for behavioral outcomes. Three promising approaches emerge. First, school-based dating violence interventions show considerable success. However, they have only been implemented in high-income countries and should be adapted and evaluated in other settings. Second, community-based interventions to form gender equitable attitudes among boys and girls have successfully prevented IPV or SV. Third, evidence suggests that parenting interventions and interventions with children and adolescents subjected to maltreatment hold promise in preventing IPV or SV by addressing child maltreatment, which is a risk factor for later perpetration or experience of IPV or SV. Results suggest that programs with longer term investments and repeated exposure to ideas delivered in different settings over time have better results than single awareness-raising or discussion sessions. However, lack of rigorous evidence limits conclusions regarding the effectiveness of adolescent IPV and SV prevention programs and indicates a need for more robust evaluation. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

  18. Structural barriers in access to medical marijuana in the USA-a systematic review protocol.

    PubMed

    Valencia, Celina I; Asaolu, Ibitola O; Ehiri, John E; Rosales, Cecilia

    2017-08-07

    There are 43 state medical marijuana programs in the USA, yet limited evidence is available on the demographic characteristics of the patient population accessing these programs. Moreover, insights into the social and structural barriers that inform patients' success in accessing medical marijuana are limited. A current gap in the scientific literature exists regarding generalizable data on the social, cultural, and structural mechanisms that hinder access to medical marijuana among qualifying patients. The goal of this systematic review, therefore, is to identify the aforementioned mechanisms that inform disparities in access to medical marijuana in the USA. This scoping review protocol outlines the proposed study design for the systematic review and evaluation of peer-reviewed scientific literature on structural barriers to medical marijuana access. The protocol follows the guidelines set forth by the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) checklist. The overarching goal of this study is to rigorously evaluate the existing peer-reviewed data on access to medical marijuana in the USA. Income, ethnic background, stigma, and physician preferences have been posited as the primary structural barriers influencing medical marijuana patient population demographics in the USA. Identification of structural barriers to accessing medical marijuana provides a framework for future policies and programs. Evidence-based policies and programs for increasing medical marijuana access help minimize the disparity of access among qualifying patients.

  19. Rules for New College-Aid Program Outlined

    ERIC Educational Resources Information Center

    Davis, Michelle R.

    2006-01-01

    The Department of Education's May 2, 2006 announcement of a variety of methods that high schools may use to provide a "rigorous" curriculum to allow low-income graduates to qualify for a new federal college-grant program was welcome news to those who had feared that the government's reach into the classroom was too expansive. Students who complete…

  20. Advanced Career (AC) Curricula: Teachers and Students Enthusiastic about Challenging, Project-Based Courses

    ERIC Educational Resources Information Center

    Southern Regional Education Board (SREB), 2013

    2013-01-01

    To keep pace with accelerating technology and workplace expectations, high school and technology center students need access to high-level programs and courses that open the doors to further education and careers. The Southern Regional Education Board (SREB) and nine states have launched a far-reaching program to provide rigorous and relevant…

  1. Exploring the Impact of an Outdoor Orientation Program on Adaptation to College

    ERIC Educational Resources Information Center

    Ribbe, Robert, Jr.; Cyrus, Rachael; Langan, Emily

    2016-01-01

    Outdoor orientation programming as a means for orientating students to college has experienced significant growth and expanded use over the past decade. An increase in rigorous research has accompanied this growth as colleges and universities seek to understand and meet the needs of young adults in transition. In this study, two research questions…

  2. Teacher Workforce: Understanding the Relationship among Teacher Demographics, Preparation Programs, Performance, and Persistence

    ERIC Educational Resources Information Center

    Leech, Nancy L.; Haug, Carolyn A.

    2015-01-01

    Pressure from state and federal mandates is being brought to faculty members at institutions who prepare teacher candidates to increase the standards and rigor of their programs, and who provide evidence that their graduates not only know the content, but also will be effective in the classroom. This article investigated the relationships among…

  3. School in the Park: Bridging Formal and Informal Learning Environments

    ERIC Educational Resources Information Center

    Mathison, Carla; Wachowiak, Susan; Feldman, Linda

    2007-01-01

    In San Diego, California, 800 public school students from the inner city are attending a program called School in the Park (SITP), for approximately one-fourth of their 3rd-, 4th-, and 5th-grade education. This unique program blends rigorous academic standards (formal learning) with hands-on, experiential curricula (informal learning), using…

  4. Impacts of the Boston Prekindergarten Program on the School Readiness of Young Children with Special Needs

    ERIC Educational Resources Information Center

    Weiland, Christina

    2016-01-01

    Theory and empirical work suggest inclusion preschool improves the school readiness of young children with special needs, but only 2 studies of the model have used rigorous designs that could identify causality. The present study examined the impacts of the Boston Public prekindergarten program-which combined proven language, literacy, and…

  5. Gathering Evidence on an After-School Supplemental Instruction Program: Design Challenges and Early Findings in Light of NCLB

    ERIC Educational Resources Information Center

    Chatterji, Madhabi; Kwon, Young Ae; Sng, Clarice

    2006-01-01

    The No Child Left Behind (NCLB) Act of 2001 requires that public schools adopt research-supported programs and practices, with a strong recommendation for randomized controlled trials (RCTs) as the "gold standard" for scientific rigor in empirical research. Within that policy framework, this paper compares the relative utility of…

  6. Influence of mhealth interventions on gender relations in developing countries: a systematic literature review

    PubMed Central

    2013-01-01

    Introduction Research has shown that mHealth initiatives, or health programs enhanced by mobile phone technologies, can foster women’s empowerment. Yet, there is growing concern that mobile-based programs geared towards women may exacerbate gender inequalities. Methods A systematic literature review was conducted to examine the empirical evidence of changes in men and women’s interactions as a result of mHealth interventions. To be eligible, studies had to have been published in English from 2002 to 2012, conducted in a developing country, included an evaluation of a mobile health intervention, and presented findings on resultant dynamics between women and men. The search strategy comprised four electronic bibliographic databases in addition to a manual review of the reference lists of relevant articles and a review of organizational websites and journals with recent mHealth publications. The methodological rigor of selected studies was appraised by two independent reviewers who also abstracted data on the study’s characteristics. Iterative thematic analyses were used to synthesize findings relating to gender-transformative and non-transformative experiences. Results Out of the 173 articles retrieved for review, seven articles met the inclusion criteria and were retained in the final analysis. Most mHealth interventions were SMS-based and conducted in sub-Saharan Africa on topics relating to HIV/AIDS, sexual and reproductive health, health-based microenterprise, and non-communicable diseases. Several methodological limitations were identified among eligible quantitative and qualitative studies. The current literature suggests that mobile phone programs can influence gender relations in meaningfully positive ways by providing new modes for couple’s health communication and cooperation and by enabling greater male participation in health areas typically targeted towards women. MHealth initiatives also increased women’s decision-making, social status, and access to health resources. However, programmatic experiences by design may inadvertently reinforce the digital divide, and perpetuate existing gender-based power imbalances. Domestic disputes and lack of spousal approval additionally hampered women’s participation. Conclusion Efforts to scale-up health interventions enhanced by mobile technologies should consider the implementation and evaluation imperative of ensuring that mHealth programs transform rather than reinforce gender inequalities. The evidence base on the effect of mHealth interventions on gender relations is weak, and rigorous research is urgently needed. PMID:24131553

  7. Influence of mHealth interventions on gender relations in developing countries: a systematic literature review.

    PubMed

    Jennings, Larissa; Gagliardi, Laina

    2013-10-16

    Research has shown that mHealth initiatives, or health programs enhanced by mobile phone technologies, can foster women's empowerment. Yet, there is growing concern that mobile-based programs geared towards women may exacerbate gender inequalities. A systematic literature review was conducted to examine the empirical evidence of changes in men and women's interactions as a result of mHealth interventions. To be eligible, studies had to have been published in English from 2002 to 2012, conducted in a developing country, included an evaluation of a mobile health intervention, and presented findings on resultant dynamics between women and men. The search strategy comprised four electronic bibliographic databases in addition to a manual review of the reference lists of relevant articles and a review of organizational websites and journals with recent mHealth publications. The methodological rigor of selected studies was appraised by two independent reviewers who also abstracted data on the study's characteristics. Iterative thematic analyses were used to synthesize findings relating to gender-transformative and non-transformative experiences. Out of the 173 articles retrieved for review, seven articles met the inclusion criteria and were retained in the final analysis. Most mHealth interventions were SMS-based and conducted in sub-Saharan Africa on topics relating to HIV/AIDS, sexual and reproductive health, health-based microenterprise, and non-communicable diseases. Several methodological limitations were identified among eligible quantitative and qualitative studies. The current literature suggests that mobile phone programs can influence gender relations in meaningfully positive ways by providing new modes for couple's health communication and cooperation and by enabling greater male participation in health areas typically targeted towards women. MHealth initiatives also increased women's decision-making, social status, and access to health resources. However, programmatic experiences by design may inadvertently reinforce the digital divide, and perpetuate existing gender-based power imbalances. Domestic disputes and lack of spousal approval additionally hampered women's participation. Efforts to scale-up health interventions enhanced by mobile technologies should consider the implementation and evaluation imperative of ensuring that mHealth programs transform rather than reinforce gender inequalities. The evidence base on the effect of mHealth interventions on gender relations is weak, and rigorous research is urgently needed.

  8. Circular instead of hierarchical: methodological principles for the evaluation of complex interventions

    PubMed Central

    Walach, Harald; Falkenberg, Torkel; Fønnebø, Vinjar; Lewith, George; Jonas, Wayne B

    2006-01-01

    Background The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery). Discussion The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability). Summary Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform. PMID:16796762

  9. A review of mammalian carcinogenicity study design and potential effects of alternate test procedures on the safety evaluation of food ingredients.

    PubMed

    Hayes, A W; Dayan, A D; Hall, W C; Kodell, R L; Williams, G M; Waddell, W D; Slesinski, R S; Kruger, C L

    2011-06-01

    Extensive experience in conducting long term cancer bioassays has been gained over the past 50 years of animal testing on drugs, pesticides, industrial chemicals, food additives and consumer products. Testing protocols for the conduct of carcinogenicity studies in rodents have been developed in Guidelines promulgated by regulatory agencies, including the US EPA (Environmental Protection Agency), the US FDA (Food and Drug Administration), the OECD (Organization for Economic Co-operation and Development) for the EU member states and the MAFF (Ministries of Agriculture, Forestries and Fisheries) and MHW (Ministry of Health and Welfare) in Japan. The basis of critical elements of the study design that lead to an accepted identification of the carcinogenic hazard of substances in food and beverages is the focus of this review. The approaches used by entities well-known for carcinogenicity testing and/or guideline development are discussed. Particular focus is placed on comparison of testing programs used by the US National Toxicology Program (NTP) and advocated in OECD guidelines to the testing programs of the European Ramazzini Foundation (ERF), an organization with numerous published carcinogenicity studies. This focus allows for a good comparison of differences in approaches to carcinogenicity testing and allows for a critical consideration of elements important to appropriate carcinogenicity study designs and practices. OECD protocols serve as good standard models for carcinogenicity testing protocol design. Additionally, the detailed design of any protocol should include attention to the rationale for inclusion of particular elements, including the impact of those elements on study interpretations. Appropriate interpretation of study results is dependent on rigorous evaluation of the study design and conduct, including differences from standard practices. Important considerations are differences in the strain of animal used, diet and housing practices, rigorousness of test procedures, dose selection, histopathology procedures, application of historical control data, statistical evaluations and whether statistical extrapolations are supported by, or are beyond the limits of, the data generated. Without due consideration, there can be result conflicting data interpretations and uncertainty about the relevance of a study's results to human risk. This paper discusses the critical elements of rodent (rat) carcinogenicity studies, particularly with respect to the study of food ingredients. It also highlights study practices and procedures that can detract from the appropriate evaluation of human relevance of results, indicating the importance of adherence to international consensus protocols, such as those detailed by OECD. Copyright © 2010. Published by Elsevier Inc.

  10. Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

    PubMed

    Cypress, Brigitte S

    Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.

  11. Factors underlying the psychological and behavioral characteristics of Office of Strategic Services candidates: the assessment of men data revisited.

    PubMed

    Lenzenweger, Mark F

    2015-01-01

    During World War II, the Office of Strategic Services (OSS), the forerunner of the Central Intelligence Agency, sought the assistance of clinical psychologists and psychiatrists to establish an assessment program for evaluating candidates for the OSS. The assessment team developed a novel and rigorous program to evaluate OSS candidates. It is described in Assessment of Men: Selection of Personnel for the Office of Strategic Services (OSS Assessment Staff, 1948). This study examines the sole remaining multivariate data matrix that includes all final ratings for a group of candidates (n = 133) assessed near the end of the assessment program. It applies the modern statistical methods of both exploratory and confirmatory factor analysis to this rich and highly unique data set. An exploratory factor analysis solution suggested 3 factors underlie the OSS assessment staff ratings. Confirmatory factor analysis results of multiple plausible substantive models reveal that a 3-factor model provides the best fit to these data. The 3 factors are emotional/interpersonal factors (social relations, emotional stability, security), intelligence processing (effective IQ, propaganda skills, observing and reporting), and agency/surgency (motivation, energy and initiative, leadership, physical ability). These factors are discussed in terms of their potential utility for personnel selection within the intelligence community.

  12. Body Mass Index and Sociodemographic Predictors of School Lunch Purchase Behavior during a Year-Long Environmental Intervention in Middle School.

    PubMed

    Greece, Jacey A; Kratze, Alyssa; DeJong, William; Cozier, Yvette C; Quatromoni, Paula A

    2015-06-10

    Modifying the school food environment is on the national agenda as one strategy to improve the nutritional quality of children's diets. Because few environmental-level interventions have been rigorously evaluated, the evidence base to inform programs and policies is limited. Of concern is the impact that changes to cafeteria offerings will have on participation in school meal programs. This study evaluates school lunch participation in the setting of a year-long middle school cafeteria intervention by examining the association between body mass index (BMI), sociodemographics, and the purchases of school lunch meals. IMOVE meals were healthier choices that met stringent nutritional criteria and were offered alongside standard lunch meals. Students who were overweight had a significantly higher purchase rate for both types of meals compared to those with a healthy BMI. Non-white race, younger age, being male, and low-income status were also significantly associated with participation in school lunch. Results indicate that nutritionally vulnerable students participate in school lunch and are equally likely to buy healthy alternatives or standard meals. This behavioral observation has important implications for school foodservice programs and policies. These results are timely given recent federal legislation to improve the school food environment to influence students' food choice behaviors.

  13. Body Mass Index and Sociodemographic Predictors of School Lunch Purchase Behavior during a Year-Long Environmental Intervention in Middle School

    PubMed Central

    Greece, Jacey A.; Kratze, Alyssa; DeJong, William; Cozier, Yvette C.; Quatromoni, Paula A.

    2015-01-01

    Modifying the school food environment is on the national agenda as one strategy to improve the nutritional quality of children’s diets. Because few environmental-level interventions have been rigorously evaluated, the evidence base to inform programs and policies is limited. Of concern is the impact that changes to cafeteria offerings will have on participation in school meal programs. This study evaluates school lunch participation in the setting of a year-long middle school cafeteria intervention by examining the association between body mass index (BMI), sociodemographics, and the purchases of school lunch meals. IMOVE meals were healthier choices that met stringent nutritional criteria and were offered alongside standard lunch meals. Students who were overweight had a significantly higher purchase rate for both types of meals compared to those with a healthy BMI. Non-white race, younger age, being male, and low-income status were also significantly associated with participation in school lunch. Results indicate that nutritionally vulnerable students participate in school lunch and are equally likely to buy healthy alternatives or standard meals. This behavioral observation has important implications for school foodservice programs and policies. These results are timely given recent federal legislation to improve the school food environment to influence students’ food choice behaviors. PMID:26067683

  14. Applying the RE-AIM Framework to Evaluate Integrative Medicine Group Visits Among Diverse Women with Chronic Pelvic Pain.

    PubMed

    Chao, Maria T; Abercrombie, Priscilla D; Santana, Trilce; Duncan, Larissa G

    2015-12-01

    The purpose of this study was to evaluate group medical visits using an integrative health approach for underserved women with chronic pelvic pain (CPP). We implemented an integrative medicine program to improve quality of life among women with CPP using Centering, a group-based model that combines healthcare assessment, education, and social support. Patients were from university-affiliated and public hospital-affiliated clinics. We evaluated the program with qualitative and quantitative data to address components of the RE-AIM framework: Reach, Effectiveness, Adoption, Implementation, and Maintenance. Participants of the Centering CPP Program participants (n = 26) were demographically similar to a sample of women with CPP who sought care at Bay Area hospitals (n = 701). Participants were on average 40 years of age, a majority of whom were racial/ethnic minorities with low household income (76%). Women who attended four or more sessions (n = 16) had improved health-related quality of life, including decreases in average number of unhealthy days in the past month (from 24 to 18, p < .05), depressive symptoms (from 11.7 to 9.0, p < .05), and symptom severity (from 4.2 to 3.1, p < .01). Sexual health outcomes also improved (30.5 to 50.3, p = .02). No improvements were observed for pain catastrophizing. Our pilot program provides preliminary data that an integrative health approach using a group-based model can be adapted and implemented to reach diverse women with CPP to improve physical and psychological well-being. Given these promising findings, rigorous evaluation of implementation and effectiveness of this approach compared with usual care is warranted. Copyright © 2015 American Society for Pain Management Nursing. Published by Elsevier Inc. All rights reserved.

  15. Evaluating Diagnostic Point-of-Care Tests in Resource-Limited Settings

    PubMed Central

    Drain, Paul K; Hyle, Emily P; Noubary, Farzad; Freedberg, Kenneth A; Wilson, Douglas; Bishai, William; Rodriguez, William; Bassett, Ingrid V

    2014-01-01

    Diagnostic point-of-care (POC) testing is intended to minimize the time to obtain a test result, thereby allowing clinicians and patients to make an expeditious clinical decision. As POC tests expand into resource-limited settings (RLS), the benefits must outweigh the costs. To optimize POC testing in RLS, diagnostic POC tests need rigorous evaluations focused on relevant clinical outcomes and operational costs, which differ from evaluations of conventional diagnostic tests. Here, we reviewed published studies on POC testing in RLS, and found no clearly defined metric for the clinical utility of POC testing. Therefore, we propose a framework for evaluating POC tests, and suggest and define the term “test efficacy” to describe a diagnostic test’s capacity to support a clinical decision within its operational context. We also proposed revised criteria for an ideal diagnostic POC test in resource-limited settings. Through systematic evaluations, comparisons between centralized diagnostic testing and novel POC technologies can be more formalized, and health officials can better determine which POC technologies represent valuable additions to their clinical programs. PMID:24332389

  16. Tank waste remediation system privatization infrastructure program, configuration management implementation plan

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Schaus, P.S.

    This Configuration Management Implementation Plan (CMIP) was developed to assist in managing systems, structures, and components (SSCS), to facilitate the effective control and statusing of changes to SSCS, and to ensure technical consistency between design, performance, and operational requirements. Its purpose is to describe the approach Privatization Infrastructure will take in implementing a configuration management program, to identify the Program`s products that need configuration management control, to determine the rigor of control, and to identify the mechanisms for that control.

  17. Stop smoking support programs

    MedlinePlus

    ... A.D.A.M. follows rigorous standards of quality and accountability. A.D.A.M. is among the first to achieve this important distinction for online health information and services. Learn more about A.D.A.M.'s editorial ...

  18. Golf Injuries: They Really Do Happen.

    ERIC Educational Resources Information Center

    Duda, Marty

    1987-01-01

    Although golf is not a rigorous sport, it has its share of injuries. Greater attention to preplay stretching and conditioning programs and to the proper mechanics of the golf swing can help prevent injuries. (Author/CB)

  19. Study protocol: a pragmatic randomised controlled trial of a 12-week physical activity and nutritional education program for overweight Aboriginal and Torres Strait Islander women.

    PubMed

    Canuto, Karla J; McDermott, Robyn A; Cargo, Margaret; Esterman, Adrian J

    2011-08-19

    Aboriginal and Torres Strait Islander women have a higher prevalence and incidence of obesity and type 2 diabetes than non-Indigenous Australian women. Physical inactivity is a key modifiable risk factor for obesity and evidence shows that even modest reductions in waist circumference (WC) have significant health benefits. Trialing physical activity programs in difficult-to-reach high risk groups, especially urban Indigenous Australians poses distinct implementation challenges. The trial objective is to evaluate the effectiveness of a structured 12-week physical activity group program with nutritional advice. The design is a pragmatic randomised controlled trial. This study protocol describes the implementation and evaluation of the program. Participants are randomised into either an intervention or waitlisted group. The waitlisted group have a 12 month waiting period before commencing the 12-week program. Participant data is collected at baseline, 12, 24 and 52 weeks. Participants are Aboriginal and Torres Strait Islander women, aged 18-64 years with a waist circumference greater than 80 centimetres residing in Adelaide. The primary outcome measure is WC change immediately post program from baseline. Secondary outcomes include short term and long term changes in WC, weight, blood pressure, fasting blood glucose, insulin, insulin resistance (calculated HOMA), haemoglobin A1C (HbA1C), triglycerides and C-reactive protein (CRP). Behavioural and psychosocial surveys are administered to assess physical activity, dietary intake and the participant's motivation, self-efficacy and perceived social support for physical activity. Qualitative interviews focusing on participants' motivation, enablers and barriers to healthy eating and physical activity will be undertaken. Implementation fidelity and participation are also assessed. The Aboriginal and Torres Strait Islander Women's Fitness Program (WFP) is designed to provide a rigorous physiological and client-based evaluation of a structured 12-week program aimed to increase metabolic fitness and reduce WC in this high risk population. Evaluation results aim to provide the support necessary to design programs that are accessible, affordable and effective at reducing WC, while also improving the metabolic profile of overweight Aboriginal and Torres Strait Islander women. Australian New Zealand Clinical Trials Registry ACTRN12610000224022.

  20. A better way to evaluate remote monitoring programs in chronic disease care: receiver operating characteristic analysis.

    PubMed

    Brown Connolly, Nancy E

    2014-12-01

    This foundational study applies the process of receiver operating characteristic (ROC) analysis to evaluate utility and predictive value of a disease management (DM) model that uses RM devices for chronic obstructive pulmonary disease (COPD). The literature identifies a need for a more rigorous method to validate and quantify evidence-based value for remote monitoring (RM) systems being used to monitor persons with a chronic disease. ROC analysis is an engineering approach widely applied in medical testing, but that has not been evaluated for its utility in RM. Classifiers (saturated peripheral oxygen [SPO2], blood pressure [BP], and pulse), optimum threshold, and predictive accuracy are evaluated based on patient outcomes. Parametric and nonparametric methods were used. Event-based patient outcomes included inpatient hospitalization, accident and emergency, and home health visits. Statistical analysis tools included Microsoft (Redmond, WA) Excel(®) and MedCalc(®) (MedCalc Software, Ostend, Belgium) version 12 © 1993-2013 to generate ROC curves and statistics. Persons with COPD were monitored a minimum of 183 days, with at least one inpatient hospitalization within 12 months prior to monitoring. Retrospective, de-identified patient data from a United Kingdom National Health System COPD program were used. Datasets included biometric readings, alerts, and resource utilization. SPO2 was identified as a predictive classifier, with an optimal average threshold setting of 85-86%. BP and pulse were failed classifiers, and areas of design were identified that may improve utility and predictive capacity. Cost avoidance methodology was developed. RESULTS can be applied to health services planning decisions. Methods can be applied to system design and evaluation based on patient outcomes. This study validated the use of ROC in RM program evaluation.

  1. The influence of low temperature, type of muscle and electrical stimulation on the course of rigor mortis, ageing and tenderness of beef muscles.

    PubMed

    Olsson, U; Hertzman, C; Tornberg, E

    1994-01-01

    The course of rigor mortis, ageing and tenderness have been evaluated for two beef muscles, M. semimembranosus (SM) and M. longissimus dorsi (LD), when entering rigor at constant temperatures in the cold-shortening region (1, 4, 7 and 10°C). The influence of electrical stimulation (ES) was also examined. Post-mortem changes were registered by shortening and isometric tension and by following the decline of pH, ATP and creatine phosphate. The effect of ageing on tenderness was recorded by measuring shear-force (2, 8 and 15 days post mortem) and the sensory properties were assessed 15 days post mortem. It was found that shortening increased with decreasing temperature, resulting in decreased tenderness. Tenderness for LD, but not for SM, was improved by ES at 1 and 4°C, whereas ES did not give rise to any decrease in the degree of shortening during rigor mortis development. This suggests that ES influences tenderization more than it prevents cold-shortening. The samples with a pre-rigor mortis temperature of 1°C could not be tenderized, when stored up to 15 days, whereas this was the case for the muscles entering rigor mortis at the other higher temperatures. The results show that under the conditions used in this study, the course of rigor mortis is more important for the ultimate tenderness than the course of ageing. Copyright © 1994. Published by Elsevier Ltd.

  2. Understanding and Evolving the ML Module System

    DTIC Science & Technology

    2005-05-01

    kinds Abstract The ML module system stands as a high-water mark of programming language support for data abstraction. Nevertheless, it is not in a... language of part (3) using the framework of Harper and Stone, in which the meanings of “external” ML programs are interpreted by translation into an...researcher has been influenced to a large degree by their rigorous approach to programming language research and their profound sense of aesthetics. I

  3. The University of Alabama at Birmingham Center for Community OutReach Development Summer Science Institute Program: A 3-Yr Laboratory Research Experience for Inner-City Secondary-Level Students

    ERIC Educational Resources Information Center

    Niemann, Marilyn A.; Miller, Michael L.; Davis, Thelma

    2004-01-01

    This article describes and assesses the effectiveness of a 3-yr, laboratory-based summer science program to improve the academic performance of inner-city high school students. The program was designed to gradually introduce such students to increasingly more rigorous laboratory experiences in an attempt to interest them in and model what…

  4. Parent Management Training-Oregon Model: Adapting Intervention with Rigorous Research.

    PubMed

    Forgatch, Marion S; Kjøbli, John

    2016-09-01

    Parent Management Training-Oregon Model (PMTO(®) ) is a set of theory-based parenting programs with status as evidence-based treatments. PMTO has been rigorously tested in efficacy and effectiveness trials in different contexts, cultures, and formats. Parents, the presumed agents of change, learn core parenting practices, specifically skill encouragement, limit setting, monitoring/supervision, interpersonal problem solving, and positive involvement. The intervention effectively prevents and ameliorates children's behavior problems by replacing coercive interactions with positive parenting practices. Delivery format includes sessions with individual families in agencies or families' homes, parent groups, and web-based and telehealth communication. Mediational models have tested parenting practices as mechanisms of change for children's behavior and found support for the theory underlying PMTO programs. Moderating effects include children's age, maternal depression, and social disadvantage. The Norwegian PMTO implementation is presented as an example of how PMTO has been tailored to reach diverse populations as delivered by multiple systems of care throughout the nation. An implementation and research center in Oslo provides infrastructure and promotes collaboration between practitioners and researchers to conduct rigorous intervention research. Although evidence-based and tested within a wide array of contexts and populations, PMTO must continue to adapt to an ever-changing world. © 2016 Family Process Institute.

  5. Proceedings of the 1999 U.S. DOE Hydrogen Program Review

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    NREL

    2000-08-28

    The Proceedings of the 1999 US Department of Energy (DOE) Hydrogen Program Review serve as an important technology reference for the DOE Hydrogen Program. This document contains technical progress reports on 60 research and technology validation projects funded by the DOE Hydrogen Program in Fiscal Year 1999, in support of its mission to make hydrogen a cost-effective energy carrier for utility, building, and transportation applications. Each year, the Program conducts a rigorous review of its portfolio of projects, utilizing teams of experts to provide vital feedback on the progress of research.

  6. Effects of Conservation Policies on Forest Cover Change in Giant Panda Habitat Regions, China

    PubMed Central

    Li, Yu; Viña, Andrés; Yang, Wu; Chen, Xiaodong; Zhang, Jindong; Ouyang, Zhiyun; Liang, Zai; Liu, Jianguo

    2014-01-01

    After long periods of deforestation, forest transition has occurred globally, but the causes of forest transition in different countries are highly variable. Conservation policies may play important roles in facilitating forest transition around the world, including China. To restore forests and protect the remaining natural forests, the Chinese government initiated two nationwide conservation policies in the late 1990s -- the Natural Forest Conservation Program (NFCP) and the Grain-To-Green Program (GTGP). While some studies have discussed the environmental and socioeconomic effects of each of these policies independently and others have attributed forest recovery to both policies without rigorous and quantitative analysis, it is necessary to rigorously quantify the outcomes of these two conservation policies simultaneously because the two policies have been implemented at the same time. To fill the knowledge gap, this study quantitatively evaluated the effects of the two conservation policies on forest cover change between 2001 and 2008 in 108 townships located in two important giant panda habitat regions -- the Qinling Mountains region in Shaanxi Province and the Sichuan Giant Panda Sanctuary in Sichuan Province. Forest cover change was evaluated using a land-cover product (MCD12Q1) derived from the Moderate Resolution Imaging Spectroradiometer (MODIS). This product proved to be highly accurate in the study region (overall accuracy was ca. 87%, using 425 ground truth points collected in the field), thus suitable for the forest change analysis performed. Results showed that within the timeframe evaluated, most townships in both regions exhibited either increases or no changes in forest cover. After accounting for a variety of socioeconomic and biophysical attributes, an Ordinary Least Square (OLS) regression model suggests that the two policies had statistically significant positive effects on forest cover change after seven years of implementation, while population density, percent agricultural population, road density, and initial forest cover (i.e. in 2001) had significant negative effects. The methods and results from this study will be useful for continuing the implementation of these conservation policies, for the development of future giant panda habitat conservation projects, and for achieving forest sustainability in China and elsewhere. PMID:26146431

  7. Effects of Conservation Policies on Forest Cover Change in Giant Panda Habitat Regions, China.

    PubMed

    Li, Yu; Viña, Andrés; Yang, Wu; Chen, Xiaodong; Zhang, Jindong; Ouyang, Zhiyun; Liang, Zai; Liu, Jianguo

    2013-07-01

    After long periods of deforestation, forest transition has occurred globally, but the causes of forest transition in different countries are highly variable. Conservation policies may play important roles in facilitating forest transition around the world, including China. To restore forests and protect the remaining natural forests, the Chinese government initiated two nationwide conservation policies in the late 1990s -- the Natural Forest Conservation Program (NFCP) and the Grain-To-Green Program (GTGP). While some studies have discussed the environmental and socioeconomic effects of each of these policies independently and others have attributed forest recovery to both policies without rigorous and quantitative analysis, it is necessary to rigorously quantify the outcomes of these two conservation policies simultaneously because the two policies have been implemented at the same time. To fill the knowledge gap, this study quantitatively evaluated the effects of the two conservation policies on forest cover change between 2001 and 2008 in 108 townships located in two important giant panda habitat regions -- the Qinling Mountains region in Shaanxi Province and the Sichuan Giant Panda Sanctuary in Sichuan Province. Forest cover change was evaluated using a land-cover product (MCD12Q1) derived from the Moderate Resolution Imaging Spectroradiometer (MODIS). This product proved to be highly accurate in the study region (overall accuracy was ca. 87%, using 425 ground truth points collected in the field), thus suitable for the forest change analysis performed. Results showed that within the timeframe evaluated, most townships in both regions exhibited either increases or no changes in forest cover. After accounting for a variety of socioeconomic and biophysical attributes, an Ordinary Least Square (OLS) regression model suggests that the two policies had statistically significant positive effects on forest cover change after seven years of implementation, while population density, percent agricultural population, road density, and initial forest cover (i.e. in 2001) had significant negative effects. The methods and results from this study will be useful for continuing the implementation of these conservation policies, for the development of future giant panda habitat conservation projects, and for achieving forest sustainability in China and elsewhere.

  8. A large-scale initiative to disseminate an evidence-based drug abuse prevention program in Italy: Lessons learned for practitioners and researchers.

    PubMed

    Velasco, Veronica; Griffin, Kenneth W; Antichi, Mariella; Celata, Corrado

    2015-10-01

    Across developed countries, experimentation with alcohol, tobacco, and other drugs often begins in the early adolescent years. Several evidence-based programs have been developed to prevent adolescent substance use. Many of the most rigorously tested and empirically supported prevention programs were initially developed and tested in the United States. Increasingly, these interventions are being adopted for use in Europe and throughout the world. This paper reports on a large-scale comprehensive initiative designed to select, adapt, implement, and sustain an evidence-based drug abuse prevention program in Italy. As part of a large-scale regionally funded collaboration in the Lombardy region of Italy, we report on processes through which a team of stakeholders selected, translated and culturally adapted, planned, implemented and evaluated the Life Skills Training (LST) school-based drug abuse prevention program, an evidence-based intervention developed in the United States. We discuss several challenges and lessons learned and implications for prevention practitioners and researchers attempting to undertake similar international dissemination projects. We review several published conceptual models designed to promote the replication and widespread dissemination of effective programs, and discuss their strengths and limitations in the context of planning and implementing a complex, large-scale real-world dissemination effort. Copyright © 2015 Elsevier Ltd. All rights reserved.

  9. Evaluation of Additively Manufactured Metals for Use in Oxygen Systems Project

    NASA Technical Reports Server (NTRS)

    Tylka, Jonathan; Cooper, Ken; Peralta, Stephen; Wilcutt, Terrence; Hughitt, Brian; Generazio, Edward

    2016-01-01

    Space Launch System, Commercial Resupply, and Commercial Crew programs have published intent to use additively manufactured (AM) components in propulsion systems and are likely to include various life support systems in the future. Parts produced by these types of additive manufacturing techniques have not been fully evaluated for use in oxygen systems and the inherent risks have not been fully identified. Some areas of primary concern in the SLS process with respect to oxygen compatibility may be the porosity of the printed parts, fundamental differences in microstructure of an AM part as compared to traditional materials, or increased risk of shed metal particulate into an oxygen system. If an ignition were to occur the printed material could be more flammable than components manufactured from a traditional billet of raw material and/or present a significant hazards if not identified and rigorously studied in advance of implementation into an oxygen system.

  10. Dynamic Modeling of Yield and Particle Size Distribution in Continuous Bayer Precipitation

    NASA Astrophysics Data System (ADS)

    Stephenson, Jerry L.; Kapraun, Chris

    Process engineers at Alcoa's Point Comfort refinery are using a dynamic model of the Bayer precipitation area to evaluate options in operating strategies. The dynamic model, a joint development effort between Point Comfort and the Alcoa Technical Center, predicts process yields, particle size distributions and occluded soda levels for various flowsheet configurations of the precipitation and classification circuit. In addition to rigorous heat, material and particle population balances, the model includes mechanistic kinetic expressions for particle growth and agglomeration and semi-empirical kinetics for nucleation and attrition. The kinetic parameters have been tuned to Point Comfort's operating data, with excellent matches between the model results and plant data. The model is written for the ACSL dynamic simulation program with specifically developed input/output graphical user interfaces to provide a user-friendly tool. Features such as a seed charge controller enhance the model's usefulness for evaluating operating conditions and process control approaches.

  11. A research agenda to guide progress on childhood obesity prevention in Latin America.

    PubMed

    Kline, L; Jones-Smith, J; Jaime Miranda, J; Pratt, M; Reis, R S; Rivera, J A; Sallis, J F; Popkin, B M

    2017-07-01

    Childhood obesity rates in Latin America are among the highest in the world. This paper examines and evaluates the many efforts underway in the region to reduce and prevent further increases in obesity, identifies and discusses unique research challenges and opportunities in Latin America, and proposes a research agenda in Latin America for the prevention of childhood obesity and concomitant non-communicable diseases. Identified research gaps include biological challenges to healthy growth across the life cycle, diet and physical activity dynamics, community interventions promoting healthy child growth, and rigorous evaluation of national food and activity programs and regulatory actions. Addressing these research gaps is critical to advance the evidence-based policy and practice in childhood obesity tailored to the Latin American context that will be effective in addressing obesity. © 2017 The Authors. Obesity Reviews published by John Wiley & Sons Ltd on behalf of World Obesity.

  12. Comparison of Plastic Surgery Residency Training in United States and China.

    PubMed

    Zheng, Jianmin; Zhang, Boheng; Yin, Yiqing; Fang, Taolin; Wei, Ning; Lineaweaver, William C; Zhang, Feng

    2015-12-01

    Residency training is internationally recognized as the only way for the physicians to be qualified to practice independently. China has instituted a new residency training program for the specialty of plastic surgery. Meanwhile, plastic surgery residency training programs in the United States are presently in a transition because of restricted work hours. The purpose of this study is to compare the current characteristics of plastic surgery residency training in 2 countries. Flow path, structure, curriculum, operative experience, research, and evaluation of training in 2 countries were measured. The number of required cases was compared quantitatively whereas other aspects were compared qualitatively. Plastic surgery residency training programs in 2 countries differ regarding specific characteristics. Requirements to become a plastic surgery resident in the United States are more rigorous. Ownership structure of the regulatory agency for residency training in 2 countries is diverse. Training duration in the United States is more flexible. Clinical and research training is more practical and the method of evaluation of residency training is more reasonable in the United States. The job opportunities after residency differ substantially between 2 countries. Not every resident has a chance to be an independent surgeon and would require much more training time in China than it does in the United States. Plastic surgery residency training programs in the United States and China have their unique characteristics. The training programs in the United States are more standardized. Both the United States and China may complement each other to create training programs that will ultimately provide high-quality care for all people.

  13. Methodology and Baseline Results From the Evaluation of a Sexuality Education Activity in Mpumalanga and KwaZulu-Natal, South Africa.

    PubMed

    Speizer, Ilene S; Mandal, Mahua; Xiong, Khou; Hattori, Aiko; Makina-Zimalirana, Ndinda; Kumalo, Faith; Taylor, Stephen; Ndlovu, Muzi S; Madibane, Mathata; Beke, Andy

    2018-04-01

    In South Africa, adolescents and young adults (ages 15-24) are at risk of HIV, sexually transmitted infections, and unintended pregnancies. Recently, the Department of Basic Education has revised its sexuality education content and teaching strategies (using scripted lessons plans) as part of its life orientation curriculum. This paper presents the methodology and baseline results from the evaluation of the scripted lesson plans and supporting activities. A rigorous cluster-level randomized design with random assignment of schools as clusters is used for the evaluation. Baseline results from grade 8 female and male learners and grade 10 female learners demonstrate that learners are at risk of HIV and early and unintended pregnancies. Multivariable analyses demonstrate that household-level food insecurity and living with an HIV-positive person are associated with sexual experience and pregnancy experience. Implications are discussed for strengthening the current life orientation program for future scale-up by the government of South Africa.

  14. Safety assessment of adjuvanted vaccines: Methodological considerations

    PubMed Central

    Da Silva, Fernanda Tavares; Di Pasquale, Alberta; Yarzabal, Juan P; Garçon, Nathalie

    2015-01-01

    Adjuvants mainly interact with the innate immune response and are used to enhance the quantity and quality of the downstream adaptive immune response to vaccine antigens. Establishing the safety of a new adjuvant-antigen combination is achieved through rigorous evaluation that begins in the laboratory, and that continues throughout the vaccine life-cycle. The strategy for the evaluation of safety pre-licensure is guided by the disease profile, vaccine indication, and target population, and it is also influenced by available regulatory guidelines. In order to allow meaningful interpretation of clinical data, clinical program methodology should be optimized and standardized, making best use of all available data sources. Post-licensure safety activities are directed by field experience accumulated pre- and post-licensure clinical trial data and spontaneous adverse event reports. Continued evolution of safety evaluation processes that keep pace with advances in vaccine technology and updated communication of the benefit-risk profile is necessary to maintain public confidence in vaccines. PMID:26029975

  15. A statistically rigorous sampling design to integrate avian monitoring and management within Bird Conservation Regions.

    PubMed

    Pavlacky, David C; Lukacs, Paul M; Blakesley, Jennifer A; Skorkowsky, Robert C; Klute, David S; Hahn, Beth A; Dreitz, Victoria J; George, T Luke; Hanni, David J

    2017-01-01

    Monitoring is an essential component of wildlife management and conservation. However, the usefulness of monitoring data is often undermined by the lack of 1) coordination across organizations and regions, 2) meaningful management and conservation objectives, and 3) rigorous sampling designs. Although many improvements to avian monitoring have been discussed, the recommendations have been slow to emerge in large-scale programs. We introduce the Integrated Monitoring in Bird Conservation Regions (IMBCR) program designed to overcome the above limitations. Our objectives are to outline the development of a statistically defensible sampling design to increase the value of large-scale monitoring data and provide example applications to demonstrate the ability of the design to meet multiple conservation and management objectives. We outline the sampling process for the IMBCR program with a focus on the Badlands and Prairies Bird Conservation Region (BCR 17). We provide two examples for the Brewer's sparrow (Spizella breweri) in BCR 17 demonstrating the ability of the design to 1) determine hierarchical population responses to landscape change and 2) estimate hierarchical habitat relationships to predict the response of the Brewer's sparrow to conservation efforts at multiple spatial scales. The collaboration across organizations and regions provided economy of scale by leveraging a common data platform over large spatial scales to promote the efficient use of monitoring resources. We designed the IMBCR program to address the information needs and core conservation and management objectives of the participating partner organizations. Although it has been argued that probabilistic sampling designs are not practical for large-scale monitoring, the IMBCR program provides a precedent for implementing a statistically defensible sampling design from local to bioregional scales. We demonstrate that integrating conservation and management objectives with rigorous statistical design and analyses ensures reliable knowledge about bird populations that is relevant and integral to bird conservation at multiple scales.

  16. A statistically rigorous sampling design to integrate avian monitoring and management within Bird Conservation Regions

    PubMed Central

    Hahn, Beth A.; Dreitz, Victoria J.; George, T. Luke

    2017-01-01

    Monitoring is an essential component of wildlife management and conservation. However, the usefulness of monitoring data is often undermined by the lack of 1) coordination across organizations and regions, 2) meaningful management and conservation objectives, and 3) rigorous sampling designs. Although many improvements to avian monitoring have been discussed, the recommendations have been slow to emerge in large-scale programs. We introduce the Integrated Monitoring in Bird Conservation Regions (IMBCR) program designed to overcome the above limitations. Our objectives are to outline the development of a statistically defensible sampling design to increase the value of large-scale monitoring data and provide example applications to demonstrate the ability of the design to meet multiple conservation and management objectives. We outline the sampling process for the IMBCR program with a focus on the Badlands and Prairies Bird Conservation Region (BCR 17). We provide two examples for the Brewer’s sparrow (Spizella breweri) in BCR 17 demonstrating the ability of the design to 1) determine hierarchical population responses to landscape change and 2) estimate hierarchical habitat relationships to predict the response of the Brewer’s sparrow to conservation efforts at multiple spatial scales. The collaboration across organizations and regions provided economy of scale by leveraging a common data platform over large spatial scales to promote the efficient use of monitoring resources. We designed the IMBCR program to address the information needs and core conservation and management objectives of the participating partner organizations. Although it has been argued that probabilistic sampling designs are not practical for large-scale monitoring, the IMBCR program provides a precedent for implementing a statistically defensible sampling design from local to bioregional scales. We demonstrate that integrating conservation and management objectives with rigorous statistical design and analyses ensures reliable knowledge about bird populations that is relevant and integral to bird conservation at multiple scales. PMID:29065128

  17. Regression discontinuity design in criminal justice evaluation: an introduction and illustration.

    PubMed

    Rhodes, William; Jalbert, Sarah Kuck

    2013-01-01

    Corrections agencies frequently place offenders into risk categories, within which offenders receive different levels of supervision and programming. This supervision strategy is seldom evaluated but often can be through routine use of a regression discontinuity design (RDD). This article argues that RDD provides a rigorous and cost-effective method for correctional agencies to evaluate and improve supervision strategies and advocates for using RDD routinely in corrections administration. The objective is to better employ correctional resources. This article uses a Neyman-Pearson counterfactual framework to introduce readers to RDD, to provide intuition for why RDD should be used broadly, and to motivate a deeper reading into the methodology. The article also illustrates an application of RDD to evaluate an intensive supervision program for probationers. Application of the RDD, which requires basic knowledge of regressions and some special diagnostic tools, is within the competencies of many criminal justice evaluators. RDD is shown to be an effective strategy to identify the treatment effect in a community corrections agency using supervision that meets the necessary conditions for RDD. The article concludes with a critical review of how RDD compares to experimental methods to answer policy questions. The article recommends using RDD to evaluate whether differing levels of control and correction reduce criminal recidivism. It also advocates for routine use of RDD as an administrative tool to determine cut points used to assign offenders into different risk categories based on the offenders' risk scores.

  18. 77 FR 71600 - Medicare Program; Request for Information To Aid in the Design and Development of a Survey...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-12-03

    ...] Medicare Program; Request for Information To Aid in the Design and Development of a Survey Regarding... from emergency room to inpatient care). Having a rigorous, well-designed emergency department survey... this solicitation, please reply via email to CMS ED_Survey@cms.hhs.gov or by postal mail at Centers for...

  19. Exploring the Influence of 21st Century Skills in a Dual Language Program: A Case Study

    ERIC Educational Resources Information Center

    Heinrichs, Christine R.

    2016-01-01

    Preparing students as 21st century learners is a key reform in education. The Partnership for 21st Century Skills developed a framework that identifies outcomes needed for successful implementation of rigorous standards. The Dual Language (DL) program was identified as a structure for reform with systems and practices which can be used to prepare…

  20. Remarks by Drew S. Days III Before the Urban Mass Transportation Administration (Washington, D.C., June 30, 1979).

    ERIC Educational Resources Information Center

    Days, Drew S., III

    Title VI was designed to put an end to Federal support of discrimination and to assure blacks the right of access to Federally assisted programs. However, the Federal government has not established sufficiently rigorous compliance and enforcement mechanisms to ensure that its programs do not contribute to racial discrimination. In order to enforce…

  1. Creating Online Content with Real World Application by Designing and Implementing Online Practicums for Virtual and Physical Environments

    ERIC Educational Resources Information Center

    Barrett, Bob

    2012-01-01

    Universities need to assess student learning in order to determine if they are reaching the needs of the students, linking learning to course objectives, and determining if their courses have academic rigor. While many courses focus on the immediate course learning objectives, the use of final program projects and program assessments are becoming…

  2. Military and Veteran Families and Children: Policies and Programs for Health Maintenance and Positive Development. Social Policy Report. Volume 28, Number 3

    ERIC Educational Resources Information Center

    Cozza, Stephen J.; Lerner, Richard M.; Haskins, Ron

    2014-01-01

    This "Social Policy Report" summarizes what is currently known about our nation's military children and families and presents ideas and proposals pertinent to the formulation of new programs and the policies that would create and sustain these initiatives. We emphasize the need for future rigorous developmental research about military…

  3. Scaling Climate Change Communication for Behavior Change

    NASA Astrophysics Data System (ADS)

    Rodriguez, V. C.; Lappé, M.; Flora, J. A.; Ardoin, N. M.; Robinson, T. N.

    2014-12-01

    Ultimately, effective climate change communication results in a change in behavior, whether the change is individual, household or collective actions within communities. We describe two efforts to promote climate-friendly behavior via climate communication and behavior change theory. Importantly these efforts are designed to scale climate communication principles focused on behavior change rather than soley emphasizing climate knowledge or attitudes. Both cases are embedded in rigorous evaluations (randomized controlled trial and quasi-experimental) of primary and secondary outcomes as well as supplementary analyses that have implications for program refinement and program scaling. In the first case, the Girl Scouts "Girls Learning Environment and Energy" (GLEE) trial is scaling the program via a Massive Open Online Course (MOOC) for Troop Leaders to teach the effective home electricity and food and transportation energy reduction programs. The second case, the Alliance for Climate Education (ACE) Assembly Program, is advancing the already-scaled assembly program by using communication principles to further engage youth and their families and communities (school and local communities) in individual and collective actions. Scaling of each program uses online learning platforms, social media and "behavior practice" videos, mastery practice exercises, virtual feedback and virtual social engagement to advance climate-friendly behavior change. All of these communication practices aim to simulate and advance in-person train-the-trainers technologies.As part of this presentation we outline scaling principles derived from these two climate change communication and behavior change programs.

  4. Mathematics interventions for children and adolescents with Down syndrome: a research synthesis.

    PubMed

    Lemons, C J; Powell, S R; King, S A; Davidson, K A

    2015-08-01

    Many children and adolescents with Down syndrome fail to achieve proficiency in mathematics. Researchers have suggested that tailoring interventions based on the behavioural phenotype may enhance efficacy. The research questions that guided this review were (1) what types of mathematics interventions have been empirically evaluated with children and adolescents with Down syndrome?; (2) do the studies demonstrate sufficient methodological rigor?; (3) is there evidence of efficacy for the evaluated mathematics interventions?; and (4) to what extent have researchers considered aspects of the behavioural phenotype in selecting, designing and/or implementing mathematics interventions for children and adolescents with Down syndrome? Nine studies published between 1989 and 2012 were identified for inclusion. Interventions predominantly focused on early mathematics skills and reported positive outcomes. However, no study met criteria for methodological rigor. Further, no authors explicitly considered the behavioural phenotype. Additional research using rigorous experimental designs is needed to evaluate the efficacy of mathematics interventions for children and adolescents with Down syndrome. Suggestions for considering the behavioural phenotype in future research are provided. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

  5. The promise of prison-based treatment for dually diagnosed inmates.

    PubMed

    Wexler, Harry K

    2003-10-01

    The Stay'n Out therapeutic community was created 25 years ago, the first rigorously evaluated prison program that demonstrated recidivism reduction. Since then, there has been a growing appreciation for the recidivism-reducing benefit of substance abuse treatment and the general understanding has been reached that prison treatment for substance abuse is good for the public interest. A number of replicated outcome studies have led to increases in treatment capacity in most state correctional systems, primarily utilizing the therapeutic community model. In contrast, efforts to introduce treatment for offenders with co-occurring mental illness and substance abuse disorders (COD) are only beginning. This article describes developments in prison substance abuse treatment and reentry programs and offers some guiding observations from prison substance abuse treatment history that could facilitate the development of COD treatment. Lessons learned include that: public safety (i.e., recidivism reduction) is a primary goal; personal accountability as a basic treatment value facilitates cooperation between treatment and correctional staff; self-help approaches foster more ambitious treatment goals than just symptom reduction; and well-run treatment programs often ease the burden of correctional administration.

  6. American Recovery and Reinvestment Act of 2009. Experiences from the Consumer Behavior Studies on Engaging Customers

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Cappers, Peter; Scheer, Richard

    2014-09-01

    One of the most important aspects for the successful implementation of customer-facing programs is to better understand how to engage and communicate with consumers. Customer-facing programs include time-based rates, information and feedback, load management, and energy efficiency. This report presents lessons learned by utilities through consumer behavior studies (CBS) conducted as part of the Department of Energy’s (DOE) Smart Grid Investment Grant (SGIG) program. The SGIG CBS effort presents a unique opportunity to advance the understanding of consumer behaviors in terms of customer acceptance and retention, and electricity consumption and peak demand impacts. The effort includes eleven comprehensive studies withmore » the aim of evaluating the response of residential and small commercial customers to time-based rate programs implemented in conjunction with advanced metering infrastructure and customer systems such as in-home displays, programmable communicating thermostats, and web portals. DOE set guidelines and protocols that sought to help the utilities design studies that would rigorously test and more precisely estimate the impact of time-based rates on customers’ energy usage patterns, as well as identify the key drivers that motivate behavioral changes.« less

  7. Rigorous evaluation of chemical measurement uncertainty: liquid chromatographic analysis methods using detector response factor calibration

    NASA Astrophysics Data System (ADS)

    Toman, Blaza; Nelson, Michael A.; Bedner, Mary

    2017-06-01

    Chemical measurement methods are designed to promote accurate knowledge of a measurand or system. As such, these methods often allow elicitation of latent sources of variability and correlation in experimental data. They typically implement measurement equations that support quantification of effects associated with calibration standards and other known or observed parametric variables. Additionally, multiple samples and calibrants are usually analyzed to assess accuracy of the measurement procedure and repeatability by the analyst. Thus, a realistic assessment of uncertainty for most chemical measurement methods is not purely bottom-up (based on the measurement equation) or top-down (based on the experimental design), but inherently contains elements of both. Confidence in results must be rigorously evaluated for the sources of variability in all of the bottom-up and top-down elements. This type of analysis presents unique challenges due to various statistical correlations among the outputs of measurement equations. One approach is to use a Bayesian hierarchical (BH) model which is intrinsically rigorous, thus making it a straightforward method for use with complex experimental designs, particularly when correlations among data are numerous and difficult to elucidate or explicitly quantify. In simpler cases, careful analysis using GUM Supplement 1 (MC) methods augmented with random effects meta analysis yields similar results to a full BH model analysis. In this article we describe both approaches to rigorous uncertainty evaluation using as examples measurements of 25-hydroxyvitamin D3 in solution reference materials via liquid chromatography with UV absorbance detection (LC-UV) and liquid chromatography mass spectrometric detection using isotope dilution (LC-IDMS).

  8. Position of the American Dietetic Association: individual-, family-, school-, and community-based interventions for pediatric overweight.

    PubMed

    2006-06-01

    The American Dietetic Association (ADA), recognizing that overweight is a significant problem for children and adolescents in the United States, takes the position that pediatric overweight intervention requires a combination of family-based and school-based multi-component programs that include the promotion of physical activity, parent training/modeling, behavioral counseling, and nutrition education. Furthermore, although not yet evidence-based, community-based and environmental interventions are recommended as among the most feasible ways to support healthful lifestyles for the greatest numbers of children and their families. ADA supports the commitment of resources for programs, policy development, and research for the efficacious promotion of healthful eating habits and increased physical activity in all children and adolescents, regardless of weight status. This is the first position paper of ADA to be based on a rigorous systematic evidence-based analysis of the pediatric overweight literature on intervention programs. The research showed positive effects of two specific kinds of overweight interventions: a) multicomponent, family-based programs for children between the ages of 5 and 12 years, and b) multicomponent, school-based programs for adolescents. Multicomponent programs include behavioral counseling, promotion of physical activity, parent training/modeling, dietary counseling, and nutrition education. Analysis of the literature to date points to the need for further investigation of promising strategies not yet adequately evaluated. Furthermore, this review highlights the need for research to develop effective and innovative overweight prevention programs for various sectors of the population, including those of varying ethnicities, young children, and adolescents. To support and enhance the efficacy of family- and school-based weight interventions, community-wide interventions should be undertaken; few such interventions have been conducted and even fewer evaluated.

  9. Where is the F in MCH? Father involvement in African American families.

    PubMed

    Lu, Michael C; Jones, Loretta; Bond, Melton J; Wright, Kynna; Pumpuang, Maiteeny; Maidenberg, Molly; Jones, Drew; Garfield, Craig; Rowley, Diane L

    2010-01-01

    To: 1) review the historical contexts and current profiles of father involvement in African American families; 2) identify barriers to, and supports of, involvement; 3) evaluate the effectiveness of father involvement programs; and 4) recommend directions for future research, programs, and public policies. Review of observational and interventional studies on father involvement. Several historical developments (slavery, declining employment for Black men and increasing workforce participation for Black women, and welfare policies that favored single mothers) led to father absence from African American families. Today, more than two thirds of Black infants are born to unmarried mothers. Even if unmarried fathers are actively involved initially, their involvement over time declines. We identified multiple barriers to, and supports of, father involvement at multiple levels. These levels include intrapersonal (eg, human capital, attitudes and beliefs about parenting), interpersonal (eg, the father's relationships with the mother and maternal grandmother), neighborhoods and communities (eg, high unemployment and incarceration rates), cultural or societal (eg, popular cultural perceptions of Black fathers as expendable and irresponsible, racial stratification and institutionalized racism), policy (eg, Earned Income Tax Credit, Temporary Assistance for Needy Families, child support enforcement), and life-course factors (eg, father involvement by the father's father). We found strong evidence of success for several intervention programs (eg, Reducing the Risk, Teen Outreach Program, and Children's Aid Society - Carrera Program) designed to prevent formation of father-absent families, but less is known about the effectiveness of programs to encourage greater father involvement because of a lack of rigorous research design and evaluation for most programs. A multi-level, life-course approach is needed to strengthen the capacity of African American men to promote greater involvement in pregnancy and parenting as they become fathers.

  10. The Conservation Reserve Program: Planting for the future

    USGS Publications Warehouse

    Hyberg, Skip; Allen, Arthur

    2006-01-01

    Proceedings are now available from a scientific and technical forum held to review ongoing and planned research, identify lessons learned, and determine future research needs for the purpose of developing a rigorous scientific basis for future CRP policy discussions.

  11. THE US ENVIRONMENTAL PROTECTION AGENCY'S MONITORING AND ASSESSMENT PROGRAM

    EPA Science Inventory

    A scientifically rigorous determination of the condition of an aquatic resource is fundamental to all subsequent research, modeling, protection, and restoration issues. Environmental risk characterization is predicated on knowledge of condition and the rate at which that conditio...

  12. Drug checking: a potential solution to the opioid overdose epidemic?

    PubMed

    Bardwell, Geoff; Kerr, Thomas

    2018-05-25

    North America is experiencing an overdose epidemic driven in part by the proliferation of illicitly-manufactured fentanyl and related analogues. In response, communities are scaling up novel overdose prevention interventions. Included are drug checking technologies. Drug checking technologies aim to identify the contents of illicit drugs. These technologies vary considerably in terms of cost, accuracy, and usability, and while efforts are now underway to implement drug checking programs for people who inject drugs, there remains a lack of rigorous evaluation of their impacts. Given the ongoing overdose crisis and the urgent need for effective responses, research on drug checking should be prioritized. However, while such research should be supported, it should be completed before these technologies are widely implemented.

  13. Development and evaluation of a youth mental health community awareness campaign - The Compass Strategy.

    PubMed

    Wright, Annemarie; McGorry, Patrick D; Harris, Meredith G; Jorm, Anthony F; Pennell, Kerryn

    2006-08-22

    Early detection and treatment of mental disorders in adolescents and young adults can lead to better health outcomes. Mental health literacy is a key to early recognition and help seeking. Whilst a number of population health initiatives have attempted to improve mental health literacy, none to date have specifically targeted young people nor have they applied the rigorous standards of population health models now accepted as best practice in other health areas. This paper describes the outcomes from the application of a health promotion model to the development, implementation and evaluation of a community awareness campaign designed to improve mental health literacy and early help seeking amongst young people. The Compass Strategy was implemented in the western metropolitan Melbourne and Barwon regions of Victoria, Australia. The Precede-Proceed Model guided the population assessment, campaign strategy development and evaluation. The campaign included the use of multimedia, a website, and an information telephone service. Multiple levels of evaluation were conducted. This included a cross-sectional telephone survey of mental health literacy undertaken before and after 14 months of the campaign using a quasi-experimental design. Randomly selected independent samples of 600 young people aged 12-25 years from the experimental region and another 600 from a comparison region were interviewed at each time point. A series of binary logistic regression analyses were used to measure the association between a range of campaign outcome variables and the predictor variables of region and time. The program was judged to have an impact on the following variables, as indicated by significant region-by-time interaction effects (p < 0.05): awareness of mental health campaigns, self-identified depression, help for depression sought in the previous year, correct estimate of prevalence of mental health problems, increased awareness of suicide risk, and a reduction in perceived barriers to help seeking. These effects may be underestimated because media distribution error resulted in a small amount of print material "leaking" into the comparison region. We believe this is the first study to apply the rigorous standards of a health promotion model including the use of a control region to a mental health population intervention. The program achieved many of its aims despite the relatively short duration and moderate intensity of the campaign.

  14. Development and evaluation of a youth mental health community awareness campaign – The Compass Strategy

    PubMed Central

    Wright, Annemarie; McGorry, Patrick D; Harris, Meredith G; Jorm, Anthony F; Pennell, Kerryn

    2006-01-01

    Background Early detection and treatment of mental disorders in adolescents and young adults can lead to better health outcomes. Mental health literacy is a key to early recognition and help seeking. Whilst a number of population health initiatives have attempted to improve mental health literacy, none to date have specifically targeted young people nor have they applied the rigorous standards of population health models now accepted as best practice in other health areas. This paper describes the outcomes from the application of a health promotion model to the development, implementation and evaluation of a community awareness campaign designed to improve mental health literacy and early help seeking amongst young people. Method The Compass Strategy was implemented in the western metropolitan Melbourne and Barwon regions of Victoria, Australia. The Precede-Proceed Model guided the population assessment, campaign strategy development and evaluation. The campaign included the use of multimedia, a website, and an information telephone service. Multiple levels of evaluation were conducted. This included a cross-sectional telephone survey of mental health literacy undertaken before and after 14 months of the campaign using a quasi-experimental design. Randomly selected independent samples of 600 young people aged 12–25 years from the experimental region and another 600 from a comparison region were interviewed at each time point. A series of binary logistic regression analyses were used to measure the association between a range of campaign outcome variables and the predictor variables of region and time. Results The program was judged to have an impact on the following variables, as indicated by significant region-by-time interaction effects (p < 0.05): awareness of mental health campaigns, self-identified depression, help for depression sought in the previous year, correct estimate of prevalence of mental health problems, increased awareness of suicide risk, and a reduction in perceived barriers to help seeking. These effects may be underestimated because media distribution error resulted in a small amount of print material "leaking" into the comparison region. Conclusion We believe this is the first study to apply the rigorous standards of a health promotion model including the use of a control region to a mental health population intervention. The program achieved many of its aims despite the relatively short duration and moderate intensity of the campaign. PMID:16923195

  15. Teacher Evaluation Reform: Focus, Feedback, and Fear

    ERIC Educational Resources Information Center

    Donaldson, Morgaen L.

    2016-01-01

    How are teachers experiencing the more rigorous teacher evaluation systems that many states have mandated in recent years? Donaldson, who has studied teacher evaluation reform over the past eight years, shares insights from a study of 14 Connecticut districts that have implemented the state's 2012 teacher evaluation reforms. In surveys and…

  16. Risk Factors for Homelessness Among US Veterans

    PubMed Central

    Tsai, Jack; Rosenheck, Robert A.

    2015-01-01

    Homelessness among US veterans has been a focus of research for over 3 decades. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, this is the first systematic review to summarize research on risk factors for homelessness among US veterans and to evaluate the evidence for these risk factors. Thirty-one studies published from 1987 to 2014 were divided into 3 categories: more rigorous studies, less rigorous studies, and studies comparing homeless veterans with homeless nonveterans. The strongest and most consistent risk factors were substance use disorders and mental illness, followed by low income and other income-related factors. There was some evidence that social isolation, adverse childhood experiences, and past incarceration were also important risk factors. Veterans, especially those who served since the advent of the all-volunteer force, were at greater risk for homelessness than other adults. Homeless veterans were generally older, better educated, and more likely to be male, married/have been married, and to have health insurance coverage than other homeless adults. More studies simultaneously addressing premilitary, military, and postmilitary risk factors for veteran homelessness are needed. This review identifies substance use disorders, mental illness, and low income as targets for policies and programs in efforts to end homelessness among veterans. PMID:25595171

  17. Implementing and Evaluating Comprehensive Evidence-Based Approaches to Prevent Youth Violence: Partnering to Create Communities Where Youth Are Safe From Violence.

    PubMed

    Matjasko, Jennifer L; Massetti, Greta M; Bacon, Sarah

    2016-04-01

    Violence, including its occurrence among youth, results in considerable physical, emotional, social, and economic consequences in the U.S. Youth violence prevention work at the Division of Violence Prevention (DVP) at the Centers for Disease Control and Prevention (CDC) emphasizes preventing youth violence-related behaviors, injuries, and deaths by collaborating with academic and community partners and stakeholders. Since 2000, DVP has funded three rounds of CDC's National Centers of Excellence in Youth Violence Prevention (YVPCs) in 5-year cycles, with the goal of supporting university-community partnerships so that the best science can be utilized in order to prevent youth violence. The current YVPCs focus on: (a) partnering with communities to identify community needs; (b) selecting and implementing the best comprehensive evidence-based programs to meet those needs; and (c) rigorously evaluating whether those efforts have a community-level impact on youth violence rates. The introduction to this special issue on the current YVPCs provides a brief historical overview on the YVPC Program; outlines the YVPCs' accomplishments to date; and describes the current YVPCs, their community partners, and their activities. The introduction concludes with an overview of the special issue.

  18. Prevalence of acute blood transfusion reactions in Mazandaran Heart Center, Sari, Iran, 2010-2012.

    PubMed

    Azizi, Soheil; Tabary, Shervin Ziabakhsh; Soleimani, Arya

    2014-01-01

    Although blood transfusion is life saving for patients, it is responsible for a series of complications and exposes the patients to a variety of risks. Therefore knowing different adverse effects of blood transfusion represents a great issue in managing recipient patients. The aim of the present work was to study the prevalence of blood transfusion complications among patients in the Mazandaran Heart Center, Sari, Iran, during a period of 2 years. A retrospective review of all reported and evaluated acute transfusion reactions during a 2 years period in Mazandaran Heart Center was performed. Associated clinical signs and symptoms were evaluated. In 9193 transfused blood products, there was 34 (0.4%) acute transfusion reactions. The commonest were discomfort and restlessness (0.16%), dyspnea (0.16%), rigors (0.13%), fever (0.08%), chest pain (0.06%), rash or urticaria (0.04%), nausea and vomiting (0.03%), palpitation (0.03%), hypertension (0.03%) flashing (0.02%), hypotension (0.02%). Acute transfusion reaction is seen in %0.4 of transfused patients therefore, we recommend a well-structured program for monitoring adverse reactions associated with blood transfusion and blood product administration (Hemovigilance program).

  19. Implanted component faults and their effects on gas turbine engine performance

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    MacLeod, J.D.; Taylor, V.; Laflamme, J.C.G.

    Under the sponsorship of the Canadian Department of National Defence, the Engine Laboratory of the National Research Council of Canada (NRCC) has established a program for the evaluation of component deterioration on gas turbine engine performance. The effect is aimed at investigating the effects of typical in-service faults on the performance characteristics of each individual engine component. The objective of the program is the development of a generalized fault library, which will be used with fault identification techniques in the field, to reduce unscheduled maintenance. To evaluate the effects of implanted faults on the performance of a single spool engine,more » such as an Allison T56 turboprop engine, a series of faulted parts were installed. For this paper the following faults were analyzed: (a) first-stage turbine nozzle erosion damage; (b) first-stage turbine rotor blade untwist; (c) compressor seal wear; (d) first and second-stage compressor blade tip clearance increase. This paper describes the project objectives, the experimental installation, and the results of the fault implantation on engine performance. Discussed are performance variations on both engine and component characteristics. As the performance changes were significant, a rigorous measurement uncertainty analysis is included.« less

  20. Tobacco interventions for Indigenous Australians: a review of current evidence.

    PubMed

    Power, Jennifer; Grealy, Claire; Rintoul, Duncan

    2009-12-01

    This paper reviewed effective interventions for increasing smoking cessation among Indigenous Australians and identified gaps in evidence regarding smoking cessation interventions for Indigenous Australians. A systematic review of academic literature and reports from government and non-government agencies published between 2001 and 2007 was conducted in early 2008. Initial findings from the review were tested using 16 in-depth interviews and two half-day workshops with practitioners and researchers working in the area of Indigenous health. Seven Australian programs for which there had been well-designed, rigorous evaluations were identified. A further four programs were identified that had limited evaluation information available. These studies provide evidence that face-to-face counselling or quit support used in conjunction with nicotine replacement therapy (NRT) is likely to increase quit rates among Indigenous people. Training Aboriginal Health Workers to provide brief smoking cessation intervention with patients is also likely to contribute to increased quit rates. Evidence regarding other interventions is more limited. Evidence indicates that smoking cessation strategies targeted at individuals, such as NRT and/ or counselling, may be effective smoking cessation aids for Indigenous Australians. However, there is no evidence regarding interventions likely to be effective in encouraging more Indigenous Australians to access these quit support strategies.

Some links on this page may take you to non-federal websites. Their policies may differ from this site.
Top