rigorous impact evaluation: Topics by Science.gov

Sample records for rigorous impact evaluation

Improving Education in Developing Countries: Lessons From Rigorous Impact Evaluations

ERIC Educational Resources Information Center

Ganimian, Alejandro J.; Murnane, Richard J.

2016-01-01

In this article, we reviewed and interpreted the evidence from 223 rigorous impact evaluations of educational initiatives conducted in 56 low- and middle-income countries. We considered for inclusion in our review all studies in recent syntheses that have reached seemingly conflicting conclusions about which interventions improve educational…
Which Interventions Have the Greatest Effect on Student Learning in Sub-Saharan Africa? "A Meta-Analysis of Rigorous Impact Evaluations"

ERIC Educational Resources Information Center

Conn, Katharine

2014-01-01

In the last three decades, there has been a large increase in the number of rigorous experimental and quasi-experimental evaluations of education programs in developing countries. These impact evaluations have taken place all over the globe, including a large number in Sub-Saharan Africa (SSA). The fact that the developing world is socially and…
Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor.

PubMed

Zimmerman, Kathleen N; Ledford, Jennifer R; Severini, Katherine E; Pustejovsky, James E; Barton, Erin E; Lloyd, Blair P

2018-03-03

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional Children, What Works Clearinghouse, and Single-Case Analysis and Design Framework) were compared to determine if conclusions regarding the effectiveness of antecedent sensory-based interventions for young children changed based on choice of quality evaluation tool. Evaluation of SCD quality differed across tools, suggesting selection of quality evaluation tools impacts evaluation findings. Suggestions for selecting an appropriate quality and rigor assessment tool are provided and across-tool conclusions are drawn regarding the quality and rigor of studies. Finally, authors provide guidance for using quality evaluations in conjunction with outcome analyses when conducting syntheses of interventions evaluated in the context of SCD. Copyright © 2018 Elsevier Ltd. All rights reserved.
Rigor + Results = Impact: Measuring Impact with Integrity (Invited)

NASA Astrophysics Data System (ADS)

Davis, H. B.; Scalice, D.

2013-12-01

Are you struggling to measure and explain the impact of your EPO efforts? The NASA Astrobiology Institute (NAI) is using an evaluation process to determine the impact of its 15 EPO projects with over 200 activities. What is the current impact? How can it be improved in the future? We have developed a process that preserves autonomy at the project implementation level while still painting a picture of the entire portfolio. The impact evaluation process looks at an education/public outreach activity through its entire project cycle. Working with an external evaluator, education leads: 1) rate the quality/health of an activity in each stage of its cycle, and 2) determine the impact based on the results of the evaluation and the rigor of the methods used. The process has created a way to systematically codify a project's health and its impact, while offering support for improving both impact and how it is measured.
A Critical Review of Methods to Evaluate the Impact of FDA Regulatory Actions

PubMed Central

Briesacher, Becky A.; Soumerai, Stephen B.; Zhang, Fang; Toh, Sengwee; Andrade, Susan E.; Wagner, Joann L.; Shoaibi, Azadeh; Gurwitz, Jerry H.

2013-01-01

Purpose To conduct a synthesis of the literature on methods to evaluate the impacts of FDA regulatory actions, and identify best practices for future evaluations. Methods We searched MEDLINE for manuscripts published between January 1948 and August 2011 that included terms related to FDA, regulatory actions, and empirical evaluation; the review additionally included FDA-identified literature. We used a modified Delphi method to identify preferred methodologies. We included studies with explicit methods to address threats to validity, and identified designs and analytic methods with strong internal validity that have been applied to other policy evaluations. Results We included 18 studies out of 243 abstracts and papers screened. Overall, analytic rigor in prior evaluations of FDA regulatory actions varied considerably; less than a quarter of studies (22%) included control groups. Only 56% assessed changes in the use of substitute products/services, and 11% examined patient health outcomes. Among studies meeting minimal criteria of rigor, 50% found no impact or weak/modest impacts of FDA actions and 33% detected unintended consequences. Among those studies finding significant intended effects of FDA actions, all cited the importance of intensive communication efforts. There are preferred methods with strong internal validity that have yet to be applied to evaluations of FDA regulatory actions. Conclusions Rigorous evaluations of the impact of FDA regulatory actions have been limited and infrequent. Several methods with strong internal validity are available to improve trustworthiness of future evaluations of FDA policies. PMID:23847020
Characteristics of School Districts That Participate in Rigorous National Educational Evaluations

PubMed Central

Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.

2017-01-01

Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to potential target populations for the interventions that were evaluated. Utilizing a list of the actual districts that participated in 11 large-scale rigorous educational evaluations, we compare those districts to several different target populations of districts that could potentially be affected by policy decisions regarding the interventions under study. We find that school districts that participated in the 11 rigorous educational evaluations differ from the interventions’ target populations in several ways, including size, student performance on state assessments, and location (urban/rural). These findings raise questions about whether, as currently implemented, the results from rigorous impact studies in education are likely to generalize to the larger set of school districts—and thus schools and students—of potential interest to policymakers, and how we can improve our study designs to retain strong internal validity while also enhancing external validity. PMID:29276552
Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

ERIC Educational Resources Information Center

Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

2012-01-01

This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…
A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation.

PubMed

Acosta, Joie D; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S

2016-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014-2015 school year. The study's rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area.
FORMAL SCENARIO DEVELOPMENT FOR ENVIRONMENTAL IMPACT ASSESSMENT STUDIES

EPA Science Inventory

Scenario analysis is a process of evaluating possible future events through the consideration of alternative plausible (though not equally likely) outcomes (scenarios). The analysis is designed to enable improved decision-making and assessment through a more rigorous evaluation o...
A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

PubMed Central

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2017-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014–2015 school year. The study’s rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area. PMID:28936104
Exploring the barriers to rigorous monitoring and evaluation of health systems strengthening activities: qualitative evidence from international development partners.

PubMed

Wisniewski, Janna M; Yeager, Valerie A; Diana, Mark L; Hotchkiss, David R

2016-10-01

The number of health systems strengthening (HSS) programs has increased in the last decade. However, a limited number of studies providing robust evidence for the value and impact of these programs are available. This study aims to identify knowledge gaps and challenges that impede rigorous monitoring and evaluation (M&E) of HSS, and to ascertain the extent to which these efforts are informed by existing technical guidance. Interviews were conducted with HSS advisors at United States Agency for International Development-funded missions as well as senior M&E advisors at implementing partner and multilateral organizations. Findings showed that mission staff do not use existing technical resources, either because they do not know about them or do not find them useful. Barriers to rigorous M&E included a lack suitable of indicators, data limitations, difficulty in demonstrating an impact on health, and insufficient funding and resources. Consensus and collaboration between international health partners and local governments may mitigate these challenges. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.
Impact evaluation to communicate and improve conservation non-governmental organization performance: the case of Conservation International.

PubMed

McKinnon, Madeleine C; Mascia, Michael B; Yang, Wu; Turner, Will R; Bonham, Curan

2015-11-05

The rising prominence of more rigorous approaches to measuring conservation outcomes has included greater adoption of impact evaluation by conservation non-governmental organizations (CNGOs). Within the scientific literature, however, little consideration has been given to the unique and specific roles of CNGOs in advancing impact evaluation. We explore these issues in the context of one CNGO-Conservation International (CI)-and its experiences producing, using and funding impact evaluations over the past decade. We examine the contributions of impact evaluation to CI's mission at three different stages of CI's strategy: innovation, demonstration and amplification. Furthermore, we review incentives and barriers encountered by CI in its 10+ years' experience in impact evaluation. More coordinated and strategic use of impact evaluation by CNGOs would facilitate learning and promote accountability across the conservation community. © 2015 The Author(s).
Impact evaluation to communicate and improve conservation non-governmental organization performance: the case of Conservation International

PubMed Central

McKinnon, Madeleine C.; Mascia, Michael B.; Yang, Wu; Turner, Will R.; Bonham, Curan

2015-01-01

The rising prominence of more rigorous approaches to measuring conservation outcomes has included greater adoption of impact evaluation by conservation non-governmental organizations (CNGOs). Within the scientific literature, however, little consideration has been given to the unique and specific roles of CNGOs in advancing impact evaluation. We explore these issues in the context of one CNGO—Conservation International (CI)—and its experiences producing, using and funding impact evaluations over the past decade. We examine the contributions of impact evaluation to CI's mission at three different stages of CI's strategy: innovation, demonstration and amplification. Furthermore, we review incentives and barriers encountered by CI in its 10+ years' experience in impact evaluation. More coordinated and strategic use of impact evaluation by CNGOs would facilitate learning and promote accountability across the conservation community. PMID:26460134
76 FR 74076 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Final Notice

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-30

... Evaluate the YouthBuild Program; Final Notice AGENCY: Employment and Training Administration (ETA), Labor... rigorous, nationally-representative estimates of the net impacts of the YouthBuild program. The Department... study. In the sites randomly selected to participate in this evaluation, all applicants for YouthBuild...
Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

PubMed

Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

2016-04-01

Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.
Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.
Unmet Need: Improving mHealth Evaluation Rigor to Build the Evidence Base.

PubMed

Mookherji, Sangeeta; Mehl, Garrett; Kaonga, Nadi; Mechael, Patricia

2015-01-01

mHealth-the use of mobile technologies for health-is a growing element of health system activity globally, but evaluation of those activities remains quite scant, and remains an important knowledge gap for advancing mHealth activities. In 2010, the World Health Organization and Columbia University implemented a small-scale survey to generate preliminary data on evaluation activities used by mHealth initiatives. The authors describe self-reported data from 69 projects in 29 countries. The majority (74%) reported some sort of evaluation activity, primarily nonexperimental in design (62%). The authors developed a 6-point scale of evaluation rigor comprising information on use of comparison groups, sample size calculation, data collection timing, and randomization. The mean score was low (2.4); half (47%) were conducting evaluations with a minimum threshold (4+) of rigor, indicating use of a comparison group, while less than 20% had randomized the mHealth intervention. The authors were unable to assess whether the rigor score was appropriate for the type of mHealth activity being evaluated. What was clear was that although most data came from mHealth projects pilots aimed for scale-up, few had designed evaluations that would support crucial decisions on whether to scale up and how. Whether the mHealth activity is a strategy to improve health or a tool for achieving intermediate outcomes that should lead to better health, mHealth evaluations must be improved to generate robust evidence for cost-effectiveness assessment and to allow for accurate identification of the contribution of mHealth initiatives to health systems strengthening and the impact on actual health outcomes.
The CAEP Standards and Research on Educator Preparation Programs: Linking Clinical Partnerships with Program Impact

ERIC Educational Resources Information Center

Heafner, Tina; McIntyre, Ellen; Spooner, Melba

2014-01-01

Responding to the challenge of more rigorous and outcome-oriented program evaluation criteria of the Council for the Accreditation of Educator Preparation (CAEP), authors take a critical look at the intersection of two standards: Clinical Partnerships and Practice (Standard 2) and Program Impact (Standard 4). Illustrating one aspect of a secondary…
Failure to Learn from Failure: Evaluating Computer Systems in Medicine

PubMed Central

Grann, Richard P.

1980-01-01

Evaluation of ADP systems in medicine frequently becomes mired in problems of tenuous cost measurement, of proving illusory cost savings, of false precision, and of dubious discounting methods, while giving only superficial treatment to non-dollar benefits. It would frequently be more advantageous to study non-dollar impacts with greater care and rigor.
The Impact of Performance Ratings on Job Satisfaction for Public School Teachers

ERIC Educational Resources Information Center

Koedel, Cory; Li, Jiaxi; Springer, Matthew G.; Tan, Li

2017-01-01

Spurred by the federal Race to the Top competition, the state of Tennessee implemented a comprehensive statewide educator evaluation system in 2011. The new system is designed to increase the rigor of evaluations and better differentiate teachers based on performance. The use of more differentiated ratings represents a significant shift in…

International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed Central

Craigie, Ian D.; Barnes, Megan D.; Geldmann, Jonas; Woodley, Stephen

2015-01-01

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. PMID:26460135
Analysis of the Impacts of City Year's Whole School Whole Child Model on Partner Schools' Performance

ERIC Educational Resources Information Center

Meredith, Julie; Anderson, Leslie M.

2015-01-01

City Year is a learning organization committed to the rigorous evaluation of its "Whole School Whole Child" model, which trains and deploys teams of AmeriCorps members to low-performing, urban schools to empower more students to reach their full potential. A third-party study by Policy Studies Associates (PSA) examined the impact of…
School Nurses' Role in Asthma Management, School Absenteeism, and Cost Savings: A Demonstration Project

ERIC Educational Resources Information Center

Rodriguez, Eunice; Rivera, Diana Austria; Perlroth, Daniella; Becker, Edmund; Wang, Nancy Ewen; Landau, Melinda

2013-01-01

Background: With increasing budget cuts to education and social services, rigorous evaluation needs to document school nurses' impact on student health, academic outcomes, and district funding. Methods: Utilizing a quasi-experimental design, we evaluated outcomes in 4 schools with added full-time nurses and 5 matched schools with part-time nurses…
DEMONSTRATION AND EVALUATION OF STRUCTURAL BENEFIT TRANSFER AND BAYESIAN BENEFIT TRANSFER FOR VALUING WELFARE IMPACTS OF SALTWATER BEACH QUALITY CHANGES

EPA Science Inventory

The main methodological contribution lies in the demonstration and evaluation of these two BT methods, which are not in common use, in a new application (valuing beach closures). Another important contribution is the use of the NSRE data for rigorous nonmarket valuation ap...
Guiding Math Students to Campus Services: An Impact Evaluation of the Beacon Program at South Texas College

ERIC Educational Resources Information Center

Visher, Mary; Butcher, Kristin F.; Cerna, Oscar S.

2011-01-01

This research rigorously evaluates whether a low-cost intervention can improve students' performance in developmental math. The "Beacon Mentoring Program" was developed at South Texas College by professors, administrators, and staff at the college. Surveys of students revealed that many did not have someone on campus whom they felt they…
Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Rigorous Impact Evaluations

ERIC Educational Resources Information Center

Conn, Katharine

2014-01-01

The aim of this dissertation is to identify effective educational interventions in Sub-Saharan African with an impact on student learning. This is the first meta-analysis in the field of education conducted for Sub-Saharan Africa. This paper takes an in-depth look at twelve different types of education interventions or programs and attempts to not…
Impact of insects on multiple-use values of north-central forests: an experimental rating scheme.

Treesearch

Norton D. Addy; Harold O. Batzer; William J. Mattson; William E. Miller

1971-01-01

Ranking or assigning priorities to problems is an essential step in research problem selection. Up to now, no rigorous basis for ranking forest insects has been available. We evaluate and rank forest insects with a systematic numerical scheme that considers insect impact on the multiple-use values of timber, wildlife, recreation, and water. The result is a better...
International funding agencies: potential leaders of impact evaluation in protected areas?

PubMed

Craigie, Ian D; Barnes, Megan D; Geldmann, Jonas; Woodley, Stephen

2015-11-05

Globally, protected areas are the most commonly used tools to halt biodiversity loss. Yet, some are failing to adequately conserve the biodiversity they contain. There is an urgent need for knowledge on how to make them function more effectively. Impact evaluation methods provide a set of tools that could yield this knowledge. However, rigorous outcome-focused impact evaluation is not yet used as extensively as it could be in protected area management. We examine the role of international protected area funding agencies in facilitating the use of impact evaluation. These agencies are influential stakeholders as they allocate hundreds of millions of dollars annually to support protected areas, creating a unique opportunity to shape how the conservation funds are spent globally. We identify key barriers to the use of impact evaluation, detail how large funders are uniquely placed to overcome many of these, and highlight the potential benefits if impact evaluation is used more extensively. © 2015 The Author(s).
Estimating Impacts on Students, Teachers, and Schools of Programs Targeted for Preschool through Transition to College--Lessons for Methodologists from the Designs of 117 Evaluations Being Conducted in the Investing in Innovation Fund (i3) Grant Program.

ERIC Educational Resources Information Center

Price, Cristofer; Wolf, Anne; Goodson, Barbara; Boulay, Beth

2015-01-01

When presenting results from rigorous, field-based evaluations of educational interventions, researchers often reveal methodological barriers they face in designing studies to assessing program effectiveness. The evaluations funded by the Investing in Innovation Fund (i3) present a timely opportunity for identifying relevant and pressing issues…
Adding a Time-Series Design Element to the Success Case Method to Improve Methodological Rigor: An Application for Nonprofit Program Evaluation

ERIC Educational Resources Information Center

Coryn, Chris L. S.; Schroter, Daniela C.; Hanssen, Carl E.

2009-01-01

Brinkerhoff's Success Case Method (SCM) was developed with the specific purpose of assessing the impact of organizational interventions (e.g., training and coaching) on business goals by analyzing extreme groups using case study techniques and storytelling. As an efficient and cost-effective method of evaluative inquiry, SCM is attractive in other…
Closing the Learning Loop: A Review of Assignments in International Business Education

ERIC Educational Resources Information Center

Seno-Alday, Sandra; Budde-Sung, Amanda

2016-01-01

The continuing rapid globalization has significantly changed the nature of business and management, leading to increased pressure from a wide range of stakeholders to globalize business schools and to internationalize business curricula. This comes with a corresponding imperative to rigorously evaluate the impact of an international business…
Effective Dropout Prevention and College Attendance Programs for Latino Students.

ERIC Educational Resources Information Center

Fashola, Olatokunbo S.; Slavin, Robert E.

This paper reviews research related to effective secondary school programs aimed at dropout prevention and increasing college enrollment rates for at-risk Latino youth. The review identifies programs that have demonstrated a significant impact on dropout rates, college attendance, school performance, or related outcomes in rigorous evaluations;…
Early Childhood Development through an Integrated Program: Evidence from the Philippines. Impact Evaluation Series No. 2. World Bank Policy Research Working Paper 3922-IE

ERIC Educational Resources Information Center

Armecin, Graeme; Behrman, Jere R.; Ghuman, Sharon; Gultiano, Socorro; King, Elizabeth M.; Lee, Nanette

2006-01-01

More attention and resources have been devoted in recent years to early childhood development (ECD) in low- and middle-income countries. Rigorous studies on the effectiveness of ECD-related programs for improving children's development in various dimensions in the developing world are scant. The authors evaluate an important ECD initiative of the…
Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

ERIC Educational Resources Information Center

Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

2014-01-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…
Genetic and environmental effects on the muscle structure response post-mortem.

PubMed

Thompson, J M; Perry, D; Daly, B; Gardner, G E; Johnston, D J; Pethick, D W

2006-09-01

This paper reviewed the mechanisms by which glycolytic rate and pre-rigor stretching of muscle impact on meat quality. If muscle is free to shorten during the rigor process extremes in glycolytic rate can impact negatively on meat quality by inducing either cold or rigor shortening. Factors that contribute to variation in glycolytic rate include the glycogen concentration at slaughter and fibre type of the muscle. Glycolysis is highly sensitive to temperature, which is an important factor in heavy grain fed carcasses. An alternative solution to controlling glycolysis is to stretch the muscle pre-rigor so that it cannot shorten, thus providing an insurance against extremes in processing conditions. Results are presented which show a large reduction in variance (both additive and phenotypic) in tenderness caused by pre-rigor stretching. Whilst this did not impact on the heritability of shear force, it did reduce genotype differences. The implications of these results on the magnitude of genotype effects on tenderness is discussed.
Impact of cooking and home food preparation interventions among adults: outcomes and implications for future programs

PubMed Central

Reicks, Marla; Trofholz, Amanda C.; Stang, Jamie S; Laska, Melissa N.

2014-01-01

Objective Cooking programs are growing in popularity; however an extensive review has not examined overall impact. Therefore, this study reviewed previous research on cooking/home food preparation interventions and diet and health-related outcomes among adults and identified implications for practice and research. Design Literature review and descriptive summative method. Main outcome measures Dietary intake, knowledge/skills, cooking attitudes and self-efficacy/confidence, health outcomes. Analysis Articles evaluating effectiveness of interventions that included cooking/home food preparation as the primary aim (January 1980 through December 2011) were identified via OVID MEDLINE, Agricola and Web of Science databases. Studies grouped according to design and outcomes were reviewed for validity using an established coding system. Results were summarized for several outcome categories. Results Of 28 studies identified, 12 included a control group with six as non-randomized and six as randomized controlled trials. Evaluation was done post-intervention for five studies, pre- and post-intervention for 23 and beyond post-intervention for 15. Qualitative and quantitative measures suggested a positive influence on main outcomes. However, non-rigorous study designs, varying study populations, and use of non-validated assessment tools limited stronger conclusions. Conclusions and Implications Well-designed studies are needed that rigorously evaluate long-term impact on cooking behavior, dietary intake, obesity and other health outcomes. PMID:24703245
The Economic Payoffs to Workplace Literacy. Upjohn Institute Staff Working Paper 93-21.

ERIC Educational Resources Information Center

Hollenbeck, Kevin

Although a substantial literature has addressed workplace literacy programs, only two studies have attempted to evaluate rigorously the economic benefits to workplace education. A multivariate model has been suggested that provides evidence about the productivity impacts of participation in a workplace literacy program. The data used in this paper…
Incentives, Selection, and Teacher Performance: Evidence from IMPACT

ERIC Educational Resources Information Center

Dee, Thomas S.; Wyckoff, James

2015-01-01

Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This…
Practice Brief: Assessing Impact of Inclusive Postsecondary Education Using the Think College Standards

ERIC Educational Resources Information Center

Lynch, Kathleen Bodisch; Getzel, Elizabeth Evans

2013-01-01

Increasingly across the United States, institutions of higher education (IHE) are offering a wide array of postsecondary educational (PSE) opportunities for students with intellectual disabilities (ID). As more students with ID aspire to college, it is incumbent upon IHEs to engage in rigorous program evaluation to assess student outcomes and…
International Service Learning: Conceptual Frameworks and Research. IUPUI Series on Service Learning Research 1

ERIC Educational Resources Information Center

Bringle, Robert G., Ed.; Hatcher, Julie A., Ed.; Jones, Steven G., Ed.

2010-01-01

This book focuses on conducting research on International Service Learning (ISL), which includes developing and evaluating hypotheses about ISL outcomes and measuring its impact on students, faculty, and communities. The book argues that rigorous research is essential to improving the quality of ISL's implementation and delivery, and providing the…

A Review of Interventions To Increase Driving Safety among Teenage Drivers.

ERIC Educational Resources Information Center

Mattox, John R., II

Young drivers across the United States represent a persistent traffic safety problem. Many interventions have been imposed on these drivers but few studies have evaluated the impact of these interventions on risky behaviors or traffic safety measures. To fill this gap, a review was undertaken to examine the most rigorous methodological evaluations…
Educating Students for E-Entrepreneurship in the UK, the USA and China

ERIC Educational Resources Information Center

Millman, Cindy; Wong, Wang-chan; Li, Zhengwei; Matlay, Harry

2009-01-01

A growing body of research evaluates various aspects of entrepreneurship education (such as curriculum, delivery and assessment) and links it to outcomes in terms of both the number and quality of entrepreneurs entering an economy. There is, however, a marked paucity of empirically rigorous research appraising the impact of entrepreneurship…
Exploring Student Perceptions of Rigor Online: Toward a Definition of Rigorous Learning

ERIC Educational Resources Information Center

Duncan, Heather E.; Range, Bret; Hvidston, David

2013-01-01

Technological advances in the last decade have impacted delivery methods of university courses. More and more courses are offered in a variety of formats. While academic rigor is a term often used, its definition is less clear. This mixed-methods study explored graduate student conceptions of rigor in the online learning environment embedded…
Integrating impact evaluation in the design and implementation of monitoring marine protected areas

PubMed Central

Ahmadia, Gabby N.; Glew, Louise; Provost, Mikaela; Gill, David; Hidayat, Nur Ismu; Mangubhai, Sangeeta; Purwanto; Fox, Helen E.

2015-01-01

Quasi-experimental impact evaluation approaches, which enable scholars to disentangle effects of conservation interventions from broader changes in the environment, are gaining momentum in the conservation sector. However, rigorous impact evaluation using statistical matching techniques to estimate the counterfactual have yet to be applied to marine protected areas (MPAs). While there are numerous studies investigating ‘impacts’ of MPAs that have generated considerable insights, results are variable. This variation has been linked to the biophysical and social context in which they are established, as well as attributes of management and governance. To inform decisions about MPA placement, design and implementation, we need to expand our understanding of conditions under which MPAs are likely to lead to positive outcomes by embracing advances in impact evaluation methodologies. Here, we describe the integration of impact evaluation within an MPA network monitoring programme in the Bird's Head Seascape, Indonesia. Specifically we (i) highlight the challenges of implementation ‘on the ground’ and in marine ecosystems and (ii) describe the transformation of an existing monitoring programme into a design appropriate for impact evaluation. This study offers one potential model for mainstreaming impact evaluation in the conservation sector. PMID:26460128
Immunogenicity of therapeutic proteins. Part 2: impact of container closures.

PubMed

Sharma, Basant

2007-01-01

Immunogenicity as a potential consequence of therapeutic protein administration is increasingly being scrutinized in the biopharmaceuticals industry, particularly with the imminent introduction of biosimilar products. Immunogenicity is an important safety aspect requiring rigorous investigation to fully appreciate its impact. Factors involved in product handling, such as storage temperature, light exposure, and shaking, have been implicated in immunogenicity, while container closure systems are no less important. Intended to provide a stable environment for the dosage form, container closures may also interact with a product, affecting performance and potentially enhancing immunogenicity. Glass surfaces, air-liquid interfaces, and lubricants can mediate protein denaturation, while phthalates in plastics and latex rubber are sources of extractables and leachates that may contaminate a product, causing allergic reactions and increasing immunogenicity. The manufacture of therapeutic proteins therefore requires rigorous safety evaluations not just in the context of the product, but also product containment.
Program Evaluation: Experienced Agencies Follow a Similar Model for Prioritizing Research. Report to the Subcommittee on Oversight of Government Management, the Federal Workforce, and the District of Columbia, Committee on Homeland Security and Governmental Affairs, U.S. Senate. GAO-11-176

ERIC Educational Resources Information Center

Kingsbury, Nancy

2011-01-01

Amid efforts to improve performance and constrain spending, federal agencies are being asked to expand the use of rigorous program evaluation in decision-making. In addition to performance data, indepth program evaluation studies are often needed for assessing program impact or designing improvements. Agencies can also use their evaluation…
Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children. Report from the Social and Character Development Research Program. NCER 2011-2001

ERIC Educational Resources Information Center

Ruby, Allen; Doolittle, Emily

2010-01-01

The Institute of Education Sciences (IES) and the Division of Violence Prevention in the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention (CDC) collaborated to conduct a rigorous impact evaluation of programs aimed at improving students' behavior. For this evaluation, such programs were termed Social…
Impact Evaluation of the National Writing Project's College-Ready Writing Project in High Poverty Rural Districts

ERIC Educational Resources Information Center

Gallagher, H. Alix; Arshan, Nicole; Woodworth, Katrina

2016-01-01

Writing is an essential skill for participating in modern American society. Although it is crucial to careers and civic engagement, student writing falls far short of national expectations (College Board, 2004; NCES, 2012; Persky, Daane, & Jin, 2003). The Common Core State Standards (CCSS) seek to increase the rigor of writing instruction…
Incentives, Selection, and Teacher Performance: Evidence from IMPACT. NBER Working Paper No. 19529

ERIC Educational Resources Information Center

Dee, Thomas; Wyckoff, James

2013-01-01

Teachers in the United States are compensated largely on the basis of fixed schedules that reward experience and credentials. However, there is a growing interest in whether performance-based incentives based on rigorous teacher evaluations can improve teacher retention and performance. The evidence available to date has been mixed at best. This…
Manufacturing Educational Change: Impact Evaluation of the Lansing Area Manufacturing Partnership Pilot Program. Executive Summary.

ERIC Educational Resources Information Center

MacAllum, Keith; Taylor, Susan Hubbard; Johnson, Amy Bell

The Lansing Area Manufacturing Partnership (LAMP) is an academically rigorous, business/labor-driven school-to-career program in Lansing, Michigan, that includes business, union, school, and parent partners and provides participating students with work-based learning experiences for 2.5 hours every day throughout their senior year. LAMP's…
A pilot mixed-methods evaluation of MS INFoRm: a self-directed fatigue management resource for individuals with multiple sclerosis.

PubMed

Akbar, Nadine; Turpin, Karen; Petrin, Julie; Smyth, Penny; Finlayson, Marcia

2018-06-01

Fatigue management interventions for individuals with multiple sclerosis (MS) often feature structured programmes requiring repeated, in-person attendance that is not possible for all individuals. We sought to determine whether MS INFoRm, a self-directed fatigue management resource for individuals with MS, was worth further, more rigorous evaluation. Our indicators of worthiness were actual use of the resource by participants over 3 months, reductions in fatigue impact and increases in self-efficacy, and participant reports of changes in fatigue management knowledge and behaviours. This was a single-group, mixed-methods, before-after pilot study in individuals with MS reporting mild to moderate fatigue. Thirty-five participants were provided with MS INFoRm by a USB flash drive to use at home for 3 months, on their own volition. Twenty-three participants completed all standardized questionnaires, semi-structured interviews and study process measures. Participants reported actively using MS INFoRm over the 3-month study period (median total time spent using MS INFoRm=315 min) as well as significantly lower overall fatigue impact (Modified Fatigue Impact Scale: t=2.6, P=0.01), increased knowledge of MS fatigue (z=-2.8, P=0.01) and greater confidence in managing MS fatigue (z=-3.3, P=0.001). Individuals with significant reductions in fatigue impact also reported behavioural changes including tracking fatigue, better communication with others, greater awareness, improved quality of life and being more proactive. This study provides evidence that further rigorous evaluation of MS INFoRm, a self-directed resource for managing fatigue, is worth pursuing.
Characteristics of School Districts That Participate in Rigorous National Educational Evaluations

ERIC Educational Resources Information Center

Stuart, Elizabeth A.; Bell, Stephen H.; Ebnesajjad, Cyrus; Olsen, Robert B.; Orr, Larry L.

2017-01-01

Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to…
The need for better evidence to evaluate the health & economic benefits of India's Rashtriya Swasthya Bima Yojana

PubMed Central

Nandi, Arindam; Holtzman, E. Phoebe; Malani, Anup; Laxminarayan, Ramanan

2015-01-01

In this review the existing evidence on the impact of Rashtriya Swasthya Bima Yojana (RSBY) is discussed in the context of international literature available on health insurance. We describe potential pathways through which health insurance can affect health and economic outcomes, discuss evidence from other developing countries, and identify potential biases and inconsistencies in existing studies on RSBY impact. Given the relatively recent introduction of RSBY, lack of quality, verifiable data on utilization patterns, and the absence of reliable evaluation studies, there is a need to exercise caution while assessing the merits of the programme. Considering the enormous potential and cost of the programme, we emphasize the need for a rigorous impact evaluation of RSBY. It will not only help capture the real impact of the scheme, but may also be able to estimate the extent of systemic inefficiencies at the level of the consumer. PMID:26609029
Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.
Staff Acceptance of Tele-ICU Coverage

PubMed Central

Chan, Paul S.; Cram, Peter

2011-01-01

Background: Remote coverage of ICUs is increasing, but staff acceptance of this new technology is incompletely characterized. We conducted a systematic review to summarize existing research on acceptance of tele-ICU coverage among ICU staff. Methods: We searched for published articles pertaining to critical care telemedicine systems (aka, tele-ICU) between January 1950 and March 2010 using PubMed, Cumulative Index to Nursing and Allied Health Literature, Global Health, Web of Science, and the Cochrane Library and abstracts and presentations delivered at national conferences. Studies were included if they provided original qualitative or quantitative data on staff perceptions of tele-ICU coverage. Studies were imported into content analysis software and coded by tele-ICU configuration, methodology, participants, and findings (eg, positive and negative staff evaluations). Results: Review of 3,086 citations yielded 23 eligible studies. Findings were grouped into four categories of staff evaluation: overall acceptance level of tele-ICU coverage (measured in 70% of studies), impact on patient care (measured in 96%), impact on staff (measured in 100%), and organizational impact (measured in 48%). Overall acceptance was high, despite initial ambivalence. Favorable impact on patient care was perceived by > 82% of participants. Staff impact referenced enhanced collaboration, autonomy, and training, although scrutiny, malfunctions, and contradictory advice were cited as potential barriers. Staff perceived the organizational impact to vary. An important limitation of available studies was a lack of rigorous methodology and validated survey instruments in many studies. Conclusions: Initial reports suggest high levels of staff acceptance of tele-ICU coverage, but more rigorous methodologic study is required. PMID:21051386
Building an Evidence Base to Inform Interventions for Pregnant and Parenting Adolescents: A Call for Rigorous Evaluation

PubMed Central

Burrus, Barri B.; Scott, Alicia Richmond

2012-01-01

Adolescent parents and their children are at increased risk for adverse short- and long-term health and social outcomes. Effective interventions are needed to support these young families. We studied the evidence base and found a dearth of rigorously evaluated programs. Strategies from successful interventions are needed to inform both intervention design and policies affecting these adolescents. The lack of rigorous evaluations may be attributable to inadequate emphasis on and sufficient funding for evaluation, as well as to challenges encountered by program evaluators working with this population. More rigorous program evaluations are urgently needed to provide scientifically sound guidance for programming and policy decisions. Evaluation lessons learned have implications for other vulnerable populations. PMID:22897541
Comprehensive Adolescent Health Programs That Include Sexual and Reproductive Health Services: A Systematic Review

PubMed Central

Parekh, Jenita; Tunçalp, Özge; Turke, Shani; Blum, Robert William

2014-01-01

We systematically reviewed peer-reviewed and gray literature on comprehensive adolescent health (CAH) programs (1998–2013), including sexual and reproductive health services. We screened 36 119 records and extracted articles using predefined criteria. We synthesized data into descriptive characteristics and assessed quality by evidence level. We extracted data on 46 programs, of which 19 were defined as comprehensive. Ten met all inclusion criteria. Most were US based; others were implemented in Egypt, Ethiopia, and Mexico. Three programs displayed rigorous evidence; 5 had strong and 2 had modest evidence. Those with rigorous or strong evidence directly or indirectly influenced adolescent sexual and reproductive health. The long-term impact of many CAH programs cannot be proven because of insufficient evaluations. Evaluation approaches that take into account the complex operating conditions of many programs are needed to better understand mechanisms behind program effects. PMID:25320876
Encouraging Evidence on a Sector-Focused Advancement Strategy: Two-Year Impacts from the WorkAdvance Demonstration

ERIC Educational Resources Information Center

Hendra, Richard; Greenberg, David H.; Hamilton, Gayle; Oppenheim, Ari; Pennington, Alexandra; Schaberg, Kelsey; Tessler, Betsy L.

2016-01-01

This report summarizes the two-year findings of a rigorous random assignment evaluation of the WorkAdvance model, a sectoral training, and advancement initiative. Launched in 2011, WorkAdvance goes beyond the previous generation of employment programs by introducing demand-driven skills training and a focus on jobs that have career pathways. The…
Evaluation of Quality Teaching for English Learners (QTEL) Professional Development. Final Report. NCEE 2012-4005

ERIC Educational Resources Information Center

Bos, Johannes M.; Sanchez, Raquel C.; Tseng, Fannie; Rayyes, Nada; Ortiz, Lorena; Sinicrope, Castle

2012-01-01

To add to the evidence base on effective strategies for teaching English language learner students, the 2006-2011 REL West at WestEd conducted a rigorous study, using an intent-to-treat model, of the impact on middle grades student achievement of offering teachers the opportunity to participate in a teacher professional development program. The…
Encouraging Evidence on a Sector-Focused Advancement Strategy: Two-Year Impacts from the WorkAdvance Demonstration. Preview Summary

ERIC Educational Resources Information Center

Hendra, Richard; Greenberg, David H.; Hamilton, Gayle; Oppenheim, Ari; Pennington, Alexandra; Schaberg, Kelsey; Tessler, Betsy L.

2016-01-01

This report summarizes the two-year findings of a rigorous random assignment evaluation of the WorkAdvance model, a sectoral training and advancement initiative. Launched in 2011, WorkAdvance goes beyond the previous generation of employment programs by introducing demand-driven skills training and a focus on jobs that have career pathways. The…

Considering Research Outcomes as Essential Tools for Medical Education Decision Making.

PubMed

Miller, Karen Hughes; Miller, Bonnie M; Karani, Reena

2015-11-01

As medical educators face the challenge of incorporating new content, learning methods, and assessment techniques into the curriculum, the need for rigorous medical education research to guide efficient and effective instructional planning increases. When done properly, well-designed education research can provide guidance for complex education decision making. In this Commentary, the authors consider the 2015 Research in Medical Education (RIME) research and review articles in terms of the critical areas in teaching and learning that they address. The broad categories include (1) assessment (the largest collection of RIME articles, including both feedback from learners and instructors and the reliability of learner assessment), (2) the institution's impact on the learning environment, (3) what can be learned from program evaluation, and (4) emerging issues in faculty development. While the articles in this issue are broad in scope and potential impact, the RIME committee noted few studies of sufficient rigor focusing on areas of diversity and diverse learners. Although challenging to investigate, the authors encourage continuing innovation in research focused on these important areas.
The role and impact of nurses in American elementary schools: a systematic review of the research.

PubMed

Lineberry, Michelle J; Ickes, Melinda J

2015-02-01

School nurses are tasked with the critical job of keeping students safe and well. Due to competing demands for resources in schools, the impact of school nurses must be demonstrated to secure their jobs. A systematic review of the literature from 1937 to 2013 was conducted to show the efficacy of school nursing activities in American elementary schools. While some studies of immunization compliance, attendance rates, body mass index screening, vision screening, and follow-up are promising, results are mixed and additional evidence is needed. The impact of school nurses on educational and health outcomes must continue to be evaluated and more rigorous evaluation methods should be explored. Suggestions for future research and collaborations are discussed. © The Author(s) 2014.
Paths to Work in Rural Places: Key Findings and Lessons from the Impact Evaluation of the Future Steps Rural Welfare-to-Work Program. Final Report

ERIC Educational Resources Information Center

Meckstroth, Alicia; Burwick, Andrew; Ponza, Michael; Marsh, Shawn; Novak, Tim; Phillips, Shannon; Diaz-Tena, Nuria; Ng, Judy

2006-01-01

Helping low-income families in rural areas find gainful employment and achieve economic self-sufficiency is an ongoing policy concern. The Rural Welfare-to-Work Strategies demonstration is using rigorous experimental designs to build knowledge about how to help low-income families in rural areas strive toward sustained employment and…
Stakeholder-focused evaluation of an online course for health care providers.

PubMed

Dunet, Diane O; Reyes, Michele

2006-01-01

Different people who have a stake or interest in a training course (stakeholders) may have markedly different definitions of what constitutes "training success" and how they will use evaluation results. Stakeholders at multiple levels within and outside of the organization guided the development of an evaluation plan for a Web-based training course on hemochromatosis. Stakeholder interests and values were reflected in the type, level, and rigor of evaluation methods selected. Our mixed-method evaluation design emphasized small sample sizes and repeated measures. Limited resources for evaluation were leveraged by focusing on the data needs of key stakeholders, understanding how they wanted to use evaluation results, and collecting data needed for stakeholder decision making. Regular feedback to key stakeholders provided opportunities for updating the course evaluation plan to meet emerging needs for new or different information. Early and repeated involvement of stakeholders in the evaluation process also helped build support for the final product. Involving patient advocacy groups, managers, and representative course participants improved the course and enhanced product dissemination. For training courses, evaluation planning is an opportunity to tailor methods and data collection to meet the information needs of particular stakeholders. Rigorous evaluation research of every training course may be infeasible or unwarranted; however, course evaluations can be improved by good planning. A stakeholder-focused approach can build a picture of the results and impact of training while fostering the practical use of evaluation data.
Measuring the difference made by conservation initiatives: protected areas and their environmental and social impacts.

PubMed

Ferraro, Paul J; Pressey, Robert L

2015-11-05

Success in conservation depends on our ability to reduce human pressures in areas that harbour biological diversity and ecosystem services. Legally protecting some of these areas through the creation of protected areas is a key component of conservation efforts globally. To develop effective protected area networks, practitioners need credible, scientific evidence about the degree to which protected areas affect environmental and social outcomes, and how these effects vary with context. Such evidence has been lacking, but the situation is changing as conservation scientists adopt more sophisticated research designs for evaluating protected areas' past impacts and for predicting their future impacts. Complementing these scientific advances, conservation funders and practitioners are paying increasing attention to evaluating their investments with more scientifically rigorous evaluation designs. This theme issue highlights recent advances in the science of protected area evaluations and explores the challenges to developing a more credible evidence base that can help societies achieve their goals of protecting nature while enhancing human welfare. © 2015 The Author(s).
Measuring the difference made by conservation initiatives: protected areas and their environmental and social impacts

PubMed Central

Ferraro, Paul J.; Pressey, Robert L.

2015-01-01

Success in conservation depends on our ability to reduce human pressures in areas that harbour biological diversity and ecosystem services. Legally protecting some of these areas through the creation of protected areas is a key component of conservation efforts globally. To develop effective protected area networks, practitioners need credible, scientific evidence about the degree to which protected areas affect environmental and social outcomes, and how these effects vary with context. Such evidence has been lacking, but the situation is changing as conservation scientists adopt more sophisticated research designs for evaluating protected areas' past impacts and for predicting their future impacts. Complementing these scientific advances, conservation funders and practitioners are paying increasing attention to evaluating their investments with more scientifically rigorous evaluation designs. This theme issue highlights recent advances in the science of protected area evaluations and explores the challenges to developing a more credible evidence base that can help societies achieve their goals of protecting nature while enhancing human welfare. PMID:26460123
Can performance-based financing help reaching the poor with maternal and child health services? The experience of rural Rwanda.

PubMed

Lannes, Laurence; Meessen, Bruno; Soucat, Agnes; Basinga, Paulin

2016-07-01

More than 20 countries in Africa are scaling up performance-based financing (PBF), but its impact on equity in access to health services remains to be documented. This paper draws on evidence from Rwanda to examine the capacity of PBF to ensure equal access to key health interventions especially in rural areas where most of the poor live. Specifically, it focuses on maternal and child health services, distinguishing two wealth groups, and uses data from a rigorous impact evaluation. Difference-in-difference technique is used, and different model specifications are tested: control for unobserved heterogeneity and common random error using linear probability model, seemingly unrelated regression equations, and clustering and fixed effects. Results suggest that in Rwanda, PBF improved efficiency rather than equity for most health services. We find that PBF achieved efficiency gains by improving access to health services for those easier to reach, generally the relatively more affluent. It turns out to be less effective in reaching the poorest. Our results illustrate the advantages of rigorous randomized impact evaluation data as results published earlier using a nationally representative survey (Demographic and Health Survey) were not able to capture the pro-rich nature of the PBF scheme in Rwanda. Our paper advocates for building mechanisms targeting the vulnerable groups in PBF strategies. It also highlights the need to understand the impact of PBF together with the specific development of health insurance coverage and the organization of the health system. Copyright © 2015 John Wiley & Sons, Ltd.
Mitigating Reptile Road Mortality: Fence Failures Compromise Ecopassage Effectiveness

PubMed Central

Baxter-Gilbert, James H.; Riley, Julia L.; Lesbarrères, David; Litzgus, Jacqueline D.

2015-01-01

Roadways pose serious threats to animal populations. The installation of roadway mitigation measures is becoming increasingly common, yet studies that rigorously evaluate the effectiveness of these conservation tools remain rare. A highway expansion project in Ontario, Canada included exclusion fencing and ecopassages as mitigation measures designed to offset detrimental effects to one of the most imperial groups of vertebrates, reptiles. Taking a multispecies approach, we used a Before-After-Control-Impact study design to compare reptile abundance on the highway before and after mitigation at an Impact site and a Control site from 1 May to 31 August in 2012 and 2013. During this time, radio telemetry, wildlife cameras, and an automated PIT-tag reading system were used to monitor reptile movements and use of ecopassages. Additionally, a willingness to utilize experiment was conducted to quantify turtle behavioral responses to ecopassages. We found no difference in abundance of turtles on the road between the un-mitigated and mitigated highways, and an increase in the percentage of both snakes and turtles detected dead on the road post-mitigation, suggesting that the fencing was not effective. Although ecopassages were used by reptiles, the number of crossings through ecopassages was lower than road-surface crossings. Furthermore, turtle willingness to use ecopassages was lower than that reported in previous arena studies, suggesting that effectiveness of ecopassages may be compromised when alternative crossing options are available (e.g., through holes in exclusion structures). Our rigorous evaluation of reptile roadway mitigation demonstrated that when exclusion structures fail, the effectiveness of population connectivity structures is compromised. Our project emphasizes the need to design mitigation measures with the biology and behavior of the target species in mind, to implement mitigation designs in a rigorous fashion, and quantitatively evaluate road mitigation to ensure allow for adaptive management and optimization of these increasingly important conservation tools. PMID:25806531
Mitigating reptile road mortality: fence failures compromise ecopassage effectiveness.

PubMed

Baxter-Gilbert, James H; Riley, Julia L; Lesbarrères, David; Litzgus, Jacqueline D

2015-01-01

Roadways pose serious threats to animal populations. The installation of roadway mitigation measures is becoming increasingly common, yet studies that rigorously evaluate the effectiveness of these conservation tools remain rare. A highway expansion project in Ontario, Canada included exclusion fencing and ecopassages as mitigation measures designed to offset detrimental effects to one of the most imperial groups of vertebrates, reptiles. Taking a multispecies approach, we used a Before-After-Control-Impact study design to compare reptile abundance on the highway before and after mitigation at an Impact site and a Control site from 1 May to 31 August in 2012 and 2013. During this time, radio telemetry, wildlife cameras, and an automated PIT-tag reading system were used to monitor reptile movements and use of ecopassages. Additionally, a willingness to utilize experiment was conducted to quantify turtle behavioral responses to ecopassages. We found no difference in abundance of turtles on the road between the un-mitigated and mitigated highways, and an increase in the percentage of both snakes and turtles detected dead on the road post-mitigation, suggesting that the fencing was not effective. Although ecopassages were used by reptiles, the number of crossings through ecopassages was lower than road-surface crossings. Furthermore, turtle willingness to use ecopassages was lower than that reported in previous arena studies, suggesting that effectiveness of ecopassages may be compromised when alternative crossing options are available (e.g., through holes in exclusion structures). Our rigorous evaluation of reptile roadway mitigation demonstrated that when exclusion structures fail, the effectiveness of population connectivity structures is compromised. Our project emphasizes the need to design mitigation measures with the biology and behavior of the target species in mind, to implement mitigation designs in a rigorous fashion, and quantitatively evaluate road mitigation to ensure allow for adaptive management and optimization of these increasingly important conservation tools.
The Development of a Service-Learning Program for First-Year Students Based on the Hallmarks of High Quality Service-Learning and Rigorous Program Evaluation

ERIC Educational Resources Information Center

Smith, Bradley H.; Gahagan, James; McQuillin, Samuel; Haywood, Benjamin; Cole, Caroline Pender; Bolton, Clay; Wampler, Mary Katherine

2011-01-01

We describe six hallmarks of high quality service-learning and explain how these considerations guided the development of a Transitional Coaching Program (TCP) during the first three years of implementation. We have demonstrated that the TCP is acceptable, feasible, and sustainable. Improvements have been seen in the degree of impact on learning…
Obesity and the US Military Family

PubMed Central

Tanofsky-Kraff, Marian; Sbrocco, Tracy; Theim, Kelly R.; Cohen, L. Adelyn; Mackey, Eleanor R.; Stice, Eric; Henderson, Jennifer L.; McCreight, Sarah J.; Bryant, Edny J.; Stephens, Mark B.

2014-01-01

Objective This review discusses the current knowledge and future directions regarding obesity within the US military family (i.e., active-duty servicemembers, as well as military spouses, children, retirees, and veterans). The increasing rates of overweight and obesity within the US military adversely impact military readiness, limit recruitment, and place a significant financial burden on the Department of Defense. Design and Methods The following topics are reviewed: 1) The prevalence of and the financial, physical, and psychological costs associated with overweight in military communities; 2) military weight regulations, and challenges faced by the military family related to overweight and disordered eating; 3) the continued need for rigorous program evaluations and new intervention development. Results Overweight and its associated sequelae impact the entire military family. Military families share many similarities with their civilian counterparts, but they face unique challenges (e.g., stress related to deployments and relocations). Although the military has weight management resources, there is an urgent need for rigorous program evaluation and the development of enhanced obesity prevention programs across the lifespan of the military family–several of which are proposed herein. Conclusions Interdisciplinary and collaborative research efforts and team-based interventions will continue to inform understanding of obesity treatment and prevention within military and civilian populations. PMID:23836452
Cost evaluation of cellulase enzyme for industrial-scale cellulosic ethanol production based on rigorous Aspen Plus modeling.

PubMed

Liu, Gang; Zhang, Jian; Bao, Jie

2016-01-01

Cost reduction on cellulase enzyme usage has been the central effort in the commercialization of fuel ethanol production from lignocellulose biomass. Therefore, establishing an accurate evaluation method on cellulase enzyme cost is crucially important to support the health development of the future biorefinery industry. Currently, the cellulase cost evaluation methods were complicated and various controversial or even conflict results were presented. To give a reliable evaluation on this important topic, a rigorous analysis based on the Aspen Plus flowsheet simulation in the commercial scale ethanol plant was proposed in this study. The minimum ethanol selling price (MESP) was used as the indicator to show the impacts of varying enzyme supply modes, enzyme prices, process parameters, as well as enzyme loading on the enzyme cost. The results reveal that the enzyme cost drives the cellulosic ethanol price below the minimum profit point when the enzyme is purchased from the current industrial enzyme market. An innovative production of cellulase enzyme such as on-site enzyme production should be explored and tested in the industrial scale to yield an economically sound enzyme supply for the future cellulosic ethanol production.
Evaluating the Impacts of Mangrove Rehabilitation in Cogtong Bay, Philippines

NASA Astrophysics Data System (ADS)

Maliao, Ronald J.; Polohan, Bernice B.

2008-03-01

Marine Protected Areas (MPAs) have been hailed worldwide as vehicles toward sustainable development (SD) in coastal zones. The prominent model by which MPAs operate is through a comanagement approach, a shift from traditional top-down management. This paradigm shift must be reviewed continuously to evaluate its social and ecological impacts, thereby allowing adaptive management. We evaluated the perceived impacts of the Cogtong Bay Mangrove Rehabilitation Project (CBMRP; Philippines) by using 12 perception indicators categorized into 3 comanagement impact criteria (equity, efficiency, and sustainability). We also collected 16 contextual attributes of each respondent to determine the correlates of perceived impacts. Our results showed that there were significant improvements in all indicators under the efficiency criterion but mixed impacts in the equity and sustainability criteria. Access to resource and household income (equity) and fisheries abundance (sustainability) were perceived to have decreased during the last 15 years and were not expected to improve in the future. Stepwise multiple regression analysis showed that the asymmetries of the perceived impacts of the CBMRP were principally caused by disparities in perceptions by gender and by location (Candijay and Mabini). This highlighted the importance of cross-scale institutional linkages between Cogtong Bay municipalities to systematically address baywide management issues. Our results further demonstrated the necessity of integrating gender issues into the evaluation of MPA impacts to ensure a robust evaluation. Finally, we recommend that a rigorous evaluation of MPAs using a common set of impact indicators should be encouraged to allow comparison of studies both spatially and temporally.
Revealing and Resolving Patient Safety Defects: The Impact of Leadership WalkRounds on Frontline Caregiver Assessments of Patient Safety

PubMed Central

Frankel, Allan; Grillo, Sarah Pratt; Pittman, Mary; Thomas, Eric J; Horowitz, Lisa; Page, Martha; Sexton, Bryan

2008-01-01

Objective To evaluate the impact of rigorous WalkRounds on frontline caregiver assessments of safety climate, and to clarify the steps and implementation of rigorous WalkRounds. Data Sources/Study Setting Primary outcome variables were baseline and post WalkRounds safety climate scores from the Safety Attitudes Questionnaire (SAQ). Secondary outcomes were safety issues elicited through WalkRounds. Study period was August 2002 to April 2005; seven hospitals in Massachusetts agreed to participate; and the project was implemented in all patient care areas. Study Design Prospective study of the impact of rigorously applied WalkRounds on frontline caregivers assessments of safety climate in their patient care area. WalkRounds were conducted weekly and according to the seven-step WalkRounds Guide. The SAQ was administered at baseline and approximately 18 months post-WalkRounds implementation to all caregivers in patient care areas. Results Two of seven hospitals complied with the rigorous WalkRounds approach; hospital A was an academic teaching center and hospital B a community teaching hospital. Of 21 patient care areas, SAQ surveys were received from 62 percent of respondents at baseline and 60 percent post WalkRounds. At baseline, 10 of 21 care areas (48 percent) had safety climate scores below 60 percent, whereas post-WalkRounds three care areas (14 percent) had safety climate scores below 60 percent without improving by 10 points or more. Safety climate scale scores in hospital A were 62 percent at baseline and 77 percent post-WalkRounds (t=2.67, p=.03), and in hospital B were 46 percent at baseline and 56 percent post WalkRounds (t=2.06, p=.06). Main safety issues by category were equipment/facility (A [26 percent] and B [33 percent]) and communication (A [24 percent] and B [18 percent]). Conclusions WalkRounds implementation requires significant organizational will; sustainability requires outstanding project management and leadership engagement. In the patient care areas that rigorously implemented WalkRounds, frontline caregiver assessments of patient safety increased. SAQ results such as safety climate scores facilitate the triage of quality improvement efforts, and provide consensus assessments of frontline caregivers that identify themes for improvement. PMID:18671751
Methodological Considerations for Use of Routine Health Information System Data to Evaluate Malaria Program Impact in an Era of Declining Malaria Transmission

PubMed Central

Ashton, Ruth A.; Bennett, Adam; Yukich, Joshua; Bhattarai, Achuyt; Keating, Joseph; Eisele, Thomas P.

2017-01-01

Abstract. Coverage of malaria control interventions is increasing dramatically across endemic countries. Evaluating the impact of malaria control programs and specific interventions on health indicators is essential to enable countries to select the most effective and appropriate combination of tools to accelerate progress or proceed toward malaria elimination. When key malaria interventions have been proven effective under controlled settings, further evaluations of the impact of the intervention using randomized approaches may not be appropriate or ethical. Alternatives to randomized controlled trials are therefore required for rigorous evaluation under conditions of routine program delivery. Routine health management information system (HMIS) data are a potentially rich source of data for impact evaluation, but have been underused in impact evaluation due to concerns over internal validity, completeness, and potential bias in estimates of program or intervention impact. A range of methodologies were identified that have been used for impact evaluations with malaria outcome indicators generated from HMIS data. Methods used to maximize internal validity of HMIS data are presented, together with recommendations on reducing bias in impact estimates. Interrupted time series and dose-response analyses are proposed as the strongest quasi-experimental impact evaluation designs for analysis of malaria outcome indicators from routine HMIS data. Interrupted time series analysis compares the outcome trend and level before and after the introduction of an intervention, set of interventions or program. The dose-response national platform approach explores associations between intervention coverage or program intensity and the outcome at a subnational (district or health facility catchment) level. PMID:28990915
[Social marketing and public policies for health: campaign to promote smoke-free spaces in Mexico].

PubMed

Villalobos, Víctor; Ramírez, Olivia Ortiz; Thrasher, James F; Santillán, Edna Arillo; Hernández, Rosaura Pérez; Cedillo, Claudia; González, Wendy

2010-01-01

"Porque todos respiramos lo mismo" is a mass media campaign to promote smoke-free places (SFP). The development stages were: strategic planning; formative research; message development; media plan; and impact evaluation. Development involved formation of a coalition of key actors in various sectors. The target population was smokers and nonsmokers, with the aim of changing social norms around SFP. Nonsmokers were targeted because they comprised the majority and were most likely to appreciate the benefits of SFPs. Campaign materials were aired on television, radio, print and on billboards. One key limitation was the lack of evidence for previous campaigns, which increased the importance of formative research and of including a rigorous evaluation for this one. The campaign evaluation indicates a significant impact, which suggests that future campaigns use similar strategies in their development.
A novel framework for analyzing conservation impacts: evaluation, theory, and marine protected areas.

PubMed

Mascia, Michael B; Fox, Helen E; Glew, Louise; Ahmadia, Gabby N; Agrawal, Arun; Barnes, Megan; Basurto, Xavier; Craigie, Ian; Darling, Emily; Geldmann, Jonas; Gill, David; Holst Rice, Susie; Jensen, Olaf P; Lester, Sarah E; McConney, Patrick; Mumby, Peter J; Nenadovic, Mateja; Parks, John E; Pomeroy, Robert S; White, Alan T

2017-07-01

Environmental conservation initiatives, including marine protected areas (MPAs), have proliferated in recent decades. Designed to conserve marine biodiversity, many MPAs also seek to foster sustainable development. As is the case for many other environmental policies and programs, the impacts of MPAs are poorly understood. Social-ecological systems, impact evaluation, and common-pool resource governance are three complementary scientific frameworks for documenting and explaining the ecological and social impacts of conservation interventions. We review key components of these three frameworks and their implications for the study of conservation policy, program, and project outcomes. Using MPAs as an illustrative example, we then draw upon these three frameworks to describe an integrated approach for rigorous empirical documentation and causal explanation of conservation impacts. This integrated three-framework approach for impact evaluation of governance in social-ecological systems (3FIGS) accounts for alternative explanations, builds upon and advances social theory, and provides novel policy insights in ways that no single approach affords. Despite the inherent complexity of social-ecological systems and the difficulty of causal inference, the 3FIGS approach can dramatically advance our understanding of, and the evidentiary basis for, effective MPAs and other conservation initiatives. © 2017 New York Academy of Sciences.
Leveraging Rigorous Local Evaluations to Understand Contradictory Findings

ERIC Educational Resources Information Center

Boulay, Beth; Martin, Carlos; Zief, Susan; Granger, Robert

2013-01-01

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…
Application of Crossover Design for Conducting Rigorous Extension Evaluations

ERIC Educational Resources Information Center

Jayaratne, K. S. U.; Bird, Carolyn L.; McClelland, Jacquelyn W.

2013-01-01

With the increasing demand for accountability of Extension programming, Extension professionals need to apply rigorous evaluation designs. Randomized designs are useful to eliminate selection biases of program participants and to improve the accuracy of evaluation. However, randomized control designs are not practical to apply in Extension program…
Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-08-01

Objectives To identify the agriculture, food, and nutrition security interventions that facilitate sustainable food production and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 17 databases and 10 websites. The search employed a pre-defined protocol with clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese between 1 January 1997 and November 2013 were included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Fifteen systematic reviews and seven economic evaluations met the inclusion criteria. All interventions had some impact on health or on risk factors for health outcomes, except those related to genetically modified foods. Impact on health inequalities was rarely measured. All interventions with economic evaluations were very cost-effective, had cost savings, or net benefits. In addition to impacting health (inclusive social development), all interventions had the potential to impact on inclusive economic development, and some, on environmental sustainability, though these effects were rarely assessed. Conclusions What is needed now is careful implementation of interventions with expected positive health impacts but with concurrent, rigorous evaluation. Possible impact on health inequalities needs to be considered and measured by future primary studies and systematic reviews, as does impact of interventions on all dimensions of sustainable development.

Nine Criteria for a Measure of Scientific Output

PubMed Central

Kreiman, Gabriel; Maunsell, John H. R.

2011-01-01

Scientific research produces new knowledge, technologies, and clinical treatments that can lead to enormous returns. Often, the path from basic research to new paradigms and direct impact on society takes time. Precise quantification of scientific output in the short-term is not an easy task but is critical for evaluating scientists, laboratories, departments, and institutions. While there have been attempts to quantifying scientific output, we argue that current methods are not ideal and suffer from solvable difficulties. Here we propose criteria that a metric should have to be considered a good index of scientific output. Specifically, we argue that such an index should be quantitative, based on robust data, rapidly updated and retrospective, presented with confidence intervals, normalized by number of contributors, career stage and discipline, impractical to manipulate, and focused on quality over quantity. Such an index should be validated through empirical testing. The purpose of quantitatively evaluating scientific output is not to replace careful, rigorous review by experts but rather to complement those efforts. Because it has the potential to greatly influence the efficiency of scientific research, we have a duty to reflect upon and implement novel and rigorous ways of evaluating scientific output. The criteria proposed here provide initial steps toward the systematic development and validation of a metric to evaluate scientific output. PMID:22102840
Effectiveness of the surviving the Teens® suicide prevention and depression awareness program: an impact evaluation utilizing a comparison group.

PubMed

Strunk, Catherine M; King, Keith A; Vidourek, Rebecca A; Sorter, Michael T

2014-12-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their effectiveness. This evaluation employs a comparison group to measure whether program group participants differed significantly from comparison group participants on pretest-posttest measures while assessing the immediate impact of the Surviving the Teens® Suicide Prevention and Depression Awareness Program. Findings indicate several positive outcomes in program group students' suicide and depression knowledge, attitudes, confidence, and behavioral intentions compared with the comparison group. Suicide prevention specialists and prevention planners may benefit from study findings. © 2014 Society for Public Health Education.
The MIXED framework: A novel approach to evaluating mixed-methods rigor.

PubMed

Eckhardt, Ann L; DeVon, Holli A

2017-10-01

Evaluation of rigor in mixed-methods (MM) research is a persistent challenge due to the combination of inconsistent philosophical paradigms, the use of multiple research methods which require different skill sets, and the need to combine research at different points in the research process. Researchers have proposed a variety of ways to thoroughly evaluate MM research, but each method fails to provide a framework that is useful for the consumer of research. In contrast, the MIXED framework is meant to bridge the gap between an academic exercise and practical assessment of a published work. The MIXED framework (methods, inference, expertise, evaluation, and design) borrows from previously published frameworks to create a useful tool for the evaluation of a published study. The MIXED framework uses an experimental eight-item scale that allows for comprehensive integrated assessment of MM rigor in published manuscripts. Mixed methods are becoming increasingly prevalent in nursing and healthcare research requiring researchers and consumers to address issues unique to MM such as evaluation of rigor. © 2017 John Wiley & Sons Ltd.
Assessing the public health impact of cannabis legalization in Canada: core outcome indicators towards an 'index' for monitoring and evaluation.

PubMed

Fischer, Benedikt; Russell, Cayley; Rehm, Jürgen; Leece, Pamela

2018-05-30

The legalization of non-medical cannabis use and supply is impending in Canada. This constitutes a major policy change with the declared objective of improving public health outcomes, which requires rigorous monitoring and evaluation. While numerous different aspects associated with legalization will be examined, a focused perspective is required for effective policy evaluation purposes. To these ends, we have identified a set of 10 core indicators associated with cannabis-related risk/harm outcomes-based on current best evidence-that are expected to measure the primary impacts of legalization on public health outcomes. We briefly review these indicators, and their respective data availability in Canada. As ideally an integrated outcome assessment of cannabis legalization's impact on public health will be available, we further propose options to merge the individual indicators into an integrated, weighted 'index', considering their expected relative impact for public health. One possible approach to undertake this is 'multi-criteria decision analysis' as a method to weight the relative indicator impact on public health; alternative approaches are proposed. The integrated 'public health index' for cannabis legalization will allow for scientifically comprehensive, while focused, monitoring and evaluation of the effects of legalization in Canada for the benefits of science and evidence-based policy alike.
Evaluating Rigor in Qualitative Methodology and Research Dissemination

ERIC Educational Resources Information Center

Trainor, Audrey A.; Graue, Elizabeth

2014-01-01

Despite previous and successful attempts to outline general criteria for rigor, researchers in special education have debated the application of rigor criteria, the significance or importance of small n research, the purpose of interpretivist approaches, and the generalizability of qualitative empirical results. Adding to these complications, the…
Boston Naming Test Discontinuation Rule: "Rigorous" versus "Lenient" Interpretations.

ERIC Educational Resources Information Center

Ferman, Tanis J.; Ivnik, Robert J.; Lucas, John A.

1998-01-01

Two interpretations of the Boston Naming Test (BNT) (E. Kaplan, H. Goodglass, and S. Weintraub, 1983) discontinuation rule of six consecutive failures were found in BNT use with 655 normal older adults and 140 people with Alzheimer's disease. Differences between lenient and rigorous interpretations of responses could have impact on…
Experimental evaluation of rigor mortis. V. Effect of various temperatures on the evolution of rigor mortis.

PubMed

Krompecher, T

1981-01-01

Objective measurements were carried out to study the evolution of rigor mortis on rats at various temperatures. Our experiments showed that: (1) at 6 degrees C rigor mortis reaches full development between 48 and 60 hours post mortem, and is resolved at 168 hours post mortem; (2) at 24 degrees C rigor mortis reaches full development at 5 hours post mortem, and is resolved at 16 hours post mortem; (3) at 37 degrees C rigor mortis reaches full development at 3 hours post mortem, and is resolved at 6 hours post mortem; (4) the intensity of rigor mortis grows with increase in temperature (difference between values obtained at 24 degrees C and 37 degrees C); and (5) and 6 degrees C a "cold rigidity" was found, in addition to and independent of rigor mortis.
Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence.

PubMed

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants - sexual activity, number of sexual partners, condom use, and other contraceptive use - among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent-youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent-youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use.
Clinical and translational scientist career success: metrics for evaluation.

PubMed

Lee, Linda S; Pusek, Susan N; McCormack, Wayne T; Helitzer, Deborah L; Martina, Camille A; Dozier, Ann M; Ahluwalia, Jasjit S; Schwartz, Lisa S; McManus, Linda M; Reynolds, Brian D; Haynes, Erin N; Rubio, Doris M

2012-10-01

Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. © 2012 Wiley Periodicals, Inc.
Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.
Experimental evaluation of rigor mortis. VI. Effect of various causes of death on the evolution of rigor mortis.

PubMed

Krompecher, T; Bergerioux, C; Brandt-Casadevall, C; Gujer, H R

1983-07-01

The evolution of rigor mortis was studied in cases of nitrogen asphyxia, drowning and strangulation, as well as in fatal intoxications due to strychnine, carbon monoxide and curariform drugs, using a modified method of measurement. Our experiments demonstrated that: (1) Strychnine intoxication hastens the onset and passing of rigor mortis. (2) CO intoxication delays the resolution of rigor mortis. (3) The intensity of rigor may vary depending upon the cause of death. (4) If the stage of rigidity is to be used to estimate the time of death, it is necessary: (a) to perform a succession of objective measurements of rigor mortis intensity; and (b) to verify the eventual presence of factors that could play a role in the modification of its development.
[A new formula for the measurement of rigor mortis: the determination of the FRR-index (author's transl)].

PubMed

Forster, B; Ropohl, D; Raule, P

1977-07-05

The manual examination of rigor mortis as currently used and its often subjective evaluation frequently produced highly incorrect deductions. It is therefore desirable that such inaccuracies should be replaced by the objective measuring of rigor mortis at the extremities. To that purpose a method is described which can also be applied in on-the-spot investigations and a new formula for the determination of rigor mortis--indices (FRR) is introduced.
Grading Rigor in Counselor Education: A Specifications Grading Framework

ERIC Educational Resources Information Center

Bonner, Matthew W.

2016-01-01

According to accreditation and professional bodies, evaluation and grading are a high priority in counselor education. Specifications grading, an evaluative tool, can be used to increase grading rigor. This article describes the components of specifications grading and applies the framework of specifications grading to a counseling theories course.
The impact of contracting-out on health system performance: a conceptual framework.

PubMed

Liu, Xingzhu; Hotchkiss, David R; Bose, Sujata

2007-07-01

Despite the increased popularity of contracting-out of health services in developing countries, its effectiveness on overall health system performance is not yet conclusive. Except for substantial evidence of contracting-out's positive effect on access to health services and some evidence on improved equity in access, there is little evidence of contracting-out's impact on quality and efficiency. Most studies on the subject evaluate specific contracting-out projects against narrowly specified project objectives, not against more broadly defined health system goals. For this reason, conclusions of positive effects pertaining to project level may not hold at system level. This paper presents a conceptual framework that is expected to facilitate comprehensive, rigorous, and standardized evaluation of contracting-out at health system level. Specifically, this framework supports: full and standardized description of contracting-out interventions, study of the determinants of effectiveness, examination of provider and purchaser responses, assessment of the impact of contracting-out on all dimensions of health system performance, and cross-project analyses.
Estimation of the breaking of rigor mortis by myotonometry.

PubMed

Vain, A; Kauppila, R; Vuori, E

1996-05-31

Myotonometry was used to detect breaking of rigor mortis. The myotonometer is a new instrument which measures the decaying oscillations of a muscle after a brief mechanical impact. The method gives two numerical parameters for rigor mortis, namely the period and decrement of the oscillations, both of which depend on the time period elapsed after death. In the case of breaking the rigor mortis by muscle lengthening, both the oscillation period and decrement decreased, whereas, shortening the muscle caused the opposite changes. Fourteen h after breaking the stiffness characteristics of the right and left m. biceps brachii, or oscillation periods, were assimilated. However, the values for decrement of the muscle, reflecting the dissipation of mechanical energy, maintained their differences.
The COMPASS study: a longitudinal hierarchical research platform for evaluating natural experiments related to changes in school-level programs, policies and built environment resources.

PubMed

Leatherdale, Scott T; Brown, K Stephen; Carson, Valerie; Childs, Ruth A; Dubin, Joel A; Elliott, Susan J; Faulkner, Guy; Hammond, David; Manske, Steve; Sabiston, Catherine M; Laxer, Rachel E; Bredin, Chad; Thompson-Haile, Audra

2014-04-08

Few researchers have the data required to adequately understand how the school environment impacts youth health behaviour development over time. COMPASS is a prospective cohort study designed to annually collect hierarchical longitudinal data from a sample of 90 secondary schools and the 50,000+ grade 9 to 12 students attending those schools. COMPASS uses a rigorous quasi-experimental design to evaluate how changes in school programs, policies, and/or built environment (BE) characteristics are related to changes in multiple youth health behaviours and outcomes over time. These data will allow for the quasi-experimental evaluation of natural experiments that will occur within schools over the course of COMPASS, providing a means for generating "practice based evidence" in school-based prevention programming. COMPASS is the first study with the infrastructure to robustly evaluate the impact that changes in multiple school-level programs, policies, and BE characteristics within or surrounding a school might have on multiple youth health behaviours or outcomes over time. COMPASS will provide valuable new insight for planning, tailoring and targeting of school-based prevention initiatives where they are most likely to have impact.
Communicating to Policymakers: What to Do with Ambiguous Results from Three Impact Studies of the Same Education Program

ERIC Educational Resources Information Center

Hartry, Ardice

2013-01-01

This paper considers one challenge from recent emphasis on rigorous research for decision-making in education: the interpretation of non-replicated findings. Under Clinton and Bush, the federal government called for and funded highly rigorous research. The "gold-standard" for research was randomized-control trials (RCTs), which…
Rigor, vigor, and the study of health disparities

PubMed Central

Adler, Nancy; Bush, Nicole R.; Pantell, Matthew S.

2012-01-01

Health disparities research spans multiple fields and methods and documents strong links between social disadvantage and poor health. Associations between socioeconomic status (SES) and health are often taken as evidence for the causal impact of SES on health, but alternative explanations, including the impact of health on SES, are plausible. Studies showing the influence of parents’ SES on their children’s health provide evidence for a causal pathway from SES to health, but have limitations. Health disparities researchers face tradeoffs between “rigor” and “vigor” in designing studies that demonstrate how social disadvantage becomes biologically embedded and results in poorer health. Rigorous designs aim to maximize precision in the measurement of SES and health outcomes through methods that provide the greatest control over temporal ordering and causal direction. To achieve precision, many studies use a single SES predictor and single disease. However, doing so oversimplifies the multifaceted, entwined nature of social disadvantage and may overestimate the impact of that one variable and underestimate the true impact of social disadvantage on health. In addition, SES effects on overall health and functioning are likely to be greater than effects on any one disease. Vigorous designs aim to capture this complexity and maximize ecological validity through more complete assessment of social disadvantage and health status, but may provide less-compelling evidence of causality. Newer approaches to both measurement and analysis may enable enhanced vigor as well as rigor. Incorporating both rigor and vigor into studies will provide a fuller understanding of the causes of health disparities. PMID:23045672
Clinical and Translational Scientist Career Success: Metrics for Evaluation

PubMed Central

Lee, Linda S.; Pusek, Susan N.; McCormack, Wayne T.; Helitzer, Deborah L.; Martina, Camille A.; Dozier, Ann M.; Ahluwalia, Jasjit S.; Schwartz, Lisa S.; McManus, Linda M.; Reynolds, Brian D.; Haynes, Erin N.; Rubio, Doris M.

2012-01-01

Abstract Despite the increased emphasis on formal training in clinical and translational research and the growth in the number and scope of training programs over the past decade, the impact of training on research productivity and career success has yet to be fully evaluated at the institutional level. In this article, the Education Evaluation Working Group of the Clinical and Translational Science Award Consortium introduces selected metrics and methods associated with the assessment of key factors that affect research career success. The goals in providing this information are to encourage more consistent data collection across training sites, to foster more rigorous and systematic exploration of factors associated with career success, and to help address previously identified difficulties in program evaluation. Clin Trans Sci 2012; Volume 5: 400–407 PMID:23067352
Experimental evaluation of rigor mortis. VII. Effect of ante- and post-mortem electrocution on the evolution of rigor mortis.

PubMed

Krompecher, T; Bergerioux, C

1988-01-01

The influence of electrocution on the evolution of rigor mortis was studied on rats. Our experiments showed that: (1) Electrocution hastens the onset of rigor mortis. After an electrocution of 90 s, a complete rigor develops already 1 h post-mortem (p.m.) compared to 5 h p.m. for the controls. (2) Electrocution hastens the passing of rigor mortis. After an electrocution of 90 s, the first significant decrease occurs at 3 h p.m. (8 h p.m. in the controls). (3) These modifications in rigor mortis evolution are less pronounced in the limbs not directly touched by the electric current. (4) In case of post-mortem electrocution, the changes are slightly less pronounced, the resistance is higher and the absorbed energy is lower as compared with the ante-mortem electrocution cases. The results are completed by two practical observations on human electrocution cases.

A systematic review of universal campaigns targeting child physical abuse prevention

PubMed Central

Poole, Mary Kathryn; Seal, David W.; Taylor, Catherine A.

2014-01-01

The purpose of this review was to better understand the impact of universal campaign interventions with a media component aimed at preventing child physical abuse (CPA). The review included 17 studies featuring 15 campaigns conducted from 1989 to 2011 in five countries. Seven studies used experimental designs, but most were quasi-experimental. CPA incidence was assessed in only three studies and decreased significantly in two. Studies also found significant reductions in relevant outcomes such as dysfunctional parenting, child problem behaviors and parental anger as well as increases in parental self-efficacy and knowledge of concepts and actions relevant to preventing child abuse. The following risk factors were most frequently targeted in campaigns: lack of knowledge regarding positive parenting techniques, parental impulsivity, the stigma of asking for help, inadequate social support and inappropriate expectations for a child’s developmental stage. The evidence base for universal campaigns designed to prevent CPA remains inconclusive due to the limited availability of rigorous evaluations; however, Triple-P is a notable exception. Given the potential for such interventions to shift population norms relevant to CPA and reduce rates of CPA, there is a need to further develop and rigorously evaluate such campaigns. PMID:24711483
Quantitative validation of carbon-fiber laminate low velocity impact simulations

DOE PAGES

English, Shawn A.; Briggs, Timothy M.; Nelson, Stacy M.

2015-09-26

Simulations of low velocity impact with a flat cylindrical indenter upon a carbon fiber fabric reinforced polymer laminate are rigorously validated. Comparison of the impact energy absorption between the model and experiment is used as the validation metric. Additionally, non-destructive evaluation, including ultrasonic scans and three-dimensional computed tomography, provide qualitative validation of the models. The simulations include delamination, matrix cracks and fiber breaks. An orthotropic damage and failure constitutive model, capable of predicting progressive damage and failure, is developed in conjunction and described. An ensemble of simulations incorporating model parameter uncertainties is used to predict a response distribution which ismore » then compared to experimental output using appropriate statistical methods. Lastly, the model form errors are exposed and corrected for use in an additional blind validation analysis. The result is a quantifiable confidence in material characterization and model physics when simulating low velocity impact in structures of interest.« less
The need to promote behaviour change at the cultural level: one factor explaining the limited impact of the MEMA kwa Vijana adolescent sexual health intervention in rural Tanzania. A process evaluation.

PubMed

Wight, Daniel; Plummer, Mary; Ross, David

2012-09-14

Few of the many behavioral sexual health interventions in Africa have been rigorously evaluated. Where biological outcomes have been measured, improvements have rarely been found. One of the most rigorous trials was of the multi-component MEMA kwa Vijana adolescent sexual health programme, which showed improvements in knowledge and reported attitudes and behaviour, but none in biological outcomes. This paper attempts to explain these outcomes by reviewing the process evaluation findings, particularly in terms of contextual factors. A large-scale, primarily qualitative process evaluation based mainly on participant observation identified the principal contextual barriers and facilitators of behavioural change. The contextual barriers involved four interrelated socio-structural factors: culture (i.e. shared practices and systems of belief), economic circumstances, social status, and gender. At an individual level they appeared to operate through the constructs of the theories underlying MEMA kwa Vijana - Social Cognitive Theory and the Theory of Reasoned Action - but the intervention was unable to substantially modify these individual-level constructs, apart from knowledge. The process evaluation suggests that one important reason for this failure is that the intervention did not operate sufficiently at a structural level, particularly in regard to culture. Recently most structural interventions have focused on gender or/and economics. Complementing these with a cultural approach could address the belief systems that justify and perpetuate gender and economic inequalities, as well as other barriers to behaviour change.
Effects of rigor status during high-pressure processing on the physical qualities of farm-raised abalone (Haliotis rufescens).

PubMed

Hughes, Brianna H; Greenberg, Neil J; Yang, Tom C; Skonberg, Denise I

2015-01-01

High-pressure processing (HPP) is used to increase meat safety and shelf-life, with conflicting quality effects depending on rigor status during HPP. In the seafood industry, HPP is used to shuck and pasteurize oysters, but its use on abalones has only been minimally evaluated and the effect of rigor status during HPP on abalone quality has not been reported. Farm-raised abalones (Haliotis rufescens) were divided into 12 HPP treatments and 1 unprocessed control treatment. Treatments were processed pre-rigor or post-rigor at 2 pressures (100 and 300 MPa) and 3 processing times (1, 3, and 5 min). The control was analyzed post-rigor. Uniform plugs were cut from adductor and foot meat for texture profile analysis, shear force, and color analysis. Subsamples were used for scanning electron microscopy of muscle ultrastructure. Texture profile analysis revealed that post-rigor processed abalone was significantly (P < 0.05) less firm and chewy than pre-rigor processed irrespective of muscle type, processing time, or pressure. L values increased with pressure to 68.9 at 300 MPa for pre-rigor processed foot, 73.8 for post-rigor processed foot, 90.9 for pre-rigor processed adductor, and 89.0 for post-rigor processed adductor. Scanning electron microscopy images showed fraying of collagen fibers in processed adductor, but did not show pressure-induced compaction of the foot myofibrils. Post-rigor processed abalone meat was more tender than pre-rigor processed meat, and post-rigor processed foot meat was lighter in color than pre-rigor processed foot meat, suggesting that waiting for rigor to resolve prior to processing abalones may improve consumer perceptions of quality and market value. © 2014 Institute of Food Technologists®
A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

ERIC Educational Resources Information Center

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2016-01-01

Restorative practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this article describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI)…
Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

ERIC Educational Resources Information Center

Vaade, Elizabeth; McCready, Bo

2012-01-01

Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…
Unleashing Expert Judgment in the IPCC's Fifth Assessment Report

NASA Astrophysics Data System (ADS)

Freeman, P. T.; Mach, K. J.; Mastrandrea, M.; Field, C. B.

2016-12-01

IPCC assessments are critical vehicles for evaluating and synthesizing existing knowledge about climate change, its impacts, and potential options for adaptation and mitigation. In these assessments, rigorous expert judgment is essential for characterizing current scientific understanding including persistent and complex uncertainties related to climate change. Over its history the IPCC has iteratively developed frameworks for evaluating and communicating what is known and what is not known about climate change science. In this presentation, we explore advances and challenges in approaches to evaluating and communicating expert judgment in the Intergovernmental Panel on Climate Change's Fifth Assessment Report (IPCC AR5). We present an analysis of the frequency of the use of calibrated degree-of-certainty terms in the policymaker summaries from the IPCC's AR5 and Fourth Assessment Report (AR4). We find that revised guidance for IPCC author teams in the AR5 improved the development of balanced judgments on scientific evidence across disciplines. Overall, degree-of-certainty terms are more abundant in the AR5 policymaker summaries compared to those of the AR4, demonstrating an increased commitment to extensively and transparently characterizing expert judgments underpinning report conclusions. This analysis also shows that while working groups still favor different degree-of-certainty scales in the AR5, authors employed a wider array of degree-of-certainty scales to communicate expert judgment supporting report findings compared to the policymaker summaries of the AR4. Finally, our analysis reveals greater inclusion of lower-certainty findings in the AR5 as compared to the AR4, critical for communicating a fuller range of possible climate change impacts and response options. Building on our findings we propose a simpler, more transparent, and more rigorous framework for developing and communicating expert judgments in future climate and environmental assessments.
How best to evaluate clinician-educators and teachers for promotion?

PubMed

Glick, Thomas H

2002-05-01

The challenge of how best to evaluate educational scholars (and specifically, clinician-educators) and teachers for promotion continues to confront academia. While the work of educational scholars and teachers often overlaps, the terms for justifying their promotion differ substantially. In each case, the author maintains that evaluation should be oriented to evidence of the impact of their work. Educational scholars can be assessed mainly by objective impact, whereas the evidence for the impact of teachers should include profound, subjective effects on individual learners. For example, for clinician-educators engaged in scholarly work, the impact of that work can be identified in terms of changes in educational methods, career commitments, and practices (all intermediate outcomes), and even health outcomes. For teachers, in addition to customary criteria such as critical thinking, depth of knowledge, communication ability, and personal engagement, learners can be asked about the deep influence of these teachers. The author states his case for these principles, and also presents an innovative tool, the "impact map," as a way of graphically portraying the track record of an individual clinician-educator. Such maps are more vivid than narrative testimonials in organizing and displaying evidence of impact over time. This tool, combined with the author's other suggestions to assist the promotion process for educators and teachers, is aimed at fostering a greater emphasis on outcomes in assessing both clinician-educators and teachers to achieve greater rigor and fairness.
Interconnected or disconnected? Promotion of mental health and prevention of mental disorder in the digital age

PubMed Central

Hayes, Joseph F; Maughan, Daniel L; Grant-Peterkin, Hugh

2016-01-01

Summary To date there have been few peer-reviewed studies on the feasibility, acceptability and effectiveness of digital technologies for mental health promotion and disorder prevention. Any evaluation of these evolving technologies is complicated by a lack of understanding about the specific risks and possible benefits of the many forms of internet use on mental health. In order to adequately meet the mental health needs of today’s society, psychiatry must engage in rigorous assessment of the impact of digital technologies. PMID:26932479
Implementation Science for closing the treatment gap for mental disorders by translating evidence base into practice: experiences from the PRIME project.

PubMed

Shidhaye, Rahul

2015-12-01

This paper utilizes the experience of PRIME (Programme for Improving Mental health care) to exemplify how implementation science provides key insights and approaches to closing the treatment gap for mental disorders. The real-world application of strategies described in the implementation science literature, accompanied by use of alternative, rigorous evaluation methods to assess their impact on patient outcomes, can help in closing the mental health treatment gap in disadvantaged populations. © The Royal Australian and New Zealand College of Psychiatrists 2015.
Raising household saving: does financial education work?

PubMed

Gale, William G; Harris, Benjamin H; Levine, Ruth

2012-01-01

This article highlights the prevalence and economic outcomes of financial illiteracy among American households, and reviews previous research that examines how improving financial literacy affects household saving. Analysis of the research literature suggests that previous financial literacy efforts have yielded mixed results. Evidence suggests that interventions provided for employees in the workplace have helped increase household saving, but estimates of the magnitude of the impact vary widely. For financial education initiatives targeted to other groups, the evidence is much more ambiguous, suggesting a need for more econometrically rigorous evaluations.
Interconnected or disconnected? Promotion of mental health and prevention of mental disorder in the digital age.

PubMed

Hayes, Joseph F; Maughan, Daniel L; Grant-Peterkin, Hugh

2016-03-01

To date there have been few peer-reviewed studies on the feasibility, acceptability and effectiveness of digital technologies for mental health promotion and disorder prevention. Any evaluation of these evolving technologies is complicated by a lack of understanding about the specific risks and possible benefits of the many forms of internet use on mental health. To adequately meet the mental health needs of today's society, psychiatry must engage in rigorous assessment of the impact of digital technologies. © The Royal College of Psychiatrists 2016.
Rigged or rigorous? Partnerships for research and evaluation of complex social problems: Lessons from the field of violence against women and girls.

PubMed

Zimmerman, Cathy; Michau, Lori; Hossain, Mazeda; Kiss, Ligia; Borland, Rosilyne; Watts, Charlotte

2016-09-01

There is growing demand for robust evidence to address complex social phenomena such as violence against women and girls (VAWG). Research partnerships between scientists and non-governmental or international organizations (NGO/IO) are increasingly popular, but can pose challenges, including concerns about potential conflicts of interest. Drawing on our experience collaborating on VAWG research, we describe challenges and contributions that NGO/IO and academic partners can make at different stages of the research process and the effects that collaborations can have on scientific inquiry. Partners may struggle with differing priorities and misunderstandings about roles, limitations, and intentions. Benefits of partnerships include a shared vision of study goals, differing and complementary expertise, mutual respect, and a history of constructive collaboration. Our experience suggests that when investigating multi-faceted social problems, instead of 'rigging' study results, research collaborations can strengthen scientific rigor and offer the greatest potential for impact in the communities we seek to serve.
Effects of Pre and Post-Rigor Marinade Injection on Some Quality Parameters of Longissimus Dorsi Muscles

PubMed Central

Fadıloğlu, Eylem Ezgi; Serdaroğlu, Meltem

2018-01-01

Abstract This study was conducted to evaluate the effects of pre and post-rigor marinade injections on some quality parameters of Longissimus dorsi (LD) muscles. Three marinade formulations were prepared with 2% NaCl, 2% NaCl+0.5 M lactic acid and 2% NaCl+0.5 M sodium lactate. In this study marinade uptake, pH, free water, cooking loss, drip loss and color properties were analyzed. Injection time had significant effect on marinade uptake levels of samples. Regardless of marinate formulation, marinade uptake of pre-rigor samples injected with marinade solutions were higher than post rigor samples. Injection of sodium lactate increased pH values of samples whereas lactic acid injection decreased pH. Marinade treatment and storage period had significant effect on cooking loss. At each evaluation period interaction between marinade treatment and injection time showed different effect on free water content. Storage period and marinade application had significant effect on drip loss values. Drip loss in all samples increased during the storage. During all storage days, lowest CIE L* value was found in pre-rigor samples injected with sodium lactate. Lactic acid injection caused color fade in pre-rigor and post-rigor samples. Interaction between marinade treatment and storage period was found statistically significant (p<0.05). At day 0 and 3, the lowest CIE b* values obtained pre-rigor samples injected with sodium lactate and there were no differences were found in other samples. At day 6, no significant differences were found in CIE b* values of all samples. PMID:29805282
Effects of Pre and Post-Rigor Marinade Injection on Some Quality Parameters of Longissimus Dorsi Muscles.

PubMed

Fadıloğlu, Eylem Ezgi; Serdaroğlu, Meltem

2018-04-01

This study was conducted to evaluate the effects of pre and post-rigor marinade injections on some quality parameters of Longissimus dorsi (LD) muscles. Three marinade formulations were prepared with 2% NaCl, 2% NaCl+0.5 M lactic acid and 2% NaCl+0.5 M sodium lactate. In this study marinade uptake, pH, free water, cooking loss, drip loss and color properties were analyzed. Injection time had significant effect on marinade uptake levels of samples. Regardless of marinate formulation, marinade uptake of pre-rigor samples injected with marinade solutions were higher than post rigor samples. Injection of sodium lactate increased pH values of samples whereas lactic acid injection decreased pH. Marinade treatment and storage period had significant effect on cooking loss. At each evaluation period interaction between marinade treatment and injection time showed different effect on free water content. Storage period and marinade application had significant effect on drip loss values. Drip loss in all samples increased during the storage. During all storage days, lowest CIE L* value was found in pre-rigor samples injected with sodium lactate. Lactic acid injection caused color fade in pre-rigor and post-rigor samples. Interaction between marinade treatment and storage period was found statistically significant ( p <0.05). At day 0 and 3, the lowest CIE b* values obtained pre-rigor samples injected with sodium lactate and there were no differences were found in other samples. At day 6, no significant differences were found in CIE b* values of all samples.
Experimental evaluation of rigor mortis. III. Comparative study of the evolution of rigor mortis in different sized muscle groups in rats.

PubMed

Krompecher, T; Fryc, O

1978-01-01

The use of new methods and an appropriate apparatus has allowed us to make successive measurements of rigor mortis and a study of its evolution in the rat. By a comparative examination on the front and hind limbs, we have determined the following: (1) The muscular mass of the hind limbs is 2.89 times greater than that of the front limbs. (2) In the initial phase rigor mortis is more pronounced in the front limbs. (3) The front and hind limbs reach maximum rigor mortis at the same time and this state is maintained for 2 hours. (4) Resolution of rigor mortis is accelerated in the front limbs during the initial phase, but both front and hind limbs reach complete resolution at the same time.
Can innovative health financing policies increase access to MDG-related services? Evidence from Rwanda.

PubMed

Sekabaraga, Claude; Diop, Francois; Soucat, Agnes

2011-11-01

Ensuring financial access to health services is a critical challenge for poor countries if they are to reach the health Millennium Development Goals (MDGs). This article examines the case of Rwanda, a country which has championed innovative health care financing policies. Between 2000 and 2007, Rwanda has improved financial access for the poor, increased utilization of health services and reduced out-of-pocket payments for health care. Poor groups' utilization has increased for all health services, sometimes dramatically. Use of assisted deliveries, for example, increased from 12.1% to 42.7% among the poorest quintile; payments at the point of delivery have also been reduced; and catastrophic expenditures have declined. Part of these achievements is likely linked to innovative health financing policies, particularly the expansion of micro-insurance ('mutuelles') and performance-based financing. The paper concludes that the Rwanda experience provides a useful example of effective implementation of policies that reduce the financial barrier to health services, hereby contributing to the health MDGs. Today's main challenge is to build the sustainability of this system. Finally, the paper proposes a simple set of rigorous metrics to assess the impact of health financing policies and calls for implementing rigorous impact evaluation of health care financing policies in low-income countries.
Designing and Evaluating Interventions to Halt the Transmission of Tuberculosis.

PubMed

Dowdy, David W; Grant, Alison D; Dheda, Keertan; Nardell, Edward; Fielding, Katherine; Moore, David A J

2017-11-03

To reduce the incidence of tuberculosis, it is insufficient to simply understand the dynamics of tuberculosis transmission. Rather, we must design and rigorously evaluate interventions to halt transmission, prioritizing those interventions most likely to achieve population-level impact. Synergy in reducing tuberculosis transmission may be attainable by combining interventions that shrink the reservoir of latent Mycobacterium tuberculosis infection (preventive therapy), shorten the time between disease onset and treatment initiation (case finding and diagnosis), and prevent transmission in key settings, such as the built environment (infection control). In evaluating efficacy and estimating population-level impact, cluster-randomized trials and mechanistic models play particularly prominent roles. Historical and contemporary evidence suggests that effective public health interventions can halt tuberculosis transmission, but an evidence-based approach based on knowledge of local epidemiology is necessary for success. We provide a roadmap for designing, evaluating, and modeling interventions to interrupt the process of transmission that fuels a diverse array of tuberculosis epidemics worldwide. © The Author 2017. Published by Oxford University Press for the Infectious Diseases Society of America.
Single-case synthesis tools II: Comparing quantitative outcome measures.

PubMed

Zimmerman, Kathleen N; Pustejovsky, James E; Ledford, Jennifer R; Barton, Erin E; Severini, Katherine E; Lloyd, Blair P

2018-03-07

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes-overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])-were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.
Energy interventions that facilitate sustainable development and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-04-01

Objective To inform policy by providing an overview of systematic reviews on interventions that facilitate sustainable energy use and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 13 databases and nine websites based on a pre-defined protocol, including clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese during the 17 years from January 1997 - January 2014 was included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Five systematic reviews and one economic evaluation met the inclusion criteria. The most promising interventions that impacted health were electricity for lighting and other uses (developing countries); improved stoves for cooking and health and/or cleaner fuels for cooking (developing countries); and household energy efficiency measures (developed countries). These interventions also had potential environmental and economic impacts. Their cost-effectiveness is not known, nor is their impact on health inequalities. Conclusions What is needed now is careful implementation of interventions where the impacts are likely to be positive but their implementation needs to be rigorously evaluated, including possible adverse impacts. Care needs to be taken not to exacerbate health inequalities and to consider context, human behavior and cultural factors so that the potential health benefits are realized in real-life implementation. Possible impact on health inequalities needs to be considered and measured in future primary studies and systematic reviews.

Programs to improve adolescent sexual and reproductive health in the US: a review of the evidence

PubMed Central

Manlove, Jennifer; Fish, Heather; Moore, Kristin Anderson

2015-01-01

Background US adolescents have high rates of teen pregnancy, childbearing, and sexually transmitted infections (STIs), highlighting the need to identify and implement effective programs that will help improve teen sexual and reproductive health. Materials and methods This review identified 103 random-assignment evaluations of 85 programs that incorporated intent-to-treat analyses and assessed impacts on pregnancy, childbearing, STIs, and their key determinants – sexual activity, number of sexual partners, condom use, and other contraceptive use – among teens. This review describes the evidence base for five broad program approaches, including abstinence education, comprehensive sex education, clinic-based programs, youth development programs, and parent–youth relationship programs. We also describe programs with impacts on key outcomes, including pregnancy/childbearing, STIs, and those that found impacts on both sexual activity and contraceptive use. Results Our review identified 52 effective programs: 38 with consistent impacts on reproductive health outcomes, and 14 with mixed findings (across subpopulations, follow-ups, or multiple measures of a single outcome). We found that a variety of program approaches produced impacts on sexual and reproductive health outcomes. Parent–youth relationship programs and clinic-based program evaluations more frequently showed impacts than other program approaches, although we also identified a number of abstinence-education, comprehensive sex education, and youth-development programs with impacts on sexual and reproductive health outcomes. Overall, we identified nine program evaluations with impacts on teen pregnancies or births, five with impacts on reducing STIs, and 15 with impacts on both delaying/reducing sexual activity and increasing contraceptive use (including condom use). Conclusion Future efforts should conduct replications of existing program evaluations, identify implementation components linked to impacts, rigorously evaluate programs that appear promising, and expand the evidence base on programs that impact hormonal and long-acting contraceptive method use. PMID:25897271
Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles.

PubMed

Kim, Hyun-Wook; Hwang, Ko-Eun; Song, Dong-Heon; Kim, Yong-Jae; Ham, Youn-Kyung; Yeo, Eui-Joo; Jeong, Tae-Jun; Choi, Yun-Sang; Kim, Cheon-Jei

2015-01-01

This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle.
Effect of Pre-rigor Salting Levels on Physicochemical and Textural Properties of Chicken Breast Muscles

PubMed Central

Choi, Yun-Sang

2015-01-01

This study was conducted to evaluate the effect of pre-rigor salting level (0-4% NaCl concentration) on physicochemical and textural properties of pre-rigor chicken breast muscles. The pre-rigor chicken breast muscles were de-boned 10 min post-mortem and salted within 25 min post-mortem. An increase in pre-rigor salting level led to the formation of high ultimate pH of chicken breast muscles at post-mortem 24 h. The addition of minimum of 2% NaCl significantly improved water holding capacity, cooking loss, protein solubility, and hardness when compared to the non-salting chicken breast muscle (p<0.05). On the other hand, the increase in pre-rigor salting level caused the inhibition of myofibrillar protein degradation and the acceleration of lipid oxidation. However, the difference in NaCl concentration between 3% and 4% had no great differences in the results of physicochemical and textural properties due to pre-rigor salting effects (p>0.05). Therefore, our study certified the pre-rigor salting effect of chicken breast muscle salted with 2% NaCl when compared to post-rigor muscle salted with equal NaCl concentration, and suggests that the 2% NaCl concentration is minimally required to ensure the definite pre-rigor salting effect on chicken breast muscle. PMID:26761884
GREGOR: evaluating global enrichment of trait-associated variants in epigenomic features using a systematic, data-driven approach.

PubMed

Schmidt, Ellen M; Zhang, Ji; Zhou, Wei; Chen, Jin; Mohlke, Karen L; Chen, Y Eugene; Willer, Cristen J

2015-08-15

The majority of variation identified by genome wide association studies falls in non-coding genomic regions and is hypothesized to impact regulatory elements that modulate gene expression. Here we present a statistically rigorous software tool GREGOR (Genomic Regulatory Elements and Gwas Overlap algoRithm) for evaluating enrichment of any set of genetic variants with any set of regulatory features. Using variants from five phenotypes, we describe a data-driven approach to determine the tissue and cell types most relevant to a trait of interest and to identify the subset of regulatory features likely impacted by these variants. Last, we experimentally evaluate six predicted functional variants at six lipid-associated loci and demonstrate significant evidence for allele-specific impact on expression levels. GREGOR systematically evaluates enrichment of genetic variation with the vast collection of regulatory data available to explore novel biological mechanisms of disease and guide us toward the functional variant at trait-associated loci. GREGOR, including source code, documentation, examples, and executables, is available at http://genome.sph.umich.edu/wiki/GREGOR. cristen@umich.edu Supplementary data are available at Bioinformatics online. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.
The impact of rigorous mathematical thinking as learning method toward geometry understanding

NASA Astrophysics Data System (ADS)

Nugraheni, Z.; Budiyono, B.; Slamet, I.

2018-05-01

To reach higher order thinking skill, needed to be mastered the conceptual understanding. RMT is a unique realization of the cognitive conceptual construction approach based on Mediated Learning Experience (MLE) theory by Feurstein and Vygotsky’s sociocultural theory. This was quasi experimental research which was comparing the experimental class that was given Rigorous Mathematical Thinking (RMT) as learning method and control class that was given Direct Learning (DL) as the conventional learning activity. This study examined whether there was different effect of two learning method toward conceptual understanding of Junior High School students. The data was analyzed by using Independent t-test and obtained a significant difference of mean value between experimental and control class on geometry conceptual understanding. Further, by semi-structure interview known that students taught by RMT had deeper conceptual understanding than students who were taught by conventional way. By these result known that Rigorous Mathematical Thinking (RMT) as learning method have positive impact toward Geometry conceptual understanding.
Clinical relevance in anesthesia journals.

PubMed

Lauritsen, Jakob; Møller, Ann M

2006-04-01

The purpose of this review is to present the latest knowledge and research on the definition and distribution of clinically relevant articles in anesthesia journals. It will also discuss the importance of the chosen methodology and outcome of articles. In the last few years, more attention has been paid to evidence-based medicine in anesthesia. Several articles on the subject have focused on the need to base clinical decisions on sound research employing both methodological rigor and clinically relevant outcomes. The number of systematic reviews in anesthesia literature is increasing as well as the focus on diminishing the number of surrogate outcomes. It has been shown that the impact factor is not a valid measure of establishing the level of clinical relevance to a journal. This review presents definitions of clinically relevant anesthesia articles. A clinically relevant article employs both methodological rigor and a clinically relevant outcome. The terms methodological rigor and clinical outcomes are fully discussed in the review as well as problems with journal impact factors.
The "Performance of Rotavirus and Oral Polio Vaccines in Developing Countries" (PROVIDE) study: description of methods of an interventional study designed to explore complex biologic problems.

PubMed

Kirkpatrick, Beth D; Colgate, E Ross; Mychaleckyj, Josyf C; Haque, Rashidul; Dickson, Dorothy M; Carmolli, Marya P; Nayak, Uma; Taniuchi, Mami; Naylor, Caitlin; Qadri, Firdausi; Ma, Jennie Z; Alam, Masud; Walsh, Mary Claire; Diehl, Sean A; Petri, William A

2015-04-01

Oral vaccines appear less effective in children in the developing world. Proposed biologic reasons include concurrent enteric infections, malnutrition, breast milk interference, and environmental enteropathy (EE). Rigorous study design and careful data management are essential to begin to understand this complex problem while assuring research subject safety. Herein, we describe the methodology and lessons learned in the PROVIDE study (Dhaka, Bangladesh). A randomized clinical trial platform evaluated the efficacy of delayed-dose oral rotavirus vaccine as well as the benefit of an injectable polio vaccine replacing one dose of oral polio vaccine. This rigorous infrastructure supported the additional examination of hypotheses of vaccine underperformance. Primary and secondary efficacy and immunogenicity measures for rotavirus and polio vaccines were measured, as well as the impact of EE and additional exploratory variables. Methods for the enrollment and 2-year follow-up of a 700 child birth cohort are described, including core laboratory, safety, regulatory, and data management practices. Intense efforts to standardize clinical, laboratory, and data management procedures in a developing world setting provide clinical trials rigor to all outcomes. Although this study infrastructure requires extensive time and effort, it allows optimized safety and confidence in the validity of data gathered in complex, developing country settings. © The American Society of Tropical Medicine and Hygiene.
The need to promote behaviour change at the cultural level: one factor explaining the limited impact of the MEMA kwa Vijana adolescent sexual health intervention in rural Tanzania. A process evaluation

PubMed Central

2012-01-01

Background Few of the many behavioral sexual health interventions in Africa have been rigorously evaluated. Where biological outcomes have been measured, improvements have rarely been found. One of the most rigorous trials was of the multi-component MEMA kwa Vijana adolescent sexual health programme, which showed improvements in knowledge and reported attitudes and behaviour, but none in biological outcomes. This paper attempts to explain these outcomes by reviewing the process evaluation findings, particularly in terms of contextual factors. Methods A large-scale, primarily qualitative process evaluation based mainly on participant observation identified the principal contextual barriers and facilitators of behavioural change. Results The contextual barriers involved four interrelated socio-structural factors: culture (i.e. shared practices and systems of belief), economic circumstances, social status, and gender. At an individual level they appeared to operate through the constructs of the theories underlying MEMA kwa Vijana - Social Cognitive Theory and the Theory of Reasoned Action – but the intervention was unable to substantially modify these individual-level constructs, apart from knowledge. Conclusion The process evaluation suggests that one important reason for this failure is that the intervention did not operate sufficiently at a structural level, particularly in regard to culture. Recently most structural interventions have focused on gender or/and economics. Complementing these with a cultural approach could address the belief systems that justify and perpetuate gender and economic inequalities, as well as other barriers to behaviour change. PMID:22978613
Increased scientific rigor will improve reliability of research and effectiveness of management

USGS Publications Warehouse

Sells, Sarah N.; Bassing, Sarah B.; Barker, Kristin J.; Forshee, Shannon C.; Keever, Allison; Goerz, James W.; Mitchell, Michael S.

2018-01-01

Rigorous science that produces reliable knowledge is critical to wildlife management because it increases accurate understanding of the natural world and informs management decisions effectively. Application of a rigorous scientific method based on hypothesis testing minimizes unreliable knowledge produced by research. To evaluate the prevalence of scientific rigor in wildlife research, we examined 24 issues of the Journal of Wildlife Management from August 2013 through July 2016. We found 43.9% of studies did not state or imply a priori hypotheses, which are necessary to produce reliable knowledge. We posit that this is due, at least in part, to a lack of common understanding of what rigorous science entails, how it produces more reliable knowledge than other forms of interpreting observations, and how research should be designed to maximize inferential strength and usefulness of application. Current primary literature does not provide succinct explanations of the logic behind a rigorous scientific method or readily applicable guidance for employing it, particularly in wildlife biology; we therefore synthesized an overview of the history, philosophy, and logic that define scientific rigor for biological studies. A rigorous scientific method includes 1) generating a research question from theory and prior observations, 2) developing hypotheses (i.e., plausible biological answers to the question), 3) formulating predictions (i.e., facts that must be true if the hypothesis is true), 4) designing and implementing research to collect data potentially consistent with predictions, 5) evaluating whether predictions are consistent with collected data, and 6) drawing inferences based on the evaluation. Explicitly testing a priori hypotheses reduces overall uncertainty by reducing the number of plausible biological explanations to only those that are logically well supported. Such research also draws inferences that are robust to idiosyncratic observations and unavoidable human biases. Offering only post hoc interpretations of statistical patterns (i.e., a posteriorihypotheses) adds to uncertainty because it increases the number of plausible biological explanations without determining which have the greatest support. Further, post hocinterpretations are strongly subject to human biases. Testing hypotheses maximizes the credibility of research findings, makes the strongest contributions to theory and management, and improves reproducibility of research. Management decisions based on rigorous research are most likely to result in effective conservation of wildlife resources.
IMPROVING ALTERNATIVES FOR ENVIRONMENTAL IMPACT ASSESSMENT. (R825758)

EPA Science Inventory

Environmental impact assessment (EIA), in the US, requires an objective and rigorous analysis of alternatives. Yet the choice of alternatives for that analysis can be subjective and arbitrary. Alternatives often reflect narrow project objectives, agency agendas, and predilecti...
DOE Office of Scientific and Technical Information (OSTI.GOV)

English, Shawn A.; Briggs, Timothy M.; Nelson, Stacy M.

Simulations of low velocity impact with a flat cylindrical indenter upon a carbon fiber fabric reinforced polymer laminate are rigorously validated. Comparison of the impact energy absorption between the model and experiment is used as the validation metric. Additionally, non-destructive evaluation, including ultrasonic scans and three-dimensional computed tomography, provide qualitative validation of the models. The simulations include delamination, matrix cracks and fiber breaks. An orthotropic damage and failure constitutive model, capable of predicting progressive damage and failure, is developed in conjunction and described. An ensemble of simulations incorporating model parameter uncertainties is used to predict a response distribution which ismore » then compared to experimental output using appropriate statistical methods. Lastly, the model form errors are exposed and corrected for use in an additional blind validation analysis. The result is a quantifiable confidence in material characterization and model physics when simulating low velocity impact in structures of interest.« less
The search for underlying principles of health impact assessment: progress and prospects: Comment on "Investigating underlying principles to guide health impact assessment".

PubMed

Winkler, Mirko S; Utzinger, Jürg

2014-07-01

Health Impact Assessment (HIA) is a relatively young field of endeavour, and hence, future progress will depend on the planning, implementation and rigorous evaluation of additional HIAs of projects, programmes and policies the world over. In the June 2014 issue of the International Journal of Health Policy and Management, Fakhri and colleagues investigated underlying principles of HIA through a comprehensive review of the literature and expert consultation. With an emphasis on the Islamic Republic of Iran, the authors identified multiple issues that are relevant for guiding HIA practice. At the same time, the study unravelled current shortcomings in the understanding and definition of HIA principles and best practice at national, regional, and global levels. In this commentary we scrutinise the research presented, highlight strengths and limitations, and discuss the findings in the context of other recent attempts to guide HIA.
Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

NASA Technical Reports Server (NTRS)

Staats, Matt; Whalen, Michael W.; Heindahl, Mats P. E.; Rajan, Ajitha

2010-01-01

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.
A systematic review of universal campaigns targeting child physical abuse prevention.

PubMed

Poole, Mary Kathryn; Seal, David W; Taylor, Catherine A

2014-06-01

The purpose of this review was to better understand the impact of universal campaign interventions with a media component aimed at preventing child physical abuse (CPA). The review included 17 studies featuring 15 campaigns conducted from 1989 to 2011 in five countries. Seven studies used experimental designs, but most were quasi-experimental. CPA incidence was assessed in only three studies and decreased significantly in two. Studies also found significant reductions in relevant outcomes such as dysfunctional parenting, child problem behaviors and parental anger as well as increases in parental self-efficacy and knowledge of concepts and actions relevant to preventing child abuse. The following risk factors were most frequently targeted in campaigns: lack of knowledge regarding positive parenting techniques, parental impulsivity, the stigma of asking for help, inadequate social support and inappropriate expectations for a child's developmental stage. The evidence base for universal campaigns designed to prevent CPA remains inconclusive due to the limited availability of rigorous evaluations; however, Triple-P is a notable exception. Given the potential for such interventions to shift population norms relevant to CPA and reduce rates of CPA, there is a need to further develop and rigorously evaluate such campaigns. © The Author 2014. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.
Evaluating clinical librarian services: a systematic review.

PubMed

Brettle, Alison; Maden-Jenkins, Michelle; Anderson, Lucy; McNally, Rosalind; Pratchett, Tracey; Tancock, Jenny; Thornton, Debra; Webb, Anne

2011-03-01

Previous systematic reviews have indicated limited evidence and poor quality evaluations of clinical librarian (CL) services. Rigorous evaluations should demonstrate the value of CL services, but guidance is needed before this can be achieved. To undertake a systematic review which examines models of CL services, quality, methods and perspectives of clinical librarian service evaluations. Systematic review methodology and synthesis of evidence, undertaken collaboratively by a group of 8 librarians to develop research and critical appraisal skills. There are four clear models of clinical library service provision. Clinical librarians are effective in saving health professionals time, providing relevant, useful information and high quality services. Clinical librarians have a positive effect on clinical decision making by contributing to better informed decisions, diagnosis and choice of drug or therapy. The quality of CL studies is improving, but more work is needed on reducing bias and providing evidence of specific impacts on patient care. The Critical Incident Technique as part of a mixed method approach appears to offer a useful approach to demonstrating impact. This systematic review provides practical guidance regarding the evaluation of CL services. It also provides updated evidence regarding the effectiveness and impact of CL services. The approach used was successful in developing research and critical appraisal skills in a group of librarians. © 2010 The authors. Health Information and Libraries Journal © 2010 Health Libraries Group.
Communities putting prevention to work: Local evaluation of community-based strategies designed to make healthy living easier☆,☆☆

PubMed Central

Soler, Robin E.; Whitten, Kathleen L.; Ottley, Phyllis G.

2015-01-01

This introduction is an overview of the articles presented in this supplement that describe implementation and evaluation activities conducted as part of the Centers for Disease Control and Prevention’s (CDC’s) Communities Putting Prevention to Work (CPPW) initiative. CPPW was one of the largest federal investments ever to combat chronic diseases in the United States. CPPW supported high-impact, jurisdiction-wide policy, systems, and environmental changes to improve health by increasing access to physical activity and healthy foods, and by decreasing tobacco use and exposure to secondhand smoke. The articles included in this supplement describe implementation and evaluation efforts of strategies implemented as part of CPPW by local awardees. This supplement is intended to guide the evidence base for public health interventions on the basis of jurisdiction-wide policy and environmental-level improvements and to encourage rigorous evaluation of the public health interventions. PMID:25150384
Wildlife conservation and solar energy development in the Desert Southwest, United States

USGS Publications Warehouse

Lovich, Jeffrey E.; Ennen, Josua R.

2011-01-01

Large areas of public land are currently being permitted or evaluated for utility-scale solar energy development (USSED) in the southwestern United States, including areas with high biodiversity and protected species. However, peer-reviewed studies of the effects of USSED on wildlife are lacking. The potential effects of the construction and the eventual decommissioning of solar energy facilities include the direct mortality of wildlife; environmental impacts of fugitive dust and dust suppressants; destruction and modification of habitat, including the impacts of roads; and off-site impacts related to construction material acquisition, processing, and transportation. The potential effects of the operation and maintenance of the facilities include habitat fragmentation and barriers to gene flow, increased noise, electromagnetic field generation, microclimate alteration, pollution, water consumption, and fire. Facility design effects, the efficacy of site-selection criteria, and the cumulative effects of USSED on regional wildlife populations are unknown. Currently available peer-reviewed data are insufficient to allow a rigorous assessment of the impact of USSED on wildlife.
Kindergarten Readiness Impacts of the Arkansas Better Chance State Prekindergarten Initiative

ERIC Educational Resources Information Center

Hustedt, Jason T.; Jung, Kwanghee; Barnett, W. Steven; Williams, Tonya

2015-01-01

Enrollment in state-funded pre-K programs prior to kindergarten entry has become increasingly common. As each state develops its own model for pre-K, rigorous studies of the impacts of state-specific programs are needed. This study investigates impacts of the Arkansas Better Chance (ABC) initiative at kindergarten entry using a…
Motivation for Evaluation: A roadmap for Improving Program Efficacy

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method (Invited). Abstract ED53D-0871 presented at 2015 Fall Meeting, AGU, San Francisco, Calif., 14 - 18 Dec.
Strategies used by community-based organizations to evaluate their locally developed HIV prevention interventions: Lessons learned from the CDC's innovative interventions project.

PubMed

Painter, Thomas M; Ngalame, Paulyne M; Lucas, Basil; Lauby, Jennifer L; Herbst, Jeffrey H

2010-10-01

Community-based organizations (CBOs) play an important role in health promotion efforts and the delivery of HIV prevention interventions for at-risk minority populations. CBOs may also develop their own interventions but often lack the capacity or funds to rigorously evaluate them. The Innovative Interventions project of the Centers for Disease Control and Prevention (CDC) funded three CBOs to rigorously evaluate the efficacy of interventions they had developed and were delivering to Black women, Black men who have sex with men (MSM), and adolescent males in juvenile justice settings, respectively. The evaluation results have been reported elsewhere. This article describes operational issues that the CBOs identified as being particularly salient to their evaluations and the strategies they developed to address the issues and successfully complete their evaluations. These issues included the development of organizational capacity to conduct a rigorous outcome evaluation, difficulties with recruitment and retention of evaluation participants, and the use of process monitoring data to improve intervention delivery. The strategies described in this article can be used by CBOs when evaluating their locally developed HIV prevention interventions and may be of interest to funding agencies and researchers that collaborate with CBOs to evaluate their interventions.

Climate change impacts on tree ranges: model intercomparison facilitates understanding and quantification of uncertainty.

PubMed

Cheaib, Alissar; Badeau, Vincent; Boe, Julien; Chuine, Isabelle; Delire, Christine; Dufrêne, Eric; François, Christophe; Gritti, Emmanuel S; Legay, Myriam; Pagé, Christian; Thuiller, Wilfried; Viovy, Nicolas; Leadley, Paul

2012-06-01

Model-based projections of shifts in tree species range due to climate change are becoming an important decision support tool for forest management. However, poorly evaluated sources of uncertainty require more scrutiny before relying heavily on models for decision-making. We evaluated uncertainty arising from differences in model formulations of tree response to climate change based on a rigorous intercomparison of projections of tree distributions in France. We compared eight models ranging from niche-based to process-based models. On average, models project large range contractions of temperate tree species in lowlands due to climate change. There was substantial disagreement between models for temperate broadleaf deciduous tree species, but differences in the capacity of models to account for rising CO(2) impacts explained much of the disagreement. There was good quantitative agreement among models concerning the range contractions for Scots pine. For the dominant Mediterranean tree species, Holm oak, all models foresee substantial range expansion. © 2012 Blackwell Publishing Ltd/CNRS.
State of the Science of Spirituality and Palliative Care Research Part II: Screening, Assessment, and Interventions.

PubMed

Balboni, Tracy A; Fitchett, George; Handzo, George F; Johnson, Kimberly S; Koenig, Harold G; Pargament, Kenneth I; Puchalski, Christina M; Sinclair, Shane; Taylor, Elizabeth J; Steinhauser, Karen E

2017-09-01

The State of the Science in Spirituality and Palliative Care was convened to address the current landscape of research at the intersection of spirituality and palliative care and to identify critical next steps to advance this field of inquiry. Part II of the SOS-SPC report addresses the state of extant research and identifies critical research priorities pertaining to the following questions: 1) How do we assess spirituality? 2) How do we intervene on spirituality in palliative care? And 3) How do we train health professionals to address spirituality in palliative care? Findings from this report point to the need for screening and assessment tools that are rigorously developed, clinically relevant, and adapted to a diversity of clinical and cultural settings. Chaplaincy research is needed to form professional spiritual care provision in a variety of settings, and outcomes assessed to ascertain impact on key patient, family, and clinical staff outcomes. Intervention research requires rigorous conceptualization and assessments. Intervention development must be attentive to clinical feasibility, incorporate perspectives and needs of patients, families, and clinicians, and be targeted to diverse populations with spiritual needs. Finally, spiritual care competencies for various clinical care team members should be refined. Reflecting those competencies, training curricula and evaluation tools should be developed, and the impact of education on patient, family, and clinician outcomes should be systematically assessed. Published by Elsevier Inc.
Evaluation of physical dimension changes as nondestructive measurements for monitoring rigor mortis development in broiler muscles.

PubMed

Cavitt, L C; Sams, A R

2003-07-01

Studies were conducted to develop a non-destructive method for monitoring the rate of rigor mortis development in poultry and to evaluate the effectiveness of electrical stimulation (ES). In the first study, 36 male broilers in each of two trials were processed at 7 wk of age. After being bled, half of the birds received electrical stimulation (400 to 450 V, 400 to 450 mA, for seven pulses of 2 s on and 1 s off), and the other half were designated as controls. At 0.25 and 1.5 h postmortem (PM), carcasses were evaluated for the angles of the shoulder, elbow, and wing tip and the distance between the elbows. Breast fillets were harvested at 1.5 h PM (after chilling) from all carcasses. Fillet samples were excised and frozen for later measurement of pH and R-value, and the remainder of each fillet was held on ice until 24 h postmortem. Shear value and pH means were significantly lower, but R-value means were higher (P < 0.05) for the ES fillets compared to the controls, suggesting acceleration of rigor mortis by ES. The physical dimensions of the shoulder and elbow changed (P < 0.05) during rigor mortis development and with ES. These results indicate that physical measurements of the wings maybe useful as a nondestructive indicator of rigor development and for monitoring the effectiveness of ES. In the second study, 60 male broilers in each of two trials were processed at 7 wk of age. At 0.25, 1.5, 3.0, and 6.0 h PM, carcasses were evaluated for the distance between the elbows. At each time point, breast fillets were harvested from each carcass. Fillet samples were excised and frozen for later measurement of pH and sacromere length, whereas the remainder of each fillet was held on ice until 24 h PM. Shear value and pH means (P < 0.05) decreased, whereas sarcomere length means (P < 0.05) increased over time, indicating rigor mortis development. Elbow distance decreased (P < 0.05) with rigor development and was correlated (P < 0.01) with shear value (r = 0.2581), sarcomere length (r = -0.3079), and pH (r = 0.6303). These results suggest that elbow distance could be used in conjunction with other detection methods for optically automating measurement of rigor mortis development in broiler carcasses.
Social and Environmental Impacts of Forest Management Certification in Indonesia

PubMed Central

Miteva, Daniela A.; Loucks, Colby J.; Pattanayak, Subhrendu K.

2015-01-01

In response to unsustainable timber production in tropical forest concessions, voluntary forest management certification programs such as the Forest Stewardship Council (FSC) have been introduced to improve environmental, social, and economic performance over existing management practices. However, despite the proliferation of forest certification over the past two decades, few studies have evaluated its effectiveness. Using temporally and spatially explicit village-level data on environmental and socio-economic indicators in Kalimantan (Indonesia), we evaluate the performance of the FSC-certified timber concessions compared to non-certified logging concessions. Employing triple difference matching estimators, we find that between 2000 and 2008 FSC reduced aggregate deforestation by 5 percentage points and the incidence of air pollution by 31%. It had no statistically significant impacts on fire incidence or core areas, but increased forest perforation by 4 km2 on average. In addition, we find that FSC reduced firewood dependence (by 33%), respiratory infections (by 32%) and malnutrition (by 1 person) on average. By conducting a rigorous statistical evaluation of FSC certification in a biodiversity hotspot such as Indonesia, we provide a reference point and offer methodological and data lessons that could aid the design of ongoing and future evaluations of a potentially critical conservation policy. PMID:26132491
Increasing the use of evaluation data collection in an EPO program

NASA Astrophysics Data System (ADS)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.
Valuing environmental health for informed policy-making.

PubMed

Máca, Vojtěch; Melichar, Jan; Ščasný, Milan; Kohlová, Markéta Braun

2017-03-01

Monetized environmental health impact assessments help to better evaluate the environmental burden of a wide range of economic activities. Apart from the limitations and uncertainties in physical and biological science used in such assessments, assumptions taken from economic valuation may also substantially influence subsequent policy-making considerations. This study attempts to demonstrate the impact of normative policy assumptions on quantified external costs using a case study of recently discussed variants of future coal mining and use of extracted coal in electricity and heat generation in the Czech Republic. A bottom-up impact-pathway approach is used for quantification of external costs. Several policy perspectives are elaborated for aggregating impacts that differ in geographic coverage and in how valuation of quantified impacts is adjusted in a particular perspective. We find that the fraction of monetized external impacts taken into policy-making considerations may vary according to choice of decision perspective up to a factor of 10. At present there are virtually no hard rules for defining geographical boundaries or adjusting values for a summation of monetized environmental impacts. We, however, stress that any rigorous external cost assessment should, for instance in a separate calculation, take account of impacts occurring beyond country borders.
Do men need empowering too? A systematic review of entrepreneurial education and microenterprise development on health disparities among inner-city black male youth.

PubMed

Jennings, Larissa

2014-10-01

Economic strengthening through entrepreneurial and microenterprise development has been shown to mitigate poverty-based health disparities in developing countries. Yet, little is known regarding the impact of similar approaches on disadvantaged U.S. populations, particularly inner-city African-American male youth disproportionately affected by poverty, unemployment, and adverse health outcomes. A systematic literature review was conducted to guide programming and research in this area. Eligible studies were those published in English from 2003 to 2014 which evaluated an entrepreneurial and microenterprise initiative targeting inner-city youth, aged 15 to 24, and which did not exclude male participants. Peer-reviewed publications were identified from two electronic bibliographic databases. A manual search was conducted among web-based gray literature and registered trials not yet published. Among the 26 papers retrieved for review, six met the inclusion criteria and were retained for analysis. None of the 16 registered microenterprise trials were being conducted among disadvantaged populations in the U.S. The available literature suggests that entrepreneurial and microenterprise programs can positively impact youth's economic and psychosocial functioning and result in healthier decision-making. Young black men specifically benefited from increased autonomy, engagement, and risk avoidance. However, such programs are vastly underutilized among U.S. minority youth, and the current evidence is insufficiently descriptive or rigorous to draw definitive conclusions. Many programs described challenges in securing adequate resources, recruiting minority male youth, and sustaining community buy-in. There is an urgent need to increase implementation and evaluation efforts, using innovative and rigorous designs, to improve the low status of greater numbers of African-American male youth.
Accelerating Research Impact in a Learning Health Care System

PubMed Central

Elwy, A. Rani; Sales, Anne E.; Atkins, David

2017-01-01

Background: Since 1998, the Veterans Health Administration (VHA) Quality Enhancement Research Initiative (QUERI) has supported more rapid implementation of research into clinical practice. Objectives: With the passage of the Veterans Access, Choice and Accountability Act of 2014 (Choice Act), QUERI further evolved to support VHA’s transformation into a Learning Health Care System by aligning science with clinical priority goals based on a strategic planning process and alignment of funding priorities with updated VHA priority goals in response to the Choice Act. Design: QUERI updated its strategic goals in response to independent assessments mandated by the Choice Act that recommended VHA reduce variation in care by providing a clear path to implement best practices. Specifically, QUERI updated its application process to ensure its centers (Programs) focus on cross-cutting VHA priorities and specify roadmaps for implementation of research-informed practices across different settings. QUERI also increased funding for scientific evaluations of the Choice Act and other policies in response to Commission on Care recommendations. Results: QUERI’s national network of Programs deploys effective practices using implementation strategies across different settings. QUERI Choice Act evaluations informed the law’s further implementation, setting the stage for additional rigorous national evaluations of other VHA programs and policies including community provider networks. Conclusions: Grounded in implementation science and evidence-based policy, QUERI serves as an example of how to operationalize core components of a Learning Health Care System, notably through rigorous evaluation and scientific testing of implementation strategies to ultimately reduce variation in quality and improve overall population health. PMID:27997456
76 FR 338 - Notice of Proposed Information Collection Requests

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-04

... feasibility of a promising practices study of Upward Bound that uses a rigorous quasi-experimental design. The design and feasibility report will develop a set of design options for conducting a study of Upward Bound and examine their applicability to studies of other TRIO programs. If a rigorous evaluation design...
The benefits of health information exchange: an updated systematic review.

PubMed

Menachemi, Nir; Rahurkar, Saurabh; Harle, Christopher A; Vest, Joshua R

2018-04-28

Widespread health information exchange (HIE) is a national objective motivated by the promise of improved care and a reduction in costs. Previous reviews have found little rigorous evidence that HIE positively affects these anticipated benefits. However, early studies of HIE were methodologically limited. The purpose of the current study is to review the recent literature on the impact of HIE. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to conduct our systematic review. PubMed and Scopus databases were used to identify empirical articles that evaluated HIE in the context of a health care outcome. Our search strategy identified 24 articles that included 63 individual analyses. The majority of the studies were from the United States representing 9 states; and about 40% of the included analyses occurred in a handful of HIEs from the state of New York. Seven of the 24 studies used designs suitable for causal inference and all reported some beneficial effect from HIE; none reported adverse effects. The current systematic review found that studies with more rigorous designs all reported benefits from HIE. Such benefits include fewer duplicated procedures, reduced imaging, lower costs, and improved patient safety. We also found that studies evaluating community HIEs were more likely to find benefits than studies that evaluated enterprise HIEs or vendor-mediated exchanges. Overall, these finding bode well for the HIEs ability to deliver on anticipated improvements in care delivery and reduction in costs.
New Challenges Facing Small Undergraduate Departments And The Role Of Faculty And Administrators.

NASA Astrophysics Data System (ADS)

El-Shazly, A. K.

2003-12-01

Small geoscience departments with 5 faculty members or less in undergraduate institutions are facing serious challenges that will have a profound impact on their future, as well as the future of geoscience education. In addition to past and future budget cuts that affect all departments, small departments are more vulnerable to such problems as (i) decreased enrollments in introductory level classes, (ii) small number of geology majors, (iii) small number of graduates per year (iv) lack or paucity of equipment necessary for faculty and student research, (v) limited opportunities for external funding, (vi) need to offer upper division classes on an alternate year basis, (vii) difficulty in recruiting and retaining students, (viii) high teaching loads for faculty, and (ix) designing rigorous curricula based on 120 credit hours with a significant component of liberal art classes. These problems pose new challenges for faculty, department chairs and administrators. Faculty need to design curricula tailored to the need of the job market, without compromising rigor or the quality of the program. New classes/ concentrations in environmental science, hydrogeology and geographical information systems should be offered, and traditional classes in petrology, geophysics and tectonics should be maintained. Classes in Physics, Chemistry and Math should be core requirements. Student involvement in research should be encouraged at an early stage (sophomore/ junior levels). Department chairs need to assign duties in their department carefully to capitalize on the strengths of their faculty: faculty with strong research backgrounds should be helped in their efforts to pursue external funding opportunities, whereas those with strong teaching abilities should be evaluated primarily on their performance in the classroom. Student credit hour production should not be used as a criterion for evaluating faculty. Administrators should evaluate programs and departments based on the success of their graduates in the workplace/ graduate school, not their numbers, and the quality of faculty research and its impact on attracting new majors and acquisition of funds.
A cluster randomized controlled trial to assess the impact on intimate partner violence of a 10-session participatory gender training curriculum delivered to women taking part in a group-based microfinance loan scheme in Tanzania (MAISHA CRT01): study protocol.

PubMed

Harvey, Sheila; Lees, Shelley; Mshana, Gerry; Pilger, Daniel; Hansen, Christian; Kapiga, Saidi; Watts, Charlotte

2018-04-02

Worldwide, almost one third (30%) of women who have been in a relationship have experienced physical and/or sexual violence from an intimate partner. Given the considerable negative impacts of intimate partner violence (IPV) on women's physical health and well-being, there is an urgent need for rigorous evidence on violence prevention interventions. The study, comprising a cluster randomized controlled trial (RCT) and in-depth qualitative study, will assess the impact on women's past year experience of physical and/or sexual IPV of a participatory gender training curriculum (MAISHA curriculum) delivered to women participating in group-based microfinance in Tanzania. More broadly, the study aims to learn more about the factors that contribute to women's vulnerability to violence and understand how the intervention impacts on the lives of women and their families. Sixty-six eligible microfinance loan groups are enrolled and randomly allocated to: the 10-session MAISHA curriculum, delivered over 20 weeks (n = 33); or, to no intervention (n = 33). Study participants are interviewed at baseline and at 24 months post-intervention about their: household; partner; income; health; attitudes and social norms; relationship (including experiences of different forms of violence); childhood; and community. For the qualitative study and process evaluation, focus group discussions are being conducted with study participants and MAISHA curriculum facilitators. In-depth interviews are being conducted with a purposive sample of 18 participants. The primary outcome, assessed at 24 months post-intervention, is a composite of women's reported experience of physical and/or sexual IPV during the past 12 months. Secondary outcomes include: reported experience of physical, sexual and emotional/psychological IPV during the past 12 months, attitudes towards IPV and reported disclosure of IPV to others. The study forms part of a wider programme of research (MAISHA) that includes: a complementary cluster RCT evaluating the impact of delivering the MAISHA curriculum to women not receiving formal group-based microfinance; an economic evaluation; and a cross-sectional survey of men to explore male risk factors associated with IPV. MAISHA will generate rigorous evidence on violence prevention interventions, as well as further insights into the different forms and consequences of violence and drivers of violence perpetration. ClinicalTrials.gov ID: NCT02592252 , registered retrospectively on 13 August 2015.
Technology-assisted Interventions for Parents of Young Children: Emerging Practices, Current Research, and Future Directions

PubMed Central

Hall, Cristin M.; Bierman, Karen L.

2016-01-01

Technology can potentially expand the reach and cut the costs of providing effective, evidence-based interventions. This paper reviews existing publications that describe the application and evaluation of technology-assisted interventions for parents of young children. A broad review of the early childhood literature revealed 48 studies describing technology-assisted parent education and interventions. Across these studies, multiple forms of technology were used, including web-based platforms, discussion forums, mobile devices, and video conferencing. Results are described moving from feasibility and acceptability of technology-based delivery systems to more rigorous evaluations examining their impact on parent and child outcomes. Potential exists for technology to deliver interventions to parents. Limitations are discussed including differential acceptability and elevated attrition associated with internet-only intervention delivery. PMID:27773964
Evaluative conditioning may incur attentional costs.

PubMed

Pleyers, Gordy; Corneille, Olivier; Yzerbyt, Vincent; Luminet, Olivier

2009-04-01

Evaluative conditioning (EC) refers to changes in the liking of an affectively neutral stimulus (conditioned stimulus, or CS) after pairing this stimulus with an affect-laden stimulus (unconditioned stimulus, or US). Several authors proposed that EC incurs little or no attentional cost. Using a rigorous design, we provide evidence that a reduction in attentional resources may have a negative impact on EC. Additional analyses also revealed that participants correctly encoded fewer CS-US pairings when their attentional resources were depleted. Replicating Pleyers, Corneille, Luminet, and Yzerbyt's (2007) findings, EC was also obtained only for CSs that could be correctly linked to their associated US in the context of an identification task. This research clarifies the role of higher order processes in EC and has significant practical implications. Copyright (c) 2009 APA, all rights reserved.
The Medicine with Respect Project: a stakeholder focus group evaluation.

PubMed

Hemingway, Steve; White, Jacquie; Turner, James; Dewhirst, Kate; Smith, George

2012-11-01

The administration of medicines is a role that fundamentally impacts on the wellbeing of the patient and has been described as one of the highest risk activities that a nurse undertakes. This article reports on the Medicine with Respect Project where collaborating organisations sought to improve the education and training of Mental Health Nurses toward safe and competence practice. Focus groups were used to evaluate stakeholders experiences and what emerged was overall satisfaction but with specific suggestions in how to improve the effectiveness of the project. All groups emphasised that all nurses in administering medicines should undergo a rigorous assessment of their medicines administration performance. This would make the ultimate aim of competent and safe practice more achievable. Copyright © 2012 Elsevier Ltd. All rights reserved.
Technology-assisted Interventions for Parents of Young Children: Emerging Practices, Current Research, and Future Directions.

PubMed

Hall, Cristin M; Bierman, Karen L

Technology can potentially expand the reach and cut the costs of providing effective, evidence-based interventions. This paper reviews existing publications that describe the application and evaluation of technology-assisted interventions for parents of young children. A broad review of the early childhood literature revealed 48 studies describing technology-assisted parent education and interventions. Across these studies, multiple forms of technology were used, including web-based platforms, discussion forums, mobile devices, and video conferencing. Results are described moving from feasibility and acceptability of technology-based delivery systems to more rigorous evaluations examining their impact on parent and child outcomes. Potential exists for technology to deliver interventions to parents. Limitations are discussed including differential acceptability and elevated attrition associated with internet-only intervention delivery.
Pediatric Concerns Due to Expanded Cannabis Use: Unintended Consequences of Legalization.

PubMed

Wang, George Sam

2017-03-01

An "unintended consequence" of marijuana legalization is the impact on the pediatric population. From prenatal exposure to unintentional childhood exposures, through concerns of adolescence abuse and marijuana use for medicinal indications in children, marijuana exposure can affect pediatric patients at every stage in childhood. Regardless of the stage or reason of exposure, concerns exist about short-term and long-term consequences in a child's physical and mental health. The use of cannabidiol (CBD) may have some benefit for the treatment of epilepsy, but emphasis needs to be on rigorous clinical trials to evaluate efficacy and safety. As more states allow both medical and recreational marijuana, availability and prevalence of use will likely increase and more surveillance and research is needed to evaluate the consequences on the pediatric population.
A high rigor temperature, not sarcomere length, determines light scattering properties and muscle colour in beef M. sternomandibularis meat and muscle fibres.

PubMed

Hughes, J; Clarke, F; Purslow, P; Warner, R

2018-05-18

Beef meat colour is impacted by both myoglobin status and the light scattering properties of the muscle, and the specific causative scattering elements of the latter are still unknown. We hypothesize that stretching muscles during rigor will generate a structure which favours light scattering, by increasing the length of the I-band (longer sarcomeres) and that a high rigor temperature will cause protein reconfiguration, changing the muscle structure and promoting light scattering. Muscle fibre fragments were isolated from four beef M. sternomandibularis and subjected to stretching (plus, minus) and three incubation temperatures (5, 15, 35 °C). Reflectance confocal laser scanning microscopy (rCLSM) revealed sarcomere stretching alone was not solely responsible for light scattering development. A high rigor temperature (35 °C) was more favourable for light scattering. Stretching and taking muscle into rigor at 35 °C promoted transverse shrinkage of muscle fibres and increased light scattering and could be applied post-mortem (PM) to reduce the occurrence of problematic dark meat. Crown Copyright © 2018. Published by Elsevier Ltd. All rights reserved.
Spatial scaling and multi-model inference in landscape genetics: Martes americana in northern Idaho

Treesearch

Tzeidle N. Wasserman; Samuel A. Cushman; Michael K. Schwartz; David O. Wallin

2010-01-01

Individual-based analyses relating landscape structure to genetic distances across complex landscapes enable rigorous evaluation of multiple alternative hypotheses linking landscape structure to gene flow. We utilize two extensions to increase the rigor of the individual-based causal modeling approach to inferring relationships between landscape patterns and gene flow...
A systematic review of primary prevention strategies for sexual violence perpetration☆

PubMed Central

DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K.; Massetti, Greta M.; Matjasko, Jennifer L.; Tharp, Andra Teten

2018-01-01

This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003). PMID:29606897

A systematic review of primary prevention strategies for sexual violence perpetration.

PubMed

DeGue, Sarah; Valle, Linda Anne; Holt, Melissa K; Massetti, Greta M; Matjasko, Jennifer L; Tharp, Andra Teten

2014-01-01

This systematic review examined 140 outcome evaluations of primary prevention strategies for sexual violence perpetration. The review had two goals: 1) to describe and assess the breadth, quality, and evolution of evaluation research in this area; and 2) to summarize the best available research evidence for sexual violence prevention practitioners by categorizing programs with regard to their evidence of effectiveness on sexual violence behavioral outcomes in a rigorous evaluation. The majority of sexual violence prevention strategies in the evaluation literature are brief, psycho-educational programs focused on increasing knowledge or changing attitudes, none of which have shown evidence of effectiveness on sexually violent behavior using a rigorous evaluation design. Based on evaluation studies included in the current review, only three primary prevention strategies have demonstrated significant effects on sexually violent behavior in a rigorous outcome evaluation: Safe Dates (Foshee et al., 2004); Shifting Boundaries (building-level intervention only, Taylor, Stein, Woods, Mumford, & Forum, 2011); and funding associated with the 1994 U.S. Violence Against Women Act (VAWA; Boba & Lilley, 2009). The dearth of effective prevention strategies available to date may reflect a lack of fit between the design of many of the existing programs and the principles of effective prevention identified by Nation et al. (2003).
Testing the Impact of a Pre-Instructional Digital Game on Middle-Grade Students' Understanding of Photosynthesis

ERIC Educational Resources Information Center

Culp, Katherine McMillan; Martin, Wendy; Clements, Margaret; Lewis Presser, Ashley

2015-01-01

Rigorous studies of the impact of digital games on student learning remain relatively rare, as do studies of games as supports for learning difficult, core curricular concepts in the context of normal classroom practices. This study uses a blocked, cluster randomized controlled trial design to test the impact of a digital game, played as homework…
Opto-mechanical design of optical window for aero-optics effect simulation instruments

NASA Astrophysics Data System (ADS)

Wang, Guo-ming; Dong, Dengfeng; Zhou, Weihu; Ming, Xing; Zhang, Yan

2016-10-01

A complete theory is established for opto-mechanical systems design of the window in this paper, which can make the design more rigorous .There are three steps about the design. First, the universal model of aerodynamic environment is established based on the theory of Computational Fluid Dynamics, and the pneumatic pressure distribution and temperature data of optical window surface is obtained when aircraft flies in 5-30km altitude, 0.5-3Ma speed and 0-30°angle of attack. The temperature and pressure distribution values for the maximum constraint is selected as the initial value of external conditions on the optical window surface. Then, the optical window and mechanical structure are designed, which is also divided into two parts: First, mechanical structure which meet requirements of the security and tightness is designed. Finally, rigorous analysis and evaluation are given about the structure of optics and mechanics we have designed. There are two parts to be analyzed. First, the Fluid-Solid-Heat Coupled Model is given based on finite element analysis. And the deformation of the glass and structure can be obtained by the model, which can assess the feasibility of the designed optical windows and ancillary structure; Second, the new optical surface is fitted by Zernike polynomials according to the deformation of the surface of the optical window, which can evaluate imaging quality impact of spectral camera by the deformation of window.
Towards Reliable Evaluation of Anomaly-Based Intrusion Detection Performance

NASA Technical Reports Server (NTRS)

Viswanathan, Arun

2012-01-01

This report describes the results of research into the effects of environment-induced noise on the evaluation process for anomaly detectors in the cyber security domain. This research was conducted during a 10-week summer internship program from the 19th of August, 2012 to the 23rd of August, 2012 at the Jet Propulsion Laboratory in Pasadena, California. The research performed lies within the larger context of the Los Angeles Department of Water and Power (LADWP) Smart Grid cyber security project, a Department of Energy (DoE) funded effort involving the Jet Propulsion Laboratory, California Institute of Technology and the University of Southern California/ Information Sciences Institute. The results of the present effort constitute an important contribution towards building more rigorous evaluation paradigms for anomaly-based intrusion detectors in complex cyber physical systems such as the Smart Grid. Anomaly detection is a key strategy for cyber intrusion detection and operates by identifying deviations from profiles of nominal behavior and are thus conceptually appealing for detecting "novel" attacks. Evaluating the performance of such a detector requires assessing: (a) how well it captures the model of nominal behavior, and (b) how well it detects attacks (deviations from normality). Current evaluation methods produce results that give insufficient insight into the operation of a detector, inevitably resulting in a significantly poor characterization of a detectors performance. In this work, we first describe a preliminary taxonomy of key evaluation constructs that are necessary for establishing rigor in the evaluation regime of an anomaly detector. We then focus on clarifying the impact of the operational environment on the manifestation of attacks in monitored data. We show how dynamic and evolving environments can introduce high variability into the data stream perturbing detector performance. Prior research has focused on understanding the impact of this variability in training data for anomaly detectors, but has ignored variability in the attack signal that will necessarily affect the evaluation results for such detectors. We posit that current evaluation strategies implicitly assume that attacks always manifest in a stable manner; we show that this assumption is wrong. We describe a simple experiment to demonstrate the effects of environmental noise on the manifestation of attacks in data and introduce the notion of attack manifestation stability. Finally, we argue that conclusions about detector performance will be unreliable and incomplete if the stability of attack manifestation is not accounted for in the evaluation strategy.
A Generalizability Investigation of Cognitive Demand and Rigor Ratings of Items and Standards in an Alignment Study

ERIC Educational Resources Information Center

Lombardi, Allison; Seburn, Mary; Conley, David; Snow, Eric

2010-01-01

In alignment studies, expert raters evaluate assessment items against standards and ratings are used to compute various alignment indices. Questions about rater reliability, however, are often ignored or inadequately addressed. This paper reports the results of a generalizability theory study of cognitive demand and rigor ratings of assessment…
Beyond the RCT: Integrating Rigor and Relevance to Evaluate the Outcomes of Domestic Violence Programs

ERIC Educational Resources Information Center

Goodman, Lisa A.; Epstein, Deborah; Sullivan, Cris M.

2018-01-01

Programs for domestic violence (DV) victims and their families have grown exponentially over the last four decades. The evidence demonstrating the extent of their effectiveness, however, often has been criticized as stemming from studies lacking scientific rigor. A core reason for this critique is the widespread belief that credible evidence can…
Public Hearing or `Hearing Public'? An Evaluation of the Participation of Local Stakeholders in Environmental Impact Assessment of Ghana's Jubilee Oil Fields

NASA Astrophysics Data System (ADS)

Bawole, Justice Nyigmah

2013-08-01

This article investigates the involvement of local stakeholders in the environmental impact assessment (EIA) processes of Ghana's first off-shore oil fields (the Jubilee fields). Adopting key informants interviews and documentary reviews, the article argues that the public hearings and the other stakeholder engagement processes were cosmetic and rhetoric with the view to meeting legal requirements rather than a purposeful interest in eliciting inputs from local stakeholders. It further argues that the operators appear to lack the social legitimacy and social license that will make them acceptable in the project communities. A rigorous community engagement along with a commitment to actively involving local stakeholders in the corporate social responsibility (CSR) programmes of the partners may enhance the image of the partners and improve their social legitimacy. Local government agencies should be capacitated to actively engage project organisers; and government must mitigate the impact of the oil projects through well-structured social support programmes.
Impact of Increasing Inter-pregnancy Interval on Maternal and Infant Health

PubMed Central

Wendt, Amanda; Gibbs, Cassandra M.; Peters, Stacey; Hogue, Carol J.

2015-01-01

Short inter-pregnancy intervals (IPIs) have been associated with adverse maternal and infant health outcomes in the literature. However, many studies in this area have been lacking in quality and appropriate control for confounders known to be associated with both short IPIs and poor outcomes. The objective of this systematic review was to assess this relationship using more rigorous criteria, based on GRADE (Grading of Recommendations Assessment, Development and Evaluation) methodology. We found too few higher-quality studies of the impact of IPIs (measured as the time between the birth of a previous child and conception of the next child) on maternal health to reach conclusions about maternal nutrition, morbidity or mortality. However, the evidence for infant effects justified meta-analyses. We found significant impacts of short IPIs for extreme preterm birth [<6 m adjusted odds ratio (aOR): 1.58 [95% confidence interval (CI) 1.40, 1.78], 6–11 m aOR: 1.23 [1.03, 1.46
Public hearing or 'hearing public'? an evaluation of the participation of local stakeholders in environmental impact assessment of Ghana's Jubilee oil fields.

PubMed

Bawole, Justice Nyigmah

2013-08-01

This article investigates the involvement of local stakeholders in the environmental impact assessment (EIA) processes of Ghana's first off-shore oil fields (the Jubilee fields). Adopting key informants interviews and documentary reviews, the article argues that the public hearings and the other stakeholder engagement processes were cosmetic and rhetoric with the view to meeting legal requirements rather than a purposeful interest in eliciting inputs from local stakeholders. It further argues that the operators appear to lack the social legitimacy and social license that will make them acceptable in the project communities. A rigorous community engagement along with a commitment to actively involving local stakeholders in the corporate social responsibility (CSR) programmes of the partners may enhance the image of the partners and improve their social legitimacy. Local government agencies should be capacitated to actively engage project organisers; and government must mitigate the impact of the oil projects through well-structured social support programmes.
On Lack of Robustness in Hydrological Model Development Due to Absence of Guidelines for Selecting Calibration and Evaluation Data: Demonstration for Data-Driven Models

NASA Astrophysics Data System (ADS)

Zheng, Feifei; Maier, Holger R.; Wu, Wenyan; Dandy, Graeme C.; Gupta, Hoshin V.; Zhang, Tuqiao

2018-02-01

Hydrological models are used for a wide variety of engineering purposes, including streamflow forecasting and flood-risk estimation. To develop such models, it is common to allocate the available data to calibration and evaluation data subsets. Surprisingly, the issue of how this allocation can affect model evaluation performance has been largely ignored in the research literature. This paper discusses the evaluation performance bias that can arise from how available data are allocated to calibration and evaluation subsets. As a first step to assessing this issue in a statistically rigorous fashion, we present a comprehensive investigation of the influence of data allocation on the development of data-driven artificial neural network (ANN) models of streamflow. Four well-known formal data splitting methods are applied to 754 catchments from Australia and the U.S. to develop 902,483 ANN models. Results clearly show that the choice of the method used for data allocation has a significant impact on model performance, particularly for runoff data that are more highly skewed, highlighting the importance of considering the impact of data splitting when developing hydrological models. The statistical behavior of the data splitting methods investigated is discussed and guidance is offered on the selection of the most appropriate data splitting methods to achieve representative evaluation performance for streamflow data with different statistical properties. Although our results are obtained for data-driven models, they highlight the fact that this issue is likely to have a significant impact on all types of hydrological models, especially conceptual rainfall-runoff models.
Process evaluation improves delivery of a nutrition-sensitive agriculture programme in Burkina Faso.

PubMed

Nielsen, Jennifer N; Olney, Deanna K; Ouedraogo, Marcellin; Pedehombga, Abdoulaye; Rouamba, Hippolyte; Yago-Wienne, Fanny

2017-12-26

Evidence is emerging from rigorous evaluations about the effectiveness of nutrition-sensitive agriculture programmes in improving nutritional outcomes. Additional evidence can elucidate how different programme components and pathways contribute and can be optimized for impact. The International Food Policy Research Institute, with Helen Keller International, designed a comprehensive framework to evaluate the delivery, utilization, and impact of Helen Keller International's enhanced homestead food production programme in Burkina Faso. After 18 months of implementation, a process evaluation was conducted to examine programme impact pathways, using key informant and semistructured interviews with implementing agents and beneficiaries, and with residents of control communities. Data were analyzed by International Food Policy Research Institute and reviewed with project managers and partners through multiple workshops to identify opportunities to strengthen implementation. Findings illuminated gaps between intended and actual delivery schemes, including input constraints, knowledge gaps among community agents in agriculture and young child nutrition practices, and lower than expected activity by community volunteers. In response, staff developed measures to overcome water constraints and expand vegetable and poultry production, retrained volunteers in certain techniques of food production and counselling for nutrition behaviour change, added small incentives to motivate volunteers, and shaped both immediate and long-term changes to the programme model. Working closely with International Food Policy Research Institute on the evaluation activities also expanded the repertoire of research methods and skills of Helen Keller International staff. Process evaluation can strengthen programme delivery, utilization, and design. Collaboration between researchers and implementers can improve programme effectiveness, project staff capacity, and advance delivery science. © 2017 John Wiley & Sons Ltd.
Motivation Measures in Sport: A Critical Review and Bibliometric Analysis.

PubMed

Clancy, Rachel B; Herring, Matthew P; Campbell, Mark J

2017-01-01

Motivation is widely-researched, in both sport psychology and other fields. As rigorous measurement is essential to understanding this latent construct, a critical appraisal of measurement instruments is needed. Thus, the purpose of this review was to evaluate the six most highly cited motivation measures in sport. Peer-reviewed articles published prior to August 2016 were searched to identify the six most highly cited motivation questionnaires in sport: Sport Motivation Scale (SMS), Intrinsic Motivation Inventory (IMI), Situational Motivational Scale (SIMS), Perceptions of Success Questionnaire (POSQ), Behavioural Regulation in Sport Questionnaire (BRSQ), and Task and Ego Orientation in Sport Questionnaire (TEOSQ). The questionnaires were then evaluated and discussed in four sections: Development, Reliability, Correlates, and Summary. Bibliometric data were also calculated (average weighted impact factor) and assessed (e.g., citations per year) to evaluate the impact of the use of each questionnaire. Despite some variance in their psychometric properties, conceptualization, structure, and utility, the six questionnaires are psychometrically strong instruments for quantifying motivation that are widely supported in the literature. Bibliometric analyses suggested that the IMI ranks first and the SMS ranks sixth according to the average weighted impact factors of their original publications. Consideration of each questionnaire's psychometric strengths/limitations, and conceptualization of motivation in the context of specific research questions should guide researchers in selecting the most appropriate instrument to measure motivation in sport. The average weighted impact factor of each questionnaire is a useful value to consider as well. With these points in mind, recommendations are provided.
Motivation Measures in Sport: A Critical Review and Bibliometric Analysis

PubMed Central

Clancy, Rachel B.; Herring, Matthew P.; Campbell, Mark J.

2017-01-01

Motivation is widely-researched, in both sport psychology and other fields. As rigorous measurement is essential to understanding this latent construct, a critical appraisal of measurement instruments is needed. Thus, the purpose of this review was to evaluate the six most highly cited motivation measures in sport. Peer-reviewed articles published prior to August 2016 were searched to identify the six most highly cited motivation questionnaires in sport: Sport Motivation Scale (SMS), Intrinsic Motivation Inventory (IMI), Situational Motivational Scale (SIMS), Perceptions of Success Questionnaire (POSQ), Behavioural Regulation in Sport Questionnaire (BRSQ), and Task and Ego Orientation in Sport Questionnaire (TEOSQ). The questionnaires were then evaluated and discussed in four sections: Development, Reliability, Correlates, and Summary. Bibliometric data were also calculated (average weighted impact factor) and assessed (e.g., citations per year) to evaluate the impact of the use of each questionnaire. Despite some variance in their psychometric properties, conceptualization, structure, and utility, the six questionnaires are psychometrically strong instruments for quantifying motivation that are widely supported in the literature. Bibliometric analyses suggested that the IMI ranks first and the SMS ranks sixth according to the average weighted impact factors of their original publications. Consideration of each questionnaire's psychometric strengths/limitations, and conceptualization of motivation in the context of specific research questions should guide researchers in selecting the most appropriate instrument to measure motivation in sport. The average weighted impact factor of each questionnaire is a useful value to consider as well. With these points in mind, recommendations are provided. PMID:28337165
Differential rigor development in red and white muscle revealed by simultaneous measurement of tension and stiffness.

PubMed

Kobayashi, Masahiko; Takemori, Shigeru; Yamaguchi, Maki

2004-02-10

Based on the molecular mechanism of rigor mortis, we have proposed that stiffness (elastic modulus evaluated with tension response against minute length perturbations) can be a suitable index of post-mortem rigidity in skeletal muscle. To trace the developmental process of rigor mortis, we measured stiffness and tension in both red and white rat skeletal muscle kept in liquid paraffin at 37 and 25 degrees C. White muscle (in which type IIB fibres predominate) developed stiffness and tension significantly more slowly than red muscle, except for soleus red muscle at 25 degrees C, which showed disproportionately slow rigor development. In each of the examined muscles, stiffness and tension developed more slowly at 25 degrees C than at 37 degrees C. In each specimen, tension always reached its maximum level earlier than stiffness, and then decreased more rapidly and markedly than stiffness. These phenomena may account for the sequential progress of rigor mortis in human cadavers.
School Obesity Prevention Policies and Practices in Minnesota and Student Outcomes: A Longitudinal Cohort Study.

PubMed

Nanney, Marilyn S; MacLehose, Richard F; Kubik, Martha Y; Davey, Cynthia S; O'Connell, Michael J; Grannon, Katherine Y; Nelson, Toben F

2016-11-01

The School Obesity-related Policy Evaluation (ScOPE) Study uses existing public surveillance data and applies a rigorous study design to evaluate effectiveness of school policies and practices impacting student behavioral and weight outcomes. The ScOPE Study used a cohort of 50 combined junior-senior and high schools in Minnesota to evaluate the change in weight-related policy environments in 2006 and 2012 and test the effect of policy change on students attending those schools in 2007 and 2013. Exposure variables included school practices about foods and beverages available in school vending machines and school stores, physical education requirements, and intramural opportunities. Primary study outcomes were average school-level ninth grade student BMI percentile, obesity prevalence, daily servings of fruits/vegetables, and daily glasses of soda. Availability of fruits/vegetables in schools was associated with a significant increase in total daily intake among ninth grade students by 0.4 servings. Availability of soda in schools was associated with a significant increase in total daily intake among ninth grade boys by 0.5 servings. Less-healthy snack and drink availability in schools was associated with a small, significant increase (1%) in student BMI percentile at the school level. Use of a school-level longitudinal cohort study design over a 6-year period uniquely adds to the methodologic rigor of school policy and practice evaluation studies. The ScOPE Study provides marginal evidence that school policies and practices, especially those that restrict vending and school store offerings, may have small effects on weight status among ninth grade students. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.
Quality Assessment of Clinical Practice Guidelines for Respiratory Diseases in China: A Systematic Appraisal.

PubMed

Jiang, Mei; Liao, Li-Yue; Liu, Xiao-Qing; He, Wei-Qun; Guan, Wei-Jie; Chen, Hao; Li, Yi-Min

2015-09-01

There has been a significant increase in the publication of clinical practice guidelines (CPGs) for respiratory diseases in China. However, little is known about the quality and potential impacts of these CPGs. Our objective was to critically evaluate the quality of Chinese CPGs for respiratory diseases that were published in peer-reviewed medical journals. A systematic search of scientific literature published between 1979 and 2013 was undertaken to identify and select CPGs that were related to respiratory diseases. Four Chinese databases (the Chinese Biomedical Literature database [CBM], the China National Knowledge Infrastructure [CNKI], the VIP database, and the WANFANG database) were used. The quality of eligible guidelines was assessed independently by four reviewers using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The overall agreement among reviewers was evaluated using an intraclass correlation coefficient. A total of 109 guidelines published in 27 medical journals from 1979 to 2013 were evaluated. The overall agreement among reviewers was considered good (intraclass correlation coefficient, 0.838; 95% CI, 0.812-0.862). The scores of the six AGREE domains were low: 57.3% for scope and purpose (range, 4.2%-80.5%), 23.8% for stakeholder involvement (range, 2.8%-54.2%), 7.7% for rigor of development (range, 0%-27.1%), 59.8% for clarity and presentation (range, 22.2%-80.6%), 10.9% for applicability (range, 0%-22.9%), and 0.6% for editorial independence (range, 0%-16.7%). Scores for all guidelines were below 60%, and only three guidelines (2.8%) were recommended for clinical practice with modifications. The quality of the guidelines was low, and stakeholder involvement, rigor of development, applicability, and editorial independence should be considered in the future development of CPGs for respiratory diseases in China.
Warnings on alcohol containers and advertisements: international experience and evidence on effects.

PubMed

Wilkinson, Claire; Room, Robin

2009-07-01

In light of possible introduction of alcohol warning labels in Australia and New Zealand, this paper discusses the international experience with and evidence of effects of alcohol warning labels. The report describes international experience with providing information and warnings concerning the promotion or sale of alcoholic beverages, and considers the evidence on the effects of such information and warnings. The experience with and evaluations of the effects of tobacco warning labels are also considered. The most methodologically sound evaluations of alcohol warning labels are based on the US experience. Although these evaluations find little evidence that the introduction of the warning label in the USA had an impact on drinking behaviour, there is evidence that they led to an increase in awareness of the message they contained. In contrast, evaluations of tobacco warning labels find clear evidence of effects on behaviour. There is a need and opportunity for a rigorous evaluation of the impacts of introducing alcohol warning labels to add to the published work on their effectiveness. The experience with tobacco labels might guide the way for more effective alcohol warning labels. Alcohol warning labels are an increasingly popular alcohol policy initiative. It is clear that warning labels can be ineffective, but the tobacco experience suggests that effective warning labels are possible. Any introduction of alcohol warning labels should be evaluated in terms of effects on attitudes and behaviour.
Benefits and harms of direct to consumer advertising: a systematic review.

PubMed

Gilbody, S; Wilson, P; Watt, I

2005-08-01

Direct to consumer advertising is increasingly used by the pharmaceutical industry, but its benefits and harms have yet to be summarised in a comprehensive and rigorous manner. A systematic review was conducted of robust evaluations of the impact (positive and negative) of direct to consumer advertising. A broad range of databases and data sources (including Cinahl, Embase, HMIC, HSRProj, Medline, PsycInfo, and the internet) were searched from inception to 2004. From 2853 citations only four reports were found that met the strict inclusion criteria and provided usable results. Direct to consumer advertising is associated with increased prescription of advertised products and there is substantial impact on patients' request for specific drugs and physicians' confidence in prescribing. No additional benefits in terms of health outcomes were demonstrated. Direct to consumer advertising is banned in most countries, and the research evidence tends to support the negative impact that is feared by those who support a legislative ban. Further research is needed into the clinical and economic impact of direct to consumer advertising in healthcare systems.
Benefits and harms of direct to consumer advertising: a systematic review

PubMed Central

Gilbody, S; Wilson, P; Watt, I

2005-01-01

Background: Direct to consumer advertising is increasingly used by the pharmaceutical industry, but its benefits and harms have yet to be summarised in a comprehensive and rigorous manner. Methods: A systematic review was conducted of robust evaluations of the impact (positive and negative) of direct to consumer advertising. A broad range of databases and data sources (including Cinahl, Embase, HMIC, HSRProj, Medline, PsycInfo, and the internet) were searched from inception to 2004. Results: From 2853 citations only four reports were found that met the strict inclusion criteria and provided usable results. Direct to consumer advertising is associated with increased prescription of advertised products and there is substantial impact on patients' request for specific drugs and physicians' confidence in prescribing. No additional benefits in terms of health outcomes were demonstrated. Discussion: Direct to consumer advertising is banned in most countries, and the research evidence tends to support the negative impact that is feared by those who support a legislative ban. Further research is needed into the clinical and economic impact of direct to consumer advertising in healthcare systems. PMID:16076787
A Neonatal Resuscitation Curriculum in Malawi, Africa: Did It Change In-Hospital Mortality?

PubMed Central

Hole, Michael K.; Olmsted, Keely; Kiromera, Athanase; Chamberlain, Lisa

2012-01-01

Objective. The WHO estimates that 99% of the 3.8 million neonatal deaths occur in developing countries. Neonatal resuscitation training was implemented in Namitete, Malawi. The study's objective was to evaluate the training's impact on hospital staff and neonatal mortality rates. Study Design. Pre-/postcurricular surveys of trainee attitude, knowledge, and skills were analyzed. An observational, longitudinal study of secondary data assessed neonatal mortality. Result. All trainees' (n = 18) outcomes improved, (P = 0.02). Neonatal mortality did not change. There were 3449 births preintervention, 3515 postintervention. Neonatal mortality was 20.9 deaths per 1000 live births preintervention and 21.9/1000 postintervention, (P = 0.86). Conclusion. Short-term pre-/postintervention evaluations frequently reveal positive results, as ours did. Short-term pre- and postintervention evaluations should be interpreted cautiously. Whenever possible, clinical outcomes such as in-hospital mortality should be additionally assessed. More rigorous evaluation strategies should be applied to training programs requiring longitudinal relationships with international community partners. PMID:22164184

Evaluating the Health Impact of Large-Scale Public Policy Changes: Classical and Novel Approaches

PubMed Central

Basu, Sanjay; Meghani, Ankita; Siddiqi, Arjumand

2018-01-01

Large-scale public policy changes are often recommended to improve public health. Despite varying widely—from tobacco taxes to poverty-relief programs—such policies present a common dilemma to public health researchers: how to evaluate their health effects when randomized controlled trials are not possible. Here, we review the state of knowledge and experience of public health researchers who rigorously evaluate the health consequences of large-scale public policy changes. We organize our discussion by detailing approaches to address three common challenges of conducting policy evaluations: distinguishing a policy effect from time trends in health outcomes or preexisting differences between policy-affected and -unaffected communities (using difference-in-differences approaches); constructing a comparison population when a policy affects a population for whom a well-matched comparator is not immediately available (using propensity score or synthetic control approaches); and addressing unobserved confounders by utilizing quasi-random variations in policy exposure (using regression discontinuity, instrumental variables, or near-far matching approaches). PMID:28384086
Enhancing rigor and practice of scoping reviews in social policy research: considerations from a worked example on the Americans with disabilities act.

PubMed

Harris, Sarah Parker; Gould, Robert; Fujiura, Glenn

2015-01-01

There is increasing theoretical consideration about the use of systematic and scoping reviews of evidence in informing disability and rehabilitation research and practice. Indicative of this trend, this journal published a piece by Rumrill, Fitzgerald and Merchant in 2010 explaining the utility and process for conducting reviews of intervention-based research. There is still need to consider how to apply such rigor when conducting more exploratory reviews of heterogeneous research. This article explores the challenges, benefits, and procedures for conducting rigorous exploratory scoping reviews of diverse evidence. The article expands upon Rumrill, Fitzgerald and Merchant's framework and considers its application to more heterogeneous evidence on the impact of social policy. A worked example of a scoping review of the Americans with Disabilities Act is provided with a procedural framework for conducting scoping reviews on the effects of a social policy. The need for more nuanced techniques for enhancing rigor became apparent during the review process. There are multiple methodological steps that can enhance the utility of exploratory scoping reviews. The potential of systematic consideration during the exploratory review process is shown as a viable method to enhance the rigor in reviewing diverse bodies of evidence.
[Evaluation of Uruguay's antismoking campaign: progress and challenges at ten years].

PubMed

Triunfo, Patricia; Harris, Jeffrey; Balsa, Ana

2016-10-01

In 2005, shortly after ratifying the Framework Convention on Tobacco Control (FCTC), Uruguay began an ambitious tobacco control campaign that brought the country to the global forefront in the fight against smoking. The wide range of measures implemented in a relatively short period and the rigorousness with which policies were implemented and enforced have few precedents, even in the most developed countries. This paper presents a synthesis and update of several papers by the authors that evaluate different aspects of the campaign ten years following ratification of the FCTC. In particular, these research studies highlight the campaign's aggregate impact on the drop in prevalence of current tobacco consumption in adult and youth populations, and on decisions by pregnant women to quit smoking (1, 2), as well as the relative impact of tax policies in relation to non-price tobacco control measures. The analyses are based on observational studies (at the population or individual level) that use external (Argentina and Chile) and internal (nonsmokers) control groups. Pending challenges in the design of antismoking policies are also discussed.
A comprehensive evaluation of the impact of telemonitoring in patients with long-term conditions and social care needs: protocol for the whole systems demonstrator cluster randomised trial

PubMed Central

2011-01-01

Background It is expected that increased demands on services will result from expanding numbers of older people with long-term conditions and social care needs. There is significant interest in the potential for technology to reduce utilisation of health services in these patient populations, including telecare (the remote, automatic and passive monitoring of changes in an individual's condition or lifestyle) and telehealth (the remote exchange of data between a patient and health care professional). The potential of telehealth and telecare technology to improve care and reduce costs is limited by a lack of rigorous evidence of actual impact. Methods/Design We are conducting a large scale, multi-site study of the implementation, impact and acceptability of these new technologies. A major part of the evaluation is a cluster-randomised controlled trial of telehealth and telecare versus usual care in patients with long-term conditions or social care needs. The trial involves a number of outcomes, including health care utilisation and quality of life. We describe the broad evaluation and the methods of the cluster randomised trial Discussion If telehealth and telecare technology proves effective, it will provide additional options for health services worldwide to deliver care for populations with high levels of need. Trial Registration Current Controlled Trials ISRCTN43002091 PMID:21819569
Impact of cooking and home food preparation interventions among adults: outcomes and implications for future programs.

PubMed

Reicks, Marla; Trofholz, Amanda C; Stang, Jamie S; Laska, Melissa N

2014-01-01

Cooking programs are growing in popularity; however, an extensive review has not examined their overall impact. Therefore, this study reviewed previous research on cooking/home food preparation interventions and diet and health-related outcomes among adults and identified implications for practice and research. Literature review and descriptive summative method. Dietary intake, knowledge/skills, cooking attitudes and self-efficacy/confidence, health outcomes. Articles evaluating the effectiveness of interventions that included cooking/home food preparation as the primary aim (January, 1980 through December, 2011) were identified via Ovid MEDLINE, Agricola, and Web of Science databases. Studies grouped according to design and outcomes were reviewed for validity using an established coding system. Results were summarized for several outcome categories. Of 28 studies identified, 12 included a control group with 6 as nonrandomized and 6 as randomized controlled trials. Evaluation was done postintervention for 5 studies, pre- and postintervention for 23, and beyond postintervention for 15. Qualitative and quantitative measures suggested a positive influence on main outcomes. However, nonrigorous study designs, varying study populations, and the use of nonvalidated assessment tools limited stronger conclusions. Well-designed studies are needed that rigorously evaluate long-term impact on cooking behavior, dietary intake, obesity and other health outcomes. Copyright © 2014 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.
A rigorous test of the accuracy of USGS digital elevation models in forested areas of Oregon and Washington.

Treesearch

Ward W. Carson; Stephen E. Reutebuch

1997-01-01

A procedure for performing a rigorous test of elevational accuracy of DEMs using independent ground coordinate data digitized photogrammetrically from aerial photography is presented. The accuracy of a sample set of 23 DEMs covering National Forests in Oregon and Washington was evaluated. Accuracy varied considerably between eastern and western parts of Oregon and...
Explaining the variation in the shear force of lamb meat using sarcomere length, the rate of rigor onset and pH.

PubMed

Hopkins, D L; Toohey, E S; Lamb, T A; Kerr, M J; van de Ven, R; Refshauge, G

2011-08-01

The temperature when the pH=6.0 (temp@pH6) impacts on the tenderness and eating quality of sheep meat. Due to the expense, sarcomere length is not routinely measured as a variable to explain variation in shear force, but whether measures such as temp@pH6 are as useful a parameter needs to be established. Measures of rigor onset in 261 carcases, including the temp@pH6, were evaluated in this study for their ability to explain some of the variation in shear force. The results show that for 1 day aged product combinations of the temp@pH6, the pH at 18 °C and the pH at 24 h provided a larger reduction (almost double) in total shear force variation than sarcomere length alone, with pH at 24 h being the single best measure. For 5 day aged product, pH at 18 °C was the single best measure. Inclusion of sarcomere length did represent some improvement, but the marginal increase would not be cost effective. Crown Copyright © 2011. Published by Elsevier Ltd. All rights reserved.
Effects of -1.5°C Super-chilling on quality of Atlantic salmon (Salmo salar) pre-rigor Fillets: Cathepsin activity, muscle histology, texture and liquid leakage.

PubMed

Bahuaud, D; Mørkøre, T; Langsrud, Ø; Sinnes, K; Veiseth, E; Ofstad, R; Thomassen, M S

2008-11-15

The aim of this study was to evaluate the impact of super-chilling on the quality of Atlantic salmon (Salmo salar) pre-rigor fillets. The fillets were kept for 45min in a super-chilling tunnel at -25°C with an air speed in the tunnel at 2.5m/s, to reach a fillet core temperature of -1.5°C, prior to ice storage in a cold room for 4 weeks. Super-chilling seemed to form intra- and extracellular ice crystals in the upper layer of the fillets and prevent myofibre contraction. Lysosome breakages followed by release of cathepsin B and L during storage and myofibre-myofibre detachments were accelerated in the super-chilled fillets. Super-chilling resulted in higher liquid leakage and increased myofibre breakages in the fillets, while texture values of fillets measured instrumentally were not affected by super-chilling one week after treatment. Optimisation of the super-chilling technique is needed to avoid the formation of ice crystals, which may cause irreversible destruction of the myofibres, in order to obtain high quality products. Copyright © 2008 Elsevier Ltd. All rights reserved.
The Impact of a Rigorous Multiple Work Shift Schedule and Day Versus Night Shift Work on Reaction Time and Balance Performance in Female Nurses: A Repeated Measures Study.

PubMed

Thompson, Brennan J; Stock, Matt S; Banuelas, Victoria K; Akalonu, Chibuzo C

2016-07-01

The aim of this study was to determine the impact of a demanding work schedule involving long, cumulative work shifts on response time and balance-related performance outcomes and to evaluate the prevalence of musculoskeletal disorders between day and night shift working nurses. A questionnaire was used to identify the prevalence of past (12-month) and current (7-day) musculoskeletal disorders. Nurses worked three 12-hour work shifts in a 4-day period. Reaction time and balance tests were conducted before and after the work period. The work period induced impairments for reaction time, errors on reaction time tasks, and balance performance, independent of shift type. Musculoskeletal symptom prevalence was high in workers of both work shifts. Compressed work shifts caused performance-based fatigue in nurses. Reaction time and balance tests may be sensitive fatigue identification markers in nurses.
Promise and Peril: Dissemination of Findings from Studies of Drugs Used in Pregnancy and Their Association with Birth Defects

PubMed Central

Patrick, Stephen W.; Cooper, William O.

2015-01-01

When and how to publish birth defects research can be complex, especially in the context of drugs used in pregnancy. Such research frequently involves multiple stakeholders, including regulatory agencies. Researchers must balance the potential peril of an unnecessarily panicked populace versus the benefit of protecting the public's health. We use a case presentation and contemporary literature to highlight the potential tradeoffs that researchers must consider. We highlight important considerations including the public health impact, examining the likelihood of causality, understanding common considerations when using large data sources, the role of peer review and working in partnership with regulatory agencies. We suggest that plans for analyses, dissemination and risk communication are done best a priori and not post hoc. Rigorous research evaluating the impact of drugs used in pregnancy, coupled with effective dissemination strategies, has the potential improve outcomes for mothers and their infants for generations. PMID:26153150
Bringing scientific rigor to community-developed programs in Hong Kong.

PubMed

Fabrizio, Cecilia S; Hirschmann, Malia R; Lam, Tai Hing; Cheung, Teresa; Pang, Irene; Chan, Sophia; Stewart, Sunita M

2012-12-31

This paper describes efforts to generate evidence for community-developed programs to enhance family relationships in the Chinese culture of Hong Kong, within the framework of community-based participatory research (CBPR). The CBPR framework was applied to help maximize the development of the intervention and the public health impact of the studies, while enhancing the capabilities of the social service sector partners. Four academic-community research teams explored the process of designing and implementing randomized controlled trials in the community. In addition to the expected cultural barriers between teams of academics and community practitioners, with their different outlooks, concerns and languages, the team navigated issues in utilizing the principles of CBPR unique to this Chinese culture. Eventually the team developed tools for adaptation, such as an emphasis on building the relationship while respecting role delineation and an iterative process of defining the non-negotiable parameters of research design while maintaining scientific rigor. Lessons learned include the risk of underemphasizing the size of the operational and skills shift between usual agency practices and research studies, the importance of minimizing non-negotiable parameters in implementing rigorous research designs in the community, and the need to view community capacity enhancement as a long term process. The four pilot studies under the FAMILY Project demonstrated that nuanced design adaptations, such as wait list controls and shorter assessments, better served the needs of the community and led to the successful development and vigorous evaluation of a series of preventive, family-oriented interventions in the Chinese culture of Hong Kong.
Effects of chopping time, meat source and storage temperature on the colour of New Zealand type fresh beef sausages.

PubMed

Boles, J A; Mikkelsen, V L; Swan, J E

1998-05-01

The colour stability of finely chopped fresh sausages made from post-rigor, pre-rigor salt added (1.5% w/w) or pre-rigor no salt added beef mince was evaluated using a Hunter Miniscan (L (∗) a (∗) b (∗)) and sensory colour panel. Batters were chopped for various times and sausages stored at -1.5 °, + 4.0 ° and + 8.0 °C. Regardless of meat source or chopping time, colour stability was greatest at -1.5 °C. Panellists found the colour of all sausages stored at -1.5 °C acceptable for at least six days. Sausages made from unsalted pre-rigor mince had markedly better colour stability than those made from the other meats, especially when stored at 4 °C or 8 °C.
Using Small-Scale Randomized Controlled Trials to Evaluate the Efficacy of New Curricular Materials

PubMed Central

Bass, Kristin M.; Stark, Louisa A.

2014-01-01

How can researchers in K–12 contexts stay true to the principles of rigorous evaluation designs within the constraints of classroom settings and limited funding? This paper explores this question by presenting a small-scale randomized controlled trial (RCT) designed to test the efficacy of curricular supplemental materials on epigenetics. The researchers asked whether the curricular materials improved students’ understanding of the content more than an alternative set of activities. The field test was conducted in a diverse public high school setting with 145 students who were randomly assigned to a treatment or comparison condition. Findings indicate that students in the treatment condition scored significantly higher on the posttest than did students in the comparison group (effect size: Cohen's d = 0.40). The paper discusses the strengths and limitations of the RCT, the contextual factors that influenced its enactment, and recommendations for others wishing to conduct small-scale rigorous evaluations in educational settings. Our intention is for this paper to serve as a case study for university science faculty members who wish to employ scientifically rigorous evaluations in K–12 settings while limiting the scope and budget of their work. PMID:25452482
Economic Evaluation of Health IT.

PubMed

Luzi, Daniela; Pecoraro, Fabrizio; Tamburis, Oscar

2016-01-01

Economic evaluation in health care supports decision makers in prioritizing interventions and maximizing the available limited resources for social benefits. Health Information Technology (health IT) constitutes a promising strategy to improve the quality and delivery of health care. However, to determine whether the appropriate health IT solution has been selected in a specific health context, its impact on the clinical and organizational process, on costs, on user satisfaction as well as on patient outcomes, a rigorous and multidimensional evaluation analysis is necessary. Starting from the principles of evaluation introduced since the mid-1980s within the Health Technology Assessment (HTA) guidelines, this contribution provides an overview of the main challenging issues related to the complex task of performing an economic evaluation of health IT. A set of necessary key principles to deliver a proper design and implementation of a multidimensional economic evaluation study is described, focusing in particular on the classification of costs and outcomes as well as on the type of economic analysis to be performed. A case study is eventually described to show how the key principles introduced are applied.
Standardized Tests as Outcome Measures for Evaluating Instructional Interventions in Mathematics and Science

NASA Astrophysics Data System (ADS)

Sussman, Joshua Michael

This three-paper dissertation explores problems with the use of standardized tests as outcome measures for the evaluation of instructional interventions in mathematics and science. Investigators commonly use students' scores on standardized tests to evaluate the impact of instructional programs designed to improve student achievement. However, evidence suggests that the standardized tests may not measure, or may not measure well, the student learning caused by the interventions. This problem is special case of a basic problem in applied measurement related to understanding whether a particular test provides accurate and useful information about the impact of an educational intervention. The three papers explore different aspects of the issue and highlight the potential benefits of (a) using particular research methods and of (b) implementing changes to educational policy that would strengthen efforts to reform instructional intervention in mathematics and science. The first paper investigates measurement problems related to the use of standardized tests in applied educational research. Analysis of the research projects funded by the Institute of Education Sciences (IES) Mathematics and Science Education Program permitted me to address three main research questions. One, how often are standardized tests used to evaluate new educational interventions? Two, do the tests appear to measure the same thing that the intervention teaches? Three, do investigators establish validity evidence for the specific uses of the test? The research documents potential problems and actual problems related to the use of standardized tests in leading applied research, and suggests changes to policy that would address measurement issues and improve the rigor of applied educational research. The second paper explores the practical consequences of misalignment between an outcome measure and an educational intervention in the context of summative evaluation. Simulated evaluation data and a psychometric model of alignment grounded in item response modeling generate the results that address the following research question: how do differences between what a test measures and what an intervention teaches influence the results of an evaluation? The simulation derives a functional relationship between alignment, defined as the match between the test and the intervention, and treatment sensitivity, defined as the statistical power for detecting the impact of an intervention. The paper presents a new model of the effect of misalignment on the results of an evaluation and recommendations for outcome measure selection. The third paper documents the educational effectiveness of the Learning Mathematics through Representations (LMR) lesson sequence for students classified as English Learners (ELs). LMR is a research-based curricular unit designed to support upper elementary students' understandings of integers and fractions, areas considered foundational for the development of higher mathematics. The experimental evaluation contains a multilevel analysis of achievement data from two assessments: a standardized test and a researcher-developed assessment. The study coordinates the two sources of research data with a theoretical mechanism of action in order to rigorously document the effectiveness and educational equity of LMR for ELs using multiple sources of information.
Evaluating a De-Centralized Regional Delivery System for Breast Cancer Screening and Patient Navigation for the Rural Underserved.

PubMed

Inrig, Stephen J; Tiro, Jasmin A; Melhado, Trisha V; Argenbright, Keith E; Craddock Lee, Simon J

2014-01-01

Providing breast cancer screening services in rural areas is challenging due to the fractured nature of healthcare delivery systems and complex reimbursement mechanisms that create barriers to access for the under- and uninsured. Interventions that reduce structural barriers to mammography, like patient navigation programs, are effective and recommended, especially for minority and underserved women. Although the literature on rural healthcare is significant, the field lacks studies of adaptive service delivery models and rigorous evaluation of evidence-based programs that facilitate routine screening and appropriate follow-up across large geographic areas. To better understand how to implement a decentralized regional delivery "hub & spoke" model for rural breast cancer screening and patient navigation, we have designed a rigorous, structured, multi-level and mixed-methods evaluation based on Glasgow's RE-AIM model (Reach, Effectiveness, Adoption, Implementation, and Maintenance). The program is comprised of three core components: 1) Outreach to underserved women by partnering with county organizations; 2) Navigation to guide patients through screening and appropriate follow-up; and 3) Centralized Reimbursement to coordinate funding for screening services through a central contract with Medicaid Breast and Cervical Cancer Services (BCCS). Using Glasgow's RE-AIM model, we will: 1) assess which counties have the resources and capacity to implement outreach and/or navigation components, 2) train partners in each county on how to implement components, and 3) monitor process and outcome measures in each county at regular intervals, providing booster training when needed. This evaluation strategy will elucidate how the heterogeneity of rural county infrastructure impacts decentralized service delivery as a navigation program expands. In addition to increasing breast cancer screening access, our model improves and maintains time to diagnostic resolution and facilitates timely referral to local cancer treatment services. We offer this evaluation approach as an exemplar for scientific methods to evaluate the translation of evidence-based federal policy into sustainable health services delivery in a rural setting.
Evaluating a De-Centralized Regional Delivery System for Breast Cancer Screening and Patient Navigation for the Rural Underserved

PubMed Central

Inrig, Stephen J.; Tiro, Jasmin A.; Melhado, Trisha V.; Argenbright, Keith E.; Craddock Lee, Simon J.

2017-01-01

Providing breast cancer screening services in rural areas is challenging due to the fractured nature of healthcare delivery systems and complex reimbursement mechanisms that create barriers to access for the under- and uninsured. Interventions that reduce structural barriers to mammography, like patient navigation programs, are effective and recommended, especially for minority and underserved women. Although the literature on rural healthcare is significant, the field lacks studies of adaptive service delivery models and rigorous evaluation of evidence-based programs that facilitate routine screening and appropriate follow-up across large geographic areas. Objectives To better understand how to implement a decentralized regional delivery “hub & spoke” model for rural breast cancer screening and patient navigation, we have designed a rigorous, structured, multi-level and mixed-methods evaluation based on Glasgow’s RE-AIM model (Reach, Effectiveness, Adoption, Implementation, and Maintenance). Methods and Design The program is comprised of three core components: 1) Outreach to underserved women by partnering with county organizations; 2) Navigation to guide patients through screening and appropriate follow-up; and 3) Centralized Reimbursement to coordinate funding for screening services through a central contract with Medicaid Breast and Cervical Cancer Services (BCCS). Using Glasgow’s RE-AIM model, we will: 1) assess which counties have the resources and capacity to implement outreach and/or navigation components, 2) train partners in each county on how to implement components, and 3) monitor process and outcome measures in each county at regular intervals, providing booster training when needed. Discussion This evaluation strategy will elucidate how the heterogeneity of rural county infrastructure impacts decentralized service delivery as a navigation program expands. In addition to increasing breast cancer screening access, our model improves and maintains time to diagnostic resolution and facilitates timely referral to local cancer treatment services. We offer this evaluation approach as an exemplar for scientific methods to evaluate the translation of evidence-based federal policy into sustainable health services delivery in a rural setting. PMID:28713882
Agent based modeling in tactical wargaming

NASA Astrophysics Data System (ADS)

James, Alex; Hanratty, Timothy P.; Tuttle, Daniel C.; Coles, John B.

2016-05-01

Army staffs at division, brigade, and battalion levels often plan for contingency operations. As such, analysts consider the impact and potential consequences of actions taken. The Army Military Decision-Making Process (MDMP) dictates identification and evaluation of possible enemy courses of action; however, non-state actors often do not exhibit the same level and consistency of planned actions that the MDMP was originally designed to anticipate. The fourth MDMP step is a particular challenge, wargaming courses of action within the context of complex social-cultural behaviors. Agent-based Modeling (ABM) and its resulting emergent behavior is a potential solution to model terrain in terms of the human domain and improve the results and rigor of the traditional wargaming process.
Evidence-based effectiveness of vaccination against Mannheimia haemolytica, Pasteurella multocida, and Histophilus somni in feedlot cattle for mitigating the incidence and effect of bovine respiratory disease complex.

PubMed

Larson, R L; Step, D L

2012-03-01

Bovine respiratory disease complex is the leading cause of morbidity and mortality in feedlot cattle. A number of vaccines against bacterial respiratory pathogens are commercially available and researchers have studied their impact on morbidity, mortality, and other disease outcome measures in feedlot cattle. A systematic review will provide veterinarians with a rigorous and transparent evaluation of the published literature to estimate the extent of vaccine effect. Unfortunately, the published body of evidence does not provide a consistent estimate of the direction and magnitude of effectiveness in feedlot cattle vaccination against Mannheimia haemolytica, Pasteurella multocida, or Histophilus somni.
Experimental evaluation of rigor mortis IX. The influence of the breaking (mechanical solution) on the development of rigor mortis.

PubMed

Krompecher, Thomas; Gilles, André; Brandt-Casadevall, Conception; Mangin, Patrice

2008-04-07

Objective measurements were carried out to study the possible re-establishment of rigor mortis on rats after "breaking" (mechanical solution). Our experiments showed that: *Cadaveric rigidity can re-establish after breaking. *A significant rigidity can reappear if the breaking occurs before the process is complete. *Rigidity will be considerably weaker after the breaking. *The time course of the intensity does not change in comparison to the controls: --the re-establishment begins immediately after the breaking; --maximal values are reached at the same time as in the controls; --the course of the resolution is the same as in the controls.

Improving Baseline Model Assumptions: Evaluating the Impacts of Typical Methodological Approaches in Watershed Models

NASA Astrophysics Data System (ADS)

Muenich, R. L.; Kalcic, M. M.; Teshager, A. D.; Long, C. M.; Wang, Y. C.; Scavia, D.

2017-12-01

Thanks to the availability of open-source software, online tutorials, and advanced software capabilities, watershed modeling has expanded its user-base and applications significantly in the past thirty years. Even complicated models like the Soil and Water Assessment Tool (SWAT) are being used and documented in hundreds of peer-reviewed publications each year, and likely more applied in practice. These models can help improve our understanding of present, past, and future conditions, or analyze important "what-if" management scenarios. However, baseline data and methods are often adopted and applied without rigorous testing. In multiple collaborative projects, we have evaluated the influence of some of these common approaches on model results. Specifically, we examined impacts of baseline data and assumptions involved in manure application, combined sewer overflows, and climate data incorporation across multiple watersheds in the Western Lake Erie Basin. In these efforts, we seek to understand the impact of using typical modeling data and assumptions, versus using improved data and enhanced assumptions on model outcomes and thus ultimately, study conclusions. We provide guidance for modelers as they adopt and apply data and models for their specific study region. While it is difficult to quantitatively assess the full uncertainty surrounding model input data and assumptions, recognizing the impacts of model input choices is important when considering actions at the both the field and watershed scales.
Impacts of the Boston Prekindergarten Program on the School Readiness of Young Children with Special Needs

ERIC Educational Resources Information Center

Weiland, Christina

2016-01-01

Theory and empirical work suggest inclusion preschool improves the school readiness of young children with special needs, but only 2 studies of the model have used rigorous designs that could identify causality. The present study examined the impacts of the Boston Public prekindergarten program-which combined proven language, literacy, and…
Invasive forest pests: trends and impacts

Treesearch

Deborah G. McCullough

2011-01-01

Non-native forest insects and pathogens affect a variety of forest and urban settings across the U.S., and introductions are likely to continue as global trade and travel expand. Past efforts to assess economic impacts of invasive forest pests have been useful for bringing attention to the issue, but a broad, rigorous cost analysis is critically needed by policymakers...
Modeling technology innovation: how science, engineering, and industry methods can combine to generate beneficial socioeconomic impacts.

PubMed

Stone, Vathsala I; Lane, Joseph P

2012-05-16

Government-sponsored science, technology, and innovation (STI) programs support the socioeconomic aspects of public policies, in addition to expanding the knowledge base. For example, beneficial healthcare services and devices are expected to result from investments in research and development (R&D) programs, which assume a causal link to commercial innovation. Such programs are increasingly held accountable for evidence of impact-that is, innovative goods and services resulting from R&D activity. However, the absence of comprehensive models and metrics skews evidence gathering toward bibliometrics about research outputs (published discoveries), with less focus on transfer metrics about development outputs (patented prototypes) and almost none on econometrics related to production outputs (commercial innovations). This disparity is particularly problematic for the expressed intent of such programs, as most measurable socioeconomic benefits result from the last category of outputs. This paper proposes a conceptual framework integrating all three knowledge-generating methods into a logic model, useful for planning, obtaining, and measuring the intended beneficial impacts through the implementation of knowledge in practice. Additionally, the integration of the Context-Input-Process-Product (CIPP) model of evaluation proactively builds relevance into STI policies and programs while sustaining rigor. The resulting logic model framework explicitly traces the progress of knowledge from inputs, following it through the three knowledge-generating processes and their respective knowledge outputs (discovery, invention, innovation), as it generates the intended socio-beneficial impacts. It is a hybrid model for generating technology-based innovations, where best practices in new product development merge with a widely accepted knowledge-translation approach. Given the emphasis on evidence-based practice in the medical and health fields and "bench to bedside" expectations for knowledge transfer, sponsors and grantees alike should find the model useful for planning, implementing, and evaluating innovation processes. High-cost/high-risk industries like healthcare require the market deployment of technology-based innovations to improve domestic society in a global economy. An appropriate balance of relevance and rigor in research, development, and production is crucial to optimize the return on public investment in such programs. The technology-innovation process needs a comprehensive operational model to effectively allocate public funds and thereby deliberately and systematically accomplish socioeconomic benefits.
Impact of conditional cash transfers on maternal and newborn health.

PubMed

Glassman, Amanda; Duran, Denizhan; Fleisher, Lisa; Singer, Daniel; Sturke, Rachel; Angeles, Gustavo; Charles, Jodi; Emrey, Bob; Gleason, Joanne; Mwebsa, Winnie; Saldana, Kelly; Yarrow, Kristina; Koblinsky, Marge

2013-12-01

Maternal and newborn health (MNH) is a high priority for global health and is included among the Millennium Development Goals (MDGs). However, the slow decline in maternal and newborn mortality jeopardizes achievements of the targets of MDGs. According to UNICEF, 60 million women give birth outside of health facilities, and family planning needs are satisfied for only 50%. Further, skilled birth attendance and the use of antenatal care are most inequitably distributed in maternal and newborn health interventions in low- and middle-income countries. Conditional cash transfer (CCT) programmes have been shown to increase health service utilization among the poorest but little is written on the effects of such programmes on maternal and newborn health. We carried out a systematic review of studies on CCT that report maternal and newborn health outcomes, including studies from 8 countries. The CCT programmes have increased antenatal visits, skilled attendance at birth, delivery at a health facility, and tetanus toxoid vaccination for mothers and reduced the incidence of low birthweight. The programmes have not had a significant impact on fertility while the impact on maternal and newborn mortality has not been well-documented thus far. Given these positive effects, we make the case for further investment in CCT programmes for maternal and newborn health, noting gaps in knowledge and providing recommendations for better design and evaluation of such programmes. We recommend more rigorous impact evaluations that document impact pathways and take factors, such as cost-effectiveness, into account.
Biofuels: Network Analysis of the Literature Reveals Key Environmental and Economic Unknowns

PubMed Central

2012-01-01

Despite rapid growth in biofuel production worldwide, it is uncertain whether decision-makers possess sufficient information to fully evaluate the impacts of the industry and avoid unintended consequences. Doing so requires rigorous peer-reviewed data and analyses across the entire range of direct and indirect effects. To assess the coverage of scientific research, we analyzed over 1600 peer-reviewed articles published between 2000 and 2009 that addressed 23 biofuels-related topics within four thematic areas: environment and human well-being, economics, technology, and geography. Greenhouse gases, fuel production, and feedstock production were well-represented in the literature, while trade, biodiversity, and human health were not. Gaps were especially striking across topics in the Southern Hemisphere, where the greatest potential socio-economic benefits, as well as environmental damages, may co-occur. There was strong asymmetry in the connectedness of research topics; greenhouse gases articles were twice as often connected to other topics as biodiversity articles. This could undermine the ability of scientific and economic analyses to adequately evaluate impacts and avoid significant unintended consequences. At the least, our review suggests caution in this developing industry and the need to pursue more interdisciplinary research to assess complex trade-offs and feedbacks inherent to an industry with wide-reaching potential impacts. PMID:22229835
Impact of peer delivered wellness coaching.

PubMed

Swarbrick, Margaret; Gill, Kenneth J; Pratt, Carlos W

2016-09-01

People receiving publicly funded behavioral health services for severe mental disorders have shorter lifespans and significantly impaired health-related quality of life compared to the general population. The aim of this article was to explore how peer wellness coaching (PWC), a manualized approach to pursue specific physical wellness goals, impacted goal attainment and overall health related quality of life. Deidentified archival program evaluation data were examined to explore whether peer delivered wellness coaching had an impact on 33 service recipients with regard to goal attainment and health-related quality of life. Participants were served by 1 of 12 wellness coach trainees from a transformation transfer initiative grant who had been trained in the manualized approach. Coaching participants and their coaches reported significant progress toward the attainment of individually chosen goals, 2 to 4 weeks after establishing their goals. After 8 to 10 weeks of peer delivered wellness coaching, improvements were evident in the self-report of physical health, general health, and perceived health. These improvements were sustained 90 days later. PWC is potentially a promising practice for helping people choose and pursue individual goals and facilitating positive health and wellness changes. Rigorous controlled research with larger samples is needed to evaluate the benefits of peer delivered wellness coaching. (PsycINFO Database Record (c) 2016 APA, all rights reserved).
Circular instead of hierarchical: methodological principles for the evaluation of complex interventions

PubMed Central

Walach, Harald; Falkenberg, Torkel; Fønnebø, Vinjar; Lewith, George; Jonas, Wayne B

2006-01-01

Background The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery). Discussion The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability). Summary Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform. PMID:16796762
Rigor or Reliability and Validity in Qualitative Research: Perspectives, Strategies, Reconceptualization, and Recommendations.

PubMed

Cypress, Brigitte S

Issues are still raised even now in the 21st century by the persistent concern with achieving rigor in qualitative research. There is also a continuing debate about the analogous terms reliability and validity in naturalistic inquiries as opposed to quantitative investigations. This article presents the concept of rigor in qualitative research using a phenomenological study as an exemplar to further illustrate the process. Elaborating on epistemological and theoretical conceptualizations by Lincoln and Guba, strategies congruent with qualitative perspective for ensuring validity to establish the credibility of the study are described. A synthesis of the historical development of validity criteria evident in the literature during the years is explored. Recommendations are made for use of the term rigor instead of trustworthiness and the reconceptualization and renewed use of the concept of reliability and validity in qualitative research, that strategies for ensuring rigor must be built into the qualitative research process rather than evaluated only after the inquiry, and that qualitative researchers and students alike must be proactive and take responsibility in ensuring the rigor of a research study. The insights garnered here will move novice researchers and doctoral students to a better conceptual grasp of the complexity of reliability and validity and its ramifications for qualitative inquiry.
How Quality Improvement Practice Evidence Can Advance the Knowledge Base.

PubMed

OʼRourke, Hannah M; Fraser, Kimberly D

2016-01-01

Recommendations for the evaluation of quality improvement interventions have been made in order to improve the evidence base of whether, to what extent, and why quality improvement interventions affect chosen outcomes. The purpose of this article is to articulate why these recommendations are appropriate to improve the rigor of quality improvement intervention evaluation as a research endeavor, but inappropriate for the purposes of everyday quality improvement practice. To support our claim, we describe the differences between quality improvement interventions that occur for the purpose of practice as compared to research. We then carefully consider how feasibility, ethics, and the aims of evaluation each impact how quality improvement interventions that occur in practice, as opposed to research, can or should be evaluated. Recommendations that fit the evaluative goals of practice-based quality improvement interventions are needed to support fair appraisal of the distinct evidence they produce. We describe a current debate on the nature of evidence to assist in reenvisioning how quality improvement evidence generated from practice might complement that generated from research, and contribute in a value-added way to the knowledge base.
Biosciences within the pre-registration (pre-requisite) curriculum: an integrative literature review of curriculum interventions 1990-2012.

PubMed

McVicar, Andrew; Andrew, Sharon; Kemble, Ross

2014-04-01

The learning of biosciences is well-documented to be problematic as students find the subjects amongst the most difficult and anxiety-provoking of their pre-registration programme. Studies suggest that learning consequently is not at the level anticipated by the profession. Curriculum innovations might improve the situation but the effectiveness of applied interventions has not been evaluated. To undertake an integrative review and narrative synthesis of curriculum interventions and evaluate their effect on the learning of biosciences by pre-registration student nurses. Review methods A systematic search of electronic databases CINAHL, Medline, British Nursing Index and Google Scholar for empirical research studies was designed to evaluate the introduction of a curriculum intervention related to the biosciences, published in 1990-2012. Studies were evaluated for design, receptivity of the intervention and impact on bioscience learning. The search generated fourteen papers that met inclusion criteria. Seven studies introduced on-line learning packages, five an active learning format into classroom teaching or practical sessions, and two applied Audience Response Technology as an exercise in self-testing and reflection. Almost all studies reported a high level of student satisfaction, though in some there were access/utilization issues for students using on-line learning. Self-reporting suggested positive experiences, but objective evaluation suggests that impacts on learning were variable and unconvincing even where an effect on course progress was identified. Adjunct on-line programmes also show promise for supporting basic science or language acquisition. Published studies of curriculum interventions, including on-line support, have focused too heavily on the perceived benefit to students rather than objective measures of impact on actual learning. Future studies should include rigorous assessment evaluations within their design if interventions are to be adopted to reduce the 'bioscience problem'. © 2013.
Estimation of the time since death--reconsidering the re-establishment of rigor mortis.

PubMed

Anders, Sven; Kunz, Michaela; Gehl, Axel; Sehner, Susanne; Raupach, Tobias; Beck-Bornholdt, Hans-Peter

2013-01-01

In forensic medicine, there is an undefined data background for the phenomenon of re-establishment of rigor mortis after mechanical loosening, a method used in establishing time since death in forensic casework that is thought to occur up to 8 h post-mortem. Nevertheless, the method is widely described in textbooks on forensic medicine. We examined 314 joints (elbow and knee) of 79 deceased at defined time points up to 21 h post-mortem (hpm). Data were analysed using a random intercept model. Here, we show that re-establishment occurred in 38.5% of joints at 7.5 to 19 hpm. Therefore, the maximum time span for the re-establishment of rigor mortis appears to be 2.5-fold longer than thought so far. These findings have major impact on the estimation of time since death in forensic casework.
Evidence-based evolution of an integrated nutrition-focused agriculture approach to address the underlying determinants of stunting.

PubMed

Haselow, Nancy J; Stormer, Ame; Pries, Alissa

2016-05-01

Despite progress in reducing hunger and malnutrition since the 1990s, many still suffer from undernutrition and food insecurity, particularly women and young children, resulting in preterm birth, low birthweight and stunting, among other conditions. Helen Keller International (HKI) has addressed malnutrition and household food insecurity through implementation of an Enhanced Homestead Food Production (EHFP) programme that increases year-round availability and intake of diverse micronutrient-rich foods and promotes optimal nutrition and hygiene practices among poor households. This paper reviews the evolution and impact of HKI's EHFP programme and identifies core components of the model that address the underlying determinants of stunting. To date, evaluations of EHFP have shown impact on food production, consumption by women and children and household food security. Sale of surplus produce has increased household income, and the use of a transformative gender approach has empowered women. EHFP has also realized nutrition improvements in many project sites. Results from a randomized control trial (RCT) in Baitadi district, Nepal showed a significant improvement in a range of practices known to impact child growth, although no impact on stunting. Additional non-RCT evaluations in Kailali district of Nepal, demonstrated a 10.5% reduction in stunting and in the Chittagong Hill Tracts in Bangladesh, revealed an 18% decrease in stunting. Based on evidence, the EHFP has evolved into an integrated package that includes agriculture, nutrition, water/hygiene/sanitation, linkages to health care, women's empowerment, income generation and advocacy. Closing the stunting gap requires long-term exposure to targeted multi-sectoral solutions and rigorous evaluation to optimize impact. © 2016 The Authors. Maternal & Child Nutrition published by John Wiley & Sons Ltd.
Impact of a rural solar electrification project on the level and structure of women’s empowerment

NASA Astrophysics Data System (ADS)

Burney, Jennifer; Alaofè, Halimatou; Naylor, Rosamond; Taren, Douglas

2017-09-01

Although development organizations agree that reliable access to energy and energy services—one of the 17 Sustainable Development Goals—is likely to have profound and perhaps disproportionate impacts on women, few studies have directly empirically estimated the impact of energy access on women’s empowerment. This is a result of both a relative dearth of energy access evaluations in general and a lack of clarity on how to quantify gender impacts of development projects. Here we present an evaluation of the impacts of the Solar Market Garden—a distributed photovoltaic irrigation project—on the level and structure of women’s empowerment in Benin, West Africa. We use a quasi-experimental design (matched-pair villages) to estimate changes in empowerment for project beneficiaries after one year of Solar Market Garden production relative to non-beneficiaries in both treatment and comparison villages (n = 771). To create an empowerment metric, we constructed a set of general questions based on existing theories of empowerment, and then used latent variable analysis to understand the underlying structure of empowerment locally. We repeated this analysis at follow-up to understand whether the structure of empowerment had changed over time, and then measured changes in both the levels and likelihood of empowerment over time. We show that the Solar Market Garden significantly positively impacted women’s empowerment, particularly through the domain of economic independence. In addition to providing rigorous evidence for the impact of a rural renewable energy project on women’s empowerment, our work lays out a methodology that can be used in the future to benchmark the gender impacts of energy projects.
Measuring impact of protected area management interventions: current and future use of the Global Database of Protected Area Management Effectiveness

PubMed Central

Coad, Lauren; Leverington, Fiona; Knights, Kathryn; Geldmann, Jonas; Eassom, April; Kapos, Valerie; Kingston, Naomi; de Lima, Marcelo; Zamora, Camilo; Cuardros, Ivon; Nolte, Christoph; Burgess, Neil D.; Hockings, Marc

2015-01-01

Protected areas (PAs) are at the forefront of conservation efforts, and yet despite considerable progress towards the global target of having 17% of the world's land area within protected areas by 2020, biodiversity continues to decline. The discrepancy between increasing PA coverage and negative biodiversity trends has resulted in renewed efforts to enhance PA effectiveness. The global conservation community has conducted thousands of assessments of protected area management effectiveness (PAME), and interest in the use of these data to help measure the conservation impact of PA management interventions is high. Here, we summarize the status of PAME assessment, review the published evidence for a link between PAME assessment results and the conservation impacts of PAs, and discuss the limitations and future use of PAME data in measuring the impact of PA management interventions on conservation outcomes. We conclude that PAME data, while designed as a tool for local adaptive management, may also help to provide insights into the impact of PA management interventions from the local-to-global scale. However, the subjective and ordinal characteristics of the data present significant limitations for their application in rigorous scientific impact evaluations, a problem that should be recognized and mitigated where possible. PMID:26460133
The influence of low temperature, type of muscle and electrical stimulation on the course of rigor mortis, ageing and tenderness of beef muscles.

PubMed

Olsson, U; Hertzman, C; Tornberg, E

1994-01-01

The course of rigor mortis, ageing and tenderness have been evaluated for two beef muscles, M. semimembranosus (SM) and M. longissimus dorsi (LD), when entering rigor at constant temperatures in the cold-shortening region (1, 4, 7 and 10°C). The influence of electrical stimulation (ES) was also examined. Post-mortem changes were registered by shortening and isometric tension and by following the decline of pH, ATP and creatine phosphate. The effect of ageing on tenderness was recorded by measuring shear-force (2, 8 and 15 days post mortem) and the sensory properties were assessed 15 days post mortem. It was found that shortening increased with decreasing temperature, resulting in decreased tenderness. Tenderness for LD, but not for SM, was improved by ES at 1 and 4°C, whereas ES did not give rise to any decrease in the degree of shortening during rigor mortis development. This suggests that ES influences tenderization more than it prevents cold-shortening. The samples with a pre-rigor mortis temperature of 1°C could not be tenderized, when stored up to 15 days, whereas this was the case for the muscles entering rigor mortis at the other higher temperatures. The results show that under the conditions used in this study, the course of rigor mortis is more important for the ultimate tenderness than the course of ageing. Copyright © 1994. Published by Elsevier Ltd.
Rigor in electronic health record knowledge representation: Lessons learned from a SNOMED CT clinical content encoding exercise.

PubMed

Monsen, Karen A; Finn, Robert S; Fleming, Thea E; Garner, Erin J; LaValla, Amy J; Riemer, Judith G

2016-01-01

Rigor in clinical knowledge representation is necessary foundation for meaningful interoperability, exchange and reuse of electronic health record (EHR) data. It is critical for clinicians to understand principles and implications of using clinical standards for knowledge representation within EHRs. To educate clinicians and students about knowledge representation and to evaluate their success of applying the manual lookups method for assigning Systematized Nomenclature of Medicine Clinical Terms (SNOMED CT) concept identifiers using formally mapped concepts from the Omaha System interface terminology. Clinicians who were students in a doctoral nursing program conducted 21 lookups for Omaha System terms in publicly available SNOMED CT browsers. Lookups were deemed successful if results matched exactly with the corresponding code from the January 2013 SNOMED CT-Omaha System terminology cross-map. Of the 21 manual lookups attempted, 12 (57.1%) were successful. Errors were due to semantic gaps differences in granularity and synonymy or partial term matching. Achieving rigor in clinical knowledge representation across settings, vendors and health systems is a globally recognized challenge. Cross-maps have potential to improve rigor in SNOMED CT encoding of clinical data. Further research is needed to evaluate outcomes of using of terminology cross-maps to encode clinical terms with SNOMED CT concept identifiers based on interface terminologies.
Supported education for individuals with psychiatric disabilities: State of the practice and policy implications.

PubMed

Ringeisen, Heather; Langer Ellison, Marsha; Ryder-Burge, Amy; Biebel, Kathleen; Alikhan, Shums; Jones, Emily

2017-06-01

Supported education (SEd) is a promising practice that supports and encourages educational goals and attainment among individuals with psychiatric disabilities. This paper provides insights into how SEd objectives are pursued in different settings, assesses the evidence base, and discusses policy implications. Insights from 3 data sources were synthesized: published literature, an environmental scan, and 3 site visits to programs that support the education goals of individuals with psychiatric disabilities. While setting, target populations, level of coordination with supported employment, and financing strategies varied, common SEd components emerged: specialized and dedicated staffing, one-on-one and group skill-building activities, assistance with navigating the academic setting and coordinating different services, and linkages with mental health counseling. The evidence base is growing; however, many published studies to date do not employ rigorous methodology. Conclusions and Implications for Policy and Practice: Continued specification, operationalization, and testing of SEd core components are needed. The components of the evolving SEd model would benefit from rigorous testing to evaluate impact on degree completion and other key impacts such as employment; health, mental health, or recovery; and community participation. In addition to funding streams from special education and Medicaid, new opportunities for increasing the availability of SEd include the Workforce Innovation and Opportunities Act (WIOA) reauthorization, which requires state vocational rehabilitation agencies to fund preemployment services for transition-age individuals. New "set-aside" requirements for the Mental Health Services Block Grant will increase funding for early intervention services for individuals with serious mental illness, potentially including SEd. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Green Marine: An environmental program to establish sustainability in marine transportation.

PubMed

Walker, Tony R

2016-04-15

European maritime companies have adopted programs to limit operational impacts on the environment. For maritime companies in North America, the Green Marine Environmental Program (GMEP) offers a framework to establish and reduce environmental footprints. Green Marine (GM) participants demonstrate annual improvements of specific environmental performance indicators (e.g., reductions in air pollution emissions) to maintain certification. Participants complete annual self-evaluations with results determining rankings for performance indicators on a 1-to-5 scale. Self-evaluations are independently verified every two years to ensure rigor and individual results are made publicly available annually to achieve transparency. GM benefits the marine industry across North America by encouraging sustainable development initiatives. GM's credibility is reflected through a diverse network of environmental groups and government agencies that endorse and help shape the program. Merits of this relatively new maritime certification (not previously described in the academic literature), are discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.
[Computer-assisted cardiovascular disease management: better implementation of care but no improvement in clinical outcomes].

PubMed

de Wit, Niek J

2012-01-01

Computer support is considered by many to be a promising strategy for improving healthcare interventions, especially in the management of chronic diseases. So far, however, evidence of the effectiveness of ICT support in healthcare is limited. Recently, computer-supported cardiovascular disease management was compared with usual care during an RCT comprised of 1100 primary care patients. This trial demonstrated that neither the clinical outcome nor the cardiovascular morbidity rate improved, even though management of the risk factors improved over 1 year of follow-up. The pragmatic design of the RCT in daily general practice may have restricted implementing the computer support, and may also have hampered the evaluation of the cardiovascular effects. The results demonstrate that although computer support may help improve the performance of disease management, its impact on disease outcomes is questionable. ICT innovations in healthcare require rigorous investigative evaluation before their implementation in daily practice can be justified.

What Works in Developing Nations to Get Children into School or Keep Them There?: A Systematic Review of Rigorous Impact Studies

ERIC Educational Resources Information Center

Petrosino, Anthony; Morgan, Claire; Fronius, Trevor; Tanner-Smith, Emily E.; Boruch, Robert F.

2015-01-01

Due to evidence linking education and development, funding has been invested in interventions relevant to getting youth into school and keeping them there. This article reports on a systematic review of impact studies of these school enrollment interventions. Reports were identified through electronic searches of bibliographic databases and other…
A review of the evaluation of 47 drug abuse prevention curricula available nationally.

PubMed

Dusenbury, L; Falco, M; Lake, A

1997-04-01

This review determined how many drug prevention curricula available to schools have been shown in rigorous research studies to reduce substance use behavior. Forty-seven curricula which met the following criteria were included: 1) they focused on primary prevention of alcohol and/or drug use, 2) they were classroom-based curricula designed for any grade level P-12, 3) they were nationally and currently available, and 4) program distributors were willing to provide samples of curriculum materials to determine drug abuse prevention content. Of the 47 drug abuse prevention curricula identified, 10 (21%) had been subjected to sufficiently rigorous evaluations. At least eight of the 10 programs have been shown effective at reducing tobacco or drug use, in at least some studies. The remaining two programs did not appear to have sustained effects on drug use, although they had variable success at reducing substance use early on. One of the 10 programs has been shown to have positive effects lasting into young adulthood. Six of the 10 curricula have been shown to have effects lasting for at least two years after the pretest. Two curricula have not been evaluated beyond the post-test, so it is impossible to know whether their effectiveness will last. Recommendations to increase the number of programs rigorously evaluated are offered.
Low-intensity case management increases contact with primary care in recently released prisoners: a single-blinded, multisite, randomised controlled trial

PubMed Central

Alati, Rosa; Longo, Marie; Spittal, Matthew J; Boyle, Frances M; Williams, Gail M; Lennox, Nicholas G

2016-01-01

Background The world prison population is large and growing. Poor health outcomes after release from prison are common, but few programmes to improve health outcomes for ex-prisoners have been rigorously evaluated. The aim of this study was to evaluate the impact of individualised case management on contact with health services during the first 6 months post-release. Methods Single-blinded, randomised, controlled trial. Baseline assessment with N=1325 adult prisoners in Queensland, Australia, within 6 weeks of expected release; follow-up interviews 1, 3 and 6 months post-release. The intervention consisted of provision of a personalised booklet (‘Passport’) at the time of release, plus up to four brief telephone contacts in the first 4 weeks post-release. Results Of 1179 eligible participants, 1003 (85%) completed ≥1 follow-up interview. In intention-to-treat analyses, 53% of the intervention group and 41% of the control group reported contacting a general practitioner (GP) at 1 month post-release (difference=12%, 95% CI 5% to 19%). Similar effects were observed for GP contact at 3 months (difference=9%, 95% CI 2% to 16%) and 6 months (difference=8%, 95% CI 1% to 15%), and for mental health (MH) service contact at 6 months post release (difference=8%, 95% CI 3% to 14%). Conclusions Individualised case management in the month after release from prison increases usage of primary care and MH services in adult ex-prisoners for at least 6 months post-release. Given the poor health profile of ex-prisoners, there remains an urgent need to develop and rigorously evaluate interventions to increase health service contact in this profoundly marginalised population. Trial registration number ACTRN12608000232336. PMID:26787201
Nurse and midwifery education and intimate partner violence: a scoping review.

PubMed

Crombie, Nerissa; Hooker, Leesa; Reisenhofer, Sonia

2017-08-01

This scoping review aims to identify the scope of current literature considering nurse/midwife educational practices in the areas of intimate partner violence to inform future nursing/midwifery educational policy and practice. Intimate partner violence is a global issue affecting a significant portion of the community. Healthcare professionals including nurses/midwives in hospital- and community-based environments are likely to encounter affected women and need educational strategies that support best practice and promote positive outcomes for abused women and their families. Scoping review of relevant literature from January 2000 to July 2015. Search of databases: CINHAL, MEDLINE, EMBASE, PROQUEST Central and COCHRANE Library. Reference lists from included articles were searched for relevant literature as were several grey literature sources. This review demonstrates low levels of undergraduate or postregistration intimate partner violence education for nursing/midwifery staff and students. Existing intimate partner violence education strategies are varied in implementation, method and content. Outcomes of these educational programmes are not always rigorously evaluated for staff or client-based outcomes. Further research is needed to evaluate existing intimate partner violence education programmes for nurses/midwives and identify the most effective strategies to promote improved clinical practice and outcomes for abused women and their families. Intimate partner violence has a significant social and public health impact. The World Health Organization has identified the need to ensure that healthcare professionals are adequately trained to meet the needs of abused women. Intimate partner violence education programmes, commencing at undergraduate studies for nurses/midwives, need to be implemented with rigorously evaluated programmes to ensure they meet identified objectives, promote best practice and improve care for abused women. © 2016 John Wiley & Sons Ltd.
Study Protocol: Evaluation of a DVD intervention designed to meet the informaton needs of patients with head and neck cancer and their partner, carer and families.

PubMed

Parker, Vicki; Bennett, Leearna; Bellamy, Douglas; Britton, Benjamin; Lambert, Sylvia

2016-11-22

Patients who undergo surgery for cancer of the head and neck and their families face complex and difficult challenges and are at risk of anxiety and depression and inability to cope with symptom and treatment burden. Information available to support them is not flexible enough to adjust to individual need. A randomised clinical trial pre and post intervention design, comparing the use of a tailored DVD intervention, provided preoperatively and used throughout the post- operative period, with usual treatment. One hundred fifty-six individuals or partner couples will be randomly recruited into either the intervention or control group. A survey will be administered at three time points, preoperatively, post operatively and 3 months post-surgery. Anxiety and empowerment are the primary outcome measures. Qualitative data about use of the resource will be gathered by phone interview. This is the first study to rigorously evaluate the impact of a DVD intervention for this group of patients and their family members. The study will help to understand the impact of information usage on patient and family well- being and test a means by which to evaluate information and education resources for this and other cancer patient groups. ACTRN12614001104640 . Date registered: 17/10/2014.
Critical Analysis of Strategies for Determining Rigor in Qualitative Inquiry.

PubMed

Morse, Janice M

2015-09-01

Criteria for determining the trustworthiness of qualitative research were introduced by Guba and Lincoln in the 1980s when they replaced terminology for achieving rigor, reliability, validity, and generalizability with dependability, credibility, and transferability. Strategies for achieving trustworthiness were also introduced. This landmark contribution to qualitative research remains in use today, with only minor modifications in format. Despite the significance of this contribution over the past four decades, the strategies recommended to achieve trustworthiness have not been critically examined. Recommendations for where, why, and how to use these strategies have not been developed, and how well they achieve their intended goal has not been examined. We do not know, for example, what impact these strategies have on the completed research. In this article, I critique these strategies. I recommend that qualitative researchers return to the terminology of social sciences, using rigor, reliability, validity, and generalizability. I then make recommendations for the appropriate use of the strategies recommended to achieve rigor: prolonged engagement, persistent observation, and thick, rich description; inter-rater reliability, negative case analysis; peer review or debriefing; clarifying researcher bias; member checking; external audits; and triangulation. © The Author(s) 2015.
Accelerating Biomedical Discoveries through Rigor and Transparency.

PubMed

Hewitt, Judith A; Brown, Liliana L; Murphy, Stephanie J; Grieder, Franziska; Silberberg, Shai D

2017-07-01

Difficulties in reproducing published research findings have garnered a lot of press in recent years. As a funder of biomedical research, the National Institutes of Health (NIH) has taken measures to address underlying causes of low reproducibility. Extensive deliberations resulted in a policy, released in 2015, to enhance reproducibility through rigor and transparency. We briefly explain what led to the policy, describe its elements, provide examples and resources for the biomedical research community, and discuss the potential impact of the policy on translatability with a focus on research using animal models. Importantly, while increased attention to rigor and transparency may lead to an increase in the number of laboratory animals used in the near term, it will lead to more efficient and productive use of such resources in the long run. The translational value of animal studies will be improved through more rigorous assessment of experimental variables and data, leading to better assessments of the translational potential of animal models, for the benefit of the research community and society. Published by Oxford University Press on behalf of the Institute for Laboratory Animal Research 2017. This work is written by (a) US Government employee(s) and is in the public domain in the US.
The unique effects of environmental strategies in health promotion campaigns: a review.

PubMed

Randolph, Karen A; Whitaker, Pippin; Arellano, Adriana

2012-08-01

Various strategies are used as tools in health promotion campaigns to increase health-related outcomes among target populations. Evaluations of these campaigns examine effects on changing people's knowledge, attitudes, and/or behaviors. Most evaluations examine the combined impact of multiple strategies. Less is known about the unique effects of particular strategies. To address this gap, we used highly systematic methods to identify and review scientifically rigorous evaluations of 18 campaigns that examined the unique effects of three sets of intervention strategies (entertainment education, law enforcement, and mass media) on changes in knowledge, attitudes, and practice with regard to various health behaviors. Results showed differences in evaluation processes based on the type of strategy used to promote campaign messages. For instance, evaluations of mass-media based campaigns were more likely to examine changes in knowledge, relative to evaluations of campaigns that used law enforcement strategies. In addition, campaign effects varied by particular strategies. Mass media-based campaigns were more likely to affect knowledge, relative to behaviors. Law enforcement and entertainment education-based campaigns showed positive effects on behaviors. The implications for planning and evaluating health promotion campaigns are described. Copyright © 2012 Elsevier Ltd. All rights reserved.
Early rigorous control interventions can largely reduce dengue outbreak magnitude: experience from Chaozhou, China.

PubMed

Liu, Tao; Zhu, Guanghu; He, Jianfeng; Song, Tie; Zhang, Meng; Lin, Hualiang; Xiao, Jianpeng; Zeng, Weilin; Li, Xing; Li, Zhihao; Xie, Runsheng; Zhong, Haojie; Wu, Xiaocheng; Hu, Wenbiao; Zhang, Yonghui; Ma, Wenjun

2017-08-02

Dengue fever is a severe public heath challenge in south China. A dengue outbreak was reported in Chaozhou city, China in 2015. Intensified interventions were implemented by the government to control the epidemic. However, it is still unknown the degree to which intensified control measures reduced the size of the epidemics, and when should such measures be initiated to reduce the risk of large dengue outbreaks developing? We selected Xiangqiao district as study setting because the majority of the indigenous cases (90.6%) in Chaozhou city were from this district. The numbers of daily indigenous dengue cases in 2015 were collected through the national infectious diseases and vectors surveillance system, and daily Breteau Index (BI) data were reported by local public health department. We used a compartmental dynamic SEIR (Susceptible, Exposed, Infected and Removed) model to assess the effectiveness of control interventions, and evaluate the control effect of intervention timing on dengue epidemic. A total of 1250 indigenous dengue cases was reported from Xiangqiao district. The results of SEIR modeling using BI as an indicator of actual control interventions showed a total of 1255 dengue cases, which is close to the reported number (n = 1250). The size and duration of the outbreak were highly sensitive to the intensity and timing of interventions. The more rigorous and earlier the control interventions implemented, the more effective it yielded. Even if the interventions were initiated several weeks after the onset of the dengue outbreak, the interventions were shown to greatly impact the prevalence and duration of dengue outbreak. This study suggests that early implementation of rigorous dengue interventions can effectively reduce the epidemic size and shorten the epidemic duration.
International approaches to driving under the influence of cannabis: A review of evidence on impact.

PubMed

Watson, Tara Marie; Mann, Robert E

2016-12-01

There are knowledge gaps regarding the effectiveness of different approaches designed to prevent and deter driving under the influence of cannabis (DUIC). Policymakers are increasingly interested in evidence-based responses to DUIC as numerous jurisdictions worldwide have legally regulated cannabis or are debating such regulation. We contribute a comprehensive review of international literature on countermeasures that address DUIC, and identify where and how such measures have been evaluated. The following databases were systematically searched from 1995 to present: Medline, Embase, PsycINFO, CINAHL, Sociological Abstracts, and Criminal Justice Abstracts. Hand searching of relevant documents, internet searches for grey literature, and review of ongoing email alerts were conducted to capture any emerging literature and relevant trends. Numerous international jurisdictions have introduced a variety of measures designed to deter DUIC. Much interest has been generated regarding non-zero per se laws that set fixed legal limits for tetrahydrocannabinol and/or its metabolites detected in drivers. Other approaches include behavioural impairment laws, zero-tolerance per se laws, roadside drug testing, graduated licensing system restrictions, and remedial programs. However, very few evaluations have appeared in the literature. Although some promising results have been reported (e.g., roadside testing), it is premature to draw firm conclusions regarding the broader impacts of general deterrent approaches to DUIC. This review points to the need for a long-term commitment to rigorously evaluate, using multiple methods, the impact of general and specific deterrent DUIC countermeasures. Copyright Â© 2016 Elsevier Ireland Ltd. All rights reserved.
Mathematics interventions for children and adolescents with Down syndrome: a research synthesis.

PubMed

Lemons, C J; Powell, S R; King, S A; Davidson, K A

2015-08-01

Many children and adolescents with Down syndrome fail to achieve proficiency in mathematics. Researchers have suggested that tailoring interventions based on the behavioural phenotype may enhance efficacy. The research questions that guided this review were (1) what types of mathematics interventions have been empirically evaluated with children and adolescents with Down syndrome?; (2) do the studies demonstrate sufficient methodological rigor?; (3) is there evidence of efficacy for the evaluated mathematics interventions?; and (4) to what extent have researchers considered aspects of the behavioural phenotype in selecting, designing and/or implementing mathematics interventions for children and adolescents with Down syndrome? Nine studies published between 1989 and 2012 were identified for inclusion. Interventions predominantly focused on early mathematics skills and reported positive outcomes. However, no study met criteria for methodological rigor. Further, no authors explicitly considered the behavioural phenotype. Additional research using rigorous experimental designs is needed to evaluate the efficacy of mathematics interventions for children and adolescents with Down syndrome. Suggestions for considering the behavioural phenotype in future research are provided. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.
Total focusing method (TFM) robustness to material deviations

NASA Astrophysics Data System (ADS)

Painchaud-April, Guillaume; Badeau, Nicolas; Lepage, Benoit

2018-04-01

The total focusing method (TFM) is becoming an accepted nondestructive evaluation method for industrial inspection. What was a topic of discussion in the applied research community just a few years ago is now being deployed in critical industrial applications, such as inspecting welds in pipelines. However, the method's sensitivity to unexpected parametric changes (material and geometric) has not been rigorously assessed. In this article, we investigate the robustness of TFM in relation to unavoidable deviations from modeled nominal inspection component characteristics, such as sound velocities and uncertainties about the parts' internal and external diameters. We also review TFM's impact on the standard inspection modes often encountered in industrial inspections, and we present a theoretical model supported by empirical observations to illustrate the discussion.
Drug checking: a potential solution to the opioid overdose epidemic?

PubMed

Bardwell, Geoff; Kerr, Thomas

2018-05-25

North America is experiencing an overdose epidemic driven in part by the proliferation of illicitly-manufactured fentanyl and related analogues. In response, communities are scaling up novel overdose prevention interventions. Included are drug checking technologies. Drug checking technologies aim to identify the contents of illicit drugs. These technologies vary considerably in terms of cost, accuracy, and usability, and while efforts are now underway to implement drug checking programs for people who inject drugs, there remains a lack of rigorous evaluation of their impacts. Given the ongoing overdose crisis and the urgent need for effective responses, research on drug checking should be prioritized. However, while such research should be supported, it should be completed before these technologies are widely implemented.
Rigorous evaluation of chemical measurement uncertainty: liquid chromatographic analysis methods using detector response factor calibration

NASA Astrophysics Data System (ADS)

Toman, Blaza; Nelson, Michael A.; Bedner, Mary

2017-06-01

Chemical measurement methods are designed to promote accurate knowledge of a measurand or system. As such, these methods often allow elicitation of latent sources of variability and correlation in experimental data. They typically implement measurement equations that support quantification of effects associated with calibration standards and other known or observed parametric variables. Additionally, multiple samples and calibrants are usually analyzed to assess accuracy of the measurement procedure and repeatability by the analyst. Thus, a realistic assessment of uncertainty for most chemical measurement methods is not purely bottom-up (based on the measurement equation) or top-down (based on the experimental design), but inherently contains elements of both. Confidence in results must be rigorously evaluated for the sources of variability in all of the bottom-up and top-down elements. This type of analysis presents unique challenges due to various statistical correlations among the outputs of measurement equations. One approach is to use a Bayesian hierarchical (BH) model which is intrinsically rigorous, thus making it a straightforward method for use with complex experimental designs, particularly when correlations among data are numerous and difficult to elucidate or explicitly quantify. In simpler cases, careful analysis using GUM Supplement 1 (MC) methods augmented with random effects meta analysis yields similar results to a full BH model analysis. In this article we describe both approaches to rigorous uncertainty evaluation using as examples measurements of 25-hydroxyvitamin D3 in solution reference materials via liquid chromatography with UV absorbance detection (LC-UV) and liquid chromatography mass spectrometric detection using isotope dilution (LC-IDMS).
Bringing a transgenic crop to market: where compositional analysis fits.

PubMed

Privalle, Laura S; Gillikin, Nancy; Wandelt, Christine

2013-09-04

In the process of developing a biotechnology product, thousands of genes and transformation events are evaluated to select the event that will be commercialized. The ideal event is identified on the basis of multiple characteristics including trait efficacy, the molecular characteristics of the insert, and agronomic performance. Once selected, the commercial event is subjected to a rigorous safety evaluation taking a multipronged approach including examination of the safety of the gene and gene product - the protein, plant performance, impact of cultivating the crop on the environment, agronomic performance, and equivalence of the crop/food to conventional crops/food - by compositional analysis. The compositional analysis is composed of a comparison of the nutrient and antinutrient composition of the crop containing the event, its parental line (variety), and other conventional lines (varieties). Different geographies have different requirements for the compositional analysis studies. Parameters that vary include the number of years (seasons) and locations (environments) to be evaluated, the appropriate comparator(s), analytes to be evaluated, and statistical analysis. Specific examples of compositional analysis results will be presented.
The impact ejection of living organisms into space

NASA Technical Reports Server (NTRS)

Melosh, H. J.

1985-01-01

The possibility of natural processes to blast living organisms into space was examined. It is suggested that rocks ejected from the Earth by a giant meteorite or comet impact can carry microorganisms into space. Such microscopic Earth life would have an opportunity to colonize the other planets if it can survive the rigors of space until it falls into the atmosphere of a hospitable planet.
Museums, Zoos, and Gardens: How Formal-Informal Partnerships Can Impact Urban Students' Performance. Working Paper #04-13

ERIC Educational Resources Information Center

Weinstein, Meryle; Whitesell, Emilyn Ruble; Schwartz, Amy Ellen

2013-01-01

In this paper we provide the first rigorous evidence of the impact of a partnership between public middle schools and informal science institutions (ISIs), such as museums and zoos, on student outcomes. This study focuses on Urban Advantage (UA), a program in New York City (NYC) that explicitly draws upon the expertise and resources of the city's…
Methodology, Methods, and Metrics for Testing and Evaluating Augmented Cognition Systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Greitzer, Frank L.

The augmented cognition research community seeks cognitive neuroscience-based solutions to improve warfighter performance by applying and managing mitigation strategies to reduce workload and improve the throughput and quality of decisions. The focus of augmented cognition mitigation research is to define, demonstrate, and exploit neuroscience and behavioral measures that support inferences about the warfighter’s cognitive state that prescribe the nature and timing of mitigation. A research challenge is to develop valid evaluation methodologies, metrics and measures to assess the impact of augmented cognition mitigations. Two considerations are external validity, which is the extent to which the results apply to operational contexts;more » and internal validity, which reflects the reliability of performance measures and the conclusions based on analysis of results. The scientific rigor of the research methodology employed in conducting empirical investigations largely affects the validity of the findings. External validity requirements also compel us to demonstrate operational significance of mitigations. Thus it is important to demonstrate effectiveness of mitigations under specific conditions. This chapter reviews some cognitive science and methodological considerations in designing augmented cognition research studies and associated human performance metrics and analysis methods to assess the impact of augmented cognition mitigations.« less
Teacher Evaluation Reform: Focus, Feedback, and Fear

ERIC Educational Resources Information Center

Donaldson, Morgaen L.

2016-01-01

How are teachers experiencing the more rigorous teacher evaluation systems that many states have mandated in recent years? Donaldson, who has studied teacher evaluation reform over the past eight years, shares insights from a study of 14 Connecticut districts that have implemented the state's 2012 teacher evaluation reforms. In surveys and…
The impacts of livestock diseases and their control on growth and development processes that are pro-poor

PubMed Central

Perry, Brian; Grace, Delia

2009-01-01

Poverty is now at the heart of development discourse; we discuss how it is measured and understood. We next consider the negative and positive impacts of livestock on pro-poor development. Taking a value-chain approach that includes keepers, users and eaters of livestock, we identify diseases that are road blocks on the ‘three livestock pathways out of poverty’. We discuss livestock impacts on poverty reduction and review attempts to prioritize the livestock diseases relevant to the poor. We make suggestions for metrics that better measure disease impact and show the benefits of more rigorous evaluation before reviewing recent attempts to measure the importance of disease to the poor. High impact of a disease does not guarantee high benefits from its control; other factors must be taken into consideration, including technical feasibility and political desirability. We conclude by considering how we might better understand and exploit the roles of livestock and improved animal health by posing three speculative questions on the impact of livestock diseases and their control on global poverty: how can understanding livestock and poverty links help disease control?; if global poverty reduction was the aim of livestock disease control, how would it differ from the current model?; and how much of the impact of livestock disease on poverty is due to disease control policy rather than disease itself? PMID:19687035

A Mathematical Evaluation of the Core Conductor Model

PubMed Central

Clark, John; Plonsey, Robert

1966-01-01

This paper is a mathematical evaluation of the core conductor model where its three dimensionality is taken into account. The problem considered is that of a single, active, unmyelinated nerve fiber situated in an extensive, homogeneous, conducting medium. Expressions for the various core conductor parameters have been derived in a mathematically rigorous manner according to the principles of electromagnetic theory. The purpose of employing mathematical rigor in this study is to bring to light the inherent assumptions of the one dimensional core conductor model, providing a method of evaluating the accuracy of this linear model. Based on the use of synthetic squid axon data, the conclusion of this study is that the linear core conductor model is a good approximation for internal but not external parameters. PMID:5903155
Position Paper: Applying Machine Learning to Software Analysis to Achieve Trusted, Repeatable Scientific Computing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Prowell, Stacy J; Symons, Christopher T

2015-01-01

Producing trusted results from high-performance codes is essential for policy and has significant economic impact. We propose combining rigorous analytical methods with machine learning techniques to achieve the goal of repeatable, trustworthy scientific computing.
75 FR 28287 - Final Plan for Fiscal Year 2010

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-20

... Federal agencies. In keeping with OJJDP's mission, these programs are designed to help strengthen the.../intervention based on sound theory and evaluative literature, which has yet to be evaluated rigorously. OJJDP..., and research and evaluation projects designed to improve juvenile justice systems and delinquency...
76 FR 17654 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-30

... OMB Review; Comment Request Title: Evaluation of Adolescent Pregnancy Prevention Approaches-- First... as part of the Evaluation of Adolescent Pregnancy Prevention Approaches (PPA). PPA is a random assignment evaluation designed to result in rigorous evidence on effective ways to reduce teen pregnancy. The...
Rigorously Assessing Whether the Data Backs the Back School

PubMed Central

Vinh, David T.; Johnson, Craig W.; Phelps, Cynthia L.

2003-01-01

A rigorous between-subjects methodology employing independent random samples and having broad clinical applicability was designed and implemented to evaluate the effectiveness of back safety and patient transfer training interventions for both hospital nurses and nursing assistants. Effects upon self-efficacy, cognitive, and affective measures are assessed for each of three back safety procedures. The design solves the problem of obtaining randomly assigned independent controls where all experimental subjects must participate in the training interventions. PMID:14728544
Optical potential approach to the electron-atom impact ionization threshold problem

NASA Technical Reports Server (NTRS)

Temkin, A.; Hahn, Y.

1973-01-01

The problem of the threshold law for electron-atom impact ionization is reconsidered as an extrapolation of inelastic cross sections through the ionization threshold. The cross sections are evaluated from a distorted wave matrix element, the final state of which describes the scattering from the Nth excited state of the target atom. The actual calculation is carried for the e-H system, and a model is introduced which is shown to preserve the essential properties of the problem while at the same time reducing the dimensionability of the Schrodinger equation. Nevertheless, the scattering equation is still very complex. It is dominated by the optical potential which is expanded in terms of eigen-spectrum of QHQ. It is shown by actual calculation that the lower eigenvalues of this spectrum descend below the relevant inelastic thresholds; it follows rigorously that the optical potential contains repulsive terms. Analytical solutions of the final state wave function are obtained with several approximations of the optical potential.
Comparative Analysis of CNV Calling Algorithms: Literature Survey and a Case Study Using Bovine High-Density SNP Data.

PubMed

Xu, Lingyang; Hou, Yali; Bickhart, Derek M; Song, Jiuzhou; Liu, George E

2013-06-25

Copy number variations (CNVs) are gains and losses of genomic sequence between two individuals of a species when compared to a reference genome. The data from single nucleotide polymorphism (SNP) microarrays are now routinely used for genotyping, but they also can be utilized for copy number detection. Substantial progress has been made in array design and CNV calling algorithms and at least 10 comparison studies in humans have been published to assess them. In this review, we first survey the literature on existing microarray platforms and CNV calling algorithms. We then examine a number of CNV calling tools to evaluate their impacts using bovine high-density SNP data. Large incongruities in the results from different CNV calling tools highlight the need for standardizing array data collection, quality assessment and experimental validation. Only after careful experimental design and rigorous data filtering can the impacts of CNVs on both normal phenotypic variability and disease susceptibility be fully revealed.
Promise and peril: Dissemination of findings from studies of drugs used in pregnancy and their association with birth defects.

PubMed

Patrick, Stephen W; Cooper, William O

2015-08-01

When and how to publish birth defects research can be complex, especially in the context of drugs used in pregnancy. Such research frequently involves multiple stakeholders, including regulatory agencies. Researchers must balance the potential peril of an unnecessarily panicked populace versus the benefit of protecting the public's health. We use a case presentation and contemporary literature to highlight the potential tradeoffs that researchers must consider. We highlight important considerations including the public health impact, examining the likelihood of causality, understanding common considerations when using large data sources, the role of peer review and working in partnership with regulatory agencies. We suggest that plans for analyses, dissemination and risk communication are done best a priori and not post hoc. Rigorous research evaluating the impact of drugs used in pregnancy, coupled with effective dissemination strategies, has the potential improve outcomes for mothers and their infants for generations. © 2015 Wiley Periodicals, Inc.
Career Decision Making and Its Evaluation.

ERIC Educational Resources Information Center

Miller-Tiedeman, Anna

1979-01-01

The author discusses a career decision-making program which she designed and implemented using a pyramidal model of exploration, crystallization, choice, and classification. Her article outlines the value of rigorous evaluation techniques applied by the local practitioner. (MF)
Impact and economic evaluations of a combination prevention programme for men who have sex with men in Mexico.

PubMed

Colchero, M Arantxa; Bautista-Arredondo, Sergio; Cortés-Ortiz, María A; Romero-Martinez, Martín; Salas, Jessica; Sosa-Rubí, Sandra G; Uribe, Patricia

2016-01-01

Despite the high-profile support for combination prevention programmes (CPPs) since 2008, there is little rigorous evidence on their impact and cost-effectiveness. In 2010, Mexico received funds from the Global Fund to implement a series of behavioural, biomedical, and structural interventions over 3 years targeted to men who have sex with men. The aims of the study were to estimate the impact of the programme across a range of outcomes and cost-effectiveness. A quasi-experiment was designed before the implementation of the CPP, in which 24 cities were randomly selected for impact evaluation and 12 pairs of cities were matched. In practice, though, implementation of the programme was staggered over 1 year. Therefore, we used two different approaches to estimate impact: a difference-in-difference estimation comparing both groups and a dose-response approach using time exposure to the programme at the city level. Results from the difference-in-difference estimation showed modest impact on condom use. However, the dose-response findings revealed a 7.5% increase in HIV testing per additional year exposed to the programme, relative to baseline coverage; an increase in awareness of HIV status among HIV-positive individuals of 6.6%; a 6.4% increase in HIV-positive individuals on treatment; and an 8% reduction in the perception of stigma/discrimination from healthcare personnel. The cost per person not exposed to an untreated HIV-positive individual was gauged to be US$400. The study provides evidence of the effectiveness and cost of a CPP along the HIV treatment cascade: access to HIV tests, awareness of HIV status, and antiretroviral therapy initiation.
Evaluating the Flipped Classroom: A Randomized Controlled Trial

ERIC Educational Resources Information Center

Wozny, Nathan; Balser, Cary; Ives, Drew

2018-01-01

Despite recent interest in flipped classrooms, rigorous research evaluating their effectiveness is sparse. In this study, the authors implement a randomized controlled trial to evaluate the effect of a flipped classroom technique relative to a traditional lecture in an introductory undergraduate econometrics course. Random assignment enables the…
A Psychometric Evaluation of the Digital Logic Concept Inventory

ERIC Educational Resources Information Center

Herman, Geoffrey L.; Zilles, Craig; Loui, Michael C.

2014-01-01

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric…
THE IMPACT OF SOCIAL CAPITAL ON ENVIRONMENTAL RISK REDUCTION IN MONCURE

EPA Science Inventory

Despite rigorous efforts to understand and resolve environmental justice (EJ) issues, the complexity of the issues associated with many of these EJ communities continues to bring challenges to community residents and environmental researchers. Moncure, NC, located in northern Cha...
Research on the Impact of School Facilities on Students and Teachers: A Summary of Studies Published since 2000

ERIC Educational Resources Information Center

21st Century School Fund, 2009

2009-01-01

There has been a slow but steady increase of research on the impact of public school facilities on educational achievement and community outcomes and of the rigor of the research. This summary of studies is part of a larger literature review conducted by the 21st Century School Fund with funding from the Charitable Trust of the Council on…
Pre-rigor temperature control of Chinese yellow cattle carcasses to 12-18 °C during chilling improves beef tenderness.

PubMed

Liu, Yuqing; Mao, Yanwei; Zhang, Yimin; Liang, Rongrong; Wang, Renhuan; Zhu, Lixian; Meng, Xianyong; Luo, Xin

2015-02-01

This study evaluates the effects of pre-rigor temperature control on quality traits of Chinese yellow cattle M. longissimus lumborum (LL). One stepwise chilling (SC) treatment was used on one half-carcass, involved a fast chilling (-11 ± 1 °C;0.5 m/s) for 2h, then the refrigeration was stopped to hold a core temperature of 12-18 °C until 10h postmortem, followed by a 1 ± 1 °C chilling (0.5 m/s) to 48h postmortem. The other half-carcass was conventional chilled at 1 ± 1 °C (0.5 m/s) until 48h as control chilling (CC). Quality attributes were evaluated at 1, 7 and 14 days. The SC treatment resulted in decreased WBSF and increased myofibril fragmentation index compared with control. SC-treated LL at 7d postmortem had a lower WBSF than those of CC-treated at 14d. This pre-rigor temperature controlled chilling is a realistic alternative for the beef industry in China to ensure adequate tenderness and shorten aging time.
Optimal design and evaluation of a color separation grating using rigorous coupled wave analysis

NASA Astrophysics Data System (ADS)

Nagayoshi, Mayumi; Oka, Keiko; Klaus, Werner; Komai, Yuki; Kodate, Kashiko

2006-02-01

In recent years, the technology which separates white light into the three primary colors of Red (R), Green (G) and Blue (B) and adjusts each optical intensity and composites R, G and B to display various colors is required in the development and spread of color visual equipments. Various color separation devices have been proposed and have been put to practical use in color visual equipments. We have focused on a small and light grating-type device which has the possibility of reduction in cost and large-scale production and generates only the three primary colors of R, G and B so that a high saturation level can be obtained. To perform a rigorous analysis and design of color separation gratings, our group has developed a program that is based on the Rigorous Coupled Wave Analysis (RCWA). We then calculated the parameters to obtain a diffraction efficiency of higher than 70% and the color gamut of about 70%. We will report on the design, fabrication and evaluation of color separation gratings that have been optimized for fabrication by laser drawing.
EVALUATION OF THE COLD PIPE PRECHARGER

EPA Science Inventory

The article gives results of an evaluation of the performance of the cold pipe precharger, taking a more rigorous approach than had been previously taken. The approach required detailed descriptions of electrical characteristics, electro-hydrodynamics, and charging theory. The co...
Evaluation of knowledge transfer in an immersive virtual learning environment for the transportation community.

DOT National Transportation Integrated Search

2014-05-01

Immersive Virtual Learning Environments (IVLEs) are extensively used in training, but few rigorous scientific investigations regarding the : transfer of learning have been conducted. Measurement of learning transfer through evaluative methods is key ...
Subthreshold posttraumatic stress disorder: A meta-analytic review of DSM-IV prevalence and a proposed DSM-5 approach to measurement.

PubMed

Brancu, Mira; Mann-Wrobel, Monica; Beckham, Jean C; Wagner, H Ryan; Elliott, Alyssa; Robbins, Allison T; Wong, Madrianne; Berchuck, Ania E; Runnals, Jennifer J

2016-03-01

Subthreshold posttraumatic stress disorder (PTSD) is a chronic condition that is often ignored, the cumulative effects of which can negatively impact an individual's quality of life and overall health care costs. However, subthreshold PTSD prevalence rates and impairment remain unclear due to variations in research methodology. This study examined the existing literature in order to recommend approaches to standardize subthreshold PTSD assessment. We conducted (a) a meta-analysis of subthreshold PTSD prevalence rates and (b) compared functional impairment associated with the 3 most commonly studied subthreshold PTSD definitions. Meta-analytic results revealed that the average prevalence rate of subthreshold PTSD across studies was 14.7%, with a lower rate (12.6%) among the most methodologically rigorous studies and higher rate (15.6%) across less rigorous studies. There were significant methodological differences among reviewed studies with regard to definition, measurement, and population. Different definitions led to prevalence rates ranging between 13.7% and 16.4%. Variability in prevalence rates most related to population and sample composition, with trauma type and community (vs. epidemiological) samples significantly impacting heterogeneity. Qualitative information gathered from studies presenting functional correlates supported current evidence that psychological and behavioral parameters were worse among subthreshold PTSD groups compared with no-PTSD groups, but not as severe as impairment in PTSD groups. Several studies also reported significant increased risk of suicidality and hopelessness as well as higher health care utilization rates among those with subthreshold PTSD (compared with trauma exposed no-PTSD samples). Based on findings, we propose recommendations for developing a standard approach to evaluation of subthreshold PTSD. (c) 2016 APA, all rights reserved).
Patient-Reported Outcome Instruments for Surgical and Traumatic Scars: A Systematic Review of their Development, Content, and Psychometric Validation.

PubMed

Mundy, Lily R; Miller, H Catherine; Klassen, Anne F; Cano, Stefan J; Pusic, Andrea L

2016-10-01

Patient-reported outcomes (PROs) are of growing importance in research and clinical care and may be used as primary outcomes or as compliments to traditional surgical outcomes. In assessing the impact of surgical and traumatic scars, PROs are often the most meaningful. To assess outcomes from the patient perspective, rigorously developed and validated PRO instruments are essential. The authors conducted a systematic literature review to identify PRO instruments developed and/or validated for patients with surgical and/or non-burn traumatic scars. Identified instruments were assessed for content, development process, and validation under recommended guidelines for PRO instrument development. The systematic review identified 6534 articles. After review, we identified four PRO instruments meeting inclusion criteria: patient and observer scar assessment scale (POSAS), bock quality of life questionnaire for patients with keloid and hypertrophic scarring (Bock), patient scar assessment questionnaire (PSAQ), and patient-reported impact of scars measure (PRISM). Common concepts measured were symptoms and psychosocial well-being. Only PSAQ had a dedicated appearance domain. Qualitative data were used to inform content for the PSAQ and PRISM, and a modern psychometric approach (Rasch Measurement Theory) was used to develop PRISM and to test POSAS. Overall, PRISM demonstrated the most rigorous design and validation process, however, was limited by the lack of a dedicated appearance domain. PRO instruments to evaluate outcomes in scars exist but vary in terms of concepts measured and psychometric soundness. This review discusses the strengths and weaknesses of existing instruments, highlighting the need for future scar-focused PRO instrument development. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Evaluation of the community response to HIV and AIDS: learning from a portfolio approach.

PubMed

Rodriguez-García, Rosalía; Wilson, David; York, Nick; Low, Corinne; N'Jie, N'Della; Bonnel, Rene

2013-01-01

While communities have played a large role in the HIV/AIDS response, their contributions and innovative approaches to HIV prevention, treatment, care and support have not always been the focus of systematic and rigorous evaluations. To address this gap, the World Bank led an evaluation of the impact of the community response to HIV, including country studies in Burkina Faso, India, Kenya, Lesotho, Nigeria, Senegal, South Africa and Zimbabwe over a three-year period. Due to the complexity and varied nature of community responses, the evaluation attempted to determine the results that investments have produced at the community level by applying a mixed method approach: Randomized Controlled Trials, quasi-experimental studies, qualitative studies and analytical studies including financial data. Specifically, the studies examined a typology of community response and the flow of funds to community-based organizations, while investigating the impact of the community responses on (1) knowledge and behavior, (2) use of services, (3) social transformation, and (4) HIV incidence. This editorial summarizes the results of this evaluation portfolio, finding that investments in communities have produced significant results, including, improved knowledge and behavior, and increased use of health services, and even decreased HIV incidence. Evidence on social transformation was more mixed, with community groups found to be effective only in some settings. Each study in the evaluation provides a partial view of how communities shape the local response; however, taken together they corroborate the common wisdom that communities can be a vital part of the global HIV/AIDS response.
Lessons from the trenches: meeting evaluation challenges in school health education.

PubMed

Young, Michael; Denny, George; Donnelly, Joseph

2012-11-01

Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. This paper helps the reader understand the context of school health program evaluation, examines several problems and challenges, shows how problems can often be fixed, or prevented, and demonstrates ways in which challenges can be met. A number of topics are addressed, including distinguishing between curricula evaluation and evaluation of outcomes, types of evaluation, identifying stakeholders in school health evaluation, selection of a program evaluator, recruiting participants, design issues, staff training, parental consent, instrumentation, program implementation and treatment fidelity, participant retention, data collection, data analysis and interpretation, presentation of results, and manuscript preparation and submission. Although there is a lack of health-education program evaluation, rigorous evaluations that have been conducted have, at least in some cases, led to wider dissemination of effective programs. These suggestions will help those interested in school health education understand the importance of evaluation and will provide important guidelines for those conducting evaluations of school health-education programs. © 2012, American School Health Association.
Examining Tensions That Affect the Evaluation of Technology in Health Care: Considerations for System Decision Makers From the Perspective of Industry and Evaluators

PubMed Central

Shaw, James; Wallace, Ross; Bhattacharyya, Onil; Bhatia, R Sacha; Jamieson, Trevor

2017-01-01

Virtual technologies have the potential to mitigate a range of challenges for health care systems. Despite the widespread use of mobile devices in everyday life, they currently have a limited role in health service delivery and clinical care. Efforts to integrate the fast-paced consumer technology market with health care delivery exposes tensions among patients, providers, vendors, evaluators, and system decision makers. This paper explores the key tensions between the high bar for evidence prior to market approval that guides health care regulatory decisions and the “fail fast” reality of the technology industry. We examine three core tensions: balancing user needs versus system needs, rigor versus responsiveness, and the role of pre- versus postmarket evidence generation. We use these to elaborate on the structure and appropriateness of evaluation mechanisms for virtual care solutions. Virtual technologies provide a foundation for personalized, patient-centered medicine on the user side, coupled with a broader understanding of impact on the system side. However, mechanisms for stakeholder discussion are needed to clarify the nature of the health technology marketplace and the drivers of evaluation priorities. PMID:29222075
Evaluation of Metals Release from Oxidation of Fly Ash during Dredging of the Emory River, TN

DTIC Science & Technology

2011-08-01

from an oil -free source (trickle flow, 2-5 bubbles per second) to provide some turbulent flow and to maintain dissolved oxygen levels. More rigorous...larval and (b) juvenile Pimephales promelas. ERDC/EL TR-11-9 79 five juvenile fish and was rigorously aerated from an oil -free source to...epithelial width. In contrast, juvenile pike from a reference lake had significantly thicker gill filaments compared to those exposed to Key Lake uranium
Towards a Credibility Assessment of Models and Simulations

NASA Technical Reports Server (NTRS)

Blattnig, Steve R.; Green, Lawrence L.; Luckring, James M.; Morrison, Joseph H.; Tripathi, Ram K.; Zang, Thomas A.

2008-01-01

A scale is presented to evaluate the rigor of modeling and simulation (M&S) practices for the purpose of supporting a credibility assessment of the M&S results. The scale distinguishes required and achieved levels of rigor for a set of M&S elements that contribute to credibility including both technical and process measures. The work has its origins in an interest within NASA to include a Credibility Assessment Scale in development of a NASA standard for models and simulations.
Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

PubMed

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across programs allows the summative assessment of outcomes, an understanding of factors common to interventions that do and do not lead to success, and elucidates the processes developed for data collection and management. This will provide a framework for the assessment of other training programs and have national implications in transforming biomedical research training.
Nursing Faculty Experiences with Student Evaluations

ERIC Educational Resources Information Center

Beck, Debbie

2016-01-01

Faculty members are often evaluated primarily on the results of student end-of-course surveys (SEOCSs) for promotion, teaching contract renewals, and offers of teaching assignments. Consequently, SEOCSs have become a primary focus in faculty evaluations. Rigor in a course and the assignment of grades associated with assessments can be a source of…
Legal Aspects of Evaluating Teacher Performance.

ERIC Educational Resources Information Center

Beckham, Joseph C.

Chapter 14 in a book on school law concerns the legal aspects of evaluating teacher performance. Careful analysis of recent decisions makes it clear the courts will compel uniform standards and unprecedented rigor in teacher evaluation practices. Particularly in the consideration of equitable standards, state and federal courts are relying on…
Evaluating Groups for Training Parents in Child Management.

ERIC Educational Resources Information Center

Aitchison, Robert A.; Liberman, Robert Paul

The Oxnard (California) Community Mental Health Center reports on evaluation of efforts to train parents in child management skills using behavior modification techniques. Rigorous training procedures, curriculum, and evaluation techniques have been developed over the past two years. Twenty groups of 3-15 parents have received training in behavior…
Evaluating Extension Based Leadership Development Programs in the Southern United States

ERIC Educational Resources Information Center

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…
Modeling technology innovation: How science, engineering, and industry methods can combine to generate beneficial socioeconomic impacts

PubMed Central

2012-01-01

Background Government-sponsored science, technology, and innovation (STI) programs support the socioeconomic aspects of public policies, in addition to expanding the knowledge base. For example, beneficial healthcare services and devices are expected to result from investments in research and development (R&D) programs, which assume a causal link to commercial innovation. Such programs are increasingly held accountable for evidence of impact—that is, innovative goods and services resulting from R&D activity. However, the absence of comprehensive models and metrics skews evidence gathering toward bibliometrics about research outputs (published discoveries), with less focus on transfer metrics about development outputs (patented prototypes) and almost none on econometrics related to production outputs (commercial innovations). This disparity is particularly problematic for the expressed intent of such programs, as most measurable socioeconomic benefits result from the last category of outputs. Methods This paper proposes a conceptual framework integrating all three knowledge-generating methods into a logic model, useful for planning, obtaining, and measuring the intended beneficial impacts through the implementation of knowledge in practice. Additionally, the integration of the Context-Input-Process-Product (CIPP) model of evaluation proactively builds relevance into STI policies and programs while sustaining rigor. Results The resulting logic model framework explicitly traces the progress of knowledge from inputs, following it through the three knowledge-generating processes and their respective knowledge outputs (discovery, invention, innovation), as it generates the intended socio-beneficial impacts. It is a hybrid model for generating technology-based innovations, where best practices in new product development merge with a widely accepted knowledge-translation approach. Given the emphasis on evidence-based practice in the medical and health fields and “bench to bedside” expectations for knowledge transfer, sponsors and grantees alike should find the model useful for planning, implementing, and evaluating innovation processes. Conclusions High-cost/high-risk industries like healthcare require the market deployment of technology-based innovations to improve domestic society in a global economy. An appropriate balance of relevance and rigor in research, development, and production is crucial to optimize the return on public investment in such programs. The technology-innovation process needs a comprehensive operational model to effectively allocate public funds and thereby deliberately and systematically accomplish socioeconomic benefits. PMID:22591638
Protocol for the evaluation of a social franchising model to improve maternal health in Uttar Pradesh, India.

PubMed

Pereira, Shreya K; Kumar, Paresh; Dutt, Varun; Haldar, Kaveri; Penn-Kekana, Loveday; Santos, Andreia; Powell-Jackson, Timothy

2015-05-26

Social franchising is the fastest growing market-based approach to organising and improving the quality of care in the private sector of low- and middle-income countries, but there is limited evidence on its impact and cost-effectiveness. The "Sky" social franchise model was introduced in the Indian state of Uttar Pradesh in late 2013. Difference-in-difference methods will be used to estimate the impact of the social franchise programme on the quality and coverage of health services along the continuum of care for reproductive, maternal and newborn health. Comparison clusters will be selected to be as similar as possible to intervention clusters using nearest neighbour matching methods. Two rounds of data will be collected from a household survey of 3600 women with a birth in the last 2 years and a survey of 450 health providers in the same localities. To capture the full range of effects, 59 study outcomes have been specified and then grouped into conceptually similar domains. Methods to account for multiple inferences will be used based on the pre-specified grouping of outcomes. A process evaluation will seek to understand the scale of the social franchise network, the extent to which various components of the programme are implemented and how impacts are achieved. An economic evaluation will measure the costs of setting up, maintaining and running the social franchise as well as the cost-effectiveness and financial sustainability of the programme. There is a dearth of evidence demonstrating whether market-based approaches such as social franchising can improve care in the private sector. This evaluation will provide rigorous evidence on whether an innovative model of social franchising can contribute to better population health in a low-income setting.
Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques

PubMed Central

Jones, Kelly W.; Lewis, David J.

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented—from protected areas to payments for ecosystem services (PES)—to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing ‘matching’ to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods—an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators—due to the presence of unobservable bias—that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs. PMID:26501964
Estimating the Counterfactual Impact of Conservation Programs on Land Cover Outcomes: The Role of Matching and Panel Regression Techniques.

PubMed

Jones, Kelly W; Lewis, David J

2015-01-01

Deforestation and conversion of native habitats continues to be the leading driver of biodiversity and ecosystem service loss. A number of conservation policies and programs are implemented--from protected areas to payments for ecosystem services (PES)--to deter these losses. Currently, empirical evidence on whether these approaches stop or slow land cover change is lacking, but there is increasing interest in conducting rigorous, counterfactual impact evaluations, especially for many new conservation approaches, such as PES and REDD, which emphasize additionality. In addition, several new, globally available and free high-resolution remote sensing datasets have increased the ease of carrying out an impact evaluation on land cover change outcomes. While the number of conservation evaluations utilizing 'matching' to construct a valid control group is increasing, the majority of these studies use simple differences in means or linear cross-sectional regression to estimate the impact of the conservation program using this matched sample, with relatively few utilizing fixed effects panel methods--an alternative estimation method that relies on temporal variation in the data. In this paper we compare the advantages and limitations of (1) matching to construct the control group combined with differences in means and cross-sectional regression, which control for observable forms of bias in program evaluation, to (2) fixed effects panel methods, which control for observable and time-invariant unobservable forms of bias, with and without matching to create the control group. We then use these four approaches to estimate forest cover outcomes for two conservation programs: a PES program in Northeastern Ecuador and strict protected areas in European Russia. In the Russia case we find statistically significant differences across estimators--due to the presence of unobservable bias--that lead to differences in conclusions about effectiveness. The Ecuador case illustrates that if time-invariant unobservables are not present, matching combined with differences in means or cross-sectional regression leads to similar estimates of program effectiveness as matching combined with fixed effects panel regression. These results highlight the importance of considering observable and unobservable forms of bias and the methodological assumptions across estimators when designing an impact evaluation of conservation programs.
Regional assessment of Climate change impacts in the Mediterranean: the CIRCE project

NASA Astrophysics Data System (ADS)

Iglesias, A.

2011-12-01

The CIRCE project has developed for the first time an assessment of the climate change impacts in the Mediterranean area. The objectives of the project are: to predict and to quantify physical impacts of climate change in the Mediterranean area; to evaluate the consequences of climate change for the society and the economy of the populations located in the Mediterranean area; to develop an integrated approach to understand combined effects of climate change; and to identify adaptation and mitigation strategies in collaboration with regional stakeholders. The CIRCE Project, coordinated by the Instituto Nazionale di Geofisca e Vulcanologia, started on 1st April 2007 and ended in a policy conference in Rome on June 2011. CIRCE involves 64 partners from Europe, Middle East and North Africa working together to evaluate the best strategies of adaptation to the climate change in the Mediterranean basin. CIRCE wants to understand and to explain how climate will change in the Mediterranean area bringing together the natural sciences community and social community in a new integrated and comprehensive way. The project has investigated how global and Mediterranean climates interact, how the radiative properties of the atmosphere and the radiative fluxes vary, the interaction between cloudiness and aerosol, the modifications in the water cycle. Recent observed modifications in the climate variables and detected trends will be compared. The economic and social consequences of climate change are evaluated by analysing direct impacts on migration, tourism and energy markets together with indirect impacts on the economic system. CIRCE has produced results about the consequences on agriculture, forests and ecosystems, human health and air quality. The variability of extreme events in the future scenario and their impacts is also assessed. A rigorous common framework, including a set of quantitative indicators developed specifically for the Mediterranean environment was be developed and used in collaboration with regional stakeholders. Possible adaptation and mitigation strategies were be identified. The integrated results discussed by the project CIRCE will be presented in the first Regional Assessment of Climate Change in the Mediterranean area, to be published in September 2011 and will make a powerful contribution to the definition and evaluation of adaptation and mitigation strategies.
Evaluation of knowledge transfer in an immersive virtual learning environment for the transportation community : [tech summary].

DOT National Transportation Integrated Search

2014-05-01

mmersive Virtual Learning Environments (IVLEs) are extensively used in training, but few rigorous scienti c investigations regarding : the transfer of learning have been conducted. Measurement of learning transfer through evaluative methods is key...
Translational Educational Research

PubMed Central

Issenberg, S. Barry; Cohen, Elaine R.; Barsuk, Jeffrey H.; Wayne, Diane B.

2012-01-01

Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research. PMID:23138127
Putting Management Capacity Building at the Forefront of Health Systems Strengthening: Comment on "Management Matters: A Leverage Point for Health Systems Strengthening in Global Health".

PubMed

Yeager, Valerie A; Bertrand, Jane

2015-10-26

The current limited focus on management in global health activities is highly problematic given the amounts of financial and human resources that are pouring into health system strengthening interventions and the complexity of clinical operations across settings. By ensuring that public health and healthcare practitioners in domestic and international settings receive management training in their educational programs and that we build management capacity among individuals already in the health workforce, we can begin to prepare for more effective health systems strengthening efforts. Rigorous evaluation of health systems strengthening and the impact of management capacity building is crucial to building evidence for the field. © 2016 by Kerman University of Medical Sciences.
Digital technology and the conservation of nature.

PubMed

Arts, Koen; van der Wal, René; Adams, William M

2015-11-01

Digital technology is changing nature conservation in increasingly profound ways. We describe this impact and its significance through the concept of 'digital conservation', which we found to comprise five pivotal dimensions: data on nature, data on people, data integration and analysis, communication and experience, and participatory governance. Examining digital innovation in nature conservation and addressing how its development, implementation and diffusion may be steered, we warn against hypes, techno-fix thinking, good news narratives and unverified assumptions. We identify a need for rigorous evaluation, more comprehensive consideration of social exclusion, frameworks for regulation and increased multi-sector as well as multi-discipline awareness and cooperation. Along the way, digital technology may best be reconceptualised by conservationists from something that is either good or bad, to a dual-faced force in need of guidance.
An unfinished agenda on adolescent health: Opportunities for interventions.

PubMed

Lassi, Zohra S; Salam, Rehana A; Das, Jai K; Wazny, Kerri; Bhutta, Zulfiqar A

2015-08-01

The Millennium Development Goal era has resulted in improvements in maternal and child health worldwide. As more children are surviving past their fifth birthday, the population of adolescents is increasing. Adolescence is a time of significant developmental transition; adolescence sets the stage for adult health through risks taken and beneficial and detrimental habits that are formed and it is thus an optimal time to target health interventions. Beginning interventions in adolescence or even earlier in childhood maximizes the impact on the individual's health in adult life. Evidence suggests that interventions to promote sexual and reproductive health, physical activity and healthy lifestyle, mental health and wellbeing, safe and hazard-free environment, improving access to nutritious and healthy foods, and minimizing exposure to substance abuse can improve health outcomes in young adolescents. School-based delivery strategies appear to be the most highly evaluated for improving adolescent health; they have been used to deliver interventions such as sexual health, substance abuse prevention, and nutritional interventions. Use of social media and information technologies, cash transfers, social protection, and micro-finance initiatives are promising strategies; however, given the lack of rigorous evaluations, there is a need for further research. Additional research is also warranted to strengthen the evidence base by establishing causality, understanding the differential impacts of adolescent health in different contexts particularly in low- and middle-income countries. In addition, research and evaluation in the domain of adolescent health must focus on how to implement interventions effectively at-scale, sustain the impacts over time and ensure equitable outcomes. Copyright © 2015 Elsevier Inc. All rights reserved.

A theory-driven, longitudinal evaluation of the impact of team training on safety culture in 24 hospitals.

PubMed

Jones, Katherine J; Skinner, Anne M; High, Robin; Reiter-Palmon, Roni

2013-05-01

Effective teamwork facilitates collective learning, which is integral to safety culture. There are no rigorous evaluations of the impact of team training on the four components of safety culture-reporting, just, flexible and learning cultures. We evaluated the impact of a year-long team training programme on safety culture in 24 hospitals using two theoretical frameworks. We used two quasi-experimental designs: a cross-sectional comparison of hospital survey on patient safety culture (HSOPS) results from an intervention group of 24 hospitals to a static group of 13 hospitals and a pre-post comparison of HSOPS results within intervention hospitals. Dependent variables were HSOPS items representing the four components of safety culture; independent variables were derived from items added to the HSOPS that measured the extent of team training, learning and transfer. We used a generalised linear mixed model approach to account for the correlated nature of the data. 59% of 2137 respondents from the intervention group reported receiving team training. Intervention group HSOPS scores were significantly higher than static group scores in three dimensions assessing the flexible and learning components of safety culture. The distribution of the adoption of team behaviours (transfer) varied in the intervention group from 2.8% to 31.0%. Adoption of team behaviours was significantly associated with odds of an individual reacting more positively at reassessment than baseline to nine items reflecting all four components of safety culture. Team training can result in transformational change in safety culture when the work environment supports the transfer of learning to new behaviour.
Synergy of stereo cloud top height and ORAC optimal estimation cloud retrieval: evaluation and application to AATSR

NASA Astrophysics Data System (ADS)

Fisher, Daniel; Poulsen, Caroline A.; Thomas, Gareth E.; Muller, Jan-Peter

2016-03-01

In this paper we evaluate the impact on the cloud parameter retrievals of the ORAC (Optimal Retrieval of Aerosol and Cloud) algorithm following the inclusion of stereo-derived cloud top heights as a priori information. This is performed in a mathematically rigorous way using the ORAC optimal estimation retrieval framework, which includes the facility to use such independent a priori information. Key to the use of a priori information is a characterisation of their associated uncertainty. This paper demonstrates the improvements that are possible using this approach and also considers their impact on the microphysical cloud parameters retrieved. The Along-Track Scanning Radiometer (AATSR) instrument has two views and three thermal channels, so it is well placed to demonstrate the synergy of the two techniques. The stereo retrieval is able to improve the accuracy of the retrieved cloud top height when compared to collocated Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO), particularly in the presence of boundary layer inversions and high clouds. The impact of the stereo a priori information on the microphysical cloud properties of cloud optical thickness (COT) and effective radius (RE) was evaluated and generally found to be very small for single-layer clouds conditions over open water (mean RE differences of 2.2 (±5.9) microns and mean COD differences of 0.5 (±1.8) for single-layer ice clouds over open water at elevations of above 9 km, which are most strongly affected by the inclusion of the a priori).
Impact of faculty development programs for positive behavioural changes among teachers: a case study

PubMed Central

2018-01-01

Purpose Faculty development (FD) is essential to prepare faculty members to become effective teachers to meet the challenges in medical education. Despite the growth of FD programmes, most evaluations were often conducted using short questionnaires to assess participants’ satisfaction immediately after they attended a programme. Consequently, there were calls for more rigorous evaluations based on observed changes in participants’ behaviours. Hence, this study aims to explore how the FD workshops run by the Centre for Medical Education, Yong Loo Lin School of Medicine, National University of Singapore have impacted behavioural changes in the educators. Methods We followed up with the educators at least half a year after they have attended the workshops. With limited literature as reference, we initiated a small-scale case-study research design involving semi-structured interviews with six educators which was triangulated with three focus group discussions with their students. This allowed us to explore behavioural changes among the educators as well as evaluate the feasibility of this research methodology. Results We identified three emerging categories among the educators: ignorance to awareness, from intuition to confirmation and expansion, and from individualism to community of practice. Conclusion Although FD have placed much emphasis on teaching and learning approaches, we found that the teacher-student interaction or human character components (passionate, willing to sacrifice, are open to feedback) in becoming a good educator are lacking in our FD workshops. PMID:29510604
Rigor force responses of permeabilized fibres from fast and slow skeletal muscles of aged rats.

PubMed

Plant, D R; Lynch, G S

2001-09-01

1. Ageing is generally associated with a decline in skeletal muscle mass and strength and a slowing of muscle contraction, factors that impact upon the quality of life for the elderly. The mechanisms underlying this age-related muscle weakness have not been fully resolved. The purpose of the present study was to determine whether the decrease in muscle force as a consequence of age could be attributed partly to a decrease in the number of cross-bridges participating during contraction. 2. Given that the rigor force is proportional to the approximate total number of interacting sites between the actin and myosin filaments, we tested the null hypothesis that the rigor force of permeabilized muscle fibres from young and old rats would not be different. 3. Permeabilized fibres from the extensor digitorum longus (fast-twitch; EDL) and soleus (predominantly slow-twitch) muscles of young (6 months of age) and old (27 months of age) male F344 rats were activated in Ca2+-buffered solutions to determine force-pCa characteristics (where pCa = -log(10)[Ca2+]) and then in solutions lacking ATP and Ca2+ to determine rigor force levels. 4. The rigor forces for EDL and soleus muscle fibres were not different between young and old rats, indicating that the approximate total number of cross-bridges that can be formed between filaments did not decline with age. We conclude that the age-related decrease in force output is more likely attributed to a decrease in the force per cross-bridge and/or decreases in the efficiency of excitation-contraction coupling.
Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

PubMed

Hawkes, Claire; Foxcroft, David R; Yerrell, Paul

2010-09-01

This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.
Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.
Collisional damping rates for plasma waves

NASA Astrophysics Data System (ADS)

Tigik, S. F.; Ziebell, L. F.; Yoon, P. H.

2016-06-01

The distinction between the plasma dynamics dominated by collisional transport versus collective processes has never been rigorously addressed until recently. A recent paper [P. H. Yoon et al., Phys. Rev. E 93, 033203 (2016)] formulates for the first time, a unified kinetic theory in which collective processes and collisional dynamics are systematically incorporated from first principles. One of the outcomes of such a formalism is the rigorous derivation of collisional damping rates for Langmuir and ion-acoustic waves, which can be contrasted to the heuristic customary approach. However, the results are given only in formal mathematical expressions. The present brief communication numerically evaluates the rigorous collisional damping rates by considering the case of plasma particles with Maxwellian velocity distribution function so as to assess the consequence of the rigorous formalism in a quantitative manner. Comparison with the heuristic ("Spitzer") formula shows that the accurate damping rates are much lower in magnitude than the conventional expression, which implies that the traditional approach over-estimates the importance of attenuation of plasma waves by collisional relaxation process. Such a finding may have a wide applicability ranging from laboratory to space and astrophysical plasmas.
An operations-partnered evaluation of care redesign for high-risk patients in the Veterans Health Administration (VHA): Study protocol for the PACT Intensive Management (PIM) randomized quality improvement evaluation.

PubMed

Chang, Evelyn T; Zulman, Donna M; Asch, Steven M; Stockdale, Susan E; Yoon, Jean; Ong, Michael K; Lee, Martin; Simon, Alissa; Atkins, David; Schectman, Gordon; Kirsh, Susan R; Rubenstein, Lisa V

2018-06-01

Patient-centered medical homes have made great strides providing comprehensive care for patients with chronic conditions, but may not provide sufficient support for patients at highest risk for acute care use. To address this, the Veterans Health Administration (VHA) initiated a five-site demonstration project to evaluate the effectiveness of augmenting the VA's Patient Aligned Care Team (PACT) medical home with PACT Intensive Management (PIM) teams for Veterans at highest risk for hospitalization. Researchers partnered with VHA leadership to design a mixed-methods prospective multi-site evaluation that met leadership's desire for a rigorous evaluation conducted as quality improvement rather than research. We conducted a randomized QI evaluation and assigned high-risk patients to participate in PIM and compared them with high-risk Veterans receiving usual care through PACT. The summative evaluation examines whether PIM: 1) decreases VHA emergency department and hospital use; 2) increases satisfaction with VHA care; 3) decreases provider burnout; and 4) generates positive returns on investment. The formative evaluation aims to support improved care for high-risk patients at demonstration sites and to inform future initiatives for high-risk patients. The evaluation was reviewed by representatives from the VHA Office of Research and Development and the Office of Research Oversight and met criteria for quality improvement. VHA aims to function as a learning organization by rapidly implementing and rigorously testing QI innovations prior to final program or policy development. We observed challenges and opportunities in designing an evaluation consistent with QI standards and operations priorities, while also maintaining scientific rigor. This trial was retrospectively registered at ClinicalTrials.gov on April 3, 2017: NCT03100526. Protocol v1, FY14-17. Copyright © 2018 Elsevier Inc. All rights reserved.
Navigating Transitions: Challenges for Engineering Students

ERIC Educational Resources Information Center

Moore-Russo, Deborah; Wilsey, Jillian N.; Parthum, Michael J., Sr.; Lewis, Kemper

2017-01-01

As college students enter engineering, they face challenges when they navigate across various transitions. These challenges impact whether a student can successfully adapt to the rigorous curricular requirements of an engineering degree and to the norms and expectations that are particular to engineering. This article focuses on the transitions…
What Districts Know--and Need to Know--about Their Principals

ERIC Educational Resources Information Center

George W. Bush Institute, Education Reform Initiative, 2016

2016-01-01

Research on school leadership has highlighted the impact principals have on student achievement through their influence on classroom instruction, organizational conditions, community support, and setting the teaching and learning conditions in schools. However, there is limited rigorous quantitative research on the best district policies and…
Characterizing Surface Transport Barriers in the South China Sea

DTIC Science & Technology

2015-09-30

to a coral reef system flow, rigorously identifying hyperbolic and elliptic flow structures. 2 RESULTS The FTLE approach was found to be...included in real world applications (Allshouse et al. 2015). Figure 3: The impact of windage on a hypothetical tracer release event of Ningaloo Reef
Improving Learning in Sub-Saharan Africa Using Rigorous Research Designs

ERIC Educational Resources Information Center

Piper, Benjamin

2017-01-01

Education researchers working in sub-Saharan Africa have recently and rapidly expanded the availability of evidence related to the impact of educational interventions on learning outcomes, particularly in preprimary and lower primary education (Ganimian & Murnane, 2016; McEwan, 2015; Popova, Evans, & Arancibia, 2016). Awareness that…
The Rigors of Training Evaluation: A Discussion and Field Demonstration

ERIC Educational Resources Information Center

Bunker, Kerry A.; Cohen, Stephen L.

1977-01-01

The objectives of this research are to report an application of a complex evaluation design, the classic Solomon 4-group, to an organizational training program and to demonstrate the necessity and feasibility of conducting research of this type. (Author/RK)
Oil sands mining and reclamation cause massive loss of peatland and stored carbon

PubMed Central

Rooney, Rebecca C.; Bayley, Suzanne E.; Schindler, David W.

2012-01-01

We quantified the wholesale transformation of the boreal landscape by open-pit oil sands mining in Alberta, Canada to evaluate its effect on carbon storage and sequestration. Contrary to claims made in the media, peatland destroyed by open-pit mining will not be restored. Current plans dictate its replacement with upland forest and tailings storage lakes, amounting to the destruction of over 29,500 ha of peatland habitat. Landscape changes caused by currently approved mines will release between 11.4 and 47.3 million metric tons of stored carbon and will reduce carbon sequestration potential by 5,734–7,241 metric tons C/y. These losses have not previously been quantified, and should be included with the already high estimates of carbon emissions from oil sands mining and bitumen upgrading. A fair evaluation of the costs and benefits of oil sands mining requires a rigorous assessment of impacts on natural capital and ecosystem services. PMID:22411786
Determining the Measurement Quality of a Montessori High School Teacher Evaluation Survey

ERIC Educational Resources Information Center

Setari, Anthony Philip; Bradley, Kelly D.

2017-01-01

The purpose of this study was to conduct a psychometric validation of a course evaluation instrument, known as a student evaluation of teaching (SET), implemented in a Montessori high school. The authors demonstrate to the Montessori community how to rigorously examine the measurement and assessment quality of instruments used within Montessori…
Evaluating habitat suitability models for nesting white-headed woodpeckers in unburned forest

Treesearch

Quresh S. Latif; Victoria A. Saab; Kim Mellen-Mclean; Jonathan G. Dudley

2015-01-01

Habitat suitability models can provide guidelines for species conservation by predicting where species of interest are likely to occur. Presence-only models are widely used but typically provide only relative indices of habitat suitability (HSIs), necessitating rigorous evaluation often using independently collected presence-absence data. We refined and evaluated...
Evaluation of Mental Health Programs for the Aged.

ERIC Educational Resources Information Center

Kahn, Robert L.; Zarit, Steven H.

This paper highlights what the authors believe are the important issues and directions of change in the evaluation of mental health programs. The rationale for such evaluation is twofold. First, it provides a scientifically rigorous method of determining the therapeutic efficacy of the treatment or program, and secondly, these results can exercise…
How to Critically Evaluate Case Studies in Social Work

ERIC Educational Resources Information Center

Lee, Eunjung; Mishna, Faye; Brennenstuhl, Sarah

2010-01-01

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…
Research design issues for evaluating complex multicomponent interventions in neighborhoods and communities.

PubMed

Komro, Kelli A; Flay, Brian R; Biglan, Anthony; Wagenaar, Alexander C

2016-03-01

Major advances in population health will not occur unless we translate existing knowledge into effective multicomponent interventions, implement and maintain these in communities, and develop rigorous translational research and evaluation methods to ensure continual improvement and sustainability. We discuss challenges and offer approaches to evaluation that are key for translational research stages 3 to 5 to advance optimized adoption, implementation, and maintenance of effective and replicable multicomponent strategies. The major challenges we discuss concern (a) multiple contexts of evaluation/research, (b) complexity of packages of interventions, and (c) phases of evaluation/research questions. We suggest multiple alternative research designs that maintain rigor but accommodate these challenges and highlight the need for measurement systems. Longitudinal data collection and a standardized continuous measurement system are fundamental to the evaluation and refinement of complex multicomponent interventions. To be useful to T3-T5 translational research efforts in neighborhoods and communities, such a system would include assessments of the reach, implementation, effects on immediate outcomes, and effects of the comprehensive intervention package on more distal health outcomes.
The impact of social services interventions in developing countries: a review of the evidence of impact on clinical outcomes in people living with HIV.

PubMed

Bateganya, Moses H; Dong, Maxia; Oguntomilade, John; Suraratdecha, Chutima

2015-04-15

Social service interventions have been implemented in many countries to help people living with HIV (PLHIV) and household members cope with economic burden as a result of reduced earning or increased spending on health care. However, the evidence for specific interventions-economic strengthening and legal services-on key health outcomes has not been appraised. We searched electronic databases from January 1995 to May 2014 and reviewed relevant literature from resource-limited settings on the impact of social service interventions on mortality, morbidity, retention in HIV care, quality of life, and ongoing HIV transmission and their cost-effectiveness. Of 1685 citations, 8 articles reported the health impact of economic strengthening interventions among PLHIV in resource-limited settings. None reported on legal services. Six of the 8 studies were conducted in sub-Saharan Africa: 1 reported on all 5 outcomes and 2 reported on 4 and 2 outcomes, respectively. The remaining 5 reported on 1 outcome each. Seven studies reported on quality of life. Although all studies reported some association between economic strengthening interventions and HIV care outcomes, the quality of evidence was rated fair or poor because studies were of low research rigor (observational or qualitative), had small sample size, or had other limitations. The expected impact of economic strengthening interventions was rated as high for quality of life but uncertain for all the other outcomes. Implementation of economic strengthening interventions is expected to have a high impact on the quality of life for PLHIV but uncertain impact on mortality, morbidity, retention in care, and HIV transmission. More rigorous research is needed to explore the impact of more targeted intervention components on health outcomes.

The effectiveness of community-based rehabilitation programmes: an impact evaluation of a quasi-randomised trial.

PubMed

Mauro, Vincenzo; Biggeri, Mario; Deepak, Sunil; Trani, Jean-Francois

2014-11-01

Community-based rehabilitation (CBR) programmes have been described as highly effective means of promoting the rights and opportunities of persons with disabilities (PwD). Although CBR is often the main way in which PwD in low-income and middle-income countries access rehabilitation services, there is little literature providing rigorous evaluation of their impact on people's well-being. Data were collected in the Mandya and Ramanagar districts (Karnataka state, India), between December 2009 and May 2010. In total 2540 PwD were interviewed using stratified random sampling: 1919 CBR beneficiaries (who joined the programme between 1997 and 2009) and 621 persons who were living in villages not covered by the programme. We controlled for the systematic differences between people joining and not joining the programme using the propensity score matching method controlling for covariates at individual and village level. We evaluated the impact of the programme on the subgroups of PwD who are disadvantaged on the dimensions of interest: access to pensions, use of aid appliances, access to paid jobs and improvement in personal-practical autonomy after 4 and 7 years of joining the CBR. We observed a positive and significant impact of the programme on access to services, rights and opportunities of PwD. The results indicate that compared with the control group access to pensions and allowances, aid appliances, access to paid jobs and personal-practical autonomy increased by 29.7%, 9.4%, 12.3% and 36.2%, respectively, after 7 years. The CBR programme analysed has a positive impact on access to services and the well-being of PwD who are particularly deprived on outcomes of interest. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Supervising community health workers in low-income countries – a review of impact and implementation issues

PubMed Central

Hill, Zelee; Dumbaugh, Mari; Benton, Lorna; Källander, Karin; Strachan, Daniel; Asbroek, Augustinus ten; Tibenderana, James; Kirkwood, Betty; Meek, Sylvia

2014-01-01

Background Community health workers (CHWs) are an increasingly important component of health systems and programs. Despite the recognized role of supervision in ensuring CHWs are effective, supervision is often weak and under-supported. Little is known about what constitutes adequate supervision and how different supervision strategies influence performance, motivation, and retention. Objective To determine the impact of supervision strategies used in low- and middle-income countries and discuss implementation and feasibility issues with a focus on CHWs. Design A search of peer-reviewed, English language articles evaluating health provider supervision strategies was conducted through November 2013. Included articles evaluated the impact of supervision in low- or middle-income countries using a controlled, pre-/post- or observational design. Implementation and feasibility literature included both peer-reviewed and gray literature. Results A total of 22 impact papers were identified. Papers were from a range of low- and middle-income countries addressing the supervision of a variety of health care providers. We classified interventions as testing supervision frequency, the supportive/facilitative supervision package, supervision mode (peer, group, and community), tools (self-assessment and checklists), focus (quality assurance/problem solving), and training. Outcomes included coverage, performance, and perception of quality but were not uniform across studies. Evidence suggests that improving supervision quality has a greater impact than increasing frequency of supervision alone. Supportive supervision packages, community monitoring, and quality improvement/problem-solving approaches show the most promise; however, evaluation of all strategies was weak. Conclusion Few supervision strategies have been rigorously tested and data on CHW supervision is particularly sparse. This review highlights the diversity of supervision approaches that policy makers have to choose from and, while choices should be context specific, our findings suggest that high-quality supervision that focuses on supportive approaches, community monitoring, and/or quality assurance/problem solving may be most effective. PMID:24815075
Evaluating sex as a biological variable in preclinical research: the devil in the details.

PubMed

Tannenbaum, Cara; Schwarz, Jaclyn M; Clayton, Janine A; de Vries, Geert J; Sullivan, Casey

2016-01-01

Translating policy into action is a complex task, with much debate surrounding the process whereby US and Canadian health funding agencies intend to integrate sex and gender science as an integral component of methodological rigor and reporting in health research. Effective January 25, 2016, the US National Institutes of Health implemented a policy that expects scientists to account for the possible role of sex as a biological variable (SABV) in vertebrate animal and human studies. Applicants for NIH-funded research and career development awards will be asked to explain how they plan to factor consideration of SABV into their research design, analysis, and reporting; strong justification will be required for proposing single-sex studies. The Canadian Institutes of Health Research is revising their peer review accreditation process to ensure that peer reviewers are skilled in applying a critical lens to protocols that should be incorporating sex and gender science. The current paper outlines the components that peer reviewers in North America will be asked to assess when considering whether SABV is appropriately integrated into research designs, analyses, and reporting. Consensus argues against narrowly defining rules of engagement in applying SABV, with criteria provided for reviewers as guidance only. Scores will not be given for each criterion; applications will be judged on the overall merit of scientific innovation, rigor, reproducibility, and potential impact.
Returning to Work after Cancer: Quantitative Studies and Prototypical Narratives

PubMed Central

Steiner, John F.; Nowels, Carolyn T.; Main, Deborah S.

2009-01-01

Objective A combination of quantitative data and illustrative narratives may allow cancer survivorship researchers to disseminate their research findings more broadly. We identified recent, methodologically rigorous quantitative studies on return to work after cancer, summarized the themes from these studies, and illustrated those themes with narratives of individual cancer survivors. Methods We reviewed English-language studies of return to work for adult cancer survivors through June, 2008, and identified 13 general themes from papers that met methodological criteria (population-based sampling, prospective and longitudinal assessment, detailed assessment of work, evaluation of economic impact, assessment of moderators of work return, and large sample size). We drew survivorship narratives from a prior qualitative research study to illustrate these themes. Results Nine quantitative studies met 4 or more of our 6 methodological criteria. These studies suggested that most cancer survivors could return to work without residual disabilities. Cancer site, clinical prognosis, treatment modalities, socioeconomic status, and attributes of the job itself influenced the likelihood of work return. Three narratives - a typical survivor who returned to work after treatment, an individual unable to return to work, and an inspiring survivor who returned to work despite substantial barriers - illustrated many of the themes from the quantitative literature while providing additional contextual details. Conclusion Illustrative narratives can complement the findings of cancer survivorship research if researchers are rigorous and transparent in the selection, analysis, and retelling of those stories. PMID:19507264
How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations.

PubMed Central

Ennett, S T; Tobler, N S; Ringwalt, C L; Flewelling, R L

1994-01-01

OBJECTIVES. Project DARE (Drug Abuse Resistance Education) is the most widely used school-based drug use prevention program in the United States, but the findings of rigorous evaluations of its effectiveness have not been considered collectively. METHODS. We used meta-analytic techniques to review eight methodologically rigorous DARE evaluations. Weighted effect size means for several short-term outcomes also were compared with means reported for other drug use prevention programs. RESULTS. The DARE effect size for drug use behavior ranged from .00 to .11 across the eight studies; the weighted mean for drug use across studies was .06. For all outcomes considered, the DARE effect size means were substantially smaller than those of programs emphasizing social and general competencies and using interactive teaching strategies. CONCLUSIONS. DARE's short-term effectiveness for reducing or preventing drug use behavior is small and is less than for interactive prevention programs. PMID:8092361
Judging Interpretations: But Is It Rigorous? Trustworthiness and Authenticity in Naturalistic Evaluation

ERIC Educational Resources Information Center

Schwandt, Thomas A.; Lincoln, Yvonna S.; Guba, Egon G.

2007-01-01

Among the most knotty problems faced by investigators committed to interpretive practices in disciplines and fields such as sociocultural anthropology, jurisprudence, literary criticism, historiography, feminist studies, public administration, policy analysis, planning, educational research, and evaluation are deciding whether an interpretation is…
75 FR 71131 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-22

... impacts. To complete this task with scientific rigor, it will be necessary to collect high quality survey... instruments, methodologies, procedures, and analytical techniques for this task. Moreover, they have been pilot tested in 11 States. The tools and techniques were submitted for review, and were approved, by...
Tomorrow's Research Library: Vigor or Rigor Mortis?

ERIC Educational Resources Information Center

Hacken, Richard D.

1988-01-01

Compares, contrasts, and critiques predictions that have been made about the future of research libraries, focusing on the impact of technology on the library's role and users' needs. The discussion includes models for the adaptation of new technologies that may assist in library planning and change. (38 references) (CLB)
Impacts of more rigorous ADA paratransit eligibility assessments on riders with disabilities : revised final draft report, May 2009.

DOT National Transportation Integrated Search

2009-05-01

Due to the ever-increasing demand for complementary ADA paratransit trips, transit agencies have instituted a number of actions related to reducing the costs of this type of service, including steps to limit the demand through stricter and more compl...
The Impact of Lesson Study on Teacher Effectiveness

ERIC Educational Resources Information Center

Somma, Victoria

2016-01-01

Federal mandates have increased the pressure on school officials to improve student achievement. These mandates have forced educators across the nation to analyze different types of professional development that train teachers to provide quality lessons that are rigorous in nature. These mandates have forced a shift in pedagogy where teachers work…
A Practical Guide to Regression Discontinuity

ERIC Educational Resources Information Center

Jacob, Robin; Zhu, Pei; Somers, Marie-Andrée; Bloom, Howard

2012-01-01

Regression discontinuity (RD) analysis is a rigorous nonexperimental approach that can be used to estimate program impacts in situations in which candidates are selected for treatment based on whether their value for a numeric rating exceeds a designated threshold or cut-point. Over the last two decades, the regression discontinuity approach has…
College Readiness Indicators. Bulletin. Issue 25

ERIC Educational Resources Information Center

Cromwell, Ashley M.; McClarty, Katie Larsen; Larson, Sarah J.

2013-01-01

This paper outlines current student-level indicators at the high school and middle school levels that predict college success. In this bulletin, indicators are divided into three categories: assessment scores (e.g., SAT® exam scores), transcript attributes (e.g., course rigor), and additional indicators (e.g., attendance) that impact achievement.
78 FR 9815 - Final Priorities, Requirements, Definitions, and Selection Criteria-Supporting Effective Educator...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-02-12

... that can demonstrate impact through other methodological approaches such as a quasi-experimental design... definition of ``relevant outcome.'' Lastly, quasi-experimental designs are already included in the definition... paragraph (b) of this definition, provided they are rigorous and comparable across schools. (b) For non...
Secondary School Curricula Issues: Impact on Postsecondary Students with Disabilities.

ERIC Educational Resources Information Center

Stodden, Robert A.; Galloway, L. M.; Stodden, Norma Jean

2003-01-01

This article examines the complex needs of students with disabilities in learning rigorous standards-based curricula, the need of educators to teach this population standards-based curricula effectively, and the contextual factors that affect teaching and learning standards-based curricula in secondary schools. Exemplary and promising practices…
Branch-and-Bound algorithm applied to uncertainty quantification of a Boiling Water Reactor Station Blackout

DOE PAGES

Nielsen, Joseph; Tokuhiro, Akira; Hiromoto, Robert; ...

2015-11-13

Evaluation of the impacts of uncertainty and sensitivity in modeling presents a significant set of challenges in particular to high fidelity modeling. Computational costs and validation of models creates a need for cost effective decision making with regards to experiment design. Experiments designed to validate computation models can be used to reduce uncertainty in the physical model. In some cases, large uncertainty in a particular aspect of the model may or may not have a large impact on the final results. For example, modeling of a relief valve may result in large uncertainty, however, the actual effects on final peakmore » clad temperature in a reactor transient may be small and the large uncertainty with respect to valve modeling may be considered acceptable. Additionally, the ability to determine the adequacy of a model and the validation supporting it should be considered within a risk informed framework. Low fidelity modeling with large uncertainty may be considered adequate if the uncertainty is considered acceptable with respect to risk. In other words, models that are used to evaluate the probability of failure should be evaluated more rigorously with the intent of increasing safety margin. Probabilistic risk assessment (PRA) techniques have traditionally been used to identify accident conditions and transients. Traditional classical event tree methods utilize analysts’ knowledge and experience to identify the important timing of events in coordination with thermal-hydraulic modeling. These methods lack the capability to evaluate complex dynamic systems. In these systems, time and energy scales associated with transient events may vary as a function of transition times and energies to arrive at a different physical state. Dynamic PRA (DPRA) methods provide a more rigorous analysis of complex dynamic systems. Unfortunately DPRA methods introduce issues associated with combinatorial explosion of states. This study presents a methodology to address combinatorial explosion using a Branch-and-Bound algorithm applied to Dynamic Event Trees (DET), which utilize LENDIT (L – Length, E – Energy, N – Number, D – Distribution, I – Information, and T – Time) as well as a set theory to describe system, state, resource, and response (S2R2) sets to create bounding functions for the DET. The optimization of the DET in identifying high probability failure branches is extended to create a Phenomenological Identification and Ranking Table (PIRT) methodology to evaluate modeling parameters important to safety of those failure branches that have a high probability of failure. The PIRT can then be used as a tool to identify and evaluate the need for experimental validation of models that have the potential to reduce risk. Finally, in order to demonstrate this methodology, a Boiling Water Reactor (BWR) Station Blackout (SBO) case study is presented.« less
Dating and Sexual Violence Research in the Schools: Balancing Protection of Confidentiality with Supporting the Welfare of Survivors.

PubMed

Sharkey, Jill D; Reed, Lauren A; Felix, Erika D

2017-12-01

Rigorous research and program evaluation are needed to understand the experience of dating and sexual violence among youth and the impact of prevention and intervention efforts. Our dilemma in doing this work occurred when youth disclosed dating and sexual violence on a research survey. What responsibility do researchers have to protect survivors' confidentiality as a research participant versus taking steps to ensure the student has the opportunity to access help? In our evaluation of a pilot dating violence prevention program, our protocols employed widely used procedures for providing resources to participants upon their completion of the survey and de-identifying survey data. Upon reviewing preliminary survey results, we became concerned that these established procedures were not sufficient to support research participants who were adolescent survivors of dating and sexual violence. We followed a structured ethical decision-making process to examine legal and ethical considerations, consult with colleagues, consider impacts and alternative solutions, and ultimately find a solution. Through this process, we developed procedures that balance participant confidentiality and the desire to support the welfare of survivors, which other researchers may want to employ when conducting youth sexual and dating violence research in school and community settings. © Society for Community Research and Action 2017.
Effect Of A Large-Scale Social Franchising And Telemedicine Program On Childhood Diarrhea And Pneumonia Outcomes In India.

PubMed

Mohanan, Manoj; Babiarz, Kimberly S; Goldhaber-Fiebert, Jeremy D; Miller, Grant; Vera-Hernández, Marcos

2016-10-01

Despite the rapid growth of social franchising, there is little evidence on its population impact in the health sector. Similar in many ways to private-sector commercial franchising, social franchising can be found in sectors with a social objective, such as health care. This article evaluates the World Health Partners (WHP) Sky program, a large-scale social franchising and telemedicine program in Bihar, India. We studied appropriate treatment for childhood diarrhea and pneumonia and associated health care outcomes. We used multivariate difference-in-differences models to analyze data on 67,950 children ages five and under in 2011 and 2014. We found that the WHP-Sky program did not improve rates of appropriate treatment or disease prevalence. Both provider participation and service use among target populations were low. Our results do not imply that social franchising cannot succeed; instead, they underscore the importance of understanding factors that explain variation in the performance of social franchises. Our findings also highlight, for donors and governments in particular, the importance of conducting rigorous impact evaluations of new and potentially innovative health care delivery programs before investing in scaling them up. Published by Project HOPE—The People-to-People Health Foundation, Inc.
Collaborative Evaluation of a High School Prevention Curriculum: How Methods of Collaborative Evaluation Enhanced a Randomized Control Trial to Inform Program Improvement

ERIC Educational Resources Information Center

Orsini, Muhsin Michael; Wyrick, David L.; Milroy, Jeffrey J.

2012-01-01

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…
South to south learning in great ape conservation.

PubMed

Schoneveld-de Lange, Nicolien; Meijaard, Erik; Löhr, Ansje

2016-06-01

Despite evidence that killing of Bornean Orangutan (Pongo pygmaeus) in South-East Asia is a major threat to the species, few researchers and non-governmental conservationists have addressed it in management and research, and there is virtually no implementation of anti-killing strategies. In large parts of the Congo Basin, Central Africa, instead, illegal killing of great apes is acknowledged to be their largest threat, and many conservation strategies have been used to reduce killing pressure. However, since these strategies have not been subject to systematic and comprehensive review, it remains unclear which of them have been successful and why. Knowledge of the success, failure, and practices of common conservation strategies to manage great ape killing is critical to ensure adaptive conservation management in the Congo Basin. Understanding the Congo context also facilitates simultaneously highlighting great ape killing in Borneo and suggesting solutions to manage orangutan killing. Here, we compile and analyze the available literature on great ape conservation strategies for reducing killing rates in the Congo Basin. Through a systematic literature review of 198 publications, we find that the most widely employed conservation strategies in the Congo Basin are legislation and law enforcement, protected area management, community-based conservation, alternatives to bushmeat consumption and trade, ecotourism, education, and capacity building. Despite lack of rigorous post-intervention evaluation of conservation impact, we derive several recommendations for addressing the orangutan killing issue in Borneo. A critical lesson, widely applicable to developing countries for conservationists and not limited to Congo Basin realities, is the need for rigorous post-intervention evaluations compared to pre-intervention baselines and over appropriate time frames. Am. J. Primatol. 78:669-678, 2016. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.
Case-control vaccine effectiveness studies: Preparation, design, and enrollment of cases and controls.

PubMed

Verani, Jennifer R; Baqui, Abdullah H; Broome, Claire V; Cherian, Thomas; Cohen, Cheryl; Farrar, Jennifer L; Feikin, Daniel R; Groome, Michelle J; Hajjeh, Rana A; Johnson, Hope L; Madhi, Shabir A; Mulholland, Kim; O'Brien, Katherine L; Parashar, Umesh D; Patel, Manish M; Rodrigues, Laura C; Santosham, Mathuram; Scott, J Anthony; Smith, Peter G; Sommerfelt, Halvor; Tate, Jacqueline E; Victor, J Chris; Whitney, Cynthia G; Zaidi, Anita K; Zell, Elizabeth R

2017-06-05

Case-control studies are commonly used to evaluate effectiveness of licensed vaccines after deployment in public health programs. Such studies can provide policy-relevant data on vaccine performance under 'real world' conditions, contributing to the evidence base to support and sustain introduction of new vaccines. However, case-control studies do not measure the impact of vaccine introduction on disease at a population level, and are subject to bias and confounding, which may lead to inaccurate results that can misinform policy decisions. In 2012, a group of experts met to review recent experience with case-control studies evaluating the effectiveness of several vaccines; here we summarize the recommendations of that group regarding best practices for planning, design and enrollment of cases and controls. Rigorous planning and preparation should focus on understanding the study context including healthcare-seeking and vaccination practices. Case-control vaccine effectiveness studies are best carried out soon after vaccine introduction because high coverage creates strong potential for confounding. Endpoints specific to the vaccine target are preferable to non-specific clinical syndromes since the proportion of non-specific outcomes preventable through vaccination may vary over time and place, leading to potentially confusing results. Controls should be representative of the source population from which cases arise, and are generally recruited from the community or health facilities where cases are enrolled. Matching of controls to cases for potential confounding factors is commonly used, although should be reserved for a limited number of key variables believed to be linked to both vaccination and disease. Case-control vaccine effectiveness studies can provide information useful to guide policy decisions and vaccine development, however rigorous preparation and design is essential. Published by Elsevier Ltd.

Determinants of the Rigor of State Protection Policies for Persons With Dementia in Assisted Living.

PubMed

Nattinger, Matthew C; Kaskie, Brian

2017-01-01

Continued growth in the number of individuals with dementia residing in assisted living (AL) facilities raises concerns about their safety and protection. However, unlike federally regulated nursing facilities, AL facilities are state-regulated and there is a high degree of variation among policies designed to protect persons with dementia. Despite the important role these protection policies have in shaping the quality of life of persons with dementia residing in AL facilities, little is known about their formation. In this research, we examined the adoption of AL protection policies pertaining to staffing, the physical environment, and the use of chemical restraints. For each protection policy type, we modeled policy rigor using an innovative point-in-time approach, incorporating variables associated with state contextual, institutional, political, and external factors. We found that the rate of state AL protection policy adoptions remained steady over the study period, with staffing policies becoming less rigorous over time. Variables reflecting institutional policy making, including legislative professionalism and bureaucratic oversight, were associated with the rigor of state AL dementia protection policies. As we continue to evaluate the mechanisms contributing to the rigor of AL protection policies, it seems that organized advocacy efforts might expand their role in educating state policy makers about the importance of protecting persons with dementia residing in AL facilities and moving to advance appropriate policies.
Impact of topographic mask models on scanner matching solutions

NASA Astrophysics Data System (ADS)

Tyminski, Jacek K.; Pomplun, Jan; Renwick, Stephen P.

2014-03-01

Of keen interest to the IC industry are advanced computational lithography applications such as Optical Proximity Correction of IC layouts (OPC), scanner matching by optical proximity effect matching (OPEM), and Source Optimization (SO) and Source-Mask Optimization (SMO) used as advanced reticle enhancement techniques. The success of these tasks is strongly dependent on the integrity of the lithographic simulators used in computational lithography (CL) optimizers. Lithographic mask models used by these simulators are key drivers impacting the accuracy of the image predications, and as a consequence, determine the validity of these CL solutions. Much of the CL work involves Kirchhoff mask models, a.k.a. thin masks approximation, simplifying the treatment of the mask near-field images. On the other hand, imaging models for hyper-NA scanner require that the interactions of the illumination fields with the mask topography be rigorously accounted for, by numerically solving Maxwell's Equations. The simulators used to predict the image formation in the hyper-NA scanners must rigorously treat the masks topography and its interaction with the scanner illuminators. Such imaging models come at a high computational cost and pose challenging accuracy vs. compute time tradeoffs. Additional complication comes from the fact that the performance metrics used in computational lithography tasks show highly non-linear response to the optimization parameters. Finally, the number of patterns used for tasks such as OPC, OPEM, SO, or SMO range from tens to hundreds. These requirements determine the complexity and the workload of the lithography optimization tasks. The tools to build rigorous imaging optimizers based on first-principles governing imaging in scanners are available, but the quantifiable benefits they might provide are not very well understood. To quantify the performance of OPE matching solutions, we have compared the results of various imaging optimization trials obtained with Kirchhoff mask models to those obtained with rigorous models involving solutions of Maxwell's Equations. In both sets of trials, we used sets of large numbers of patterns, with specifications representative of CL tasks commonly encountered in hyper-NA imaging. In this report we present OPEM solutions based on various mask models and discuss the models' impact on hyper- NA scanner matching accuracy. We draw conclusions on the accuracy of results obtained with thin mask models vs. the topographic OPEM solutions. We present various examples representative of the scanner image matching for patterns representative of the current generation of IC designs.
Impact of post-rigor high pressure processing on the physicochemical and microbial shelf-life of cultured red abalone (Haliotis rufescens).

PubMed

Hughes, Brianna H; Perkins, L Brian; Yang, Tom C; Skonberg, Denise I

2016-03-01

High pressure processing (HPP) of post-rigor abalone at 300MPa for 10min extended the refrigerated shelf-life to four times that of unprocessed controls. Shucked abalone meats were processed at 100 or 300MPa for 5 or 10min, and stored at 2°C for 35days. Treatments were analyzed for aerobic plate count (APC), total volatile base nitrogen (TVBN), K-value, biogenic amines, color, and texture. APC did not exceed 10(6) and TVBN levels remained below 35mg/100g for 35days for the 300MPa treatments. No biogenic amines were detected in the 300MPa treatments, but putrescine and cadaverine were detected in the control and 100MPa treatments. Color and texture were not affected by HPP or storage time. These results indicate that post-rigor processing at 300MPa for 10min can significantly increase refrigerated shelf-life of abalone without affecting chemical or physical quality characteristics important to consumers. Copyright © 2015 Elsevier Ltd. All rights reserved.
Geography and the burden of care in pediatric cancers.

PubMed

Fluchel, Mark N; Kirchhoff, Anne C; Bodson, Julia; Sweeney, Carol; Edwards, Sandra L; Ding, Qian; Stoddard, Gregory J; Kinney, Anita Y

2014-11-01

Childhood cancers typically require rigorous treatment at specialized centers in urban areas, which can create substantial challenges for families residing in remote communities. We evaluated the impact of residence and travel time on the burden of care for families of childhood cancer patients. We conducted a cross-sectional, self-administered survey of 354 caregivers of pediatric cancer patients at a children's hospital serving a seven state area. Measures included the impact of cancer treatment on relocation, employment, schooling, and finances. We evaluated these domains by rural/urban residence and travel time (>1 hour and >2 hours) to the hospital in multivariable regression models. Of the 29% of caregivers who reported moving residences as their child was diagnosed, 33% reported that the move was due to their child's cancer. Rural and remote (e.g., >1 hour travel time) caregivers missed more days of work during the first month after diagnosis than did urban and local caregivers, however, these differences did not persist over the first 6 months of therapy. One-third of caregivers reported quitting or changing jobs as a direct result of their child being diagnosed with cancer. Rural respondents had greater out-of-pocket travel expenses and reported a significantly greater perceived financial burden. Rural patients missed more school days and were at an increased risk of having to repeat a grade. Childhood cancer has an appreciable impact on the lives of patients and caregivers. The burden is greater for those living far from a treatment center. © 2014 Wiley Periodicals, Inc.
Safer disclosure of HIV serostatus for women living with HIV who experience or fear violence: a systematic review.

PubMed

Kennedy, Caitlin E; Haberlen, Sabina; Amin, Avni; Baggaley, Rachel; Narasimhan, Manjulaa

2015-01-01

Supporting individuals as they disclose their HIV serostatus may lead to a variety of individual and public health benefits. However, many women living with HIV are hesitant to disclose their HIV status due to fear of negative outcomes such as violence, abandonment, relationship dissolution and stigma. We conducted a systematic review of studies evaluating interventions to facilitate safer disclosure of HIV status for women living with HIV who experience or fear violence. Articles, conference abstracts and programme reports were included if they reported post-intervention evaluation results and were published before 1 April 2015. Searching was conducted through electronic databases for peer-reviewed articles and conference abstracts, reviewing websites of relevant organizations for grey literature, hand searching reference lists of included studies and contacting experts. Systematic methods were used for screening and data abstraction, which was conducted in duplicate. Study quality (rigor) was assessed with the Cochrane risk of bias tool. Two interventions met the inclusion criteria: the Safe Homes and Respect for Everyone cluster-randomized trial of combination HIV and intimate partner violence (IPV) services in Rakai, Uganda, and the South Africa HIV/AIDS Antenatal Post-Test Support study individual randomized trial of an enhanced counselling intervention for pregnant women undergoing HIV testing and counselling. Both programmes integrated screening for IPV into HIV testing services and trained counsellors to facilitate discussions about disclosure based on a woman's risk of violence. However, both were implemented as part of multiple-component interventions, making it impossible to isolate the impact of the safer disclosure components. The existing evidence base for interventions to facilitate safe HIV serostatus disclosure for women who experience or fear violence is limited. Development and implementation of new approaches and rigorous evaluation of safe disclosure outcomes is needed to guide programme planners and policy makers.
Assessing the effectiveness of strategies to implement clinical guidelines for the management of chronic diseases at primary care level in EU Member States: a systematic review.

PubMed

Brusamento, Serena; Legido-Quigley, Helena; Panteli, Dimitra; Turk, Eva; Knai, Cecile; Saliba, Vanessa; Car, Josip; McKee, Martin; Busse, Reinhard

2012-10-01

This review aimed to evaluate the effectiveness of strategies to implement clinical guidelines for chronic disease management in primary care in EU Member States. We conducted a systematic review of interventional studies assessing the implementation of clinical guidelines. We searched five databases (EMBASE, MEDLINE, CENTRAL, Eppi-Centre and Clinicaltrials.gov) following a strict Cochrane methodology. We included studies focusing on the management of chronic diseases in adults in primary care. A total of 21 studies were found. The implementation strategy was fully effective in only four (19%), partially effective in eight (38%), and not effective in nine (43%). The probability that an intervention would be effective was only slightly higher with multifaceted strategies, compared to single interventions. However, effect size varied across studies; therefore it was not possible to determine the most successful strategy. Only eight studies evaluated the impact on patients' health and only two of those showed significant improvement, while in five there was an improvement in the process of care which did not translate into an improvement in health outcomes. Only four studies reported any data on the cost of the implementation but none undertook a cost-effectiveness analysis. Only one study presented data on the barriers to the implementation of guidelines, noting a lack of awareness and agreement about clinical guidelines. Our results reveal that there are only a few rigorous studies which assess the effectiveness of a strategy to implement clinical guidelines in Europe. Moreover, the results are not consistent in showing which strategy is the most appropriate to facilitate their implementation. Therefore, further research is needed to develop more rigorous studies to evaluate health outcomes associated with the implementation of clinical guidelines; to assess the cost-effectiveness of implementing clinical guidelines; and to investigate the perspective of service users and health service staff. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.
Evaluation, Instruction and Policy Making. IIEP Seminar Paper: 9.

ERIC Educational Resources Information Center

Bloom, Benjamin S.

Recently, educational evaluation has attempted to use the precision, objectivity, and mathematical rigor of the psychological measurement field as well as to find ways in which instrumentation and data utilization could more directly be related to educational institutions, educational processes, and educational purposes. The linkages between…
75 FR 34997 - National Institute on Disability and Rehabilitation Research (NIDRR)-Disability and...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-06-21

... trial research designs to evaluate the effectiveness of interventions or practices. NIDRR believes that randomized control trial research designs can be appropriate for research that involves evaluating specific interventions. However, in complex service delivery settings, other scientifically rigorous research designs may...
77 FR 49653 - Applications for New Awards; Race to the Top-District

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-16

... evaluation data, and student and parent surveys); (4) evaluates principals on a regular basis; (5) provides... on rigorous teacher performance standards, teacher portfolios, and student and parent surveys); (4..., locally directed improvements in learning and teaching that will directly improve student achievement and...
The Evaluation of the National Long Term Care Demonstration: Final Report. Executive Summary.

ERIC Educational Resources Information Center

Mathematica Policy Research, Inc., Plainsboro, NJ.

This report describes the evaluation of the National Long-Term Care (Channeling) Demonstration, a rigorous test of comprehensive case management of community care as a way of containing long-term care costs for the impaired elderly while providing adequate care to those in need. The evaluation process is presented as an experimental design with…
Relationship between School Professional Climate and Teachers' Satisfaction with the Evaluation Process. REL 2016-133

ERIC Educational Resources Information Center

Lacireno-Paquet, Natalie; Bocala, Candice; Bailey, Jessica

2016-01-01

Recent changes in the policy environment have led states and districts in the Regional Educational Laboratory (REL) Northeast & Islands Region to increase the rigor of their teacher evaluation systems by including more frequent observations or student test score data. States and districts nationwide began reforming their evaluation systems as…
Using Abductive Research Logic: "The Logic of Discovery", to Construct a Rigorous Explanation of Amorphous Evaluation Findings

ERIC Educational Resources Information Center

Levin-Rozalis, Miri

2010-01-01

Background: Two kinds of research logic prevail in scientific research: deductive research logic and inductive research logic. However, both fail in the field of evaluation, especially evaluation conducted in unfamiliar environments. Purpose: In this article I wish to suggest the application of a research logic--"abduction"--"the logic of…
Mechanical properties of frog skeletal muscles in iodoacetic acid rigor.

PubMed Central

Mulvany, M J

1975-01-01

1. Methods have been developed for describing the length: tension characteristics of frog skeletal muscles which go into rigor at 4 degrees C following iodoacetic acid poisoning either in the presence of Ca2+ (Ca-rigor) or its absence (Ca-free-rigor). 2. Such rigor muscles showed less resistance to slow stretch (slow rigor resistance) that to fast stretch (fast rigor resistance). The slow and fast rigor resistances of Ca-free-rigor muscles were much lower than those of Ca-rigor muscles. 3. The slow rigor resistance of Ca-rigor muscles was proportional to the amount of overlap between the contractile filaments present when the muscles were put into rigor. 4. Withdrawing Ca2+ from Ca-rigor muscles (induced-Ca-free rigor) reduced their slow and fast rigor resistances. Readdition of Ca2+ (but not Mg2+, Mn2+ or Sr2+) reversed the effect. 5. The slow and fast rigor resistances of Ca-rigor muscles (but not of Ca-free-rigor muscles) decreased with time. 6.The sarcomere structure of Ca-rigor and induced-Ca-free rigor muscles stretched by 0.2lo was destroyed in proportion to the amount of stretch, but the lengths of the remaining intact sarcomeres were essentially unchanged. This suggests that there had been a successive yielding of the weakeast sarcomeres. 7. The difference between the slow and fast rigor resistance and the effect of calcium on these resistances are discussed in relation to possible variations in the strength of crossbridges between the thick and thin filaments. Images Plate 1 Plate 2 PMID:1082023
Study Protocol--Alcohol Management Plans (AMPs) in remote indigenous communities in Queensland: their impacts on injury, violence, health and social indicators and their cost-effectiveness.

PubMed

Clough, Alan R; Fitts, Michelle S; Robertson, Jan A; Shakeshaft, Anthony; Miller, Adrian; Doran, Christopher M; Muller, Reinhold; Ypinazar, Valmae; Martin, David; McDermott, Robyn; Sanson-Fisher, Rob; Towle, Simon; Margolis, Stephen A; West, Caryn

2014-01-09

In 2002/03 the Queensland Government responded to high rates of alcohol-related harm in discrete Indigenous communities by implementing alcohol management plans (AMPs), designed to include supply and harm reduction and treatment measures. Tighter alcohol supply and carriage restrictions followed in 2008 following indications of reductions in violence and injury. Despite the plans being in place for over a decade, no comprehensive independent review has assessed to what level the designed aims were achieved and what effect the plans have had on Indigenous community residents and service providers. This study will describe the long-term impacts on important health, economic and social outcomes of Queensland's AMPs. The project has two main studies, 1) outcome evaluation using de-identified epidemiological data on injury, violence and other health and social indicators for across Queensland, including de-identified databases compiled from relevant routinely-available administrative data sets, and 2) a process evaluation to map the nature, timing and content of intervention components targeting alcohol. Process evaluation will also be used to assess the fidelity with which the designed intervention components have been implemented, their uptake and community responses to them and their perceived impacts on alcohol supply and consumption, injury, violence and community health. Interviews and focus groups with Indigenous residents and service providers will be used. The study will be conducted in all 24 of Queensland's Indigenous communities affected by alcohol management plans. This evaluation will report on the impacts of the original aims for AMPs, what impact they have had on Indigenous residents and service providers. A central outcome will be the establishment of relevant databases describing the parameters of the changes seen. This will permit comprehensive and rigorous surveillance systems to be put in place and provided to communities empowering them with the best credible evidence to judge future policy and program requirements for themselves. The project will inform impending alcohol policy and program adjustments in Queensland and other Australian jurisdictions.The project has been approved by the James Cook University Human Research Ethics Committee (approval number H4967 & H5241).
Improved methods for distribution loss evaluation. Volume 1: analytic and evaluative techniques. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Flinn, D.G.; Hall, S.; Morris, J.

This volume describes the background research, the application of the proposed loss evaluation techniques, and the results. The research identified present loss calculation methods as appropriate, provided care was taken to represent the various system elements in sufficient detail. The literature search of past methods and typical data revealed that extreme caution in using typical values (load factor, etc.) should be taken to ensure that all factors were referred to the same time base (daily, weekly, etc.). The performance of the method (and computer program) proposed in this project was determined by comparison of results with a rigorous evaluation ofmore » losses on the Salt River Project system. This rigorous evaluation used statistical modeling of the entire system as well as explicit enumeration of all substation and distribution transformers. Further tests were conducted at Public Service Electric and Gas of New Jersey to check the appropriateness of the methods in a northern environment. Finally sensitivity tests indicated data elements inaccuracy of which would most affect the determination of losses using the method developed in this project.« less
Predictability of the geospace variations and measuring the capability to model the state of the system

NASA Astrophysics Data System (ADS)

Pulkkinen, A.

2012-12-01

Empirical modeling has been the workhorse of the past decades in predicting the state of the geospace. For example, numerous empirical studies have shown that global geoeffectiveness indices such as Kp and Dst are generally well predictable from the solar wind input. These successes have been facilitated partly by the strongly externally driven nature of the system. Although characterizing the general state of the system is valuable and empirical modeling will continue playing an important role, refined physics-based quantification of the state of the system has been the obvious next step in moving toward more mature science. Importantly, more refined and localized products are needed also for space weather purposes. Predictions of local physical quantities are necessary to make physics-based links to the impacts on specific systems. As we have introduced more localized predictions of the geospace state one central question is how predictable these local quantities are? This complex question can be addressed by rigorously measuring the model performance against the observed data. Space sciences community has made great advanced on this topic over the past few years and there are ongoing efforts in SHINE, CEDAR and GEM to carry out community-wide evaluations of the state-of-the-art solar and heliospheric, ionosphere-thermosphere and geospace models, respectively. These efforts will help establish benchmarks and thus provide means to measure the progress in the field analogous to monitoring of the improvement in lower atmospheric weather predictions carried out rigorously since 1980s. In this paper we will discuss some of the latest advancements in predicting the local geospace parameters and give an overview of some of the community efforts to rigorously measure the model performances. We will also briefly discuss some of the future opportunities for advancing the geospace modeling capability. These will include further development in data assimilation and ensemble modeling (e.g. taking into account uncertainty in the inflow boundary conditions).
What outcomes are associated with developing and implementing co-produced interventions in acute healthcare settings? A rapid evidence synthesis

PubMed Central

Clarke, David; Jones, Fiona; Harris, Ruth; Robert, Glenn

2017-01-01

Background Co-production is defined as the voluntary or involuntary involvement of users in the design, management, delivery and/or evaluation of services. Interest in co-production as an intervention for improving healthcare quality is increasing. In the acute healthcare context, co-production is promoted as harnessing the knowledge of patients, carers and staff to make changes about which they care most. However, little is known regarding the impact of co-production on patient, staff or organisational outcomes in these settings. Aims To identify and appraise reported outcomes of co-production as an intervention to improve quality of services in acute healthcare settings. Design Rapid evidence synthesis. Data sources Medline, Cinahl, Web of Science, Embase, HMIC, Cochrane Database of Systematic Reviews, SCIE, Proquest Dissertation and Theses, EThOS, OpenGrey; CoDesign; The Design Journal; Design Issues. Study selection Studies reporting patient, staff or organisational outcomes associated with using co-production in an acute healthcare setting. Findings 712 titles and abstracts were screened; 24 papers underwent full-text review, and 11 papers were included in the evidence synthesis. One study was a feasibility randomised controlled trial, three were process evaluations and seven used descriptive qualitative approaches. Reported outcomes related to (a) the value of patient and staff involvement in co-production processes; (b) the generation of ideas for changes to processes, practices and clinical environments; and (c) tangible service changes and impacts on patient experiences. Only one study included cost analysis; none reported an economic evaluation. No studies assessed the sustainability of any changes made. Conclusions Despite increasing interest in and advocacy for co-production, there is a lack of rigorous evaluation in acute healthcare settings. Future studies should evaluate clinical and service outcomes as well as the cost-effectiveness of co-production relative to other forms of quality improvement. Potentially broader impacts on the values and behaviours of participants should also be considered. PMID:28701409
Translational educational research: a necessity for effective health-care improvement.

PubMed

McGaghie, William C; Issenberg, S Barry; Cohen, Elaine R; Barsuk, Jeffrey H; Wayne, Diane B

2012-11-01

Medical education research contributes to translational science (TS) when its outcomes not only impact educational settings, but also downstream results, including better patient-care practices and improved patient outcomes. Simulation-based medical education (SBME) has demonstrated its role in achieving such distal results. Effective TS also encompasses implementation science, the science of health-care delivery. Educational, clinical, quality, and safety goals can only be achieved by thematic, sustained, and cumulative research programs, not isolated studies. Components of an SBME TS research program include motivated learners, curriculum grounded in evidence-based learning theory, educational resources, evaluation of downstream results, a productive research team, rigorous research methods, research resources, and health-care system acceptance and implementation. National research priorities are served from translational educational research. National funding priorities should endorse the contribution and value of translational education research.
Solar-powered drip irrigation enhances food security in the Sudano–Sahel

PubMed Central

Burney, Jennifer; Woltering, Lennart; Burke, Marshall; Naylor, Rosamond; Pasternak, Dov

2010-01-01

Meeting the food needs of Africa’s growing population over the next half-century will require technologies that significantly improve rural livelihoods at minimal environmental cost. These technologies will likely be distinct from those of the Green Revolution, which had relatively little impact in sub-Saharan Africa; consequently, few such interventions have been rigorously evaluated. This paper analyzes solar-powered drip irrigation as a strategy for enhancing food security in the rural Sudano–Sahel region of West Africa. Using a matched-pair comparison of villages in northern Benin (two treatment villages, two comparison villages), and household survey and field-level data through the first year of harvest in those villages, we find that solar-powered drip irrigation significantly augments both household income and nutritional intake, particularly during the dry season, and is cost effective compared to alternative technologies. PMID:20080616
Neighborhood crime and school climate as predictors of elementary school academic quality: a cross-lagged panel analysis.

PubMed

McCoy, Dana Charles; Roy, Amanda L; Sirkman, Gabriel M

2013-09-01

Past research has found negative relationships between neighborhood structural disadvantage and students' academic outcomes. Comparatively little work has evaluated the associations between characteristics of neighborhoods and schools themselves. This study explored the longitudinal, reciprocal relationships between neighborhood crime and school-level academic achievement within 500 urban schools. Results revealed that higher neighborhood crime (and particularly violent crime) predicted decreases in school academic achievement across time. School climate emerged as one possible mechanism within this relationship, with higher neighborhood crime predicting decreases in socioemotional learning and safety, but not academic rigor. All three dimensions of school climate were predictive of changes in academic achievement. Although this research supports a primarily unidirectional hypothesis of neighborhoods' impacts on embedded settings, additional work is needed to understand these relationships using additional conceptualizations of neighborhood climate.

Perceived decline in intimate partner violence against women in Bangladesh: qualitative evidence.

PubMed

Schuler, Sidney Ruth; Lenzi, Rachel; Nazneen, Sohela; Bates, Lisa M

2013-09-01

The Bangladesh government, nongovernmental organizations, donors, and advocacy groups have attempted various interventions to promote gender equality and reduce intimate partner violence (IPV) against women, but rigorous evaluations of these interventions are rare and few published studies have yet to show that any of them has had a substantial impact. This study presents qualitative evidence from four villages in central and northern Bangladesh drawn from 11 group discussions (6 with men, 5 with women), 16 open-ended interviews with men, and 62 women's life history narratives. The findings strongly suggest that IPV is declining in these villages as women's economic roles expand and they gain a stronger sense of their rights. Periodic surveys are recommended to measure trends in the incidence of IPV in settings where transitions in gender systems are under way. © 2013 The Population Council, Inc.
Developing methods for systematic reviewing in health services delivery and organization: an example from a review of access to health care for people with learning disabilities. Part 2. Evaluation of the literature--a practical guide.

PubMed

Alborz, Alison; McNally, Rosalind

2004-12-01

To develop methods to facilitate the 'systematic' review of evidence from a range of methodologies on diffuse or 'soft' topics, as exemplified by 'access to health care'. Twenty-eight bibliographic databases, research registers, organizational websites or library catalogues. Reference lists from identified studies. Contact with experts and service users. Current awareness and contents alerting services in the area of learning disabilities. Inclusion criteria were English language literature from 1980 onwards, relating to people with learning disabilities of any age and all study designs. The main criteria for assessment was relevance to Guillifords' model of access to health care which was adapted to the circumstances of people with learning disabilities. Selected studies were evaluated for scientific rigour then data was extracted and the results synthesized. Quality assessment was by an initial set of 'generic' quality indicators. This enabled further evidence selection before evaluation of findings according to specific criteria for qualitative, quantitative or mixed-method studies. Eighty-two studies were fully evaluated. Five studies were rated 'highly rigorous', 22 'rigorous', 46 'less rigorous' and nine 'poor' papers were retained as the sole evidence covering aspects of the guiding model. The majority of studies were quantitative but used only descriptive statistics. Most evidence lacked methodological detail, which often lowered final quality ratings. The application of a consistent structure to quality evaluation can facilitate data appraisal, extraction and synthesis across a range of methodologies in diffuse or 'soft' topics. Synthesis can be facilitated further by using software, such as the microsoft 'access' database, for managing information.
Designing for competence: spaces that enhance collaboration readiness in healthcare.

PubMed

Lamb, Gerri; Shraiky, James

2013-09-01

Many universities in the United States are investing in classrooms and campuses designed to increase collaboration and teamwork among the health professions. To date, we know little about whether these learning spaces are having the intended impact on student performance. Recent advances in the identification of interprofessional teamwork competencies provide a much-needed step toward a defined outcome metric. Rigorous study of the relationship between design and student competence in collaboration also requires clear specification of design concepts and development of testable frameworks. Such theory-based evaluation is crucial for design to become an integral part of interprofessional education strategies and initiatives. Current classroom and campus designs were analyzed for common themes and features in collaborative spaces as a starting place for specification of design concepts and model development. Four major themes were identified: flexibility, visual transparency/proximity, technology and environmental infrastructure. Potential models linking this preliminary set of design concepts to student competencies are proposed and used to generate hypotheses for future study of the impact of collaborative design spaces on student outcomes.
Investigation of Time Series Representations and Similarity Measures for Structural Damage Pattern Recognition

PubMed Central

Swartz, R. Andrew

2013-01-01

This paper investigates the time series representation methods and similarity measures for sensor data feature extraction and structural damage pattern recognition. Both model-based time series representation and dimensionality reduction methods are studied to compare the effectiveness of feature extraction for damage pattern recognition. The evaluation of feature extraction methods is performed by examining the separation of feature vectors among different damage patterns and the pattern recognition success rate. In addition, the impact of similarity measures on the pattern recognition success rate and the metrics for damage localization are also investigated. The test data used in this study are from the System Identification to Monitor Civil Engineering Structures (SIMCES) Z24 Bridge damage detection tests, a rigorous instrumentation campaign that recorded the dynamic performance of a concrete box-girder bridge under progressively increasing damage scenarios. A number of progressive damage test case datasets and damage test data with different damage modalities are used. The simulation results show that both time series representation methods and similarity measures have significant impact on the pattern recognition success rate. PMID:24191136
District Stressors and Teacher Evaluation Ratings

ERIC Educational Resources Information Center

Lenhoff, Sarah Winchell; Pogodzinski, Ben; Mayrowetz, David; Superfine, Benjamin Michael; Umpstead, Regina R.

2018-01-01

Purpose: Federal and state policymakers in the USA have sought to better differentiate the performance of K-12 teachers by enacting more rigorous evaluation policies. The purpose of this paper is to investigate whether these policies are working as intended and explore whether district stressors such as funding, enrollment, and governance are…
An Evaluation of Knowledge Transfer from Microworld Programming to Conventional Programming

ERIC Educational Resources Information Center

Xinogalos, Stelios

2012-01-01

Programming microworlds are being used for introducing students to programming for many years. Although many professors and school teachers report positive results from using programming microwords, these results are usually based on anecdotal evidence rather than rigorous empirical evaluation. A question that has not been answered yet with…
Law-Related Education and Delinquency Prevention. ERIC Digest.

ERIC Educational Resources Information Center

Parrini, Michelle

Evidence from research/evaluation studies indicates that the principles underlying law-related education (LRE) programs address the factors that put youth at risk for delinquency. Although rigorous evaluations of LRE are limited, what evidence exists suggests that LRE has potential to prevent delinquency and problem behavior. This digest…
77 FR 26764 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-07

... two sites, with the random assignment of AFI-eligible cases to program and control groups. The... Families (ACF) is proposing a data collection activity as part of an experimental evaluation of the Assets... outcomes? While some evaluations suggest that IDAs help low-income families save, rigorous experimental...
Reporting Randomized Controlled Trials in Education

ERIC Educational Resources Information Center

Mayo-Wilson, Evan; Grant, Sean; Montgomery, Paul

2014-01-01

Randomized controlled trials (RCTs) are increasingly used to evaluate programs and interventions in order to inform education policy and practice. High quality reports of these RCTs are needed for interested readers to understand the rigor of the study, the interventions tested, and the context in which the evaluation took place (Mayo-Wilson et…
The Stanford Medical Youth Science Program: Educational and Science-Related Outcomes

ERIC Educational Resources Information Center

Crump, Casey; Ned, Judith; Winkleby, Marilyn A.

2015-01-01

Biomedical preparatory programs (pipeline programs) have been developed at colleges and universities to better prepare youth for entering science- and health-related careers, but outcomes of such programs have seldom been rigorously evaluated. We conducted a matched cohort study to evaluate the Stanford Medical Youth Science Program's Summer…
The Economic Cost of Substance Abuse Treatment in the State of Florida

ERIC Educational Resources Information Center

Alexandre, Pierre K.; Beulaygue, Isabelle C.; French, Michael T.; McCollister, Kathryn E.; Popovici, Ioana; Sayed, Bisma A.

2012-01-01

Objective: Public and private stakeholders of substance abuse treatment services require economic cost data to guide program evaluations and funding decisions. Background: Rigorous cost assessments have been conducted for several treatment programs across the United States, but a systematic and comprehensive evaluation of programs in a particular…
Reports of the National Juvenile Justice Assessment Centers. Juvenile Delinquency Prevention Experiments: A Review and Analysis.

ERIC Educational Resources Information Center

Berleman, William C.

Ten delinquency prevention studies are reviewed that incorporated rigorous evaluative procedures (specifically the classic experimental design) for assessing programmatic outcomes. Following an introduction, the evaluation mechanisms built into each project are described, since they were used for determination of the effectiveness of the…
Examining Tensions That Affect the Evaluation of Technology in Health Care: Considerations for System Decision Makers From the Perspective of Industry and Evaluators.

PubMed

Desveaux, Laura; Shaw, James; Wallace, Ross; Bhattacharyya, Onil; Bhatia, R Sacha; Jamieson, Trevor

2017-12-08

Virtual technologies have the potential to mitigate a range of challenges for health care systems. Despite the widespread use of mobile devices in everyday life, they currently have a limited role in health service delivery and clinical care. Efforts to integrate the fast-paced consumer technology market with health care delivery exposes tensions among patients, providers, vendors, evaluators, and system decision makers. This paper explores the key tensions between the high bar for evidence prior to market approval that guides health care regulatory decisions and the "fail fast" reality of the technology industry. We examine three core tensions: balancing user needs versus system needs, rigor versus responsiveness, and the role of pre- versus postmarket evidence generation. We use these to elaborate on the structure and appropriateness of evaluation mechanisms for virtual care solutions. Virtual technologies provide a foundation for personalized, patient-centered medicine on the user side, coupled with a broader understanding of impact on the system side. However, mechanisms for stakeholder discussion are needed to clarify the nature of the health technology marketplace and the drivers of evaluation priorities. ©Laura Desveaux, James Shaw, Ross Wallace, Onil Bhattacharyya, R Sacha Bhatia, Trevor Jamieson. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 08.12.2017.
Translation, adaptation and validation of the Coronary Revascularization Outcome Questionnaire into Greek.

PubMed

Takousi, Maria G; Schmeer, Stefanie; Manaras, Irene; Olympios, Christoforos D; Fakiolas, Constantine N; Makos, Georgios; Troop, Nick A

2016-04-01

Evaluating the impact of coronary revascularization on patients' health related quality of life with a patient-based and disease-specific tool is important for drawing conclusions about treatment and outcomes. This study reports on the translation, adaptation and psychometric evaluation of a Greek version of the Coronary Revascularization Outcome Questionnaire (CROQ-Gr). A total of 609 (81.7% male) patients who had undergone coronary revascularization (percutaneous coronary intervention or coronary artery bypass grafting) were recruited from four hospitals in Athens. After translating the CROQ into Greek, a preliminary qualitative study and a pilot quantitative study were conducted. A full psychometric evaluation was carried out on the main study's data. The psychometric evaluation demonstrated that the CROQ-Gr is acceptable to patients (high response rate, low missing data) and has a good level of reliability (internal consistency >0.70, test-retest reliability >0.90) and validity (both content and construct validity). The results of this study show the CROQ-Gr to be a psychometrically rigorous patient-based measure of outcomes of coronary revascularization. It would be appropriate for use in evaluative research as well as a routine clinical tool to aid cardiologists in monitoring the outcomes of care. © The European Society of Cardiology 2015.
Recycling of end-of-life reverse osmosis membranes by oxidative treatment: a technical evaluation.

PubMed

Coutinho de Paula, Eduardo; Gomes, Júlia Célia Lima; Amaral, Míriam Cristina Santos

2017-07-01

The adverse impacts caused by the disposal of thousands of tonnes per annum of reverse osmosis (RO) membranes modules have grown dramatically around the world. The objective of this study was to evaluate the technical feasibility of recycling by chemical oxidation of end-of-life RO membranes for applications in other separation processes with specifications less rigorous. The recycling technique consisted in to cause a membrane exposition with oxidant solutions in order to remove its aromatic polyamide layer and subsequent conversion to a porous membrane. The recycling technique was evaluated by water permeability and salt rejection tests before and after the oxidative treatments. Initially, membranes' chemical cleaning and pretreatment procedures were assessed. Among factors evaluated, the oxidizing agent, its concentration and pH, associated with the oxidative treatment time, showed important influence on the oxidation of the membranes. Results showed that sodium hypochlorite and potassium permanganate are efficient agents for the membrane recycling. The great increased permeability and decreased salt rejection indicated changes on membranes' selective properties. Scanning electron microscopy (SEM), energy dispersive X-ray spectroscopy (EDX), atomic force microscopy (AFM), and contact angle characterization techniques revealed marked changes on the main membranes' physical-chemical properties, such as morphology, roughness and hydrophobicity. Reuse of produced effluents and fouling tendency of recycled membranes were also evaluated.
Scientific impact: opportunity and necessity.

PubMed

Cohen, Marlene Z; Alexander, Gregory L; Wyman, Jean F; Fahrenwald, Nancy L; Porock, Davina; Wurzbach, Mary E; Rawl, Susan M; Conn, Vicki S

2010-08-01

Recent National Institutes of Health changes have focused attention on the potential scientific impact of research projects. Research with the excellent potential to change subsequent science or health care practice may have high scientific impact. Only rigorous studies that address highly significant problems can generate change. Studies with high impact may stimulate new research approaches by changing understanding of a phenomenon, informing theory development, or creating new research methods that allow a field of science to move forward. Research with high impact can transition health care to more effective and efficient approaches. Studies with high impact may propel new policy developments. Research with high scientific impact typically has both immediate and sustained influence on the field of study. The article includes ideas to articulate potential scientific impact in grant applications as well as possible dissemination strategies to enlarge the impact of completed projects.
Quantitative Approach to Collaborative Learning: Performance Prediction, Individual Assessment, and Group Composition

ERIC Educational Resources Information Center

Cen, Ling; Ruta, Dymitr; Powell, Leigh; Hirsch, Benjamin; Ng, Jason

2016-01-01

The benefits of collaborative learning, although widely reported, lack the quantitative rigor and detailed insight into the dynamics of interactions within the group, while individual contributions and their impacts on group members and their collaborative work remain hidden behind joint group assessment. To bridge this gap we intend to address…
USOE And The Library Role.

ERIC Educational Resources Information Center

Ottina, John R.

In light of today's inflation and the changing priorities of the present Administration, the Office of Education (OE) has taken careful stock of its inventory of programs and has attempted to plan rigorously for the needs of the present and the future. Over the years, OE expenditures on library programs have had significant impact on public,…
Study Casts Cold Water on Bonus Pay

ERIC Educational Resources Information Center

Sawchuk, Stephen

2010-01-01

The most rigorous experimental study of performance-based teacher compensation ever conducted in the United States shows that a nationally watched bonus-pay system had no overall impact on student achievement--results that are certain to set off a firestorm of debate. The study, known as POINT for the Project on Incentives in Teaching, was a…
Valuing a More Rigorous Review of Formative Assessment's Effectiveness

ERIC Educational Resources Information Center

Apthorp, Helen; Klute, Mary; Petrites, Tony; Harlacher, Jason; Real, Marianne

2016-01-01

Prior reviews of evidence for the impact of formative assessment on student achievement suggest widely different estimates of formative assessment's effectiveness, ranging from 0.40 and 0.70 standard deviations in one review. The purpose of this study is to describe variability in the effectiveness of formative assessment for promoting student…

Impact of Perceived Website Service Quality on Customer E-Loyalty on a Lodging Website

ERIC Educational Resources Information Center

Jeon, Myunghee

2009-01-01

Customer loyalty on websites, "e-loyalty", is reflected on customer behavior, regardless of online or offline business. Specifically, it is believed that customer loyalty on a website is strongly associated with website service quality. This study rigorously reviewed previously reported research in the website service quality dimensions and…
Character in Action: A Case of Authentic Educational Leadership That Advanced Equity and Excellence

ERIC Educational Resources Information Center

Beard, Karen Stansberry

2013-01-01

The third pillar of No Child Left Behind emphasizes determining which educational programs and practices have been proven effective through rigorous scientific research. This study addressed Davis, Darling-Hammond, LaPointe, and Meyerson's (2005) call for a "need for additional research to determine the impact and relative importance of…
Poverty in People with Disabilities: Indicators from the Capability Approach

ERIC Educational Resources Information Center

Rosano, Aldo; Mancini, Federica; Solipaca, Alessandro

2009-01-01

People with disability are particularly exposed to poor living conditions: on one hand they have more difficulties in getting an income cause to their inabilities, on the other hand conditions of poverty increase the risk of disability. However, little rigorous quantitative research has been undertaken to measure the real impact of disability on…
Measuring International Service Outcomes: Implications for International Social Work Field Placements

ERIC Educational Resources Information Center

Lough, Benjamin J.; McBride, Amanda Moore; Sherraden, Margaret S.

2012-01-01

International field placements are a unique educational opportunity for social work students to develop the skills they need for social work practice in a globalized world; however, outcomes of international placements have not been rigorously studied. This article reports on the International Volunteer Impacts Survey (IVIS), a 48-item survey…
Quantifying trail erosion and stream sedimentation with sediment tracers

Treesearch

Mark S. Riedel

2006-01-01

Abstract--The impacts of forest disturbance and roads on stream sedimentation have been rigorously investigated and documented. While historical research on turbidity and suspended sediments has been thorough, studies of stream bed sedimentation have typically relied on semi-quantitative measures such as embeddedness or marginal pool depth. To directly quantify the...
Standards, Assessments & Opting Out, Spring 2015

ERIC Educational Resources Information Center

Advance Illinois, 2015

2015-01-01

In the spring, Illinois students will take new state assessments that reflect the rigor and relevance of the new Illinois Learning Standards. But some classmates will sit out and join the pushback against standardized testing. Opt-out advocates raise concerns about over-testing, and the resulting toll on students as well as the impact on classroom…
Integrated Energy Solutions Research | Integrated Energy Solutions | NREL

Science.gov Websites

that spans the height and width of the wall they are facing. Decision Science and Informatics Enabling decision makers with rigorous, technology-neutral, data-backed decision support to maximize the impact of security in energy systems through analysis, decision support, advanced energy technology development, and
Educational Technology: A Theoretical Discussion

ERIC Educational Resources Information Center

Andrews, Barbara; Hakken, David

1977-01-01

Views educational technology in relation to the pattern of technological change, argues that the new technology must be rigorously evaluated, and suggests it is best understood as a business approach to education. (DD)
Interventions for Preventing Unintended, Rapid Repeat Pregnancy Among Adolescents: A Review of the Evidence and Lessons From High-Quality Evaluations

PubMed Central

Norton, Maureen; Chandra-Mouli, Venkatraman; Lane, Cate

2017-01-01

Background: In 2017, of the 22.5 million parenting adolescents (ages 15–19) in 60 countries, approximately 4.1 million gave birth to a second or higher-order child. Adolescent pregnancy in general, and rapid repeat pregnancies specifically, expose young mothers and their children to multiple health and socioeconomic risks. The purpose of this article is to review the impact of interventions designed to prevent unintended, rapid repeat pregnancies among adolescents, including those aimed at changing norms to postpone “intended” closely spaced pregnancies to promote healthy spacing. Methods: We searched PubMed and other databases for evaluations of interventions published in English from 1990 through 2016. We included evaluations that assessed a programmatic intervention specifically designed to prevent rapid repeat pregnancy (occurring less than 24 months after the index birth) or birth (occurring less than 33 months after the index birth), or that reported on contraceptive continuation for at least 2 years. We first assessed the quality of the evaluations, then ranked the interventions based on the quality of the evaluation and the level of impact on repeat pregnancy or birth (statistically significant impact, positive trends but not statistically significant, or no impact) to identify the most effective interventions. Finally, we extracted program design and implementation lessons from the interventions included in the high-quality evaluations. Results: Our search identified 2,187 articles, of which 40 evaluations met the inclusion criteria (24=high quality, 14=moderate quality, 2=less rigorous). We found 14 high-quality evaluations in which the intervention achieved a statistically significant impact on repeat pregnancy or birth. These interventions fell into 5 broad categories: (1) contraceptive services and information, with proactive monitoring of contraceptive use and outreach to families; (2) postpartum contraceptive counseling and services provided soon after delivery; (3) activities that help adolescents improve planning skills, including preparing contraceptive plans; (4) social and behavioral change activities that help adolescents understand the role contraception can play in determining positive life outcomes, and the implications of their reproductive health decisions for their future; and (5) activities that provide mentoring, goal setting, and motivation. Conclusion: Effective interventions that prevent rapid adolescent childbearing link clinical contraceptive services with non-clinical activities that build planning skills, enhance understanding of the role that contraceptives can play in determining positive life outcomes, and provide mentoring and goal setting. Recognizing potentially synergistic effects, we recommend testing various combinations of these interventions, with access to contraception as the foundational activity. PMID:29284694
Prevalence, effectiveness, and characteristics of pharmacy-based medication synchronization programs.

PubMed

Krumme, Alexis A; Isaman, Danielle L; Stolpe, Samuel F; Dougherty, Samantha; Choudhry, Niteesh K

2016-03-01

The burden of visiting pharmacies to fill medications is a central contributor to nonadherence to maintenance medications. Recently, pharmacies have begun offering services that align prescription fill dates to allow patients to pick up all medications on a single visit. We evaluated the prevalence and structure of synchronization programs and evidence of their impact on adherence and clinical outcomes. Mixed-methods approach consisting of semi-structured interviews, data from surveillance activities, and a systematic literature review. We conducted interviews with opinion leaders from nonprofit advocacy organizations and exemplary synchronization programs. Program prevalence was determined using data from regular surveillance efforts. A literature review included Medline, EMBASE, Google Scholar, and general Internet searches. Synchronization programs exist in approximately 10% of independent, 6% of stand-alone chain, and 11% of retail store pharmacies. The majority of programs include a monthly pharmacist appointment and reminder communication. Programs reported the importance of pharmacist buy-in, technology to track and recruit patients, links to other healthcare services, and flexible solutions for managing costs and communication preferences. Although existing peer-reviewed literature suggests that synchronization improves adherence, more evidence is needed to evaluate its impact on patient-centered outcomes. As medication synchronization programs shift directions and compete for patients and payer resources, it will be more important than ever to rigorously evaluate their ability to improve clinical outcomes while also providing the growing number of patients managing multiple chronic conditions with the highest level of patient engagement and consumer choice.
Kirkpatrick and Beyond: A Review of Models of Training Evaluation. IES Report.

ERIC Educational Resources Information Center

Tamkin, P.; Yarnall, J.; Kerrin, M.

Many organizations are not satisfied that their methods of evaluating training are rigorous or extensive enough to answer questions of value to them. Complaints about Kirkpatrick's popular four-step model (1959) of training evaluation are that each level is assumed to be associated with the previous and next levels and that the model is too simple…
A Review of Out-of-School Time Program Quasi-Experimental and Experimental Evaluation Results. Out-of-School Time Evaluation Snapshot.

ERIC Educational Resources Information Center

Little, Priscilla M. D.; Harris, Erin

As the amount of resources allocated to out-of-school (OST) programming and policymakers' demands for research-based results increase, there is increasing interest in rigorous research designs to examine OST program outcomes. This issue of "Out-of-School Time Evaluation Snapshots" reviews 27 quasi-experimental and experimental OST…
State and Local Efforts to Investigate the Validity and Reliability of Scores from Teacher Evaluation Systems

ERIC Educational Resources Information Center

Herlihy, Corinne; Karger, Ezra; Pollard, Cynthia; Hill, Heather C.; Kraft, Matthew A.; Williams, Megan; Howard, Sarah

2014-01-01

Context: In the past two years, states have implemented sweeping reforms to their teacher evaluation systems in response to Race to the Top legislation and, more recently, NCLB waivers. With these new systems, policymakers hope to make teacher evaluation both more rigorous and more grounded in specific job performance domains such as teaching…
Evaluation of automatic video summarization systems

NASA Astrophysics Data System (ADS)

Taskiran, Cuneyt M.

2006-01-01

Compact representations of video, or video summaries, data greatly enhances efficient video browsing. However, rigorous evaluation of video summaries generated by automatic summarization systems is a complicated process. In this paper we examine the summary evaluation problem. Text summarization is the oldest and most successful summarization domain. We show some parallels between these to domains and introduce methods and terminology. Finally, we present results for a comprehensive evaluation summary that we have performed.
The Health Impact Assessment (HIA) Resource and Tool ...

EPA Pesticide Factsheets

Health Impact Assessment (HIA) is a relatively new and rapidly emerging field in the U.S. An inventory of available HIA resources and tools was conducted, with a primary focus on resources developed in the U.S. The resources and tools available to HIA practitioners in the conduct of their work were identified through multiple methods and compiled into a comprehensive list. The compilation includes tools and resources related to the HIA process itself and those that can be used to collect and analyze data, establish a baseline profile, assess potential health impacts, and establish benchmarks and indicators for monitoring and evaluation. These resources include literature and evidence bases, data and statistics, guidelines, benchmarks, decision and economic analysis tools, scientific models, methods, frameworks, indices, mapping, and various data collection tools. Understanding the data, tools, models, methods, and other resources available to perform HIAs will help to advance the HIA community of practice in the U.S., improve the quality and rigor of assessments upon which stakeholder and policy decisions are based, and potentially improve the overall effectiveness of HIA to promote healthy and sustainable communities. The Health Impact Assessment (HIA) Resource and Tool Compilation is a comprehensive list of resources and tools that can be utilized by HIA practitioners with all levels of HIA experience to guide them throughout the HIA process. The HIA Resource
Lumped Model Generation and Evaluation: Sensitivity and Lie Algebraic Techniques with Applications to Combustion

DTIC Science & Technology

1989-03-03

address global parameter space mapping issues for first order differential equations. The rigorous criteria for the existence of exact lumping by linear projective transformations was also established.
The MINERVA Software Development Process

NASA Technical Reports Server (NTRS)

Narkawicz, Anthony; Munoz, Cesar A.; Dutle, Aaron M.

2017-01-01

This paper presents a software development process for safety-critical software components of cyber-physical systems. The process is called MINERVA, which stands for Mirrored Implementation Numerically Evaluated against Rigorously Verified Algorithms. The process relies on formal methods for rigorously validating code against its requirements. The software development process uses: (1) a formal specification language for describing the algorithms and their functional requirements, (2) an interactive theorem prover for formally verifying the correctness of the algorithms, (3) test cases that stress the code, and (4) numerical evaluation on these test cases of both the algorithm specifications and their implementations in code. The MINERVA process is illustrated in this paper with an application to geo-containment algorithms for unmanned aircraft systems. These algorithms ensure that the position of an aircraft never leaves a predetermined polygon region and provide recovery maneuvers when the region is inadvertently exited.
Physical activity and the rejuvenation of Connswater (PARC study): protocol for a natural experiment investigating the impact of urban regeneration on public health

PubMed Central

2013-01-01

Background There is a dearth of evidence regarding the impact of urban regeneration projects on public health, particularly the nature and degree to which urban regeneration impacts upon health-related behaviour change. Natural experiment methodology enables comprehensive large-scale evaluations of such interventions. The Connswater Community Greenway in Belfast is a major urban regeneration project involving the development of a 9 km linear park, including the provision of new cycle paths and walkways. In addition to the environmental improvements, this complex intervention involves a number of programmes to promote physical activity in the regenerated area. The project affords a unique opportunity to investigate the public health impact of urban regeneration. Methods/Design The evaluation framework was informed by the socio-ecological model and guided by the RE-AIM Framework. Key components include: (1) a quasi-experimental before-and-after survey of the Greenway population (repeated cross-sectional design), in tandem with data from a parallel Northern Ireland-wide survey for comparison; (2) an assessment of changes in the local built environment and of walkability using geographic information systems; (3) semi-structured interviews with a purposive sample of survey respondents, and a range of community stakeholders, before and after the regeneration project; and (4) a cost-effectiveness analysis. The primary outcome is change in proportion of individuals identified as being regularly physically active, according to the current UK recommendations. The RE-AIM Framework will be used to make an overall assessment of the impact of the Greenway on the physical activity behaviour of local residents. Discussion The Connswater Community Greenway provides a significant opportunity to achieve long-term, population level behaviour change. We argue that urban regeneration may be conceptualised meaningfully as a complex intervention comprising multiple components with the potential, individually and interactively, to affect the behaviour of a diverse population. The development and implementation of our comprehensive evaluation framework reflects this complexity and illuminates an approach to the empirical, rigorous evaluation of urban regeneration. More specifically, this study will add to the much needed evidence-base about the impact of urban regeneration on public health as well as having important implications for the development of natural experiment methodology. PMID:24103381
Physical activity and the rejuvenation of Connswater (PARC study): protocol for a natural experiment investigating the impact of urban regeneration on public health.

PubMed

Tully, Mark A; Hunter, Ruth F; McAneney, Helen; Cupples, Margaret E; Donnelly, Michael; Ellis, Geraint; Hutchinson, George; Prior, Lindsay; Stevenson, Michael; Kee, Frank

2013-08-23

There is a dearth of evidence regarding the impact of urban regeneration projects on public health, particularly the nature and degree to which urban regeneration impacts upon health-related behaviour change. Natural experiment methodology enables comprehensive large-scale evaluations of such interventions. The Connswater Community Greenway in Belfast is a major urban regeneration project involving the development of a 9 km linear park, including the provision of new cycle paths and walkways. In addition to the environmental improvements, this complex intervention involves a number of programmes to promote physical activity in the regenerated area. The project affords a unique opportunity to investigate the public health impact of urban regeneration. The evaluation framework was informed by the socio-ecological model and guided by the RE-AIM Framework. Key components include: (1) a quasi-experimental before-and-after survey of the Greenway population (repeated cross-sectional design), in tandem with data from a parallel Northern Ireland-wide survey for comparison; (2) an assessment of changes in the local built environment and of walkability using geographic information systems; (3) semi-structured interviews with a purposive sample of survey respondents, and a range of community stakeholders, before and after the regeneration project; and (4) a cost-effectiveness analysis. The primary outcome is change in proportion of individuals identified as being regularly physically active, according to the current UK recommendations. The RE-AIM Framework will be used to make an overall assessment of the impact of the Greenway on the physical activity behaviour of local residents. The Connswater Community Greenway provides a significant opportunity to achieve long-term, population level behaviour change. We argue that urban regeneration may be conceptualised meaningfully as a complex intervention comprising multiple components with the potential, individually and interactively, to affect the behaviour of a diverse population. The development and implementation of our comprehensive evaluation framework reflects this complexity and illuminates an approach to the empirical, rigorous evaluation of urban regeneration. More specifically, this study will add to the much needed evidence-base about the impact of urban regeneration on public health as well as having important implications for the development of natural experiment methodology.
Quasi-experimental study designs series-paper 6: risk of bias assessment.

PubMed

Waddington, Hugh; Aloe, Ariel M; Becker, Betsy Jane; Djimeu, Eric W; Hombrados, Jorge Garcia; Tugwell, Peter; Wells, George; Reeves, Barney

2017-09-01

Rigorous and transparent bias assessment is a core component of high-quality systematic reviews. We assess modifications to existing risk of bias approaches to incorporate rigorous quasi-experimental approaches with selection on unobservables. These are nonrandomized studies using design-based approaches to control for unobservable sources of confounding such as difference studies, instrumental variables, interrupted time series, natural experiments, and regression-discontinuity designs. We review existing risk of bias tools. Drawing on these tools, we present domains of bias and suggest directions for evaluation questions. The review suggests that existing risk of bias tools provide, to different degrees, incomplete transparent criteria to assess the validity of these designs. The paper then presents an approach to evaluating the internal validity of quasi-experiments with selection on unobservables. We conclude that tools for nonrandomized studies of interventions need to be further developed to incorporate evaluation questions for quasi-experiments with selection on unobservables. Copyright © 2017 Elsevier Inc. All rights reserved.

Interventions for disorder and severe intoxication in and around licensed premises, 1989-2009.

PubMed

Brennan, Iain; Moore, Simon C; Byrne, Ellie; Murphy, Simon

2011-04-01

To systematically review rigorous evaluation studies into the effectiveness of interventions in and around licensed premises that aimed to reduce severe intoxication and disorder. A systematic search was conducted. Papers that rigorously evaluated interventions based in and around licensed premises to reduce disorder or intoxication were included. Fifteen studies were identified, three randomized controlled trials and 12 non-randomized quasi-experimental evaluations. Outcome measures were intoxication (n = 6), disorder (n = 6) and intoxication and disorder (n = 3). Interventions included responsible beverage service training (n = 5), server violence prevention training (n = 1), enhanced enforcement of licensing regulations (n = 1), multi-level interventions (n = 5), licensee accords (n = 2) and a risk-focused consultation (n = 1). Intervention effects varied, even across studies using similar interventions. Server training courses that are designed to reduce disorder have some potential, although there is a lack of evidence to support their use to reduce intoxication and the evidence base is weak. © 2011 The Authors, Addiction © 2011 Society for the Study of Addiction.
Assessing face validity of a physical activity questionnaire for Spanish-speaking women in California

USDA-ARS?s Scientific Manuscript database

Background: A review of the literature produced no rigorously tested and validated Spanish-language physical activity survey or evaluation tools for use by USDA’s food assistance and education programs. The purpose of the current study was to develop and evaluate the face validity of a visually enha...
Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings

ERIC Educational Resources Information Center

Graham, Matthew; Milanowski, Anthony; Miller, Jackson

2012-01-01

As states, districts, and schools transition toward more rigorous educator evaluation systems, they are placing additional weight on judgments about educator practice. Since teacher and principal observation ratings inherently rely on evaluators' professional judgment, there is always a question of how much the ratings depend on the particular…
An Ex Post Facto Evaluation Framework for Place-Based Police Interventions

ERIC Educational Resources Information Center

Braga, Anthony A.; Hureau, David M.; Papachristos, Andrew V.

2011-01-01

Background: A small but growing body of research evidence suggests that place-based police interventions generate significant crime control gains. While place-based policing strategies have been adopted by a majority of U.S. police departments, very few agencies make a priori commitments to rigorous evaluations. Objective: Recent methodological…
Using Microanalytical Simulation Methods in Educational Evaluation: An Exploratory Study

ERIC Educational Resources Information Center

Sondergeld, Toni A.; Beltyukova, Svetlana A.; Fox, Christine M.; Stone, Gregory E.

2012-01-01

Scientifically based research used to inform evidence based school reform efforts has been required by the federal government in order to receive grant funding since the reenactment of No Child Left Behind (2002). Educational evaluators are thus faced with the challenge to use rigorous research designs to establish causal relationships. However,…
Evaluation of holonomic quantum computation: adiabatic versus nonadiabatic.

PubMed

Cen, LiXiang; Li, XinQi; Yan, YiJing; Zheng, HouZhi; Wang, ShunJin

2003-04-11

Based on the analytical solution to the time-dependent Schrödinger equations, we evaluate the holonomic quantum computation beyond the adiabatic limit. Besides providing rigorous confirmation of the geometrical prediction of holonomies, the present dynamical resolution offers also a practical means to study the nonadiabaticity induced effects for the universal qubit operations.
A Narrative Review of Generic Intervention Fidelity Measures

ERIC Educational Resources Information Center

Di Rezze, Briano; Law, Mary; Gorter, Jan Willem; Eva, Kevin; Pollock, Nancy

2012-01-01

To increase the rigor of pediatric rehabilitation research, there is a need to evaluate the degree to which an intervention is conducted as planned (i.e., fidelity). Generic fidelity measures evaluate more than one intervention and often include nonspecific attributes of the therapy process common to both interventions. The objective of this study…
Designing Studies to Evaluate Parent-Mediated Interventions for Toddlers with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Siller, Michael; Morgan, Lindee; Turner-Brown, Lauren; Baggett, Kathleen M.; Baranek, Grace T.; Brian, Jessica; Bryson, Susan E.; Carter, Alice S.; Crais, Elizabeth R.; Estes, Annette; Kasari, Connie; Landa, Rebecca J.; Lord, Catherine; Messinger, Daniel S.; Mundy, Peter; Odom, Samuel L.; Reznick, J. Steven; Roberts, Wendy; Rogers, Sally J.; Schertz, Hannah H.; Smith, Isabel M.; Stone, Wendy L.; Watson, Linda R.; Wetherby, Amy M.; Yoder, Paul J.; Zwaigenbaum, Lonnie

2013-01-01

Given recent advances in science, policy, and practice of early identification in autism spectrum disorder (ASD), questions about the effectiveness of early intervention have far-reaching service and policy implications. However, rigorous research evaluating the efficacy and effectiveness of intervention programs for toddlers with ASD faces a…
Evaluating Interactive Policy Making on Biotechnology: The Case of the Dutch Ministry of Health, Welfare and Sport

ERIC Educational Resources Information Center

Broerse, Jacqueline E. W.; de Cock Buning, Tjard; Roelofsen, Anneloes; Bunders, Joske F. G.

2009-01-01

Public engagement is increasingly advocated and applied in the development and implementation of technological innovations. However, initiatives so far are rarely considered effective. There is a need for more methodological rigor and insight into conducive conditions. The authors developed an evaluative framework and assessed accordingly the…
Evaluation of Listening Skill of ELT Textbook at Secondary School Level

ERIC Educational Resources Information Center

Ahmed, Mumtaz; Yaqoob, Humaira; Yaqoob, Maimoona

2015-01-01

Textbook evaluation means development of textbook that is based on rigorous research. In Pakistan text books are designed on communicative language teaching which focuses on communication. Morley (1991) has asserted that listening has a critical role in communication and in language acquisition because the better the students understand, the…
ISRIA statement: ten-point guidelines for an effective process of research impact assessment.

PubMed

Adam, Paula; Ovseiko, Pavel V; Grant, Jonathan; Graham, Kathryn E A; Boukhris, Omar F; Dowd, Anne-Maree; Balling, Gert V; Christensen, Rikke N; Pollitt, Alexandra; Taylor, Mark; Sued, Omar; Hinrichs-Krapels, Saba; Solans-Domènech, Maite; Chorzempa, Heidi

2018-02-08

As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available.In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school's learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders' needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice.The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school's faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community.
Jazz and substance abuse: road to creative genius or pathway to premature death.

PubMed

Tolson, Gerald H Jerry; Cuyjet, Michael J

2007-01-01

Jazz music and jazz musicians have often been linked for better or worse to the world of addictive substances. Many talented jazz musicians either had their careers sidetracked or prematurely ended due to their addiction to drugs and/or alcohol. The rigors of nightly performances, travel, and for many musicians a disapproving society exacted a toll that impacted the creativity of many artists of the genre. The fact that drug and alcohol use had a significant impact on the performance levels of numerous jazz musicians in the 1940's and 1950's has been much discussed, but more study of that impact is warranted. While recent research has provided new information regarding this challenging topic, there is still much to learn. Indeed, a number of questions for inquiry may be posed. Among those questions are the following: Was the work of these jazz artists truly inspired? Would their creative output have been enhanced had they not been addicted to substances? What was the impact of the addictive substances on their ability to function as creative artists and is there evidence to refute or verify that impact? Are there identifiable traits in certain artists that allowed them to be creative in spite of their addictions? This examination presents an evaluation of the evidence of the link between creativity and substance abuse especially as it relates to selected jazz artists during this time period and how they remained creative and actually prospered in their careers in spite of addictions to controlled substances.
Physician Dual Practice: A Descriptive Mapping Review of Literature.

PubMed

Moghri, Javad; Arab, Mohammad; Rashidian, Arash; Akbari Sari, Ali

2016-03-01

Physician dual practice is a common phenomenon in almost all countries throughout the world, which could potential impacts on access, equity and quality of services. This paper aims to review studies in physician dual practice and categorize them in order to their main objectives and purposes. Comprehensive literature searches were undertaken in order to obtain main papers and documents in the field of physician dual practice. Systematic searches in Medline and Embase from 1960 to 2013, and general searches in some popular search engines were carried out in this way. After that, descriptive mapping review methods were utilized to categorize eligible studies in this area. The searches obtained 404 titles, of which 81 full texts were assessed. Finally, 24 studies were eligible for inclusion in our review. These studies were categorized into four groups - "motivation and forces behind dual practice", "consequences of dual practice", "dual practice Policies and their impacts", and "other studies" - based on their main objectives. Our findings showed a dearth of scientifically reliable literature in some areas of dual practice, like the prevalence of the phenomenon, the real consequences of it, and the impacts of the implemented policy measures. Rigorous empirical and evaluative studies should be designed to detect the real consequences of DP and assess the effects of interventions and regulations, which governments have implemented in this field.
Pediatric Multiple Organ Dysfunction Syndrome: Promising Therapies

PubMed Central

Doctor, Allan; Zimmerman, Jerry; Agus, Michael; Rajasekaran, Surender; Wardenburg, Juliane Bubeck; Fortenberry, James; Zajicek, Anne; Typpo, Katri

2016-01-01

Objective To describe the state of the science, identify knowledge gaps, and offer potential future research questions regarding promising therapies for children with multiple organ dysfunction syndrome (MODS) presented during the Eunice Kennedy Shriver National Institute of Child Health and Human Development Workshop on Pediatric Multiple Organ Dysfunction Syndrome (March 26-27, 2015). Data Sources Literature review, research data, and expert opinion. Study Selection Not applicable. Data Extraction Moderated by an expert from the field, issues relevant to the association of MODS with a variety of conditions were presented, discussed and debated with a focus on identifying knowledge gaps and research priorities. Data Synthesis Summary of presentations and discussion supported and supplemented by relevant literature. Conclusions Among critically ill children, MODS is relatively common and associated with significant morbidity and mortality. For outcomes to improve, effective therapies aimed at preventing and treating this condition must be discovered and rigorously evaluated. In this manuscript, a number of potential opportunities to enhance current care are highlighted including the need for a better understanding of the pharmacokinetics and pharmacodynamics of medications, the effect of early and optimized nutrition, and the impact of effective glucose control in the setting of MODS. Additionally, a handful of the promising therapies either currently being implemented or developed are described. These include extracorporeal therapies, anti-cytokine therapies, anti-toxin treatments, anti-oxidant approaches and multiple forms of exogenous steroids. For the field to advance, these and other therapies must be assessed in rigorous manner and implemented accordingly. PMID:28248836
Pediatric Multiple Organ Dysfunction Syndrome: Promising Therapies.

PubMed

Doctor, Allan; Zimmerman, Jerry; Agus, Michael; Rajasekaran, Surender; Bubeck Wardenburg, Juliane; Fortenberry, James; Zajicek, Anne; Mairson, Emma; Typpo, Katri

2017-03-01

To describe the state of the science, identify knowledge gaps, and offer potential future research questions regarding promising therapies for children with multiple organ dysfunction syndrome presented during the Eunice Kennedy Shriver National Institute of Child Health and Human Development Workshop on Pediatric Multiple Organ Dysfunction Syndrome (March 26-27, 2015). Literature review, research data, and expert opinion. Not applicable. Moderated by an expert from the field, issues relevant to the association of multiple organ dysfunction syndrome with a variety of conditions were presented, discussed, and debated with a focus on identifying knowledge gaps and research priorities. Summary of presentations and discussion supported and supplemented by relevant literature. Among critically ill children, multiple organ dysfunction syndrome is relatively common and associated with significant morbidity and mortality. For outcomes to improve, effective therapies aimed at preventing and treating this condition must be discovered and rigorously evaluated. In this article, a number of potential opportunities to enhance current care are highlighted including the need for a better understanding of the pharmacokinetics and pharmacodynamics of medications, the effect of early and optimized nutrition, and the impact of effective glucose control in the setting of multiple organ dysfunction syndrome. Additionally, a handful of the promising therapies either currently being implemented or developed are described. These include extracorporeal therapies, anticytokine therapies, antitoxin treatments, antioxidant approaches, and multiple forms of exogenous steroids. For the field to advance, promising therapies and other therapies must be assessed in rigorous manner and implemented accordingly.
Unfolding the Cosmos or Divining "What's up?"

ERIC Educational Resources Information Center

Saxton, Juliana

2010-01-01

This short paper considers the question: what of the future of drama in education? It suggests that perhaps, because we are artists, the future is already in play. If that is so, then we need to address those questions of value, advocacy and marginalisation more rigorously while, at the same time, addressing the impact of technology on empathic…
Confronting challenges to economic analysis of biological invasions in forests

Treesearch

Thomas P Holmes

2010-01-01

Biological invasions of forests by non-indigenous organisms present a complex, persistent, and largely irreversible threat to forest ecosystems around the globe. Rigorous assessments of the economic impacts of introduced species, at a national scale, are needed to provide credible information to policy makers. It is proposed here that microeconomic models of damage due...
A spatial-dynamic value transfer model of economic losses from a biological invasion

Treesearch

Thomas P. Holmes; Andrew M. Liebhold; Kent F. Kovacs; Betsy Von Holle

2010-01-01

Rigorous assessments of the economic impacts of introduced species at broad spatial scales are required to provide credible information to policy makers. We propose that economic models of aggregate damages induced by biological invasions need to link microeconomic analyses of site-specific economic damages with spatial-dynamic models of value change associated with...
Team Pay for Performance: Experimental Evidence from Round Rock's Project on Incentives in Teaching

ERIC Educational Resources Information Center

McCaffrey, Daniel F.; Pane, John F.; Springer, Matthew G.; Burns, Susan F.; Haas, Ann

2011-01-01

This paper presents the results of a rigorous experiment examining the impact of pay for performance on student achievement and instructional practice. This study, conducted by the National Center on Performance Incentives, examines a pay-for-performance program in Round Rock (Texas) which distributed performance awards to teachers based on a…
Exploring the Impact of an Outdoor Orientation Program on Adaptation to College

ERIC Educational Resources Information Center

Ribbe, Robert, Jr.; Cyrus, Rachael; Langan, Emily

2016-01-01

Outdoor orientation programming as a means for orientating students to college has experienced significant growth and expanded use over the past decade. An increase in rigorous research has accompanied this growth as colleges and universities seek to understand and meet the needs of young adults in transition. In this study, two research questions…

Facts Are More Important than Novelty: Replication in the Education Sciences

ERIC Educational Resources Information Center

Makel, Matthew C.; Plucker, Jonathan A.

2014-01-01

Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not on the merit of replicating important results. The present study analyzed the complete publication history of the current top 100 education journals ranked by 5-year impact factor and found that only 0.13% of…
Random Assignment within Schools: Lessons Learned from the Teach for America Experiment

ERIC Educational Resources Information Center

Glazerman, Steven

2012-01-01

Randomized trials are a common way to provide rigorous evidence on the impacts of education programs. This article discusses the trade-offs associated with study designs that involve random assignment of students within schools and describes the experience from one such study of Teach for America (TFA). The TFA experiment faced challenges with…
A Review of the Application of Lifecycle Analysis to Renewable Energy Systems

ERIC Educational Resources Information Center

Lund, Chris; Biswas, Wahidul

2008-01-01

The lifecycle concept is a "cradle to grave" approach to thinking about products, processes, and services, recognizing that all stages have environmental and economic impacts. Any rigorous and meaningful comparison of energy supply options must be done using a lifecycle analysis approach. It has been applied to an increasing number of conventional…
Changes in the Cognitive Complexity of English Instruction: The Moderating Effects of School and Classroom Characteristics

ERIC Educational Resources Information Center

Polikoff, Morgan S.; Struthers, Kathryn

2013-01-01

Background/Context: A central aim of standards-based reform is to close achievement gaps by raising academic standards for all students. Rigorous standards coupled with aligned assessments will purportedly improve student opportunity to learn through high-quality, aligned instruction. After 10 years of No Child Left Behind (NCLB), the impact of…
Can High School Assessments Predict Developmental Education Enrollment in New Mexico?

ERIC Educational Resources Information Center

Weldon, Tyler L.

2013-01-01

Thousands of American's enter postsecondary institutions every year and many are under prepared for college-level work. Subsequently, students enroll in or are placed in remedial courses in preparation for the rigor of college level classes. Numerous studies have looked at the impact of developmental course work on student outcomes, but few focus…
Learning Communities for Students in Developmental Reading: An Impact Study at Hillsborough Community College. NCPR Brief

ERIC Educational Resources Information Center

Weiss, Michael J.; Visher, Mary G.; Wathington, Heather

2010-01-01

This Brief, based on a report of the same title, presents results from a rigorous study of a basic learning communities program operated at Hillsborough Community College. Hillsborough, one of six community colleges participating in the National Center for Postsecondary Research's (NCPR) Learning Communities Demonstration, is a large, urban…
The Relationship between Self-Directed Learning Readiness and Student Retention in Nursing Education

ERIC Educational Resources Information Center

Larmon, Brandy H.

2015-01-01

Retention in higher education, especially nursing education, is a concern for nurse educators. Due to the needs of nurse graduates and practicing nurses, the characteristic of self-directed learning in students is often an educational goal of a rigorous nursing curriculum. Program retention is often impacted by such demands. This study, based upon…
Examining Evidence-Based Content Related to Hospital Acquired Pressure Ulcer Prevention in Paper and Electronic Health Records

ERIC Educational Resources Information Center

Jaekel, Camilla M.

2012-01-01

Although there have been great advancements in the Electronic Health Record (EHR), there is a dearth of rigorous research that examines the relationship between the use of electronic documentation to capture nursing process components and the impact of consistent documentation on patient outcomes (Daly, Buckwalter & Maas, 2002; Gugerty, 2006;…
The International Baccalaureate Diploma Program's Impacting High School Culture and Climate

ERIC Educational Resources Information Center

Duarte, George

2013-01-01

School reformers are often searching for a program that will have a positive and far-reaching effect on a school campus. Researchers and writers have described the International Baccalaureate Diploma Program (IB DP) as a largely positive influence on a school campus, providing a rigorous and standards-based curriculum to IB DP students. However,…
What We Are Learning about Early Education in Sub-Saharan Africa

ERIC Educational Resources Information Center

Gove, Amber

2017-01-01

This commentary discusses the three articles in this (2017) issue. The articles expand the published research base on the effectiveness of early education in the sub-Saharan Africa countries of Zambia, Kenya, and the Democratic Republic of Congo (DRC). Each of the three articles employs rigorous methods to better understand the impact of…
Automatic and user-centric approaches to video summary evaluation

NASA Astrophysics Data System (ADS)

Taskiran, Cuneyt M.; Bentley, Frank

2007-01-01

Automatic video summarization has become an active research topic in content-based video processing. However, not much emphasis has been placed on developing rigorous summary evaluation methods and developing summarization systems based on a clear understanding of user needs, obtained through user centered design. In this paper we address these two topics and propose an automatic video summary evaluation algorithm adapted from teh text summarization domain.
Upgrading geometry conceptual understanding and strategic competence through implementing rigorous mathematical thinking (RMT)

NASA Astrophysics Data System (ADS)

Nugraheni, Z.; Budiyono, B.; Slamet, I.

2018-03-01

To reach higher order thinking skill, needed to be mastered the conceptual understanding and strategic competence as they are two basic parts of high order thinking skill (HOTS). RMT is a unique realization of the cognitive conceptual construction approach based on Feurstein with his theory of Mediated Learning Experience (MLE) and Vygotsky’s sociocultural theory. This was quasi-experimental research which compared the experimental class that was given Rigorous Mathematical Thinking (RMT) as learning method and the control class that was given Direct Learning (DL) as the conventional learning activity. This study examined whether there was different effect of two learning model toward conceptual understanding and strategic competence of Junior High School Students. The data was analyzed by using Multivariate Analysis of Variance (MANOVA) and obtained a significant difference between experimental and control class when considered jointly on the mathematics conceptual understanding and strategic competence (shown by Wilk’s Λ = 0.84). Further, by independent t-test is known that there was significant difference between two classes both on mathematical conceptual understanding and strategic competence. By this result is known that Rigorous Mathematical Thinking (RMT) had positive impact toward Mathematics conceptual understanding and strategic competence.
Evidence on public policy: methodological issues, political issues and examples.

PubMed

Attanasio, Orazio P

2014-03-01

In this paper I discuss how evidence on public policy is generated and in particular the issue of evaluation of public policies. In economics, the issue of attribution and the identification of causal links has recently received considerable attention. Important methodological issues have been tackled and new techniques have been proposed and used. Randomized Control Trials have become some sort of gold standard. However, they are not exempt from problems and have important limitations: in some case they cannot be constructed and, more generally, problems of external validity and transferability of results can be important. The paper then moves on to discuss the political economy of policy evaluations for policy evaluations to have an impact for the conduct of actual policy, it is important that the demand for evaluation comes directly from the policy making process and is generated endogenously within it. In this sense it is important that the institutional design of policy making is such that policy making institutions are incentivized to use rigorous evaluation in the process of designing policies and allocating resources to alternative options. Economists are currently involved in the design and evaluation of many policies, including policies about health, nutrition and education. The role they can play in these fields is not completely obvious. The paper argues that their main contribution is in the modelling of how individual reacts to incentives (including those provided by public policies).
A review of antimicrobial stewardship training in medical education

PubMed Central

Silverberg, Sarah L.; Zannella, Vanessa E.; Countryman, Drew; Ayala, Ana Patricia; Lenton, Erica; Friesen, Farah

2017-01-01

Objectives We reviewed the published literature on antimicrobial stewardship training in undergraduate and postgraduate medical education to determine which interventions have been implemented, the extent to which they have been evaluated, and to understand which are most effective. Methods We searched Ovid MEDLINE and EMBASE from inception to December 2016. Four thousand three hundred eighty-five (4385) articles were identified and underwent title and abstract review. Only those articles that addressed antimicrobial stewardship interventions for medical trainees were included in the final review. We employed Kirkpatrick’s four levels of evaluation (reaction, learning, behaviour, results) to categorize intervention evaluations. Results Our review included 48 articles. The types of intervention varied widely amongst studies worldwide. Didactic teaching was used heavily in all settings, while student-specific feedback was used primarily in the postgraduate setting. The high-level evaluation was sparse, with 22.9% reporting a Kirkpatrick Level 3 evaluation; seventeen reported no evaluation. All but one article reported positive results from the intervention. No articles evaluated the impact of an intervention on undergraduate trainees’ prescribing behaviour after graduation. Conclusions This study enhances our understanding of the extent of antimicrobial stewardship in the context of medical education. While our study demonstrates that medical schools are implementing antimicrobial stewardship interventions, rigorous evaluation of programs to determine whether such efforts are effective is lacking. We encourage more robust evaluation to establish effective, evidence-based approaches to training prescribers in light of the global challenge of antimicrobial resistance. PMID:29035872
Evaluating an integrated approach to clinical quality improvement: clinical guidelines, quality measurement, and supportive system design.

PubMed

Cretin, S; Farley, D O; Dolter, K J; Nicholas, W

2001-08-01

Implementing clinical practice guidelines to change patient outcomes presents a challenge. Studies of single interventions focused on changing provider behavior demonstrate modest effects, suggesting that effective guideline implementation requires a multifaceted approach. Traditional biomedical research designs are not well suited to evaluating systems interventions. RAND and the Army Medical Department collaborated to develop and evaluate a system for implementing guidelines and documenting their effects on patient care. The evaluation design blended quality improvement, case study, and epidemiologic methods. A formative evaluation of implementation process and an outcome evaluation of patient impact were combined. Guidelines were implemented in 3 successive demonstrations targeting low back pain, asthma, and diabetes. This paper reports on the first wave of 4 facilities implementing a low back pain guideline. Organizational climate and culture, motivation, leadership commitment, and resources were assessed. Selected indicators of processes and outcomes of care were compared before, during, and after guideline implementation at the demonstration facilities and at comparison facilities. Logistic regression analysis was used to test for guideline effects on patient care. Process evaluation documented varied approaches to quality improvement across sites. Outcome evaluation revealed a significant downward trend in the percentage of acute low back pain patients referred to physical therapy or chiropractic care (10.7% to 7.2%) at demonstration sites and no such trend at control sites. Preliminary results suggest the power of this design to stimulate improvements in guideline implementation while retaining the power to evaluate rigorously effects on patient care.
A user-friendly tool to evaluate the effectiveness of no-take marine reserves.

PubMed

Villaseñor-Derbez, Juan Carlos; Faro, Caio; Wright, Melaina; Martínez, Jael; Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria Del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge; Costello, Christopher

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called "MAREA", to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA's ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management.
A user-friendly tool to evaluate the effectiveness of no-take marine reserves

PubMed Central

Fitzgerald, Sean; Fulton, Stuart; Mancha-Cisneros, Maria del Mar; McDonald, Gavin; Micheli, Fiorenza; Suárez, Alvin; Torre, Jorge

2018-01-01

Marine reserves are implemented to achieve a variety of objectives, but are seldom rigorously evaluated to determine whether those objectives are met. In the rare cases when evaluations do take place, they typically focus on ecological indicators and ignore other relevant objectives such as socioeconomics and governance. And regardless of the objectives, the diversity of locations, monitoring protocols, and analysis approaches hinder the ability to compare results across case studies. Moreover, analysis and evaluation of reserves is generally conducted by outside researchers, not the reserve managers or users, plausibly thereby hindering effective local management and rapid response to change. We present a framework and tool, called “MAREA”, to overcome these challenges. Its purpose is to evaluate the extent to which any given reserve has achieved its stated objectives. MAREA provides specific guidance on data collection and formatting, and then conducts rigorous causal inference analysis based on data input by the user, providing real-time outputs about the effectiveness of the reserve. MAREA’s ease of use, standardization of state-of-the-art inference methods, and ability to analyze marine reserve effectiveness across ecological, socioeconomic, and governance objectives could dramatically further our understanding and support of effective marine reserve management. PMID:29381762
Improving diets and nutrition through an integrated poultry value chain and nutrition intervention (SELEVER) in Burkina Faso: study protocol for a randomized trial.

PubMed

Gelli, Aulo; Becquey, Elodie; Ganaba, Rasmane; Headey, Derek; Hidrobo, Melissa; Huybregts, Lieven; Verhoef, Hans; Kenfack, Romain; Zongouri, Sita; Guedenet, Hannah

2017-09-06

The SELEVER study is designed to evaluate the impact of an integrated agriculture-nutrition package of interventions (including poultry value chain development, women's empowerment activities, and a behavior change communications strategy to promote improved diets and feeding, care, and hygiene practices) on the diets, health, and nutritional status of women and children in Burkina Faso. This paper presents the rationale and study design. The impact evaluation involves a cluster randomized controlled trial design that will be implemented in 120 rural communities/villages within 60 communes supported by SELEVER in the Boucle de Mouhoun, Centre-Ouest, and Haut-Bassins regions of Burkina Faso. Communities will be randomly assigned to one of three treatment arms, including: (1) SELEVER intervention group; (2) SELEVER with an intensive WASH component; and (3) control group without intervention. Primary outcomes include the mean probability of adequacy of diets for women and children (aged 2-4 years at baseline), infant and young child feeding practices of caregivers of children aged 0-2 years, and household poultry production and sales. Intermediate outcomes along the agriculture and nutrition pathways will also be measured, including child nutrition status and development. The evaluation will follow a mixed-methods approach, including a panel of child-, household-, community-, and market-level surveys, and data collection points during post-harvest and lean seasons, as well as one year after implementation completion to examine sustainability. To our knowledge, this study is the first to rigorously examine from a food systems perspective, the simultaneous impact of scaling-up nutrition-specific and nutrition-sensitive interventions through a livestock value-chain and community-intervention platform, across nutrition, health, and agriculture domains. The findings of this evaluation will provide evidence to support the design of market-based nutrition-sensitive interventions. ISRCTN registry, ISRCTN16686478 . Registered on 2 December 2016.
Social Franchising and a Nationwide Mass Media Campaign Increased the Prevalence of Adequate Complementary Feeding in Vietnam: A Cluster-Randomized Program Evaluation123

PubMed Central

Rawat, Rahul; Nguyen, Phuong Hong; Tran, Lan Mai; Hajeebhoy, Nemat; Nguyen, Huan Van; Baker, Jean; Frongillo, Edward A; Ruel, Marie T; Menon, Purnima

2017-01-01

Background: Rigorous evaluations of health system–based interventions in large-scale programs to improve complementary feeding (CF) practices are limited. Alive & Thrive applied principles of social franchising within the government health system in Vietnam to improve the quality of interpersonal counseling (IPC) for infant and young child feeding combined with a national mass media (MM) campaign and community mobilization (CM). Objective: We evaluated the impact of enhanced IPC + MM + CM (intensive) compared with standard IPC + less-intensive MM and CM (nonintensive) on CF practices and anthropometric indicators. Methods: A cluster-randomized, nonblinded evaluation design with cross-sectional surveys (n = ∼500 children aged 6–23.9 mo and ∼1000 children aged 24–59.9 mo/group) implemented at baseline (2010) and endline (2014) was used. Difference-in-difference estimates (DDEs) of impact were calculated for intent-to-treat (ITT) analyses and modified per-protocol analyses (MPAs; mothers who attended the social franchising at least once: 62%). Results: Groups were similar at baseline. In ITT analyses, there were no significant differences between groups in changes in CF practices over time. In the MPAs, greater improvements in the intensive than in the nonintensive group were seen for minimum dietary diversity [DDE: 6.4 percentage points (pps); P < 0.05] and minimum acceptable diet (8.0 pps; P < 0.05). Significant stunting declines occurred in both intensive (7.1 pps) and nonintensive (5.4 pps) groups among children aged 24–59.9 mo, with no differential decline. Conclusions: When combined with MM and CM, an at-scale social franchising approach to improve IPC, delivered through the existing health care system, significantly improved CF practices, but not child growth, among mothers who used counseling services at least once. A greater impact may be achieved with strategies designed to increase service utilization. This trial was registered at clinicaltrials.gov as NCT01676623. PMID:28179488
Social Franchising and a Nationwide Mass Media Campaign Increased the Prevalence of Adequate Complementary Feeding in Vietnam: A Cluster-Randomized Program Evaluation.

PubMed

Rawat, Rahul; Nguyen, Phuong Hong; Tran, Lan Mai; Hajeebhoy, Nemat; Nguyen, Huan Van; Baker, Jean; Frongillo, Edward A; Ruel, Marie T; Menon, Purnima

2017-04-01

Background: Rigorous evaluations of health system-based interventions in large-scale programs to improve complementary feeding (CF) practices are limited. Alive & Thrive applied principles of social franchising within the government health system in Vietnam to improve the quality of interpersonal counseling (IPC) for infant and young child feeding combined with a national mass media (MM) campaign and community mobilization (CM). Objective: We evaluated the impact of enhanced IPC + MM + CM (intensive) compared with standard IPC + less-intensive MM and CM (nonintensive) on CF practices and anthropometric indicators. Methods: A cluster-randomized, nonblinded evaluation design with cross-sectional surveys ( n = ∼500 children aged 6-23.9 mo and ∼1000 children aged 24-59.9 mo/group) implemented at baseline (2010) and endline (2014) was used. Difference-in-difference estimates (DDEs) of impact were calculated for intent-to-treat (ITT) analyses and modified per-protocol analyses (MPAs; mothers who attended the social franchising at least once: 62%). Results: Groups were similar at baseline. In ITT analyses, there were no significant differences between groups in changes in CF practices over time. In the MPAs, greater improvements in the intensive than in the nonintensive group were seen for minimum dietary diversity [DDE: 6.4 percentage points (pps); P < 0.05] and minimum acceptable diet (8.0 pps; P < 0.05). Significant stunting declines occurred in both intensive (7.1 pps) and nonintensive (5.4 pps) groups among children aged 24-59.9 mo, with no differential decline. Conclusions: When combined with MM and CM, an at-scale social franchising approach to improve IPC, delivered through the existing health care system, significantly improved CF practices, but not child growth, among mothers who used counseling services at least once. A greater impact may be achieved with strategies designed to increase service utilization. This trial was registered at clinicaltrials.gov as NCT01676623.

Impact of payments for environmental services and protected areas on local livelihoods and forest conservation in northern Cambodia.

PubMed

Clements, Tom; Milner-Gulland, E J

2015-02-01

The potential impacts of payments for environmental services (PES) and protected areas (PAs) on environmental outcomes and local livelihoods in developing countries are contentious and have been widely debated. The available evidence is sparse, with few rigorous evaluations of the environmental and social impacts of PAs and particularly of PES. We measured the impacts on forests and human well-being of three different PES programs instituted within two PAs in northern Cambodia, using a panel of intervention villages and matched controls. Both PES and PAs delivered additional environmental outcomes relative to the counterfactual: reducing deforestation rates significantly relative to controls. PAs increased security of access to land and forest resources for local households, benefiting forest resource users but restricting households' ability to expand and diversify their agriculture. The impacts of PES on household well-being were related to the magnitude of the payments provided. The two higher paying market-linked PES programs had significant positive impacts, whereas a lower paying program that targeted biodiversity protection had no detectable effect on livelihoods, despite its positive environmental outcomes. Households that signed up for the higher paying PES programs, however, typically needed more capital assets; hence, they were less poor and more food secure than other villagers. Therefore, whereas the impacts of PAs on household well-being were limited overall and varied between livelihood strategies, the PES programs had significant positive impacts on livelihoods for those that could afford to participate. Our results are consistent with theories that PES, when designed appropriately, can be a powerful new tool for delivering conservation goals whilst benefiting local people. © 2014 The Authors. Conservation Biology published by Wiley Periodicals, Inc. on behalf of Society for Conservation Biology.
School nurses' role in asthma management, school absenteeism, and cost savings: a demonstration project.

PubMed

Rodriguez, Eunice; Rivera, Diana Austria; Perlroth, Daniella; Becker, Edmund; Wang, Nancy Ewen; Landau, Melinda

2013-12-01

With increasing budget cuts to education and social services, rigorous evaluation needs to document school nurses' impact on student health, academic outcomes, and district funding. Utilizing a quasi-experimental design, we evaluated outcomes in 4 schools with added full-time nurses and 5 matched schools with part-time nurses in the San Jose Unified School District. Student data and logistic regression models were used to examine predictors of illness-related absenteeism for 2006-2007 and 2008-2009. We calculated average daily attendance (ADA) funding and parent wages associated with an improvement in illness-related absenteeism. Utilizing parent surveys, we also estimated the cost of services for asthma-related visits to the emergency room (ER; N = 2489). Children with asthma were more likely to be absent due to illness; however, mean absenteeism due to illness decreased when full-time nurses were added to demonstration schools but increased in comparison schools during 2008-2009, resulting in a potential savings of $48,518.62 in ADA funding (N = 6081). Parents in demonstration schools reported fewer ER visits, and the estimated savings in ER services and parent wages were significant. Full-time school nurses play an important role in improving asthma management among students in underserved schools, which can impact school absenteeism and attendance-related economic costs. © 2013, American School Health Association.
Rationale, challenges, and participants in a Phase II trial of a botanical product for chronic hepatitis C

PubMed Central

Belle, Steven H; Fried, Michael W; Afdhal, Nezam; Navarro, Victor J; Hawke, Roy L; Wahed, Abdus S; Doo, Edward; Meyers, Catherine M

2012-01-01

Background Chronic hepatitis C is associated with significant morbidity and mortality as a consequence of progression to cirrhosis, hepatocellular carcinoma, and liver failure. Current treatment for chronic hepatitis C with pegylated interferon (IFN) and ribavirin is associated with suboptimal responses and numerous adverse effects. A number of botanical products have been used to treat hepatic disorders. Silymarin, extracted from the milk thistle plant, Silybum marianum (L) Gaertn. (Asteraceae), has been most widely used for various liver disorders, including chronic hepatitis C, B, and alcoholic liver disease. However, the safety and efficacy of silymarin have not been studied systematically in chronic hepatitis C. Purpose We describe our strategy for a phased approach for studying the impact of silymarin in hepatitis C, in the context of the unique challenges of botanical product clinical trials and the development of specific and curative antiviral therapy. Methods This multicenter, randomized, double-masked, placebo-controlled trial was conducted with four clinical centers and a data-coordinating center in the United States, to assess the impact of silymarin therapy in patients with chronic hepatitis C who failed conventional antiviral therapy. Results Key aspects relevant to performing clinical trials of botanical products include early identification of an appropriate product with standard product chemistry, acquisition of pharmacokinetic and dosing information, selection of the appropriate study group, and choosing rigorous outcome variables. Potential limitations Trial participants were chronic hepatitis C patients who were nonsustained virologic responders to IFN-based therapy; therefore, the findings are not generalizable to all hepatitis C populations. Further, alanine aminotransferase, a biochemical liver test, rather than hepatitis viral RNA or liver histology was the primary end point. Conclusions The challenges identified and addressed during development of this United States multicenter Phase II trial to evaluate silymarin for treatment of patients with chronic hepatitis C infection who had failed to respond successfully to previous IFN-based therapy are common and must be addressed to conduct rigorous trials of botanical products. PMID:22058086
Rationale, challenges, and participants in a Phase II trial of a botanical product for chronic hepatitis C.

PubMed

Reddy, K Rajender; Belle, Steven H; Fried, Michael W; Afdhal, Nezam; Navarro, Victor J; Hawke, Roy L; Wahed, Abdus S; Doo, Edward; Meyers, Catherine M

2012-02-01

Chronic hepatitis C is associated with significant morbidity and mortality as a consequence of progression to cirrhosis, hepatocellular carcinoma, and liver failure. Current treatment for chronic hepatitis C with pegylated interferon (IFN) and ribavirin is associated with suboptimal responses and numerous adverse effects. A number of botanical products have been used to treat hepatic disorders. Silymarin, extracted from the milk thistle plant, Silybum marianum (L) Gaertn. (Asteraceae), has been most widely used for various liver disorders, including chronic hepatitis C, B, and alcoholic liver disease. However, the safety and efficacy of silymarin have not been studied systematically in chronic hepatitis C. We describe our strategy for a phased approach for studying the impact of silymarin in hepatitis C, in the context of the unique challenges of botanical product clinical trials and the development of specific and curative antiviral therapy. This multicenter, randomized, double-masked, placebo-controlled trial was conducted with four clinical centers and a data-coordinating center in the United States, to assess the impact of silymarin therapy in patients with chronic hepatitis C who failed conventional antiviral therapy. Key aspects relevant to performing clinical trials of botanical products include early identification of an appropriate product with standard product chemistry, acquisition of pharmacokinetic and dosing information, selection of the appropriate study group, and choosing rigorous outcome variables. POTENTIAL LIMITATIONS: Trial participants were chronic hepatitis C patients who were nonsustained virologic responders to IFN-based therapy; therefore, the findings are not generalizable to all hepatitis C populations. Further, alanine aminotransferase, a biochemical liver test, rather than hepatitis viral RNA or liver histology was the primary end point. The challenges identified and addressed during development of this United States multicenter Phase II trial to evaluate silymarin for treatment of patients with chronic hepatitis C infection who had failed to respond successfully to previous IFN-based therapy are common and must be addressed to conduct rigorous trials of botanical products.
A randomised study of leadership interventions for healthcare managers.

PubMed

Lornudd, Caroline; Bergman, David; Sandahl, Christer; von Thiele Schwarz, Ulrica

2016-10-03

Purpose The purpose of this paper was to assess two different leader development interventions by comparing their effects on leadership behaviour and evaluating their combined impact after two years, from the viewpoints of both the participating managers and external raters. Design/methodology/approach The study was a longitudinal randomised controlled trial with a cross-over design. Health care managers ( n = 177) were first randomised to either of two 10-month interventions and a year later were switched to the other intervention. Leadership behaviour was rated at pre-test and 12 and 24 months by participating managers and their superiors, colleagues and subordinates using a 360-degree instrument. Analysis of variance and multilevel regression analysis was performed. Findings No difference in effect on leadership behaviour was found between the two interventions. The evaluation of the combined effect of the interventions on leadership behaviour showed inconsistent (i.e. both increased and decreased) ratings by the various rater sources. Practical implications This study provides some evidence that participation in leadership development programmes can improve managers' leadership behaviours, but the results also highlight the interpretive challenges connected with using a 360-degree instrument to evaluate such development. Originality/value The longitudinal randomised controlled design and the large sample comprising both managers and external raters make this study unusually rigorous in the field of leadership development evaluations.
Is women’s empowerment contributing to a decline in intimate partner violence against women in Bangladesh? Evidence from a qualitative study

PubMed Central

Schuler, Sidney Ruth; Lenzi, Rachel; Nazneen, Sohela; Bates, Lisa M.

2013-01-01

The Bangladesh government, nongovernmental organizations, donors, and advocacy groups have attempted various interventions to promote gender equality and reduce intimate partner violence (IPV) against women, but rigorous evaluations of these interventions are rare and few published studies have yet to show that any of them has had a substantial impact. This study presents qualitative evidence from four villages in central and northern Bangladesh drawn from 11 group discussions (6 with men, 5 with women), 16 open-ended interviews with men, and 62 women’s life history narratives. The findings strongly suggest that IPV is declining in these villages as women’s economic roles expand and they gain a stronger sense of their rights. Periodic surveys are recommended to measure trends in the incidence of IPV in settings where transitions in gender systems are under way. PMID:24006072
The rehabilitation engineering research center for the advancement of cognitive technologies.

PubMed

Heyn, Patricia Cristine; Cassidy, Joy Lucille; Bodine, Cathy

2015-02-01

Barring few exceptions, allied health professionals, engineers, manufacturers of assistive technologies (ATs), and consumer product manufacturers have developed few technologies for individuals with cognitive impairments (CIs). In 2004, the National Institute on Disability Rehabilitation Research (NIDRR) recognized the need to support research in this emergent field. They funded the first Rehabilitation Engineering Research Center for the Advancement of Cognitive Technologies (RERC-ACT). The RERC-ACT has since designed and evaluated existing and emerging technologies through rigorous research, improving upon existing AT devices, and creating new technologies for individuals with CIs. The RERC-ACT has contributed to the development and testing of AT products that assist persons with CIs to actively engage in tasks of daily living at home, school, work, and in the community. This article highlights the RERC-ACT's engineering development and research projects and discusses how current research may impact the quality of life for an aging population. © The Author(s) 2014.
Nondestructive Analysis of Apollo Samples by Micro-CT and Micro-XRF Analysis: A PET Style Examination

NASA Technical Reports Server (NTRS)

Zeigler, Ryan A.

2014-01-01

An integral part of any sample return mission is the initial description and classification of returned samples by the preliminary examination team (PET). The goal of a PET is to characterize and classify the returned samples, making this information available to the general research community who can then conduct more in-depth studies on the samples. A PET strives to minimize the impact their work has on the sample suite, which often limits the PET work to largely visual measurements and observations like optical microscopy. More modern techniques can also be utilized by future PET to nondestructively characterize astromaterials in a more rigorous way. Here we present our recent analyses of Apollo samples 14321 and 14305 by micro-CT and micro-XRF (respectively), assess the potential for discovery of "new" Apollo samples for scientific study, and evaluate the usefulness of these techniques in future PET efforts.
A Transdisciplinary Approach to Public Health Law: The Emerging Practice of Legal Epidemiology

PubMed Central

Burris, Scott; Ashe, Marice; Levin, Donna; Penn, Matthew; Larkin, Michelle

2017-01-01

Public health law has roots in both law and science. For more than a century, lawyers have helped develop and implement health laws; over the past 50 years, scientific evaluation of the health effects of laws and legal practices has achieved high levels of rigor and influence. We describe an emerging model of public health law that unites these two traditions. This transdisciplinary model adds scientific practices to the lawyerly functions of normative and doctrinal research, counseling, and representation. These practices include policy surveillance and empirical public health law research on the efficacy of legal interventions and the impact of laws and legal practices on health and health system operation. A transdisciplinary model of public health law, melding its legal and scientific facets, can help break down enduring cultural, disciplinary, and resource barriers that have prevented the full recognition and optimal role of law in public health. PMID:26667606
A Transdisciplinary Approach to Public Health Law: The Emerging Practice of Legal Epidemiology.

PubMed

Burris, Scott; Ashe, Marice; Levin, Donna; Penn, Matthew; Larkin, Michelle

2016-01-01

Public health law has roots in both law and science. For more than a century, lawyers have helped develop and implement health laws; over the past 50 years, scientific evaluation of the health effects of laws and legal practices has achieved high levels of rigor and influence. We describe an emerging model of public health law that unites these two traditions. This transdisciplinary model adds scientific practices to the lawyerly functions of normative and doctrinal research, counseling, and representation. These practices include policy surveillance and empirical public health law research on the efficacy of legal interventions and the impact of laws and legal practices on health and health system operation. A transdisciplinary model of public health law, melding its legal and scientific facets, can help break down enduring cultural, disciplinary, and resource barriers that have prevented the full recognition and optimal role of law in public health.
Is methicillin-resistant Staphylococcus aureus replacing methicillin-susceptible S. aureus?

PubMed Central

Mostofsky, Elizabeth; Lipsitch, Marc; Regev-Yochay, Gili

2011-01-01

Despite extensive research on the emergence of and treatments for methicillin-resistant Staphylococcus aureus (MRSA), prior studies have not rigorously evaluated the impact of methicillin resistance on the overall incidence of S. aureus infections. Yet, there are direct clinical and research implications of determining whether methicillin-susceptible S. aureus (MSSA) infection rates remain stable in the face of increasing MRSA prevalence or whether MSSA will be replaced over time. A synthesis of prior studies indicates that the emergence of healthcare-associated MRSA (HA-MRSA) and community-associated MRSA (CA-MRSA) has led to an increase in the overall incidence of S. aureus infections, with MRSA principally adding to, rather than replacing, MSSA. However, colonization with CA-MRSA may at least partially replace colonization with MSSA. So far, evidence indicates that MSSA still accounts for many infections. Therefore, eradication of MRSA alone is not sufficient to address the public health burden of S. aureus. PMID:21737459
Predicting and downscaling ENSO impacts on intraseasonal precipitation statistics in California: The 1997/98 event

USGS Publications Warehouse

Gershunov, A.; Barnett, T.P.; Cayan, D.R.; Tubbs, T.; Goddard, L.

2000-01-01

Three long-range forecasting methods have been evaluated for prediction and downscaling of seasonal and intraseasonal precipitation statistics in California. Full-statistical, hybrid-dynamical - statistical and full-dynamical approaches have been used to forecast El Nin??o - Southern Oscillation (ENSO) - related total precipitation, daily precipitation frequency, and average intensity anomalies during the January - March season. For El Nin??o winters, the hybrid approach emerges as the best performer, while La Nin??a forecasting skill is poor. The full-statistical forecasting method features reasonable forecasting skill for both La Nin??a and El Nin??o winters. The performance of the full-dynamical approach could not be evaluated as rigorously as that of the other two forecasting schemes. Although the full-dynamical forecasting approach is expected to outperform simpler forecasting schemes in the long run, evidence is presented to conclude that, at present, the full-dynamical forecasting approach is the least viable of the three, at least in California. The authors suggest that operational forecasting of any intraseasonal temperature, precipitation, or streamflow statistic derivable from the available records is possible now for ENSO-extreme years.
The impact of stunning methods on stress conditions and quality of silver carp (Hypophthalmichthys molitrix) fillets stored at 4°C during 72h postmortem.

PubMed

Zhang, Longteng; Li, Qian; Lyu, Jian; Kong, Chunli; Song, Sijia; Luo, Yongkang

2017-02-01

This study aimed to evaluate different stunning methods [percussion (T1), immersion in ice/water slurry (T2), and gill cut (T3)] on quality and stress conditions of silver carp (Hypophthalmichthys molitrix) fillets stored at 4°C in 72h postmortem. Rigor index (RI%), behavioral analysis, levels of lactic acid and muscle glycogen were measured for stress level evaluation. Meanwhile, sensory assessment, texture properties, cooking loss, adenosine triphosphate (ATP) related compounds, adenosine monophosphate deaminase (ADA) activity, and acid phosphatase (ACP) activity were analyzed. The least stress condition, significantly (P<0.05) higher initial glycogen content was observed in T1. Ice/water stunning reduced the rate of ATP degradation, reflected in the lowest K value during 72h. Aversive behaviors, significantly (P<0.05) higher cooking loss, hypoxanthine riboside (HxR) content, and lower sensory score were observed in T3. The results indicated that gill cut in aquatic processing industry should be avoided for inferior quality and aversive reactions during stunning. Copyright © 2016 Elsevier Ltd. All rights reserved.
Asthma management simulation for children: translating theory, methods, and strategies to effect behavior change.

PubMed

Shegog, Ross; Bartholomew, L Kay; Gold, Robert S; Pierrel, Elaine; Parcel, Guy S; Sockrider, Marianna M; Czyzewski, Danita I; Fernandez, Maria E; Berlin, Nina J; Abramson, Stuart

2006-01-01

Translating behavioral theories, models, and strategies to guide the development and structure of computer-based health applications is well recognized, although a continued challenge for program developers. A stepped approach to translate behavioral theory in the design of simulations to teach chronic disease management to children is described. This includes the translation steps to: 1) define target behaviors and their determinants, 2) identify theoretical methods to optimize behavioral change, and 3) choose educational strategies to effectively apply these methods and combine these into a cohesive computer-based simulation for health education. Asthma is used to exemplify a chronic health management problem and a computer-based asthma management simulation (Watch, Discover, Think and Act) that has been evaluated and shown to effect asthma self-management in children is used to exemplify the application of theory to practice. Impact and outcome evaluation studies have indicated the effectiveness of these steps in providing increased rigor and accountability, suggesting their utility for educators and developers seeking to apply simulations to enhance self-management behaviors in patients.
New linked data on research investments: scientific workforce, productivity, and public value

PubMed Central

Lane, Julia; Owen-Smith, Jason; Rosen, Rebecca; Weinberg, Bruce

2015-01-01

Longitudinal micro-data derived from transaction level information about wage and vendor payments made by federal grants on multiple U.S. campuses are being developed in a partnership involving researchers, university administrators, representatives of federal agencies, and others. This paper describes the UMETRICS data initiative that has been implemented under the auspices of the Committee on Institutional Cooperation. The resulting data set reflects an emerging conceptual framework for analyzing the process, products, and impact of research. It grows from and engages the work of a diverse and vibrant community. This paper situates the UMETRICS effort in the context of research evaluation and ongoing data infrastructure efforts in order to highlight its novel and valuable features. Refocusing data construction in this field around individuals, networks, and teams offers dramatic possibilities for data linkage, the evaluation of research investments, and the development of rigorous conceptual and empirical models. Two preliminary analyses of the scientific workforce and network approaches to characterizing scientific teams ground a discussion of future directions and a call for increased community engagement. PMID:26335785
Development of rigor mortis is not affected by muscle volume.

PubMed

Kobayashi, M; Ikegaya, H; Takase, I; Hatanaka, K; Sakurada, K; Iwase, H

2001-04-01

There is a hypothesis suggesting that rigor mortis progresses more rapidly in small muscles than in large muscles. We measured rigor mortis as tension determined isometrically in rat musculus erector spinae that had been cut into muscle bundles of various volumes. The muscle volume did not influence either the progress or the resolution of rigor mortis, which contradicts the hypothesis. Differences in pre-rigor load on the muscles influenced the onset and resolution of rigor mortis in a few pairs of samples, but did not influence the time taken for rigor mortis to reach its full extent after death. Moreover, the progress of rigor mortis in this muscle was biphasic; this may reflect the early rigor of red muscle fibres and the late rigor of white muscle fibres.
Experimental evaluation of rigor mortis. VIII. Estimation of time since death by repeated measurements of the intensity of rigor mortis on rats.

PubMed

Krompecher, T

1994-10-21

The development of the intensity of rigor mortis was monitored in nine groups of rats. The measurements were initiated after 2, 4, 5, 6, 8, 12, 15, 24, and 48 h post mortem (p.m.) and lasted 5-9 h, which ideally should correspond to the usual procedure after the discovery of a corpse. The experiments were carried out at an ambient temperature of 24 degrees C. Measurements initiated early after death resulted in curves with a rising portion, a plateau, and a descending slope. Delaying the initial measurement translated into shorter rising portions, and curves initiated 8 h p.m. or later are comprised of a plateau and/or a downward slope only. Three different phases were observed suggesting simple rules that can help estimate the time since death: (1) if an increase in intensity was found, the initial measurements were conducted not later than 5 h p.m.; (2) if only a decrease in intensity was observed, the initial measurements were conducted not earlier than 7 h p.m.; and (3) at 24 h p.m., the resolution is complete, and no further changes in intensity should occur. Our results clearly demonstrate that repeated measurements of the intensity of rigor mortis allow a more accurate estimation of the time since death of the experimental animals than the single measurement method used earlier. A critical review of the literature on the estimation of time since death on the basis of objective measurements of the intensity of rigor mortis is also presented.
Professional Practice, Student Surveys, and Value-Added: Multiple Measures of Teacher Effectiveness in the Pittsburgh Public Schools. REL 2014-024

ERIC Educational Resources Information Center

Chaplin, Duncan; Gill, Brian; Thompkins, Allison; Miller, Hannah

2014-01-01

Responding to federal and state prompting, school districts across the country are implementing new teacher evaluation systems that aim to increase the rigor of evaluation ratings, better differentiate effective teaching, and support personnel and staff development initiatives that promote teacher effectiveness and ultimately improve student…
Providing Home Visiting to High-Risk Pregnant and Postpartum Families: The Development and Evaluation of the MOMobile® Program

ERIC Educational Resources Information Center

Hadley, Barbara; Rudolph, Kara E.; Mogul, Marjie; Perry, Deborah F.

2014-01-01

Maternal, Infant, and Early Childhood Home Visiting legislation permits states to fund "promising practices"--with the understanding that these models will have a rigorous evaluation component. This article describes an innovative, low cost paraprofessional home visiting model developed in Pennsylvania by the Maternity Care Coalition. In…
EVALUATION OF THE NEW YORK STATE EDUCATION DEPARTMENT CONFERENCE, NUMBER 1.

ERIC Educational Resources Information Center

GREEN, ROBERT L.

THE MAJOR PROBLEM FACING EDUCATION, ACCORDING TO THIS REVIEW OF THE CONFERENCE, IS TO DEVELOP THE MOST EFFECTIVE LEARNING PROGRAMS FOR DISADVANTAGED YOUTH, WHICH SHOULD BE EVALUATED SCIENTIFICALLY. RIGOROUS STUDY IS NEEDED OF SUCH ISSUES AS (1) THE NATURE OF THE MOST EFFECTIVE PROGRAM FOR THE DISADVANTAGED LEARNER, (2) THE ASSESSMENT OF THE BASIC…

Evaluation of insecticides for protecting southwestern ponderosa pines from attack by engraver beetles (Coleoptera: Curculionidae: Scolytinae)

Treesearch

Tom E. DeGomez; Christopher J. Hayes; John A. Anhold; Joel D. McMillin; Karen M. Clancy; Paul P. Bosu

2006-01-01

Insecticides that might protect pine trees from attack by engraver beetles (Ips spp.) have not been rigorously tested in the southwestern United States. We conducted two field experiments to evaluate the efficacy of several currently and potentially labeled preventative insecticides for protecting high-value ponderosa pine, Pinus ponderosa...
Toward More Critical Reviewing and Analysis of CD-ROM User Software Interfaces.

ERIC Educational Resources Information Center

Zink, Steven D.

1991-01-01

Criticizes reviews of library CD-ROM products as being uncritical of the user interface and advocates a more rigorous evaluation, not only to aid potential buyers, but as a way to influence manufacturers. Congressional Information Services' Masterfile 2 is evaluated in the context of Heckel's "Principles of Friendly Software Design." (24…
Collaborative Research in Child Welfare: A Rationale for Rigorous Participatory Evaluation Designs to Promote Sustained Systems Change

ERIC Educational Resources Information Center

Collins-Camargo, Crystal; Shackelford, Kim; Kelly, Michael; Martin-Galijatovic, Ramie

2011-01-01

Expansion of the child welfare evidence base is a major challenge. The field must establish how organizational systems and practice techniques yield outcomes for children and families. Needed research must be grounded in practice and must engage practitioners and administrators via participatory evaluation. The extent to which successful practices…
Teaching MBA Students Teamwork and Team Leadership Skills: An Empirical Evaluation of a Classroom Educational Program

ERIC Educational Resources Information Center

Hobson, Charles J.; Strupeck, David; Griffin, Andrea; Szostek, Jana; Rominger, Anna S.

2014-01-01

A comprehensive educational program for teaching behavioral teamwork and team leadership skills was rigorously evaluated with 148 MBA students enrolled at an urban regional campus of a Midwestern public university. Major program components included (1) videotaped student teams in leaderless group discussion (LGD) exercises at the course beginning…
76 FR 51056 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Request for Comment

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-17

... assigned to the control group can re-apply to the YouthBuild program. The Department is soliciting comments... ``utilize appropriate methodology and research designs, including the use of control groups chosen by.... Accordingly, ETA is conducting a multisite control group evaluation to provide rigorous estimates [[Page 51058...
Statistical linearization for multi-input/multi-output nonlinearities

NASA Technical Reports Server (NTRS)

Lin, Ching-An; Cheng, Victor H. L.

1991-01-01

Formulas are derived for the computation of the random input-describing functions for MIMO nonlinearities; these straightforward and rigorous derivations are based on the optimal mean square linear approximation. The computations involve evaluations of multiple integrals. It is shown that, for certain classes of nonlinearities, multiple-integral evaluations are obviated and the computations are significantly simplified.
Good Evaluation Measures: More than Their Psychometric Properties

ERIC Educational Resources Information Center

Weitzman, Beth C.; Silver, Diana

2013-01-01

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…
Evidence-Based Psychosocial Treatments for Phobic and Anxiety Disorders in Children and Adolescents

ERIC Educational Resources Information Center

Silverman, Wendy K.; Pina, Armando A.; Viswesvaran, Chockalingam

2008-01-01

The article reviews psychosocial treatments for phobic and anxiety disorders in youth. Using criteria from Nathan and Gorman (2002), 32 studies are evaluated along a continuum of methodological rigor. In addition, the treatments evaluated in each of the 32 studies are classified according to Chambless et al.'s (1996) and Chambless and Hollon's…
Using Small-Scale Randomized Controlled Trials to Evaluate the Efficacy of New Curricular Materials

ERIC Educational Resources Information Center

Drits-Esser, Dina; Bass, Kristin M.; Stark, Louisa A.

2014-01-01

How can researchers in K-12 contexts stay true to the principles of rigorous evaluation designs within the constraints of classroom settings and limited funding? This paper explores this question by presenting a small-scale randomized controlled trial (RCT) designed to test the efficacy of curricular supplemental materials on epigenetics. The…
The impact of employee assistance services on workplace outcomes: Results of a prospective, quasi-experimental study.

PubMed

Richmond, Melissa K; Pampel, Fred C; Wood, Randi C; Nunes, Ana P

2017-04-01

Employee Assistance Programs (EAPs) are widely used to help employees experiencing personal or work-related difficulties that impact work productivity. However, rigorous research on the effectiveness of programs to improve work-related outcomes is lacking. The current study represents a major advance in EAP research by using a prospective, quasi-experimental design with a large and diverse employee base. Using propensity scores calculated from demographic, social, work-related, and psychological variables collected on baseline surveys, we matched 156 employees receiving EAP to 188 non-EAP employees. Follow-up surveys were collected from 2 to 12 months post-baseline (M = 6.0). At follow-up, EAP employees had significantly greater reductions in absenteeism (b = -.596, p = .001) and presenteeism (b = -.217, p = .038), but not workplace distress (b = -.079, p = .448), than did non-EAP employees. Tests of moderation of baseline alcohol use, depression, anxiety, and productivity indicate that for the most part, the program works equally well for all groups. However, EAP did more to reduce absenteeism for those who began with lower severity of depression and anxiety at baseline. Results provide the scientific rigor needed to demonstrate EAP impact on improved work outcomes. In the first study of its kind, findings confirm the value of EAPs to help employees address personal and work-related concerns that are affecting job performance. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Cultural Competence in the Treatment of Addictions: Theory, Practice and Evidence.

PubMed

Gainsbury, Sally M

2017-07-01

Culturally and linguistically diverse (CALD) populations often have high rates of addictive disorders, but lower rates of treatment seeking and completion than the mainstream population. A significant barrier to treatment is the lack of culturally relevant and appropriate treatment. A literature review was conducted to identify relevant literature related to cultural competence in mental health services delivery and specifically treatment for addictive disorders. Several theoretical models of cultural competence in therapy have been developed, but the lack of rigorous research limits the empirical evidence available. Research indicates that culturally competent treatment practices including providing therapy and materials in the client's language, knowledge, understanding and appreciation for cultural perspectives and nuances, involving the wider family and community and training therapists can enhance client engagement, retention and treatment outcomes for substance use and gambling. Further methodologically rigorous research is needed to isolate the impact of cultural competence for the treatment of addictions and guide research to determine treatment efficacy within specific CALD populations. Training therapists and recruiting therapists and researchers from CALD communities is important to ensure an ongoing focus and improved outcomes for CALD populations due to the importance of engaging these populations with addiction treatment. Copyright © 2016 John Wiley & Sons, Ltd. Key Practitioner Message: The treatment needs of culturally diverse individuals with addictions are often not met. Theoretical models can guide therapists in incorporating cultural competence. Culturally targeted treatments increase recruitment, retention and treatment outcomes. Cultural competence includes matching clinicians and clients on linguistic and cultural backgrounds as well as being mindful of the impact of culture on client's experience of addiction problems. Few methodologically rigorous trials have been conducted to guide treatment practices and research needs to be incorporated into existing culturally relevant treatment services. Copyright © 2016 John Wiley & Sons, Ltd.
Adjoint-Based Algorithms for Adaptation and Design Optimizations on Unstructured Grids

NASA Technical Reports Server (NTRS)

Nielsen, Eric J.

2006-01-01

Schemes based on discrete adjoint algorithms present several exciting opportunities for significantly advancing the current state of the art in computational fluid dynamics. Such methods provide an extremely efficient means for obtaining discretely consistent sensitivity information for hundreds of design variables, opening the door to rigorous, automated design optimization of complex aerospace configuration using the Navier-Stokes equation. Moreover, the discrete adjoint formulation provides a mathematically rigorous foundation for mesh adaptation and systematic reduction of spatial discretization error. Error estimates are also an inherent by-product of an adjoint-based approach, valuable information that is virtually non-existent in today's large-scale CFD simulations. An overview of the adjoint-based algorithm work at NASA Langley Research Center is presented, with examples demonstrating the potential impact on complex computational problems related to design optimization as well as mesh adaptation.
Practice guidelines for program evaluation in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2017-06-01

This paper proposes practice guidelines to evaluate community-based rehabilitation (CBR) programs. These were developed through a rigorous three-phase research process including a literature review on good practices in CBR program evaluation, a field study during which a South Africa CBR program was evaluated, and a Delphi study to generate consensus among a highly credible panel of CBR experts from a wide range of backgrounds and geographical areas. The 10 guidelines developed are summarized into a practice model highlighting key features of sound CBR program evaluation. They strongly indicate that sound CBR evaluations are those that give a voice and as much control as possible to the most affected groups, embrace the challenge of diversity, and foster use of evaluation processes and findings through a rigorous, collaborative and empowering approach. The practice guidelines should facilitate CBR evaluation decisions in respect to facilitating an evaluation process, using frameworks and designing methods. Implications for rehabilitation Ten practice guidelines provide guidance to facilitate sound community-based rehabilitation (CBR) program evaluation decisions. Key indications of good practice include: • being as participatory and empowering as possible; • ensuring that all, including the most affected, have a real opportunity to share their thoughts; • highly considering mixed methods and participatory tools; • adapting to fit evaluation context, local culture and language(s); • defining evaluation questions and reporting findings using shared CBR language when possible, which the framework offered may facilitate.
Technology Proliferation: Acquisition Strategies and Opportunities for an Uncertain Future

DTIC Science & Technology

2018-04-20

The large programs of record characteristic of federal acquisition consist of rigorous research, development, testing, and evaluation (RDT&E...and evaluation (IOT&E) activities drive the program toward the decision to enter full rate production (FRP). Finally, in the sustainment phase, the...the new feature by a full release at a later date, or halt the development altogether. As stated by the Director of Operational Test and Evaluation
Evaluation of the Academy of Math, Science, and Engineering at Luther Burbank High School During the 1984-85 School Year. Evaluation Report No. 21.

ERIC Educational Resources Information Center

Sacramento City Unified School District, CA.

The Academy of Math, Science, and Engineering was established at the Luther Burbank High School of Sacramento, California as a rigorous and competitive academic alternative program. This report contains an evaluation of the second year (1984-85) of the program. Program accomplishments are reviewed in the categories of: (1) student enrollment; (2)…
On Improving the Quality and Interpretation of Environmental Assessments using Statistical Analysis and Geographic Information Systems

NASA Astrophysics Data System (ADS)

Karuppiah, R.; Faldi, A.; Laurenzi, I.; Usadi, A.; Venkatesh, A.

2014-12-01

An increasing number of studies are focused on assessing the environmental footprint of different products and processes, especially using life cycle assessment (LCA). This work shows how combining statistical methods and Geographic Information Systems (GIS) with environmental analyses can help improve the quality of results and their interpretation. Most environmental assessments in literature yield single numbers that characterize the environmental impact of a process/product - typically global or country averages, often unchanging in time. In this work, we show how statistical analysis and GIS can help address these limitations. For example, we demonstrate a method to separately quantify uncertainty and variability in the result of LCA models using a power generation case study. This is important for rigorous comparisons between the impacts of different processes. Another challenge is lack of data that can affect the rigor of LCAs. We have developed an approach to estimate environmental impacts of incompletely characterized processes using predictive statistical models. This method is applied to estimate unreported coal power plant emissions in several world regions. There is also a general lack of spatio-temporal characterization of the results in environmental analyses. For instance, studies that focus on water usage do not put in context where and when water is withdrawn. Through the use of hydrological modeling combined with GIS, we quantify water stress on a regional and seasonal basis to understand water supply and demand risks for multiple users. Another example where it is important to consider regional dependency of impacts is when characterizing how agricultural land occupation affects biodiversity in a region. We developed a data-driven methodology used in conjuction with GIS to determine if there is a statistically significant difference between the impacts of growing different crops on different species in various biomes of the world.
Preserving pre-rigor meat functionality for beef patty production.

PubMed

Claus, J R; Sørheim, O

2006-06-01

Three methods were examined for preserving pre-rigor meat functionality in beef patties. Hot-boned semimembranosus muscles were processed as follows: (1) pre-rigor ground, salted, patties immediately cooked; (2) pre-rigor ground, salted and stored overnight; (3) pre-rigor injected with brine; and (4) post-rigor ground and salted. Raw patties contained 60% lean beef, 19.7% beef fat trim, 1.7% NaCl, 3.6% starch, and 15% water. Pre-rigor processing occurred at 3-3.5h postmortem. Patties made from pre-rigor ground meat had higher pH values; greater protein solubility; firmer, more cohesive, and chewier texture; and substantially lower cooking losses than the other treatments. Addition of salt was sufficient to reduce the rate and extent of glycolysis. Brine injection of intact pre-rigor muscles resulted in some preservation of the functional properties but not as pronounced as with salt addition to pre-rigor ground meat.
After Ten Years, National Board Certification Has Proven It Is Not a Passing Fad in the Library Media Field

ERIC Educational Resources Information Center

Purcell, Melissa

2011-01-01

To understand that National Board Certification is not a passing trend, it is important to take a look at its history. National Board Certified teachers are highly accomplished educators who have met rigorous standards. By achieving National Board Certification, media specialists provide evidence that they are impacting students' learning. The…
Adding to the Truth of the Matter: The Case for Qualitative Research.

PubMed

Florczak, Kristine L

2017-10-01

The purpose of this column is to discuss the impact that qualitative research has on translational research, whose aim is to improve the health and well-being of individuals. To that end, rigorous qualitative research is examined; translational research is entertained and the manner in which qualitative research can be a co-equal partner with quantitative research is proposed.
Los Angeles in an Era of Welfare Reform: Implications for Poor People and Community Well-being.

ERIC Educational Resources Information Center

Wolch, Jennifer; Sommer, Heidi

This report, framed by the region's foremost experts on poverty, is the first comprehensive and scientifically rigorous analysis of the implications of welfare reform for the people and communities of Los Angeles (California). Direct and indirect impacts are considered. It is concluded that the number of welfare recipients in Los Angeles likely to…

Who Chooses, Who Uses? Initial Evidence from the D.C. Opportunity Scholarship Program

ERIC Educational Resources Information Center

Wolf, Patrick; Eissa, Nada; Gutmann, Babette

2006-01-01

The federal government recently enacted its first school voucher program as a pilot project in the District of Columbia. To be eligible, students need to be entering grades K-12 and have a family income at or below 185 percent of the poverty level. Although a rigorous analysis of the Opportunity Scholarship Program's impact on student achievement…
The Impact of Racially Diverse Schools in a Democratic Society. Research Brief No. 3. Updated

ERIC Educational Resources Information Center

Eaton, Susan; Chirichigno, Gina

2011-01-01

This is the third in a series of briefs summarizing findings from the newest and most rigorous research related to racial and socioeconomic diversity in public schools. The studies on which this brief is based were published recently in three special issues of the peer-reviewed journal, "Teachers College Record," edited by Professors…
Classroom Assessment for Student Learning: Impact on Elementary School Mathematics in the Central Region. Final Report. NCEE 2011-4005

ERIC Educational Resources Information Center

Randel, Bruce; Beesley, Andrea D.; Apthorp, Helen; Clark, Tedra F.; Wang, Xin; Cicchinelli, Louis F.; Williams, Jean M.

2011-01-01

This study was conducted by the Central Region Educational Laboratory (REL Central) administered by Mid-continent Research for Education and Learning to provide educators and policymakers with rigorous evidence about the potential of Classroom Assessment for Student Learning (CASL) to improve student achievement. CASL is a widely used professional…
High School Exit Exams and Dropout in an Era of Increased Accountability

ERIC Educational Resources Information Center

Hemelt, Steven W.; Marcotte, Dave E.

2013-01-01

A key form of student-level accountability is the requirement for students to pass high school exit exams (HSEEs) in order to receive a diploma. In this paper, we examine the impact of HSEEs on dropout during a period when these exams became more common and rigorous. Further, we study whether offering alternate pathways to graduation for students…
[The impact of policies on tobacco sales to young people at the point of purchase].

PubMed

Mihălţan, Florin

2013-01-01

In a concerted policy to tobacco control nothing noteworthy. However, point of sales and distributors of tobacco products have escaped the rigors of the law. In this article are analyzed the consequences of the absence of ban advertising at the level of distributors and retailers and exposed how to break this vicious circle.
The Negative Impact of Community Stressors on Learning Time: Examining Inequalities between California High Schools

ERIC Educational Resources Information Center

Mirra, Nicole; Rogers, John

2015-01-01

Allocated classroom time is not the same as time available for learning--a host of economic and social stressors undermine learning time in schools serving low-income students. When time is limited, it is hard to meet rigorous learning standards. The challenge is compounded in high-poverty schools where community stressors place additional demands…
School Closures in New York City: Did Students Do Better after Their High Schools Were Closed?

ERIC Educational Resources Information Center

Kemple, James J.

2016-01-01

Much has been written about the controversy surrounding performance-based school closures, but there has been no rigorous assessment of their impact on student achievement. Does the closure process harm students who are enrolled in a school while it is being phased out? Are future students better-off because a low-performing option has been…
An Art Museum in the Interest of Publicness: A Discussion of Educational Strategies at Tate Exchange

ERIC Educational Resources Information Center

Christensen-Scheel, Boel

2018-01-01

Influenced by needs to legitimise large collections and the position as public institutions, art museums today are searching to develop rigorous public strategies in order to increase numbers of visitors and public impact. Education is part of those strategies, and the need to discuss art education in relation to publicness and criticality arises.…
Adult Basic Educators' Descriptions of Standards Implementation and Its Influence on Cognitive Rigor

ERIC Educational Resources Information Center

Olson, Lia Conklin

2017-01-01

With only four years of mandated state-standards in adult basic education (ABE), very little is known about the influence of state-standards implementation on the unique learning needs of its adult students. Two decades of research on standards-based education in the U.S. K12 system has yielded widely debated results regarding the impact of…
Transnational English Language Learners Fighting on an Unlevel Playing Field: High School Exit Exams, Accommodations, and ESL Status

ERIC Educational Resources Information Center

Alexander, Mariko Mizuno

2017-01-01

Though previous research addresses the negative impact of state-mandated high school exit exams on English language learners' (ELLs) educational experiences, less attention has been given to how college-oriented ELLs, especially those who attended school in their home countries before coming to the US, handle rigorous exams or gain access to…
Does condom social marketing improve health outcomes and increase usage and equitable access?

PubMed

Knerr, Wendy

2011-05-01

Condom social marketing (CSM) has increased condom supplies, broadened commercial markets for condoms and introduced marketing innovations in developing countries. Yet rigorous and reliable evidence of the impact on condom usage and disease prevention is limited, as is evidence of the impact on equity of access to condoms for poor populations, women and people living with HIV. One strand of research on CSM reports mostly on output (e.g. sales and processes) and market growth; but these have been found to be highly unreliable measures of condom usage. Another strand of research reports primarily on changes in sexual behaviour, attitude or condom usage, using survey data. While random sampling is rare, these studies often use representative samples, which provide some measure of validity. There have been attempts to improve the reliability or results to good effect, but challenges remain for researchers, scholars and donors, including the need to supplement output data with measures of behaviour change, use rigorous designs which are built into programmes a priori, report on equity measures, report on potential harms of CSM programmes, and encourage external and systematic reviews. Copyright © 2011 Reproductive Health Matters. Published by Elsevier Ltd. All rights reserved.
Forty years of quality-of-life research in congenital heart disease: Temporal trends in conceptual and methodological rigor.

PubMed

Bratt, Ewa-Lena; Moons, Philip

2015-09-15

The first study on quality of life (QoL) in patients with congenital heart disease was published 40 years ago. Since then, the number of QoL articles on these patients has grown exponentially. We conducted a systematic literature review of all empirical studies on QoL in patients with congenital heart disease published since 1974, with the aim of determining the range of conceptual and methodological rigor of studies and identifying temporal trends in these parameters. PubMed, Embase, and Cinahl were searched for empirical studies addressing QoL in children, adolescents, or adults with congenital heart disease, published between January 1, 1974, and December 31, 2014. We applied 10 review criteria that were previously developed by Gill and Feinstein in 1994 and further refined by Moons et al. in 2004. Overall, 234 articles were reviewed. We found slight but non-significant temporal improvements in conceptual and methodological rigor and in use of assessment methods. This indicates a trend toward a more professional and exacting approach in QoL assessments. However, the majority of articles still had substantial conceptual and methodological deficits. Furthermore, we observed that citation of the publications of Gill and Feinstein and Moons et al. in published QoL research is associated with higher quality scores, suggesting that these articles have a positive impact on conceptual and methodological caliber. Despite 40 years of QoL research in this field, this review shows that major weaknesses in methodological rigor remain highly prevalent, which may make QoL studies inconclusive. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Partnered research in healthcare delivery redesign for high-need, high-cost patients: development and feasibility of an Intensive Management Patient-Aligned Care Team (ImPACT).

PubMed

Zulman, Donna M; Ezeji-Okoye, Stephen C; Shaw, Jonathan G; Hummel, Debra L; Holloway, Katie S; Smither, Sasha F; Breland, Jessica Y; Chardos, John F; Kirsh, Susan; Kahn, James S; Asch, Steven M

2014-12-01

We employed a partnered research healthcare delivery redesign process to improve care for high-need, high-cost (HNHC) patients within the Veterans Affairs (VA) healthcare system. Health services researchers partnered with VA national and Palo Alto facility leadership and clinicians to: 1) analyze characteristics and utilization patterns of HNHC patients, 2) synthesize evidence about intensive management programs for HNHC patients, 3) conduct needs-assessment interviews with HNHC patients (n = 17) across medical, access, social, and mental health domains, 4) survey providers (n = 8) about care challenges for HNHC patients, and 5) design, implement, and evaluate a pilot Intensive Management Patient-Aligned Care Team (ImPACT) for a random sample of 150 patients. HNHC patients accounted for over half (52 %) of VA facility patient costs. Most (94 %) had three or more chronic conditions, and 60 % had a mental health diagnosis. Formative data analyses and qualitative assessments revealed a need for intensive case management, care coordination, transitions navigation, and social support and services. The ImPACT multidisciplinary team developed care processes to meet these needs, including direct access to team members (including after-hours), chronic disease management protocols, case management, and rapid interventions in response to health changes or acute service use. Two-thirds of invited patients (n = 101) enrolled in ImPACT, 87 % of whom remained actively engaged at 9 months. ImPACT is now serving as a model for a national VA intensive management demonstration project. Partnered research that incorporated population data analysis, evidence synthesis, and stakeholder needs assessments led to the successful redesign and implementation of services for HNHC patients. The rigorous design process and evaluation facilitated dissemination of the intervention within the VA healthcare system. Employing partnered research to redesign care for high-need, high-cost patients may expedite development and dissemination of high-value, cost-saving interventions.
Changing over-the-counter ephedrine and pseudoephedrine products to prescription only: impacts on methamphetamine clandestine laboratory seizures.

PubMed

Cunningham, James K; Callaghan, Russell C; Tong, Daoqin; Liu, Lon-Mu; Li, Hsiao-Yun; Lattyak, William J

2012-11-01

Clandestine laboratory operators commonly extract ephedrine and pseudoephedrine-precursor chemicals used to synthesize methamphetamine-from over-the-counter cold/allergy/sinus products. To prevent this activity, two states, Oregon in 07/2006 and Mississippi in 07/2010, implemented regulations classifying ephedrine and pseudoephedrine as Schedule III substances, making products containing them available by prescription only. Using simple pre-regulation versus post-regulation comparisons, reports claim that the regulations have substantially reduced clandestine laboratory seizures (an indicator of laboratory prevalence) in both states, motivating efforts to implement similar regulation nationally. This study uses ARIMA-intervention time-series analysis to more rigorously evaluate the regulations' impacts on laboratory seizures. Monthly counts of methamphetamine clandestine laboratory seizures were extracted from the Clandestine Laboratory Seizure System (2000-early 2011) for Oregon, Mississippi and selected nearby states (for quasi-control). Seizures in Oregon and nearby western states largely bottomed out months before Oregon's regulation, and changed little thereafter. No significant impact for Oregon's regulation was found. Mississippi and nearby states generally had elevated seizures before Mississippi's regulation. Mississippi experienced a regulation-associated drop of 28.9 seizures (50.2%) in the series level (p<0.01), while nearby states exhibited no comparable decline. Oregon's regulation encountered a floor effect, making any sizable impact infeasible. Mississippi, however, realized a substantial impact, suggesting that laboratories, if sufficiently extant, can be meaningfully impacted by prescription precursor regulation. It follows that national prescription precursor regulation would have little impact in western states with low indicated laboratory prevalence, but may be of significant use in regions facing higher indicated prevalence. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.
Consensus statement: immunonutrition and exercise

USDA-ARS?s Scientific Manuscript database

In this section we evaluate the strengths and weaknesses of various biomarkers used in studies by nutritional immunologists (Table 1). An important consideration is that exercise immunologists often perform investigative work in the field, away from the rigorously controlled laboratory environment; ...
The effectiveness of interventions to reduce the household economic burden of illness and injury: a systematic review

PubMed Central

Kimman, Merel; Svenstrup, Nina; Lindevig Kjoege, Katharina; Lea Laba, Tracey; Hackett, Maree L; Jan, Stephen

2015-01-01

Abstract Objective To determine the nature, scope and effectiveness of interventions to reduce the household economic burden of illness or injury. Methods We systematically reviewed reports published on or before 31 January 2014 that we found in the CENTRAL, CINAHL, Econlit, Embase, MEDLINE, PreMEDLINE and PsycINFO databases. We extracted data from prospective controlled trials and assessed the risk of bias. We narratively synthesized evidence. Findings Nine of the 4330 studies checked met our inclusion criteria – seven had evaluated changes to existing health-insurance programmes and two had evaluated different modes of delivering information. The only interventions found to reduce out-of-pocket expenditure significantly were those that eliminated or substantially reduced co-payments for a given patient population. However, the reductions only represented marginal changes in the total expenditures of patients. We found no studies that had been effective in addressing broader household economic impacts – such as catastrophic health expenditure – in the disease populations investigated. Conclusion In general, interventions designed to reduce the complex household economic burden of illness and injury appear to have had little impact on household economies. We only found a few relevant studies using rigorous study designs that were conducted in defined patient populations. The studies were limited in the range of interventions tested and they evaluated only a narrow range of household economic outcomes. There is a need for method development to advance the measurement of the household economic consequences of illness and injury and facilitate the development of innovative interventions to supplement the strategies based on health insurance. PMID:25883403
Evaluation of item candidates for a diabetic retinopathy quality of life item bank.

PubMed

Fenwick, Eva K; Pesudovs, Konrad; Khadka, Jyoti; Rees, Gwyn; Wong, Tien Y; Lamoureux, Ecosse L

2013-09-01

We are developing an item bank assessing the impact of diabetic retinopathy (DR) on quality of life (QoL) using a rigorous multi-staged process combining qualitative and quantitative methods. We describe here the first two qualitative phases: content development and item evaluation. After a comprehensive literature review, items were generated from four sources: (1) 34 previously validated patient-reported outcome measures; (2) five published qualitative articles; (3) eight focus groups and 18 semi-structured interviews with 57 DR patients; and (4) seven semi-structured interviews with diabetes or ophthalmic experts. Items were then evaluated during 3 stages, namely binning (grouping) and winnowing (reduction) based on key criteria and panel consensus; development of item stems and response options; and pre-testing of items via cognitive interviews with patients. The content development phase yielded 1,165 unique items across 7 QoL domains. After 3 sessions of binning and winnowing, items were reduced to a minimally representative set (n = 312) across 9 domains of QoL: visual symptoms; ocular surface symptoms; activity limitation; mobility; emotional; health concerns; social; convenience; and economic. After 8 cognitive interviews, 42 items were amended resulting in a final set of 314 items. We have employed a systematic approach to develop items for a DR-specific QoL item bank. The psychometric properties of the nine QoL subscales will be assessed using Rasch analysis. The resulting validated item bank will allow clinicians and researchers to better understand the QoL impact of DR and DR therapies from the patient's perspective.
The ORNL Indoor Air Quality Study: Re-cap, Context, and Assessment on Radon

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tonn, Bruce Edward; Rose, Erin M.; Ternes, Mark P.

As part of the retrospective evaluation of the U.S. Department of Energy s low-income Weatherization Assistance Program that was led by Oak Ridge National Laboratory (ORNL), an assessment of the impacts of weatherization on indoor air quality (IAQ) was conducted. This assessment included nearly 500 treatment and control homes across the country. Homes were monitored for carbon monoxide, radon, formaldehyde, temperature and humidity pre- and post-weatherization. This report focuses on the topic of radon and addresses issues not thoroughly discussed in the original IAQ report. The size, scope and rigor of the radon component of the IAQ study are comparedmore » to previous studies that assessed the impacts of weatherization on indoor radon levels. It is found that the ORNL study is by far the most extensive study conducted to date, though the ORNL results are consistent with the findings of the other studies. However, the study does have limitations related to its reliance on short-term measurements of radon and inability to attribute changes in radon levels in homes post-weatherization to specific weatherization measures individually or in combination.« less
American Recovery and Reinvestment Act of 2009. Experiences from the Consumer Behavior Studies on Engaging Customers

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cappers, Peter; Scheer, Richard

2014-09-01

One of the most important aspects for the successful implementation of customer-facing programs is to better understand how to engage and communicate with consumers. Customer-facing programs include time-based rates, information and feedback, load management, and energy efficiency. This report presents lessons learned by utilities through consumer behavior studies (CBS) conducted as part of the Department of Energy’s (DOE) Smart Grid Investment Grant (SGIG) program. The SGIG CBS effort presents a unique opportunity to advance the understanding of consumer behaviors in terms of customer acceptance and retention, and electricity consumption and peak demand impacts. The effort includes eleven comprehensive studies withmore » the aim of evaluating the response of residential and small commercial customers to time-based rate programs implemented in conjunction with advanced metering infrastructure and customer systems such as in-home displays, programmable communicating thermostats, and web portals. DOE set guidelines and protocols that sought to help the utilities design studies that would rigorously test and more precisely estimate the impact of time-based rates on customers’ energy usage patterns, as well as identify the key drivers that motivate behavioral changes.« less
Rigorous Program Evaluations on a Budget: How Low-Cost Randomized Controlled Trials Are Possible in Many Areas of Social Policy

ERIC Educational Resources Information Center

Coalition for Evidence-Based Policy, 2012

2012-01-01

The increasing ability of social policy researchers to conduct randomized controlled trials (RCTs) at low cost could revolutionize the field of performance-based government. RCTs are widely judged to be the most credible method of evaluating whether a social program is effective, overcoming the demonstrated inability of other, more common methods…

Evaluation of the Tennessee Voluntary Prekindergarten Program: Kindergarten and First Grade Follow-Up Results from the Randomized Control Design. Research Report

ERIC Educational Resources Information Center

Lipsey, Mark W.; Hofer, Kerry G.; Dong, Nianbo; Farran, Dale C.; Bilbrey, Carol

2013-01-01

In 2009, Vanderbilt University's Peabody Research Institute, with the assistance of the Tennessee Department of Education's Division of Curriculum and Instruction, initiated a rigorous, independent evaluation of the state's Voluntary Prekindergarten program (TN- VPK). TN-VPK is a full-day prekindergarten program for four-year-old children expected…
The Development and Implementation of a Peer-Led Intervention to Prevent Smoking among Secondary School Students Using Their Established Social Networks

ERIC Educational Resources Information Center

Audrey, Suzanne; Cordall, Kathleen; Moore, Laurence; Cohen, David; Campbell, Rona

2004-01-01

Objective: To design, implement and evaluate a peer-led intervention to reduce smoking amongst secondary school students. Design: A health promotion intervention combining peer education with diffusion of innovation theory, to be rigorously evaluated by means of a cluster randomised controlled trial with concurrent process and economic…
A Multilevel Analysis of a Guided Inquiry Curriculum Unit on Motion and Force for a Diverse Student Population in "Ability-Grouped" Classrooms

ERIC Educational Resources Information Center

Rethinam, Vasuki; Lynch, Sharon J.

2011-01-01

This study is an evaluation of "Exploring Motion and Forces: Speed, Acceleration, and Friction" ("M&F") developed by ARIES of the Harvard-Smithsonian Center for Astrophysics (2001). Although "M&F" has been used in many schools and field-tested, it has never been evaluated in rigorous experimental or…
Staying on Course: Three-Year Results of the National Guard Youth ChalleNGe Evaluation. Executive Summary

ERIC Educational Resources Information Center

Millenky, Megan; Bloom, Dan; Muller-Ravett, Sara; Broadus, Joseph

2011-01-01

High school dropouts face an uphill battle in a labor market that increasingly rewards skills and postsecondary credentials: they are more likely than their peers to need public assistance, be arrested or incarcerated, and less likely to marry. This executive summary summarizes results from a rigorous evaluation of the National Guard Youth…
Technology-Enhanced Physics Programme for Community-Based Science Learning: Innovative Design and Programme Evaluation in a Theme Park

ERIC Educational Resources Information Center

Tho, Siew Wei; Chan, Ka Wing; Yeung, Yau Yuen

2015-01-01

In this study, a new physics education programme is specifically developed for a famous theme park in Hong Kong to provide community-based science learning to her visitors, involving her three newly constructed rides. We make innovative use of digital technologies in this programme and incorporate a rigorous evaluation of the learning…
Three Independent Evaluations of Healthy Kids Programs Find Substantial Gains in Children's Dental Health Care. In Brief, September 2008, Number 2

ERIC Educational Resources Information Center

Hughes, Dana; Howell, Embry; Trenholm, Christopher; Hill, Ian; Dubay, Lisa

2008-01-01

This brief presents highlights from rigorous, independent evaluations of the Healthy Kids programs in three California counties: Los Angeles, San Mateo, and Santa Clara. Launched by Children's Health Initiatives (CHIs) in these counties between 2001 and 2003, the three Healthy Kids programs provide children with comprehensive health insurance…
The Supporting Healthy Marriage Evaluation: Early Lessons from the Implementation of a Relationship and Marriage Skills Program for Low-Income Married Couples

ERIC Educational Resources Information Center

Gaubert, Jennifer Miller; Knox, Virginia; Alderson, Desiree Principe; Dalton, Christopher; Fletcher, Kate; McCormick, Meghan

2010-01-01

This report presents early implementation and operational lessons from the Supporting Healthy Marriage (SHM) evaluation. Funded by the Administration for Children and Families, SHM uses a rigorous research design to test the effectiveness of a new approach to improving outcomes for low-income children: strengthening the marriages and relationships…
Use of Evidence and Evaluation in the 2014 Budget. Memorandum to the Heads of Executive Departments and Agencies

ERIC Educational Resources Information Center

Zient, Jeffrey D.

2012-01-01

Since taking office, the President has emphasized the need to use evidence and rigorous evaluation in budget, management, and policy decisions to make government work effectively. This need has only grown in the current fiscal environment. Agencies should demonstrate the use of evidence throughout their Fiscal Year (FY) 2014 budget submissions.…
Competency Assessment in Senior Emergency Medicine Residents for Core Ultrasound Skills.

PubMed

Schmidt, Jessica N; Kendall, John; Smalley, Courtney

2015-11-01

Quality resident education in point-of-care ultrasound (POC US) is becoming increasingly important in emergency medicine (EM); however, the best methods to evaluate competency in graduating residents has not been established. We sought to design and implement a rigorous assessment of image acquisition and interpretation in POC US in a cohort of graduating residents at our institution. We evaluated nine senior residents in both image acquisition and image interpretation for five core US skills (focused assessment with sonography for trauma (FAST), aorta, echocardiogram (ECHO), pelvic, central line placement). Image acquisition, using an observed clinical skills exam (OSCE) directed assessment with a standardized patient model. Image interpretation was measured with a multiple-choice exam including normal and pathologic images. Residents performed well on image acquisition for core skills with an average score of 85.7% for core skills and 74% including advanced skills (ovaries, advanced ECHO, advanced aorta). Residents scored well but slightly lower on image interpretation with an average score of 76%. Senior residents performed well on core POC US skills as evaluated with a rigorous assessment tool. This tool may be developed further for other EM programs to use for graduating resident evaluation.
Evaluating Organic Aerosol Model Performance: Impact of two Embedded Assumptions

NASA Astrophysics Data System (ADS)

Jiang, W.; Giroux, E.; Roth, H.; Yin, D.

2004-05-01

Organic aerosols are important due to their abundance in the polluted lower atmosphere and their impact on human health and vegetation. However, modeling organic aerosols is a very challenging task because of the complexity of aerosol composition, structure, and formation processes. Assumptions and their associated uncertainties in both models and measurement data make model performance evaluation a truly demanding job. Although some assumptions are obvious, others are hidden and embedded, and can significantly impact modeling results, possibly even changing conclusions about model performance. This paper focuses on analyzing the impact of two embedded assumptions on evaluation of organic aerosol model performance. One assumption is about the enthalpy of vaporization widely used in various secondary organic aerosol (SOA) algorithms. The other is about the conversion factor used to obtain ambient organic aerosol concentrations from measured organic carbon. These two assumptions reflect uncertainties in the model and in the ambient measurement data, respectively. For illustration purposes, various choices of the assumed values are implemented in the evaluation process for an air quality model based on CMAQ (the Community Multiscale Air Quality Model). Model simulations are conducted for the Lower Fraser Valley covering Southwest British Columbia, Canada, and Northwest Washington, United States, for a historical pollution episode in 1993. To understand the impact of the assumed enthalpy of vaporization on modeling results, its impact on instantaneous organic aerosol yields (IAY) through partitioning coefficients is analysed first. The analysis shows that utilizing different enthalpy of vaporization values causes changes in the shapes of IAY curves and in the response of SOA formation capability of reactive organic gases to temperature variations. These changes are then carried into the air quality model and cause substantial changes in the organic aerosol modeling results. In another aspect, using different assumed factors to convert measured organic carbon to organic aerosol concentrations cause substantial variations in the processed ambient data themselves, which are normally used as performance targets for model evaluations. The combination of uncertainties in the modeling results and in the moving performance targets causes major uncertainties in the final conclusion about the model performance. Without further information, the best thing that a modeler can do is to choose a combination of the assumed values from the sensible parameter ranges available in the literature, based on the best match of the modeling results with the processed measurement data. However, the best match of the modeling results with the processed measurement data may not necessarily guarantee that the model itself is rigorous and the model performance is robust. Conclusions on the model performance can only be reached with sufficient understanding of the uncertainties and their impact.
[Reconsidering evaluation criteria regarding health care research: toward an integrative framework of quantitative and qualitative criteria].

PubMed

Miyata, Hiroaki; Kai, Ichiro

2006-05-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confused and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. It is therefore very important to reconsider evaluation criteria regarding rigor in social science. As Lincoln & Guba have already compared quantitative paradigms (validity, reliability, neutrality, generalizability) with qualitative paradigms (credibility, dependability, confirmability, transferability), we have discuss use of evaluation criteria based on pragmatic perspective. Validity/Credibility is the paradigm concerned to observational framework, while Reliability/Dependability refer to the range of stability in observations, Neutrality/Confirmability reflect influences between observers and subjects, Generalizability/Transferability have epistemological difference in the way findings are applied. Qualitative studies, however, does not always chose the qualitative paradigms. If we assume the stability to some extent, it is better to use the quantitative paradigm (reliability). Moreover as a quantitative study can not always guarantee a perfect observational framework, with stability in all phases of observations, it is useful to use qualitative paradigms to enhance the rigor in the study.
The challenges of interventions to promote healthier food in independent takeaways in England: qualitative study of intervention deliverers' views.

PubMed

Goffe, Louis; Penn, Linda; Adams, Jean; Araujo-Soares, Vera; Summerbell, Carolyn D; Abraham, Charles; White, Martin; Adamson, Ashley; Lake, Amelia A

2018-01-27

Much of the food available from takeaways, pubs and restaurants particularly that sold by independent outlets, is unhealthy and its consumption is increasing. These food outlets are therefore important potential targets for interventions to improve diet and thus prevent diet related chronic diseases. Local authorities in England have been charged with delivering interventions to increase the provision of healthy food choices in independent outlets, but prior research shows that few such interventions have been rigorously developed or evaluated. We aimed to learn from the experiences of professionals delivering interventions in independent food outlets in England to identify the operational challenges and their suggestions for best practice. We used one-to-one semi-structured qualitative interviews to explore the views and experiences of professionals who were either employees of, or contracted by, a local authority to deliver interventions to increase the provision of healthier food choices in independent food outlets. Purposive sampling was used to recruit a sample which included men and women, from a range of professional roles, across different areas of England. Interviews were informed by a topic guide, and proceeded until no new themes emerged. Interviews were recorded, transcribed verbatim and analysed using the Framework method. We conducted 11 individual interviews. Participants focussed on independent takeaways and their unhealthy food offerings, and highlighted the advantages and disadvantages of intervention delivery methods, their evaluation and impact. The main barriers to implementation of interventions in independent takeaways were identified as limited funding and the difficulties of engaging the food outlet owner/manager. Engagement was thought to be facilitated by delivering intensive, interactive and tailored interventions, clear and specific information, and incentives, whilst accounting for practical, primarily financial, constraints of food businesses. Alternative intervention approaches, targeting suppliers or customers, were suggested. Participants emphasised independent takeaways as particularly challenging, but worthwhile intervention targets. Participants perceived that interventions need to take account of the potentially challenging operating environment, particularly the primacy of the profit motive. Upstream interventions, engaging suppliers, as well as those that drive consumer demand, may be worth exploring. Rigorous, evidence-informed development and evaluation of such interventions is needed.
Programs and policies to assist high school dropouts in the transition to adulthood.

PubMed

Bloom, Dan

2010-01-01

Dan Bloom of MDRC examines policies and programs designed to help high school dropouts improve their educational attainment and labor market outcomes. So called "second-chance" programs, he says, have long provided some combination of education, training, employment, counseling, and social services. But the research record on their effectiveness is fairly thin, he says, and the results are mixed. Bloom describes eleven employment- or education-focused programs serving high school dropouts that have been rigorously evaluated over the past thirty years. Some relied heavily on paid work experience, while others focused more on job training or education. Some programs, especially those that offered paid work opportunities, generated significant increases in employment or earnings in the short term, but none of the studies that followed participants for more than a couple of years found lasting improvements in economic outcomes. Nevertheless, the findings provide an important foundation on which to build. Because of the high individual and social costs of ignoring high school dropouts, the argument for investing more public funds in services, systems, and research for these young people is strong. The paucity of conclusive evidence, however, makes it hard to know how to direct resources and magnifies the importance of ensuring that all new initiatives provide for rigorous evaluation of their impacts. Bloom concludes with recommendations for policy and research aimed at building on current efforts to expand and improve effective programs for dropouts while simultaneously developing and testing new approaches that might be more effective and strengthening local systems to support vulnerable young people. He stresses the importance of identifying and disseminating strategies to engage young people who are more seriously disconnected and unlikely to join programs. A recurring theme is that providing young people with opportunities for paid work may be useful both as an engagement tool and as a strategy for improving long-term labor market outcomes.
Enhancing causal interpretations of quality improvement interventions

PubMed Central

Cable, G

2001-01-01

In an era of chronic resource scarcity it is critical that quality improvement professionals have confidence that their project activities cause measured change. A commonly used research design, the single group pre-test/post-test design, provides little insight into whether quality improvement interventions cause measured outcomes. A re-evaluation of a quality improvement programme designed to reduce the percentage of bilateral cardiac catheterisations for the period from January 1991 to October 1996 in three catheterisation laboratories in a north eastern state in the USA was performed using an interrupted time series design with switching replications. The accuracy and causal interpretability of the findings were considerably improved compared with the original evaluation design. Moreover, the re-evaluation provided tangible evidence in support of the suggestion that more rigorous designs can and should be more widely employed to improve the causal interpretability of quality improvement efforts. Evaluation designs for quality improvement projects should be constructed to provide a reasonable opportunity, given available time and resources, for causal interpretation of the results. Evaluators of quality improvement initiatives may infrequently have access to randomised designs. Nonetheless, as shown here, other very rigorous research designs are available for improving causal interpretability. Unilateral methodological surrender need not be the only alternative to randomised experiments. Key Words: causal interpretations; quality improvement; interrupted time series design; implementation fidelity PMID:11533426
Enhancing causal interpretations of quality improvement interventions.

PubMed

Cable, G

2001-09-01

In an era of chronic resource scarcity it is critical that quality improvement professionals have confidence that their project activities cause measured change. A commonly used research design, the single group pre-test/post-test design, provides little insight into whether quality improvement interventions cause measured outcomes. A re-evaluation of a quality improvement programme designed to reduce the percentage of bilateral cardiac catheterisations for the period from January 1991 to October 1996 in three catheterisation laboratories in a north eastern state in the USA was performed using an interrupted time series design with switching replications. The accuracy and causal interpretability of the findings were considerably improved compared with the original evaluation design. Moreover, the re-evaluation provided tangible evidence in support of the suggestion that more rigorous designs can and should be more widely employed to improve the causal interpretability of quality improvement efforts. Evaluation designs for quality improvement projects should be constructed to provide a reasonable opportunity, given available time and resources, for causal interpretation of the results. Evaluators of quality improvement initiatives may infrequently have access to randomised designs. Nonetheless, as shown here, other very rigorous research designs are available for improving causal interpretability. Unilateral methodological surrender need not be the only alternative to randomised experiments.
Using multiple methods to assess learning and outcomes in an online degree-granting dental hygiene program.

PubMed

Springfield, Emily; Gwozdek, Anne E; Peet, Melissa; Kerschbaum, Wendy E

2012-04-01

Program evaluation is a necessary component of curricular change and innovation. It ascertains whether an innovation has met benchmarks and contributes to the body of knowledge about educational methodologies and supports the use of evidence-based practice in teaching. Education researchers argue that rigorous program evaluation should utilize a mixed-method approach, triangulating both qualitative and quantitative methods to understand program effectiveness. This approach was used to evaluate the University of Michigan Dental Hygiene Degree Completion E-Learning (online) Program. Quantitative data included time spent on coursework, grades, publications, course evaluation results, and survey responses. Qualitative data included student and faculty responses in focus groups and on surveys as well as students' portfolio reflections. The results showed the program was academically rigorous, fostering students' ability to connect theory with practice and apply evidence-based practice principles. These results also demonstrated that the students had learned to critically reflect on their practice and develop expanded professional identities; going beyond the role of clinician, they began to see themselves as educators, advocates, and researchers. This evaluation model is easily adaptable and is applicable to any health science or other professional degree program. This study also raised important questions regarding the effect of meta-reflection on student confidence and professional behavior.
Augmented assessment as a means to augmented reality.

PubMed

Bergeron, Bryan

2006-01-01

Rigorous scientific assessment of educational technologies typically lags behind the availability of the technologies by years because of the lack of validated instruments and benchmarks. Even when the appropriate assessment instruments are available, they may not be applied because of time and monetary constraints. Work in augmented reality, instrumented mannequins, serious gaming, and similar promising educational technologies that haven't undergone timely, rigorous evaluation, highlights the need for assessment methodologies that address the limitations of traditional approaches. The most promising augmented assessment solutions incorporate elements of rapid prototyping used in the software industry, simulation-based assessment techniques modeled after methods used in bioinformatics, and object-oriented analysis methods borrowed from object oriented programming.
Impact of Sheltered Instruction Observation Protocol (SIOP) Strategies on Reading Achievement of English Language Learners in the Primary Grades

ERIC Educational Resources Information Center

Zito-Nash, Judith A.

2017-01-01

When four forces create shift in the landscape of PK-12 education, change in response to the environment is inevitable and necessary. It is such in the United States, as schools face increased accountability for the growth and attainment of reading skills, rigorous demands of the Common Core State Standards, a rapidly growing population of…
Teaching and Learning vs. "Doing School": The Impact of Rigorous Curriculum on Student Development

ERIC Educational Resources Information Center

Jarva, Carly Kristin

2013-01-01

"I think what I learned in the IB [International Baccalaureate] program...well, in a way I felt like--have you read Great Expectations? When Pip gets the stipend from the mysterious person and he's walking out and the clouds are lifting up and he can see all the possibilities--that's how I felt with the IB program." -Student reflection…
The Participant Effects of Private School Vouchers across the Globe: A Meta-Analytic and Systematic Review

ERIC Educational Resources Information Center

Shakeel, M. Danish; Anderson, Kaitlin P.; Wolf, Patrick J.

2016-01-01

The objective of this meta-analysis is to rigorously assess the participant effects of private school vouchers, or in other words, to estimate the average academic impacts that the offer (or use) of a voucher has on a student. This review adds to the literature by being the first to systematically review all Randomized Control Trials (RCTs) in an…

Some links on this page may take you to non-federal websites. Their policies may differ from this site.