Evaluation systems for clinical governance development: a comparative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.

Online Continuing Professional Education: An Evaluative Case Study

ERIC Educational Resources Information Center

Pullen, Darren L.

2005-01-01

An evaluation study, assessing the pedagogical and instructional design (e-pedagogy) effectiveness of online continuing professional education (CPE) courses offered by a large Australasian CPE provider to health care professionals (HCPs). The study used a naturalistic theory approach in conjunction with a multilevel evaluation to examine the…

School Evaluation and Accreditation: A Bibliography of Research Studies.

ERIC Educational Resources Information Center

Diamond, Joan

1982-01-01

This 97-item bibliography cites research in the following categories: purposes and structures of school accreditation/evaluation; the school evaluation process, involving self-study, team visits, and implementation; evaluation of the accreditation/evaluation process; external factors influencing school accreditation/evaluation; and objectivity in…

Principals' Experiences of Being Evaluated: A Phenomenological Study

ERIC Educational Resources Information Center

Parylo, Oksana; Zepeda, Sally J.; Bengtson, Ed

2012-01-01

This phenomenological study sought to understand principals' lived experiences of being evaluated with reliance on the principles of developmental supervision and adult learning theory. Analysis of interview data from 16 principals revealed 3 major constructs in principal evaluation: evaluation is a complex, constantly changing system; principal…

Handbook of Evaluated Materials for Secondary Social Studies.

ERIC Educational Resources Information Center

Mount Diablo Unified School District, Concord, CA.

The handbook contains teacher evaluations of secondary social studies materials used in the Mt. Diablo Unified School District (MDUSD), Orinda, California. The Materials Testing Program of MDUSD is an effort to involve secondary teachers in the process of evaluating social studies materials in certain concept areas: conflict, social change, man's…

Products for Improving Educational Evaluation. Center for the Study of Evaluation. Fifth Annual Report.

ERIC Educational Resources Information Center

Alkin, Marvin C.

This publication provides background information on the functions and operations of the Center for the Study of Evaluation and reports on such center products as Insructional Objectives Exchange (IOX), CSE Elementary School Test Evaluations, and Evaluation Workshop I. Appendixes include: a summary of center accomplishments; a list of the center's…

Evaluation of the National Assessment of Educational Progress. Study Reports

ERIC Educational Resources Information Center

Buckendahl, Chad W.; Davis, Susan L.; Plake, Barbara S.; Sireci, Stephen G.; Hambleton, Ronald K.; Zenisky, April L.; Wells, Craig S.

2009-01-01

The "Evaluation of the National Assessment of Educational Progress: Study Reports" describes the special studies that comprised the design of the evaluation. In the Final Report, the authors presented a practical discussion of the evaluation studies to its primary, intended audience, namely policymakers. On this accompanying CD, readers…

An evaluative study of clinical preceptorship.

PubMed

Kaviani, N; Stillwell, Y

2000-04-01

Clinical preceptorships, in collaboration between clinical agencies and educational institutions have been documented as an effective and innovative means of facilitating student learning, providing advantages for both the clinical and educational settings. A preceptorship programme of 100 hours duration was developed and delivered by the nurse education institute, in consultation with a health care organization. The objectives of the preceptorship programme were to help registered nurses, in partnership with clinical nurse educators, to effectively integrate, support and assist the development of clinical competence in the undergraduate nursing student. Following the implementation of the preceptorship programme a research study was conducted to evaluate programme effectiveness. The purpose of the study was to examine preceptors, preceptees, and nurse managers' preceptions of the preceptor role and factors which influenced the performance of preceptors. The methods used in this study included those commonly found in evaluation research. That is, participants were drawn from those who were involved, either directly or indirectly, in the preceptorship programme, namely preceptors, preceptees and nurse managers. Using focus groups, they were each asked to identify the outcomes of the programme in practice. Study findings highlighted the importance of formal preceptor preparation, which was shown to enhance teaching and learning opportunities for student preceptees, personal and professional development of the preceptors, and the promotion of positive partnerships between nurse educators and nurse practitioners. The need for formal recognition of the preceptor role in practice, particularly in relation to the provision of adequate time and resources, emerged from the study. The research findings enabled the development of an evaluative model of preceptorship, which highlights the intrinsic and extrinsic factors impacting on the preceptor role.

Michigan English Study of Structure for Curriculum Evaluation (MESSAGE).

ERIC Educational Resources Information Center

Taylor, Vi Marie

The Michigan English Study of Structure for Curriculum Evaluation (MESSAGE) training session involved 40 leaders of English curriculum study in a 7-day intensive program. They studied objective evaluation in terms of behavior, instruction, and institution; approaches to the English curriculum through instructional objectives that include…

42 CFR 456.143 - Content of medical care evaluation studies.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 4 2010-10-01 2010-10-01 false Content of medical care evaluation studies. 456.143...: Medical Care Evaluation Studies § 456.143 Content of medical care evaluation studies. Each medical care... patient care; (b) Include analysis of at least the following: (1) Admissions; (2) Durations of stay; (3...

Urban pedestrian accident countermeasures experimental evaluation. Volume 1, Behavioral evaluation studies

DOT National Transportation Integrated Search

1975-02-01

A series of site and accident specific pedestrian safety countermeasures had been developed in a previous study, but the effectiveness of these countermeasures had not been empirically evaluated. This project focused on the determination of the effec...

Improved bioavailability and clinical response in patients with chronic liver disease following the administration of a spironolactone: β-cyclodextrin complex

PubMed Central

Abosehmah-Albidy, A. Z. M.; York, P.; Wong, V.; Losowsky, M. S.; Chrystyn, H.

1997-01-01

Aims To compare the absorption and clinical effect of spironolactone from an inclusion complex with β-cyclodextrin (SP-COMP) to Aldactone tablets (ALD) in chronic liver disease. Methods Patients, admitted with chronic liver disease, completed a randomized crossover steady state study. They received their spironolactone dose as either daily SP-COMP or ALD for 7 days. Serial blood samples were drawn over a 24 h period from day 7 of each therapy. Accurate fluid balance was recorded on days 5–7 and 12–14. Thirteen (six females) whose mean (s.d.) age and weight was 58.4(9.3) years and 74.3(19.0) kg completed the study. Results The mean (95% confidence limits) relative bioavailability for SP-COMP (compared with ALD) from steady state serum concentrations of canrenone, 6β-hydroxyl 7α-thiomethyl spironolactone and 7α-thiomethyl spironolactone was 310.0 (265.4, 336.7), 233.4(212.9, 250.8) and 254.8(230.8, 279.0)%, respectively. Improvements in clinical status and fluid balance occurred over the last 3 days of SP-COMP with a mean (s.d.) net loss, in fluid balance, of 1370(860)ml compared with a gain of 228(936)ml during ALD. Conclusions Better absorption of spironolactone from the spironolactone: β-cyclodextrin complex formulation should lead to a reduction in dosage and perhaps a more consistent effect in patients with chronic liver disease. PMID:9241094

Experimental study and evaluation of radioprotective drugs

NASA Technical Reports Server (NTRS)

Smith, D. E.; Thomson, J. F.

1968-01-01

Experimental study evaluates radioprotective drugs administered before exposure either orally or intravenously. Specifically studied are the sources of radiation, choice of radiation dose, choice of animals, administration of drugs, the toxicity of protective agents and types of protective drug.

The scope of costs in alcohol studies: Cost-of-illness studies differ from economic evaluations.

PubMed

van Gils, Paul F; Hamberg-van Reenen, Heleen H; van den Berg, Matthijs; Tariq, Luqman; de Wit, G Ardine

2010-07-06

Alcohol abuse results in problems on various levels in society. In terms of health, alcohol abuse is not only an important risk factor for chronic disease, but it is also related to injuries. Social harms which can be related to drinking include interpersonal problems, work problems, violent and other crimes. The scope of societal costs related to alcohol abuse in principle should be the same for both economic evaluations and cost-of-illness studies. In general, economic evaluations report a small part of all societal costs. To determine the cost- effectiveness of an intervention it is necessary that all costs and benefits are included. The purpose of this study is to describe and quantify the difference in societal costs incorporated in economic evaluations and cost-of-illness studies on alcohol abuse. To investigate the economic costs attributable to alcohol in cost-of-illness studies we used the results of a recent systematic review (June 2009). We performed a PubMed search to identify economic evaluations on alcohol interventions. Only economic evaluations in which two or more interventions were compared from a societal perspective were included. The proportion of health care costs and the proportion of societal costs were estimated in both type of studies. The proportion of healthcare costs in cost-of-illness studies was 17% and the proportion of societal costs 83%. In economic evaluations, the proportion of healthcare costs was 57%, and the proportion of societal costs was 43%. The costs included in economic evaluations performed from a societal perspective do not correspond with those included in cost-of-illness studies. Economic evaluations on alcohol abuse underreport true societal cost of alcohol abuse. When considering implementation of alcohol abuse interventions, policy makers should take into account that economic evaluations from the societal perspective might underestimate the total effects and costs of interventions.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Inside the Black Box--An Implementation Evaluation Case Study

ERIC Educational Resources Information Center

Rector, Patricia; Bakacs, Michele; Rowe, Amy; Barbour, Bruce

2016-01-01

The case study presented in this article is an example of an implementation evaluation. The evaluation investigated significant components of the implementation of a long-term environmental educational program. Direct observation, evaluation-specific survey data, and historical data were used to determine program integrity as identified by…

Helping Students Evaluate the Validity of a Research Study.

ERIC Educational Resources Information Center

Morgan, George A.; Gliner, Jeffrey A.

Students often have difficulty in evaluating the validity of a study. A conceptually and linguistically meaningful framework for evaluating research studies is proposed that is based on the discussion of internal and external validity of T. D. Cook and D. T. Campbell (1979). The proposal includes six key dimensions, three related to internal…

A Visual Evaluation Study of Graph Sampling Techniques

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Fangyan; Zhang, Song; Wong, Pak C.

2017-01-29

We evaluate a dozen prevailing graph-sampling techniques with an ultimate goal to better visualize and understand big and complex graphs that exhibit different properties and structures. The evaluation uses eight benchmark datasets with four different graph types collected from Stanford Network Analysis Platform and NetworkX to give a comprehensive comparison of various types of graphs. The study provides a practical guideline for visualizing big graphs of different sizes and structures. The paper discusses results and important observations from the study.

How to Critically Evaluate Case Studies in Social Work

ERIC Educational Resources Information Center

Lee, Eunjung; Mishna, Faye; Brennenstuhl, Sarah

2010-01-01

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

Women, Co-occurring Disorders, and Violence Study: evaluation design and study population.

PubMed

McHugo, G J; Kammerer, N; Jackson, E W; Markoff, L S; Gatz, M; Larson, M J; Mazelis, R; Hennigan, K

2005-03-01

The Women, Co-occurring Disorders, and Violence Study (WCDVS) was a multi-site cooperative study to evaluate new service models for women with co-occurring mental health and substance use disorders and a history of physical and/or sexual abuse. Despite common features in the service interventions and evaluation procedures, diversity across the nine sites plus differences introduced by non-random assignment led to numerous methodological challenges. This article describes the design, measurement, and analysis decisions behind the WCDVS and lays the foundation for understanding participant-level outcomes and service costs. This article also describes the study population, as recruited and following attrition at the 6-month follow-up, in order to address the threat of selection bias to inferences drawn from this multi-site study.

Oasis Connections: Results from an Evaluation Study

ERIC Educational Resources Information Center

Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-01-01

Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…

Compendium of JTPA and Related Evaluation Studies.

ERIC Educational Resources Information Center

Employment and Training Administration (DOL), Washington, DC.

This document summarizes the findings of currently available evaluation studies of the Job Training Partnership Act (JTPA) and other related reports and data. Data from 26 studies conducted between 1980 and 1986 are presented under the following subject headings: the state role (monitoring and oversight, policy interpretation and leadership,…

A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries

ERIC Educational Resources Information Center

Noh, Younghee

2010-01-01

This study aimed to improve the current state of electronic resource evaluation in libraries. While the use of Web DB, e-book, e-journal, and other e-resources such as CD-ROM, DVD, and micro materials is increasing in libraries, their use is not comprehensively factored into the general evaluation of libraries and may diminish the reliability of…

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

PubMed

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Integrating service development with evaluation in telehealthcare: an ethnographic study.

PubMed

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-11-22

To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties-dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Clinicians, managers, technical experts, and researchers involved in the projects. Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS.

Upper stage technology evaluation studies

NASA Technical Reports Server (NTRS)

1972-01-01

Studies to evaluate advanced technology relative to chemical upper stages and orbit-to-orbit stages are reported. The work described includes: development of LH2/LOX stage data, development of data to indicate stage sensitivity to engine tolerance, modified thermal routines to accommodate storable propellants, added stage geometries to computer program for monopropellant configurations, determination of the relative gain obtainable through improvement of stage mass fraction, future propulsion concepts, effect of ultrahigh chamber-pressure increases, and relative gains obtainable through improved mass fraction.

Revisioning the Process: A Case Study in Feminist Program Evaluation.

ERIC Educational Resources Information Center

Beardsley, Rebecca M.; Miller, Michelle Hughes

2002-01-01

Conducted a case study of the evaluation of a women's substance abuse prevention program and identified three key aspects of negotiated evaluation. Discusses the processes involved in feminist evaluation, including collaborative agenda setting and cooperative teamwork. (SLD)

Study on the evaluation index of active power reserve

NASA Astrophysics Data System (ADS)

Guo, Xiaorui; Liu, Jiantao; Wang, Ke; Min, Lu

2018-01-01

Based on the role of active reserve at different time scales, divides the evaluation dimension of active reserve. Analysis the calculation principle of traditional reliability index such as probability of system safety, lack of power shortage and electricity shortage expectancy, and studies the applicability of these indicators to evaluate the reserve capacity on different dimensions. Resolves the evaluation index of active reserve capacity from the dimensions of time dimension, spatial dimension, system state, risk degree and economy, then construct evaluation index of active reserve capacity.

Integrating service development with evaluation in telehealthcare: an ethnographic study

PubMed Central

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-01-01

Objectives To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Design Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Setting Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties—dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Participants Clinicians, managers, technical experts, and researchers involved in the projects. Results and discussion Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Conclusions Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS. PMID:14630758

Attitudes toward evaluation: An exploratory study of students' and stakeholders' social representations.

PubMed

Schultes, Marie-Therese; Kollmayer, Marlene; Mejeh, Mathias; Spiel, Christiane

2018-06-15

Positive attitudes toward evaluation among stakeholders are an important precondition for successful evaluation processes. However, empirical studies focusing on stakeholders' attitudes toward evaluation are scarce. The present paper explores the approach of assessing social representations as indicators of people's attitudes toward evaluation. In an exploratory study, two groups were surveyed: University students (n = 60) with rather theoretical knowledge of evaluation and stakeholders (n = 61) who had shortly before taken part in participatory evaluation studies. Both groups were asked to name their free associations with the term "evaluation", which were subsequently analyzed lexicographically. The results indicate different social representations of evaluation in the two groups. The student group primarily saw evaluation as an "appraisal", whereas the stakeholders emphasized the "improvement" resulting from evaluation. Implications for further evaluation research and practice are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Cautions on the Use of Investigative Case Studies in Meta-Evaluation.

ERIC Educational Resources Information Center

Smith, Nick L.

1990-01-01

A meta-analysis combining expert evaluation with naturalistic case study methods indicates that such investigations must use special methods to render evaluative judgments of worth. It is demonstrated that descriptive, interpretive, and evaluative aspects of such a study must be combined to yield justifiable conclusions. (TJH)

Sustaining and Improving Study Abroad Experiences Through Comparative Evaluation.

PubMed

Johanson, Linda S

Researchers have related participation in study abroad experiences to many positive outcomes for nursing students; however, educators are faced with the task of not only developing meaningful study abroad opportunities but sustaining and improving them as well. Educators can evaluate repeat study abroad programs by comparing experiences, looking for trends, and conjecturing rationales. To illustrate this process, an example of a study abroad opportunity that has been repeated over 11 years is presented. The first six years have been compared to the most recent five years, revealing three categories of change for evaluation and the resulting course improvements.

Insight into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

ERIC Educational Resources Information Center

Christie, Christina A.; Fleischer, Dreolin Nesbitt

2010-01-01

To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…

Arts Integration and Students' Reading Achievement: A Formative Evaluation Study

ERIC Educational Resources Information Center

Hosfelt, Patricia D.

2017-01-01

The purpose of this dissertation was to evaluate essential components of an arts-integration program that may contribute to improved student achievement in elementary reading at the school of study through a formative evaluation. Stufflebeam's CIPP model of program evaluation served as the conceptual framework for the study's findings. Creative…

Case study of a framing effect in course evaluations.

PubMed

Lynöe, Niels; Juth, Niklas; Helgesson, Gert

2012-01-01

When new elements are included in the medical curriculum and the total time frame remains unchanged, established disciplines have to shorten their courses. This might bring about frustration among the teachers and students concerned, which in turn might affect how other courses are perceived. Two course evaluations, one before and one after a major change in the curriculum were compared. Comments were also analysed. We found that the students' and teachers' frustration influenced the students' evaluations of a new course in the philosophy of medicine and accordingly brought about an unintended message effect referred to as a framing effect. The results of this observational study indicate that a negative framing effect might influence course-evaluations. We suggest that this study might be used as a point of departure for further empirical studies about negative framing effects.

An Evaluation of Digital Stories Created for Social Studies Teaching

ERIC Educational Resources Information Center

Seker, Burcu Sezginsoy

2016-01-01

Digital stories are useful tools for combining technology with education, in terms of the preparation stage, practicality, availability and usability as an evaluation instrument. In this study, digital stories created in a social studies teaching class were evaluated and the opinions of primary school teacher candidates were obtained concerning…

Evaluation of a proposed expert system development methodology: Two case studies

NASA Technical Reports Server (NTRS)

Gilstrap, Lewey

1990-01-01

Two expert system development projects were studied to evaluate a proposed Expert Systems Development Methodology (ESDM). The ESDM was developed to provide guidance to managers and technical personnel and serve as a standard in the development of expert systems. It was agreed that the proposed ESDM must be evaluated before it could be adopted; therefore a study was planned for its evaluation. This detailed study is now underway. Before the study began, however, two ongoing projects were selected for a retrospective evaluation. They were the Ranging Equipment Diagnostic Expert System (REDEX) and the Backup Control Mode Analysis and Utility System (BCAUS). Both projects were approximately 1 year into development. Interviews of project personnel were conducted, and the resulting data was used to prepare the retrospective evaluation. Decision models of the two projects were constructed and used to evaluate the completeness and accuracy of key provisions of ESDM. A major conclusion reached from these case studies is that suitability and risk analysis should be required for all AI projects, large and small. Further, the objectives of each stage of development during a project should be selected to reduce the next largest area of risk or uncertainty on the project.

Research Governance and the Role of Evaluation: A Comparative Study

ERIC Educational Resources Information Center

Molas-Gallart, Jordi

2012-01-01

Through a comparative study of the United Kingdom and Spain, this article addresses the effect of different research governance structures on the functioning and uses of research evaluation. It distinguishes three main evaluation uses: distributive, improvement, and controlling. Research evaluation in the United Kingdom plays important…

Impact of a Major National Evaluation Study: Israel's Van Leer Report.

ERIC Educational Resources Information Center

Alkin, Marvin C.; Lewy, Arieh

This investigation documents the impact of the Van Leer Study, a large-scale evaluation study of achievement in the primary schools of Israel. It is intended to increase understanding of the process of evaluation utilization, showing how evaluation findings and other kinds of information can work together, over time and in a variety of ways, to…

Peer Evaluation: A Case Study.

ERIC Educational Resources Information Center

Weaver, Richard L., II

Acknowledging the value of peer evaluation in the classroom, this paper describes the peer evaluation system used in a basic speech communication course at an Ohio university. The first section of the paper defines peer evaluation and describes the situation at the university to provide some understanding of the context in which the system was…

A qualitative case study of evaluation use in the context of a collaborative program evaluation strategy in Burkina Faso.

PubMed

D'Ostie-Racine, Léna; Dagenais, Christian; Ridde, Valéry

2016-05-26

Program evaluation is widely recognized in the international humanitarian sector as a means to make interventions and policies more evidence based, equitable, and accountable. Yet, little is known about the way humanitarian non-governmental organizations (NGOs) actually use evaluations. The current qualitative evaluation employed an instrumental case study design to examine evaluation use (EU) by a humanitarian NGO based in Burkina Faso. This organization developed an evaluation strategy in 2008 to document the implementation and effects of its maternal and child healthcare user fee exemption program. Program evaluations have been undertaken ever since, and the present study examined the discourses of evaluation partners in 2009 (n = 15) and 2011 (n = 17). Semi-structured individual interviews and one group interview were conducted to identify instances of EU over time. Alkin and Taut's (Stud Educ Eval 29:1-12, 2003) conceptualization of EU was used as the basis for thematic qualitative analyses of the different forms of EU identified by stakeholders of the exemption program in the two data collection periods. Results demonstrated that stakeholders began to understand and value the utility of program evaluations once they were exposed to evaluation findings and then progressively used evaluations over time. EU was manifested in a variety of ways, including instrumental and conceptual use of evaluation processes and findings, as well as the persuasive use of findings. Such EU supported planning, decision-making, program practices, evaluation capacity, and advocacy. The study sheds light on the many ways evaluations can be used by different actors in the humanitarian sector. Conceptualizations of EU are also critically discussed.

Evaluations of health promoting schools: a review of nine studies.

PubMed

Mũkoma, Wanjirũ; Flisher, Alan J

2004-09-01

The concept of 'health promoting schools' has been embraced internationally as an effective way of promoting the health of children, adolescents, and the wider school community. It is only recently that attempts have been made to evaluate health promoting schools. This paper reviews evaluations of health promoting schools and draws useful evaluation methodology lessons. The review is confined to school-based interventions that are founded explicitly on the concept of the health promoting school and employ the concept beyond one school domain. We included nine evaluations in this review. Seven of these were published in the peer reviewed scientific literature. Two were unpublished reports. One study was a randomized controlled trial, while a quasi-experimental research design with comparison schools was used in three studies. With three exceptions, combinations of quantitative and qualitative data were collected. There was evidence that the health promoting school has some influence on various domains of health for the school community. It is also possible to integrate health promotion into the school curriculum and policies successfully. However, the evaluation of health promoting schools is complex. We discuss some of the methodological challenges of evaluating health promoting schools and make suggestions for improving future evaluations.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review

PubMed Central

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

OBJECTIVE: Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. METHODS: This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; “simulation,” “practice,” “drill,” “exercise,” “instrument,” “tool,” “questionnaire,” “ measurement,” “checklist,” “scale,” “test,” “inventory,” “battery,” “evaluation,” “assessment,” “appraisal,” “emergency,” “disaster,” “cricise,” “hazard,” “catastrophe,: “hospital”, “prehospital,” “health centers,” “treatment centers,” were used in combination with Boolean operators OR and AND. RESULTS: The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. CONCLUSION: Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest

An Evaluation Study of Youth Participation in Youth Work: A Case Study in Southern Italy

ERIC Educational Resources Information Center

Morciano, Daniele; Scardigno, Anna Fausta; Manuti, Amelia; Pastore, Serafina

2014-01-01

In this paper an evaluation study of a public programme financing a regional network of 157 youth centres in the South of Italy is presented. A theory-based evaluation model was adopted to explore the causal links between different types of participation experience. Evaluation questions focused on three main issues are: the perception of…

Pharmacy Information Systems in Teaching Hospitals: A Multi-dimensional Evaluation Study.

PubMed

Kazemi, Alireza; Rabiei, Reza; Moghaddasi, Hamid; Deimazar, Ghasem

2016-07-01

In hospitals, the pharmacy information system (PIS) is usually a sub-system of the hospital information system (HIS). The PIS supports the distribution and management of drugs, shows drug and medical device inventory, and facilitates preparing needed reports. In this study, pharmacy information systems implemented in general teaching hospitals affiliated to medical universities in Tehran (Iran) were evaluated using a multi-dimensional tool. This was an evaluation study conducted in 2015. To collect data, a checklist was developed by reviewing the relevant literature; this checklist included both general and specific criteria to evaluate pharmacy information systems. The checklist was then validated by medical informatics experts and pharmacists. The sample of the study included five PIS in general-teaching hospitals affiliated to three medical universities in Tehran (Iran). Data were collected using the checklist and through observing the systems. The findings were presented as tables. Five PIS were evaluated in the five general-teaching hospitals that had the highest bed numbers. The findings showed that the evaluated pharmacy information systems lacked some important general and specific criteria. Among the general evaluation criteria, it was found that only two of the PIS studied were capable of restricting repeated attempts made for unauthorized access to the systems. With respect to the specific evaluation criteria, no attention was paid to the patient safety aspect. The PIS studied were mainly designed to support financial tasks; little attention was paid to clinical and patient safety features.

Evaluation of Emotional Literacy Activities: A Phenomenological Study

ERIC Educational Resources Information Center

Oksuz, Yucel

2016-01-01

The present study aims to evaluate impact of the emotional literacy activities through participant student's experiences. Emotional literacy activities, including social-emotional skills Goleman's emotional intelligence and Fapuel's emotional literacy model designed and conducted for 2 months on primary school students, who study in 4th grade. The…

The National Treatment Improvement Evaluation Study: Retention Analysis.

ERIC Educational Resources Information Center

Orwin, Rob; Williams, Valerie

This study focuses on programmatic factors that predict retention for individuals in drug and alcohol treatment programs through secondary analysis of data from the National Treatment Improvement Evaluation Study (NTIES). It addresses the relationships between completion rates, lengths of stay, and treatment modality. It examines the effect of…

Simulation studies for the evaluation of health information technologies: experiences and results.

PubMed

Ammenwerth, Elske; Hackl, Werner O; Binzer, Kristine; Christoffersen, Tue E H; Jensen, Sanne; Lawton, Kitta; Skjoet, Peter; Nohr, Christian

It is essential for new health information technologies (IT) to undergo rigorous evaluations to ensure they are effective and safe for use in real-world situations. However, evaluation of new health IT is challenging, as field studies are often not feasible when the technology being evaluated is not sufficiently mature. Laboratory-based evaluations have also been shown to have insufficient external validity. Simulation studies seem to be a way to bridge this gap. The aim of this study was to evaluate, using a simulation methodology, the impact of a new prototype of an electronic medication management system on the appropriateness of prescriptions and drug-related activities, including laboratory test ordering or medication changes. This article presents the results of a controlled simulation study with 50 simulation runs, including ten doctors and five simulation patients, and discusses experiences and lessons learnt while conducting the study. Although the new electronic medication management system showed tendencies to improve medication safety when compared with the standard system, this tendency was not significant. Altogether, five distinct situations were identified where the new medication management system did help to improve medication safety. This simulation study provided a good compromise between internal validity and external validity. However, several challenges need to be addressed when undertaking simulation evaluations including: preparation of adequate test cases; training of participants before using unfamiliar applications; consideration of time, effort and costs of conducting the simulation; technical maturity of the evaluated system; and allowing adequate preparation of simulation scenarios and simulation setting. Simulation studies are an interesting but time-consuming approach, which can be used to evaluate newly developed health IT systems, particularly those systems that are not yet sufficiently mature to undergo field evaluation studies.

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

PubMed

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment

Exploring Organizational Evaluation Capacity and Evaluation Capacity Building: A Delphi Study of Taiwanese Elementary and Junior High Schools

ERIC Educational Resources Information Center

Cheng, Shu-Huei; King, Jean A.

2017-01-01

Researchers have conducted numerous empirical studies on evaluation capacity (EC) and evaluation capacity building (ECB) in Western cultural settings. However, little is known about these practices in non-Western contexts. To that end, this study identified the major dimensions of EC and feasible ECB approaches in Taiwanese elementary and junior…

Evaluating Work-Based Learning: Insights from an Illuminative Evaluation Study of Work-Based Learning in a Vocational Qualification

ERIC Educational Resources Information Center

van Rensburg, Estelle

2008-01-01

This article outlines an illuminative evaluation study of the work-based module in a vocational qualification in Animal Health offered for the paraveterinary industry by a distance education institution in South Africa. In illuminative evaluation, a programme is studied by qualitative methods to gain an in-depth understanding of its…

Case study of evaluations that go beyond clinical outcomes to assess quality improvement diabetes programmes using the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE)

PubMed Central

Harris, Stewart B.; Naqshbandi Hayward, Mariam; Tompkins, Jordan W.

2016-01-01

Abstract Rationale, aims and objectives Investments in efforts to reduce the burden of diabetes on patients and health care are critical; however, more evaluation is needed to provide evidence that informs and supports future policies and programmes. The newly developed Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE) incorporates the theoretical concepts needed to facilitate the capture of critical information to guide investments, policy and programmatic decision making. The aim of the study is to assess the applicability and value of DEFINE in comprehensive real‐world evaluation. Method Using a critical and positivist approach, this intrinsic and collective case study retrospectively examines two naturalistic evaluations to demonstrate how DEFINE could be used when conducting real‐world comprehensive evaluations in health care settings. Results The variability between the cases and the evaluation designs are described and aligned to the DEFINE goals, steps and sub‐steps. The majority of the theoretical steps of DEFINE were exemplified in both cases, although limited for knowledge translation efforts. Application of DEFINE to evaluate diverse programmes that target various chronic diseases is needed to further test the inclusivity and built‐in flexibility of DEFINE and its role in encouraging more comprehensive knowledge translation. Conclusions This case study shows how DEFINE could be used to structure or guide comprehensive evaluations of programmes and initiatives implemented in health care settings and support scale‐up of successful innovations. Future use of the framework will continue to strengthen its value in guiding programme evaluation and informing health policy to reduce the burden of diabetes and other chronic diseases. PMID:26804339

Case study of evaluations that go beyond clinical outcomes to assess quality improvement diabetes programmes using the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE).

PubMed

Paquette-Warren, Jann; Harris, Stewart B; Naqshbandi Hayward, Mariam; Tompkins, Jordan W

2016-10-01

Investments in efforts to reduce the burden of diabetes on patients and health care are critical; however, more evaluation is needed to provide evidence that informs and supports future policies and programmes. The newly developed Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE) incorporates the theoretical concepts needed to facilitate the capture of critical information to guide investments, policy and programmatic decision making. The aim of the study is to assess the applicability and value of DEFINE in comprehensive real-world evaluation. Using a critical and positivist approach, this intrinsic and collective case study retrospectively examines two naturalistic evaluations to demonstrate how DEFINE could be used when conducting real-world comprehensive evaluations in health care settings. The variability between the cases and the evaluation designs are described and aligned to the DEFINE goals, steps and sub-steps. The majority of the theoretical steps of DEFINE were exemplified in both cases, although limited for knowledge translation efforts. Application of DEFINE to evaluate diverse programmes that target various chronic diseases is needed to further test the inclusivity and built-in flexibility of DEFINE and its role in encouraging more comprehensive knowledge translation. This case study shows how DEFINE could be used to structure or guide comprehensive evaluations of programmes and initiatives implemented in health care settings and support scale-up of successful innovations. Future use of the framework will continue to strengthen its value in guiding programme evaluation and informing health policy to reduce the burden of diabetes and other chronic diseases. © 2016 The Authors. Journal of Evaluation in Clinical Practice published by John Wiley & Sons, Ltd.

Practical Guidelines for Evaluating Sampling Designs in Survey Studies.

ERIC Educational Resources Information Center

Fan, Xitao; Wang, Lin

The popularity of sample surveys in evaluation and research makes it necessary for consumers to tell a good survey from a poor one. Several sources were identified that gave advice on how to evaluate a sample design used in a survey study. The sources are either too limited or too extensive to be useful practically. The purpose of this paper is to…

Evaluating Mixed Research Studies: A Mixed Methods Approach

ERIC Educational Resources Information Center

Leech, Nancy L.; Dellinger, Amy B.; Brannagan, Kim B.; Tanaka, Hideyuki

2010-01-01

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

CAIRSENSE Study: Real-world evaluation of low cost sensors ...

EPA Pesticide Factsheets

Low-cost air pollution sensors are a rapidly developing field in air monitoring. In recent years, numerous sensors have been developed that can provide real-time concentration data for different air pollutants at costs accessible to individuals and non-regulatory groups. Additionally, these sensors have the potential to improve the spatial resolution of monitoring networks and provide a better understanding of neighborhood- and local-scale air quality and sources. However, many new sensors have not been evaluated to determine their long-term performance and capabilities. In this study, nine different low-cost sensor models, including O3, NO2 and particle sensors, were deployed in Denver, CO from September 2015 to February 2016. Three sensors of each type were deployed to evaluate instrument precision and consistency over the time period. Sensors were co-located with reference monitors at the Denver NCore site in order to evaluate sensor accuracy and precision. Denver was chosen as the location for this study to evaluate sensor performance in dry, high altitude, and low winter temperatures. Sensors were evaluated for data completeness, performance over time, and comparison with regulatory monitors. This presentation will also address challenges and approaches to data logging and processing. Preliminary analysis revealed that most sensors had high data completeness when data loggers were operational (e.g., the Aeroqual O3 sensor ranged from 94-100%), and exhibited

A Tentative Study on the Evaluation of Community Health Service Quality*

NASA Astrophysics Data System (ADS)

Ma, Zhi-qiang; Zhu, Yong-yue

Community health service is the key point of health reform in China. Based on pertinent studies, this paper constructed an indicator system for the community health service quality evaluation from such five perspectives as visible image, reliability, responsiveness, assurance and sympathy, according to service quality evaluation scale designed by Parasuraman, Zeithaml and Berry. A multilevel fuzzy synthetical evaluation model was constructed to evaluate community health service by fuzzy mathematics theory. The applicability and maneuverability of the evaluation indicator system and evaluation model were verified by empirical analysis.

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation

PubMed Central

Chen, Quan; Tsai, Sang-Bing; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-01

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees’ low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees’ job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice. PMID:29301375

A systematic review of clinical supervision evaluation studies in nursing.

PubMed

Cutcliffe, John R; Sloan, Graham; Bashaw, Marie

2018-02-15

According to the international, extant literature published during the last 20 years or so, clinical supervision (CS) in nursing is now a reasonably common phenomenon. Nevertheless, what appears to be noticeably 'thin on the ground' in this body of literature are empirical evaluations of CS, especially those pertaining to client outcomes. Accordingly, the authors undertook a systematic review of empirical evaluations of CS in nursing to determine the state of the science. Adopting the approach documented by Stroup et al. (JAMA, 283, 2000, 2008), the authors searched for reports of evaluation studies of CS in nursing - published during the years 1995 to 2015. Keywords for the search were 'clinical supervision', 'evaluation', 'efficacy', 'nursing', and combinations of these keywords. Electronic databases used were CINAHL, MEDLINE, PsychLIT, and the British Nursing Index. The research evidence from twenty-eight (28) studies reviewed is presented, outlining the main findings with an overview of each study presented. The following broad themes were identified and are each discussed in the study: narrative/anecdotal accounts of positive outcomes for clinical supervision, narrative/anecdotal accounts of negative outcomes for clinical supervision, empirical positive outcomes reported by supervisee, and empirical findings showing no effect by supervisee. © 2018 Australian College of Mental Health Nurses Inc.

An Empirical Study on Low-Carbon: Human Resources Performance Evaluation.

PubMed

Chen, Quan; Tsai, Sang-Bing; Zhai, Yuming; Zhou, Jie; Yu, Jian; Chang, Li-Chung; Li, Guodong; Zheng, Yuxiang; Wang, Jiangtao

2018-01-03

Low-carbon logistics meets the requirements of a low-carbon economy and is the most effective operating model for logistic development to achieve sustainability by coping with severe energy consumption and global warming. Low-carbon logistics aims to reduce carbon intensity rather than simply reduce energy consumption and carbon emissions. Human resources are an important part of the great competition in the logistics market and significantly affect the operations of enterprises. Performance evaluations of human resources are particularly important for low-carbon logistics enterprises with scarce talents. Such evaluations in these enterprises are of great significance for their strategic development. This study constructed a human resource performance evaluation system to assess non-managerial employees' low-carbon job capacity, job performance, and job attitude in the low-carbon logistics sector. The case study results revealed that the investigated company enjoyed initial success after having promoted low-carbon concepts and values to its non-managerial employees, and the success was demonstrated by excellent performance in its employees' job attitude and knowledge. This study adopts the AHP method to reasonably determine an indicator system of performance evaluation and its weight to avoid certain human-caused bias. This study not only fills the gap in the related literature, but can also be applied to industrial practice.

A case study evaluation of the use of video technology in concrete pavement evaluation.

DOT National Transportation Integrated Search

2000-01-01

This report presents the results of an evaluation of video technology as a possible solution to the problem of safely collecting objective condition data for prioritizing concrete pavement rehabilitation needs in Virginia. The study involved the eval...

STARE-HI – Statement on Reporting of Evaluation Studies in Health Informatics

PubMed Central

Brender, J.; Talmon, J.; de Keizer, N.; Nykänen, P.; Rigby, M.; Ammenwerth, E.

2013-01-01

Summary Background Improving the quality of reporting of evaluation studies in health informatics is an important requirement towards the vision of evidence-based health informatics. The STARE-HI – Statement on Reporting of Evaluation Studies in health informatics, published in 2009, provides guidelines on the elements to be contained in an evaluation study report. Objectives To elaborate on and provide a rationale for the principles of STARE-HI and to guide authors and readers of evaluation studies in health informatics by providing explanatory examples of reporting. Methods A group of methodologists, researchers and editors prepared the present elaboration of the STARE-HI statement and selected examples from the literature. Results The 35 STARE-HI items to be addressed in evaluation papers describing health informatics interventions are discussed one by one and each is extended with examples and elaborations. Conclusion The STARE-HI statement and this elaboration document should be helpful resources to improve reporting of both quantitative and qualitative evaluation studies. Evaluation manuscripts adhering to the principles will enable readers of such papers to better place the studies in a proper context and judge their validity and generalizability, and thus in turn optimize the exploitation of the evidence contained therein. Limitations This paper is based on experiences of a group of editors, reviewers, authors of systematic reviews and readers of the scientific literature. The applicability of the details of these principles has to evolve as a function of their use in practice. PMID:24155788

Evaluation of an Online Study Skills Course

ERIC Educational Resources Information Center

Pryjmachuk, Steven; Gill, Anita; Wood, Patricia; Olleveant, Nicola; Keeley, Philip

2012-01-01

This article describes the evaluation of an online study skills course unit designed, using evidence-based principles, to support undergraduate students. A mixed-methods approach was employed to establish the extent to which the unit was (a) fit for purpose and (b) effective. Data were obtained from an online survey (n = 63) conducted on entry to…

An Evaluative Case Study on Professional Competency of Preservice Information Technology Teachers

ERIC Educational Resources Information Center

Kabakci Yurdakul, Isil

2011-01-01

The purpose of this study is to evaluate preservice Information Technology (IT) teachers' professional competency in the teaching process. The study was designed on the basis of evaluative case study. The participants of the study consisted of seven preservice IT teachers attending the department of Computer Education and Instructional…

Field Artillery Ammunition Processing System (FAAPS) concept evaluation study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kring, C.T.; Babcock, S.M.; Watkin, D.C.

1992-06-01

The Field Artillery Ammunition Processing System (FAAPS) is an initiative to introduce a palletized load system (PLS) that is transportable with an automated ammunition processing and storage system for use on the battlefield. System proponents have targeted a 20% increase in the ammunition processing rate over the current operation while simultaneously reducing the total number of assigned field artillery battalion personnel by 30. The overall objective of the FAAPS Project is the development and demonstration of an improved process to accomplish these goals. The initial phase of the FAAPS Project and the subject of this study is the FAAPS conceptmore » evaluation. The concept evaluation consists of (1) identifying assumptions and requirements, (2) documenting the process flow, (3) identifying and evaluating technologies available to accomplish the necessary ammunition processing and storage operations, and (4) presenting alternative concepts with associated costs, processing rates, and manpower requirements for accomplishing the operation. This study provides insight into the achievability of the desired objectives.« less

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debono, Josephine C, E-mail: josephine.debono@bci.org.au; Poulos, Ann E; Westmead Breast Cancer Institute, Westmead, New South Wales

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies. A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers. Eleven studies were identified and the constructed toolmore » applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading. This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice.« less

A framework and case studies for evaluation of enzyme ontogeny in children's health risk evaluation.

PubMed

Ginsberg, Gary; Vulimiri, Suryanarayana V; Lin, Yu-Sheng; Kancherla, Jayaram; Foos, Brenda; Sonawane, Babasaheb

2017-01-01

Knowledge of the ontogeny of Phase I and Phase II metabolizing enzymes may be used to inform children's vulnerability based upon likely differences in internal dose from xenobiotic exposure. This might provide a qualitative assessment of toxicokinetic (TK) variability and uncertainty pertinent to early lifestages and help scope a more quantitative physiologically based toxicokinetic (PBTK) assessment. Although much is known regarding the ontogeny of metabolizing systems, this is not commonly utilized in scoping and problem formulation stage of human health risk evaluation. A framework is proposed for introducing this information into problem formulation which combines data on enzyme ontogeny and chemical-specific TK to explore potential child/adult differences in internal dose and whether such metabolic differences may be important factors in risk evaluation. The framework is illustrated with five case study chemicals, including some which are data rich and provide proof of concept, while others are data poor. Case studies for toluene and chlorpyrifos indicate potentially important child/adult TK differences while scoping for acetaminophen suggests enzyme ontogeny is unlikely to increase early-life risks. Scoping for trichloroethylene and aromatic amines indicates numerous ways that enzyme ontogeny may affect internal dose which necessitates further evaluation. PBTK modeling is a critical and feasible next step to further evaluate child-adult differences in internal dose for a number of these chemicals.

Data envelopment analysis in service quality evaluation: an empirical study

NASA Astrophysics Data System (ADS)

Najafi, Seyedvahid; Saati, Saber; Tavana, Madjid

2015-09-01

Service quality is often conceptualized as the comparison between service expectations and the actual performance perceptions. It enhances customer satisfaction, decreases customer defection, and promotes customer loyalty. Substantial literature has examined the concept of service quality, its dimensions, and measurement methods. We introduce the perceived service quality index (PSQI) as a single measure for evaluating the multiple-item service quality construct based on the SERVQUAL model. A slack-based measure (SBM) of efficiency with constant inputs is used to calculate the PSQI. In addition, a non-linear programming model based on the SBM is proposed to delineate an improvement guideline and improve service quality. An empirical study is conducted to assess the applicability of the method proposed in this study. A large number of studies have used DEA as a benchmarking tool to measure service quality. These models do not propose a coherent performance evaluation construct and consequently fail to deliver improvement guidelines for improving service quality. The DEA models proposed in this study are designed to evaluate and improve service quality within a comprehensive framework and without any dependency on external data.

Evaluation of professional supervision in Aotearoa/New Zealand: An interprofessional study.

PubMed

Davys, Allyson Mary; O'Connell, Michael; May, Janet; Burns, Beverley

2017-06-01

The evaluation of professional supervision has been a focus for discussion in the supervision literature over past decades. A review of the literature in this area, however, suggests that evaluation has been differently defined, variously addressed, and a range of outcomes reported. The present study reports the findings of the first stage of a three-stage study of evaluation in professional supervision in Aotearoa/New Zealand. Experienced practitioners from the four professions of counselling, mental health nursing, psychology, and social work were interviewed to explore how evaluation in professional supervision is understood and actioned in practice. Twenty four semistructured interviews were conducted with supervisees, supervisors, and managers from each of the identified professions. The findings from these interviews indicate that a majority of participants applied some form of evaluation to their supervision arrangement. These evaluations, however, did not reflect an overarching organizational or professional culture of formal evaluation, but rather, an individualized ad-hoc process initiated by one or both of the participants (supervisor and supervisee). These evaluations focussed predominantly on the process, rather than the outcomes, of supervision. While many respondents expressed interest in a formal process for evaluating supervision, a number of concerns were also raised. These concerns included a lack of evaluation skills and resource, the potential for formal evaluation to have a negative impact on the supervision relationship, the importance of maintaining the boundaries of confidentiality, and a wariness regarding the possible use of any information gathered. © 2016 Australian College of Mental Health Nurses Inc.

Web-site evaluation tools: a case study in reproductive health information.

PubMed

Aslani, Azam; Pournik, Omid; Abu-Hanna, Ameen; Eslami, Saeid

2014-01-01

Internet forms an opportunity to inform, teach, and connect professionals and patients. However, much information on Internet is incomplete, inaccurate, or misleading, and not only in the medical domain. Because of the potential for damage from misleading and inaccurate health information, many organizations and individuals have published or implemented scoring tools for evaluating the appropriateness or quality of these resources. The objective of this study is to identify and summarize scoring tools that have evaluated web-sites providing reproductive health information in order to compare them and recommend an overarching evaluation tool. We searched Ovid MEDLINE(R) (1946 to July 2013) and OVID Embase (1980 to July 2013); and included English language studies that have evaluated the quality of websites providing reproductive health information. Studies only assessing the content of websites were excluded. We identified 5 scoring tools: 1-The HON (health on the net) Code of Conduct for medical and health Web sites, 2-Silberg scores, 3-Hogne Sandvik scale, 4-Jim Kapoun's Criteria for Evaluating Web Pages, and 5-The Health Information Technology Institute (HITI) criteria. We have compared these scales and identified 14 criteria: authorship, ownership, currency, objectivity/content, transparency/source, interactivity, privacy/ethics, financial disclosure, navigability/links, complementarity, advertising policy, design, quantity, and accessibility. We integrated these criteria and introduced a new tool with 10 criteria. Website evaluation tools differ in their evaluation criteria and there is a lack of consensus about which to use; therefore, an integrated easy to use set of criteria is needed.

Surgery resident selection and evaluation. A critical incident study.

PubMed

Edwards, J C; Currie, M L; Wade, T P; Kaminski, D L

1993-03-01

This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general surgery faculty members and four senior residents. The researchers then directed the surgeons in a two-step process of sorting the incidents into categories and naming the categories. The final essential categories of behavior to define surgical competence were derived through discussion among the surgeons until a consensus was formed. Those categories are knowledge/self-education, clinical performance, diagnostic skills, surgical skills, communication skills, reliability, integrity, compassion, organization skills, motivation, emotional control, and personal appearance. These categories were then used to develop an interview evaluation form for selection purposes and a performance evaluation form to be used throughout residency training. Thus a continuum of evaluation was established. The categories and critical incidents were also used to structure the interview process, which has demonstrated increased interview validity and reliability in many other studies. A handbook for structuring the interviews faculty members conduct with applicants was written, and an interview training session was held with the faculty. The process of implementation of the structured selection interviews is being documented currently through qualitative research.

Descriptive analysis of context evaluation instrument for technical oral presentation skills evaluation: A case study in English technical communication course

NASA Astrophysics Data System (ADS)

Mohamed, Abdullah-Adnan; Asmawi, Adelina; Hamid, Mohd Rashid Ab; Mustafa, Zainol bin

2015-02-01

This paper reports a pilot study of Context Evaluation using a self-developed questionnaire distributed among engineering undergraduates at a university under study. The study aims to validate the self-developed questionnaires used in the Context evaluation, a component in the CIPP Model. The Context evaluation assesses background information for needs, assets, problems and opportunities relevant to beneficiaries of the study in a defined environment. Through the questionnaire, background information for the assessment of needs, assets and problems related to the engineering undergraduates' perceptions on the teaching and learning of technical oral presentation skills was collected and analysed. The questionnaire was developed using 5-points Likert scale to measure the constructs under study. They were distributed to 100 respondents with 79 returned. The respondents consisted of engineering undergraduates studied at various faculties at one technical university in Malaysia. The descriptive analysis of data for each item which makes up the construct for Context evaluation is found to be high. This implied that engineering undergraduates showed high interest in teaching and learning of technical oral presentation skills, thus their needs are met. Also, they agreed that assets and facilities are conducive to their learning. In conclusion, the context evaluation involving needs and assets factors are both considerably important; their needs are met and the assets and facilities do support their technical oral presentation skills learning experience.

Evaluating Students' Beliefs in Problem Solving Process: A Case Study

ERIC Educational Resources Information Center

Ozturk, Tugba; Guven, Bulent

2016-01-01

Problem solving is not simply a process that ends when an answer is found; it is a scientific process that evolves from understanding the problem to evaluating the solution. This process is affected by several factors. Among these, one of the most substantial is belief. The purpose of this study was to evaluate the beliefs of high school students…

Problems and challenges of nursing students’ clinical evaluation: A qualitative study

PubMed Central

Rafiee, Ghazanfar; Moattari, Marzieh; Nikbakht, Alireza N; Kojuri, Javad; Mousavinasab, Masoud

2014-01-01

Background: The purpose of this qualitative exploratory study was to explore the views of nursing trainers and students about nursing students’ clinical evaluation problems and drawbacks in Shiraz Nursing and Midwifery School. Materials and Methods: A qualitative exploratory approach was used in this study at Shiraz Nursing and Midwifery School in 2012. A purposeful sample of 8 nursing instructors and 40 nursing students was interviewed and the data on their opinions about the problems of the clinical evaluation were collected through semi-structured deep interviews. Initially, four open-ended questions, which were related to the clinical evaluation status, problems, were used to stimulate discussions in the interview sessions. Content analysis was employed in order to analyze the transcribed data. The recorded interviews were initially transcribed, read, and reread on a number of occasions to get an overall feeling of what the participants were saying. Each line or incident was described, and then a code, which reflected the essence of the participants’ comments, was given. Results: The codes were compared for similarity and differences, merged together, and categorized. Finally, five themes emerged: In appropriate clinical evaluation method, problems of clinical evaluation Process, problems related to clinical instructors, unsuitable programming of clinical education, and organizational shortcomings. Conclusion: Besides focusing on upgrading the current clinical evaluation forms, nursing trainers should improve their knowledge about a complete and comprehensive clinical evaluation. They should also apply other appropriate and objective clinical evaluation methods and tools, and perform a formative and summative clinical evaluation. Also, workload adjustment of the nursing trainers needs revision. Therefore, despite using traditional and sometimes limited evaluation methods for assessing nursing students, a co mprehensive and appropriate evaluation of nursing

Evaluation of the Project Studies in Social Studies Course of Secondary Schools in Turkey

ERIC Educational Resources Information Center

Ibret, B. Unal; Recepoglu, Ergun; Karasu, Emine; Recepoglu, Serpil

2013-01-01

The aim of this study is to evaluate project studies in the 6th and 7th grades social studies courses of secondary schools according to opinions of students. This study is a descriptive research in the survey model. The sample is 880 students selected from 6th and 7th grades of 22 secondary schools randomly in central province of Kastamonu. As a…

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and

42 CFR 456.242 - UR plan requirements for medical care evaluation studies.

Code of Federal Regulations, 2010 CFR

2010-10-01

... HEALTH AND HUMAN SERVICES (CONTINUED) MEDICAL ASSISTANCE PROGRAMS UTILIZATION CONTROL Utilization Control: Mental Hospitals Ur Plan: Medical Care Evaluation Studies § 456.242 UR plan requirements for medical care... evaluation studies in the mental hospital; (2) Documents for each study— (i) Its results; and (ii) How the...

Ground penetrating radar study--phase I : technology review and evaluation.

DOT National Transportation Integrated Search

2006-08-01

In December 2005 Mississippi Department of Transportation (MDOT) initiated State Study No. 182 on review : and evaluation of ground penetrating radar (GPR) technology. This Phase I study has reviewed GPR equipment : and data interpretation methodolog...

Evaluation of the Ramazzini Foundation Study of Methanol in Rats

EPA Pesticide Factsheets

Evaluation of the Ramazzini Foundation Study of Methanol in Rats: A Comparison of Diagnoses by the RF Study Pathologist and a Recent NTP Review Team, summarized by George Cruzan and submitted to the Methanol Institute

Evaluating care from a care ethical perspective:: A pilot study.

PubMed

Kuis, Esther E; Goossensen, Anne

2017-08-01

Care ethical theories provide an excellent opening for evaluation of healthcare practices since searching for (moments of) good care from a moral perspective is central to care ethics. However, a fruitful way to translate care ethical insights into measurable criteria and how to measure these criteria has as yet been unexplored: this study describes one of the first attempts. To investigate whether the emotional touchpoint method is suitable for evaluating care from a care ethical perspective. An adapted version of the emotional touchpoint interview method was used. Touchpoints represent the key moments to the experience of receiving care, where the patient recalls being touched emotionally or cognitively. Participants and research context: Interviews were conducted at three different care settings: a hospital, mental healthcare institution and care facility for older people. A total of 31 participants (29 patients and 2 relatives) took part in the study. Ethical considerations: The research was found not to be subject to the (Dutch) Medical Research Involving Human Subjects Act. A three-step care ethical evaluation model was developed and described using two touchpoints as examples. A focus group meeting showed that the method was considered of great value for partaking institutions in comparison with existing methods. Reflection and discussion: Considering existing methods to evaluate quality of care, the touchpoint method belongs to the category of instruments which evaluate the patient experience. The touchpoint method distinguishes itself because no pre-defined categories are used but the values of patients are followed, which is an essential issue from a care ethical perspective. The method portrays the insider perspective of patients and thereby contributes to humanizing care. The touchpoint method is a valuable instrument for evaluating care; it generates evaluation data about the core care ethical principle of responsiveness.

Case Studies of Five Teacher Supervision/Evaluation Systems.

ERIC Educational Resources Information Center

Patrick, Edward M.; Dawson, Judith A.

In the 1984-85 school year, the Pennsylvania Department of Education (PDE) began to actively encourage Pennsylvania school districts to reform their teacher supervision/evaluation (TS/E) procedures. To obtain data necessary for developing TS/E models, the PDE commissioned Research for Better Schools (RBS) to conduct a study of five school…

Study on corporate social responsibility evaluation system based on stakeholder theory

NASA Astrophysics Data System (ADS)

Ma, J.; Deng, Liming

2011-10-01

The issue of Corporate Social Responsibility (CSR) has been attracting the attention from many disciplines such as economics, management, laws, sociality and philosophy since last century. The purpose of this study is to explore the impact of CSR on performance and develop a CSR evaluation system. Building on the definition of CSR and Stakeholder theory, this article built a path-relationship model of CSR and business operation performance. The paper also constructed CSR evaluation system based on KLD index, GRJ report, CSR accounting account, SA8000, ISO14000 etc. The research provides a basis for future studies about the relationship between CSR and business performance and shed some light on the evaluation of CSR practices.

Initial Results of an MDO Method Evaluation Study

NASA Technical Reports Server (NTRS)

Alexandrov, Natalia M.; Kodiyalam, Srinivas

1998-01-01

The NASA Langley MDO method evaluation study seeks to arrive at a set of guidelines for using promising MDO methods by accumulating and analyzing computational data for such methods. The data are collected by conducting a series of re- producible experiments. In the first phase of the study, three MDO methods were implemented in the SIGHT: framework and used to solve a set of ten relatively simple problems. In this paper, we comment on the general considerations for conducting method evaluation studies and report some initial results obtained to date. In particular, although the results are not conclusive because of the small initial test set, other formulations, optimality conditions, and sensitivity of solutions to various perturbations. Optimization algorithms are used to solve a particular MDO formulation. It is then appropriate to speak of local convergence rates and of global convergence properties of an optimization algorithm applied to a specific formulation. An analogous distinction exists in the field of partial differential equations. On the one hand, equations are analyzed in terms of regularity, well-posedness, and the existence and unique- ness of solutions. On the other, one considers numerous algorithms for solving differential equations. The area of MDO methods studies MDO formulations combined with optimization algorithms, although at times the distinction is blurred. It is important to

[Preliminary study of rabbit experiment modality for evaluating cardiac fatigue].

PubMed

Yan, Xiaobo; Luo, Linmei; Liu, Leichu; Xiao, Shouzhong; Deng, Suyuan; Xiang, Lingli; Zhang, Cong

2013-04-01

This paper presents a preliminary study of rabbit experiment modality incorporating a new indicator for evaluating cardiac function changes, providing a basis for subsequent study of cardiac fatigue. Using only biochemical indicators, such as troponins, is difficult to make a distinction between exercise-induced cardiac fatigue (EICF) and exercise-induced cardiac damage (EICD). Therefore, some new indicators are needed to evaluate cardiac fatigue synthetically. In our study, we used New Zealand white rabbits to conduct a multi-step swimming experiments with load. We made the rabbits reach an exhaustive state to evaluate whether the amplitude ratio of the first to second heart sound (S1/S2) and heart rate (HR) during the exhaustive exercise would be decreased and whether they would be able to recover after the exhaustive exercise for 24 hours. During the first phase of swimming, S1/S2 and HR were increased, and then decreased at exhaustive state. They were recovered after the exhaustive exercise for 24 hours. Overloading led to deaths of three rabbis, and new phenomena from overloading and related to this kind of death were observed. The experiments proved that Multi-steps swimming experiments with loads by using New Zealand white rabbit is useful for studying cardiac fatigue and premonition of sudden cardiac death.

In-situ culvert rehabilitation : synthesis study and field evaluation.

DOT National Transportation Integrated Search

2009-06-01

This synthesis study evaluated culvert rehabilitation (repair) methods involving trenchless technologies that may be appropriate for use in Utah. This report is not intended as a replacement for installation manuals provided by the manufacturers but ...

Case Studies of Teacher Satisfaction with Three Plans for Evaluation and Supervision

ERIC Educational Resources Information Center

Arp, Jeb-Stuart Bennett

2013-01-01

The purpose of this study was to identify which plans for evaluation and supervision are most satisfactory to teachers. The study's participants come from three school systems in northwest Georgia. Each school district uses a different plan for evaluation and supervision; each claiming that the end goal is to improve teacher performance. Prior…

Overview of the Building Assessment Survey and Evaluation Study

EPA Pesticide Factsheets

The Building Assessment Survey and Evaluation (BASE) study was conducted over a five-year period from 1994-1998, to characterize determinants of indoor air quality (IAQ) and occupant perceptions in representative public and commercial office buildings.

Travtek Evaluation Safety Study

DOT National Transportation Integrated Search

1996-02-01

One of the major evaluation goals of the TravTek operational test was to assess the safety impact of the TravTek system as implemented in Orlando, Florida during the 1 -year deployment phase. Also, the results of the TravTek operational test, with re...

Review of quality assessment tools for the evaluation of pharmacoepidemiological safety studies

PubMed Central

Neyarapally, George A; Hammad, Tarek A; Pinheiro, Simone P; Iyasu, Solomon

2012-01-01

Objectives Pharmacoepidemiological studies are an important hypothesis-testing tool in the evaluation of postmarketing drug safety. Despite the potential to produce robust value-added data, interpretation of findings can be hindered due to well-recognised methodological limitations of these studies. Therefore, assessment of their quality is essential to evaluating their credibility. The objective of this review was to evaluate the suitability and relevance of available tools for the assessment of pharmacoepidemiological safety studies. Design We created an a priori assessment framework consisting of reporting elements (REs) and quality assessment attributes (QAAs). A comprehensive literature search identified distinct assessment tools and the prespecified elements and attributes were evaluated. Primary and secondary outcome measures The primary outcome measure was the percentage representation of each domain, RE and QAA for the quality assessment tools. Results A total of 61 tools were reviewed. Most tools were not designed to evaluate pharmacoepidemiological safety studies. More than 50% of the reviewed tools considered REs under the research aims, analytical approach, outcome definition and ascertainment, study population and exposure definition and ascertainment domains. REs under the discussion and interpretation, results and study team domains were considered in less than 40% of the tools. Except for the data source domain, quality attributes were considered in less than 50% of the tools. Conclusions Many tools failed to include critical assessment elements relevant to observational pharmacoepidemiological safety studies and did not distinguish between REs and QAAs. Further, there is a lack of considerations on the relative weights of different domains and elements. The development of a quality assessment tool would facilitate consistent, objective and evidence-based assessments of pharmacoepidemiological safety studies. PMID:23015600

Ethics reflection groups in community health services: an evaluation study.

PubMed

Lillemoen, Lillian; Pedersen, Reidar

2015-04-17

Systematic ethics support in community health services in Norway is in the initial phase. There are few evaluation studies about the significance of ethics reflection on care. The aim of this study was to evaluate systematic ethics reflection in groups in community health (including nursing homes and residency), - from the perspectives of employees participating in the groups, the group facilitators and the service managers. The reflection groups were implemented as part of a research and development project. A mixed-methods design with qualitative focus group interviews, observations and written reports were used to evaluate. The study was conducted at two nursing homes, two home care districts and a residence for people with learning disabilities. Participants were employees, facilitators and service managers. The study was guided by ethical standard principles and was approved by the Norwegian Social Science Data Services. We found support for ethics reflection as a valuable measure to strengthen clinical practice. New and improved solutions, more cooperation between employees, and improved collaboration with patients and their families are some of the results. No negative experiences were found. Instead, the ethics reflection based on experiences and challenges in the workplace, was described as a win-win situation. The evaluation also revealed what is needed to succeed and useful tips for further development of ethics support in community health services. Ethics reflection groups focusing on ethical challenges from the participants' daily work were found to be significant for improved practice, collegial support and cooperation, personal and professional development among staff, facilitators and managers. Resources needed to succeed were managerial support, and anchoring ethics sessions in the routine of daily work.

Objective evaluation of acute adverse events and image quality of gadolinium-based contrast agents (gadobutrol and gadobenate dimeglumine) by blinded evaluation. Pilot study.

PubMed

Semelka, Richard C; Hernandes, Mateus de A; Stallings, Clifton G; Castillo, Mauricio

2013-01-01

The purpose was to objectively evaluate a recently FDA-approved gadolinium-based contrast agent (GBCA) in comparison to our standard GBCA for acute adverse events and image quality by blinded evaluation. Evaluation was made of a recently FDA-approved GBCA, gadobutrol (Gadavist; Bayer), in comparison to our standard GBCA, gadobenate dimeglumine (MultiHance; Bracco), in an IRB- and HIPAA-compliant study. Both the imaging technologist and patient were not aware of the brand of the GBCA used. A total of 59 magnetic resonance studies were evaluated (59 patients, 31 men, 28 women, age range of 5-85 years, mean age of 52 years). Twenty-nine studies were performed with gadobutrol (22 abdominal and 7 brain studies), and 30 studies were performed with gadobenate dimeglumine (22 abdominal and 8 brain studies). Assessment was made of acute adverse events focusing on objective observations of vomiting, hives, and moderate and severe reactions. Adequacy of enhancement was rated as poor, fair and good by one of two experienced radiologists who were blinded to the type of agent evaluated. No patient experienced acute adverse events with either agent. The target minor adverse events of vomiting or hives, and moderate and severe reactions were not observed in any patient. Adequacy of enhancement was rated as good for both agents in all patients. Objective, blinded evaluation is feasible and readily performable for the evaluation of GBCAs. This proof-of-concept study showed that both GBCAs evaluated exhibited consistent good image quality and no noteworthy adverse events. Copyright © 2013 Elsevier Inc. All rights reserved.

Adult day health care evaluation study: methodology and implementation. Adult Day Health Care Evaluation Development Group.

PubMed Central

Hedrick, S C; Rothman, M L; Chapko, M; Inui, T S; Kelly, J R; Ehreth, J

1991-01-01

The Adult Day Health Care Evaluation Study was developed in response to a congressional mandate to study the medical efficacy and cost effectiveness of the Adult Day Health Care (ADHC) effort in the Department of Veterans Affairs (VA). Four sites providing ADHC in VA facilities are participating in an ongoing randomized controlled trial. Three years of developmental work prior to the study addressed methodological issues that were problematic in previous studies. This developmental work resulted in the methodological approaches described here: (1) a patient recruitment process that actively recruits and screens all potential candidates using empirically developed admission criteria based on predictors of nursing home placement in VA; (2) the selection and development of measures of medical efficacy that assess a wide range of patient and caregiver outcomes with sufficient sensitivity to detect small but clinically important changes; and (3) methods for detailed, accurate, and efficient measurement of utilization and costs of health care within and outside VA. These approaches may be helpful to other researchers and may advance the methodological sophistication of long-term care program evaluation. PMID:1991678

Evaluation of School Uniform Policy in Turkey: A Case Study

ERIC Educational Resources Information Center

Cinoglu, Mustafa

2014-01-01

The purpose of this study is to evaluate the results of current school uniform policies according to views of stakeholders. Descriptive case study method was used for this study to understand the concerns of the stakeholders about school uniforms. Data was collected through interviews with stakeholders and also reviewing the documents in TOKI…

Generalisability in economic evaluation studies in healthcare: a review and case studies.

PubMed

Sculpher, M J; Pang, F S; Manca, A; Drummond, M F; Golder, S; Urdahl, H; Davies, L M; Eastwood, A

2004-12-01

To review, and to develop further, the methods used to assess and to increase the generalisability of economic evaluation studies. Electronic databases. Methodological studies relating to economic evaluation in healthcare were searched. This included electronic searches of a range of databases, including PREMEDLINE, MEDLINE, EMBASE and EconLit, and manual searches of key journals. The case studies of a decision analytic model involved highlighting specific features of previously published economic studies related to generalisability and location-related variability. The case-study involving the secondary analysis of cost-effectiveness analyses was based on the secondary analysis of three economic studies using data from randomised trials. The factor most frequently cited as generating variability in economic results between locations was the unit costs associated with particular resources. In the context of studies based on the analysis of patient-level data, regression analysis has been advocated as a means of looking at variability in economic results across locations. These methods have generally accepted that some components of resource use and outcomes are exchangeable across locations. Recent studies have also explored, in cost-effectiveness analysis, the use of tests of heterogeneity similar to those used in clinical evaluation in trials. The decision analytic model has been the main means by which cost-effectiveness has been adapted from trial to non-trial locations. Most models have focused on changes to the cost side of the analysis, but it is clear that the effectiveness side may also need to be adapted between locations. There have been weaknesses in some aspects of the reporting in applied cost-effectiveness studies. These may limit decision-makers' ability to judge the relevance of a study to their specific situations. The case study demonstrated the potential value of multilevel modelling (MLM). Where clustering exists by location (e.g. centre or

Computed tomography in the evaluation of penetrating neck trauma: a preliminary study.

PubMed

Gracias, V H; Reilly, P M; Philpott, J; Klein, W P; Lee, S Y; Singer, M; Schwab, C W

2001-11-01

Penetrating neck trauma has traditionally been evaluated by surgical exploration and/or invasive diagnostic studies. We hypothesized that computed tomography (CT), used as an early diagnostic tool to accurately determine trajectory, would direct or eliminate further studies or procedures in stable patients with penetrating neck trauma. Retrospective case series. Academic, urban, level I trauma center. Hemodynamically stable patients without hard signs of vascular injury or aerodigestive violation who had sustained penetrating trauma to the neck. Patients underwent a spiral CT as an initial diagnostic study after initial evaluation in the trauma bay. Further invasive studies were directed by CT findings. Number of invasive studies performed. Twenty-three patients were identified during the 30-month period. Nineteen patients sustained gunshot wounds; 3, shotgun wounds; and 1, a stab wound. One patient died of a cranial gunshot wound. Three isolated zone I, 1 isolated zone II, 9 isolated zone III, and 10 multiple neck zone trajectories were evaluated. Thirteen patients were identified by CT to have trajectories remote from vital structures and required no further evaluation. Ten patients underwent angiography. Only 2 underwent bronchoscopy and esophagoscopy. Four patients were discharged from the emergency department; 7 other patients were discharged within 24 hours. No adverse patient events occurred before, during, or after CT scan. Computed tomography in stable selected patients with penetrating neck trauma appears safe. Invasive studies can often be eliminated from the diagnostic algorithm when CT demonstrates trajectories remote from vital structures. As a result, efficient evaluation and early discharge from the trauma bay or emergency department can be realized. Further prospective study of CT scan after penetrating neck trauma is needed.

FBI fingerprint identification automation study: AIDS 3 evaluation report. Volume 5: Current system evaluation

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The performance, costs, organization and other characteristics of both the manual system and AIDS 2 were used to establish a baseline case. The results of the evaluation are to be used to determine the feasibility of the AIDS 3 System, as well as provide a basis for ranking alternative systems during the second phase of the JPL study. The results of the study were tabulated by subject, scope and methods, providing a descriptive, quantitative and qualitative analysis of the current operating systems employed by the FBI Identification Division.

78 FR 41926 - Proposed Information Collection Request; Comment Request; Performance Evaluation Studies on...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-12

... ENVIRONMENTAL PROTECTION AGENCY [EPA-HQ-OECA-2013-0413; FRL--9832-8] Proposed Information Collection Request; Comment Request; Performance Evaluation Studies on Wastewater Laboratories (Renewal); EPA... request (ICR), ``Performance Evaluation Studies on Wastewater Laboratories'' (EPA ICR No. 0234.11, OMB...

Guidance for Identifying, Selecting and Evaluating Open Literature Studies

EPA Pesticide Factsheets

This guidance for Office of Pesticide Program staff will assist in their evaluation of open literature studies of pesticides. It also describes how we identify, select, and ensure that data we use in risk assessments is of sufficient scientific quality.

Evaluation of National Adaptation Planning: A Case Study in Indonesia

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kawanishi, Masato; Ridwan, Nadia Amelia

2016-01-01

The present study aims to evaluate national adaptation planning, using the National Action Plan for Climate Change Adaptation (RAN-API) in Indonesia as a case. In doing so, the current study applies the methodology used in Preston et al. (2011), where a set of 57 adaptation plans from three developed countries was evaluated against 19 planning processes. The same criteria and scoring system were applied to the current study to evaluate RAN-API, both as identified in its document and as viewed by the stakeholders. A desktop review and questionnaires were undertaken to this end. It was found that discrepancies exist betweenmore » the status of RAN-API as documented and the stakeholders views of some criteria, suggesting that information or knowledge gaps may still exist despite the efforts made for stakeholder engagement. In some of the other criteria, the stakeholders views match the status as identified in the document. Most notably, they both agree that the weakness of RAN-API is related to limited consideration for non-climatic factors. While the development of RAN-API is a critical step taken in the country, the current study finds that there remains room for further improvement. The criteria or indicators to be used to assess the progress of RAN-API as a whole may need to be further elaborated.« less

The Correction of Myopia Evaluation Trial: lessons from the study design.

PubMed

Hyman, L; Gwiazda, J

2004-01-01

The Correction of Myopia Evaluation Trial (COMET), a multicentre clinical trial based in 4 schools of optometry in the United States, evaluated the effect of progressive addition lenses versus single vision lenses on myopia progression in an ethnically diverse group of 469 myopic children aged 6 to 11 years. Completion of the clinical trial phase of the study provides an opportunity to evaluate aspects of the study design that contribute to its success. This article describes aspects of the study design that were influential in ensuring the smooth conduct of COMET. These include a dedicated team of investigators, an organisational structure with strong leadership and an independent Co-ordinating Centre, regular communication among investigators, flexible and creative approaches to recruitment and retention, sensitivity to concerns for child safety and child participation, and methods for enhancing and monitoring data reliability. The experience with COMET has provided a number of valuable lessons for all aspects of the study design that should benefit the development and implementation of future clinical trials, particularly those done in similar populations of children. The use of a carefully designed protocol using standard methods by dedicated members of the study team is essential in ensuring achievement of the study aims.

Environmental strategies: A case study of systematic evaluation

NASA Astrophysics Data System (ADS)

Sherman, Douglas J.; Garès, Paul A.

1982-09-01

A major problem facing environmental managers is the necessity to effectively evaluate management alternatives. Traditional environmental assessments have emphasized the use of economic analyses. These approaches are often deficient due to difficulty in assigning dollar values to environmental systems and to social amenities. A more flexible decisionmaking model has been developed to analyze management options for coping with beach erosion problems at the Sandy Hook Unit of Gateway National Recreation Area in New Jersey. This model is comprised of decision-making variables which are formulated from a combination of environmental and management criteria, and it has an accept-reject format in which the management options are analyzed in terms of the variables. Through logical ordering of the insertion of the variables into the model, stepwise elimination of alternatives is possible. A hierarchy of variables is determined through estimating work required to complete an assessment of the alternatives for each variable. The assessment requiring the least work is performed first so that the more difficult evaluation will be limited to fewer alternatives. The application of this approach is illustrated with a case study in which beach protection alternatives were evaluated for the United States National Park Service.

Evaluation research in occupational health services: general principles and a systematic review of empirical studies.

PubMed

Hulshof, C T; Verbeek, J H; van Dijk, F J; van der Weide, W E; Braam, I T

1999-06-01

To study the nature and extent of evaluation research in occupational health services (OHSs). Literature review of evaluation research in OHSs. On the basis of a conceptual model of OHS evaluation, empirical studies are categorised into aspects of input, process, output, outcome, and OHS core activities. Many methods to evaluate OHSs or OHS activities exist, depending on the objective and object of evaluation. The amount of empirical studies on evaluation of OHSs or OHS activities that met the non-restrictive inclusion criteria, was remarkably limited. Most of the 52 studies were more descriptive than evaluative. The methodological quality of most studies was not high. A differentiated picture of the evidence of effectiveness of OHSs arises. Occupational health consultations and occupational rehabilitation are hardly studied despite much time spent on the consultation by occupational physicians in most countries. The lack of effectiveness and efficiency of the pre-employment examination should lead to its abandonment as a means of selection of personnel by OHSs. Periodic health monitoring or surveillance, and education on occupational health hazards can be carried out with reasonable process quality. Identification and evaluation of occupational health hazards by a workplace survey can be done with a high output quality, which, however, does not guarantee a favourable outcome. Although rigorous study designs are not always applicable or feasible in daily practice, much more effort should be directed at the scientific evaluation of OHSs and OHS instruments. To develop evidence-based occupational health care the quality of evaluation studies should be improved. In particular, process and outcome of consultation and rehabilitation activities of occupational physicians need to be studied more.

Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies.

PubMed

Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry; Kunz, Regina

2017-01-25

 To explore agreement among healthcare professionals assessing eligibility for work disability benefits.  Systematic review and narrative synthesis of reproducibility studies.  Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies.  Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations. : Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed.  From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ-0.10). Inter-rater reliability was poor in six studies (37

Configuration evaluation and criteria plan. Volume 2: Evaluation critera plan (preliminary). Space Transportation Main Engine (STME) configuration study

NASA Technical Reports Server (NTRS)

Bair, E. K.

1986-01-01

The unbiased selection of the Space Transportation Main Engine (STME) configuration requires that the candidate engines be evaluated against a predetermined set of criteria which must be properly weighted to emphasize critical requirements defined prior to the actual evaluation. The evaluation and selection process involves the following functions: (1) determining if a configuration can satisfy basic STME requirements (yes/no); (2) defining the evaluation criteria; (3) selecting the criteria relative importance or weighting; (4) determining the weighting sensitivities; and (5) establishing a baseline for engine evaluation. The criteria weighting and sensitivities are cost related and are based on mission models and vehicle requirements. The evaluation process is used as a coarse screen to determine the candidate engines for the parametric studies and as a fine screen to determine concept(s) for conceptual design. The criteria used for the coarse and fine screen evaluation process is shown. The coarse screen process involves verifying that the candidate engines can meet the yes/no screening requirements and a semi-subjective quantitative evaluation. The fine screen engines have to meet all of the yes/no screening gates and are then subjected to a detailed evaluation or assessment using the quantitative cost evaluation processes. The option exists for re-cycling a concept through the quantitative portion of the screening and allows for some degree of optimization. The basic vehicle is a two stage LOX/HC, LOX/LH2 parallel burn vehicle capable of placing 150,000 lbs in low Earth orbit (LEO).

Evaluation Statistics Computed for the Wave Information Studies (WIS)

DTIC Science & Technology

2016-07-01

Studies (WIS) by Mary A. Bryant, Tyler J. Hesser, and Robert E. Jensen PURPOSE: This Coastal and Hydraulics Engineering Technical Note (CHETN...describes the statistical metrics used by the Wave Information Studies (WIS) and produced as part of the model evaluation process. INTRODUCTION: The...gauge locations along the Pacific, Great Lakes, Gulf of Mexico , Atlantic, and Western Alaska coasts. Estimates of wave climatology produced by ocean

FBI fingerprint identification automation study. AIDS 3 evaluation report. Volume 1: Compendium

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The primary features of the overall study are encompassed and an evaluation of an automation system is presented. Objectives of the study are described, methods of evaluation are summarized and conclusions about the system's feasibility are presented. Also included is a brief history of fingerprint automation activities within the FBI, the organization of the FBI, a bibliography of documents and records, a data dictionary and a reference set of all of the transparencies presented throughout the study.

Evaluability Assessment Thesis and Dissertation Studies in Graduate Professional Degree Programs

ERIC Educational Resources Information Center

Walser, Tamara M.; Trevisan, Michael S.

2016-01-01

Evaluability assessment (EA) has potential as a design option for thesis and dissertation studies, serving as a practical training experience for both technical and nontechnical evaluation skills. Based on a content review of a sample of EA theses and dissertations from graduate professional degree programs, the authors of this article found that…

Electrification Futures Study: A Technical Evaluation of the Impacts of an

Science.gov Websites

Technical Evaluation of the Impacts of an Electrified U.S. Energy System Electrification Futures Study: A Technical Evaluation of the Impacts of an Electrified U.S. Energy System Illustration showing various impacts of widespread electrification in the United States. In addition to NREL, the research team

Evaluation Services from Needs Assessment to Follow-up: A Case Study.

ERIC Educational Resources Information Center

Broadbooks, Wendy J.

This paper describes the nature and scope of evaluation services provided within the training division of Arthur Andersen & Company, and highlights some of the evaluation results. The cycle of assessment began with a needs assessment study at the curriculum level. Curriculum planning was undertaken for first-year trainees in the Tax Division.…

Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies

PubMed Central

Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry

2017-01-01

Objectives To explore agreement among healthcare professionals assessing eligibility for work disability benefits. Design Systematic review and narrative synthesis of reproducibility studies. Data sources Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies. Eligibility criteria Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations.Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed. Results From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ−0

A Study on Project Priority Evaluation Method on Road Slope Disaster Prevention Management

NASA Astrophysics Data System (ADS)

Sekiguchi, Nobuyasu; Ohtsu, Hiroyasu; Izu, Ryuutarou

To improve the safety and security of driving while coping with today's stagnant economy and frequent natural disasters, road slopes should be appropriately managed. To achieve the goals, road managers should establish project priority evaluation methods for each stage of road slope management by clarifying social losses that would result by drops in service levels. It is important that road managers evaluate a project priority properly to manage the road slope effectively. From this viewpoint, this study proposed "project priority evaluation methods" in road slope disaster prevention, which use available slope information at each stage of road slope management under limited funds. In addition, this study investigated the effect of managing it from the high slope of the priority by evaluating a risk of slope failure. In terms of the amount of available information, staged information provision is needed ranging from macroscopic studies, which involves evaluation of the entire route at each stage of decision making, to semi- and microscopic investigations for evaluating slopes, and microscopic investigations for evaluating individual slopes. With limited funds, additional detailed surveys are difficult to perform. It is effective to use the slope risk assessment system, which was constructed to complement detailed data, to extract sites to perform precise investigations.

A bibliometric analysis of evaluative medical education studies: characteristics and indexing accuracy.

PubMed

Sampson, Margaret; Horsley, Tanya; Doja, Asif

2013-03-01

To determine the characteristics of medical education studies published in general and internal medicine (GIM) and medical education journals, and to analyze the accuracy of their indexing. The authors identified the five GIM and five medical education journals that published the most articles indexed in MEDLINE as medical education during January 2001 to January 2010. They searched Ovid MEDLINE for evaluative medical education studies published in these journals during this period and classified them as quantitative or qualitative studies according to MEDLINE indexing. They also examined themes and learner levels targeted. Using a random sample of records, they assessed the accuracy of study-type indexing. Of 4,418 records retrieved, 3,853 (87.2%) were from medical education journals and 565 (12.3%) were from GIM journals. Qualitative studies and program evaluations were more prevalent within medical education journals, whereas GIM journals published a higher proportion of clinical trials and systematic reviews (χ=74.28, df=3, P<.001). Medical education journals had a concentration of studies targeting medical students, whereas GIM journals had a concentration targeting residents; themes were similar. The authors confirmed that 170 (56.7%) of the 300 sampled articles were correctly classified in MEDLINE as evaluative studies. The majority of the identified evaluative studies were published in medical education journals, confirming the integrity of medical education as a specialty. Findings concerning the study types published in medical education versus GIM journals are important for medical education researchers who seek to publish outside the field's specialty journals.

Evaluation Study of "Language, Literacy, & Vocabulary!" Spring 2006 Pilot

ERIC Educational Resources Information Center

McNabb, Mary

2006-01-01

Purpose: A pilot study of the "Language, Literacy, & Vocabulary!" program was conducted by Learning Gauger, Inc., for National Geographic School Publishing, in spring 2006. The program evaluation examined the classroom adoption approaches used by participating teachers and the subsequent impact of the "Language, Literacy, &…

Shuttle Ground Operations Efficiencies/Technologies (SGOE/T) study. Volume 2: Ground Operations evaluation

NASA Technical Reports Server (NTRS)

Scholz, A. L.; Hart, M. T.; Lowry, D. J.

1987-01-01

The Ground Operations Evaluation describes the breath and depth of the various study elements selected as a result of an operational analysis conducted during the early part of the study. Analysis techniques used for the evaluation are described in detail. Elements selected for further evaluation are identified; the results of the analysis documented; and a follow-on course of action recommended. The background and rationale for developing recommendations for the current Shuttle or for future programs is presented.

Student Use of Mobile Devices in Course Evaluation: A Longitudinal Study

ERIC Educational Resources Information Center

Champagne, Matthew V.

2013-01-01

A 2012 survey of higher education found that 27% of colleges and universities were "mobile ready", that is, allowing students to complete course evaluations via mobile devices, and 26% of schools planned to allow the use of mobile devices for course evaluations within the next year. The purpose of this study was to prepare for this…

Rationale, design and methods for process evaluation in the HEALTHY study.

PubMed

Schneider, M; Hall, W J; Hernandez, A E; Hindes, K; Montez, G; Pham, T; Rosen, L; Sleigh, A; Thompson, D; Volpe, S L; Zeveloff, A; Steckler, A

2009-08-01

The HEALTHY study was a multi-site randomized trial designed to determine whether a 3-year school-based intervention targeting nutrition and physical activity behaviors could effectively reduce risk factors associated with type 2 diabetes in middle school children. Pilot and formative studies were conducted to inform the development of the intervention components and the process evaluation methods for the main trial. During the main trial, both qualitative and quantitative assessments monitored the fidelity of the intervention and motivated modifications to improve intervention delivery. Structured observations of physical education classes, total school food environments, classroom-based educational modules, and communications and promotional campaigns provided verification that the intervention was delivered as intended. Interviews and focus groups yielded a multidimensional assessment of how the intervention was delivered and received, as well as identifying the barriers to and facilitators of the intervention across and within participating schools. Interim summaries of process evaluation data were presented to the study group as a means of ensuring standardization and quality of the intervention across the seven participating centers. Process evaluation methods and procedures documented the fidelity with which the HEALTHY study was implemented across 21 intervention schools and identified ways in which the intervention delivery might be enhanced throughout the study.

Teacher Evaluations in Leisure Studies Programs: An Old Issue with a New Slant.

ERIC Educational Resources Information Center

Butts, Frank B.; Swearingen, Tommy

1994-01-01

This paper examines teacher evaluation practices in leisure studies programs, noting the perceived effectiveness of rating instruments. Surveys of leisure studies professors nationwide indicated many institutions used evaluation instruments and processes that were not statistically validated; key decisions were often made on the basis of these…

MASA Study of Administrator Evaluation, 1974-75.

ERIC Educational Resources Information Center

Michigan Association of School Administrators, East Lansing.

Intended primarily for Michigan administrators, this document presents a variety of information on administrator evaluation. A survey of Michigan superintendents revealed, among other things, that there is a very high interest in administrative evaluation, that 45 percent of the responding districts have no formal evaluation system, that 36…

Challenges in evaluating clinical governance systems in iran: a qualitative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-04-01

In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead.

Study on automatic ECT data evaluation by using neural network

DOE Office of Scientific and Technical Information (OSTI.GOV)

Komatsu, H.; Matsumoto, Y.; Badics, Z.

1994-12-31

At the in--service inspection of the steam generator (SG) tubings in Pressurized Water Reactor (PWR) plant, eddy current testing (ECT) has been widely used at each outage. At present, ECT data evaluation is mainly performed by ECT data analyst, therefore it has the following problems. Only ECT signal configuration on the impedance trajectory is used in the evaluation. It is an enormous time consuming process. The evaluation result is influenced by the ability and experience of the analyst. Especially, it is difficult to identify the true defect signal hidden in background signals such as lift--off noise and deposit signals. Inmore » this work, the authors performed the study on the possibility of the application of neural network to ECT data evaluation. It was demonstrated that the neural network proved to be effective to identify the nature of defect, by selecting several optimum input parameters to categorize the raw ECT signals.« less

Ensuring Data Quality in Extension Research and Evaluation Studies

ERIC Educational Resources Information Center

Radhakrishna, Rama; Tobin, Daniel; Brennan, Mark; Thomson, Joan

2012-01-01

This article presents a checklist as a guide for Extension professionals to use in research and evaluation studies they carry out. A total of 40 statements grouped under eight data quality components--relevance, objectivity, validity, reliability, integrity, generalizability, completeness, and utility--are identified to ensure that research…

Mindfulness Based Stress Reduction for Academic Evaluation Anxiety: A Naturalistic Longitudinal Study.

PubMed

Dundas, Ingrid; Thorsheim, Torbjørn; Hjeltnes, Aslak; Binder, Per Einar

2016-04-02

Mindfulness based stress reduction (MBSR) for academic evaluation anxiety and self-confidence in 70 help-seeking bachelor's and master's students was examined. A repeated measures analysis of covariance on the 46 students who completed pretreatment and posttreatment measures (median age = 24 years, 83% women) showed that evaluation anxiety and self-confidence improved. A growth curve analysis with all 70 original participants showed reductions in both cognitive and emotional components of evaluation anxiety, and that reduction continued postintervention. Although more research is needed, this study indicates that MBSR may reduce evaluation anxiety.

What and How Are We Evaluating? Meta-Evaluation Study of the NASA Innovations in Climate Education (NICE) Portfolio

NASA Astrophysics Data System (ADS)

Martin, A. M.; Barnes, M. H.; Chambers, L. H.; Pippin, M. R.

2011-12-01

As part of NASA's Minority University Research and Education Program (MUREP), the NASA Innovations in Climate Education (NICE) project at Langley Research Center has funded 71 climate education initiatives since 2008. The funded initiatives span across the nation and contribute to the development of a climate-literate public and the preparation of a climate-related STEM workforce through research experiences, professional development opportunities, development of data access and modeling tools, and educational opportunities in both K-12 and higher education. Each of the funded projects proposes and carries out its own evaluation plan, in collaboration with external or internal evaluation experts. Using this portfolio as an exemplar case, NICE has undertaken a systematic meta-evaluation of these plans, focused primarily on evaluation questions, approaches, and methods. This meta-evaluation study seeks to understand the range of evaluations represented in the NICE portfolio, including descriptive information (what evaluations, questions, designs, approaches, and methods are applied?) and questions of value (do these evaluations meet the needs of projects and their staff, and of NASA/NICE?). In the current climate, as federal funders of climate change and STEM education projects seek to better understand and incorporate evaluation into their decisions, evaluators and project leaders are also seeking to build robust understanding of program effectiveness. Meta-evaluations like this provide some baseline understanding of the current status quo and the kinds of evaluations carried out within such funding portfolios. These explorations are needed to understand the common ground between evaluative best practices, limited resources, and agencies' desires, capacity, and requirements. When NASA asks for evaluation of funded projects, what happens? Which questions are asked and answered, using which tools? To what extent do the evaluations meet the needs of projects and

What and How Are We Evaluating? Meta-Evaluation Study of the NASA Innovations in Climate Education (NICE) Portfolio

NASA Astrophysics Data System (ADS)

Martin, A. M.; Barnes, M. H.; Chambers, L. H.; Pippin, M. R.

2013-12-01

As part of NASA's Minority University Research and Education Program (MUREP), the NASA Innovations in Climate Education (NICE) project at Langley Research Center has funded 71 climate education initiatives since 2008. The funded initiatives span across the nation and contribute to the development of a climate-literate public and the preparation of a climate-related STEM workforce through research experiences, professional development opportunities, development of data access and modeling tools, and educational opportunities in both K-12 and higher education. Each of the funded projects proposes and carries out its own evaluation plan, in collaboration with external or internal evaluation experts. Using this portfolio as an exemplar case, NICE has undertaken a systematic meta-evaluation of these plans, focused primarily on evaluation questions, approaches, and methods. This meta-evaluation study seeks to understand the range of evaluations represented in the NICE portfolio, including descriptive information (what evaluations, questions, designs, approaches, and methods are applied?) and questions of value (do these evaluations meet the needs of projects and their staff, and of NASA/NICE?). In the current climate, as federal funders of climate change and STEM education projects seek to better understand and incorporate evaluation into their decisions, evaluators and project leaders are also seeking to build robust understanding of program effectiveness. Meta-evaluations like this provide some baseline understanding of the current status quo and the kinds of evaluations carried out within such funding portfolios. These explorations are needed to understand the common ground between evaluative best practices, limited resources, and agencies' desires, capacity, and requirements. When NASA asks for evaluation of funded projects, what happens? Which questions are asked and answered, using which tools? To what extent do the evaluations meet the needs of projects and

Evaluation Study for Secondary Stage EFL Textbook: EFL Teachers' Perspectives

ERIC Educational Resources Information Center

Al Harbi, Abdullah Abdul Muhsen

2017-01-01

This study aimed at evaluating EFL textbook for secondary stage in Saudi Public schools. Participants consisted of (100) male teachers and (73) female teachers teaching secondary stage students in two cities: Madinah and Dowadmi. The tool of the study designed to cover five dimensions: layout and design, the objectives of the textbook, teaching…

Discovering the Future of the Case Study Method in Evaluation Research.

ERIC Educational Resources Information Center

Yin, Robert K.

1994-01-01

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

Rodent-repellent studies. III. Advanced studies in the evaluation of chemical repellents

USGS Publications Warehouse

Bellack, E.; DeWitt, J.B.

1949-01-01

In order to bridge the gap between preliminary screening of chemicals for potential rodent repellency and the application ofthese compounds to paper cartons, more advanced studies in the evaluation ofpromising materials have been carried out. These studies have resulted in: (1) a modification of the food acceptance technique which eliminates doubtful compounds and also provides a closer analogy to the ultimate goal, and (2) a method for rapidly testing chemicals incorporated in paper. When the results of these latter tests are expressed as a function of time, it can be shown that a distinct correlation exists between the deterrency exhibited by treated paper and the repellency of treated food.

The social evaluation of faces: a meta-analysis of functional neuroimaging studies

PubMed Central

Mende-Siedlecki, Peter; Said, Christopher P.

2013-01-01

Neuroscience research on the social evaluation of faces has accumulated over the last decade, yielding divergent results. We used a meta-analytic technique, multi-level kernel density analysis (MKDA), to analyze 29 neuroimaging studies on face evaluation. Across negative face evaluations, we observed the most consistent activations in bilateral amygdala. Across positive face evaluations, we observed the most consistent activations in medial prefrontal cortex, pregenual anterior cingulate cortex (pgACC), medial orbitofrontal cortex (mOFC), left caudate and nucleus accumbens (NAcc). Based on additional analyses comparing linear and non-linear responses, we propose a ventral/dorsal dissociation within the amygdala, wherein separate populations of neurons code for face valence and intensity, respectively. Finally, we argue that some of the differences between studies are attributable to differences in the typicality of face stimuli. Specifically, extremely attractive faces are more likely to elicit responses in NAcc/caudate and mOFC. PMID:22287188

Challenges in Evaluating Clinical Governance Systems in Iran: A Qualitative Study

PubMed Central

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Background: In spite of the pivotal role of clinical governance in enhancing quality of services provided by hospitals across the country, a scientific framework with specific criteria for evaluating hospitals has not been developed so far. Objectives: This study was conducted with the aim to identify the challenges involved in evaluating systems of clinical governance in Iran. Materials and Methods: For the purposes of this qualitative study, 15 semi-structured interviews with experts in the field were conducted in 2011 and the data were analyzed using framework analysis method. Results: Five major challenges in evaluating clinical governance include managing human resources, improving clinical quality, managing development, organizing clinical governance, and providing patient-oriented healthcare system. Conclusions: Healthcare system in Iran requires a clinical governance program which has a patient-oriented approach in philosophy, operation, and effectiveness in order to meet the challenges ahead. PMID:24910799

Toward Best Practice in Evaluation: A Study of Australian Health Promotion Agencies.

PubMed

Francis, Louise J; Smith, Ben J

2015-09-01

Evaluation makes a critical contribution to the evidence base for health promotion programs and policy. Because there has been limited research about the characteristics and determinants of evaluation practice in this field, this study audited evaluations completed by health promotion agencies in Victoria, Australia, and explored the factors that enabled or hindered evaluation performance. Twenty-four agencies participated. A systematic assessment of 29 recent evaluation reports was undertaken, and in-depth interviews were carried out with 18 experienced practitioners. There was wide variability in the scope of evaluations and the level of reporting undertaken. Formative evaluation was uncommon, but almost all included process evaluation, especially of strategy reach and delivery. Impact evaluation was attempted in the majority of cases, but the designs and measures used were often not specified. Practitioners strongly endorsed the importance of evaluation, but the reporting requirements and inconsistent administrative procedures of the funding body were cited as significant barriers. Budget constraints, employment of untrained coworkers, and lack of access to measurement tools were other major barriers to evaluation. Capacity building to strengthen evaluation needs to encompass system, organizational, and practitioner-level action. This includes strengthening funding and reporting arrangements, fostering partnerships, and tailoring workforce development opportunities for practitioners. © 2015 Society for Public Health Education.

An Evaluative Case Study of Nine Virtual High School Programs

ERIC Educational Resources Information Center

Bannister, Clara M.

2009-01-01

The purpose of this study was to conduct a program evaluation of nine virtual high school programs in the states of Alabama, California, Florida, Idaho, Colorado, Illinois, Michigan, North Carolina and Massachusetts. In order to assess the quality and effectiveness of the virtual high school programs in the study in terms of overall quality and…

Evaluating markers for the early detection of cancer: overview of study designs and methods.

PubMed

Baker, Stuart G; Kramer, Barnett S; McIntosh, Martin; Patterson, Blossom H; Shyr, Yu; Skates, Steven

2006-01-01

The field of cancer biomarker development has been evolving rapidly. New developments both in the biologic and statistical realms are providing increasing opportunities for evaluation of markers for both early detection and diagnosis of cancer. To review the major conceptual and methodological issues in cancer biomarker evaluation, with an emphasis on recent developments in statistical methods together with practical recommendations. We organized this review by type of study: preliminary performance, retrospective performance, prospective performance and cancer screening evaluation. For each type of study, we discuss methodologic issues, provide examples and discuss strengths and limitations. Preliminary performance studies are useful for quickly winnowing down the number of candidate markers; however their results may not apply to the ultimate target population, asymptomatic subjects. If stored specimens from cohort studies with clinical cancer endpoints are available, retrospective studies provide a quick and valid way to evaluate performance of the markers or changes in the markers prior to the onset of clinical symptoms. Prospective studies have a restricted role because they require large sample sizes, and, if the endpoint is cancer on biopsy, there may be bias due to overdiagnosis. Cancer screening studies require very large sample sizes and long follow-up, but are necessary for evaluating the marker as a trigger of early intervention.

Digital Libraries and Repositories in India: An Evaluative Study

ERIC Educational Resources Information Center

Mittal, Rekha; Mahesh, G.

2008-01-01

Purpose: The purpose of this research is to identify and evaluate the collections within digital libraries and repositories in India available in the public domain. Design/methodology/approach: The digital libraries and repositories were identified through a study of the literature, as well as internet searching and browsing. The resulting digital…

A case study of evaluating informatics impact on diffusion of scientific knowledge.

PubMed

Katz, Susan B

2008-11-06

This case study poster uses a newly developed framework to evaluate an informatics effort in its public health context. The electronic clearance system being evaluated provides the potential for increasing the speed and quality of scientific diffusion of knowledge, and thus translation of research into practice. A graphical logic model and tabular results of the evaluation are presented. Public health history suggests potential benefits of more timely and coordinated diffusion of scientific information.

Evaluation of streams in selected communities for the application of limited-detail study methods for flood-insurance studies

USGS Publications Warehouse

Cobb, Ernest D.

1986-01-01

The U.S. Geological Survey evaluated 2,349 communities in 1984 for the application of limited-detail flood-insurance study methods, that is, methods with a reduced effort and cost compared to the detailed studies. Limited-detail study methods were found to be appropriate for 1,705 communities, while detailed studies were appropriate for 62 communities and no studies were appropriate for 582 communities. The total length of streams for which limited-detail studies are recommended is 9 ,327 miles with a corresponding cost of $23,007,000. This results in average estimated costs for conducting limited-detail studies of $2,500 per mile of studied stream length. The purpose of the report is to document the limited-detail study methods and the results of the evaluation. (USGS)

Mindfulness Based Stress Reduction for Academic Evaluation Anxiety: A Naturalistic Longitudinal Study

PubMed Central

Dundas, Ingrid; Thorsheim, Torbjørn; Hjeltnes, Aslak; Binder, Per Einar

2016-01-01

ABSTRACT Mindfulness based stress reduction (MBSR) for academic evaluation anxiety and self-confidence in 70 help-seeking bachelor’s and master’s students was examined. A repeated measures analysis of covariance on the 46 students who completed pretreatment and posttreatment measures (median age = 24 years, 83% women) showed that evaluation anxiety and self-confidence improved. A growth curve analysis with all 70 original participants showed reductions in both cognitive and emotional components of evaluation anxiety, and that reduction continued postintervention. Although more research is needed, this study indicates that MBSR may reduce evaluation anxiety. PMID:27227169

Multispectral scanner data applications evaluation. Volume 1: User applications study

NASA Technical Reports Server (NTRS)

Thomson, F. J.; Erickson, J. D.; Nalepka, R. F.; Weber, J. D.

1974-01-01

A six-month systems study of earth resource surveys from satellites was conducted and is reported. SKYLAB S-192 multispectral scanner (MSS) data were used as a baseline to aid in evaluating the characteristics of future systems using satellite MSS sensors. The study took the viewpoint that overall system (sensor and processing) characteristics and parameter values should be determined largely by user requirements for automatic information extraction performance in quasi-operational earth resources surveys, the other major factor being hardware limitations imposed by state-of-the-art technology and cost. The objective was to use actual aircraft and spacecraft MSS data to outline parametrically the trade-offs between user performance requirements and hardware performance and limitations so as to allow subsequent evaluation of compromises which must be made in deciding what system(s) to build.

QUADAS and STARD: evaluating the quality of diagnostic accuracy studies.

PubMed

Oliveira, Maria Regina Fernandes de; Gomes, Almério de Castro; Toscano, Cristiana Maria

2011-04-01

To compare the performance of two approaches, one based on the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) and another on the Standards for Reporting Studies of Diagnostic Accuracy (STARD), in evaluating the quality of studies validating the OptiMal® rapid malaria diagnostic test. Articles validating the rapid test published until 2007 were searched in the Medline/PubMed database. This search retrieved 13 articles. A combination of 12 QUADAS criteria and three STARD criteria were compared with the 12 QUADAS criteria alone. Articles that fulfilled at least 50% of QUADAS criteria were considered as regular to good quality. Of the 13 articles retrieved, 12 fulfilled at least 50% of QUADAS criteria, and only two fulfilled the STARD/QUADAS criteria combined. Considering the two criteria combination (> 6 QUADAS and > 3 STARD), two studies (15.4%) showed good methodological quality. The articles selection using the proposed combination resulted in two to eight articles, depending on the number of items assumed as cutoff point. The STARD/QUADAS combination has the potential to provide greater rigor when evaluating the quality of studies validating malaria diagnostic tests, given that it incorporates relevant information not contemplated in the QUADAS criteria alone.

Evaluating QR Code Case Studies Using a Mobile Learning Framework

ERIC Educational Resources Information Center

Rikala, Jenni

2014-01-01

The aim of this study was to evaluate the feasibility of Quick Response (QR) codes and mobile devices in the context of Finnish basic education. The feasibility was analyzed through a mobile learning framework, which includes the core characteristics of mobile learning. The study is part of a larger research where the aim is to develop a…

Enhancing Learning Outcomes through Evaluation of Serious Gaming: A Mixed Methods Study

ERIC Educational Resources Information Center

Douglas, Kerrie Anna

2012-01-01

This study compared the change in counseling student's self-efficacy and skill related to suicide assessment and intervention through the use of a novel intervention-oriented evaluation method, evaluation focused discussion groups, in an experimental embedded mixed methods design. An innovation counselor pedagogical tool, Suicide Risk Assessment…

The Efficacy of Math Coaching: An Evaluative Case Study

ERIC Educational Resources Information Center

Dobbins, C. Neelie

2010-01-01

There is a lack of implementation of instructional strategies to assist middle school teachers in improving mathematics education for their students. Coaching is one solution to this problem, but its impact on student achievement is unclear. This case study evaluated the relationship between coaching and teacher efficacy and the impact of these…

Learning from Evaluation by Peer Team: A Case Study of a Family Counselling Organization

ERIC Educational Resources Information Center

Muniute-Cobb, Eivina I.; Alfred, Mary V.

2010-01-01

This qualitative study explores how employees learn from Team Primacy Concept-based employee evaluation and how they use the feedback in performing their jobs. Team Primacy Concept-based evaluation is a type of multirater evaluation. The distinctive characteristic of such evaluation is its peer feedback component during which the employee's…

The Neural Substrates of Self-Evaluation of Mental Fatigue: A Magnetoencephalography Study

PubMed Central

Ishii, Akira; Tanaka, Masaaki; Watanabe, Yasuyoshi

2014-01-01

There have been several studies of the neural mechanisms underlying sensation of fatigue. However, little is known about the neural mechanisms underlying self-evaluation of the level of fatigue. The aim of this study was to identify the neural substrates involved in self-evaluation of the level of mental fatigue. We used magnetoencephalography (MEG) with high temporal resolution on 14 healthy participants. During MEG recordings, participants were asked to evaluate their level of mental fatigue in time with execution cues (evaluation trials) or to do nothing in time with execution cues (control trials). The MEG data were analyzed with equivalent current dipole (ECD) and spatial filtering methods to localize the neural activity related to the evaluation of mental fatigue. The daily level of fatigue sensation was assessed using the Checklist Individual Strength questionnaire. In evaluation trials, ECDs were observed in the posterior cingulate cortex (PCC) in seven of 14 participants, with a mean latency of 366.0 ms. The proportion of the participants with ECDs in the PCC was higher in evaluation trials than in control trials (P<0.05, McNemar test). The extent of the decreased delta band power in the PCC (Brodmann’s area 31) 600–700 ms after the onset of the execution cue and that in the dorsolateral prefrontal cortex (DLPFC; Brodmann’s area 9) 800–900 ms after the onset of the execution cue were greater in the evaluation trials than in the control trials. The decrease in delta band power in the DLPFC was positively related to that in the PCC and to the daily level of fatigue sensation. These data suggest that the PCC and DLPFC are involved in the self-evaluation of mental fatigue. PMID:24752677

National Home Start Evaluation. Interim Report V: Case Studies.

ERIC Educational Resources Information Center

Jerome, Chris H.; And Others

One of a series of documents on the evaluation of the National Home Start (NHS) program this third year interim report of case studies describes program efforts and successes with 16 Home Start families throughout the nation. A federally funded demonstration program, NHS is aimed at providing home-based services (such as health, education,…

Leadership development through action learning sets: an evaluation study.

PubMed

Walia, Surinder; Marks-Maran, Di

2014-11-01

This article examines the use of action learning sets in a leadership module delivered by a university in south east England. An evaluation research study was undertaking using survey method to evaluate student engagement with action learning sets, and their value, impact and sustainability. Data were collected through a questionnaire with a mix of Likert-style and open-ended questions and qualitative and quantitative data analysis was undertaken. Findings show that engagement in the action learning sets was very high. Action learning sets also had a positive impact on the development of leadership knowledge and skills and are highly valued by participants. It is likely that they would be sustainable as the majority would recommend action learning to colleagues and would consider taking another module that used action learning sets. When compared to existing literature on action learning, this study offers new insights as there is little empirical literature on student engagement with action learning sets and even less on value and sustainability. Copyright © 2014 Elsevier Ltd. All rights reserved.

Do economic evaluation studies inform effective healthcare resource allocation in Iran? A critical review of the literature.

PubMed

Haghparast-Bidgoli, Hassan; Kiadaliri, Aliasghar Ahmad; Skordis-Worrall, Jolene

2014-01-01

To aid informed health sector decision-making, data from sufficient high quality economic evaluations must be available to policy makers. To date, no known study has analysed the quantity and quality of available Iranian economic evaluation studies. This study aimed to assess the quantity, quality and targeting of economic evaluation studies conducted in the Iranian context. The study systematically reviewed full economic evaluation studies (n = 30) published between 1999 and 2012 in international and local journals. The findings of the review indicate that although the literature on economic evaluation in Iran is growing, these evaluations were of poor quality and suffer from several major methodological flaws. Furthermore, the review reveals that economic evaluation studies have not addressed the major health problems in Iran. While the availability of evidence is no guarantee that it will be used to aid decision-making, the absence of evidence will certainly preclude its use. Considering the deficiencies in the data identified by this review, current economic evaluations cannot be a useful source of information for decision makers in Iran. To improve the quality and overall usefulness of economic evaluations we would recommend; 1) developing clear national guidelines for the conduct of economic evaluations, 2) highlighting priority areas where information from such studies would be most useful and 3) training researchers and policy makers in the calculation and use of economic evaluation data.

Do economic evaluation studies inform effective healthcare resource allocation in Iran? A critical review of the literature

PubMed Central

2014-01-01

To aid informed health sector decision-making, data from sufficient high quality economic evaluations must be available to policy makers. To date, no known study has analysed the quantity and quality of available Iranian economic evaluation studies. This study aimed to assess the quantity, quality and targeting of economic evaluation studies conducted in the Iranian context. The study systematically reviewed full economic evaluation studies (n = 30) published between 1999 and 2012 in international and local journals. The findings of the review indicate that although the literature on economic evaluation in Iran is growing, these evaluations were of poor quality and suffer from several major methodological flaws. Furthermore, the review reveals that economic evaluation studies have not addressed the major health problems in Iran. While the availability of evidence is no guarantee that it will be used to aid decision-making, the absence of evidence will certainly preclude its use. Considering the deficiencies in the data identified by this review, current economic evaluations cannot be a useful source of information for decision makers in Iran. To improve the quality and overall usefulness of economic evaluations we would recommend; 1) developing clear national guidelines for the conduct of economic evaluations, 2) highlighting priority areas where information from such studies would be most useful and 3) training researchers and policy makers in the calculation and use of economic evaluation data. PMID:25050084

Auditing and Evaluating University-Community Engagement: Lessons from a UK Case Study

ERIC Educational Resources Information Center

Hart, Angie; Northmore, Simon

2011-01-01

The growing importance of community and public engagement activities in universities has led to an increasing emphasis on auditing and evaluating university-community partnerships. However, the development of effective audit and evaluation tools is still at a formative stage. This article presents a case study of the University of Brighton's…

A review of evaluative studies of computer-based learning in nursing education.

PubMed

Lewis, M J; Davies, R; Jenkins, D; Tait, M I

2001-01-01

Although there have been numerous attempts to evaluate the learning benefits of computer-based learning (CBL) packages in nursing education, the results obtained have been equivocal. A literature search conducted for this review found 25 reports of the evaluation of nursing CBL packages since 1966. Detailed analysis of the evaluation methods used in these reports revealed that most had significant design flaws, including the use of too small a sample group, the lack of a control group, etc. Because of this, the conclusions reached were not always valid. More effort is required in the design of future evaluation studies of nursing CBL packages. Copyright 2001 Harcourt Publishers Ltd.

A SIMPLE METHOD FOR EVALUATING DATA FROM AN INTERLABORATORY STUDY

EPA Science Inventory

Large-scale laboratory-and method-performance studies involving more than about 30 laboratories may be evaluated by calculating the HORRAT ratio for each test sample (HORRAT=[experimentally found among-laboratories relative standard deviation] divided by [relative standard deviat...

Evaluation Criteria for Nursing Student Application of Evidence-Based Practice: A Delphi Study.

PubMed

Bostwick, Lina; Linden, Lois

2016-06-01

Core clinical evaluation criteria do not exist for measuring prelicensure baccalaureate nursing students' application of evidence-based practice (EBP) during direct care assignments. The study objective was to achieve consensus among EBP nursing experts to create clinical criteria for faculty to use in evaluating students' application of EBP principles. A three-round Delphi method was used. Experts were invited to participate in Web-based surveys. Data were analyzed using qualitative coding and categorizing. Quantitative analyses were descriptive calculations for rating and ranking. Expert consensus occurred in the Delphi rounds. The study provides a set of 10 core clinical evaluation criteria for faculty evaluating students' progression toward competency in their application of EBP. A baccalaureate program curriculum requiring the use of Bostwick's EBP Core Clinical Evaluation Criteria will provide a clear definition for understanding basic core EBP competence as expected for the assessment of student learning. [J Nurs Educ. 2016;55(5):336-341.]. Copyright 2016, SLACK Incorporated.

Needs assessment for next generation computer-aided mammography reference image databases and evaluation studies.

PubMed

Horsch, Alexander; Hapfelmeier, Alexander; Elter, Matthias

2011-11-01

Breast cancer is globally a major threat for women's health. Screening and adequate follow-up can significantly reduce the mortality from breast cancer. Human second reading of screening mammograms can increase breast cancer detection rates, whereas this has not been proven for current computer-aided detection systems as "second reader". Critical factors include the detection accuracy of the systems and the screening experience and training of the radiologist with the system. When assessing the performance of systems and system components, the choice of evaluation methods is particularly critical. Core assets herein are reference image databases and statistical methods. We have analyzed characteristics and usage of the currently largest publicly available mammography database, the Digital Database for Screening Mammography (DDSM) from the University of South Florida, in literature indexed in Medline, IEEE Xplore, SpringerLink, and SPIE, with respect to type of computer-aided diagnosis (CAD) (detection, CADe, or diagnostics, CADx), selection of database subsets, choice of evaluation method, and quality of descriptions. 59 publications presenting 106 evaluation studies met our selection criteria. In 54 studies (50.9%), the selection of test items (cases, images, regions of interest) extracted from the DDSM was not reproducible. Only 2 CADx studies, not any CADe studies, used the entire DDSM. The number of test items varies from 100 to 6000. Different statistical evaluation methods are chosen. Most common are train/test (34.9% of the studies), leave-one-out (23.6%), and N-fold cross-validation (18.9%). Database-related terminology tends to be imprecise or ambiguous, especially regarding the term "case". Overall, both the use of the DDSM as data source for evaluation of mammography CAD systems, and the application of statistical evaluation methods were found highly diverse. Results reported from different studies are therefore hardly comparable. Drawbacks of the DDSM

Applicability of the DPPH assay for evaluating the antioxidant capacity of food additives - inter-laboratory evaluation study -.

PubMed

Shimamura, Tomoko; Sumikura, Yoshihiro; Yamazaki, Takeshi; Tada, Atsuko; Kashiwagi, Takehiro; Ishikawa, Hiroya; Matsui, Toshiro; Sugimoto, Naoki; Akiyama, Hiroshi; Ukeda, Hiroyuki

2014-01-01

An inter-laboratory evaluation study was conducted in order to evaluate the antioxidant capacity of food additives by using a 1,1-diphenyl-2-picrylhydrazyl (DPPH) assay. Four antioxidants used as existing food additives (i.e., tea extract, grape seed extract, enju extract, and d-α-tocopherol) and 6-hydroxy-2,5,7,8-tetramethylchroman-2-carboxylic acid (Trolox) were used as analytical samples, and 14 laboratories participated in this study. The repeatability relative standard deviation (RSD(r)) of the IC50 of Trolox, four antioxidants, and the Trolox equivalent antioxidant capacity (TEAC) were 1.8-2.2%, 2.2-2.9%, and 2.1-2.5%, respectively. Thus, the proposed DPPH assay showed good performance within the same laboratory. The reproducibility relative standard deviation (RSD(R)) of IC50 of Trolox, four antioxidants, and TEAC were 4.0-7.9%, 6.0-11%, and 3.7-9.3%, respectively. The RSD(R)/RSD(r) values of TEAC were lower than, or nearly equal to, those of IC50 of the four antioxidants, suggesting that the use of TEAC was effective for reducing the variance among the laboratories. These results showed that the proposed DPPH assay could be used as a standard method to evaluate the antioxidant capacity of food additives.

EVALUATION OF THE REAL-TIME AIR-QUALITY MODEL USING THE RAPS (REGIONAL AIR POLLUTION STUDY) DATA BASE. VOLUME 4. EVALUATION GUIDE

EPA Science Inventory

The theory and programming of statistical tests for evaluating the Real-Time Air-Quality Model (RAM) using the Regional Air Pollution Study (RAPS) data base are fully documented in four volumes. Moreover, the tests are generally applicable to other model evaluation problems. Volu...

Istartsmart: An Evaluative Study on a College Success Course

ERIC Educational Resources Information Center

Kruse, Heather L.

2014-01-01

The researcher for this evaluative study investigated the efficacy and impact of the iStartSmart college success course by examining the first-term retention, fall-to-fall persistence, and three-year completion rates of community college students who enrolled in the one- or three-credit course at a community college in Arizona and the rates of…

Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study

PubMed Central

Pinkham, Amy E.; Penn, David L.; Green, Michael F.; Harvey, Philip D.

2016-01-01

Measurement of social cognition in treatment trials remains problematic due to poor and limited psychometric data for many tasks. As part of the Social Cognition Psychometric Evaluation (SCOPE) study, the psychometric properties of 8 tasks were assessed. One hundred and seventy-nine stable outpatients with schizophrenia and 104 healthy controls completed the battery at baseline and a 2–4-week retest period at 2 sites. Tasks included the Ambiguous Intentions Hostility Questionnaire (AIHQ), Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Relationships Across Domains (RAD), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, and Trustworthiness Task. Tasks were evaluated on: (i) test-retest reliability, (ii) utility as a repeated measure, (iii) relationship to functional outcome, (iv) practicality and tolerability, (v) sensitivity to group differences, and (vi) internal consistency. The BLERT and Hinting task showed the strongest psychometric properties across all evaluation criteria and are recommended for use in clinical trials. The ER-40, Eyes Task, and TASIT showed somewhat weaker psychometric properties and require further study. The AIHQ, RAD, and Trustworthiness Task showed poorer psychometric properties that suggest caution for their use in clinical trials. PMID:25943125

Evaluation of Visual Materials in Social Studies Coursebooks by Teachers' Opinions

ERIC Educational Resources Information Center

Yapici, Hakki

2016-01-01

The aim of this study is to evaluate the visual elements (picture, photograph, map, table, caricature, etc.) included in the 7th grade Social Studies coursebooks prepared by the Ministry of National Education and taught in 2014-2015 academic year by several variables in accordance with the opinions of Social Studies teachers, with a critical point…

An Empirical Study of Kirkpatrick's Evaluation Model in the Hospitality Industry

ERIC Educational Resources Information Center

Chang, Ya-Hui Elegance

2010-01-01

This study examined Kirkpatrick's training evaluation model (Kirkpatrick & Kirkpatrick, 2006) by assessing a sales training program conducted at an organization in the hospitality industry. The study assessed the employees' training outcomes of knowledge and skills, job performance, and the impact of the training upon the organization. By…

Outcome Reporting Bias in Government-Sponsored Policy Evaluations: A Qualitative Content Analysis of 13 Studies

PubMed Central

2016-01-01

The reporting of evaluation outcomes can be a point of contention between evaluators and policy-makers when a given reform fails to fulfil its promises. Whereas evaluators are required to report outcomes in full, policy-makers have a vested interest in framing these outcomes in a positive light–especially when they previously expressed a commitment to the reform. The current evidence base is limited to a survey of policy evaluators, a study on reporting bias in education research and several studies investigating the influence of industry sponsorship on the reporting of clinical trials. The objective of this study was twofold. Firstly, it aimed to assess the risk of outcome reporting bias (ORB or ‘spin’) in pilot evaluation reports, using seven indicators developed by clinicians. Secondly, it sought to examine how the government’s commitment to a given reform may affect the level of ORB found in the corresponding evaluation report. To answer these questions, 13 evaluation reports were content-analysed, all of which found a non-significant effect of the intervention on its stated primary outcome. These reports were systematically selected from a dataset of 233 pilot and experimental evaluations spanning three policy areas and 13 years of government-commissioned research in the UK. The results show that the risk of ORB is real. Indeed, all studies reviewed here resorted to at least one of the presentational strategies associated with a risk of spin. This study also found a small, negative association between the seniority of the reform’s champion and the risk of ORB in the evaluation of that reform. The publication of protocols and the use of reporting guidelines are recommended. PMID:27690131

Online and Paper Evaluations of Courses: A Literature Review and Case Study

ERIC Educational Resources Information Center

Morrison, Keith

2013-01-01

This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

Evaluation of reference genes for insect olfaction studies.

PubMed

Omondi, Bonaventure Aman; Latorre-Estivalis, Jose Manuel; Rocha Oliveira, Ivana Helena; Ignell, Rickard; Lorenzo, Marcelo Gustavo

2015-04-22

Quantitative reverse transcription PCR (qRT-PCR) is a robust and accessible method to assay gene expression and to infer gene regulation. Being a chain of procedures, this technique is subject to systematic error due to biological and technical limitations mainly set by the starting material and downstream procedures. Thus, rigorous data normalization is critical to grant reliability and repeatability of gene expression quantification by qRT-PCR. A number of 'housekeeping genes', involved in basic cellular functions, have been commonly used as internal controls for this normalization process. However, these genes could themselves be regulated and must therefore be tested a priori. We evaluated eight potential reference genes for their stability as internal controls for RT-qPCR studies of olfactory gene expression in the antennae of Rhodnius prolixus, a Chagas disease vector. The set of genes included were: α-tubulin; β-actin; Glyceraldehyde-3-phosphate dehydrogenase; Eukaryotic initiation factor 1A; Glutathione-S-transferase; Serine protease; Succinate dehydrogenase; and Glucose-6-phosphate dehydrogenase. Five experimental conditions, including changes in age,developmental stage and feeding status were tested in both sexes. We show that the evaluation of candidate reference genes is necessary for each combination of sex, tissue and physiological condition analyzed in order to avoid inconsistent results and conclusions. Although, Normfinder and geNorm software yielded different results between males and females, five genes (SDH, Tub, GAPDH, Act and G6PDH) appeared in the first positions in all rankings obtained. By using gene expression data of a single olfactory coreceptor gene as an example, we demonstrated the extent of changes expected using different internal standards. This work underlines the need for a rigorous selection of internal standards to grant the reliability of normalization processes in qRT-PCR studies. Furthermore, we show that particular

Process Evaluation Results from an Environmentally Focused Worksite Weight Management Study

ERIC Educational Resources Information Center

DeJoy, David M.; Wilson, Mark G.; Padilla, Heather M.; Goetzel, Ron Z.; Parker, Kristin B.; Della, Lindsay J.; Roemer, Enid C.

2012-01-01

There is currently much interest in exploring environmental approaches to combat weight gain and obesity. This study presents process evaluation results from a workplace-based study that tested two levels of environmentally focused weight management interventions in a manufacturing setting. The moderate treatment featured a set of relatively…

Sonographic Evaluation of the Anterolateral Ligament of the Knee: A Cadaveric Study.

PubMed

Zappia, Marcello; Oliva, Francesco; Chianca, Vito; Di Pietto, Francesco; Maffulli, Nicola

2018-05-31

Rotational stability of the knee involves not only the cruciate ligaments but also another structure named anterolateral ligament (ALL), the function of which is still controversial. This study evaluated the effectiveness of high-resolution ultrasound (US) examination to detect the ALL. We studied 8 cadaveric knees (8 ALLs). On each knee, high-resolution real-time ultrasonography examination was performed by an experienced musculoskeletal radiologist before and after the procedure, with the surgeons blind to the results of the scan both before and after dissection. The ALL was identified in each cadaver limb by the musculoskeletal radiologist. US is a useful imaging modality to identify and evaluate the ALL. The ability of US to fully evaluate injuries involving the ALL still needs to be demonstrated in a clinical setting. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

Social Cognition Psychometric Evaluation: Results of the Final Validation Study.

PubMed

Pinkham, Amy E; Harvey, Philip D; Penn, David L

2018-06-06

Social cognition is increasingly recognized as an important treatment target in schizophrenia; however, the dearth of well-validated measures that are suitable for use in clinical trials remains a significant limitation. The Social Cognition Psychometric Evaluation (SCOPE) study addresses this need by systematically evaluating the psychometric properties of promising measures. In this final phase of SCOPE, eight new or modified tasks were evaluated. Stable outpatients with schizophrenia (n = 218) and healthy controls (n = 154) completed the battery at baseline and 2-4 weeks later across three sites. Tasks included the Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, Mini Profile of Nonverbal Sensitivity (MiniPONS), Social Attribution Task-Multiple Choice (SAT-MC), and Intentionality Bias Task (IBT). BLERT and ER-40 modifications included response time and confidence ratings. The Eyes task was modified to include definitions of terms and TASIT to include response time. Hinting was scored with more stringent criteria. MiniPONS, SAT-MC, and IBT were new to this phase. Tasks were evaluated on (1) test-retest reliability, (2) utility as a repeated measure, (3) relationship to functional outcome, (4) practicality and tolerability, (5) sensitivity to group differences, and (6) internal consistency. Hinting, BLERT, and ER-40 showed the strongest psychometric properties and are recommended for use in clinical trials. Eyes, TASIT, and IBT showed somewhat weaker psychometric properties and require further study. MiniPONS and SAT-MC showed poorer psychometric properties that suggest caution for their use in clinical trials.

[Evaluation by case managers dementia : An explorative practice based study on types and content].

PubMed

Ketelaar, Nicole A B M; Jukema, Jan S; van Bemmel, Marlies; Adriaansen, Marian J M; Smits, Carolien H M

2017-06-01

This practice based explorative study aims to provide insight into the ways in which case managers shape and fill up the evaluation phase of their support of the informal care network of persons with dementia. A combination of quantitative and qualitative research methods were used. A group of 57 case managers of persons with dementia in three different organisational networks took part in this study. Results from the quantitative and qualitative data are organized into four themes: (1) attitude towards evaluation, (2) forms of evaluation, (3) implementation of evaluation and (4) content of evaluation. There are different ways in shaping evaluation and the content of it. The importance of interim and final evaluation is recognized, but is difficult to realize in a methodical way. Barriers experienced by the case managers include various factors associated both with clients as professionals. Case managers evaluate continuously and in an informal way to assess whether the extent of their assistance is meeting the needs of the client and informal network. Case managers do not use systematic evaluation to measure the quality of care they offer to persons with dementia and their caregivers. The findings demand a discussion on the level of clients, as well as on the professional and societal level about the way case managers should evaluate their support.

Participation in Performance-Evaluation Studies by U.S. Geological Survey National Water Quality Laboratory

USGS Publications Warehouse

Glodt, Stephen R.; Pirkey, Kimberly D.

1998-01-01

Performance-evaluation studies provide customers of the U.S. Geological Survey National Water Quality Laboratory (NWQL) with data needed to evaluate performance and to compare of select laboratories for analytical work. The NWQL participates in national and international performance-evaluation (PE) studies that consist of samples of water, sediment, and aquatic biological materials for the analysis of inorganic constituents, organic compounds, and radionuclides. This Fact Sheet provides a summary of PE study results from January 1993 through April 1997. It should be of particular interest to USGS customers and potential customers of the NWQL, water-quality specialists, cooperators, and agencies of the Federal Government.

42 CFR 456.243 - Content of medical care evaluation studies.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 4 2010-10-01 2010-10-01 false Content of medical care evaluation studies. 456.243 Section 456.243 Public Health CENTERS FOR MEDICARE & MEDICAID SERVICES, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) MEDICAL ASSISTANCE PROGRAMS UTILIZATION CONTROL Utilization Control: Mental Hospitals...

An Evaluation of the Agriculture Science Project in Mauritius. African Studies in Curriculum Development & Evaluation No. 102.

ERIC Educational Resources Information Center

Jeeroburkhan, M. Fazal

This study evaluated the Agricultural Curriculum Project which is being implemented in 16 secondary schools in Mauritius. Specific areas examined included: (1) the relevance, appropriateness, and practicability of the project's general objectives; (2) the relevance, balance, and organization of the course content; (3) the effectiveness and…

Understanding of evaluation capacity building in practice: a case study of a national medical education organization.

PubMed

Sarti, Aimee J; Sutherland, Stephanie; Landriault, Angele; DesRosier, Kirk; Brien, Susan; Cardinal, Pierre

2017-01-01

Evaluation capacity building (ECB) is a topic of great interest to many organizations as they face increasing demands for accountability and evidence-based practices. ECB is about building the knowledge, skills, and attitudes of organizational members, the sustainability of rigorous evaluative practices, and providing the resources and motivations to engage in ongoing evaluative work. There exists a solid foundation of theoretical research on ECB, however, understanding what ECB looks like in practice is relatively thin. Our purpose was to investigate what ECB looks like firsthand within a national medical educational organization. The context for this study was the Acute Critical Events Simulation (ACES) organization in Canada, which has successfully evolved into a national educational program, driven by physicians. We conducted an exploratory qualitative study to better understand and describe ECB in practice. In doing so, interviews were conducted with program leaders and instructors so as to gain a richer understanding of evaluative processes and practices. A total of 21 individuals participated in the semistructured interviews. Themes from our qualitative data analysis included the following: evaluation knowledge, skills, and attitudes, use of evaluation findings, shared evaluation beliefs and commitment, evaluation frameworks and processes, and resources dedicated to evaluation. The national ACES organization was a useful case study to explore ECB in practice. The ECB literature provided a solid foundation to understand the purpose and nuances of ECB. This study added to the paucity of studies focused on examining ECB in practice. The most important lesson learned was that the organization must have leadership who are intrinsically motivated to employ and use evaluation data to drive ongoing improvements within the organization. Leaders who are intrinsically motivated will employ risk taking when evaluation practices and processes may be somewhat unfamiliar

Evaluating the Reliability, Validity, and Usefulness of Education Cost Studies

ERIC Educational Resources Information Center

Baker, Bruce D.

2006-01-01

Recent studies that purport to estimate the costs of constitutionally adequate education have been described as either a "gold standard" that should guide legislative school finance policy design and judicial evaluation, or as pure "alchemy." Methods for estimating the cost of constitutionally adequate education can be roughly…

A systematic review of studies evaluating diffusion and dissemination of selected cancer control interventions.

PubMed

Ellis, Peter; Robinson, Paula; Ciliska, Donna; Armour, Tanya; Brouwers, Melissa; O'Brien, Mary Ann; Sussman, Jonathan; Raina, Parminder

2005-09-01

With this review, the authors sought to determine what strategies have been evaluated (including the outcomes assessed) to disseminate cancer control interventions that promote the uptake of behavior change. Five topic areas along the cancer care continuum (smoking cessation, healthy diet, mammography, cervical cancer screening, and control of cancer pain) were selected to be representative. A systematic review was conducted of primary studies evaluating dissemination of a cancer control intervention. Thirty-one studies were identified that evaluated dissemination strategies in the 5 topic areas. No strong evidence currently exists to recommend any one dissemination strategy as effective in promoting the uptake of cancer control interventions. The authors conclude that there is a strong need for more research into dissemination of cancer control interventions. Future research should consider methodological issues such as the most appropriate study design and outcomes to be evaluated. (c) 2005 APA, all rights reserved

A Collection of Papers on Self-Study and Institutional Improvement, 2003. Volume 4: The Self-Study Process for Commission Evaluation. 2003 Edition.

ERIC Educational Resources Information Center

Van Kollenburg, Susan E., Ed.

Papers in this collection were prepared for the annual meeting of the North Central Association of Colleges and Schools. This volume contains papers related to the self-study process for Commission evaluation. Papers in chapters 1, "Self-Study and Commission Evaluation: Coordinating the Self-Study," are: (1) "Initiating the…

Smartphone ECG for evaluation of STEMI: results of the ST LEUIS Pilot Study.

PubMed

Muhlestein, Joseph Boone; Le, Viet; Albert, David; Moreno, Fidela Ll; Anderson, Jeffrey L; Yanowitz, Frank; Vranian, Robert B; Barsness, Gregory W; Bethea, Charles F; Severance, Harry W; Ramo, Barry; Pierce, John; Barbagelata, Alejandro; Muhlestein, Joseph Brent

2015-01-01

12-lead ECG is a critical component of initial evaluation of cardiac ischemia, but has traditionally been limited to large, dedicated equipment in medical care environments. Smartphones provide a potential alternative platform for the extension of ECG to new care settings and to improve timeliness of care. To gain experience with smartphone electrocardiography prior to designing a larger multicenter study evaluating standard 12-lead ECG compared to smartphone ECG. 6 patients for whom the hospital STEMI protocol was activated were evaluated with traditional 12-lead ECG followed immediately by a smartphone ECG using right (VnR) and left (VnL) limb leads for precordial grounding. The AliveCor™ Heart Monitor was utilized for this study. All tracings were taken prior to catheterization or immediately after revascularization while still in the catheterization laboratory. The smartphone ECG had excellent correlation with the gold standard 12-lead ECG in all patients. Four out of six tracings were judged to meet STEMI criteria on both modalities as determined by three experienced cardiologists, and in the remaining two, consensus indicated a non-STEMI ECG diagnosis. No significant difference was noted between VnR and VnL. Smartphone based electrocardiography is a promising, developing technology intended to increase availability and speed of electrocardiographic evaluation. This study confirmed the potential of a smartphone ECG for evaluation of acute ischemia and the feasibility of studying this technology further to define the diagnostic accuracy, limitations and appropriate use of this new technology. Copyright © 2015 Elsevier Inc. All rights reserved.

Study on the evaluation method for fault displacement based on characterized source model

NASA Astrophysics Data System (ADS)

Tonagi, M.; Takahama, T.; Matsumoto, Y.; Inoue, N.; Irikura, K.; Dalguer, L. A.

2016-12-01

In IAEA Specific Safety Guide (SSG) 9 describes that probabilistic methods for evaluating fault displacement should be used if no sufficient basis is provided to decide conclusively that the fault is not capable by using the deterministic methodology. In addition, International Seismic Safety Centre compiles as ANNEX to realize seismic hazard for nuclear facilities described in SSG-9 and shows the utility of the deterministic and probabilistic evaluation methods for fault displacement. In Japan, it is required that important nuclear facilities should be established on ground where fault displacement will not arise when earthquakes occur in the future. Under these situations, based on requirements, we need develop evaluation methods for fault displacement to enhance safety in nuclear facilities. We are studying deterministic and probabilistic methods with tentative analyses using observed records such as surface fault displacement and near-fault strong ground motions of inland crustal earthquake which fault displacements arose. In this study, we introduce the concept of evaluation methods for fault displacement. After that, we show parts of tentative analysis results for deterministic method as follows: (1) For the 1999 Chi-Chi earthquake, referring slip distribution estimated by waveform inversion, we construct a characterized source model (Miyake et al., 2003, BSSA) which can explain observed near-fault broad band strong ground motions. (2) Referring a characterized source model constructed in (1), we study an evaluation method for surface fault displacement using hybrid method, which combines particle method and distinct element method. At last, we suggest one of the deterministic method to evaluate fault displacement based on characterized source model. This research was part of the 2015 research project `Development of evaluating method for fault displacement` by the Secretariat of Nuclear Regulation Authority (S/NRA), Japan.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school.

PubMed

Schiekirka, Sarah; Reinhardt, Deborah; Heim, Susanne; Fabry, Götz; Pukrop, Tobias; Anders, Sven; Raupach, Tobias

2012-06-22

Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.

Student perceptions of evaluation in undergraduate medical education: A qualitative study from one medical school

PubMed Central

2012-01-01

Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results. PMID:22726271

School Self-Evaluations and School Inspections in Europe: An Exploratory Study

ERIC Educational Resources Information Center

Janssens, Frans J. G.; van Amelsvoort, Gonnie H. W. C. H.

2008-01-01

This article presents the results of an exploratory study into the effects of School Self-Evaluation (SSE) used by eight Education Inspectorates in seven European countries. This study reveals that in the countries where SSE is strongly incorporated into the school inspection system, there is a rather substantial degree of steering by the…

Evaluation Policy in a Nonprofit Foundation: A Case Study Exploration of the Robert Wood Johnson Foundation

ERIC Educational Resources Information Center

Dillman, Lisa M.; Christie, Christina A.

2017-01-01

This study explores the relationship between evaluation policies and evaluation practice. Through document analysis, interviews, and a multiple case study, the research examined the explicit and implicit policies overarching the evaluation work commissioned by the Robert Wood Johnson Foundation (RWJF) and explored how these policies are…

An EPA Pilot Study Evaluating Personal, Housing, and ...

EPA Pesticide Factsheets

EPA pilot studyAddresses how young children’s exposures to various indoor pollutants (both chemical and biological agents) change as a result of building renovation-based interventions, potentially affecting their asthma exacerbation and morbidityProvide additional information on chemical exposures and children’s interactions with their environments to enhance ongoing research in the Green Housing Study’s evaluation of green housing and impacts on childhood asthma Invited presentation to the NC Lead and Healthy Homes Task Force Meeting, Wednesday, February 24, 2016, UNC Institute for the Environment, Chapel Hill, NC

Undergraduate medical education programme renewal: a longitudinal context, input, process and product evaluation study.

PubMed

Mirzazadeh, Azim; Gandomkar, Roghayeh; Hejri, Sara Mortaz; Hassanzadeh, Gholamreza; Koochak, Hamid Emadi; Golestani, Abolfazl; Jafarian, Ali; Jalili, Mohammad; Nayeri, Fatemeh; Saleh, Narges; Shahi, Farhad; Razavi, Seyed Hasan Emami

2016-02-01

The purpose of this study was to utilize the Context, Input, Process and Product (CIPP) evaluation model as a comprehensive framework to guide initiating, planning, implementing and evaluating a revised undergraduate medical education programme. The eight-year longitudinal evaluation study consisted of four phases compatible with the four components of the CIPP model. In the first phase, we explored the strengths and weaknesses of the traditional programme as well as contextual needs, assets, and resources. For the second phase, we proposed a model for the programme considering contextual features. During the process phase, we provided formative information for revisions and adjustments. Finally, in the fourth phase, we evaluated the outcomes of the new undergraduate medical education programme in the basic sciences phase. Information was collected from different sources such as medical students, faculty members, administrators, and graduates, using various qualitative and quantitative methods including focus groups, questionnaires, and performance measures. The CIPP model has the potential to guide policy makers to systematically collect evaluation data and to manage stakeholders' reactions at each stage of the reform in order to make informed decisions. However, the model may result in evaluation burden and fail to address some unplanned evaluation questions.

Handling time in economic evaluation studies.

PubMed

Permsuwan, Unchalee; Guntawongwan, Kansinee; Buddhawongsa, Piyaluk

2014-05-01

The discount rates and time horizons used in a health technology assessment (HTA) can have a significant impact on the results, and thus the prioritization of technologies. Therefore, it is important that clear guidance be provided on the appropriate discount rates for cost and health effect and appropriate time horizons. In this paper we conduct a review of relevant case studies and guidelines and provide guidance for all researchers conducting economic evaluations of health technologies in the Thai context. A uniform discount rate of 3% is recommended for both costs and health effects in base case analyses. A sensitivity analysis should also be conducted, with a discount range of 0-6%. For technologies where the effects are likely to sustain for at least 30y ears, a rate of 4% for costs and 2% for health effects is recommended. The time horizon should be long enough to capture the full costs and effects of the programs.

Evaluation of Mathematics Curriculum in Primary Teacher Training Institute in Somalia. African Studies in Curriculum Development & Evaluation.

ERIC Educational Resources Information Center

Jama, Mohamed A. F.

This study sought to evaluate the mathematics curriculum of the Halane Teacher Training Institute in Somalia with a view toward: (1) determining its weaknesses and recommending measures for improvement; (2) examining its relevance to the present needs of the Somali society; (3) determining the suitability of instructional materials and other…

Vocational Education Outcomes: An Evaluative Bibliography of Empirical Studies. Bibliography Series No. 49.

ERIC Educational Resources Information Center

Bolland, Kathleen A.

As part of a project designed to identify appropriate and feasible methods of evaluating vocational education with respect to its outcomes, this bibliography contains descriptive and evaluative annotations of a selection of empirical studies of vocational education outcomes. Following a technical introduction discussing the methodological issues…

Self-Study and Evaluation Guide. Section C-2: Accounting for Services and Finances.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

The self study and evaluation guide, one of 16 documents for accreditation of agencies serving the blind and visually handicapped, focuses on accounting for services and finances. Standards address five areas: planning for accounting for services and finances, service accounting systems, financial accounting systems, evaluation, and public…

Guiding the Design of Evaluations of Innovations in Health Informatics: a Framework and a Case Study of the SMArt SHARP Evaluation

PubMed Central

Ramly, Edmond; Brennan, Patricia Flatley

2012-01-01

Development of health information systems innovations is necessary to create a better future for health and health care, but evaluating them is challenging. This paper examines the problem of evaluating health IT projects in which innovation is agile, adaptive, and emergent, and in which innovation diffusion and production are interlinked. We introduce a typology of mindsets for evaluation design that are typically used in health informatics: optimality, contingency, and usefulness, and make the case for a modularity mindset. We propose a model that shifts the unit of analysis from an evaluation as a whole, to specific modules of an evaluation, such as purpose, target, and methods. We then use retrospective participant observation to illustrate the approach using a case study: the ONC SHARP Harvard project developing the SMArt platform (smartplaforms.org). We find that the proposed modular approach to evaluation design provides a balanced alternative to standard archetypical designs on the one hand, and fully custom-made designs, on the other hand. PMID:23304417

A Case Study of Group Processes and Student Evaluation of Teaching

ERIC Educational Resources Information Center

Mortenson, Kristian G.; Sathe, Richard S.

2017-01-01

This paper documents a case study undertaken to understand the effect of group processes on student evaluation of teaching (SET). The study used interviews to investigate the experiences of students in a cohort model Master of Science in Accountancy degree program and how those experiences influenced SET. The cohort served as an extreme example in…

Evaluating For-Profit Higher Education: Evidence from the Education Longitudinal Study. A CAPSEE Working Paper

ERIC Educational Resources Information Center

Liu, Yuen Ting; Belfield, Clive

2014-01-01

This study evaluates the postsecondary and labor market outcomes of students who attended for-profit colleges. The evaluation complements a similar study by Deming, Goldin, and Katz (2012) that found significant differences in outcomes between students in for-profit colleges and those in other sectors. In this study we use the Education…

Field Artillery Ammunition Processing System (FAAPS) concept evaluation study. Ammunition Logistics Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kring, C.T.; Babcock, S.M.; Watkin, D.C.

1992-06-01

The Field Artillery Ammunition Processing System (FAAPS) is an initiative to introduce a palletized load system (PLS) that is transportable with an automated ammunition processing and storage system for use on the battlefield. System proponents have targeted a 20% increase in the ammunition processing rate over the current operation while simultaneously reducing the total number of assigned field artillery battalion personnel by 30. The overall objective of the FAAPS Project is the development and demonstration of an improved process to accomplish these goals. The initial phase of the FAAPS Project and the subject of this study is the FAAPS conceptmore » evaluation. The concept evaluation consists of (1) identifying assumptions and requirements, (2) documenting the process flow, (3) identifying and evaluating technologies available to accomplish the necessary ammunition processing and storage operations, and (4) presenting alternative concepts with associated costs, processing rates, and manpower requirements for accomplishing the operation. This study provides insight into the achievability of the desired objectives.« less

Uncorrected amteropia among children hospitalized for headache evaluation: a clinical descriptive study.

PubMed

Dotan, Gad; Stolovitch, Chaim; Moisseiev, Elad; Cohen, Shlomi; Kesler, Anat

2014-09-29

Headache is a common complaint in children occasionally requiring hospital admission. The purposes of the present study were to analyze the prevalence of uncorrected ametropia in children with headache admitted to the hospital, and evaluate the importance of refraction assessment as part of their evaluation. A retrospective review of children admitted to the Tel Aviv Medical Center for headache evaluation from December 2008 to March 2013, in whom the only abnormality found was an uncorrected refractive error. During the study period 917 children with headache were hospitalized for evaluation and 16 (1.7%) of them (9 boys, mean age 12 years, range 8-18 years) were found to have an uncorrected ametropia. Average headache duration was 4 months (range, 1 week to 1 year) and mean follow-up was 15 months (range, 1 month to 3 years). Twelve (75%) children had brain imaging and 4 children (25%) had a lumbar puncture before their refractive abnormality was identified. Anisometropia and myopia were the most common refractive errors encountered (n = 10 each), followed by hyperopia (n = 6) and astigmatism (n = 3). Despite having uncorrected refractive errors most children (n = 10) did not complain of any visual difficulty. All children were given proper refractive correction and 14 of them reported complete headache resolution on re-examination one month later. Uncorrected ametropia is a possible cause of headache among hospitalized children. Therefore, complete ophthalmic evaluation, which includes proper refraction assessment, is important as it can identify a treatable headache etiology. Children without visual difficulty should be equally evaluated, as many children with headache and uncorrected amteropia do not have vision complaints.

International Evaluation Studies of Second Step, a Primary Prevention Programme: A Review

ERIC Educational Resources Information Center

Schick, Andreas; Cierpka, Manfred

2013-01-01

Second Step is a social-emotional, skill-based, violence-prevention programme, which has been adapted for several European countries. The various versions of the programme (for kindergarten/preschool, elementary school, middle school) have been evaluated in a series of research studies. The outcomes and study designs of these studies are reported…

Documenting Evaluation Use: Guided Evaluation Decisionmaking. Evaluation Productivity Project.

ERIC Educational Resources Information Center

Burry, James

This paper documents the evaluation use process among districts using the Guide for Evaluation Decision Makers, published by the Center for the Study of Evaluation (CSE) during the 1984-85 school year. Included are the following: (1) a discussion of research that led to conclusions concerning the administrator's role in evaluation use; (2) a…

Teacher Evaluation: A Qualitative Study on Growth-Producing Practices in K-8 Schools

ERIC Educational Resources Information Center

Manso, Phoebe Hechanova

2017-01-01

Literature on teacher evaluation describes a flawed system that evokes wide-ranging attempts to "get it right." This qualitative study is another effort that seeks to understand its legal and traditional constructs. The goal of this research is to identify growth-producing practices that will transform teacher evaluation into an organic…

Implementing Curriculum Evaluation: Case Study of a Generic Undergraduate Degree in Health Sciences

ERIC Educational Resources Information Center

Harris, Lynne; Driscoll, Peter; Lewis, Melinda; Matthews, Lynda; Russell, Cherry; Cumming, Steven

2010-01-01

This case study presents a longitudinal, evidence-based approach to health science curriculum reform and evaluation. Curriculum in higher education must meet the needs of diverse stakeholders and must respond to dynamic local, national and international contexts, and this creates challenges for evaluation. The long lead time prior to the…

Evaluative-feedback stimuli selectively activate the self-related brain area: an fMRI study.

PubMed

Pan, Xiaohong; Hu, Yang; Li, Lei; Li, Jianqi

2009-11-06

Evaluative-feedback, occurring in our daily life, generally contains subjective appraisal of one's specific abilities and personality characteristics besides objective right-or-wrong information. Traditional psychological researches have proved it to be important in building up one's self-concept; however, the neural basis underlying its cognitive processing remains unclear. The present neuroimaging study revealed the mechanism of evaluative-feedback processing at the neural level. 19 healthy Chinese subjects participated in this experiment, and completed the time-estimation task to better their performance according to four types of feedback, namely positive evaluative- and performance-feedback as well as negative evaluative- and performance-feedback. Neuroimaging findings showed that evaluative- rather than performance-feedback can induce increased activities mainly distributed in the cortical midline structures (CMS), including medial prefrontal cortex (BA 8/9)/anterior cigulate cortex (ACC, BA 20), precuneus (BA 7/31) adjacent to posterior cingulate gyrus (PCC, BA 23) of both hemispheres, as well as right inferior lobule (BA 40). This phenomenon can provide evidence that evaluative-feedback may significantly elicit the self-related processing in our brain. In addition, our results also revealed that more brain areas, particularly some self-related neural substrates were activated by the positive evaluative-feedback, in comparative with the negative one. In sum, this study suggested that evaluative-feedback was closely correlated with the self-concept processing, which distinguished it from the performance-feedback.

Evaluation of Core Vocabulary Intervention for Treatment of Inconsistent Phonological Disorder: Three Treatment Case Studies

ERIC Educational Resources Information Center

McIntosh, Beth; Dodd, Barbara

2009-01-01

Children with unintelligible speech differ in severity, underlying deficit, type of surface error patterns and response to treatment. Detailed treatment case studies, evaluating specific intervention protocols for particular diagnostic groups, can identify best practice for children with speech disorder. Three treatment case studies evaluated the…

A Study of Developing an Attitude Scale towards Authentic Learning Environments and Evaluation

ERIC Educational Resources Information Center

Çetinkaya, Murat

2018-01-01

The aim of the research is to improve a valid and reliable attributing scale which identifies authentic learning environments and evaluation attributes of the science teacher candidates. The study has been designed on the base of validity and reliability of the scale developed to evaluate the authentic learning environments. The research group is…

Statistical and methodological issues in the evaluation of case management studies.

PubMed

Lesser, M L; Robertson, S; Kohn, N; Cooper, D J; Dlugacz, Y D

1996-01-01

For the past 3 years, the nursing case management team at North Shore University Hospital in Manhasset, NY, has been involved in a project to implement more than 50 clinical pathways, which provide a written "time line" for clinical events that should occur during a patient's hospital stay. A major objective of this project was to evaluate the efficacy of these pathways with respect to a number of important outcomes, such as length of stay, hospital costs, quality of patient care, and nursing and patient satisfaction. This article discusses several statistics-related issues in the design and evaluation of such case management studies. In particular, the role of a research approach in implementing and evaluating hospital programs, the choice of a comparison (control) group, the exclusion of selected patients from analysis, and the problems of equating pathways with diagnosis-related groups are addressed.

Temporal prediction restores the evaluative processing of delayed action feedback: an electrophysiological study.

PubMed

Kimura, Kenta; Kimura, Motohiro

2016-09-28

The evaluative processing of the valence of action feedback is reflected by an event-related brain potential component called feedback-related negativity (FRN) or reward positivity (RewP). Recent studies have shown that FRN/RewP is markedly reduced when the action-feedback interval is long (e.g. 6000 ms), indicating that an increase in the action-feedback interval can undermine the evaluative processing of the valence of action feedback. The aim of the present study was to investigate whether or not such undermined evaluative processing of delayed action feedback could be restored by improving the accuracy of the prediction in terms of the timing of action feedback. With a typical gambling task in which the participant chose one of two cards and received an action feedback indicating monetary gain or loss, the present study showed that FRN/RewP was significantly elicited even when the action-feedback interval was 6000 ms, when an auditory stimulus sequence was additionally presented during the action-feedback interval as a temporal cue. This result suggests that the undermined evaluative processing of delayed action feedback can be restored by increasing the accuracy of the prediction on the timing of the action feedback.

Economic evaluation: Concepts, selected studies, system costs, and a proposed program

NASA Technical Reports Server (NTRS)

Osterhoudt, F. H. (Principal Investigator)

1979-01-01

The more usual approaches to valuing crop information are reviewed and an integrated approach is recommended. Problems associated with implementation are examined. What has already been accomplished in the economic evaluation of LACIE-type information is reported including various studies of benefits. The costs of the existing and proposed systems are considered. A method and approach is proposed for further studies.

A Descriptive-Evaluative Study of a Saudi EFL Textbook Series

ERIC Educational Resources Information Center

Alharbi, Ahlam

2015-01-01

This study employs checklists from Williams (1983) and Keban, Muhtar, and Zen (2012) to evaluate the "Flying High for Saudi Arabia" series, which is currently taught in high schools in the Kingdom of Saudi Arabia, to ensure it can achieve their pedagogical goals. Different results were obtained from each checklist. Keban et al.'s…

Maritime Platform Sleep and Performance Study: Evaluating the SAFTE Model for Maritime Workplace Application

DTIC Science & Technology

2012-06-01

SLEEP AND PERFORMANCE STUDY: EVALUATING THE SAFTE MODEL FOR MARITIME WORKPLACE APPLICATION by Stephanie A. T. Brown June 2012 Thesis...REPORT DATE June 2012 3. REPORT TYPE AND DATES COVERED Master’s Thesis 4. TITLE AND SUBTITLE Maritime Platform Sleep and Performance Study...Evaluating the SAFTE Model for Maritime Workplace Application 5. FUNDING NUMBERS 6. AUTHOR(S) Stephanie A. T. Brown 7. PERFORMING ORGANIZATION

Standardizing evaluation process: Necessary for achieving SDGs - A case study of India.

PubMed

Srivastava, Alok

2018-05-09

A set of 17 Sustainable Development Goals (SDGs) adopted by the United Nations General Assembly in September 2015 are to be implemented and achieved in every country from the year 2016 to 2030. In Indian context, all these goals are very relevant and critical, as India missed the target on many components of the Millennium Development Goals (MDGs). The author strongly feels that one of the key reasons was lack of an in-built robust system for measuring the progress and achievements of MDGs. Monitoring and Evaluation of programmes and schemes, aiming at different SDGs, in a robust and regular manner is therefore need of the hour. A National evaluation policy (NEP) would set the tone in the right direction from the very beginning for achieving SDGs. The paper taking India as a case study discusses different critical factors pertinent for having a well laid down national level policy towards standardizing evaluation. Using real examples under different components of an evaluation policy, the paper discusses and questions the credibility and acceptance of the present evaluation system in place. The paper identifies five core mantras or pre-requisites of a national evaluation guideline. The paper emphasizes the importance of an evaluation policy in India and other countries as well, to provide authentic data gathered through a well-designed evaluation process and take corrective measures well on time to achieve SDGs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Performance Evaluation of Community Health Workers: Case Study in the Amazon of Peru.

PubMed

Westgard, Christopher; Naraine, Renuka; Paucar Villacorta, Diego Mauricio

2018-03-26

A shortage in human resources for health is a growing crisis that has led to an inability to provide adequate health services to impoverished populations. By "task-shifting", health systems can delegate certain activities, such as health promotion and referral, to trained community members to help fill the human resource gap. An effective community health agent program can improve maternal and child health and overall effectiveness of rural health systems. Such a program is most effective when the community health agents receive supervision and evaluation of their performance. There is a shortage of literature that provides instruction and example on how to conduct a performance evaluation in the developing world to improve maternal and child health outcomes. The current study provides a case study of a performance evaluation in the Amazon region of Peru and how the findings can be used to make program adjustments. A set of instruments to measure the performance of CHWs was adapted from the literature and then implemented in the field. The instruments were used to measure the quality of home visits by the CHWs, their knowledge of the health topics, and structural activities. Three communities with an active CHW program in Loreto, Peru were chosen to receive the evaluation. All CHWs in the communities were evaluated. The scores from the evaluation were compared internally to identify strengths and weaknesses of the program and within the population of CHWs. The evaluation was completed on 52 home visits and 27 CHWs in three communities. The CHWs were found to be most effective at creating good relationships with caregivers and delivering health messages, and least effective at interacting with the child during the home visit and using material to deliver health messages. The evaluation instruments were well suited for the CHW program that utilizes home visits to teach about child health and development.

Evaluation of a respiratory symptom diary for clinical studies of idiopathic pulmonary fibrosis.

PubMed

Bacci, Elizabeth Dansie; O'Quinn, Sean; Leidy, Nancy Kline; Murray, Lindsey; Vernon, Margaret

2018-01-01

There are no validated patient diaries for evaluating respiratory symptoms in idiopathic pulmonary fibrosis (IPF). To evaluate the performance properties of the chronic obstructive pulmonary disease (COPD) Evaluating Respiratory Symptoms™ (E-RS™: COPD) measure in patients with IPF. Concept elicitation and cognitive interviews were conducted with IPF patients to evaluate content validity, including comprehensiveness, relevance, and interpretability of E-RS™ items in this patient population. Secondary analyses of IPF clinical study data were performed to evaluate the scoring structure of the tool. With modifications, reliability, validity, and responsiveness of the instrument (E-RS™: IPF) were evaluated. Qualitative interviews (n = 30) were conducted. During the elicitation interviews (n = 20), concept saturation for IPF respiratory symptoms was achieved; all respiratory symptoms covered by the E-RS™ were endorsed by ≥ 30% of the sample. During cognitive interviews (n = 10), all participants found the items interpretable and relevant. Factor analyses conducted via secondary analysis of IPF clinical study data identified no total score and four symptom scales: Chest, Breathlessness, Cough, and Sputum. Reliability of each scale was high (internal consistency [α] >0.85); 2-day reproducibility (ICC >0.88). Validity was supported through significant (P < 0.0001) relationships with the St. George's Respiratory Questionnaire (SGRQ), the University of California, San Diego Shortness of Breath Questionnaire (UCSD-SOBQ), and other variables. The scales were responsive to change when evaluated using SGRQ Symptoms, UCSD-SOBQ, and Patient Global Impression of Change as anchors (P < 0.01 to P < 0.0001). The E-RS™: IPF is a valid, reliable, and responsive tool for evaluating respiratory symptoms in patients with IPF. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

Studying health information from a distance: refining an e-learning case study in the crucible of student evaluation.

PubMed

Booth, Andrew; Levy, Philippa; Bath, Peter A; Lacey, Terence; Sanderson, Mark; Diercks-O'Brien, Gabi

2005-12-01

To present a formative evaluation of the impact of a multimedia case study as a component of a masters course in health informatics delivered by distance learning. First and second year health informatics students undertaking four core modules of a masters programme at the University of Sheffield. Individual qualitative user surveys and interviews. Formative evaluation has played a significant role in refining the case study through its text-based, intermediate and CD-ROM based stages. Feedback from students has resulted in clarification of case study tasks, clearer definition of teaching roles and a revised approach to assessment. At the same time it has highlighted the importance of ongoing revision and maintenance in keeping the scenarios realistic and current. The multimedia case study has met many of its original aims in providing greater cohesion for core modules and encouraging greater levels of interaction and multidisciplinary collaboration.

An Evaluation of Geographic Information Systems in Social Studies Lessons: Teachers' Views

ERIC Educational Resources Information Center

Aladag, Elif

2014-01-01

The aim of this study is to evaluate the applicability of Geographic Information Systems (GIS), used increasingly in primary and secondary education across the world, in social studies lessons in Turkey. In line with this aim, 14 social studies teachers working in the province of Aydin, Turkey received a 6-hour training course about GIS during the…

Development of Self-study and Student Evaluation Support System for HDL Design Education

NASA Astrophysics Data System (ADS)

Chiba, Shinji

In HDL design education, the students should study HDL description and usage of EDA tools to master HDL design technique and the teachers have to check a lot of HDL description files to evaluate students. This paper proposed a HDL design education system composed of WBT and LMS servers. The developed education system has been operated at an actual class. Results of the operation indicated that the proposal system helped effectively teachers to evaluate students. Questionnaire for students showed that a lot of students used the proposal system for self-study.

Evaluation of Therapy Management and Patient Compliance in Postmenopausal Patients with Hormone Receptor-positive Breast Cancer Receiving Letrozole Treatment: The EvaluateTM Study

PubMed Central

Fasching, P. A.; Fehm, T.; Kellner, S.; de Waal, J.; Rezai, M.; Baier, B.; Baake, G.; Kolberg, H.-C.; Guggenberger, M.; Warm, M.; Harbeck, N.; Würstlein, R.; Deuker, J.-U.; Dall, P.; Richter, B.; Wachsmann, G.; Brucker, C.; Siebers, J. W.; Fersis, N.; Kuhn, T.; Wolf, C.; Vollert, H.-W.; Breitbach, G.-P.; Janni, W.; Landthaler, R.; Kohls, A.; Rezek, D.; Noesslet, T.; Fischer, G.; Henschen, S.; Praetz, T.; Heyl, V.; Kühn, T.; Krauß, T.; Thomssen, C.; Kümmel, S.; Hohn, A.; Tesch, H.; Mundhenke, C.; Hein, A.; Rauh, C.; Bayer, C. M.; Jacob, A.; Schmidt, K.; Belleville, E.; Hadji, P.; Wallwiener, D.; Grischke, E.-M.; Beckmann, M. W.; Brucker, S. Y.

2014-01-01

Introduction: The EvaluateTM study (Evaluation of therapy management and patient compliance in postmenopausal hormone receptor-positive breast cancer patients receiving letrozole treatment) is a prospective, non-interventional study for the assessment of therapy management and compliance in the routine care of postmenopausal women with invasive hormone receptor-positive breast cancer receiving letrozole. The parameters for inclusion in the study are presented and discussed here. Material and Methods: Between January 2008 and December 2009 a total of 5045 patients in 310 study centers were recruited to the EvaluateTM study. Inclusion criteria were hormone receptor-positive breast cancer and adjuvant treatment or metastasis. 373 patients were excluded from the analysis for various reasons. Results: A total of 4420 patients receiving adjuvant treatment and 252 patients with metastasis receiving palliative treatment were included in the study. For 4181 patients receiving adjuvant treatment, treatment with the aromatase inhibitor letrozole commenced immediately after surgery (upfront). Two hundred patients had initially received tamoxifen and started aromatase inhibitor treatment with letrozole at 1–5 years after diagnosis (switch), und 39 patients only commenced letrozole treatment 5–10 years after diagnosis (extended endocrine therapy). Patient and tumor characteristics were within expected ranges, as were comorbidities and concurrent medication. Conclusion: The data from the EvaluateTM study will offer a good overview of therapy management in the routine care of postmenopausal women with hormone receptor-positive breast cancer. Planned analyses will look at therapy compliance and patient satisfaction with how information is conveyed and the contents of the conveyed information. PMID:25568468

Clinical Observed Performance Evaluation: A Prospective Study in Final Year Students of Surgery

ERIC Educational Resources Information Center

Markey, G. C.; Browne, K.; Hunter, K.; Hill, A. D.

2011-01-01

We report a prospective study of clinical observed performance evaluation (COPE) for 197 medical students in the pre-qualification year of clinical education. Psychometric quality was the main endpoint. Students were assessed in groups of 5 in 40-min patient encounters, with each student the focus of evaluation for 8 min. Each student had a series…

A Comprehensive Model for Developing and Evaluating Study Abroad Programs in Counselor Education

ERIC Educational Resources Information Center

Santos, Syntia Dinora

2014-01-01

This paper introduces a model to guide the process of designing and evaluating study abroad programs, addressing particular stages and influential factors. The main purpose of the model is to serve as a basic structure for those who want to develop their own program or evaluate previous cultural immersion experiences. The model is based on the…

Green and sustainable remediation (GSR) evaluation: framework, standards, and tool. A case study in Taiwan.

PubMed

Huang, Wen-Yen; Hung, Weiteng; Vu, Chi Thanh; Chen, Wei-Ting; Lai, Jhih-Wei; Lin, Chitsan

2016-11-01

Taiwan has a large number of poorly managed contaminated sites in need of remediation. This study proposes a framework, a set of standards, and a spreadsheet-based evaluation tool for implementing green and sustainable principles into remediation projects and evaluating the projects from this perspective. We performed a case study to understand how the framework would be applied. For the case study, we used a spreadsheet-based evaluation tool (SEFA) and performed field scale cultivation tests on a site contaminated with total petroleum hydrocarbons (TPHs). The site was divided into two lots: one treated by chemical oxidation and the other by bioremediation. We evaluated five core elements of green and sustainable remediation (GSR): energy, air, water resources, materials and wastes, and land and ecosystem. The proposed evaluation tool and field scale cultivation test were found to efficiently assess the effectiveness of the two remediation alternatives. The framework and related tools proposed herein can potentially be used to support decisions about the remediation of contaminated sites taking into account engineering management, cost effectiveness, and social reconciliation.

Evaluating Creative Thinking of Rn-Bsn Students in the Course of Clinical Case Study and Practicum

ERIC Educational Resources Information Center

Ku, Ya-Lie

2015-01-01

This case study evaluated creative thinking of RN-BSN students in the course of clinical case study and practicum. Study design used quantitative and qualitative evaluations of creative thinking of RN-BSN students by triangulation method in the course of clinical case study and practicum. Sixty RN-BSN students self-perceived the changing levels of…

Perceptions of the Principal Evaluation Process and Performance Criteria: A Qualitative Study of the Challenge of Principal Evaluation

ERIC Educational Resources Information Center

Faginski-Stark, Erica; Casavant, Christopher; Collins, William; McCandless, Jason; Tencza, Marilyn

2012-01-01

Recent federal and state mandates have tasked school systems to move beyond principal evaluation as a bureaucratic function and to re-imagine it as a critical component to improve principal performance and compel school renewal. This qualitative study investigated the district leaders' and principals' perceptions of the performance evaluation…

[Quality standards for epidemiologic cohort studies : An evaluated catalogue of requirements for the conduct and preparation of cohort studies].

PubMed

Schmidt, Carsten Oliver; Krabbe, Christine E M; Schössow, Janka; Berger, Klaus; Enzenbach, Cornelia; Kamtsiuris, Panagiotis; Schöne, Gina; Houben, Robin; Meisinger, Christa; Bamberg, Fabian; Hendel, Thomas; Selder, Sonja; Nonnemacher, Michael; Moebus, Susanne; Stausberg, Jürgen

2018-01-01

Cohort studies are a longitudinal observational study type. They are firmly established within epidemiology to assess the course of diseases and risk factors. Yet, standards to describe and evaluate quality characteristics of cohort studies need further development. Within the TMF ("Technologie- und Methodenplattform für die vernetzte medizinische Forschung e. V.") project "Quality management standards in cohort studies", a catalogue of requirements was compiled and evaluated, focusing on the preparation and conduct of epidemiologic cohort studies. The catalogue of requirements was established based on a consensus process between representatives of seven German epidemiologic cohort studies. For this purpose, a set of expert meetings (telephone, face-to-face, web-based) was conducted and the importance of each element of the catalogue was assessed as well as its implementation. A catalogue of requirements with 138 requirements was consented. It is structured into ten sections: 1. Study documentation; 2. Selection of instruments; 3. Study implementation, 4. Organizational structure; 5. Qualification and certification; 6. Participant recruitment; 7. Preparation, conduct and follow-up processing of examinations; 8. Study logistics and maintenance, 9. Data capture and data management; 10. Reporting and monitoring. In total, 41 elements were categorized as being essential, 91 as important, and 6 as less important. The catalogue of requirements provides a guideline to improve the preparation and operation of cohort studies. The evaluation of the importance and degree of implementation of requirements depended on the study design. With adaptations, the catalogue might be transferable to other study types.

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences

ERIC Educational Resources Information Center

Kraft, Matthew A.; Gilmour, Allison F.

2016-01-01

Purpose: New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to…

A Study To Evaluate the Effectiveness of the Montana Functional Vision Assessment for Multihandicapped Persons.

ERIC Educational Resources Information Center

Marks, Ron

The study evaluated the validity, reliability, and effectiveness in providing needed information of the Montana Functional Vision Assessment (MFVA) Instrument by comparing it with the Texas Education Agency Functional Vision Assessment and field testing the instrument in evaluations of nine multihandicapped students (ages 3-11). Evaluation led to…

A prospective study assessing agreement and reliability of a geriatric evaluation.

PubMed

Locatelli, Isabella; Monod, Stéfanie; Cornuz, Jacques; Büla, Christophe J; Senn, Nicolas

2017-07-19

The present study takes place within a geriatric program, aiming at improving the diagnosis and management of geriatric syndromes in primary care. Within this program it was of prime importance to be able to rely on a robust and reproducible geriatric consultation to use as a gold standard for evaluating a primary care brief assessment tool. The specific objective of the present study was thus assessing the agreement and reliability of a comprehensive geriatric consultation. The study was conducted at the outpatient clinic of the Service of Geriatric Medicine, University of Lausanne, Switzerland. All community-dwelling older persons aged 70 years and above were eligible. Patients were excluded if they hadn't a primary care physician, they were unable to speak French, or they were already assessed by a geriatrician within the last 12 months. A set of 9 geriatricians evaluated 20 patients. Each patient was assessed twice within a 2-month delay. Geriatric consultations were based on a structured evaluation process, leading to rating the following geriatric conditions: functional, cognitive, visual, and hearing impairment, mood disorders, risk of fall, osteoporosis, malnutrition, and urinary incontinence. Reliability and agreement estimates on each of these items were obtained using a three-way Intraclass Correlation and a three-way Observed Disagreement index. The latter allowed a decomposition of overall disagreement into disagreements due to each source of error variability (visit, rater and random). Agreement ranged between 0.62 and 0.85. For most domains, geriatrician-related error variability explained an important proportion of disagreement. Reliability ranged between 0 and 0.8. It was poor/moderate for visual impairment, malnutrition and risk of fall, and good/excellent for functional/cognitive/hearing impairment, osteoporosis, incontinence and mood disorders. Six out of nine items of the geriatric consultation described in this study (functional

Evaluation and Assessment Processes in Nebraska Public Schools. A Staff Report. Education Interim Study LR 181.

ERIC Educational Resources Information Center

Nebraska Legislative Council, Lincoln. Legislative Research Div.

During the spring of 1987, the National Conference of State Legislatures awarded the Nebraska Legislature a cost-sharing award to study local school evaluation processes. Embodied in Legislative Resolution 181, which has the purpose of studying school evaluation procedures, the study attempts to provide legislators, educators, local school…

Student nurse mentoring: an evaluative study of the mentor's perspective.

PubMed

Rylance, Rebecca; Barrett, Julie; Sixsmith, Pam; Ward, Donna

2017-04-13

An evaluative study aimed to capture the 'mentor voice' and provide an insight into the mentoring role from the perspective of the nurse mentor. Participants from each of the four fields of nursing practice were asked to comment on the satisfying and frustrating aspects of their mentoring role. The narrative data gleaned from the evaluation were qualitatively analysed and subsequently organised into key themes around the student-mentor relationship and the clinical environment. Given that the landscape of nurse education is set to change, in terms of new standards from the professional bodies and the political drivers, not to mention the changing profile of the student nurse, it is hoped that the findings may help to shape the relationship between the mentor, the student and the higher education institution.

Building Assessment Survey and Evaluation Study Summarized Data - HVAC Characteristics

EPA Pesticide Factsheets

In the Building Assessment Survey and Evaluation (BASE) Study Information on the characteristics of the heating, ventilation, and air conditioning (HVAC) system(s) in the entire BASE building including types of ventilation, equipment configurations, and operation and maintenance issues was acquired by examining the building plans, conducting a building walk-through, and speaking with the building owner, manager, and/or operator.

Evaluating Por Nuestra Salud: A Feasibility Study.

PubMed

Marshall, Brenda; Gonzales, Gustavo; Kernan, William

2016-01-01

This feasibility study evaluated the impact of a culturally consistent diabetes educational program, led by a Latino pastor, on Latino community diabetes knowledge levels. Latino adults were recruited from two churches serving Latino populations, one identified as intervention, the other as nonintervention. Both churches received the American Diabetes Association's booklets on diabetes education, "Four Steps to Control Your Diabetes for Life." The intervention group also received weekly reviews of the booklet's information from the church pastor, who was educated about diabetes by a Latino family nurse practitioner. Pre- and postintervention levels of diabetes knowledge were measured using the Diabetes Knowledge Questionnaire. Mean changes in the Diabetes Knowledge Questionnaire (DKQ-24) survey from pretest to posttest indicated a significant increase in knowledge in both groups. Only the grades for the participants from the pastor-led group, however, moved from failure in knowledge to high levels of passing. One hundred percent of intervention group participants reported having read the literature. This pilot study supports the feasibility of a local Latino pastor, as a culturally consistent diabetes educator, to increase Latino parishioner's knowledge of diabetes. © 2015 Society for Public Health Education.

An experimental study on CHVE's performance evaluation.

PubMed

Paiva, Paulo V F; Machado, Liliane S; Oliveira, Jauvane C

2012-01-01

Virtual reality-based training simulators, with collaborative capabilities, are known to improve the way users interact with one another while learning or improving skills on a given medical procedure. Performance evaluation of Collaborative Haptic Virtual Environments (CHVE) allows us to understand how such systems can work in the Internet, as well as the requirements for multisensorial and real-time data. This work discloses new performance evaluation results for the collaborative module of the CyberMed VR framework.

Research designs for studies evaluating the effectiveness of change and improvement strategies.

PubMed

Eccles, M; Grimshaw, J; Campbell, M; Ramsay, C

2003-02-01

The methods of evaluating change and improvement strategies are not well described. The design and conduct of a range of experimental and non-experimental quantitative designs are considered. Such study designs should usually be used in a context where they build on appropriate theoretical, qualitative and modelling work, particularly in the development of appropriate interventions. A range of experimental designs are discussed including single and multiple arm randomised controlled trials and the use of more complex factorial and block designs. The impact of randomisation at both group and individual levels and three non-experimental designs (uncontrolled before and after, controlled before and after, and time series analysis) are also considered. The design chosen will reflect both the needs (and resources) in any particular circumstances and also the purpose of the evaluation. The general principle underlying the choice of evaluative design is, however, simple-those conducting such evaluations should use the most robust design possible to minimise bias and maximise generalisability.

Formative Evaluation of the ACSC Distance Learning Program: A Status Study.

ERIC Educational Resources Information Center

MacCuish, Donald A.

2001-01-01

Describes a formative evaluation of the Air Command and Staff College (ACSC) distance learning program, which offers professional military education (PME). Highlights include use of the status study methodology; curriculum development; course design; learning theories; instructional systems design; best practices; and student assessment. (LRW)

Stability of Spironolactone Oral Suspension in PCCA Base, SuspendIt.

PubMed

Graves, Richard; Phan, Kelly V; Bostanian, Levon A; Mandal, Tarun K; Pramar, Yashoda V

2017-01-01

Spironolactone (Aldactone) is a potassium-sparing diuretic used to treat hypertension and heart failure and may also be used to treat edema resulting from kidney disease, low potassium levels, or excess aldosterone. No commercial liquid dosage form of spironolactone exists. An extemporaneously compounded suspension from pure drug powder or commercial tablets would provide an alternative option to meet unique patient needs. The purpose of this study was to determine the physicochemical stability of spironolactone in the PCCA base SuspendIt. This base is a sugar-free, paraben-free, dye-free, and gluten-free thixotropic vehicle containing a natural sweetener obtained from the monk fruit. It thickens upon standing to minimize settling of any insoluble drug particles and becomes fluid upon shaking to allow convenient pouring during administration to the patient. A robust stability-indicating highperformance liquid chromatographic assay for the determination of spironolactone in PCCA base SuspendIt was developed and validated. This assay was used to determine the chemical stability of the drug in SuspendIt. Samples were prepared and stored under three different temperature conditions (5°C, 25°C, 40°C) and assayed using the high-performance liquid chromatographic assay at pre-determined intervals over an extended period of time as follows: 0, 7, 14, 29, 46, 60, 90, 120, and 180 days at each designated temperature. Physical data such as pH, viscosity, and appearance were also monitored. The study showed that drug concentration did not go below 90% of the label claim (initial drug concentration) at all three temperatures studied. Viscosity and pH values also did not change significantly. This study demonstrates that spironolactone is physically and chemically stable in SuspendIt for 180 days in the refrigerator and at room temperature, thus providing a viable, compounded alternative for spironolactone in a liquid dosage form, with an extended beyond-use date to meet

Evaluating the Madrasa Preschool Programme in East Africa: A Quasi-Experimental Study

ERIC Educational Resources Information Center

Mwaura, Peter A. M.; Sylva, Kathy; Malmberg, Lars-Erik

2008-01-01

This study investigated the effect of preschool experience (two types of preschool: Madrasa and non-Madrasa) on the cognitive development of children in East Africa. In the three countries studied (Kenya, Uganda, and Tanzania/Zanzibar) preschool education is burgeoning and government standards are being set. This quasi experimental evaluation used…

An evaluation of fluorescent elastomer for marking bluegills in experimental studies

USGS Publications Warehouse

Dewey, Michael R.; Zigler, Steven J.

1996-01-01

We evaluated subdermal injection of a fluorescent elastomer for marking bluegills Lepomis macrochirus in laboratory and pond studies. Marking did not affect the growth or survival of adult or juvenile bluegills. Marks were visible for at least 6 months. This technique is a reliable, relatively inexpensive marking method for the identification of individual fish in experimental studies. Costs of application range from US$0.01 to $0.03 per mark.

Can the impact of public involvement on research be evaluated? A mixed methods study.

PubMed

Barber, Rosemary; Boote, Jonathan D; Parry, Glenys D; Cooper, Cindy L; Yeeles, Philippa; Cook, Sarah

2012-09-01

  Public involvement is central to health and social research policies, yet few systematic evaluations of its impact have been carried out, raising questions about the feasibility of evaluating the impact of public involvement.   To investigate whether it is feasible to evaluate the impact of public involvement on health and social research.   Mixed methods including a two-round Delphi study with pre-specified 80% consensus criterion, with follow-up interviews. UK and international panellists came from different settings, including universities, health and social care institutions and charitable organizations. They comprised researchers, members of the public, research managers, commissioners and policy makers, self-selected as having knowledge and/or experience of public involvement in health and/or social research; 124 completed both rounds of the Delphi process. A purposive sample of 14 panellists was interviewed.   Consensus was reached that it is feasible to evaluate the impact of public involvement on 5 of 16 impact issues: identifying and prioritizing research topics, disseminating research findings and on key stakeholders. Qualitative analysis revealed the complexities of evaluating a process that is subjective and socially constructed. While many panellists believed that it is morally right to involve the public in research, they also considered that it is appropriate to evaluate the impact of public involvement.   This study found consensus among panellists that it is feasible to evaluate the impact of public involvement on some research processes, outcomes and on key stakeholders. The value of public involvement and the importance of evaluating its impact were endorsed. © 2011 Blackwell Publishing Ltd.

Can the impact of public involvement on research be evaluated? A mixed methods study

PubMed Central

Barber, Rosemary; Boote, Jonathan D; Parry, Glenys D; Cooper, Cindy L; Yeeles, Philippa; Cook, Sarah

2011-01-01

Abstract Background  Public involvement is central to health and social research policies, yet few systematic evaluations of its impact have been carried out, raising questions about the feasibility of evaluating the impact of public involvement. Objective  To investigate whether it is feasible to evaluate the impact of public involvement on health and social research. Methods  Mixed methods including a two‐round Delphi study with pre‐specified 80% consensus criterion, with follow‐up interviews. UK and international panellists came from different settings, including universities, health and social care institutions and charitable organizations. They comprised researchers, members of the public, research managers, commissioners and policy makers, self‐selected as having knowledge and/or experience of public involvement in health and/or social research; 124 completed both rounds of the Delphi process. A purposive sample of 14 panellists was interviewed. Results  Consensus was reached that it is feasible to evaluate the impact of public involvement on 5 of 16 impact issues: identifying and prioritizing research topics, disseminating research findings and on key stakeholders. Qualitative analysis revealed the complexities of evaluating a process that is subjective and socially constructed. While many panellists believed that it is morally right to involve the public in research, they also considered that it is appropriate to evaluate the impact of public involvement. Conclusions  This study found consensus among panellists that it is feasible to evaluate the impact of public involvement on some research processes, outcomes and on key stakeholders. The value of public involvement and the importance of evaluating its impact were endorsed. PMID:21324054

40 CFR Appendix A to Subpart H of... - Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations

Code of Federal Regulations, 2010 CFR

2010-07-01

... Studies and Environmental Evaluations A Appendix A to Subpart H of Part 35 Protection of Environment... to Subpart H of Part 35—Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations... officer as specified in §§ 35.1650-3(b)(1) and 35.1650-3(c)(1). (a) A diagnostic study consisting of: (1...

40 CFR Appendix A to Subpart H of... - Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations

Code of Federal Regulations, 2012 CFR

2012-07-01

... Studies and Environmental Evaluations A Appendix A to Subpart H of Part 35 Protection of Environment... to Subpart H of Part 35—Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations... officer as specified in §§ 35.1650-3(b)(1) and 35.1650-3(c)(1). (a) A diagnostic study consisting of: (1...

40 CFR Appendix A to Subpart H of... - Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations

Code of Federal Regulations, 2014 CFR

2014-07-01

... Studies and Environmental Evaluations A Appendix A to Subpart H of Part 35 Protection of Environment... to Subpart H of Part 35—Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations... officer as specified in §§ 35.1650-3(b)(1) and 35.1650-3(c)(1). (a) A diagnostic study consisting of: (1...

40 CFR Appendix A to Subpart H of... - Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations

Code of Federal Regulations, 2013 CFR

2013-07-01

... Studies and Environmental Evaluations A Appendix A to Subpart H of Part 35 Protection of Environment... to Subpart H of Part 35—Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations... officer as specified in §§ 35.1650-3(b)(1) and 35.1650-3(c)(1). (a) A diagnostic study consisting of: (1...

40 CFR Appendix A to Subpart H of... - Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations

Code of Federal Regulations, 2011 CFR

2011-07-01

... Studies and Environmental Evaluations A Appendix A to Subpart H of Part 35 Protection of Environment... to Subpart H of Part 35—Requirements for Diagnostic-Feasibility Studies and Environmental Evaluations... officer as specified in §§ 35.1650-3(b)(1) and 35.1650-3(c)(1). (a) A diagnostic study consisting of: (1...

Evaluator and Program Manager Perceptions of Evaluation Capacity and Evaluation Practice

ERIC Educational Resources Information Center

Fierro, Leslie A.; Christie, Christina A.

2017-01-01

The evaluation community has demonstrated an increased emphasis and interest in evaluation capacity building in recent years. A need currently exists to better understand how to measure evaluation capacity and its potential outcomes. In this study, we distributed an online questionnaire to managers and evaluation points of contact working in…

Vibratory roller evaluation study : final report.

DOT National Transportation Integrated Search

1976-03-01

The Louisiana Department of Highways has recently completed a program to evaluate the use of vibratory rollers in the compaction of asphaltic concrete pavements. In all, a total of nine different vibratory rollers was tested along with conventional s...

FBI fingerprint identification automation study. AIDS 3 evaluation report. Volume 4: Economic feasibility

NASA Technical Reports Server (NTRS)

Mulhall, B. D. L.

1980-01-01

The results of the economic analysis of the AIDS 3 system design are presented. AIDS 3 evaluated a set of economic feasibility measures including life cycle cost, implementation cost, annual operating expenditures and annual capital expenditures. The economic feasibility of AIDS 3 was determined by comparing the evaluated measures with the same measures, where applicable, evaluated for the current system. A set of future work load scenarios was constructed using JPL's environmental evaluation study of the fingerprint identification system. AIDS 3 and the current system were evaluated for each of the economic feasibility measures for each of the work load scenarios. They were compared for a set of performance measures, including response time and accuracy, and for a set of cost/benefit ratios, including cost per transaction and cost per technical search. Benefit measures related to the economic feasibility of the system are also presented, including the required number of employees and the required employee skill mix.

An evaluative case study of online learning for healthcare professionals.

PubMed

Pullen, Darren L

2006-01-01

This evaluation study assessed the pedagogical and instructional design (e-pedagogy) effectiveness of online continuing professional education (CPE) courses offered by a large Australian CPE provider. A naturalistic theory approach and a multilevel evaluation were used to examine the impact of web-based learning on more than 300 healthcare professionals. Participant satisfaction, learning achievement, self-reported practice performance change, and e-pedagogical courseware characteristics were assessed by various qualitative and quantitative data collection methods. Findings revealed that learning online was an effective means for increasing CPE knowledge (p < .05) and improving self-reported practice performance change (p < .05). Courses containing a clinical tool resulted in an increased self-reported practice performance change over courses that did not (Zobs = 3.757). Online CPE offers a convenient format for healthcare professionals from educationally and geographically diverse populations to update their knowledge and view best practice.

A Study of the Correlation of the Improvement of Teaching Evaluation Scores Based on Student Performance Grades

ERIC Educational Resources Information Center

Chen, Chi Yuan; Wang, Shu-Yin; Yang, Yi-Fang

2017-01-01

The purpose of the study is to explore the influence of teaching evaluations on teachers in that they might try to please their students by giving higher grades in order to get higher teaching evaluation scores. To achieve this purpose, the study analyzed the correlations between teaching evaluation scores, student's final grades and course fail…

"Evaluation as Illumination: A New Approach to the Study of Innovatory Programs". Occasional Paper.

ERIC Educational Resources Information Center

Parlett, Malcolm; Hamilton, David

Conventional approaches to program evaluation have followed the experimental and psychometric traditions dominant in educational research. Their aim (unfulfilled) of achieving fully objective methods had led to studies that are artificial and restricted in scope. Illuminative evaluation is introduced as a total re-appraisal of the rationale and…

A Historical Reflection on Research Evaluation Studies, Their Recurrent Themes and Challenges. Technical Report

ERIC Educational Resources Information Center

Marjanovic, Sonja; Hanney, Stephen; Wooding, Steven

2009-01-01

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

Self and Peer Evaluation of Writing in the Interactive ESL Classroom: An Exploratory Study.

ERIC Educational Resources Information Center

Rothschild, Dennie; Klingenberg, Felicia

1990-01-01

Investigates self- and peer evaluation of writing in the English-as-a-Second-Language classroom. The investigation is examined in two parts: (1) adapting and implementing an appropriate evaluation scale, and (2) studying the various end-of-term effects use of the scale had on students. (17 references) (GLR)

Self-Study and Evaluation Guide/1968 Edition. Section D-3: Rehabilitation Centers.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on rehabilitation centers is one of 28 guides designed for organizations undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of standards to be appraised by the self-evaluation…

Self-Study and Evaluation Guide [1976 Edition]. Section D-4: Workshop Services.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on workshop service is one of twenty-eight guides designed for organizations who are undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of standards to be appraised by the…

Self-Study and Evaluation Guide/[1975 Edition]. Section D-6: Vocational Services.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on vocational services is one of 28 guides designed for organizations who are undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of standards to be appraised by the…

Evaluation models and criteria of the quality of hospital websites: a systematic review study

PubMed Central

Jeddi, Fatemeh Rangraz; Gilasi, Hamidreza; Khademi, Sahar

2017-01-01

Introduction Hospital websites are important tools in establishing communication and exchanging information between patients and staff, and thus should enjoy an acceptable level of quality. The aim of this study was to identify proper models and criteria to evaluate the quality of hospital websites. Methods This research was a systematic review study. The international databases such as Science Direct, Google Scholar, PubMed, Proquest, Ovid, Elsevier, Springer, and EBSCO together with regional database such as Magiran, Scientific Information Database, Persian Journal Citation Report (PJCR) and IranMedex were searched. Suitable keywords including website, evaluation, and quality of website were used. Full text papers related to the research were included. The criteria and sub criteria of the evaluation of website quality were extracted and classified. Results To evaluate the quality of the websites, various models and criteria were presented. The WEB-Q-IM, Mile, Minerva, Seruni Luci, and Web-Qual models were the designed models. The criteria of accessibility, content and apparent features of the websites, the design procedure, the graphics applied in the website, and the page’s attractions have been mentioned in the majority of studies. Conclusion The criteria of accessibility, content, design method, security, and confidentiality of personal information are the essential criteria in the evaluation of all websites. It is suggested that the ease of use, graphics, attractiveness and other apparent properties of websites are considered as the user-friendliness sub criteria. Further, the criteria of speed and accessibility of the website should be considered as sub criterion of efficiency. When determining the evaluation criteria of the quality of websites, attention to major differences in the specific features of any website is essential. PMID:28465807

Evaluation models and criteria of the quality of hospital websites: a systematic review study.

PubMed

Jeddi, Fatemeh Rangraz; Gilasi, Hamidreza; Khademi, Sahar

2017-02-01

Hospital websites are important tools in establishing communication and exchanging information between patients and staff, and thus should enjoy an acceptable level of quality. The aim of this study was to identify proper models and criteria to evaluate the quality of hospital websites. This research was a systematic review study. The international databases such as Science Direct, Google Scholar, PubMed, Proquest, Ovid, Elsevier, Springer, and EBSCO together with regional database such as Magiran, Scientific Information Database, Persian Journal Citation Report (PJCR) and IranMedex were searched. Suitable keywords including website, evaluation, and quality of website were used. Full text papers related to the research were included. The criteria and sub criteria of the evaluation of website quality were extracted and classified. To evaluate the quality of the websites, various models and criteria were presented. The WEB-Q-IM, Mile, Minerva, Seruni Luci, and Web-Qual models were the designed models. The criteria of accessibility, content and apparent features of the websites, the design procedure, the graphics applied in the website, and the page's attractions have been mentioned in the majority of studies. The criteria of accessibility, content, design method, security, and confidentiality of personal information are the essential criteria in the evaluation of all websites. It is suggested that the ease of use, graphics, attractiveness and other apparent properties of websites are considered as the user-friendliness sub criteria. Further, the criteria of speed and accessibility of the website should be considered as sub criterion of efficiency. When determining the evaluation criteria of the quality of websites, attention to major differences in the specific features of any website is essential.

Computer-Assisted Reading Intervention in a Secondary School: An Evaluation Study.

ERIC Educational Resources Information Center

Lynch, Lisa; Fawcett, Angela J.; Nicolson, Roderick I.

2000-01-01

RITA (Reader's Interactive Teaching Assistant) is a computer-based literacy support system that assists, rather than replaces, the teacher in providing support tailored to each child's profile of reading attainments. This study evaluated the effectiveness of RITA in secondary school with 8 children having very seriously disadvantaged literacy…

Evaluation of Child Care Subsidy Strategies: Massachusetts Family Child Care Study

ERIC Educational Resources Information Center

Collins, Ann; Goodson, Barbara; Luallen, Jeremy; Fountain, Alyssa Rulf; Checkoway, Amy

2010-01-01

This report presents findings from the Massachusetts Family Child Care study, a two-year evaluation of the impacts of an early childhood education program on providers and children in family child care. The program--"LearningGames"--is designed to train caregivers to stimulate children's cognitive, language, and social-emotional…

Cases Not Proven: An Evaluation of Two Studies of Teacher Racism.

ERIC Educational Resources Information Center

Foster, Peter

1990-01-01

Evaluates two British ethnographic studies by Bruce Carrington and Edward Wood, and by Cecile Y. Wright claiming to find evidence of teachers' racist attitudes and behaviors toward Afro-Caribbean students that contributed to student underachievement. Delineates methodological flaws. Argues that Wright's findings that the source of racism is in…

Impact of study design on development and evaluation of an activity-type classifier.

PubMed

van Hees, Vincent T; Golubic, Rajna; Ekelund, Ulf; Brage, Søren

2013-04-01

Methods to classify activity types are often evaluated with an experimental protocol involving prescribed physical activities under confined (laboratory) conditions, which may not reflect real-life conditions. The present study aims to evaluate how study design may impact on classifier performance in real life. Twenty-eight healthy participants (21-53 yr) were asked to wear nine triaxial accelerometers while performing 58 activity types selected to simulate activities in real life. For each sensor location, logistic classifiers were trained in subsets of up to 8 activities to distinguish between walking and nonwalking activities and were then evaluated in all 58 activities. Different weighting factors were used to convert the resulting confusion matrices into an estimation of the confusion matrix as would apply in the real-life setting by creating four different real-life scenarios, as well as one traditional laboratory scenario. The sensitivity of a classifier estimated with a traditional laboratory protocol is within the range of estimates derived from real-life scenarios for any body location. The specificity, however, was systematically overestimated by the traditional laboratory scenario. Walking time was systematically overestimated, except for lower back sensor data (range: 7-757%). In conclusion, classifier performance under confined conditions may not accurately reflect classifier performance in real life. Future studies that aim to evaluate activity classification methods are warranted to pay special attention to the representativeness of experimental conditions for real-life conditions.

Teaching community diagnosis to medical students: evaluation of a case study approach.

PubMed

Bair, C W

1980-01-01

A unique case study approach to training medical students in community diagnosis techniques was initiated at the Medical College of Ohio at Toledo. This paper describes the five elements of this teaching method: preliminary specification of target community and data base; group problem-solving requirement; specification of desired output; defined performance objectives; and regularly scheduled time for analysis. Experience with the case study method over two years was evaluated to identify specific strengths and weaknesses. The identified strengths include use of limited educational time to introduce community health problems, development of experience in a collegial team work setting, and specific awareness of the types of data useful to the analysis of community health service problems. Negative evaluations suggested that the method was not conducive to the development of skills in three areas: ability to establish the relative importance of health problems in communities; ability to identify an appropriate health system response to a community health problem from feasible alternatives; and ability to anticipate the community impact of health program modifications or improvements. Potential explanations for these deficiencies include: need for increased didactic support in the classroom for particular skill areas; need to establish a direct field experience in community diagnosis; inappropriateness of the data base used for evaluation of particular skills; and the probability that quantitative analysis, as used in this evaluation, may not be sufficient in and of itself to measure the outcome of a community diagnosis experience.

Case studies on clinical evaluation of biosimilar monoclonal antibody: scientific considerations for regulatory approval.

PubMed

Kudrin, Alex; Knezevic, Ivana; Joung, Jeewon; Kang, Hye-Na

2015-01-01

The objective of this paper is to provide considerations based on comprehensive case studies important for regulatory evaluation of monoclonal antibodies as similar biotherapeutic products (SBPs) with a special emphasis on clinical aspects. Scientific principles from WHO Guidelines on SBPs were used as a basis for the exercise. Working groups consisted of regulators, manufacturers and academia. The following topics were discussed by the working groups: clinical criteria for biosimilarity, extrapolation approach and the overall regulatory decision making process. In order to determine typical pitfalls in the design of a SBP clinical programme and evaluate the gap of knowledge, amongst different industry and regulatory stakeholders on the appraisal of the data arising from SBP clinical studies, we have presented two fictional but realistic clinical case studies. The first case consists of the fictional development programme for an infliximab SBP candidate. The second case describes clinical studies proposed for a fictional rituximab SBP candidate. In the first scenario a highly similar quality profile has been taken forward into clinical studies whereas there was an important residual difference in functional attributes for the rituximab SBP candidate. These case studies were presented at the WHO implementation workshop for the WHO guidelines on evaluation of similar biotherapeutic products held in Seoul, Republic of Korea, in May 2014. The goal was to illustrate the interpretation of the clinical data arising from studies with SBP candidates and elicit knowledge gaps in clinical assessment. This paper reflects the outcome of the exercise and discussions held in Seoul and offers an analysis of the case studies as a learning opportunity on clinical development and evaluation of SBPs. Copyright © 2014 The International Alliance for Biological Standardization. Published by Elsevier Ltd. All rights reserved.

Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist.

PubMed

Sepucha, Karen R; Abhyankar, Purva; Hoffman, Aubri S; Bekker, Hilary L; LeBlanc, Annie; Levin, Carrie A; Ropka, Mary; Shaffer, Victoria A; Sheridan, Stacey L; Stacey, Dawn; Stalmeier, Peep; Vo, Ha; Wills, Celia E; Thomson, Richard

2018-05-01

Patient decision aids (PDAs) are evidence-based tools designed to help patients make specific and deliberated choices among healthcare options. The International Patient Decision Aid Standards (IPDAS) Collaboration review papers and Cochrane systematic review of PDAs have found significant gaps in the reporting of evaluations of PDAs, including poor or limited reporting of PDA content, development methods and delivery. This study sought to develop and reach consensus on reporting guidelines to improve the quality of publications evaluating PDAs. An international workgroup, consisting of members from IPDAS Collaboration, followed established methods to develop reporting guidelines for PDA evaluation studies. This paper describes the results from three completed phases: (1) planning, (2) drafting and (3) consensus, which included a modified, two-stage, online international Delphi process. The work was conducted over 2 years with bimonthly conference calls and three in-person meetings. The workgroup used input from these phases to produce a final set of recommended items in the form of a checklist. The SUNDAE Checklist (Standards for UNiversal reporting of patient Decision Aid Evaluations) includes 26 items recommended for studies reporting evaluations of PDAs. In the two-stage Delphi process, 117/143 (82%) experts from 14 countries completed round 1 and 96/117 (82%) completed round 2. Respondents reached a high level of consensus on the importance of the items and indicated strong willingness to use the items when reporting PDA studies. The SUNDAE Checklist will help ensure that reports of PDA evaluation studies are understandable, transparent and of high quality. A separate Explanation and Elaboration publication provides additional details to support use of the checklist. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Graduate nursing students' evaluation of EBP courses: a cross-sectional study.

PubMed

Zelenikova, Renata; Beach, Michael; Ren, Dianxu; Wolff, Emily; Sherwood, Paula R

2015-01-01

There is a lack of appropriate tools for assessing the effectiveness of teaching evidence-based practice in nursing. The objective of the study was to develop the instrument evaluating the students' perception of the effectiveness of EBP courses and to verify its psychometric properties. A descriptive cross-sectional study design was used to verify psychometric properties of the questionnaire measuring the students' perception of the effectiveness of EBP courses. The psychometric properties were evaluated in a group of 129 graduate nursing students who completed EBP courses. The instrument for measuring the students' perception of the effectiveness of EBP courses was inspired by Kirkpatrick's evaluation model, which advocates evaluating interventions at four levels - reaction (satisfaction), learning, behavior change (transfer) and results (benefits). A web-based survey was used for data collection. Data was collected from the middle of January 2013 through the end of March 2013. A thirteen item instrument was developed for measuring the students' perception of the effectiveness of EBP courses. The internal consistency of the scale, based on standardized Cronbach's alpha, was .93. The results of factor analysis identified three factors of the instrument. The highest rated items on a scale of 1 (strongly disagree) to 7 (strongly agree) were 'implementation of EBP can improve clinical care' (mean 6.16), 'EBP instructors had a thorough knowledge of EBP' (6.13), 'EBP instructors were enthusiastic about teaching EBP' (5.65), and 'I can use my EBP knowledge and skills in my practice' (5.58). The results of testing of the psychometric properties of the questionnaire showed at least satisfactory validity and reliability. The majority of students perceived EBP courses as effective. The instrument may be used to assess the students' perception of the effectiveness of EBP courses. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of total workstation CT interpretation quality: a single-screen pilot study

NASA Astrophysics Data System (ADS)

Beard, David V.; Perry, John R.; Muller, Keith E.; Misra, Ram B.; Brown, P.; Hemminger, Bradley M.; Johnston, Richard E.; Mauro, J. Matthew; Jaques, P. F.; Schiebler, M.

1991-07-01

An interpretation report, generated with an electronic viewbox, is affected by two factors: image quality, which encompasses what can be seen on the display, and computer human interaction (CHI), which accounts for the cognitive load effect of locating, moving, and manipulating images with the workstation controls. While a number of subject experiments have considered image quality, only recently has the affect of CHI on total interpretation quality been measured. This paper presents the results of a pilot study conducted to evaluate the total interpretation quality of the FilmPlane2.2 radiology workstation for patient folders containing single forty-slice CT studies. First, radiologists interpreted cases and dictated reports using FilmPlane2.2. Requisition forms were provided. Film interpretation was provided by the original clinical report and interpretation forms generated from a previous experiment. Second, an evaluator developed a list of findings for each case based on those listed in all the reports for each case and then evaluated each report for its response on each finding. Third, the reports were compared to determine how well they agreed with one another. Interpretation speed and observation data was also gathered.

42 CFR 456.142 - UR plan requirements for medical care evaluation studies.

Code of Federal Regulations, 2010 CFR

2010-10-01

... evaluation studies. (a) The UR plan must describe the methods that the committee uses to select and conduct... needed to— (i) Correct or investigate further any deficiencies or problems in the review process for...

Study on index system of GPS interference effect evaluation

NASA Astrophysics Data System (ADS)

Zhang, Kun; Zeng, Fangling; Zhao, Yuan; Zeng, Ruiqi

2018-05-01

Satellite navigation interference effect evaluation is the key technology to break through the research of Navigation countermeasure. To evaluate accurately the interference degree and Anti-jamming ability of GPS receiver, this text based on the existing research results of Navigation interference effect evaluation, build the index system of GPS receiver effectiveness evaluation from four levels of signal acquisition, tracking, demodulation and positioning/timing and establish the model for each index. These indexes can accurately and quantitatively describe the interference effect at all levels.

38 CFR 1.17 - Evaluation of studies relating to health effects of radiation exposure.

Code of Federal Regulations, 2012 CFR

2012-07-01

... health effects of radiation exposure. (a) From time to time, the Secretary shall publish evaluations of... paragraph a valid study is one which: (i) Has adequately described the study design and methods of data... studies affecting epidemiological assessments including case series, correlational studies and studies...

38 CFR 1.17 - Evaluation of studies relating to health effects of radiation exposure.

Code of Federal Regulations, 2013 CFR

2013-07-01

... health effects of radiation exposure. (a) From time to time, the Secretary shall publish evaluations of... paragraph a valid study is one which: (i) Has adequately described the study design and methods of data... studies affecting epidemiological assessments including case series, correlational studies and studies...

38 CFR 1.17 - Evaluation of studies relating to health effects of radiation exposure.

Code of Federal Regulations, 2014 CFR

2014-07-01

... health effects of radiation exposure. (a) From time to time, the Secretary shall publish evaluations of... paragraph a valid study is one which: (i) Has adequately described the study design and methods of data... studies affecting epidemiological assessments including case series, correlational studies and studies...

38 CFR 1.17 - Evaluation of studies relating to health effects of radiation exposure.

Code of Federal Regulations, 2010 CFR

2010-07-01

... health effects of radiation exposure. (a) From time to time, the Secretary shall publish evaluations of... paragraph a valid study is one which: (i) Has adequately described the study design and methods of data... studies affecting epidemiological assessments including case series, correlational studies and studies...

38 CFR 1.17 - Evaluation of studies relating to health effects of radiation exposure.

Code of Federal Regulations, 2011 CFR

2011-07-01

... health effects of radiation exposure. (a) From time to time, the Secretary shall publish evaluations of... paragraph a valid study is one which: (i) Has adequately described the study design and methods of data... studies affecting epidemiological assessments including case series, correlational studies and studies...

Quantitative evaluation of the memory bias effect in ROC studies with PET/CT

NASA Astrophysics Data System (ADS)

Kallergi, Maria; Pianou, Nicoletta; Georgakopoulos, Alexandros; Kafiri, Georgia; Pavlou, Spiros; Chatziioannou, Sofia

2012-02-01

PURPOSE. The purpose of the study was to evaluate the memory bias effect in ROC experiments with tomographic data and, specifically, in the evaluation of two different PET/CT protocols for the detection and diagnosis of recurrent thyroid cancer. MATERIALS AND METHODS. Two readers participated in an ROC experiment that evaluated tomographic images from 43 patients followed up for thyroid cancer recurrence. Readers evaluated first whole body PET/CT scans of the patients and then a combination of whole body and high-resolution head and neck scans of the same patients. The second set was read twice. Once within 48 hours of the first set and the second time at least a month later. The detection and diagnostic performances of the readers in the three reading sessions were assessed with the DBMMRMC and LABMRMC software using the area under the ROC curve as a performance index. Performances were also evaluated by comparing the number and the size of the detected abnormal foci among the three readings. RESULTS. There was no performance difference between first and second treatments. There were statistically significant differences between first and third, and second and third treatments showing that memory can seriously affect the outcome of ROC studies. CONCLUSION. Despite the fact that tomographic data involve numerous image slices per patient, the memory bias effect is present and substantial and should be carefully eliminated from analogous ROC experiments.

The evolution of an evaluation: a case study using the tribal participatory research model.

PubMed

Richmond, Lucinda S; Peterson, Donna J; Betts, Sherry C

2008-10-01

This article presents a case study of how the evaluation design for a dating violence prevention and/or youth development program for American Indian youth in Arizona evolved throughout the project. Particular attention is given to how the evaluation design was guided by the tribal participatory research model. A brief rationale for the project is presented along with literature on culturally competent evaluation and research with American Indians. A description of the project and the unique communities in which it was implemented is provided. The focus of the article is the process of how the evaluation plan changed and how various factors influenced this process (e.g., feedback from community stakeholders, conversations with funder, results of process evaluation, suggestions from literature, the authors' experience working in American Indian communities). The authors conclude with lessons learned for others to consider as they develop working relationships and evaluation plans in similar communities.

An Evaluative Study of Clinical Preceptorship.

ERIC Educational Resources Information Center

Kaviani, Nayer; Stillwell, Yvonne

2000-01-01

A training institute to prepare nurses to serve as preceptors of undergraduate clinical experience was evaluated by focus groups of 6 preceptors, 13 students, and 2 nurse managers. Formal preceptorship training enhanced student learning and promoted positive relationships between nurse educators and practitioners. (SK)

Educational technology "Anatomy and Vital Signs": Evaluation study of content, appearance and usability.

PubMed

de Góes, Fernanda dos Santos Nogueira; Fonseca, Luciana Mara Monti; de Camargo, Rosangela Andrade Aukar; de Oliveira, Gustavo Faria; Felipe, Helena Reche

2015-11-01

The use of new technology has recently grown considerably as an increasing number of college students using Internet. In nursing education, the personal computer and the Internet facilitate teaching theoretical and practical knowledge. Evaluate an educational technology known as "Anatomy and Vital Signs" with respect to content, appearance and usability. This was a first stage evaluation-by specialists to verify content and functioning, prior to a second validation as to learning by students. A methodological study in which instructional technologists (11 participants) and nursing specialists (17 participants) used the technology in an unguided manner and completed three questionnaires. The evaluation was measured by the difference between disagreement and agreement for each statement in the questionnaires. Most of the items were positively evaluated at a level higher than 70% by most of the evaluators except for the following usability criteria: grouping by shape, minimum actions and user control, which did not attain the 70% agreement level among instructional technologists. The evaluation was useful to improve the technology and guarantee suitable product for nursing education. It may be a reliable educational tool for nursing education that applies technological resources. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Using program evaluation to support knowledge translation in an interprofessional primary care team: a case study.

PubMed

Donnelly, Catherine; Shulha, Lyn; Klinger, Don; Letts, Lori

2016-10-06

Evaluation is a fundamental component in building quality primary care and is ideally situated to support individual, team and organizational learning by offering an accessible form of participatory inquiry. The evaluation literature has begun to recognize the unique features of KT evaluations and has described attributes to consider when evaluating KT activities. While both disciplines have focused on the evaluation of KT activities neither has explored the role of evaluation in KT. The purpose of the paper is to examine how participation in program evaluation can support KT in a primary care setting. A mixed methods case study design was used, where evaluation was conceptualized as a change process and intervention. A Memory Clinic at an interprofessional primary care clinic was the setting in which the study was conducted. An evaluation framework, Pathways of Influence provided the theoretical foundation to understand how program evaluation can facilitate the translation of knowledge at the level of the individual, inter-personal (Memory Clinic team) and the organization. Data collection included questionnaires, interviews, evaluation log and document analysis. Questionnaires and interviews were administered both before and after the evaluation: Pattern matching was used to analyze the data based on predetermined propositions. Individuals gained program knowledge that resulted in changes to both individual and program practices. One of the key themes was the importance clinicians placed on local, program based knowledge. The evaluation had less influence on the broader health organization. Program evaluation facilitated individual, team and organizational learning. The use of evaluation to support KT is ideally suited to a primary care setting by offering relevant and applicable knowledge to primary care team members while being sensitive to local context.

Evaluation Study of a Wireless Multimedia Traffic-Oriented Network Model

NASA Astrophysics Data System (ADS)

Vasiliadis, D. C.; Rizos, G. E.; Vassilakis, C.

2008-11-01

In this paper, a wireless multimedia traffic-oriented network scheme over a fourth generation system (4-G) is presented and analyzed. We conducted an extensive evaluation study for various mobility configurations in order to incorporate the behavior of the IEEE 802.11b standard over a test-bed wireless multimedia network model. In this context, the Quality of Services (QoS) over this network is vital for providing a reliable high-bandwidth platform for data-intensive sources like video streaming. Therefore, the main issues concerned in terms of QoS were the metrics for bandwidth of both dropped and lost packets and their mean packet delay under various traffic conditions. Finally, we used a generic distance-vector routing protocol which was based on an implementation of Distributed Bellman-Ford algorithm. The performance of the test-bed network model has been evaluated by using the simulation environment of NS-2.

Evaluation of College Reading and Study Skills Programs; Problems and Approaches.

ERIC Educational Resources Information Center

Anderson, William W.

The purpose of this paper was to bring together some of the most outstanding and significant research in recent years relating to the problems of evaluating college reading and study skills programs and the corresponding prospects and implications for improvement. The sections of the paper include: "Criterion Measures of Program Success," which is…

Treatability studies performed in support of an engineering evaluation/cost analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Myers, J.M.; Mueller, J.P.; Sundquist, J.A.

1995-12-31

The Southern Shipbuilding Corporation (SSC) site is located on 54 acres of wooded land adjacent to Bayou Bonfouca, approximately 1.8 miles downstream of the Bayou Bonfouca National Priorities List (NPL) Superfund site in Slidell, St. Tammany Parish, Louisiana. Two one-acre, impoundments on the SSC site were used to store wastes generated from vessel cleaning. Wastes stored in the impoundments are migrating into Bayou Bonfouca, which empties into Lake Pontchartrain. In addition, the impoundments are frequently invaded by flood waters. The US EPA Emergency Response Branch (EPA-ERB) performed a site investigation which indicated that the majority of the contamination is petroleum-relatedmore » and that the compounds of concern are polycyclic aromatic hydrocarbons (PARs). The wastes are generally contained with the two impoundments and surrounding soils. As part of an Engineering Evaluation/Cost Basis (EE/CA) of potential response action alternatives, four treatability studies were performed. A thermal treatment (incineration) study was performed at the EPA`s Incineration Research Facility (IRF). Biodegradation remedy selection feasibility assessment was conducted on-site. A remedy screening soil washing study was also performed by TAT. A solidification/stabilization (S/S) study was conducted through EPA`s Risk Reduction Engineering Laboratory (RREL) to ascertain if the PAHs could be immobilized within a solid matrix. Experimental objectives, dead methodology and conclusions for these studies are presented as they relate to potential response actions being evaluated at the SSC site.« less

The Turkish Version of Web-Based Learning Platform Evaluation Scale: Reliability and Validity Study

ERIC Educational Resources Information Center

Dag, Funda

2016-01-01

The purpose of this study is to determine the language equivalence and the validity and reliability of the Turkish version of the "Web-Based Learning Platform Evaluation Scale" ("Web Tabanli Ögrenme Ortami Degerlendirme Ölçegi" [WTÖODÖ]) used in the selection and evaluation of web-based learning environments. Within this scope,…

Impact of Pregnancy and Gender on Internal Medicine Resident Evaluations: A Retrospective Cohort Study.

PubMed

Krause, Megan L; Elrashidi, Muhamad Y; Halvorsen, Andrew J; McDonald, Furman S; Oxentenko, Amy S

2017-06-01

Pregnancy and its impact on graduate medical training are not well understood. To examine the effect of gender and pregnancy for Internal Medicine (IM) residents on evaluations by peers and faculty. This was a retrospective cohort study. All IM residents in training from July 1, 2004-June 30, 2014, were included. Female residents who experienced pregnancy and male residents whose partners experienced pregnancy during training were identified using an existing administrative database. Mean evaluation scores by faculty and peers were compared relative to pregnancy (before, during, and after), accounting for the gender of both the evaluator and resident in addition to other available demographic covariates. Potential associations were assessed using mixed linear models. Of 566 residents, 117 (20.7%) experienced pregnancy during IM residency training. Pregnancy was more common in partners of male residents (24.7%) than female residents (13.2%) (p = 0.002). In the post-partum period, female residents had lower peer evaluation scores on average than their male counterparts (p = 0.0099). A large number of residents experience pregnancy during residency. Mean peer evaluation scores were lower after pregnancy for female residents. Further study is needed to fully understand the mechanisms behind these findings, develop ways to optimize training throughout pregnancy, and explore any unconscious biases that may exist.

Educator Evaluation: A Case Study of Massachusetts' Approach

ERIC Educational Resources Information Center

Brown, Catherine; Partelow, Lisette; Konoske-Graf, Annette

2016-01-01

There has been a sea change in teacher evaluation over the past eight years. Inspired in part by President Barack Obama's policies, schools have instituted teacher evaluation systems that include multiple measures of teacher impact. Model systems are aligned to systems of continuous improvement, helping teachers identify areas of weakness in their…

A STUDY TO EVALUATE THE LEVELS OF DIOXIN-LIKE ...

EPA Pesticide Factsheets

The Environmental Protection Agency (EPA), in cooperation with USDA and the US Food and Drug Administration (FDA), has undertaken a program to study the presence of dioxin-like compounds in animal feeds. Two phases of this program have been completed, and this paper reports on the third phase. The first phase was a study on the mass balance of dioxins in lactating cows. The objective of that study was to quantify the role feeds play in total dairy cow exposures. The second phase of the program involved the collections and measurement of dioxins in minor feed components. Dioxins in specific targeted animal feed components of interest, including animal and plant byproducts were measured. The third phase involved sampling of total mixed dairy feeds and feed components from dairy facilities around the United States, and measuring for dioxin-like compounds. Lorber, M; Ferrario, J; Byrne, C; Greene, C; Cyrus, A. 2004. A Study to Evaluate the Levels of Dioxin-Like Compounds in Dairy Feeds in the United States. Organohalogen Compounds 66: 1958-1965. journal articles

The Evaluation of HRD: A Critical Study with Applications

ERIC Educational Resources Information Center

Tome, Eduardo

2009-01-01

Purpose: The purpose of this paper is to analyze critically the most important methods that are used in the evaluation of human resource development (HRD). Design/methodology/approach: The approach is to ask two questions: What are the methods available to define the impact of HRD in the economy? How can we evaluate the evaluations that have been…

Competence evaluation processes for nursing students abroad: Findings from an international case study.

PubMed

Tommasini, Cristina; Dobrowolska, Beata; Zarzycka, Danuta; Bacatum, Claudia; Bruun, Anne Marie Gran; Korsath, Dag; Roel, Siv; Jansen, Mette Bro; Milling, Tine; Deschamps, Anne; Mantzoukas, Stefanos; Mantzouka, Christine; Palese, Alvisa

2017-04-01

Assessing clinical competence in nursing students abroad is a challenge, and requires both methods and instruments capable of capturing the multidimensional nature of the clinical competences acquired. The aim of the study was to compare the clinical competence assessment processes and instruments adopted for nursing students during their clinical placement abroad. A case study design was adopted in 2015. A purposeful sample of eight nursing programmes located in seven countries (Belgium, Denmark, Greece, Norway, Poland, Portugal and Italy) were approached. Tools as instruments for evaluating competences developed in clinical training by international nursing students, and written procedures aimed at guiding the evaluation process, were scrutinised through a content analysis method. All clinical competence evaluation procedures and instruments used in the nursing programmes involved were provided in English. A final evaluation of the competences was expected by all nursing programmes at the end of the clinical placement, while only four provided an intermediate evaluation. Great variability emerged in the tools, with between five and 88 items included. Through content analysis, 196 items emerged, classified into 12 different core competence categories, the majority were categorised as 'Technical skills' (=60), 'Self-learning and critical thinking' (=27) and 'Nursing care process' (=25) competences. Little emphasis was given in the tools to competences involving 'Self-adaptation', 'Inter-professional skills', 'Clinical documentation', 'Managing nursing care', 'Patient communication', and 'Theory and practice integration'. Institutions signing Bilateral Agreements should agree upon the competences expected from students during their clinical education abroad. The tools used in the process, as well as the role expected by the student, should also be agreed upon. Intercultural competences should be further addressed in the process of evaluation, in addition to

Combat Identification Systems COMO Integrated Air Defense Model Evaluation (CISE) Study

DTIC Science & Technology

1989-02-01

use K or IR , whichever one applies) E-6 CAA-SR-89- 3 Subroutine PDECLR 1/21/88 Before label 1000 Insert: IF (IR.GT.10) IR a 10 These changes were made...Internal Distribution: Unclassified Library 2 F-2 CAA-SR-89- 3 GLOSSARY 1. ABBREVIATIONS, ACRONYMS, AND SHORT TERMS ADM2 Air Defense Models Modification...STUDY REPORT ’ , CAA-Sn-89- 3 i , .- CD o COMBAT IDENTIFICATION SYSTEMS N COMO INTEGRATED AIR DEFENSE MODEL EVALUATION (CISE) STUDY FEBRUARY 1989

Evaluating the abuse potential of opioids and abuse-deterrent -opioid formulations: A review of clinical study methodology.

PubMed

Setnik, Beatrice; Schoedel, Kerri A; Levy-Cooperman, Naama; Shram, Megan; Pixton, Glenn C; Roland, Carl L

With the development of opioid abuse-deterrent formulations (ADFs), there is a need to conduct well-designed human abuse potential studies to evaluate the effectiveness of their deterrent properties. Although these types of studies have been conducted for many years, largely to evaluate inherent abuse potential of a molecule and inform drug scheduling, methodological approaches have varied across studies. The focus of this review is to describe current "best practices" and methodological adaptations required to assess abuse-deterrent opioid formulations for regulatory submissions. A literature search was conducted in PubMed® to review methodological approaches (study conduct and analysis) used in opioid human abuse potential studies. Search terms included a combination of "opioid," "opiate," "abuse potential," "abuse liability," "liking," AND "pharmacodynamic," and only studies that evaluated single doses of opioids in healthy, nondependent individuals with or without prior opioid experience were included. Seventy-one human abuse potential studies meeting the prespecified criteria were identified, of which 21 studies evaluated a purported opioid ADF. Based on these studies, key methodological considerations were reviewed and summarized according to participant demographics, study prequalification, comparator and dose selection, route of administration and drug manipulation, study blinding, outcome measures and training, safety, and statistical analyses. The authors recommend careful consideration of key elements (eg, a standardized definition of a "nondependent recreational user"), as applicable, and offer key principles and "best practices" when conducting human abuse potential studies for opioid ADFs. Careful selection of appropriate study conditions is dependent on the type of ADF technology being evaluated.

A synthesis study of noncontact nondestructive evaluation of top-down cracking in asphalt pavements.

DOT National Transportation Integrated Search

2013-12-01

The primary objective of this research study was to conduct an extensive literature review on top-down : cracking evaluation studies, prepare a synthesis of findings, and recommend a follow up phase for a : pilot study in Mississippi with a candidate...

[The external evaluation of study quality: the role in maintaining the reliability of laboratory information].

PubMed

Men'shikov, V V

2013-08-01

The external evaluation of quality of clinical laboratory examinations was gradually introduced in USSR medical laboratories since 1970s. In Russia, in the middle of 1990 a unified all-national system of external evaluation quality was organized known as the Federal center of external evaluation of quality at the basis of laboratory of the state research center of preventive medicine. The main positions of policy in this area were neatly formulated in the guidance documents of ministry of Health. Nowadays, the center of external evaluation of quality proposes 100 and more types of control studies and permanently extends their specter starting from interests of different disciplines of clinical medicine. The consistent participation of laboratories in the cycles of external evaluation of quality intrinsically promotes improvement of indicators of properness and precision of analysis results and increases reliability of laboratory information. However, a significant percentage of laboratories does not participate at all in external evaluation of quality or takes part in control process irregularly and in limited number of tests. The managers of a number of medical organizations disregard the application of the proposed possibilities to increase reliability of laboratory information and limit financing of studies in the field of quality control. The article proposes to adopt the national standard on the basis of ISO 17043 "Evaluation of compliance. The common requirements of professional competence testing".

Clinical evaluation study of the German network of disorders of sex development (DSD)/intersexuality: study design, description of the study population, and data quality

PubMed Central

Lux, Anke; Kropf, Siegfried; Kleinemeier, Eva; Jürgensen, Martina; Thyen, Ute

2009-01-01

Background The German Network of Disorders of Sex Development (DSD)/Intersexuality carried out a large scale clinical evaluation study on quality of life, gender identity, treatment satisfaction, coping, and problems associated with diagnoses and therapies in individuals with disorders of sex development (DSD). DSD are a heterogeneous group of various genetic disorders of sex determination or sex differentiation, all of which are rare conditions. In about half of all cases the molecular genetic diagnosis is unknown and diagnosis rests on clinical features. Methods and design The multi-centre clinical evaluation study includes short-term follow-up in some and cross-sectional assessments in all age and diagnostic groups fitting the criteria of DSD. Recruitment was from January 2005 until December 2007 in whole Germany and, additionally, in 2007 in Austria and German-speaking Switzerland. The study consists of a psychosocial inquiry for children, adolescents and their parents, and adults with standardized instruments and the collection of DSD-specific medical data by the attending physician. The main goal was the description of clinical outcomes and the health-care situation of individuals with DSD using a broad generic definition of DSD including all conditions with a mismatch of chromosomal, gonadal and phenotypical sex. 439 children and adolescents, their parents and adults with DSD participated. Discussion The clinical evaluation study represents the most comprehensive study in this clinical field. The paper discusses the study protocol, the data management and data quality as well as the classification used, and it describes the study population. Given the lack of large datasets in rare conditions such as DSD and often biased results from small scale clinical case series, the study aims to generate concrete hypotheses for evidence-based guidelines, which should be tested in further studies. PMID:19383134

Policy evaluation for a bus-based transit system: the case study of Busan, Korea

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lew, K.S.

This study considers a quite specific set of dimensions of transit evaluation as a comprehensive management-strategy approach for addressing the ongoing problems of urban public transit systems and apply them in a case study. With increasing difficulties in providing effective public transportation, attention in this study was placed on providing for the movement of people in an efficient and equitable manner. This study was therefore concerned with just identifying and evaluating policy options that are feasible within the socio-economic and political context of the Busan metropolitan area and, in particular, how the criteria of efficiency and equity can best bemore » achieved by implementing transit policy alternatives. In the absence of long-run major public investment in urban transportation, the criteria of both efficiency and equity can only be furthered through managerial strategies applied within a systematic evaluative framework. By emphasizing the planning, operational, and managerial considerations of fixed-route bus transit in Busan, it has been acknowledged that efficient and equitable public transportation can be provided through a variety of social, economic, political, and institutional arrangements that are possible to apply from a policy viewpoint in the immediate future.« less

Innovative nuclear thermal propulsion technology evaluation - Results of the NASA/DOE task team study

NASA Technical Reports Server (NTRS)

Howe, Steven D.; Borowski, Stanley; Motloch, Chet; Helms, Ira; Diaz, Nils; Anghaie, Samim; Latham, Thomas

1991-01-01

In response to findings from two NASA/DOE nuclear propulsion workshops, six task teams were created to continue evaluation of various propulsion concepts, from which evolved an innovative concepts subpanel to evaluate thermal propulsion concepts which did not utilize solid fuel. This subpanel endeavored to evaluate each concept on a level technology basis, and to identify critical issues, technologies, and early proof-of-concept experiments. Results of the concept studies including the liquid core fission, the gas core fission, the fission foil reactors, explosively driven systems, fusion, and antimatter are presented.

Part-Time Faculty Evaluation: A Campus Case Study.

ERIC Educational Resources Information Center

Williams, James P.

For the past 13 years, the Verde Valley Campus of Yavapai College, in Arizona, has used the same system to evaluate part-time faculty in an effort to both maintain quality control and provide feedback to part-time faculty and address their concerns. The system utilizes two instruments to gather evaluative data. The first is used to determine…

Use of a structured functional evaluation process for independent medical evaluations of claimants presenting with disabling mental illness: rationale and design for a multi-center reliability study.

PubMed

Bachmann, Monica; de Boer, Wout; Schandelmaier, Stefan; Leibold, Andrea; Marelli, Renato; Jeger, Joerg; Hoffmann-Richter, Ulrike; Mager, Ralph; Schaad, Heinz; Zumbrunn, Thomas; Vogel, Nicole; Bänziger, Oskar; Busse, Jason W; Fischer, Katrin; Kunz, Regina

2016-07-29

Work capacity evaluations by independent medical experts are widely used to inform insurers whether injured or ill workers are capable of engaging in competitive employment. In many countries, evaluation processes lack a clearly structured approach, standardized instruments, and an explicit focus on claimants' functional abilities. Evaluation of subjective complaints, such as mental illness, present additional challenges in the determination of work capacity. We have therefore developed a process for functional evaluation of claimants with mental disorders which complements usual psychiatric evaluation. Here we report the design of a study to measure the reliability of our approach in determining work capacity among patients with mental illness applying for disability benefits. We will conduct a multi-center reliability study, in which 20 psychiatrists trained in our functional evaluation process will assess 30 claimants presenting with mental illness for eligibility to receive disability benefits [Reliability of Functional Evaluation in Psychiatry, RELY-study]. The functional evaluation process entails a five-step structured interview and a reporting instrument (Instrument of Functional Assessment in Psychiatry [IFAP]) to document the severity of work-related functional limitations. We will videotape all evaluations which will be viewed by three psychiatrists who will independently rate claimants' functional limitations. Our primary outcome measure is the evaluation of claimant's work capacity as a percentage (0 to 100 %), and our secondary outcomes are the 12 mental functions and 13 functional capacities assessed by the IFAP-instrument. Inter-rater reliability of four psychiatric experts will be explored using multilevel models to estimate the intraclass correlation coefficient (ICC). Additional analyses include subgroups according to mental disorder, the typicality of claimants, and claimant perceived fairness of the assessment process. We hypothesize that a

Evaluating the Effectiveness of Remedial Reading Courses at Community Colleges: A Quantitative Study

ERIC Educational Resources Information Center

Lavonier, Nicole

2014-01-01

The present study evaluated the effectiveness of two instructional approaches for remedial reading courses at a community college. The instructional approaches were strategic reading and traditional, textbook-based instruction. The two research questions that guided the quantitative, quasi-experimental study were: (a) what is the effect of…

Challenges in evaluating cancer as a clinical outcome in postapproval studies of drug safety

PubMed Central

Pinheiro, Simone P.; Rivera, Donna R.; Graham, David J.; Freedman, Andrew N.; Major, Jacqueline M.; Penberthy, Lynne; Levenson, Mark; Bradley, Marie C.; Wong, Hui-Lee; Ouellet-Hellstrom, Rita

2017-01-01

Pharmaceuticals approved in the United States are largely not known human carcinogens. However, cancer signals associated with pharmaceuticals may be hypothesized or arise after product approval. There are many study designs that can be used to evaluate cancer as an outcome in the postapproval setting. Because prospective systematic collection of cancer outcomes from a large number of individuals may be lengthy, expensive, and challenging, leveraging data from large existing databases are an integral approach. Such studies have the capability to evaluate the clinical experience of a large number of individuals, yet there are unique methodological challenges involved in their use to evaluate cancer outcomes. To discuss methodological challenges and potential solutions, the Food and Drug Administration and the National Cancer Institute convened a two-day public meeting in 2014. This commentary summarizes the most salient issues discussed at the meeting. PMID:27663208

The evaluation of complex interventions in palliative care: an exploration of the potential of case study research strategies.

PubMed

Walshe, Catherine

2011-12-01

Complex, incrementally changing, context dependent and variable palliative care services are difficult to evaluate. Case study research strategies may have potential to contribute to evaluating such complex interventions, and to develop this field of evaluation research. This paper explores definitions of case study (as a unit of study, a process, and a product) and examines the features of case study research strategies which are thought to confer benefits for the evaluation of complex interventions in palliative care settings. Ten features of case study that are thought to be beneficial in evaluating complex interventions in palliative care are discussed, drawing from exemplars of research in this field. Important features are related to a longitudinal approach, triangulation, purposive instance selection, comprehensive approach, multiple data sources, flexibility, concurrent data collection and analysis, search for proving-disproving evidence, pattern matching techniques and an engaging narrative. The limitations of case study approaches are discussed including the potential for subjectivity and their complex, time consuming and potentially expensive nature. Case study research strategies have great potential in evaluating complex interventions in palliative care settings. Three key features need to be exploited to develop this field: case selection, longitudinal designs, and the use of rival hypotheses. In particular, case study should be used in situations where there is interplay and interdependency between the intervention and its context, such that it is difficult to define or find relevant comparisons.

Evaluation Studies of the DEN-2/S-1 Vaccine.

DTIC Science & Technology

1981-08-01

1.0 3.0, L o 1 .0 I11 125 11111 1.4 n .6_t _ MICROCOPY RESOLUTION TEST CHART NATIONAL WII ALI 0 MF S’ANDAkLT, ,’I, A ;40- AD EVALUATION STUDIES OF THE...monkeys Vaccination DEN-2/S-l Vaccine /AE TlhACT ( i - ,ewr e e1 If .,ceweu7 amd Iderdtlfy by block number) A dengue-2 live virus vaccine was tested in...viremia was detected in control animals. Serological tests were pi.r- formed on sera taken on post infection days 30,56 and 90. HI tests revealed sero

Use and Non-use of Evaluation Results: Case Study of Environmental Influences in the Private Sector.

ERIC Educational Resources Information Center

Russ-Eft, Darlene; Atwood, Regina; Egherman, Tori

2002-01-01

Studied the evaluation of a sale program within a business services organization. Interviewed 23 sales people, 10 implementation specialists, 9 consultants, and 40 clients of the business. Results show the use and nonuse of evaluation results and point out the factors contributing to use or nonuse of evaluation results in this private sector…

A dose error evaluation study for 4D dose calculations

NASA Astrophysics Data System (ADS)

Milz, Stefan; Wilkens, Jan J.; Ullrich, Wolfgang

2014-10-01

Previous studies have shown that respiration induced motion is not negligible for Stereotactic Body Radiation Therapy. The intrafractional breathing induced motion influences the delivered dose distribution on the underlying patient geometry such as the lung or the abdomen. If a static geometry is used, a planning process for these indications does not represent the entire dynamic process. The quality of a full 4D dose calculation approach depends on the dose coordinate transformation process between deformable geometries. This article provides an evaluation study that introduces an advanced method to verify the quality of numerical dose transformation generated by four different algorithms. The used transformation metric value is based on the deviation of the dose mass histogram (DMH) and the mean dose throughout dose transformation. The study compares the results of four algorithms. In general, two elementary approaches are used: dose mapping and energy transformation. Dose interpolation (DIM) and an advanced concept, so called divergent dose mapping model (dDMM), are used for dose mapping. The algorithms are compared to the basic energy transformation model (bETM) and the energy mass congruent mapping (EMCM). For evaluation 900 small sample regions of interest (ROI) are generated inside an exemplary lung geometry (4DCT). A homogeneous fluence distribution is assumed for dose calculation inside the ROIs. The dose transformations are performed with the four different algorithms. The study investigates the DMH-metric and the mean dose metric for different scenarios (voxel sizes: 8 mm, 4 mm, 2 mm, 1 mm 9 different breathing phases). dDMM achieves the best transformation accuracy in all measured test cases with 3-5% lower errors than the other models. The results of dDMM are reasonable and most efficient in this study, although the model is simple and easy to implement. The EMCM model also achieved suitable results, but the approach requires a more complex

A dose error evaluation study for 4D dose calculations.

PubMed

Milz, Stefan; Wilkens, Jan J; Ullrich, Wolfgang

2014-11-07

Previous studies have shown that respiration induced motion is not negligible for Stereotactic Body Radiation Therapy. The intrafractional breathing induced motion influences the delivered dose distribution on the underlying patient geometry such as the lung or the abdomen. If a static geometry is used, a planning process for these indications does not represent the entire dynamic process. The quality of a full 4D dose calculation approach depends on the dose coordinate transformation process between deformable geometries. This article provides an evaluation study that introduces an advanced method to verify the quality of numerical dose transformation generated by four different algorithms.The used transformation metric value is based on the deviation of the dose mass histogram (DMH) and the mean dose throughout dose transformation. The study compares the results of four algorithms. In general, two elementary approaches are used: dose mapping and energy transformation. Dose interpolation (DIM) and an advanced concept, so called divergent dose mapping model (dDMM), are used for dose mapping. The algorithms are compared to the basic energy transformation model (bETM) and the energy mass congruent mapping (EMCM). For evaluation 900 small sample regions of interest (ROI) are generated inside an exemplary lung geometry (4DCT). A homogeneous fluence distribution is assumed for dose calculation inside the ROIs. The dose transformations are performed with the four different algorithms.The study investigates the DMH-metric and the mean dose metric for different scenarios (voxel sizes: 8 mm, 4 mm, 2 mm, 1 mm; 9 different breathing phases). dDMM achieves the best transformation accuracy in all measured test cases with 3-5% lower errors than the other models. The results of dDMM are reasonable and most efficient in this study, although the model is simple and easy to implement. The EMCM model also achieved suitable results, but the approach requires a more complex programming

Evaluation of Xerostomia in Different Psychological Disorders: An Observational Study

PubMed Central

Chandrappa, Pramod Redder; Patil, Snehal; Roodmal, Seema Yadav; Kumarswamy, Akshay; Chappi, Mounesh Kumar

2016-01-01

Introduction Psychiatric diseases like anxiety, depression, schizophrenia and bipolar disorders are increasing at an alarming rate. These diseases can affect the quantity and quality of saliva leading to multiple oral diseases. Although many researchers have evaluated xerostomia in general population, its prevalence is not been assessed in patients suffering from different psychological disorders. Aim To investigate the prevalence of xerostomia and to assess the correlation between xerostomia and dryness of lip and mucosa in different psychological disorders. Materials and Methods A cross-sectional observational study was conducted over a period of six months in Department of Psychiatry and Department of Oral Medicine. Patients with anxiety, depression, schizophrenia and bipolar disorder, as diagnosed by an experienced psychiatrist, were given a questionnaire to evaluate the xerostomia. Patients with symptoms of xerostomia were subjected to oral examination by a skilled oral diagnostician to check for dryness of lips and mucosa. One hundred patients from each group of psychiatric diseases were included in the study using a consecutive sampling technique. An equal number of healthy individuals reporting to oral medicine department for routine oral screening were included as control group after initial psychiatric evaluation. Results In this study statistically significant increase in the xerostomia in psychiatric patients was recorded when compared to the control group (p<0.01). Xerostomia was significantly higher in anxiety patients (51%) followed by depression (47%), bipolar disorder (41%), schizophrenia (39%) and control group (27%). The majority of the psychiatric patients had ‘moderate’ to ‘severe’ xerostomia whereas the control group had ‘mild’ xerostomia. Xerostomia was significantly higher in younger age group (18–49 years) than in older age group and females patients had higher xerostomia than male patients. Psychiatric patients had

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

PubMed

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design

Evaluation of Multiclass Model Observers in PET LROC Studies

NASA Astrophysics Data System (ADS)

Gifford, H. C.; Kinahan, P. E.; Lartizien, C.; King, M. A.

2007-02-01

A localization ROC (LROC) study was conducted to evaluate nonprewhitening matched-filter (NPW) and channelized NPW (CNPW) versions of a multiclass model observer as predictors of human tumor-detection performance with PET images. Target localization is explicitly performed by these model observers. Tumors were placed in the liver, lungs, and background soft tissue of a mathematical phantom, and the data simulation modeled a full-3D acquisition mode. Reconstructions were performed with the FORE+AWOSEM algorithm. The LROC study measured observer performance with 2D images consisting of either coronal, sagittal, or transverse views of the same set of cases. Versions of the CNPW observer based on two previously published difference-of-Gaussian channel models demonstrated good quantitative agreement with human observers. One interpretation of these results treats the CNPW observer as a channelized Hotelling observer with implicit internal noise

Relevance Judging, Evaluation, and Decision Making in Virtual Libraries: A Descriptive Study.

ERIC Educational Resources Information Center

Fitzgerald, Mary Ann; Galloway, Chad

2001-01-01

Describes a study that investigated the cognitive processes undergraduates used to select information while using a virtual library, GALILEO (Georgia Library Learning Online). Discusses higher order thinking processes, relevance judging, evaluation (critical thinking), decision making, reasoning involving documents, relevance-related reasoning,…

Evaluation of user perceptions and behaviors of Fast-Trac : pilot study results

DOT National Transportation Integrated Search

1996-01-01

The purpose of the User Perceptions and Behaviors evaluation component of FAST-TRAC is to understand how users perceive and value the in-vehicle navigation system, ALI-SCOUT, and to determine how the system is used in the Oakland County study area. S...

Clinical report--guidelines for the ethical conduct of studies to evaluate drugs in pediatric populations.

PubMed

Shaddy, Robert E; Denne, Scott C

2010-04-01

The proper ethical conduct of studies to evaluate drugs in children is of paramount importance to all those involved in these types of studies. This report is an updated revision to the previously published guidelines from the American Academy of Pediatrics in 1995. Since the previous publication, there have been great strides made in the science and ethics of studying drugs in children. There have also been numerous legislative and regulatory advancements that have promoted the study of drugs in children while simultaneously allowing for the protection of this particularly vulnerable group. This report summarizes these changes and advances and provides a framework from which to guide and monitor the ethical conduct of studies to evaluate drugs in children.

Using Case Studies to Promote Student Engagement in Primary Literature Data Analysis and Evaluation

PubMed Central

Cook-Snyder, Denise R.

2017-01-01

Analyzing and evaluating primary literature data is a common learning objective in undergraduate neuroscience courses. However, students with more clinically focused career goals often dismiss the relevance of evaluating basic neuroscience literature. Here, we describe using case studies to promote student engagement in primary literature in a cellular and molecular neuroscience course. Two example literature-based case studies are provided: Untwisting Pretzel Syndrome, a neurodevelopment case exploring synapse formation in a pretzel syndrome patient, and The Trials of ALS, a neurodegeneration case exploring axon degeneration and repair in an amyotrophic lateral sclerosis patient. These cases were assigned after neurodevelopment and neurodegeneration lectures covering key concepts. Both cases begin by introducing the patient and hypothesizing symptoms and diagnoses, followed by scenes incorporating primary data to illustrate disease pathogenesis and treatments. Students complete questions embedded in these cases as homework, and class time is used to discuss their answers. Discussion emphasizes that there can be multiple “correct” answers, and the best answers are accurate and well-supported. Accordingly, students edit their answers in class, and these annotations are factored into a pass/fail grade on the case. Additional scenes and questions from the same case studies are used on the course’s take-home exams, thereby allowing students to practice primary data analysis and evaluation before a graded assignment. Student evaluations support literature-based case studies as an effective learning tool, with students identifying cases as the most valuable aspect of the course, and reporting increased confidence in understanding cellular and molecular neuroscience. PMID:29371850

Using Case Studies to Promote Student Engagement in Primary Literature Data Analysis and Evaluation.

PubMed

Cook-Snyder, Denise R

2017-01-01

Analyzing and evaluating primary literature data is a common learning objective in undergraduate neuroscience courses. However, students with more clinically focused career goals often dismiss the relevance of evaluating basic neuroscience literature. Here, we describe using case studies to promote student engagement in primary literature in a cellular and molecular neuroscience course. Two example literature-based case studies are provided: Untwisting Pretzel Syndrome, a neurodevelopment case exploring synapse formation in a pretzel syndrome patient, and The Trials of ALS, a neurodegeneration case exploring axon degeneration and repair in an amyotrophic lateral sclerosis patient. These cases were assigned after neurodevelopment and neurodegeneration lectures covering key concepts. Both cases begin by introducing the patient and hypothesizing symptoms and diagnoses, followed by scenes incorporating primary data to illustrate disease pathogenesis and treatments. Students complete questions embedded in these cases as homework, and class time is used to discuss their answers. Discussion emphasizes that there can be multiple "correct" answers, and the best answers are accurate and well-supported. Accordingly, students edit their answers in class, and these annotations are factored into a pass/fail grade on the case. Additional scenes and questions from the same case studies are used on the course's take-home exams, thereby allowing students to practice primary data analysis and evaluation before a graded assignment. Student evaluations support literature-based case studies as an effective learning tool, with students identifying cases as the most valuable aspect of the course, and reporting increased confidence in understanding cellular and molecular neuroscience.

[Postgraduate studies in public health: the problem of efficiency evaluation].

PubMed

Boczkowski, Andrzej

2003-01-01

The satisfaction of customer is the main measure and the most important, generally recognized criterion for evaluating the quality of products and services. In the case of education and training, the quality is frequently understood as effectiveness, i.e., the degree to what educational objectives of a training institution are met; the objectives previously formulated on the basis of analyzed and defined demands and expectations of customers (clients). In the first part of the paper: (1) the problems related to the question who in fact is the customer in the context of an institution providing education in public health are discussed; (2) a proposal for resolving these problems is presented; and (3) the main directions of evaluation activities, which should be undertaken under monitoring and effectiveness assessment of postgraduate training in public health are pointed out. In the years 1998-2002, the students' assessment data on educational programs, curriculum contents and subject teachers in the field of postgraduate studies in the School of Public Health, Nofer Institute of Occupational Medicine, Łódź, were collected with the help of specially-designed evaluation questionnaires. The data on the students' self-assessment of gained professional competencies were also collected. All students who completed the School of Public Health in these years were subjected to the evaluation inquiries. The data collected were analyzed. Due to the analysis it was possible to define: the quality of the curriculum contents, as well as the professional and didactic skills of the teaching staff as perceived by the students; the degree to what particular curriculum in public health contributed to the increase in professional competence as perceived by the students; the degree to what particular teaching subjects influenced the students' knowledge of and skills in Public Health. The results obtained provided information very useful in the teaching process, designing of

An Interprofessional Program Evaluation Case Study: Utilizing Multiple Measures To Assess What Matters. AIR 1997 Annual Forum Paper.

ERIC Educational Resources Information Center

Delaney, Anne Marie

This paper reviews the first two years of a model program-evaluation case study which is intended to show: (1) how program evaluation can contribute to academic and professional degree programs; (2) how qualitative and quantitative techniques can be used to produce reliable measures for evaluation studies; and (3) how the role of the institutional…

Automated Plasma Spray (APS) process feasibility study: Plasma spray process development and evaluation

NASA Technical Reports Server (NTRS)

Fetheroff, C. W.; Derkacs, T.; Matay, I. M.

1979-01-01

An automated plasma spray (APS) process was developed to apply two layer (NiCrAlY and ZrO2-12Y2O3) thermal-barrier coatings to aircraft gas turbine engine blade airfoils. The APS process hardware consists of four subsystems: a mechanical blade positioner incorporating two interlaced six-degree-of-freedom assemblies; a noncoherent optical metrology subsystem; a microprocessor-based adaptive system controller; and commercial plasma spray equipment. Over fifty JT9D first stage turbine blades specimens were coated with the APS process in preliminary checkout and evaluation studies. The best of the preliminary specimens achieved an overall coating thickness uniformity of + or - 53 micrometers, much better than is achievable manually. Factors limiting this performance were identified and process modifications were initiated accordingly. Comparative evaluations of coating thickness uniformity for manually sprayed and APS coated specimens were initiated. One of the preliminary evaluation specimens was subjected to a torch test and metallographic evaluation.

Evaluation and perceived results of moral case deliberation: A mixed methods study.

PubMed

Janssens, Rien M J P A; van Zadelhoff, Ezra; van Loo, Ger; Widdershoven, Guy A M; Molewijk, Bert A C

2015-12-01

Moral case deliberation is increasingly becoming part of various Dutch healthcare organizations. Although some evaluation studies of moral case deliberation have been carried out, research into the results of moral case deliberation within aged care is scarce. How did participants evaluate moral case deliberation? What has moral case deliberation brought to them? What has moral case deliberation contributed to care practice? Should moral case deliberation be further implemented and, if so, how? Quantitative analysis of a questionnaire study among participants of moral case deliberation, both caregivers and team leaders. Qualitative analysis of written answers to open questions, interview study and focus group meetings among caregivers and team leaders. Caregivers and team leaders in a large organization for aged care in the Netherlands. A total of 61 moral case deliberation sessions, carried out on 16 care locations belonging to the organization, were evaluated and perceived results were assessed. Participants gave informed consent and anonymity was guaranteed. In the Netherlands, the law does not prescribe independent ethical review by an Institutional Review Board for this kind of research among healthcare professionals. Moral case deliberation was evaluated positively by the participants. Content and atmosphere of moral case deliberation received high scores, while organizational issues regarding the moral case deliberation sessions scored lower and merit further attention. Respondents indicated that moral case deliberation has the potential to contribute to care practice as relationships among team members improve, more openness is experienced and more understanding for different perspectives is fostered. If moral case deliberation is to be successfully implemented, top-down approaches should go hand in hand with bottom-up approaches. The relevance of moral case deliberation for care practice received wide acknowledgement from the respondents. It can contribute

Evaluating the Impact of an Environmental Education Programme: An Empirical Study in Mexico

ERIC Educational Resources Information Center

Ruiz-Mallen, Isabel; Barraza, Laura; Bodenhorn, Barbara; Reyes-Garcia, Victoria

2009-01-01

This study draws on information from 11 in-depth interviews, two focus groups and 72 written questionnaires to evaluate an extra-curricular environmental education programme on forestry designed for preparatory school students from a small rural community in Mexico. Specifically, the study assessed the impact of the programme on the ecological…

Evaluation of the personal development portfolio in higher education: an explorative study.

PubMed

Head, Kevin S; Johnston, Jacqueline H

2012-11-01

Personal Development Profiles (PDPs) have been an important and necessary feature of United Kingdom (UK) Higher Education for more than a decade. There is significant agreement as to their core purpose and their key features are of relevance to higher education institutions internationally, irrespective of whether an equivalent formal system or process is in place. The aim of this exploratory study was to evaluate the use of PDPs within a Child Health Nursing Programme in a UK University, looking at the experiences of both teaching staff and of students coming to the end of their three year programme of study. A convenience sample of final year pre-registration Child Health Nursing students and their lecturers was used for the purposes of this study with mixed methods of collection used to generate the required data. A survey was conducted with questionnaires. Following the analysis of the questionnaires, a discussion group was undertaken with the students. A series of questions was developed to guide this discussion. The structure offered by the system of PDPs evaluated here was seen to offer much in the way of potential value. Staff saw it as offering direction, a tool for discussion and a clear time and reason for meeting their students. Students similarly appreciated the structure it provided, but did describe it as somewhat repetitive. These findings were clearly of use in terms of evaluating this ongoing work, but also offer the potential to inform the work of other educational institutions. Copyright © 2011 Elsevier Ltd. All rights reserved.

Effects of medical therapy on insulin resistance and the cardiovascular system in polycystic ovary syndrome.

PubMed

Meyer, Caroline; McGrath, Barry P; Teede, Helena Jane

2007-03-01

We aimed to determine the impact of medical therapy for symptom management on insulin resistance, metabolic profiles, and surrogate markers of cardiovascular disease in polycystic ovary syndrome (PCOS), an insulin-resistant pre-diabetes condition. One hundred overweight women (BMI >27 kg/m2), average age 31 years, who were nonsmokers, were not pregnant, did not have diabetes, and were off relevant medications for 3 months completed this 6-month open-label controlled trial. Randomization was to a control group (higher-dose oral contraceptive [OCP] 35 microg ethinyl estradiol [EE]/2 mg cyproterone acetate, metformin [1 g b.d.] or low-dose OCP [20 microg EE/100 microg levonorgestrel + aldactone 50 mg b.d.]). Primary outcome measures were insulin resistance (area under curve on oral glucose tolerance test) and surrogate markers of cardiovascular disease including arterial stiffness (pulse wave velocity [PWV]) and endothelial function. All treatments similarly and significantly improved symptoms including hirsutism and menstrual cycle length. Insulin resistance was improved by metformin and worsened by the high-dose OCP. Arterial stiffness worsened in the higher-dose OCP group (PWV 7.46 vs. 8.03 m/s, P < 0.05), related primarily to the increased insulin resistance. In overweight women with PCOS, metformin and low- and high-dose OCP preparations have similar efficacy but differential effects on insulin resistance and arterial function. These findings suggest that a low-dose OCP preparation may be preferable if contraception is needed and that metformin should be considered for symptomatic management, particularly in women with additional metabolic and cardiovascular risk factors.

The International Endometriosis Evaluation Program (IEEP Study) - A Systematic Study for Physicians, Researchers and Patients.

PubMed

Burghaus, S; Fehm, T; Fasching, P A; Blum, S; Renner, S K; Baier, F; Brodkorb, T; Fahlbusch, C; Findeklee, S; Häberle, L; Heusinger, K; Hildebrandt, T; Lermann, J; Strahl, O; Tchartchian, G; Bojahr, B; Porn, A; Fleisch, M; Reicke, S; Füger, T; Hartung, C-P; Hackl, J; Beckmann, M W; Renner, S P

2016-08-01

Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers.

Challenges in evaluating cancer as a clinical outcome in postapproval studies of drug safety.

PubMed

Pinheiro, Simone P; Rivera, Donna R; Graham, David J; Freedman, Andrew N; Major, Jacqueline M; Penberthy, Lynne; Levenson, Mark; Bradley, Marie C; Wong, Hui-Lee; Ouellet-Hellstrom, Rita

2016-11-01

Pharmaceuticals approved in the United States are largely not known human carcinogens. However, cancer signals associated with pharmaceuticals may be hypothesized or arise after product approval. There are many study designs that can be used to evaluate cancer as an outcome in the postapproval setting. Because prospective systematic collection of cancer outcomes from a large number of individuals may be lengthy, expensive, and challenging, leveraging data from large existing databases are an integral approach. Such studies have the capability to evaluate the clinical experience of a large number of individuals, yet there are unique methodological challenges involved in their use to evaluate cancer outcomes. To discuss methodological challenges and potential solutions, the Food and Drug Administration and the National Cancer Institute convened a two-day public meeting in 2014. This commentary summarizes the most salient issues discussed at the meeting. Published by Elsevier Inc.

Development and evaluation of a study design typology for human research.

PubMed

Carini, Simona; Pollock, Brad H; Lehmann, Harold P; Bakken, Suzanne; Barbour, Edward M; Gabriel, Davera; Hagler, Herbert K; Harper, Caryn R; Mollah, Shamim A; Nahm, Meredith; Nguyen, Hien H; Scheuermann, Richard H; Sim, Ida

2009-11-14

A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

Critical evaluation as an aid to improved report writing: a case study

NASA Astrophysics Data System (ADS)

Walker, Mirabelle; Williams, Judith

2014-05-01

Report writing is an important employability skill for Engineers and Technologists, and this case study describes how a Technology degree module took a novel approach to developing students' report writing skills. Students learned how to use a criterion-referenced critical evaluation framework for reports and other technological documents. They were given opportunities to practise using the framework both through exemplars and through evaluating the work of their peers. They also carried out self-assessment. The authors' analysis of this novel approach shows that most students responded well to it and benefited from it. Lessons are drawn from this work for others who wish to improve their students' report writing skills.

Does context matter in evaluations of stigmatized individuals? An fMRI study.

PubMed

Krendl, Anne C; Moran, Joseph M; Ambady, Nalini

2013-06-01

The manner in which disparate affective responses shape attitudes toward other individuals has received a great deal of attention in neuroscience research. However, the malleability of these affective responses remains largely unexplored. The perceived controllability of a stigma (whether or not the bearer of the stigma is perceived as being responsible for his or her condition) has been found to polarize behavioral affective responses to that stigma. The current study uses functional magnetic resonance imaging to identify the neural correlates underlying the evaluation of stigmatized individuals (people who are homeless) when perceptions of the controllability of their condition are altered. Results demonstrated that perceivers engaged neural networks implicated in inferring intentionality (e.g. the medial prefrontal cortex) when they evaluated a homeless individual who was described as being responsible for becoming homeless. Conversely, neural networks associated with resolving strong affective responses (e.g. insula) were engaged when evaluating a homeless individual who was described as not being responsible for becoming homeless.

Who Is Afraid of Evaluation? Ethics in Evaluation Research as a Way to Cope with Excessive Evaluation Anxiety: Insights from a Case Study

ERIC Educational Resources Information Center

Bechar, Shlomit; Mero-Jaffe, Irit

2014-01-01

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

Ohio's Abandoned Mine Lands Reclamation Program: a Study of Data Collection and Evaluation Techniques

NASA Technical Reports Server (NTRS)

Sperry, S. L.

1982-01-01

The planning process for a statewide reclamation plan of Ohio abandoned minelands in response to the Federal Surface Mining Control and Reclamation Act of 1977 included: (1) the development of a screening and ranking methodology; (2) the establishment of a statewide review of major watersheds affected by mining; (3) the development of an immediate action process; and (4) a prototypical study of a priority watershed demonstrating the data collection, analysis, display and evaluation to be used for the remaining state watersheds. Historical methods for satisfying map information analysis and evaluation, as well as current methodologies being used were discussed. Various computer mapping and analysis programs were examined for their usability in evaluating the priority reclamation sites. Hand methods were chosen over automated procedures; intuitive evaluation was the primary reason.

Measuring the Measurements: A Study of Evaluation of Writing: An Annotated Bibliography.

ERIC Educational Resources Information Center

Scherer, Darlene Lienau

Intended to make the educational community aware of how research has defined acceptable practice in writing assessment, this annotated bibliography examines research about writing evaluation. Divided into five sections, the first section of the bibliography surveys some psychological and linguistic studies of the development of students' writing…

From Student Evaluations to Teacher Performance: A Study of Piano Class Instruction

ERIC Educational Resources Information Center

Iwaguchi, Setsuko

2012-01-01

The purpose of this study was to evaluate instruction in individually mentored piano classes in nursery and kindergarten teacher training programmes. Questionnaires were developed and administered to piano class students; using the resulting data, relationships among the variables that affect student's satisfaction with piano classes and their…

Evaluation of the district health management fellowship training programme: a case study in Iran

PubMed Central

Gholipour, Kamal; Tabrizi, Jafar Sadegh; Farahbakhsh, Mostafa; Iezadi, Shabnam; Ghiasi, Akbar; Jahanbin, Hasan

2018-01-01

Objective To evaluate the district health management fellowship training programme in the north-west of Iran. Data sources/study setting The programme was introduced to build the managerial capacity of district health managers in Iran. Eighty-nine heads of units in the province’s health centre, district health managers and the health deputies of the district health centres in the north-west provinces of Iran had registered for the district health management fellowship training programme in Tabriz in 2015–2016. Study design This was an educational evaluation study to evaluate training courses to measure participants' reactions and learning and, to a lesser extent, application of training to their job and the organisational impact. Data collection/extraction methods Valid and reliable questionnaires were used to assess learning techniques and views towards the fellowship, and self-assessment of health managers’ knowledge and skills. Also, pretest and post-test examinations were conducted in each course and a portfolio was provided to the trainees to be completed in their work settings. Principal findings About 63% of the participants were medical doctors and 42.3% of them had over 20 years of experience. Learning by practice (scored 18.37 out of 20) and access to publications (17.27) were the most useful methods of training in health planning and management from the participants’ perspective. Moreover, meeting peers from other districts and the academic credibility of teachers were the most important features of the current programme. Based on the managers’ self-assessment, they were most skilful in quality improvement, managing, planning and evaluation of the district. The results of the post-test analysis on data collected from district health managers showed the highest scores in managing the district (77 out of 100) and planning and evaluation (69) of the courses. Conclusion The results of this study indicated that training courses, methods and

Cogeneration Technology Alternatives Study (CTAS). Volume 2: Comparison and evaluation of results

NASA Technical Reports Server (NTRS)

1984-01-01

CTAS compared and evaluated various advanced energy conversion systems that can use coal or coal-derived fuels for industrial cogeneration applications. The principal aim of the study was to provide information needed by DOE to establish research and development (R&D) funding priorities for advanced-technology systems that could significantly advance the use of coal or coal-derived fuels in industrial cogeneration. Steam turbines, diesel engines, open-cycle gas turbines, combined cycles, closed-cycle gas turbines, Stirling engines, phosphoric acid fuel cells, molten carbonate fuel cells, and thermionics were studied with technology advancements appropriate for the 1985-2000 time period. The various advanced systems were compared and evaluated for a wide diversity of representative industrial plants on the basis of fuel energy savings, annual energy cost savings, emissions savings, and rate of return on investment (ROI) as compared with purchasing electricity from a utility and providing process heat with an on-site boiler.

Exploring the Capability of Evaluating Technical Solutions: A Collaborative Study into the Primary Technology Classroom

ERIC Educational Resources Information Center

Björkholm, Eva

2014-01-01

Within the field of technology education, evaluating technical solutions is considered as an important topic. Research indicates that pupils have difficulties in evaluating technical solutions in terms of fitness for purpose, i.e. how effective a technical solution supports its intended function. By using the learning study, which is an iterative…

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals' Views and Experiences.

PubMed

Kraft, Matthew A; Gilmour, Allison

2016-12-01

New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals' ability to promote teacher development through the evaluation process. We conducted a case study of principals' perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. We found that the evaluation reforms provided a common framework and language that helped facilitate principals' feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development.

Self-Study and Evaluation Guide/1977 Edition. Section D-8: Rehabilitation Teaching Services.

ERIC Educational Resources Information Center

National Accreditation Council for Agencies Serving the Blind and Visually Handicapped, New York, NY.

This self-study and evaluation guide on rehabilitation teaching services is one of 28 guides designed for organizations who are undertaking a self-study as part of the process for accreditation from the National Accreditation Council (NAC) for agencies serving the blind and visually handicapped. Provided are lists of standards to be appraised by…

Field Collection Methods for an EPA Pilot Study Evaluating ...

EPA Pesticide Factsheets

This compilation of field collection standard operating procedures (SOPs) was assembled for the U.S. Environmental Protection Agency’s (EPA) Pilot Study add-on to the Green Housing Study (GHS). A detailed description of this add-on study can be found in the peer reviewed research protocol entitled “An EPA Pilot Study Evaluating Personal, Housing, and Community Factors Influencing Children’s Potential Exposures to Indoor Contaminants at Various Lifestages –Research Protocol” 1. Briefly, the Centers for Disease Control and Prevention’s (CDC) Green Housing Study (GHS) follows changes in environmental measurements [pesticides, volatile organic compounds (VOCs), particulate matter (i.e., PM2.5 and 1.0), indoor allergens, and fungi] in both U.S. Department of Housing and Urban Development (HUD) green-renovated and comparison (no renovation) homes and relates these changes to asthma morbidity in children ages 7-12 years. Green-renovations include (but are not limited to) use of low VOC materials, use of energy efficient appliances, and integrated pest management. The EPA has leveraged this opportunity to collect additional multimedia measurements and questionnaire data from the index children actively participating in the GHS and a sibling in order to characterize personal, housing, and community factors. The purpose of this document is to publish the methodology EPA used for a specific study for reference and use by other scientists both within the Agency

Evaluating Pillar Industry's Transformation Capability: A Case Study of Two Chinese Steel-Based Cities.

PubMed

Li, Zhidong; Marinova, Dora; Guo, Xiumei; Gao, Yuan

2015-01-01

Many steel-based cities in China were established between the 1950s and 1960s. After more than half a century of development and boom, these cities are starting to decline and industrial transformation is urgently needed. This paper focuses on evaluating the transformation capability of resource-based cities building an evaluation model. Using Text Mining and the Document Explorer technique as a way of extracting text features, the 200 most frequently used words are derived from 100 publications related to steel- and other resource-based cities. The Expert Evaluation Method (EEM) and Analytic Hierarchy Process (AHP) techniques are then applied to select 53 indicators, determine their weights and establish an index system for evaluating the transformation capability of the pillar industry of China's steel-based cities. Using real data and expert reviews, the improved Fuzzy Relation Matrix (FRM) method is applied to two case studies in China, namely Panzhihua and Daye, and the evaluation model is developed using Fuzzy Comprehensive Evaluation (FCE). The cities' abilities to carry out industrial transformation are evaluated with concerns expressed for the case of Daye. The findings have policy implications for the potential and required industrial transformation in the two selected cities and other resource-based towns.

78 FR 68461 - Guidance for Industry: Studies To Evaluate the Utility of Anti-Salmonella Chemical Food Additives...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-14

...] Guidance for Industry: Studies To Evaluate the Utility of Anti- Salmonella Chemical Food Additives in Feeds... Industry: Studies to Evaluate the Utility of Anti-Salmonella Chemical Food Additives in Feeds,'' and is... of Anti-Salmonella Chemical Food Additives in Feeds (GFI 80) is to help sponsors design efficacy...

Investigating Religion and Computing: A Case for Using Standpoint Theory in Technology Evaluation Studies

ERIC Educational Resources Information Center

Wyche, Susan Porter

2010-01-01

This research focuses on the development and study of Information and Communication Technology (ICT) that support religious practices and the use of standpoint theory in ICT evaluation studies. Three phases makeup this work: formative studies to understand how megachurches, their members and leaders use ICT in ways tied to their Protestant…

Web-based continuing medical education. (II): Evaluation study of computer-mediated continuing medical education.

PubMed

Curran, V R; Hoekman, T; Gulliver, W; Landells, I; Hatcher, L

2000-01-01

Over the years, various distance learning technologies and methods have been applied to the continuing medical education needs of rural and remote physicians. They have included audio teleconferencing, slow scan imaging, correspondence study, and compressed videoconferencing. The recent emergence and growth of Internet, World Wide Web (Web), and compact disk read-only-memory (CD-ROM) technologies have introduced new opportunities for providing continuing education to the rural medical practitioner. This evaluation study assessed the instructional effectiveness of a hybrid computer-mediated courseware delivery system on dermatologic office procedures. A hybrid delivery system merges Web documents, multimedia, computer-mediated communications, and CD-ROMs to enable self-paced instruction and collaborative learning. Using a modified pretest to post-test control group study design, several evaluative criteria (participant reaction, learning achievement, self-reported performance change, and instructional transactions) were assessed by various qualitative and quantitative data collection methods. This evaluation revealed that a hybrid computer-mediated courseware system was an effective means for increasing knowledge (p < .05) and improving self-reported competency (p < .05) in dermatologic office procedures, and that participants were very satisfied with the self-paced instruction and use of asynchronous computer conferencing for collaborative information sharing among colleagues.

An evaluation of third molar eruption for assessment of chronologic age: A panoramic study

PubMed Central

Tuteja, Monica; Bahirwani, Shraddha; Balaji, P

2012-01-01

Objectives: The identity of a person can be established by assessing one's age, and in order to be entitled to civil rights and social benefits, verification of the chronological age is required and thereby age estimation has gained an increasing significance in recent years. Tooth eruption is one of the criteria of developmental morphology that can be evaluated by either clinical examination or by evaluation of dental radiographs to determine the dental age. The present study was aimed to evaluate the reliability of the third molar eruption stage as a parameter for forensic age estimation in living subjects. Materials and Methods: The stage of wisdom tooth eruption in 77 male and 73 female Indian subjects aged between 12–26 years was determined by subjecting them to conventional orthopantomograms and was interpreted to assess the third molar eruption stages to evaluate the dental age. Results: Predicted minimum age and mean age of the study sample were found to be significant predictors (P<0.001) of actual age. Minimum age was able to explain 58.3% of the variation in actual age and the mean age was able to explain 60.3% of variation in actual age. Conclusion: Third molar is fairly a reliable indicator to determine the age of alveolar, gingival, and complete emergence of third molar in the occlusal plane in adolescents and young adults. Minimum and most probable ages of examined subjects can also be evaluated using third molar eruption stage. PMID:23087576

An evaluation of third molar eruption for assessment of chronologic age: A panoramic study.

PubMed

Tuteja, Monica; Bahirwani, Shraddha; Balaji, P

2012-01-01

The identity of a person can be established by assessing one's age, and in order to be entitled to civil rights and social benefits, verification of the chronological age is required and thereby age estimation has gained an increasing significance in recent years. Tooth eruption is one of the criteria of developmental morphology that can be evaluated by either clinical examination or by evaluation of dental radiographs to determine the dental age. The present study was aimed to evaluate the reliability of the third molar eruption stage as a parameter for forensic age estimation in living subjects. The stage of wisdom tooth eruption in 77 male and 73 female Indian subjects aged between 12-26 years was determined by subjecting them to conventional orthopantomograms and was interpreted to assess the third molar eruption stages to evaluate the dental age. Predicted minimum age and mean age of the study sample were found to be significant predictors (P<0.001) of actual age. Minimum age was able to explain 58.3% of the variation in actual age and the mean age was able to explain 60.3% of variation in actual age. Third molar is fairly a reliable indicator to determine the age of alveolar, gingival, and complete emergence of third molar in the occlusal plane in adolescents and young adults. Minimum and most probable ages of examined subjects can also be evaluated using third molar eruption stage.

A conceptual framework for evaluating data suitability for observational studies.

PubMed

Shang, Ning; Weng, Chunhua; Hripcsak, George

2017-09-08

To contribute a conceptual framework for evaluating data suitability to satisfy the research needs of observational studies. Suitability considerations were derived from a systematic literature review on researchers' common data needs in observational studies and a scoping review on frequent clinical database design considerations, and were harmonized to construct a suitability conceptual framework using a bottom-up approach. The relationships among the suitability categories are explored from the perspective of 4 facets of data: intrinsic, contextual, representational, and accessible. A web-based national survey of domain experts was conducted to validate the framework. Data suitability for observational studies hinges on the following key categories: Explicitness of Policy and Data Governance, Relevance, Availability of Descriptive Metadata and Provenance Documentation, Usability, and Quality. We describe 16 measures and 33 sub-measures. The survey uncovered the relevance of all categories, with a 5-point Likert importance score of 3.9 ± 1.0 for Explicitness of Policy and Data Governance, 4.1 ± 1.0 for Relevance, 3.9 ± 0.9 for Availability of Descriptive Metadata and Provenance Documentation, 4.2 ± 1.0 for Usability, and 4.0 ± 0.9 for Quality. The suitability framework evaluates a clinical data source's fitness for research use. Its construction reflects both researchers' points of view and data custodians' design features. The feedback from domain experts rated Usability, Relevance, and Quality categories as the most important considerations. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

WMC Database Evaluation. Case Study Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Palounek, Andrea P. T

The WMC Database is ultimately envisioned to hold a collection of experimental data, design information, and information from computational models. This project was a first attempt at using the Database to access experimental data and extract information from it. This evaluation shows that the Database concept is sound and robust, and that the Database, once fully populated, should remain eminently usable for future researchers.

The study of surgical image quality evaluation system by subjective quality factor method

NASA Astrophysics Data System (ADS)

Zhang, Jian J.; Xuan, Jason R.; Yang, Xirong; Yu, Honggang; Koullick, Edouard

2016-03-01

GreenLightTM procedure is an effective and economical way of treatment of benign prostate hyperplasia (BPH); there are almost a million of patients treated with GreenLightTM worldwide. During the surgical procedure, the surgeon or physician will rely on the monitoring video system to survey and confirm the surgical progress. There are a few obstructions that could greatly affect the image quality of the monitoring video, like laser glare by the tissue and body fluid, air bubbles and debris generated by tissue evaporation, and bleeding, just to name a few. In order to improve the physician's visual experience of a laser surgical procedure, the system performance parameter related to image quality needs to be well defined. However, since image quality is the integrated set of perceptions of the overall degree of excellence of an image, or in other words, image quality is the perceptually weighted combination of significant attributes (contrast, graininess …) of an image when considered in its marketplace or application, there is no standard definition on overall image or video quality especially for the no-reference case (without a standard chart as reference). In this study, Subjective Quality Factor (SQF) and acutance are used for no-reference image quality evaluation. Basic image quality parameters, like sharpness, color accuracy, size of obstruction and transmission of obstruction, are used as subparameter to define the rating scale for image quality evaluation or comparison. Sample image groups were evaluated by human observers according to the rating scale. Surveys of physician groups were also conducted with lab generated sample videos. The study shows that human subjective perception is a trustworthy way of image quality evaluation. More systematic investigation on the relationship between video quality and image quality of each frame will be conducted as a future study.

Evaluation of Oral Performance in Outsourced Call Centres: An Exploratory Case Study

ERIC Educational Resources Information Center

Friginal, Eric

2013-01-01

This case study discusses the development and use of an oral performance assessment instrument intended to evaluate Filipino agents' customer service transactions with callers from the United States (US). The design and applications of the instrument were based on a longitudinal, qualitative observation of language training and customer service…

Critical Evaluation as an Aid to Improved Report Writing: A Case Study

ERIC Educational Resources Information Center

Walker, Mirabelle; Williams, Judith

2014-01-01

Report writing is an important employability skill for Engineers and Technologists, and this case study describes how a Technology degree module took a novel approach to developing students' report writing skills. Students learned how to use a criterion-referenced critical evaluation framework for reports and other technological documents. They…

Evaluation of Core Vocabulary Therapy for Deaf Children: Four Treatment Case Studies

ERIC Educational Resources Information Center

Herman, Rosalind; Ford, Katie; Thomas, Jane; Oyebade, Natalie; Bennett, Danita; Dodd, Barbara

2015-01-01

This study evaluated whether core vocabulary intervention (CVT) improved single word speech accuracy, consistency and intelligibility in four 9-11-year-old children with profound sensori-neural deafness fitted with cochlear implants and/or digital hearing aids. Their speech was characterized by inconsistent production of different error forms for…

A Study of How Secondary School Principals in Minnesota Perceive the Evaluation of Their Performance

ERIC Educational Resources Information Center

Muenich, John Andrew

2014-01-01

The purpose for this study was to ascertain the perceptions principals of public secondary schools in Minnesota have in relation to the evaluation of their job performance. Responding principals reported that past evaluations have been fair and consistent but have questioned their value with regard to professional growth. When asked if student…

Earth orbit navigation study. Volume 2: System evaluation

NASA Technical Reports Server (NTRS)

1972-01-01

An overall systems evaluation was made of five candidate navigation systems in support of earth orbit missions. The five systems were horizon sensor system, unkown landmark tracking system, ground transponder system, manned space flight network, and tracking and data relay satellite system. Two reference missions were chosen: a low earth orbit mission and a transfer trajectory mission from low earth orbit to geosynchronous orbit. The specific areas addressed in the evaluation were performance, multifunction utilization, system mechanization, and cost.

Pyrotechnic hazards classification and evaluation program test report. Heat flux study of deflagrating pyrotechnic munitions

NASA Technical Reports Server (NTRS)

Fassnacht, P. O.

1971-01-01

A heat flux study of deflagrating pyrotechnic munitions is presented. Three tests were authorized to investigate whether heat flux measurements may be used as effective hazards evaluation criteria to determine safe quantity distances for pyrotechnics. A passive sensor study was conducted simultaneously to investigate their usefulness in recording events and conditions. It was concluded that heat flux measurements can effectively be used to evaluate hazards criteria and that passive sensors are an inexpensive tool to record certain events in the vicinity of deflagrating pyrotechnic stacks.

Evaluation Studies on Education in Occupational Safety and Health: Inspiration for Developing Economies.

PubMed

van Dijk, Frank J; Bubas, Marija; Smits, Paul B

2015-01-01

Education and training of students, workers, and professionals are essential for occupational safety and health (OSH). We noticed a lack of debate on how to advance coverage and quality of OSH education given high shortages in developing economies. International discussion on future options might be stimulated by an overview of recent studies. We employed a search of the Cochrane Library and PubMed/MEDLINE databases for articles from the last decade on evaluation of OSH education. We selected 121 relevant studies and 6 Cochrane reviews. Most studies came from the United States, Western Europe, and Asia. Studies from low-income countries were scarce. From a global perspective, the number of evaluation studies found was disappointingly low and the quality needs improvement. Most commonly workers' education was evaluated, less often education of students, supervisors, and OSH professionals. Interactive e-cases and e-learning modules, video conferences, and distance discussion boards are inspiring educational methods, but also participatory workshops and educational plays. Ways to find access to underserved populations were presented and evaluated, such as educational campaigns, farm safety days, and OSH expert-supported initiatives of industrial branch organizations, schools, and primary, community, or hospital-based health care. Newly educated groups were immigrant workers training colleagues, workers with a disease, managers, and family physicians. Developing economies can take advantage of a variety of online facilities improving coverage and quality of education. Blended education including face-to-face contacts and a participatory approach might be preferred. For workers, minor isolated educational efforts are less effective than enhanced education or education as part of multifaceted preventive programs. Collaboration of OSH experts with other organizations offers opportunities to reach underserved worker populations. Increasing international collaboration is a

Study area evaluations. Volume 6-H. North plants study area exposure assessment version 4. 1. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

The objectives of the Human Health Exposure Assessment include: (1) estimate the type and magnitude of exposures to contaminants; (2) Identify contaminants of concern; (3) Identify sites for remedial action; (4) Recommend sites for the no action remedial alternative; and (5) Provide a basis for detailed characterization of the risk associated with all sites. This document consists of the following: An executive summary. Vol I - Land use and exposed population evaluations. Vol. II III - Toxicity assessment (includes army and shell toxicity profiles). Vol. IV - PPLV Methodology. Vol. V - PPLV Calculations. Vol. VI - Study area exposuremore » analysis A introduction, B Western study ares, C Southern study area, D northern Central study area, E Central study area, F Eastern study area, G South plants study area, and H North plants study area. Vol. VII - Summary exposure assessment.« less

Protocol: a systematic review of studies developing and/or evaluating search strategies to identify prognosis studies.

PubMed

Corp, Nadia; Jordan, Joanne L; Hayden, Jill A; Irvin, Emma; Parker, Robin; Smith, Andrea; van der Windt, Danielle A

2017-04-20

Prognosis research is on the rise, its importance recognised because chronic health conditions and diseases are increasingly common and costly. Prognosis systematic reviews are needed to collate and synthesise these research findings, especially to help inform effective clinical decision-making and healthcare policy. A detailed, comprehensive search strategy is central to any systematic review. However, within prognosis research, this is challenging due to poor reporting and inconsistent use of available indexing terms in electronic databases. Whilst many published search filters exist for finding clinical trials, this is not the case for prognosis studies. This systematic review aims to identify and compare existing methodological filters developed and evaluated to identify prognosis studies of any of the three main types: overall prognosis, prognostic factors, and prognostic [risk prediction] models. Primary studies reporting the development and/or evaluation of methodological search filters to retrieve any type of prognosis study will be included in this systematic review. Multiple electronic bibliographic databases will be searched, grey literature will be sought from relevant organisations and websites, experts will be contacted, and citation tracking of key papers and reference list checking of all included papers will be undertaken. Titles will be screened by one person, and abstracts and full articles will be reviewed for inclusion independently by two reviewers. Data extraction and quality assessment will also be undertaken independently by two reviewers with disagreements resolved by discussion or by a third reviewer if necessary. Filters' characteristics and performance metrics reported in the included studies will be extracted and tabulated. To enable comparisons, filters will be grouped according to database, platform, type of prognosis study, and type of filter for which it was intended. This systematic review will identify all existing validated

DIRECT operational field test evaluation natural use study. Part 1, Subject stated response

DOT National Transportation Integrated Search

1998-08-01

This report presents evaluation results from the Subject Stated Response portion (Part I) of the Natural Use Study of the DIRECT (Driver Information Radio using Experimental Communication : Technologies) operational test sponsored by the Michigan Dep...

Evaluation of support group interventions for children in troubled families: study protocol for a quasi-experimental control group study.

PubMed

Skerfving, Annemi; Johansson, Fredrik; Elgán, Tobias H

2014-01-24

Support groups for children in troubled families are available in a majority of Swedish municipalities. They are used as a preventive effort for children in families with different parental problems such as addiction to alcohol/other drugs, mental illness, domestic violence, divorce situations, or even imprisonment. Children from families with these problems are a well-known at-risk group for various mental health and social problems. Support groups aim at strengthening children's coping behaviour, to improve their mental health and to prevent a negative psycho-social development. To date, evaluations using a control-group study design are scarce. The aim of the current study is to evaluate the effects of support groups. This paper describes the design of an effectiveness study, initially intended as a randomized controlled trial, but instead is pursued as a quasi-experimental study using a non-randomized control group. The aim is to include 116 children, aged 7-13 years and one parent/another closely related adult, in the study. Participants are recruited via existing support groups in the Stockholm county district and are allocated either into an intervention group or a waiting list control group, representing care as usual. The assessment consists of questionnaires that are to be filled in at baseline and at four months following the baseline. Additionally, the intervention group completes a 12-month follow-up. The outcomes include the Strength and Difficulties Questionnaire (SDQ S11-16), the Kids Coping Scale, the "Ladder of life" which measures overall life satisfaction, and "Jag tycker jag är" (I think I am) which measures self-perception and self-esteem. The parents complete the SDQ P4-16 (parent-report version) and the Swedish scale "Familjeklimat" (Family Climate), which measures the emotional climate in the family. There is a need for evaluating the effects of support groups targeted to children from troubled families. This quasi-experimental study

Study Design and Evaluation of Risk Minimization Measures: A Review of Studies Submitted to the European Medicines Agency for Cardiovascular, Endocrinology, and Metabolic Drugs.

PubMed

Mazzaglia, Giampiero; Straus, Sabine M J; Arlett, Peter; da Silva, Daniela; Janssen, Heidi; Raine, June; Alteri, Enrica

2018-02-01

Studies measuring the effectiveness of risk minimization measures (RMMs) submitted by pharmaceutical companies to the European Medicines Agency are part of the post-authorization regulatory requirements and represent an important source of data covering a range of medicinal products and safety-related issues. Their objectives, design, and the associated regulatory outcomes were reviewed, and conclusions were drawn that may support future progress in risk minimization evaluation. Information was obtained from risk management plans, study protocols, clinical study reports, and assessment reports of 157 medicinal products authorized for cardiovascular, endocrinology, and metabolic indications. We selected observational studies measuring, as outcomes of interest, the relationship between the RMMs in place and (1) implementation measures, such as clinical knowledge or physicians` compliance to recommendations contained in the RMMs; and (2) occurrence or reduced severity of the adverse drug reactions for which the RMMs were required. Of 59 eligible studies (24 completed, 35 ongoing), 44 assessed implementation measures, whereas only 15 assessed safety outcomes (1 study as a single endpoint and 14 studies with other endpoints). Fifty-one studies used non-experimental designs and 25 studies employed electronic healthcare databases for analysis. Of the 24 completed studies, 17 were considered satisfactory and supported immediate regulatory decision making, 6 were considered inconclusive and required new evaluations, and 1 was terminated early because new safety restrictions were required, thereby necessitating a new evaluation. Compliance with agreed deadlines was considered acceptable in 21 of 24 completed studies; the average time for a submission was 37 months (standard deviation ± 17), with differences observed by type of data source employed. Three important gaps in the evaluation plans of RMMs were identified: lack of early feedback on implementation, limited

Effects of the Saluda Prevention Program: A Review of Controlled Evaluation Studies

ERIC Educational Resources Information Center

Espada-Sánchez, José P.; Hernández-Serrano, Olga

2015-01-01

The objective of the present study is to review the evidence on the effectiveness concerning the Saluda program, a school-based substance use prevention protocol used amongst adolescents. We provide a description of the program content and the results from nine controlled trials evaluating the program effectiveness. Participants were Spanish…

Can Principals Promote Teacher Development as Evaluators? A Case Study of Principals’ Views and Experiences

PubMed Central

Kraft, Matthew A.; Gilmour, Allison

2017-01-01

Purpose New teacher evaluation systems have expanded the role of principals as instructional leaders, but little is known about principals’ ability to promote teacher development through the evaluation process. We conducted a case study of principals’ perspectives on evaluation and their experiences implementing observation and feedback cycles to better understand whether principals feel as though they are able to promote teacher development as evaluators. Research Methods We conducted interviews with a stratified random sample of 24 principals in an urban district that recently implemented major reforms to its teacher evaluation system. We analyzed these interviews by drafting thematic summaries, coding interview transcripts, creating data-analytic matrices, and writing analytic memos. Findings We found that the evaluation reforms provided a common framework and language that helped facilitate principals’ feedback conversations with teachers. However, we also found that tasking principals with primary responsibility for conducting evaluations resulted in a variety of unintended consequences which undercut the quality of evaluation feedback they provided. We analyze five broad solutions to these challenges: strategically targeting evaluations, reducing operational responsibilities, providing principal training, hiring instructional coaches, and developing peer evaluation systems. Implications The quality of feedback teachers receive through the evaluation process depends critically on the time and training evaluators have to provide individualized and actionable feedback. Districts that task principals with primary responsibility for conducting observation and feedback cycles must attend to the many implementation challenges associated with this approach in order for next-generation evaluation systems to successfully promote teacher development. PMID:28729742

Frameworks for evaluating health research capacity strengthening: a qualitative study

PubMed Central

2013-01-01

Background Health research capacity strengthening (RCS) projects are often complex and hard to evaluate. In order to inform health RCS evaluation efforts, we aimed to describe and compare key characteristics of existing health RCS evaluation frameworks: their process of development, purpose, target users, structure, content and coverage of important evaluation issues. A secondary objective was to explore what use had been made of the ESSENCE framework, which attempts to address one such issue: harmonising the evaluation requirements of different funders. Methods We identified and analysed health RCS evaluation frameworks published by seven funding agencies between 2004 and 2012, using a mixed methods approach involving structured qualitative analyses of documents, a stakeholder survey and consultations with key contacts in health RCS funding agencies. Results The frameworks were intended for use predominantly by the organisations themselves, and most were oriented primarily towards funders’ internal organisational performance requirements. The frameworks made limited reference to theories that specifically concern RCS. Generic devices, such as logical frameworks, were typically used to document activities, outputs and outcomes, but with little emphasis on exploring underlying assumptions or contextual constraints. Usage of the ESSENCE framework appeared limited. Conclusions We believe that there is scope for improving frameworks through the incorporation of more accessible information about how to do evaluation in practice; greater involvement of stakeholders, following evaluation capacity building principles; greater emphasis on explaining underlying rationales of frameworks; and structuring frameworks so that they separate generic and project-specific aspects of health RCS evaluation. The third and fourth of these improvements might assist harmonisation. PMID:24330628

Feasibility study on evaluating driver education curriculum.

DOT National Transportation Integrated Search

2009-04-01

One way to attempt to reduce the problem of teen driving crashes is professional driver education. However, despite the : seemingly universal appeal of driver education, scientific evaluations have indicated that such programs generally do not : prod...

[Participation, knowledge production, and evaluative research: participation by different actors in a mental health study].

PubMed

Furtado, Juarez Pereira; Campos, Rosana Onocko

2008-11-01

This article reflects on the interrelations between participation, knowledge production, and public policy evaluation in light of issues from our own experience with evaluative research on a municipal network of Psychosocial Care Centers (CAPS) in Brazil. The article discusses the coordination of the complex process and the potentials and limits of partnerships for conducting qualitative evaluative studies in mental health with participation by different social actors. The authors conclude that qualitative evaluative research aligned with the perspective of including different points of view representing various segments is the best approach for understanding the numerous spin-offs from the implementation of services linked to the Brazilian psychiatric reform movement, given the inherent specificities of the mental health field.

The Evaluation of Land Use Status in Mountainous Counties of Southwest China Based on Comprehensive Evaluation Models: A Case Study of Baoxing County, Sichuan Province

NASA Astrophysics Data System (ADS)

Cao, Mengtian; Shen, Jundi; Chen, Zhehua

2018-06-01

In mountainous areas of Southwest China, the land resources are scarce, and the ecological environment is fragile, so it is particularly important to carry out the evaluation of land use status for the sustainability of land development. Taking Baoxing County in Sichuan Province, the typical mountainous county in Southwest China, as an instance, this study refers to the existing research frameworks to establish the evaluation system of land use status. Meanwhile, the comprehensive evaluation models are used to evaluate land use status. As indicated from the results, in Baoxing County, the comprehensive evaluation score of the overall status of land use, the evaluation score of the development degree of land, the evaluation score of the intensive management degree of land and the evaluation score of the comprehensive benefits of land were 83.5, 108.24, 72.25 and 80.77, respectively. Land use status is generally at the relatively rational use stage, and the main problems are the lack of land investment and the low mechanization level of agricultural production. It is suggested to increase the financial investment in land and enhance the intensive degree and comprehensive benefits of land in the future.

Evaluation of moral case deliberation at the Dutch Health Care Inspectorate: a pilot study.

PubMed

Seekles, Wike; Widdershoven, Guy; Robben, Paul; van Dalfsen, Gonny; Molewijk, Bert

2016-05-21

Moral case deliberation (MCD) as a form of clinical ethics support is usually implemented in health care institutions and educational programs. While there is no previous research on the use of clinical ethics support on the level of health care regulation, employees of regulatory bodies are regularly confronted with moral challenges. This pilot study describes and evaluates the use of MCD at the Dutch Health Care Inspectorate (IGZ). The objective of this pilot study is to investigate: 1) the current way of dealing with moral issues at the IGZ; 2) experience with and evaluation of MCD as clinical ethics support, and 3) future preferences and (perceived) needs regarding clinical ethics support for dealing with moral questions at the IGZ. We performed an explorative pilot study. The research questions were assessed by means of: 1) interviews with MCD participants during four focus groups; and 2) interviews with six key stakeholders at the IGZ. De qualitative data is illustrated by data from questionnaires on MCD outcomes, perspective taking and MCD evaluation. Professionals do not always recognize moral issues. Employees report a need for regular and structured moral support in health care regulation. The MCD meetings are evaluated positively. The most important outcomes of MCD are feeling secure and learning from others. Additional support is needed to successfully implement MCD at the Inspectorate. We conclude that the respondents perceive moral case deliberation as a useful form of clinical ethics support for dealing with moral questions and issues in health care regulation.

Double-blinded, placebo-controlled study to evaluate an antipruritic shampoo for dogs with allergic pruritus.

PubMed

Schilling, J; Mueller, R S

2012-07-28

Shampoo therapy is frequently used on pruritic dogs. However, there are few double-blinded, placebo-controlled studies of this form of therapy. This randomised, double-blinded, placebo-controlled study evaluated the efficacy of a commercial medicated shampoo (DermaTopic; Almapharm) containing chlorhexidine, lactoferrin, piroctone olamine, chitosan and essential fatty acids in 27 dogs with mild to moderate allergic pruritus without secondary skin infections. All dogs received shampoo therapy with either DermaTopic or a shampoo vehicle as placebo twice weekly for four weeks. The extent of pruritus was evaluated before the study and then on a daily basis by the owners using a visual analogue scale. Before beginning the treatment and after four weeks, the skin lesions were evaluated by an experienced clinician with a validated lesion score (Canine Atopic Dermatitis Extent and Severity Index - CADESI). The pruritus was reduced significantly by both DermaTopic and placebo. However, there was no significant difference between both groups. There was no statistically significant difference in the CADESI scores pre- and post-treatment in either group or between the two types of treatment. This study provides further evidence of the benefit of shampoo therapy for pruritic dogs.

Evaluating mixed samples as a source of error in non-invasive genetic studies using microsatellites

USGS Publications Warehouse

Roon, David A.; Thomas, M.E.; Kendall, K.C.; Waits, L.P.

2005-01-01

The use of noninvasive genetic sampling (NGS) for surveying wild populations is increasing rapidly. Currently, only a limited number of studies have evaluated potential biases associated with NGS. This paper evaluates the potential errors associated with analysing mixed samples drawn from multiple animals. Most NGS studies assume that mixed samples will be identified and removed during the genotyping process. We evaluated this assumption by creating 128 mixed samples of extracted DNA from brown bear (Ursus arctos) hair samples. These mixed samples were genotyped and screened for errors at six microsatellite loci according to protocols consistent with those used in other NGS studies. Five mixed samples produced acceptable genotypes after the first screening. However, all mixed samples produced multiple alleles at one or more loci, amplified as only one of the source samples, or yielded inconsistent electropherograms by the final stage of the error-checking process. These processes could potentially reduce the number of individuals observed in NGS studies, but errors should be conservative within demographic estimates. Researchers should be aware of the potential for mixed samples and carefully design gel analysis criteria and error checking protocols to detect mixed samples.

'Stories' or 'snapshots'? A study directed at comparing qualitative and quantitative approaches to curriculum evaluation.

PubMed

Pateman, B; Jinks, A M

1999-01-01

The focus of this paper is a study designed to explore the validity of quantitative approaches of student evaluation in a pre-registration degree programme. As managers of the students' education we were concerned that the quantitative method, which used lecturer criteria, may not fully represent students' views. The approach taken is that of a process-type strategy for curriculum evaluation as described by Parlett and Hamilton (1972). The aim of the study is to produce illuminative data, or students' 'stories' of their educational experiences through use of semi-structured interviews. The results are then compared to the current quantitative measurement tools designed to obtain 'snapshots' of the educational effectiveness of the curriculum. The quantitative measurement tools use Likert scale measurements of teacher-devised criterion statements. The results of the study give a rich source of qualitative data which can be used to inform future curriculum development. However, complete validation of the current quantitative instruments used was not achieved in this study. Student and teacher agendas in respect of important issues pertaining to the course programme were found to differ. Limitations of the study are given. There is discussion of the options open to the management team with regard to future development of curriculum evaluation systems.

Increasing Physical Activity in Preschool: A Pilot Study to Evaluate Animal Trackers

ERIC Educational Resources Information Center

Williams, Christine L.; Carter, Betty Jean; Kibbe, Debra L.; Dennison, David

2009-01-01

Objective: This report describes a pilot study to evaluate Animal Trackers (AT), a preschool program designed to (1) increase structured physical activity (PA) during the preschool day; (2) increase practice of gross motor skills; (3) provide teachers with an easy-to-use PA program regardless of teacher experience; and (4) implement a teacher…

Evaluation of aesthetic and functional outcomes in rhinoplasty surgery: a prospective study.

PubMed

Sena Esteves, Sara; Gonçalves Ferreira, Miguel; Carvalho Almeida, João; Abrunhosa, José; Almeida E Sousa, Cecília

Evaluation of surgery outcome measured by patient satisfaction or quality of life is very important, especially in plastic surgery. There is increasing interest in self-reporting outcomes evaluation in plastic surgery. The aim of our study was to determine patient satisfaction in regard to nose appearance and function with the use of a validated questionnaire, before and after rhinoplasty surgery. A prospective study was realized at a tertiary centre. All rhinoplasty surgeries performed in adults between February 2013 and August 2014 were included. Many patients underwent additional nasal surgery such as septoplasty or turbinoplasty. The surgical procedures and patients' characteristics were also recorded. Among 113 patients, 107 completed the questionnaires and the follow-up period. Analysis of pre-operative and post-operative Rhinoplasty Evaluation Outcome showed a significant improvement after 3 and 6 months in functional and aesthetic questions (p<0.01). In the pre-operative, patients anxious and insecure had a worse score (p<0.05). Difference in improvement of scores was not significant when groups were divided on basis of other nasal procedures, primary or revision surgery and open versus closed approach. We found that patients with lower literacy degree were more satisfied with the procedure. Rhinoplasty surgery significantly improved patient quality of life regarding nose function and appearance. Copyright © 2016 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Saving babies' lives project impact and results evaluation (SPiRE): a mixed methodology study.

PubMed

Widdows, Kate; Reid, Holly E; Roberts, Stephen A; Camacho, Elizabeth M; Heazell, Alexander E P

2018-01-30

Reducing stillbirth and early neonatal death is a national priority in the UK. Current evidence indicates this is potentially achievable through application of four key interventions within routine maternity care delivered as the National Health Service (NHS) England's Saving Babies' Lives care bundle. However, there is significant variation in the degree of implementation of the care bundle between and within maternity units and the effectiveness in reducing stillbirth and improving service delivery has not yet been evaluated. This study aims to evaluate the impact of implementing the care bundle on UK maternity services and perinatal outcomes. The Saving Babies' Lives Project Impact and Results Evaluation (SPiRE) study is a multicentre evaluation of maternity care delivered through the Saving Babies' Lives care bundle using both quantitative and qualitative methodologies. The study will be conducted in twenty NHS Hospital Trusts and will include approximately 100,000 births. It involves participation by both service users and care providers. To determine the impact of the care bundle on pregnancy outcomes, birth data and other clinical measures will be extracted from maternity databases and case-note audit from before and after implementation. Additionally, this study will employ questionnaires with organisational leads and review clinical guidelines to assess how resources, leadership and governance may affect implementation in diverse hospital settings. The cost of implementing the care bundle, and the cost per stillbirth avoided, will also be estimated as part of a health economic analysis. The views and experiences of service users and service providers towards maternity care in relation to the care bundle will be also be sought using questionnaires. This protocol describes a pragmatic study design which is necessarily limited by the availability of data and limitations of timescales and funding. In particular there was no opportunity to prospectively gather

Teacher Leadership and Teacher Efficacy: A Correlational Study Comparing Teacher Perceptions of Leadership and Efficacy and Teacher Evaluation Scores from the North Carolina Educator Evaluation System

ERIC Educational Resources Information Center

Guenzler, April M.

2016-01-01

This study sought to identify correlations between constructs of teacher leadership, teacher efficacy, and teacher evaluation. Teacher perceptual data of support of teacher leadership, perceptual data on personal teacher efficacy, and teacher self-reported scores from the North Carolina Educator Evaluation System were gathered. The relationships…

Statistical Evaluation of Turkey Earthquake Cataloque: A Case study (1900-2015)

NASA Astrophysics Data System (ADS)

Kalafat, Dogan

2016-04-01

In this study, Turkey earthquake catalog of the events within the time period of 1900-2015 prepared by Boǧaziçi University Kandilli Observatory and Earthquake Research Institute is analyzed. The catalog consists of earthquakes occurred in Turkey and surrounding area (32o-45oN/23o-48oE). The current earthquake catalog data has been checked in two aspects; the time dependent variation and compliance for different regions. Specifically the data set prior to 1976 was found deficient. In total, 7 regions were evaluated according to the tectonic specifications and data set. In this study for every region original data were used without any change; b- values, a- values, Magnitude of completeness (Mc) were calculated. For the calculation of b- values focal depth was selected as h= 0-50 km. One of the important complications for the seismic catalogs is discriminating real (natural) seismic events from artificial (unnatural) seismic events. Therefore within the original current catalog events especially artificial quarry blasts and mine blasts have been separated by declustering and dequarry methods. Declustering process eliminates induced earthquakes especially occurred in thermal regions, large water basins, mine regions from the original catalogs. Current moment tensor catalog prepared by Kalafat, 2015 the faulting type map of the region was prepared. As a result, for each region it is examined if there is a relation between fault type and b- values. In this study, the hypothesis of the relation between previously evaluated and currently ongoing extensional, compression, strike-slip fault regimes in Turkey and b- values are tested one more time. This study was supported by the Department of Science Fellowship and Grant programs (2014-2219) of TUBITAK (The Scientific and Technological Research Councilof Turkey). It also encourages the conduct of the study and support the constructive contributionthat Prof.Dr. Nafi TOKSÖZ to offer my eternal gratitude.

Evaluating the utility of two gestural discomfort evaluation methods

PubMed Central

Son, Minseok; Jung, Jaemoon; Park, Woojin

2017-01-01

Evaluating physical discomfort of designed gestures is important for creating safe and usable gesture-based interaction systems; yet, gestural discomfort evaluation has not been extensively studied in HCI, and few evaluation methods seem currently available whose utility has been experimentally confirmed. To address this, this study empirically demonstrated the utility of the subjective rating method after a small number of gesture repetitions (a maximum of four repetitions) in evaluating designed gestures in terms of physical discomfort resulting from prolonged, repetitive gesture use. The subjective rating method has been widely used in previous gesture studies but without empirical evidence on its utility. This study also proposed a gesture discomfort evaluation method based on an existing ergonomics posture evaluation tool (Rapid Upper Limb Assessment) and demonstrated its utility in evaluating designed gestures in terms of physical discomfort resulting from prolonged, repetitive gesture use. Rapid Upper Limb Assessment is an ergonomics postural analysis tool that quantifies the work-related musculoskeletal disorders risks for manual tasks, and has been hypothesized to be capable of correctly determining discomfort resulting from prolonged, repetitive gesture use. The two methods were evaluated through comparisons against a baseline method involving discomfort rating after actual prolonged, repetitive gesture use. Correlation analyses indicated that both methods were in good agreement with the baseline. The methods proposed in this study seem useful for predicting discomfort resulting from prolonged, repetitive gesture use, and are expected to help interaction designers create safe and usable gesture-based interaction systems. PMID:28423016

Using Faculty Evaluation to Improve Teaching Quality: A Longitudinal Case Study of Higher Education in Southeast Asia

ERIC Educational Resources Information Center

Hallinger, Philip

2010-01-01

This paper presents a case study of implementation of a new system of faculty teaching evaluation at a graduate school of business in Thailand. The research employed a non-experimental, longitudinal case study design in the analysis of student course evaluation data gathered over a period of 21 terms during a seven-year period. The report…

Evaluating a dementia learning community: exploratory study and research implications.

PubMed

Sheaff, Rod; Sherriff, Ian; Hennessy, Catherine Hagan

2018-02-05

Access times for, the costs and overload of hospital services are an increasingly salient issue for healthcare managers in many countries. Rising demand for hospital care has been attributed partly to unplanned admissions for older people, and among these partly to the increasing prevalence of dementia. The paper makes a preliminary evaluation of the logic model of a Dementia Learning Community (DLC) intended to reduce unplanned hospital admissions from care homes of people with dementia. A dementia champion in each DLC care home trained other staff in dementia awareness and change management with the aims of changing work routines, improving quality of life, and reducing demands on external services. Controlled mixed methods realistic evaluation comparing 13 intervention homes with 10 controls in England during 2013-15. Each link in the assumed logic model was tested to find whether that link appeared to exist in the DLC sites, and if so whether its effects appeared greater there than in control sites, in terms of selected indicators of quality of life (DCM Well/Ill-Being, QUALID, end-of-life planning); and impacts on ambulance call-outs and hospital admissions. The training was implemented as planned, and triggered cycles of Plan-Do-Study-Act activity in all the intervention care homes. Residents' well-being scores, measured by dementia care mapping, improved markedly in half of the intervention homes but not in the other half, where indeed some scores deteriorated markedly. Most other care quality indicators studied did not significantly improve during the study period. Neither did ambulance call-out or emergency hospital admission rates. PDSA cycles appeared to be the more 'active ingredient' in this intervention. The reasons why they impacted on well-being in half of the intervention sites, and not the others, require further research. A larger, longer study would be necessary to measure definitively any impacts on unplanned hospital admissions. Our evidence

The Influence of Evaluators' Principles on Evaluation Resource Decisions

ERIC Educational Resources Information Center

Crohn, Kara Shea Davis

2009-01-01

This study examines ways in which evaluators' principles influence decisions about evaluation resources. Evaluators must seek-out and allocate (often scarce) resources (e.g., money, time, data, people, places) in a way that allows them to conduct the best possible evaluation given clients' and evaluation participants' constraints. Working within…

76 FR 74076 - Notice of Random Assignment Study To Evaluate the YouthBuild Program; Final Notice

Federal Register 2010, 2011, 2012, 2013, 2014

2011-11-30

... Evaluate the YouthBuild Program; Final Notice AGENCY: Employment and Training Administration (ETA), Labor... rigorous, nationally-representative estimates of the net impacts of the YouthBuild program. The Department... study. In the sites randomly selected to participate in this evaluation, all applicants for YouthBuild...

Developing a Culture of Evaluative Inquiry: A Case Study

ERIC Educational Resources Information Center

Miller, Happy Lee

2012-01-01

Research has shown that few educational reform efforts have achieved significant, long-lasting improvement in student achievement. In order to accelerate growth in student achievement, many researchers have advocated the development of cultures of evaluative inquiry. In a culture of evaluative inquiry, teachers use data to identify instructional…

Institute for Developmental Studies Interim Progress Report. Part II: Research and Evaluation.

ERIC Educational Resources Information Center

Deutsch, Martin; And Others

The Institute for Developmental Studies (IDS) is engaged in research aimed at specifying what the academic handicaps of deprived children are, what causes these handicaps, and what can be done to overcome them. This IDS report on their research and evaluation program is divided into two sections. The first, "Summaries of Basic Research, Applied…

Study of modeling and evaluation of remote manipulation tasks with force feedback

NASA Technical Reports Server (NTRS)

Hill, J. W.

1979-01-01

The use of time and motion study methods to evaluate force feedback in remote manipulation tasks are described. Several systems of time measurement derived for industrial workers were studied and adapted for manipulator use. A task board incorporating a set of basic motions was designed and built. Results obtained from two subjects in three manipulation situations for each are reported: a force-reflective manipulator, a unilateral manipulator, and the unaided human hand. The results indicate that: (1) a time-and-motion study techniques are applicable to manipulation; and that (2) force feedback facilitates some motions (notably fitting), but not others (such as positioning).

Human evaluation in association to the mathematical analysis of arch forms: Two-dimensional study.

PubMed

Zabidin, Nurwahidah; Mohamed, Alizae Marny; Zaharim, Azami; Marizan Nor, Murshida; Rosli, Tanti Irawati

2018-03-01

To evaluate the relationship between human evaluation of the dental-arch form, to complete a mathematical analysis via two different methods in quantifying the arch form, and to establish agreement with the fourth-order polynomial equation. This study included 64 sets of digitised maxilla and mandible dental casts obtained from a sample of dental arch with normal occlusion. For human evaluation, a convenient sample of orthodontic practitioners ranked the photo images of dental cast from the most tapered to the less tapered (square). In the mathematical analysis, dental arches were interpolated using the fourth-order polynomial equation with millimetric acetate paper and AutoCAD software. Finally, the relations between human evaluation and mathematical objective analyses were evaluated. Human evaluations were found to be generally in agreement, but only at the extremes of tapered and square arch forms; this indicated general human error and observer bias. The two methods used to plot the arch form were comparable. The use of fourth-order polynomial equation may be facilitative in obtaining a smooth curve, which can produce a template for individual arch that represents all potential tooth positions for the dental arch. Copyright © 2018 CEO. Published by Elsevier Masson SAS. All rights reserved.

OASIS connections: results from an evaluation study.

PubMed

Czaja, Sara J; Lee, Chin Chin; Branham, Janice; Remis, Peggy

2012-10-01

The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. The program was developed by the OASIS Institute, a nonprofit agency serving older adults and implemented in 4 cities by community trainers across the United States. One hundred and ninety-six adults aged 40-90 years were assigned to the training or a wait-list control group. Knowledge of computers and the Internet, attitudes toward computers, and computer/Internet use were assessed at baseline, posttraining, and 3 months posttraining. The program was successful in increasing the computer/Internet skills of the trainees. The data indicated a significant increase in computer and Internet knowledge and comfort with computers among those who received the training. Further, those who completed the course reported an increase in both computer and Internet use 3 months posttraining. The findings indicate that a community-based computer and Internet training program delivered by community instructors can be effective in terms of increasing computer and Internet skills and comfort with computer technology among older adults.

Evaluative judgments are based on evaluative information: Evidence against meaning change in evaluative context effects.

PubMed

Kaplan, M F

1975-07-01

Trait adjectives commonly employed in person perception studies have both evaluative and denotative meanings. Evaluative ratings of single traits shift with variations in the context of other traits ascribed to the stimulus person; the extent to which denotative changes underlie these evaluative context effects has been a theoretical controversy. In the first experiment, it was shown that context effects on quantitative ratings of denotation can be largely accounted for by evaluative halo effects. In the second experiment, increasing the denotative relatedness of context traits to the test trait didnot increase the effect of the context. Only the evaluative meaning of the context affected evaluation of the rated test trait. These studies suggest that the denotative relationship between a test adjective and its context has little influence on context effects in person perception, and that denotative meaning changes do not mediate context effects. Instead, evaluative judgments appear to be based on evaluative meaning.

Evaluating the Impact of Database Heterogeneity on Observational Study Results

PubMed Central

Madigan, David; Ryan, Patrick B.; Schuemie, Martijn; Stang, Paul E.; Overhage, J. Marc; Hartzema, Abraham G.; Suchard, Marc A.; DuMouchel, William; Berlin, Jesse A.

2013-01-01

Clinical studies that use observational databases to evaluate the effects of medical products have become commonplace. Such studies begin by selecting a particular database, a decision that published papers invariably report but do not discuss. Studies of the same issue in different databases, however, can and do generate different results, sometimes with strikingly different clinical implications. In this paper, we systematically study heterogeneity among databases, holding other study methods constant, by exploring relative risk estimates for 53 drug-outcome pairs and 2 widely used study designs (cohort studies and self-controlled case series) across 10 observational databases. When holding the study design constant, our analysis shows that estimated relative risks range from a statistically significant decreased risk to a statistically significant increased risk in 11 of 53 (21%) of drug-outcome pairs that use a cohort design and 19 of 53 (36%) of drug-outcome pairs that use a self-controlled case series design. This exceeds the proportion of pairs that were consistent across databases in both direction and statistical significance, which was 9 of 53 (17%) for cohort studies and 5 of 53 (9%) for self-controlled case series. Our findings show that clinical studies that use observational databases can be sensitive to the choice of database. More attention is needed to consider how the choice of data source may be affecting results. PMID:23648805

Public availability of results of observational studies evaluating an intervention registered at ClinicalTrials.gov.

PubMed

Baudart, Marie; Ravaud, Philippe; Baron, Gabriel; Dechartres, Agnes; Haneef, Romana; Boutron, Isabelle

2016-01-28

Observational studies are essential for assessing safety. The aims of this study were to evaluate whether results of observational studies evaluating an intervention with safety outcome(s) registered at ClinicalTrials.gov were published and, if not, whether they were available through posting on ClinicalTrials.gov or the sponsor website. We identified a cohort of observational studies with safety outcome(s) registered on ClinicalTrials.gov after October 1, 2007, and completed between October 1, 2007, and December 31, 2011. We systematically searched PubMed for a publication, as well as ClinicalTrials.gov and the sponsor website for results. The main outcomes were the time to the first publication in journals and to the first public availability of the study results (i.e. published or posted on ClinicalTrials.gov or the sponsor website). For all studies with results publicly available, we evaluated the completeness of reporting (i.e. reported with the number of events per arm) of safety outcomes. We identified 489 studies; 334 (68%) were partially or completely funded by industry. Results for only 189 (39%, i.e. 65% of the total target number of participants) were published at least 30 months after the study completion. When searching other data sources, we obtained the results for 53% (n = 158; i.e. 93% of the total target number of participants) of unpublished studies; 31% (n = 94) were posted on ClinicalTrials.gov and 21% (n = 64) on the sponsor website. As compared with non-industry-funded studies, industry-funded study results were less likely to be published but not less likely to be publicly available. Of the 242 studies with a primary outcome recorded as a safety issue, all these outcomes were adequately reported in 86% (114/133) when available in a publication, 91% (62/68) when available on ClinicalTrials.gov, and 80% (33/41) when available on the sponsor website. Only 39% of observational studies evaluating an intervention with safety outcome

Champion or Chump: Using a Book-Length Case Study to Evaluate a Mythical Principal

ERIC Educational Resources Information Center

Pace, Nicholas J.; Gilson, Timothy W.

2013-01-01

This study examined how 130 participants enrolled in the University of Northern Iowa (UNI) principalship program completed a standards-based evaluation after reading a book-length case study of a mythical principal. Application of the Iowa Standards for School Leaders (ISSL), which mirror the Interstate School Leadership Licensure Consortium…

Evaluation of emulsion emulsified by starch nanocrystal: A preliminary study

NASA Astrophysics Data System (ADS)

Ahmad, Azfar Al Ariff; Lazim, Azwan Mat

2018-04-01

The starch nanocrystals (SNC) used in this study were made of sago starch and prepared by using sulfuric acid hydrolysis of sago starch. The aim of this study is to look at the potential of SNC as and emulsifier. Previously, the SNC underwent analytical analysis in order to understand and evaluate the isolated SNC. The ability of SNC as emulsifier was further investigated in this study. Emulsions with low, medium and high oil content has been prepared in function of different wt% of SNC. The emulsion stability against coalescence for two weeks has also been studied. Results showed that the emulsions prepared are steadily stable after one weeks of storage without any separation and changes. From the observation, there are two major factor contributed to the formation of emulsion and its stability, the SNC concentration and oil content. Relatively, higher percentage of SNC resulting a higher emulsion index, whereas no emulsion was formed if oil content exceeding 50% of the systems. The most suitable formulation to prepare Pickering Emulsion is the oil content around 45% and SNC concentration around 2 - 4%.

ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

EPA Science Inventory

Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbes...

ASBESTOS IN DRINKING WATER PERFORMANCE EVALUATION STUDIES

EPA Science Inventory

Performance evaluations of laboratories testing for asbestos in drinking water according to USEPA Test Method 100.1 or 100.2 are complicated by the difficulty of providing stable sample dispersions of asbestos in water. Reference samples of a graduated series of chrysotile asbest...

Quality Attribute-Guided Evaluation of NoSQL Databases: A Case Study

DTIC Science & Technology

2015-01-16

evaluations of NoSQL databases specifically, and big data systems in general, that have become apparent during our study. Keywords—NoSQL, distributed...technology, namely that of big data , software systems [1]. At the heart of big data systems are a collection of database technologies that are more...born organizations such as Google and Amazon [3][4], along with those of numerous other big data innovators, have created a variety of open source and

The International Endometriosis Evaluation Program (IEEP Study) – A Systematic Study for Physicians, Researchers and Patients

PubMed Central

Burghaus, S.; Fehm, T.; Fasching, P. A.; Blum, S.; Renner, S. K.; Baier, F.; Brodkorb, T.; Fahlbusch, C.; Findeklee, S.; Häberle, L.; Heusinger, K.; Hildebrandt, T.; Lermann, J.; Strahl, O.; Tchartchian, G.; Bojahr, B.; Porn, A.; Fleisch, M.; Reicke, S.; Füger, T.; Hartung, C.-P.; Hackl, J.; Beckmann, M. W.; Renner, S. P.

2016-01-01

Introduction: Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. Material and Methods: To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. Results: A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. Conclusion: The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers. PMID:27582581

Brain Correlates of Self-Evaluation Deficits in Schizophrenia: A Combined Functional and Structural MRI Study

PubMed Central

Fan, Fengmei; Zou, Yizhuang; Jin, Zhen; Zen, Yawei; Zhu, Xiaolin; Yang, Fude; Tan, Yunlong; Zhou, Dongfeng

2015-01-01

Self-evaluation plays an important role in adaptive functioning and is a process that is typically impaired in patients with schizophrenia. Underlying neural mechanisms for this dysfunction may be associated with manifested psychosis. However, the brain substrates underlying this deficit are not well known. The present study used brain blood oxygen level dependent (BOLD) functional magnetic resonance imaging (fMRI) and gray matter voxel-based morphometry to explore the functional and structural brain correlates of self-evaluation deficits in schizophrenia. Eighteen patients with schizophrenia and 17 healthy controls were recruited and asked to judge whether a set of personality-trait adjectives were appropriate for describing themselves, a familiar other, or whether the adjectives were of positive or negative valence. Patients had slower response times for negative trait attributions than controls did; responses to positive trait attributions were faster than those for negative traits among the patient group, while no differences were observed in the control group. Control subjects showed greater activation within the dorsal medial prefrontal cortex (dMPFC) and the anterior cingulate cortex (ACC) than the patient group during the self-evaluation > semantic positivity-evaluation contrast. Patients showed greater activation mainly within the posterior cingulate gyrus (PCC) as compared to controls for the other-evaluation > semantic positivity-evaluation contrast. Furthermore, gray matter volume was reduced in the MPFC, temporal lobe, cuneus, and the dorsal lateral prefrontal cortex (DLPFC) among the patient group when compared to controls. The present study adds to previous findings regarding self- and other-referential processing in schizophrenia, providing support for neurobiological models of self-reflection impairment. PMID:26406464

Evaluating Training.

ERIC Educational Resources Information Center

Brethower, Karen S.; Rummler, Geary A.

1979-01-01

Presents general systems models (ballistic system, guided system, and adaptive system) and an evaluation matrix to help in examining training evaluation alternatives and in deciding what evaluation is appropriate. Includes some guidelines for conducting evaluation studies using four designs (control group, reversal, multiple baseline, and…

100-OL-1 Operable Unit Pilot Study: XRF Evaluation of Select Pre-Hanford Orchards

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bunn, Amoret L.; Fritz, Brad G.; Pulsipher, Brent A.

Prior to the acquisition of land by the U.S. Department of War in February 1943 and the creation of the Hanford Site, the land along the Columbia River was home to over 1000 people. Farming and orchard operations by both homesteaders and commercial organizations were prevalent. Orchard activities and the associated application of lead arsenate pesticide ceased in 1943, when residents were moved from the Hanford Site at the beginning of the Manhattan Project. Today, the residues from historical application of lead arsenate pesticide persist in some locations on the Hanford Site. In 2012, the U.S. Department of Energy, U.S.more » Environmental Protection Agency, and Washington State Department of Ecology established the 100-OL-1 Operable Unit (OU) through the Hanford Federal Facility Agreement and Consent Order, known as the Tri-Party Agreement. The pre-Hanford orchard lands identified as the 100-OL-1 OU are located south of the Columbia River and east of the present-day Vernita Bridge, and extend southeast to the former Hanford townsite. The discontinuous orchard lands within 100-OL-1 OU are approximately 20 km2 (5000 ac). A pilot study was conducted to support the approval of the remedial investigation/feasibility study work plan to evaluate the 100-OL-1 OU. This pilot study evaluated the use of a field portable X-ray fluorescence (XRF) analyzer for evaluating lead and arsenic concentrations on the soil surface as an indicator of lead arsenate pesticide residues in the OU. The objectives of the pilot study included evaluating a field portable XRF analyzer as the analytical method for decision making, estimating the nature and extent of lead and arsenic in surface soils in four decision units, evaluating the results for the purpose of optimizing the sampling approach implemented in the remedial investigation, and collecting information to improve the cost estimate and planning the cultural resources review for sampling activities in the remedial investigation

Mass Communication Course Evaluations: An Exploratory Study on the Effect of Gender.

ERIC Educational Resources Information Center

Lueck, Therese L.; And Others

An exploratory study examined the effect of gender on student evaluation ratings of journalism and mass communication instructors. Subjects were 8 professors (4 male and 4 female) who represented a wide range of teaching experience and taught a total of 243 students (108 women and 135 men) in 10 different types of classrooms. A total of 241…

User embracement with risk classification in an emergency care unit: an evaluative study.

PubMed

Hermida, Patrícia Madalena Vieira; Nascimento, Eliane Regina Pereira do; Echevarría-Guanilo, Maria Elena; Brüggemann, Odaléa Maria; Malfussi, Luciana Bihain Hagemann de

2018-01-01

Objective Describing the evaluation of the Structure, Process and Outcome of User Embracement with Risk Classification of an Emergency Care Unit from the perspective of physicians and nurses. Method An evaluative, descriptive, quantitative study developed in Santa Catarina. Data were collected using a validated and adapted instrument consisting of 21 items distributed in the dimensions of Structure (facilities), Process (activities and relationships in providing care) and Outcome (care effects). In the analysis, descriptive statistics and the Mean Ranking and Mean Score calculations were applied. Results The sample consisted of 37 participants. From the 21 evaluated items, 11 (52.4%) had a Mean Ranking between 3 and 4, and none of them reached the maximum ranking (5 points). "Prioritization of severe cases" and "Primary care according to the severity of the case" reached a higher Mean Ranking (4.5), while "Flowchart discussion" had the lowest Ranking (2.1). The dimensions of Structure, Process and Outcome reached mean scores of 23.9, 21.9 and 25.5, respectively, indicating a Precarious evaluation (17.5 to 26.1 points). Conclusion User Embracement with Risk Classification is precarious, especially regarding the Process which obtained a lower satisfaction level from the participants.

Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations.

PubMed

Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C

2015-03-10

In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross

Evaluating interactive technology for an evolving case study on learning and satisfaction of graduate nursing students.

PubMed

Vogt, Marjorie A; Schaffner, Barbara H

2016-07-01

Nursing education is challenged to prepare students for complex healthcare needs through the integration of teamwork and informatics. Technology has become an important teaching tool in the blended classroom to enhance group based learning experiences. Faculty evaluation of classroom technologies is imperative prior to adoption. Few studies have directly compared various technologies and their impact on student satisfaction and learning. The purpose of this study was to evaluate technology enhanced teaching methods on the learning and satisfaction of graduate students in an advanced pharmacology class using an unfolding case study. After IRB approval, students were randomly assigned to one of three groups: blogging group, wiki group or webinar group. Students completed the evolving case study using the assigned interactive technology. Student names were removed from the case studies. Faculty evaluated the case study using a rubric, while blinded to the assigned technology method used. No significant difference was found on case study grades, the range of grades on the assignment demonstrated little differences between the methods used. Students indicated an overall positive impact related to networking and collaboration on a satisfaction survey. Impact of technology methods needs to be explored in other areas of graduate nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Smartphone Apps for Cardiopulmonary Resuscitation Training and Real Incident Support: A Mixed-Methods Evaluation Study

PubMed Central

Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-01-01

Background No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. Objective The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Methods Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Results Out of 61 apps, 46 were included in the experts’ evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Conclusions Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support. PMID:24647361

Smartphone apps for cardiopulmonary resuscitation training and real incident support: a mixed-methods evaluation study.

PubMed

Kalz, Marco; Lenssen, Niklas; Felzen, Marc; Rossaint, Rolf; Tabuenca, Bernardo; Specht, Marcus; Skorning, Max

2014-03-19

No systematic evaluation of smartphone/mobile apps for resuscitation training and real incident support is available to date. To provide medical, usability, and additional quality criteria for the development of apps, we conducted a mixed-methods sequential evaluation combining the perspective of medical experts and end-users. The study aims to assess the quality of current mobile apps for cardiopulmonary resuscitation (CPR) training and real incident support from expert as well as end-user perspective. Two independent medical experts evaluated the medical content of CPR apps from the Google Play store and the Apple App store. The evaluation was based on pre-defined minimum medical content requirements according to current Basic Life Support (BLS) guidelines. In a second phase, non-medical end-users tested usability and appeal of the apps that had at least met the minimum requirements. Usability was assessed with the System Usability Scale (SUS); appeal was measured with the self-developed ReactionDeck toolkit. Out of 61 apps, 46 were included in the experts' evaluation. A consolidated list of 13 apps resulted for the following layperson evaluation. The interrater reliability was substantial (kappa=.61). Layperson end-users (n=14) had a high interrater reliability (intraclass correlation 1 [ICC1]=.83, P<.001, 95% CI 0.75-0.882 and ICC2=.79, P<.001, 95% CI 0.695-0.869). Their evaluation resulted in a list of 5 recommendable apps. Although several apps for resuscitation training and real incident support are available, very few are designed according to current BLS guidelines and offer an acceptable level of usability and hedonic quality for laypersons. The results of this study are intended to optimize the development of CPR mobile apps. The app ranking supports the informed selection of mobile apps for training situations and CPR campaigns as well as for real incident support.

Study design in medical research: part 2 of a series on the evaluation of scientific publications.

PubMed

Röhrig, Bernd; du Prel, Jean-Baptist; Blettner, Maria

2009-03-01

The scientific value and informativeness of a medical study are determined to a major extent by the study design. Errors in study design cannot be corrected afterwards. Various aspects of study design are discussed in this article. Six essential considerations in the planning and evaluation of medical research studies are presented and discussed in the light of selected scientific articles from the international literature as well as the authors' own scientific expertise with regard to study design. The six main considerations for study design are the question to be answered, the study population, the unit of analysis, the type of study, the measuring technique, and the calculation of sample size. This article is intended to give the reader guidance in evaluating the design of studies in medical research. This should enable the reader to categorize medical studies better and to assess their scientific quality more accurately.

Basic Exploratory Research versus Guideline-Compliant Studies Used for Hazard Evaluation and Risk Assessment: Bisphenol A as a Case Study

PubMed Central

Tyl, Rochelle W.

2009-01-01

Background Myers et al. [Environ Health Perspect 117:309–315 (2009)] argued that Good Laboratory Practices (GLPs) cannot be used as a criterion for selecting data for risk assessment, using bisphenol A (BPA) as a case study. They did not discuss the role(s) of guideline-compliant studies versus basic/exploratory research studies, and they criticized both GLPs and guideline-compliant studies and their roles in formal hazard evaluation and risk assessment. They also specifically criticized our published guideline-compliant dietary studies on BPA in rats and mice and 17β-estradiol (E2) in mice. Objectives As the study director/first author of the criticized E2 and BPA studies, I discuss the uses of basic research versus guideline-compliant studies, how testing guidelines are developed and revised, how new end points are validated, and the role of GLPs. I also provide an overview of the BPA guideline-compliant and exploratory research animal studies and describe BPA pharmacokinetics in rats and humans. I present responses to specific criticisms by Myers et al. Discussion and conclusions Weight-of-evidence evaluations have consistently concluded that low-level BPA oral exposures do not adversely affect human developmental or reproductive health, and I encourage increased validation efforts for “new” end points for inclusion in guideline studies, as well as performance of robust long-term studies to follow early effects (observed in small exploratory studies) to any adverse consequences. PMID:20049112

Evaluation of irregular menses in perimenarcheal girls: a pilot study.

PubMed

Browner-Elhanan, Karen J; Epstein, Jonathan; Alderman, Elizabeth M

2003-12-01

Acyclic vaginal bleeding in girls within three years of menarche is most commonly attributed to an immature hypothalamic-pituitary-ovarian axis. Assuming this diagnosis may preclude the practitioner from performing more definitive studies and thereby diagnosing other, treatable causes of menstrual irregularities. A retrospective chart review of 178 girls presenting to an inner-city hospital-based adolescent clinic within three years of menarche was performed. Personal and family medical and menarcheal history was assessed, and findings on physical and laboratory examination performed were evaluated. Of the 178 girls still perimenarcheal at presentation, 47 were the focus of this study. Of these, 39 had no significant findings on physical examination, while 3 had signs of functional ovarian hyperandrogenism (FOH) including obesity, hirsutism, and moderate acne with corresponding LH/FSH ratios>3, although pelvic ultrasound examination revealed normal ovaries. Four of the 39 patients with normal physical exams had LH/FSH testing done, and 1 of the 4 had an abnormal LH/FSH ratio, indicating possible FOH. Two of the 47 patients were pregnant. Other laboratory abnormalities included microcytic, hypochromic anemia in patients, and an elevated Erythrocyte Sedimentation Rate in a patient later diagnosed with a rheumatologic disorder. Those perimenarcheal girls presenting with irregular menses and findings including obesity, acne, or pallor, were likely to have treatable causes of menstrual irregularities. In one of the four girls with a normal physical examination, hormonal testing indicated possible FOH, thus suggesting that hormonal evaluation of perimenarcheal girls with menstrual irregularities may be justified, as it may reveal previously unsuspected pathology.

77 FR 5850 - Notice of Random Assignment Study To Evaluate Workforce Investment Act Adult and Dislocated...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-06

...: One commenter was concerned about 50 percent of the participants being placed in a control group. The... impact methodology for the evaluation. The design of the study was described as follows: The evaluation... eligible for intensive services would be randomly assigned to one of three groups. The three research...

Improving Beta Test Evaluation Response Rates: A Meta-Evaluation

ERIC Educational Resources Information Center

Russ-Eft, Darlene; Preskill, Hallie

2005-01-01

This study presents a meta-evaluation of a beta-test of a customer service training program. The initial evaluation showed a low response rate. Therefore, the meta-evaluation focused on issues related to the conduct of the initial evaluation and reasons for nonresponse. The meta-evaluation identified solutions to the nonresponse problem as related…

Design and Implementation of a Multi-Strategy, Collegewide Program of Evaluation and Planning: The Mercy College Self-Study Project.

ERIC Educational Resources Information Center

Kraetzer, Mary C.; And Others

The rationale, strategies, and methods of The Mercy College Self-Study Project are considered, and evaluation instruments are provided. This program of institutional evaluation and planning was initiated in 1980 and consists of: standardized surveys, a 10-year longitudinal (panel) study, and academic department self-studies. Questionnaires…

Study on process evaluation model of students' learning in practical course

NASA Astrophysics Data System (ADS)

Huang, Jie; Liang, Pei; Shen, Wei-min; Ye, Youxiang

2017-08-01

In practical course teaching based on project object method, the traditional evaluation methods include class attendance, assignments and exams fails to give incentives to undergraduate students to learn innovatively and autonomously. In this paper, the element such as creative innovation, teamwork, document and reporting were put into process evaluation methods, and a process evaluation model was set up. Educational practice shows that the evaluation model makes process evaluation of students' learning more comprehensive, accurate, and fairly.

Quality Evaluation Scores are no more Reliable than Gestalt in Evaluating the Quality of Emergency Medicine Blogs: A METRIQ Study.

PubMed

Thoma, Brent; Sebok-Syer, Stefanie S; Colmers-Gray, Isabelle; Sherbino, Jonathan; Ankel, Felix; Trueger, N Seth; Grock, Andrew; Siemens, Marshall; Paddock, Michael; Purdy, Eve; Kenneth Milne, William; Chan, Teresa M

2018-01-30

Construct: We investigated the quality of emergency medicine (EM) blogs as educational resources. Online medical education resources such as blogs are increasingly used by EM trainees and clinicians. However, quality evaluations of these resources using gestalt are unreliable. We investigated the reliability of two previously derived quality evaluation instruments for blogs. Sixty English-language EM websites that published clinically oriented blog posts between January 1 and February 24, 2016, were identified. A random number generator selected 10 websites, and the 2 most recent clinically oriented blog posts from each site were evaluated using gestalt, the Academic Life in Emergency Medicine (ALiEM) Approved Instructional Resources (AIR) score, and the Medical Education Translational Resources: Impact and Quality (METRIQ-8) score, by a sample of medical students, EM residents, and EM attendings. Each rater evaluated all 20 blog posts with gestalt and 15 of the 20 blog posts with the ALiEM AIR and METRIQ-8 scores. Pearson's correlations were calculated between the average scores for each metric. Single-measure intraclass correlation coefficients (ICCs) evaluated the reliability of each instrument. Our study included 121 medical students, 88 EM residents, and 100 EM attendings who completed ratings. The average gestalt rating of each blog post correlated strongly with the average scores for ALiEM AIR (r = .94) and METRIQ-8 (r = .91). Single-measure ICCs were fair for gestalt (0.37, IQR 0.25-0.56), ALiEM AIR (0.41, IQR 0.29-0.60) and METRIQ-8 (0.40, IQR 0.28-0.59). The average scores of each blog post correlated strongly with gestalt ratings. However, neither ALiEM AIR nor METRIQ-8 showed higher reliability than gestalt. Improved reliability may be possible through rater training and instrument refinement.

Economic evaluation and the Jordan Rational Drug List: an exploratory study of national-level priority setting.

PubMed

Lafi, Rania; Robinson, Suzanne; Williams, Iestyn

2012-01-01

To explore the extent of and barriers to the use of economic evaluation in compiling the Jordan Rational Drug List in the health care system of Jordan. The research reported in this article involved a case study of the Jordan Rational Drug List. Data collection methods included semi-structured interviews with decision makers and analysis of secondary documentary sources. The case study was supplemented by additional interviews with a small number of Jordanian academics involved in the production of economic evaluation. The research found that there was no formal requirement for cost-effectiveness information submitted as part of the decision-making process for the inclusion of new technologies on the Jordan Rational Drug List. Both decision makers and academics suggested that economic evidence was not influential in formulary decisions. This is unusual for national formulary bodies. The study identified a number of barriers that prevent substantive and routine use of economic evaluation. While some of these echo findings of previous studies, others-notably the extent to which the sectional interests of clinical groups and commercial (pharmaceutical) industry exert undue influence over decision making-more obviously result from the specific Jordanian context. Economic evaluation was not found to be influential in the Jordan Rational Drug List. Recommendations for improvement include enhancing capacity in relation to generating, accessing, and/or applying health economic analysis to priority setting decisions. There is a further need to incentivize the use of economic evaluation, and this requires that organizational and structural impediments be removed. Copyright © 2012 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Comparative approaches from empirical to mechanistic simulation modelling in Land Evaluation studies

NASA Astrophysics Data System (ADS)

Manna, P.; Basile, A.; Bonfante, A.; Terribile, F.

2009-04-01

The Land Evaluation (LE) comprise the evaluation procedures to asses the attitudes of the land to a generic or specific use (e.g. biomass production). From local to regional and national scale the approach to the land use planning should requires a deep knowledge of the processes that drive the functioning of the soil-plant-atmosphere system. According to the classical approaches the assessment of attitudes is the result of a qualitative comparison between the land/soil physical properties and the land use requirements. These approaches have a quick and inexpensive applicability; however, they are based on empirical and qualitative models with a basic knowledge structure specifically built for a specific landscape and for the specific object of the evaluation (e.g. crop). The outcome from this situation is the huge difficulties in the spatial extrapolation of the LE results and the rigidity of the system. Modern techniques instead, rely on the application of mechanistic and quantitative simulation modelling that allow a dynamic characterisation of the interrelated physical and chemical processes taking place in the soil landscape. Moreover, the insertion of physical based rules in the LE procedure may make it less difficult in terms of both extending spatially the results and changing the object (e.g. crop species, nitrate dynamics, etc.) of the evaluation. On the other side these modern approaches require high quality and quantity of input data that cause a significant increase in costs. In this scenario nowadays the LE expert is asked to choose the best LE methodology considering costs, complexity of the procedure and benefits in handling a specific land evaluation. In this work we performed a forage maize land suitability study by comparing 9 different methods having increasing complexity and costs. The study area, of about 2000 ha, is located in North Italy in the Lodi plain (Po valley). The range of the 9 employed methods ranged from standard LE approaches to