Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature.

PubMed

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability.

Using theory of change to design and evaluate public health interventions: a systematic review.

PubMed

Breuer, Erica; Lee, Lucy; De Silva, Mary; Lund, Crick

2016-05-06

Despite the increasing popularity of the theory of change (ToC) approach, little is known about the extent to which ToC has been used in the design and evaluation of public health interventions. This review aims to determine how ToCs have been developed and used in the development and evaluation of public health interventions globally. We searched for papers reporting the use of "theory of change" in the development or evaluation of public health interventions in databases of peer-reviewed journal articles such as Scopus, Pubmed, PsychInfo, grey literature databases, Google and websites of development funders. We included papers of any date, language or study design. Both abstracts and full text papers were double screened. Data were extracted and narratively and quantitatively summarised. A total of 62 papers were included in the review. Forty-nine (79 %) described the development of ToC, 18 (29 %) described the use of ToC in the development of the intervention and 49 (79 %) described the use of ToC in the evaluation of the intervention. Although a large number of papers were included in the review, their descriptions of the ToC development and use in intervention design and evaluation lacked detail. The use of the ToC approach is widespread in the public health literature. Clear reporting of the ToC process and outputs is important to strengthen the body of literature on practical application of ToC in order to develop our understanding of the benefits and advantages of using ToC. We also propose a checklist for reporting on the use of ToC to ensure transparent reporting and recommend that our checklist is used and refined by authors reporting the ToC approach.

75 FR 51082 - Center for Scientific Review; Notice of Closed Meetings

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-18

...: Muscle Biology. Date: September 8, 2010. Time: 11 a.m. to 3 p.m. Agenda: To review and evaluate grant...: Technology Development for High-Throughput Structural Biology Research Review. Date: September 14-15, 2010...: Biology of Development and Aging Integrated Review Group; Development--1 Study Section. Date: September 30...

Developing and Implementing a Process for the Review of Nonacademic Units.

ERIC Educational Resources Information Center

Brown, Marilyn K.

1989-01-01

A major research university's recently developed process for systematic evaluation of nonacademic units is described, and the steps in its development and implementation are outlined: review of literature on organizational effectiveness; survey of peer institutions; development of guidelines for review; and implementation in several campus units.…

Advances in Degradable Embolic Microspheres: A State of the Art Review

PubMed Central

Doucet, Jensen; Kiri, Lauren; O’Connell, Kathleen; Kehoe, Sharon; Lewandowski, Robert J.; Liu, David M.; Abraham, Robert J.; Boyd, Daniel

2018-01-01

Considerable efforts have been placed on the development of degradable microspheres for use in transarterial embolization indications. Using the guidance of the U.S. Food and Drug Administration (FDA) special controls document for the preclinical evaluation of vascular embolization devices, this review consolidates all relevant data pertaining to novel degradable microsphere technologies for bland embolization into a single reference. This review emphasizes intended use, chemical composition, degradative mechanisms, and pre-clinical safety, efficacy, and performance, while summarizing the key advantages and disadvantages for each degradable technology that is currently under development for transarterial embolization. This review is intended to provide an inclusive reference for clinicians that may facilitate an understanding of clinical and technical concepts related to this field of interventional radiology. For materials scientists, this review highlights innovative devices and current evaluation methodologies (i.e., preclinical models), and is designed to be instructive in the development of innovative/new technologies and evaluation methodologies. PMID:29373510

The Development of E-Portfolio Evaluation Criteria and Application to the Blackboard LMS E-Portfolio

ERIC Educational Resources Information Center

McKenna, Gary F.; Stansfield, Mark H.

2012-01-01

The purpose of this paper is to develop e-portfolio evaluation criteria which will be used to review the Blackboard LMS e-portfolio being used at one Higher Education (HE) institution in the UK as evaluation criteria for reviewing e-portfolio provision does not exist in the literature. The approach taken was to initiate a wide literature search…

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2014 CFR

2014-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2012 CFR

2012-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2013 CFR

2013-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

7 CFR 246.19 - Management evaluation and monitoring reviews.

Code of Federal Regulations, 2011 CFR

2011-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE CHILD NUTRITION PROGRAMS SPECIAL SUPPLEMENTAL NUTRITION PROGRAM FOR WOMEN, INFANTS AND CHILDREN Monitoring and Review § 246.19 Management evaluation and monitoring reviews... reports, the development of corrective action plans to resolve Program deficiencies, the monitoring of the...

Development, implementation and evaluation of a peer review of teaching (PRoT) initiative in nursing education.

PubMed

Mager, Diana R; Kazer, Meredith W; Conelius, Jaclyn; Shea, Joyce; Lippman, Doris T; Torosyan, Roben; Nantz, Kathryn

2014-06-03

For many years, an area of research in higher education has been emerging around the development and implementation of fair and effective peer evaluation programs. Recently, a new body of knowledge has developed regarding the development and implementation of fair and effective peer evaluation programs resulting in formative and summative evaluations. The purpose of this article is to describe the development, implementation, and evaluation of a peer review of teaching (PRoT) program for nursing faculty, initiated at one small comprehensive university in the northeastern United States. Pairs of nursing faculty evaluated each other's teaching, syllabi, and course materials after collaborating in a pre-evaluation conference to discuss goals of the classroom visit. Qualitative data gathered in post project focus groups revealed that faculty found their modified PRoT process to be a mutually beneficial experience that was more useful, flexible and collegial, and less stressful than their previous evaluation process.

Evaluation systems for clinical governance development: a comparative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.

Materials Development for Language Learning and Teaching

ERIC Educational Resources Information Center

Tomlinson, Brian

2012-01-01

This article reviews the literature on the relatively new field of materials development for language learning and teaching. It reports the origins and development of the field and then reviews the literature on the evaluation, adaptation, production and exploitation of learning materials. It also reviews the literature, first, on a number of…

Development and Psychometric Evaluation of the Counseling Women Competencies Scale (CWCS)

ERIC Educational Resources Information Center

Ancis, Julie R.; Szymanski, Dawn M.; Ladany, Nicholas

2008-01-01

This article describes the development and psychometric evaluation of the Counseling Women Competencies Scale (CWCS). The CWCS is designed to assess clinicians' self-perceived competencies with regard to therapeutic practice with diverse female clients. Through an extensive review of the literature on counseling women and expert review by 32…

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

PubMed Central

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R.; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability. PMID:28443022

Evaluating trauma nursing education: An integrative literature review.

PubMed

Ding, Min; Metcalfe, Helene; Gallagher, Olivia; Hamdorf, Jeffrey M

2016-09-01

A review of the current literature evaluating trauma nursing education. A variety of trauma nursing courses exist, to educate nurses working in trauma settings, and to maintain their continuing professional development. Despite an increase in the number of courses delivered, there appears to be a lack of evidence to demonstrate the effectiveness of trauma nursing education and in particular the justification for this resource allocation. Integrative literature review. A search of international literature on trauma nursing education evaluation published in English from 1985 to 2015 was conducted through electronic databases CINAHL Plus, Google Scholar, PubMed, Austhealth, Science Citation Index Expanded (Web of Science), Sciverse Science Direct (Elsevier) & One file (Gale). Only peer reviewed journal articles identifying trauma course and trauma nursing course evaluation have been included in the selection criteria. An integrative review of both quantitative and qualitative literature guided by Whittemore and Knafl's theoretical framework using Bowling's and Pearson's validated appraisal checklists, has been conducted for three months. Only 17 studies met the inclusion criteria, including 14 on trauma course evaluation and 3 on trauma nursing course evaluation. Study findings are presented as two main themes: the historical evolution of trauma nursing education and evaluation of trauma nursing education outcomes. Trauma nursing remains in its infancy and education in this specialty is mainly led by continuing professional development courses. The shortage of evaluation studies on trauma nursing courses reflects the similar status in continuing professional development course evaluation. A trauma nursing course evaluation study will address the gap in this under researched area. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation in Human Resource Development.

ERIC Educational Resources Information Center

1999

These four papers are from a symposium on evaluation in human resource development (HRD). "Assessing Organizational Readiness for Learning through Evaluative Inquiry" (Hallie Preskill, Rosalie T. Torres) reviews how evaluative inquiry can facilitate organizational learning; argues HRD evaluation should be reconceptualized as a process…

The Evaluation of Physical Learning Environments: A Critical Review of the Literature

ERIC Educational Resources Information Center

Cleveland, Benjamin; Fisher, Kenn

2014-01-01

This article critically reviews the methodologies and methods that have been used for the evaluation of physical learning environments. To contextualize discussion about the evaluation of learning spaces, we initially chart the development of post-occupancy evaluation (POE) for non-domestic buildings. We then discuss the recent evolution of POE…

Laser/Optical Data Base Products: Evaluation and Selection.

ERIC Educational Resources Information Center

Nicholls, Paul Travis

1988-01-01

The practical advice for the evaluation of laser/optical data disk materials (e.g., CD-ROM) is based on a review of the relevant literature. An evaluation framework is outlined and collection development tools and sources of published reviews are identified. (34 references) (Author/CLB)

77 FR 64354 - Agency Information Collection Activities; Submission for OMB Review; Comment Request; Self...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-19

... development assistance, and other services (including seed capital microgrants) to help them become more... for OMB Review; Comment Request; Self-Employment Training Demonstration Evaluation ACTION: Notice... Evaluation,'' to the Office of Management and Budget (OMB) for review and approval for use in accordance with...

A Review of Findings from Two-Way Bilingual Education Evaluation Reports.

ERIC Educational Resources Information Center

Mahrer, Cindy; Christian, Donna

A review of 35 reports evaluating 27 two-way bilingual education programs is reported. All programs represented meet basic criteria for language of instruction, student characteristics, and emphasis on developing bilingualism. The review examined program characteristics and student outcomes, when available. Results are summarized in the following…

Development of a Postacute Hospital Item Bank for the New Pediatric Evaluation of Disability Inventory-Computer Adaptive Test

ERIC Educational Resources Information Center

Dumas, Helene M.

2010-01-01

The PEDI-CAT is a new computer adaptive test (CAT) version of the Pediatric Evaluation of Disability Inventory (PEDI). Additional PEDI-CAT items specific to postacute pediatric hospital care were recently developed using expert reviews and cognitive interviewing techniques. Expert reviews established face and construct validity, providing positive…

Review on Rapid Seismic Vulnerability Assessment for Bulk of Buildings

NASA Astrophysics Data System (ADS)

Nanda, R. P.; Majhi, D. R.

2013-09-01

This paper provides a brief overview of rapid visual screening (RVS) procedures available in different countries with a comparison among all the methods. Seismic evaluation guidelines from, USA, Canada, Japan, New Zealand, India, Europe, Italy, UNDP, with other methods are reviewed from the perspective of their applicability to developing countries. The review shows clearly that some of the RVS procedures are unsuited for potential use in developing countries. It is expected that this comparative assessment of various evaluation schemes will help to identify the most essential components of such a procedure for use in India and other developing countries, which is not only robust, reliable but also easy to use with available resources. It appears that Federal Emergency Management Agency (FEMA) 154 and New Zealand Draft Code approaches can be suitably combined to develop a transparent, reasonably rigorous and generalized procedure for seismic evaluation of buildings in developing countries.

Peer Reviewers' Dilemmas: Values Antinomies when Evaluating Higher Education Institutions

ERIC Educational Resources Information Center

Patry, Jean-Luc; Gastager, Angela

2012-01-01

Whenever evaluations are done, there are antinomies of interests both within and between stakeholders. To account for such antinomies, taxonomy has been developed which will be presented and discussed using the peer review processes in university evaluations as example. The taxonomy contains four dimensions: a) seven values domains are…

Developing an English Language Textbook Evaluation Checklist

ERIC Educational Resources Information Center

Mukundan, Jayakaran; Hajimohammadi, Reza; Nimehchisalem, Vahid

2011-01-01

The paper describes the considerations that were taken into account in the development of a tentative English language textbook evaluation checklist. A brief review of the related literature precedes the crucial issues that should be considered in developing checklists. In the light of the previous evaluation checklists the developers created a…

Reflections and Future Prospects for Evaluation in Human Resource Development

ERIC Educational Resources Information Center

Han, Heeyoung; Boulay, David

2013-01-01

Human resource development (HRD) evaluation has often been criticized for its limited function in organizational decision making. This article reviews evaluation studies to uncover the current status of HRD evaluation literature. The authors further discuss general evaluation theories in terms of value, use, and evaluator role to extend the…

The Science Consistency Review A Tool To Evaluate the Use of Scientific Information in Land Management Decisionmaking

Treesearch

James M. Guldin; David Cawrse; Russell Graham; Miles Hemstrom; Linda Joyce; Steve Kessler; Ranotta McNair; George Peterson; Charles G. Shaw; Peter Stine; Mark Twery; Jeffrey Walter

2003-01-01

The paper outlines a process called the science consistency review, which can be used to evaluate the use of scientific information in land management decisions. Developed with specific reference to land management decisions in the U.S. Department of Agriculture Forest Service, the process involves assembling a team of reviewers under a review administrator to...

2012 Wind Program Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zayas, Jose; Higgins, Mark

2012-06-01

This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

78 FR 29371 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-20

...: National Institute of Child Health and Human Development Initial Review Group; Population Sciences...: National Institute of Child Health and Human Development Initial Review Group; Biobehavioral and Behavioral Sciences Subcommittee. Date: June 27, 2013. Time: 9:00 a.m. to 5:00 p.m. Agenda: To review and evaluate...

Opening the black box of ethics policy work: evaluating a covert practice.

PubMed

Frolic, Andrea; Drolet, Katherine; Bryanton, Kim; Caron, Carole; Cupido, Cynthia; Flaherty, Barb; Fung, Sylvia; McCall, Lori

2012-01-01

Hospital ethics committees (HECs) and ethicists generally describe themselves as engaged in four domains of practice: case consultation, research, education, and policy work. Despite the increasing attention to quality indicators, practice standards, and evaluation methods for the other domains, comparatively little is known or published about the policy work of HECs or ethicists. This article attempts to open the "black box" of this health care ethics practice by providing two detailed case examples of ethics policy reviews. We also describe the development and application of an evaluation strategy to assess the quality of ethics policy review work, and to enable continuous improvement of ethics policy review processes. Given the potential for policy work to impact entire patient populations and organizational systems, it is imperative that HECs and ethicists develop clearer roles, responsibilities, procedural standards, and evaluation methods to ensure the delivery of consistent, relevant, and high-quality ethics policy reviews.

Positive Youth Development through an Outdoor Physical Activity Programme: Evidence from a Four-Year Evaluation

ERIC Educational Resources Information Center

Armour, Kathleen; Sandford, Rachel

2013-01-01

In 2006, Sandford, Armour and Warmington undertook a comprehensive review of the literature on the role of physical activity/sport and physical education in promoting positive development for disaffected youth. This paper revisits the findings of the literature review in light of data from a four-year evaluation of one corporate-sponsored physical…

A Review of Self-Regulated Strategy Development for Writing for Students with EBD

ERIC Educational Resources Information Center

Sreckovic, Melissa A.; Common, Eric A.; Knowles, Meagan M.; Lane, Kathleen Lynne

2014-01-01

In this systematic review, we evaluated the evidence base of self-regulated strategy development (SRSD; Harris & Graham, 1992) for writing with students with and at risk for emotional or behavioral disorders (EBD). First, we evaluated the quality of studies identified (n 5 13) by applying the quality indicators for single case (Horner et al.,…

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

In December 2016, EPA finalized its Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide. EPA’s evaluation was reviewed internally by EPA and by other federal agencies and White House Offices in October 2016, before public release. Consistent with the May 2009 IRIS assessment development process, all written comments on IRIS assessments submitted by other federal agencies and White House Offices are made publicly available. Accordingly, interagency comments and the interagency science discussion materials provided to other agencies, including interagency review drafts of the EPA’s Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide, are posted on this site. Note: No major science comments were received on the Interagency Science Discussion Draft. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. Consistent with the May 2009 IRIS assessment development process, all written comments on IRIS assessments submitted by other federal agencies and White House Offices are made publicly available. Accordingly, interagency comments and the interagency science consultation materials provided to other agencies, including interagency review drafts of the IRIS Toxicological Review of Ammonia and the charge to external peer reviewers, are posted on this site.

Development and evaluation of online evidence based guideline bank system.

PubMed

Park, Myonghwa

2006-01-01

The purpose of this study was to develop and evaluate the online evidence-based nursing practice guideline bank system to support the best evidence-based decision in the clinical and community practice settings. The main homepage consisted of seven modules for introduction of site, EBN, guideline bank, guideline development, guideline review, related sites, and community. The major contents in the guidelines were purpose, developer, intended audience, method of development, target population, testing, knowledge components, and evaluation. Electronic versions of the guidelines were displayed by XML, PDF, and PDA versions. The system usability were evaluated by general users, guideline developers, and guideline reviewers on the web and the results showed high scores of satisfaction. This online evidence-based guideline bank system could support nurses' best and cost-effective clinical decision using the sharable standardized guidelines with education module of evidence based nursing.

Agriculture, food, and nutrition interventions that facilitate sustainable food production and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-08-01

Objectives To identify the agriculture, food, and nutrition security interventions that facilitate sustainable food production and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 17 databases and 10 websites. The search employed a pre-defined protocol with clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese between 1 January 1997 and November 2013 were included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Fifteen systematic reviews and seven economic evaluations met the inclusion criteria. All interventions had some impact on health or on risk factors for health outcomes, except those related to genetically modified foods. Impact on health inequalities was rarely measured. All interventions with economic evaluations were very cost-effective, had cost savings, or net benefits. In addition to impacting health (inclusive social development), all interventions had the potential to impact on inclusive economic development, and some, on environmental sustainability, though these effects were rarely assessed. Conclusions What is needed now is careful implementation of interventions with expected positive health impacts but with concurrent, rigorous evaluation. Possible impact on health inequalities needs to be considered and measured by future primary studies and systematic reviews, as does impact of interventions on all dimensions of sustainable development.

Special issue on the teenage brain: Sensitivity to social evaluation

PubMed Central

Somerville, Leah H.

2013-01-01

Relative to childhood, peer relationships take on a heightened importance during adolescence. Might adolescents be highly attuned to information that concerns when and how they are being evaluated, and what their peers think of them? This review evaluates how continuing brain development - which influences brain function - partially explains or reflects adolescents’ attunement to social evaluation. Though preliminary, evidence is mounting to suggest that while processing information relevant to social evaluation and the internal states of other people, adolescents respond with greater emotional intensity and corresponding nonlinear recruitment of socioaffective brain circuitry. This review highlights research findings that relate trajectories of brain development and social behavior, and discusses promising avenues of future research that will inform how brain development might lead adolescents sensitized to social evaluation. PMID:24761055

Education and Training Officer Utilization Field (AFSC 75XX).

DTIC Science & Technology

1986-01-01

completion of education, training, or achievements analyze or review attrition statistics These tasks account for 10 percent of the Admissions Staff Officers...from national or local media 4 15 analyze or review attrition statistics evaluate student administration recommend actions to take concerning student...productions develop or modify textbooks evaluate or approve student coursebooks or workbooks evaluate or approve student handbooks evaluate problems

A Systematic Literature Review of Faculty Development for Teacher Educators

ERIC Educational Resources Information Center

Phuong, Tam T.; Cole, S. Catherine; Zarestky, Jill

2018-01-01

Although ample literature exists regarding the effectiveness of faculty development (FD) activities, there is a gap in the literature synthesizing its outcomes. This review, using a predetermined review protocol, analyzed 22 publications on FD for teacher educators using Kirkpatrick's training evaluation taxonomy. We found that North American…

IRIS Toxicological Review and Summary Documents for Vinyl Chloride (External Review Draft)

EPA Science Inventory

The Draft Toxicological Review was developed to evaluate both the cancer and non cancer human health risks from environmental exposure to vinyl chloride. A reference concentration (RfC), and a reference dose (RfD) were developed based upon induction of liver cell polymorphism in ...

25 CFR 224.135 - Under what circumstances may the Director conduct additional reviews and evaluations?

Code of Federal Regulations, 2011 CFR

2011-04-01

... DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews § 224.135 Under what circumstances may the Director... submitted under subpart E of this part; (d) As follow-up to a determination that harm or the potential for harm to a physical trust asset, previously identified in a periodic review and evaluation, exists; or...

25 CFR 224.135 - Under what circumstances may the Director conduct additional reviews and evaluations?

Code of Federal Regulations, 2014 CFR

2014-04-01

... DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews § 224.135 Under what circumstances may the Director... submitted under subpart E of this part; (d) As follow-up to a determination that harm or the potential for harm to a physical trust asset, previously identified in a periodic review and evaluation, exists; or...

25 CFR 224.135 - Under what circumstances may the Director conduct additional reviews and evaluations?

Code of Federal Regulations, 2012 CFR

2012-04-01

... DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews § 224.135 Under what circumstances may the Director... submitted under subpart E of this part; (d) As follow-up to a determination that harm or the potential for harm to a physical trust asset, previously identified in a periodic review and evaluation, exists; or...

25 CFR 224.135 - Under what circumstances may the Director conduct additional reviews and evaluations?

Code of Federal Regulations, 2013 CFR

2013-04-01

... DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews § 224.135 Under what circumstances may the Director... submitted under subpart E of this part; (d) As follow-up to a determination that harm or the potential for harm to a physical trust asset, previously identified in a periodic review and evaluation, exists; or...

77 FR 52318 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development; Study...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-29

... DEPARTMENT OF EDUCATION Notice of Submission for OMB Review; Office of Planning, Evaluation and..., including technical assistance to improve the quality of evaluations and performance reporting; and how to.... Department of Education, 400 Maryland Avenue SW., LBJ, Washington, DC 20202-4537. Copies of the proposed...

77 FR 52707 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development; Study...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-30

... DEPARTMENT OF EDUCATION Notice of Submission for OMB Review; Office of Planning, Evaluation and..., including technical assistance to improve the quality of evaluations and performance reporting; and how to.... Department of Education, 400 Maryland Avenue SW, LBJ, Washington, DC 20202-4537. Copies of the proposed...

THE ATMOSPHERIC MODEL EVALUATION TOOL (AMET); AIR QUALITY MODULE

EPA Science Inventory

This presentation reviews the development of the Atmospheric Model Evaluation Tool (AMET) air quality module. The AMET tool is being developed to aid in the model evaluation. This presentation focuses on the air quality evaluation portion of AMET. Presented are examples of the...

A Systematic Literature Review on Evaluation of Digital Tools for Authoring Evidence-Based Clinical Guidelines.

PubMed

Khodambashi, Soudabeh; Nytrø, Øystein

2017-01-01

To facilitate the clinical guideline (GL) development process, different groups of researchers have proposed tools that enable computer-supported tools for authoring and publishing GLs. In a previous study we interviewed GL authors in different Norwegian institutions and identified tool shortcomings. In this follow-up study our goal is to explore to what extent GL authoring tools have been evaluated by researchers, guideline organisations, or GL authors. This article presents results from a systematic literature review of evaluation (including usability) of GL authoring tools. A controlled database search and backward snow-balling were used to identify relevant articles. From the 12692 abstracts found, 188 papers were fully reviewed and 26 papers were identified as relevant. The GRADEPro tool has attracted some evaluation, however popular tools and platforms such as DECIDE, Doctor Evidence, JBI-SUMARI, G-I-N library have not been subject to specific evaluation from an authoring perspective. Therefore, we found that little attention was paid to the evaluation of the tools in general. We could not find any evaluation relevant to how tools integrate and support the complex GL development workflow. The results of this paper are highly relevant to GL authors, tool developers and GL publishing organisations in order to improve and control the GL development and maintenance process.

Psychological Evaluation and Prescription Development Handbook.

ERIC Educational Resources Information Center

Vigo County School Corp., Terre Haute, IN.

Developed to aid children with learning difficulties, from mental retardation or brain injury to maladjustment or physical or environmental handicaps, the joint school services program provides psychological evaluation and prescription development. The handbook reviews theories of child development and surveys behavior modification and…

Model performance evaluation (validation and calibration) in model-based studies of therapeutic interventions for cardiovascular diseases : a review and suggested reporting framework.

PubMed

Haji Ali Afzali, Hossein; Gray, Jodi; Karnon, Jonathan

2013-04-01

Decision analytic models play an increasingly important role in the economic evaluation of health technologies. Given uncertainties around the assumptions used to develop such models, several guidelines have been published to identify and assess 'best practice' in the model development process, including general modelling approach (e.g., time horizon), model structure, input data and model performance evaluation. This paper focuses on model performance evaluation. In the absence of a sufficient level of detail around model performance evaluation, concerns regarding the accuracy of model outputs, and hence the credibility of such models, are frequently raised. Following presentation of its components, a review of the application and reporting of model performance evaluation is presented. Taking cardiovascular disease as an illustrative example, the review investigates the use of face validity, internal validity, external validity, and cross model validity. As a part of the performance evaluation process, model calibration is also discussed and its use in applied studies investigated. The review found that the application and reporting of model performance evaluation across 81 studies of treatment for cardiovascular disease was variable. Cross-model validation was reported in 55 % of the reviewed studies, though the level of detail provided varied considerably. We found that very few studies documented other types of validity, and only 6 % of the reviewed articles reported a calibration process. Considering the above findings, we propose a comprehensive model performance evaluation framework (checklist), informed by a review of best-practice guidelines. This framework provides a basis for more accurate and consistent documentation of model performance evaluation. This will improve the peer review process and the comparability of modelling studies. Recognising the fundamental role of decision analytic models in informing public funding decisions, the proposed framework should usefully inform guidelines for preparing submissions to reimbursement bodies.

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature

PubMed Central

Lauricella, Michela; Valdez, Jessica K.; Okamoto, Scott K.; Helm, Susana; Zaremba, Colleen

2016-01-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern U.S. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the “ground up.” This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs. PMID:26733384

Culturally Grounded Prevention for Minority Youth Populations: A Systematic Review of the Literature.

PubMed

Lauricella, Michela; Valdez, Jessica K; Okamoto, Scott K; Helm, Susana; Zaremba, Colleen

2016-02-01

Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican-American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern US. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the "ground up." This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs.

Bioaccumulation of toxic substances associated with dredging and dredged material disposal: a literature review

USGS Publications Warehouse

Seelye, James G.; Mac, Michael J.

1984-01-01

A literature review of sediment bioassessment was conducted as the first step in the development of a more standardized and ecologically sound test procedure for evaluating sediment quality. Based on the review, the authors concluded that 1) a standardized laboratory bioassessment test should consist of flowthrough exposure of at least 10 days duration using more than one aquatic organism including at least an infaunal benthic invertebrate and a fish species. 2) Before adoption of a laboratory sediment bioassessment procedure, the laboratory results should be evaluated by comparison with field conditions. 3) Most current sediment bioassessment regulatory tests measure acute toxicity or bioaccumulation. Development of tests to evaluate chronic, sublethal effects is needed.

A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes.

PubMed

Snijder, Mieke; Shakeshaft, Anthony; Wagemakers, Annemarie; Stephens, Anne; Calabria, Bianca

2015-11-21

Community development is a health promotion approach identified as having great potential to improve Indigenous health, because of its potential for extensive community participation. There has been no systematic examination of the extent of community participation in community development projects and little analysis of their effectiveness. This systematic review aims to identify the extent of community participation in community development projects implemented in Australian Indigenous communities, critically appraise the qualitative and quantitative methods used in their evaluation, and summarise their outcomes. Ten electronic peer-reviewed databases and two electronic grey literature databases were searched for relevant studies published between 1990 and 2015. The level of community participation and the methodological quality of the qualitative and quantitative components of the studies were assessed against standardised criteria. Thirty one evaluation studies of community development projects were identified. Community participation varied between different phases of project development, generally high during project implementation, but low during the evaluation phase. For the majority of studies, methodological quality was low and the methods were poorly described. Although positive qualitative or quantitative outcomes were reported in all studies, only two studies reported statistically significant outcomes. Partnerships between researchers, community members and service providers have great potential to improve methodological quality and community participation when research skills and community knowledge are integrated to design, implement and evaluate community development projects. The methodological quality of studies evaluating Australian Indigenous community development projects is currently too weak to confidently determine the cost-effectiveness of community development projects in improving the health and wellbeing of Indigenous Australians. Higher quality studies evaluating community development projects would strengthen the evidence base.

Evaluation of evidence-based literature and formulation of recommendations for the clinical preventive guidelines for immigrants and refugees in Canada

PubMed Central

Tugwell, Peter; Pottie, Kevin; Welch, Vivian; Ueffing, Erin; Chambers, Andrea; Feightner, John

2011-01-01

Background: This article describes the evidence review and guideline development method developed for the Clinical Preventive Guidelines for Immigrants and Refugees in Canada by the Canadian Collaboration for Immigrant and Refugee Health Guideline Committee. Methods: The Appraisal of Guidelines for Research and Evaluation (AGREE) best-practice framework was combined with the recently developed Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to produce evidence-based clinical guidelines for immigrants and refugees in Canada. Results: A systematic approach was designed to produce the evidence reviews and apply the GRADE approach, including building on evidence from previous systematic reviews, searching for and comparing evidence between general and specific immigrant populations, and applying the GRADE criteria for making recommendations. This method was used for priority health conditions that had been selected by practitioners caring for immigrants and refugees in Canada. Interpretation: This article outlines the 14-step method that was defined to standardize the guideline development process for each priority health condition. PMID:20573711

The development, implementation and evaluation of clinical practice guidelines in Gulf Cooperation Council (GCC) countries: a systematic review of literature.

PubMed

Koornneef, Erik; Robben, Paul; Hajat, Cother; Ali, Azhar

2015-12-01

Our aim was to examine and describe the current situation in Gulf Cooperation Council (GCC) member countries regarding the development, implementation and evaluation of clinical practice guidelines (CPG). The objectives were to describe from where the studies originated, what the clinical focus was of each study and examine the methodology and the status of each study (i.e. development, dissemination, implementation and evaluation). Review of literature - two stages: stage 1: screening through an abstract review, followed by independent adjudicator; stage 2: detailed assessment and classification. Considering the widespread acceptance that CPG's are useful and effective tools for quality improvement in health care, it is worth noting that relatively few studies have been conducted in the GCC region that examine CPG. Furthermore, the reviewers found that the quality of the research methods used could be improved. The majority of the studies that were conducted evaluated the effects of guidelines and focused on the 'lifestyle diseases', in particular diabetes and cardiovascular diseases. It is also worth noting that there has been a steady increase in the number of publications over the 10 years period. More attention needs to be given to developing, disseminating, implementing and evaluating CPG's in the GCC region in order to improve the quality and safety of health care. © 2015 John Wiley & Sons, Ltd.

Evaluating Programs That Promote Climate and Energy Education-Meeting Teacher Needs for Online Resources

NASA Astrophysics Data System (ADS)

Lynds, S. E.; Buhr, S. M.

2011-12-01

The Climate Literacy and Energy Awareness Network (CLEAN) Pathway, is a National Science Digital Library (NSDL) Pathways project that was begun in 2010. The main goal of CLEAN is to generate a reviewed collection of educational resources that are aligned with the Essential Principles of Climate Science (EPCS). Another goal of the project is to support a community that will assist students, teachers, and citizens in climate literacy. A complementary program begun in 2010 is the ICEE (Inspiring Climate Education Excellence) program, which is developing online modules and courses designed around the climate literacy principles for use by teachers and other interested citizens. In these projects, we learn about teacher needs through a variety of evaluation mechanisms. The programs use evaluation to assist in the process of providing easy access to high quality climate and energy learning resources that meet classroom requirements. The internal evaluation of the CLEAN program is multidimensional. At the CLEAN resource review camps, teachers and scientists work together in small groups to assess the value of online resources for use in the classroom. The review camps are evaluated using observation and feedback surveys; the resulting evaluation reports provide information to managers to fine-tune future camps. In this way, a model for effective climate resource development meetings has been refined. Evaluation methods used in ICEE and CLEAN include teacher needs assessment surveys, teacher feedback at professional development opportunities, scientist feedback at resource review workshops, and regular analysis of online usage of resources, forums, and education modules. This paper will review the most successful strategies for evaluating the effectiveness of online climate and energy education resources and their use by educators and the general public.

How healthcare systems evaluate their advance care planning initiatives: Results from a systematic review.

PubMed

Biondo, Patricia D; Lee, Lydia D; Davison, Sara N; Simon, Jessica E

2016-09-01

Advance care planning initiatives are being implemented across healthcare systems around the world, but how best to evaluate their implementation is unknown. To identify gaps and/or redundancies in current evaluative strategies to help healthcare systems develop future evaluative frameworks for ACP. Systematic review. Peer-reviewed and gray literature searches were conducted till February 2015 to answer: "What methods have healthcare systems used to evaluate implementation of advance care planning initiatives?" A PICOS framework was developed to identify articles describing the implementation and evaluation of a health system-level advance care planning initiative. Outcome measures were mapped onto a conceptual quality indicator framework based on the Institute of Medicine and Donabedian models of healthcare quality. A total of 46 studies met inclusion criteria for analysis. Most articles reported on single parts of a healthcare system (e.g. continuing care). The most common outcome measures pertained to document completion, followed by healthcare resource use. Patient-, family-, or healthcare provider-reported outcomes were less commonly measured. Concordance measures (e.g. dying in place of choice) were reported by only 26% of studies. The conceptual quality indicator framework identified gaps and redundancies in measurement and is presented as a potential foundation from which to develop a comprehensive advance care planning evaluation framework. Document completion is frequently used to evaluate advance care planning program implementation; capturing the quality of care appears to be more difficult. This systematic review provides health system administrators with a comprehensive summary of measures used to evaluate advance care planning and may identify gaps in evaluation within their local context. © The Author(s) 2016.

Recent trends in the development and evaluation of assistive robotic manipulation devices.

PubMed

Allin, Sonya; Eckel, Emily; Markham, Heather; Brewer, Bambi R

2010-02-01

This review explores recent trends in the development and evaluation of assistive robotic arms, both prosthetic and externally mounted. Evaluations have been organized according to the CATOR taxonomy of assistive device outcomes, which takes into consideration device effectiveness, social significance, and impact on subjective well-being. Questions that have informed the review include: (1) Are robotic arms being comprehensively evaluated along axes of the CATOR taxonomy? (2) Are definitions of effectiveness in accordance with the priorities of users? (3) What gaps in robotic arm evaluation exist, and how might these best be addressed? (4) What further advances can be expected in the next 15 years? Results highlight the need for increased standardization of evaluation methods, increased emphasis on the social significance (i.e., social cost) of devices, and increased emphasis on device impact on quality of life. Several open areas for future research, in terms of both device evaluation and device development, are also discussed.

Energy interventions that facilitate sustainable development and impact health: an overview of systematic reviews.

PubMed

Haby, Michelle M; Chapman, Evelina; Clark, Rachel; Galvão, Luiz A C

2016-04-01

Objective To inform policy by providing an overview of systematic reviews on interventions that facilitate sustainable energy use and have a positive impact on health. Methods Systematic review methods were used to synthesize evidence from multiple systematic reviews and economic evaluations through a comprehensive search of 13 databases and nine websites based on a pre-defined protocol, including clear inclusion criteria. Both grey and peer-reviewed literature published in English, Spanish, and Portuguese during the 17 years from January 1997 - January 2014 was included. To classify as "sustainable," interventions needed to aim to positively impact at least two dimensions of the integrated framework for sustainable development and include measures of health impact. Results Five systematic reviews and one economic evaluation met the inclusion criteria. The most promising interventions that impacted health were electricity for lighting and other uses (developing countries); improved stoves for cooking and health and/or cleaner fuels for cooking (developing countries); and household energy efficiency measures (developed countries). These interventions also had potential environmental and economic impacts. Their cost-effectiveness is not known, nor is their impact on health inequalities. Conclusions What is needed now is careful implementation of interventions where the impacts are likely to be positive but their implementation needs to be rigorously evaluated, including possible adverse impacts. Care needs to be taken not to exacerbate health inequalities and to consider context, human behavior and cultural factors so that the potential health benefits are realized in real-life implementation. Possible impact on health inequalities needs to be considered and measured in future primary studies and systematic reviews.

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools.

PubMed

Shurtz, Suzanne; Foster, Margaret J

2011-07-01

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Summarizing Expository Texts

ERIC Educational Resources Information Center

Westby, Carol; Culatta, Barbara; Lawrence, Barbara; Hall-Kenyon, Kendra

2010-01-01

Purpose: This article reviews the literature on students' developing skills in summarizing expository texts and describes strategies for evaluating students' expository summaries. Evaluation outcomes are presented for a professional development project aimed at helping teachers develop new techniques for teaching summarization. Methods: Strategies…

Higher Education for Sustainable Development in Japan: Policy and Progress

ERIC Educational Resources Information Center

Nomura, Ko; Abe, Osamu

2010-01-01

Purpose: The purpose of this paper is to review key developments and the role of governmental support in the field of education for sustainable development (ESD) in higher education in Japan. Design/methodology/approach: This is an analytical review paper on policy and practice, using an evaluative perspective to consider developments, challenges…

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review.

PubMed

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-05-21

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments.

Evaluation Instruments for Quality of Life Related to Melasma: An Integrative Review

PubMed Central

Pollo, Camila Fernandes; Meneguin, Silmara; Miot, Helio Amante

2018-01-01

The aim of this study was to analyze scientific production concerning the validation and cultural adaptation of quality of life evaluation instruments for patients with melasma and to offer a critical reflection on these methods. A literature review was performed based on a search of the Web of Science, Bireme, PubMed, Elsevier Scopus, and Google Scholar databases. All published articles from indexed periodicals in these electronic databases up to December 2015 were included. Eight articles were identified, of which only one (12.5%) referred to the development and validation of a specific instrument for evaluation of the quality of life of melasma patients. An additional six articles (75%) referred to transcultural adjustment and validation of the same instrument in other languages, and another (12.5%) article reported the development of a generic instrument for evaluation of quality of life in patients with pigment disorders. This review revealed only one specific instrument developed and validated in different cultures. Despite being widely used, this instrument did not follow the classic construction steps for psychometric instruments, which paves the way for future studies to develop novel instruments. PMID:29791603

42 CFR 121.10 - Reviews, evaluation, and enforcement.

Code of Federal Regulations, 2014 CFR

2014-10-01

... RESOURCES DEVELOPMENT ORGAN PROCUREMENT AND TRANSPLANTATION NETWORK § 121.10 Reviews, evaluation, and... and Board of Directors meetings in which transplant hospital and OPO compliance with these regulations or OPTN policies is considered. (c) Enforcement of OPTN rules—(1) OPTN recommendations. The Board of...

42 CFR 121.10 - Reviews, evaluation, and enforcement.

Code of Federal Regulations, 2013 CFR

2013-10-01

... RESOURCES DEVELOPMENT ORGAN PROCUREMENT AND TRANSPLANTATION NETWORK § 121.10 Reviews, evaluation, and... and Board of Directors meetings in which transplant hospital and OPO compliance with these regulations or OPTN policies is considered. (c) Enforcement of OPTN rules—(1) OPTN recommendations. The Board of...

42 CFR 121.10 - Reviews, evaluation, and enforcement.

Code of Federal Regulations, 2012 CFR

2012-10-01

... RESOURCES DEVELOPMENT ORGAN PROCUREMENT AND TRANSPLANTATION NETWORK § 121.10 Reviews, evaluation, and... and Board of Directors meetings in which transplant hospital and OPO compliance with these regulations or OPTN policies is considered. (c) Enforcement of OPTN rules—(1) OPTN recommendations. The Board of...

A review of CDC's Web-based Injury Statistics Query and Reporting System (WISQARS™): Planning for the future of injury surveillance✩

PubMed Central

Ballesteros, Michael F.; Webb, Kevin; McClure, Roderick J.

2017-01-01

Introduction The Centers for Disease Control and Prevention (CDC) developed the Web-based Injury Statistics Query and Reporting System (WISQARSTM) to meet the data needs of injury practitioners. In 2015, CDC completed a Portfolio Review of this system to inform its future development. Methods Evaluation questions addressed utilization, technology and innovation, data sources, and tools and training. Data were collected through environmental scans, a review of peer-reviewed and grey literature, a web search, and stakeholder interviews. Results Review findings led to specific recommendations for each evaluation question. Response CDC reviewed each recommendation and initiated several enhancements that will improve the ability of injury prevention practitioners to leverage these data, better make sense of query results, and incorporate findings and key messages into prevention practices. PMID:28454867

The role of quantitative safety evaluation in regulatory decision making of drugs.

PubMed

Chakravarty, Aloka G; Izem, Rima; Keeton, Stephine; Kim, Clara Y; Levenson, Mark S; Soukup, Mat

2016-01-01

Evaluation of safety is a critical component of drug review at the US Food and Drug Administration (FDA). Statisticians are playing an increasingly visible role in quantitative safety evaluation and regulatory decision-making. This article reviews the history and the recent events relating to quantitative drug safety evaluation at the FDA. The article then focuses on five active areas of quantitative drug safety evaluation and the role Division of Biometrics VII (DBVII) plays in these areas, namely meta-analysis for safety evaluation, large safety outcome trials, post-marketing requirements (PMRs), the Sentinel Initiative, and the evaluation of risk from extended/long-acting opioids. This article will focus chiefly on developments related to quantitative drug safety evaluation and not on the many additional developments in drug safety in general.

The Journey from Rhetoric to Reality: Participatory Evaluation in a Development Context

ERIC Educational Resources Information Center

Chouinard, Jill Anne; Cousins, J. Bradley

2015-01-01

In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17%) situated in development contexts. However, the…

A Guide for Monitoring District Implementation of Educator Evaluation Systems. REL 2015-069

ERIC Educational Resources Information Center

Cherasaro, Trudy; Yanoski, David; Swackhamer, Lyn

2015-01-01

This guide was developed to provide guidance to states or districts wishing to monitor implementation of educator evaluation systems. It describes a three-step process: develop state guidelines for educator evaluation systems; develop data collection methods; and determine adherence criteria and review data against criteria. The process was…

Use of WONCA global standards to evaluate family medicine postgraduate education for curriculum development and review in Nepal and Myanmar.

PubMed

Gibson, Christine; Ladak, Farah; Shrestha, Ashis; Yadav, Bharat; Thu, Kyaw; Aye, Tin

2016-09-01

Family medicine is an integral part of primary care within health systems. Globally, training programmes exhibit a great degree of variability in content and skill acquisition. While this may in part reflect the needs of a given setting, there exists standard criteria that all family medicine programmes should consider core activities. WONCA has provided an open-access list of standards that their expert community considers essential for family medicine (GP) post-graduate training. Evaluation of developing or existing training programmes using these standards can provide insight into the degree of variability, gaps within programmes and equally as important, gaps within recommendations. In collaboration with the host institution, two family medicine programmes in Nepal and Myanmar were evaluated based on WONCA global standards. The results of the evaluation demonstrated that such a process can allow for critical review of curriculum in various stages of development and evaluation. The implications of reviewing training programmes according to WONCA standards can lead to enhanced training world-wide and standardisation of training for post-graduate family medicine.

Peer Review for EPA's Biologically Based Dose-Response ...

EPA Pesticide Factsheets

EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.

42 CFR 52h.2 - Definitions.

Code of Federal Regulations, 2012 CFR

2012-10-01

... understanding to develop useful materials, devices, systems, or methods. (u) Scientific review group has the... PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH... the review (the Scientific Review Administrator or equivalent) will evaluate the appearance of a...

42 CFR 52h.2 - Definitions.

Code of Federal Regulations, 2014 CFR

2014-10-01

... understanding to develop useful materials, devices, systems, or methods. (u) Scientific review group has the... PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH... the review (the Scientific Review Administrator or equivalent) will evaluate the appearance of a...

42 CFR 52h.2 - Definitions.

Code of Federal Regulations, 2013 CFR

2013-10-01

... understanding to develop useful materials, devices, systems, or methods. (u) Scientific review group has the... PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH... the review (the Scientific Review Administrator or equivalent) will evaluate the appearance of a...

Stripping in HMA Mixtures: State of the Art and Critical Review of Test Methods

DOT National Transportation Integrated Search

1988-09-01

This report presents review summaries of the state-of-the-art regarding stripping in hot mix asphalt (HMA) mixtures. The review stresses efforts concerned with methods development, evaluation and presents a critical review of select methods including...

48 CFR 2901.603-72 - Administrative procurement management reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... Authority, and Responsibilities 2901.603-72 Administrative procurement management reviews. (a) The Senior..., policies, procedures and applicable directives. The reviews are to emphasize the development and... quality reviews and assessment techniques. This system is required to: (1) Evaluate the effectiveness and...

Stripping in HMA mixtures : state-of-the-art and critical review of test methods

DOT National Transportation Integrated Search

1988-09-01

This report presents review summaries of the state-of-the-art : regarding stripping in hot mix asphalt (HMA) mixtures. The review stresses efforts concerned with methods development, evaluation and presents a critical review of select methods includi...

Validity of peer grading using Calibrated Peer Review in a guided-inquiry, conceptual physics course

NASA Astrophysics Data System (ADS)

Price, Edward; Goldberg, Fred; Robinson, Steve; McKean, Michael

2016-12-01

Constructing and evaluating explanations are important science practices, but in large classes it can be difficult to effectively engage students in these practices and provide feedback. Peer review and grading are scalable instructional approaches that address these concerns, but which raise questions about the validity of the peer grading process. Calibrated Peer Review (CPR) is a web-based system that scaffolds peer evaluation through a "calibration" process where students evaluate sample responses and receive feedback on their evaluations before evaluating their peers. Guided by an activity theory framework, we developed, implemented, and evaluated CPR-based tasks in guided-inquiry, conceptual physics courses for future teachers and general education students. The tasks were developed through iterative testing and revision. Effective tasks had specific and directed prompts and evaluation instructions. Using these tasks, over 350 students at three universities constructed explanations or analyzed physical phenomena, and evaluated their peers' work. By independently assessing students' responses, we evaluated the CPR calibration process and compared students' peer reviews with expert evaluations. On the tasks analyzed, peer scores were equivalent to our independent evaluations. On a written explanation item included on the final exam, students in the courses using CPR outperformed students in similar courses using traditional writing assignments without a peer evaluation element. Our research demonstrates that CPR can be an effective way to explicitly include the science practices of constructing and evaluating explanations into large classes without placing a significant burden on the instructor.

Sustained Performance Review: A Threat to Academic Freedom?

ERIC Educational Resources Information Center

Hall, Daniel E.

1997-01-01

Reviews the history of the tenure system and its constitutional and due process implications. Describes Florida's sustained performance review program, an evaluation of tenured faculty every seven years to encourage continuing professional development. (SK)

Digital I and C system upgrade integration technique

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huang, H. W.; Shih, C.; Wang, J. R.

2012-07-01

This work developed an integration technique for digital I and C system upgrade, the utility can replace the I and C systems step by step systematically by this method. Inst. of Nuclear Energy Research (INER) developed a digital Instrumentation and Control (I and C) replacement integration technique on the basis of requirement of the three existing nuclear power plants (NPPs), which are Chin-Shan (CS) NPP, Kuo-Sheng (KS) NPP, and Maanshan (MS) NPP, in Taiwan, and also developed the related Critical Digital Review (CDR) Procedure. The digital I and C replacement integration technique includes: (I) Establishment of Nuclear Power Plant Digitalmore » Replacement Integration Guideline, (2) Preliminary Investigation on I and C System Digitalization, (3) Evaluation on I and C System Digitalization, and (4) Establishment of I and C System Digitalization Architectures. These works can be a reference for performing I and C system digital replacement integration of the three existing NPPs of Taiwan Power Company (TPC). A CDR is the review for a critical system digital I and C replacement. The major reference of this procedure is EPRI TR- 1011710 (2005) 'Handbook for Evaluating Critical Digital Equipment and Systems' which was published by the Electric Power Research Inst. (EPRI). With this document, INER developed a TPC-specific CDR procedure. Currently, CDR becomes one of the policies for digital I and C replacement in TPC. The contents of this CDR procedure include: Scope, Responsibility, Operation Procedure, Operation Flow Chart, CDR review items. The CDR review items include the comparison of the design change, Software Verification and Validation (SVandV), Failure Mode and Effects Analysis (FMEA), Evaluation of Diversity and Defense-in-depth (D3), Evaluation of Watchdog Timer, Evaluation of Electromagnetic Compatibility (EMC), Evaluation of Grounding for System/Component, Seismic Evaluation, Witness and Inspection, Lessons Learnt from the Digital I and C Failure Events. A solid review can assure the quality of the digital I and C system replacement. (authors)« less

Alternative Modes of Evaluation and Their Application to Rural Development.

ERIC Educational Resources Information Center

Wetherill, G. Richard; Buttram, Joan L.

In order to "cut through the jargon of the multifaceted field of evaluative research", 21 evaluation models representing a range of possibilities were identified (via literature review) and compared in terms of purpose and five basic phases applicable to rural development. Evaluation was defined as "the systematic examination of a…

Evaluating Teachers' Professional Development Initiatives: Towards an Extended Evaluative Framework

ERIC Educational Resources Information Center

Merchie, Emmelien; Tuytens, Melissa; Devos, Geert; Vanderlinde, Ruben

2018-01-01

Evaluating teachers' professional development initiatives (PDI) is one of the main challenges for the teacher professionalisation field. Although different studies have focused on the effectiveness of PDI, the obtained effects and evaluative methods have been found to be widely divergent. By means of a narrative review, this study provides an…

Evaluation and Development of Administrators. AAHE-ERIC/Higher Education Research Report No. 6, 1979.

ERIC Educational Resources Information Center

Nordvall, Robert C.

Needs and methods for the evaluation and development of higher education administrators are reviewed in this monograph. Three major reasons for evaluation are cited: external and internal pressure, improvement of performance of individual administrators, and improvement of performance of the institution. Different approaches to evaluation are…

77 FR 5031 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-01

... Committee: National Institute of Child Health and Human Development Initial Review Group; Developmental Biology Subcommittee. Date: February 23, 2012. Time: 8 a.m. to 5 p.m. Agenda: To review and evaluate grant...

Enterprise Professional Development--Evaluating Learning

ERIC Educational Resources Information Center

Murphy, Gerald A.; Calway, Bruce A.

2010-01-01

Whilst professional development (PD) is an activity required by many regulatory authorities, the value that enterprises obtain from PD is often unknown, particularly when it involves development of knowledge. This paper discusses measurement techniques and processes and provides a review of established evaluation techniques, highlighting…

The impact of Cochrane Systematic Reviews: a mixed method evaluation of outputs from Cochrane Review Groups supported by the UK National Institute for Health Research.

PubMed

Bunn, Frances; Trivedi, Daksha; Alderson, Phil; Hamilton, Laura; Martin, Alice; Iliffe, Steve

2014-10-27

There has been a growing emphasis on evidence-informed decision-making in health care. Systematic reviews, such as those produced by the Cochrane Collaboration, have been a key component of this movement. The UK National Institute for Health Research (NIHR) Systematic Review Programme currently supports 20 Cochrane Review Groups (CRGs). The aim of this study was to identify the impacts of Cochrane reviews published by NIHR-funded CRGs during the years 2007-2011. We sent questionnaires to CRGs and review authors, interviewed guideline developers and used bibliometrics and documentary review to get an overview of CRG impact and to evaluate the impact of a sample of 60 Cochrane reviews. We used a framework with four categories (knowledge production, research targeting, informing policy development and impact on practice/services). A total of 1,502 new and updated reviews were produced by the 20 NIHR-funded CRGs between 2007 and 2011. The clearest impacts were on policy with a total of 483 systematic reviews cited in 247 sets of guidance: 62 were international, 175 national (87 from the UK) and 10 local. Review authors and CRGs provided some examples of impact on practice or services, for example, safer use of medication, the identification of new effective drugs or treatments and potential economic benefits through the reduction in the use of unproven or unnecessary procedures. However, such impacts are difficult to objectively document, and the majority of reviewers were unsure if their review had produced specific impacts. Qualitative data suggested that Cochrane reviews often play an instrumental role in informing guidance, although a poor fit with guideline scope or methods, reviews being out of date and a lack of communication between CRGs and guideline developers were barriers to their use. Health and economic impacts of research are generally difficult to measure. We found that to be the case with this evaluation. Impacts on knowledge production and clinical guidance were easier to identify and substantiate than those on clinical practice. Questions remain about how we define and measure impact, and more work is needed to develop suitable methods for impact analysis.

78 FR 42795 - Submission for OMB review; 30-Day Comment Request: Evaluation of the Brain Disorders in the...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-07-17

...; 30-Day Comment Request: Evaluation of the Brain Disorders in the Developing World Program of the John... Collection: Evaluation of the Brain Disorders in the Developing World Program of the John E. Fogarty... outcomes of the Brain Disorders in the Developing World extramural research program administered by the...

The use of concept mapping in measurement development and evaluation: Application and future directions.

PubMed

Rosas, Scott R; Ridings, John W

2017-02-01

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation. Copyright © 2016 Elsevier Ltd. All rights reserved.

42 CFR 121.10 - Reviews, evaluation, and enforcement.

Code of Federal Regulations, 2010 CFR

2010-10-01

... RESOURCES DEVELOPMENT ORGAN PROCUREMENT AND TRANSPLANTATION NETWORK § 121.10 Reviews, evaluation, and... carry out her/his responsibilities under the Public Health Service Act and the Social Security Act. (b... noncompliance is with a policy designated by the Secretary as covered by section 1138 of the Social Security Act...

78 FR 78416 - Submission for Review: Program Services Evaluation Surveys, OMB Control No. 3206-0252

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-26

...) leads Federal agencies in shaping human resources management systems to effectively recruit, develop... OFFICE OF PERSONNEL MANAGEMENT Submission for Review: Program Services Evaluation Surveys, OMB Control No. 3206-0252 AGENCY: U.S. Office of Personnel Management. ACTION: 60-Day Notice and request for...

Improving Education in Developing Countries: Lessons From Rigorous Impact Evaluations

ERIC Educational Resources Information Center

Ganimian, Alejandro J.; Murnane, Richard J.

2016-01-01

In this article, we reviewed and interpreted the evidence from 223 rigorous impact evaluations of educational initiatives conducted in 56 low- and middle-income countries. We considered for inclusion in our review all studies in recent syntheses that have reached seemingly conflicting conclusions about which interventions improve educational…

Development of hybrid 3-D hydrological modeling for the NCAR Community Earth System Model (CESM)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zeng, Xubin; Troch, Peter; Pelletier, Jon

2015-11-15

This is the Final Report of our four-year (3-year plus one-year no cost extension) collaborative project between the University of Arizona (UA) and the National Center for Atmospheric Research (NCAR). The overall objective of our project is to develop and evaluate the first hybrid 3-D hydrological model with a horizontal grid spacing of 1 km for the NCAR Community Earth System Model (CESM). We have made substantial progress in model development and evaluation, computational efficiencies and software engineering, and data development and evaluation, as discussed in Sections 2-4. Section 5 presents our success in data dissemination, while Section 6 discussesmore » the scientific impacts of our work. Section 7 discusses education and mentoring success of our project, while Section 8 lists our relevant DOE services. All peer-reviewed papers that acknowledged this project are listed in Section 9. Highlights of our achievements include: • We have finished 20 papers (most published already) on model development and evaluation, computational efficiencies and software engineering, and data development and evaluation • The global datasets developed under this project have been permanently archived and publicly available • Some of our research results have already been implemented in WRF and CLM • Patrick Broxton and Michael Brunke have received their Ph.D. • PI Zeng has served on DOE proposal review panels and DOE lab scientific focus area (SFA) review panels« less

76 FR 5595 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-01

...: National Institute of Child Health and Human Development Initial Review Group, Biobehavioral and Behavioral Sciences Subcommittee. Date: February 24-25, 2011. Time: 9 a.m. to 5 p.m. Agenda: To review and evaluate...

77 FR 6811 - Center for Scientific Review; Notice of Closed Meetings

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-09

...: Anti-pathogen drug development and resistance. Date: February 28, 2012. Time: 3 p.m. to 5 p.m. Agenda... Vaccine Development. Date: March 8-9, 2012. Time: 8 a.m. to 6 p.m. Agenda: To review and evaluate grant...

Research Questions and Priorities for Tuberculosis: A Survey of Published Systematic Reviews and Meta-Analyses

PubMed Central

Nicolau, Ioana; Ling, Daphne; Tian, Lulu; Lienhardt, Christian; Pai, Madhukar

2012-01-01

Background Systematic reviews are increasingly informing policies in tuberculosis (TB) care and control. They may also be a source of questions for future research. As part of the process of developing the International Roadmap for TB Research, we did a systematic review of published systematic reviews on TB, to identify research priorities that are most frequently suggested in reviews. Methodology/Principal Findings We searched EMBASE, MEDLINE, Web of Science, and the Cochrane Library for systematic reviews and meta-analyses on any aspect of TB published between 2005 and 2010. One reviewer extracted data and a second reviewer independently extracted data from a random subset of included studies. In total, 137 systematic reviews, with 141 research questions, were included in this review. We used the UK Health Research Classification System (HRCS) to help us classify the research questions and priorities. The three most common research topics were in the area of detection, screening and diagnosis of TB (32.6%), development and evaluation of treatments and therapeutic interventions (23.4%), and TB aetiology and risk factors (19.9%). The research priorities determined were mainly focused on the discovery and evaluation of bacteriological TB tests and drug-resistant TB tests and immunological tests. Other important topics of future research were genetic susceptibility linked to TB and disease determinants attributed to HIV/TB. Evaluation of drug treatments for TB, drug-resistant TB and HIV/TB were also frequently proposed research topics. Conclusions Systematic reviews are a good source of key research priorities. Findings from our survey have informed the development of the International Roadmap for TB Research by the TB Research Movement. PMID:22848764

Identifying models of delivery, care domains and quality indicators relevant to palliative day services: a scoping review protocol.

PubMed

O'Connor, Seán R; Dempster, Martin; McCorry, Noleen K

2017-05-16

With an ageing population and increasing numbers of people with life-limiting illness, there is a growing demand for palliative day services. There is a need to measure and demonstrate the quality of these services, but there is currently little agreement on which aspects of care should be used to do this. The aim of the scoping review will be to map the extent, range and nature of the evidence around models of delivery, care domains and existing quality indicators used to evaluate palliative day services. Electronic databases (MEDLINE, EMBASE, CINAHL, PsycINFO, Cochrane Central Register of Controlled Trials) will be searched for evidence using consensus development methods; randomised or quasi-randomised controlled trials; mixed methods; and prospective, longitudinal or retrospective case-control studies to develop or test quality indicators for evaluating palliative care within non-residential settings, including day hospices and community or primary care settings. At least two researchers will independently conduct all searches, study selection and data abstraction procedures. Meta-analyses and statistical methods of synthesis are not planned as part of the review. Results will be reported using numerical counts, including number of indicators in each care domain and by using qualitative approach to describe important indicator characteristics. A conceptual model will also be developed to summarise the impact of different aspects of quality in a palliative day service context. Methodological quality relating to indicator development will be assessed using the Appraisal of Indicators through Research and Evaluation (AIRE) tool. Overall strength of evidence will be assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) system. Final decisions on quality assessment will be made via consensus between review authors. Identifying, developing and implementing evidence-based quality indicators is critical to the evaluation and continued improvement of palliative care. Review findings will be used to support clinicians and policymakers make decisions on which quality indicators are most appropriate for evaluating day services at the patient and service level, and to identify areas for further research.

Curriculum Development and Evaluation for a Cancer Education Program.

ERIC Educational Resources Information Center

Deslauriers, Marc P.

1980-01-01

The Mid-America Cancer Center Program has developed a comprehensive approach for evaluating the cancer education curriculum at the University of Kansas Medical Center. The project included a review of all cancer-related teaching objectives and the development of an interdepartmental oncology curriculum. (JMD)

Developing and using a rubric for evaluating evidence-based medicine point-of-care tools

PubMed Central

Foster, Margaret J

2011-01-01

Objective: The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library. Methods: The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control). Results: Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process. Conclusions: As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed. PMID:21753917

High Speed Digital Camera Technology Review

NASA Technical Reports Server (NTRS)

Clements, Sandra D.

2009-01-01

A High Speed Digital Camera Technology Review (HSD Review) is being conducted to evaluate the state-of-the-shelf in this rapidly progressing industry. Five HSD cameras supplied by four camera manufacturers participated in a Field Test during the Space Shuttle Discovery STS-128 launch. Each camera was also subjected to Bench Tests in the ASRC Imaging Development Laboratory. Evaluation of the data from the Field and Bench Tests is underway. Representatives from the imaging communities at NASA / KSC and the Optical Systems Group are participating as reviewers. A High Speed Digital Video Camera Draft Specification was updated to address Shuttle engineering imagery requirements based on findings from this HSD Review. This draft specification will serve as the template for a High Speed Digital Video Camera Specification to be developed for the wider OSG imaging community under OSG Task OS-33.

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Indices for the assessment of nutritional quality of meals: a systematic review.

PubMed

Gorgulho, B M; Pot, G K; Sarti, F M; Marchioni, D M

2016-06-01

This systematic review aimed to synthesise information on indices developed to evaluate nutritional quality of meals. A strategy for systematic search of the literature was developed using keywords related to assessment of meal quality. Databases searched included ScienceDirect, PubMed, Lilacs, SciELO, Scopus, Cochrane, Embase and Google Scholar. The literature search resulted in seven different meal quality indices. Each article was analysed in order to identify the following items: authors, country, year, study design, population characteristics, type of meal evaluated, dietary assessment method, characteristics evaluated (nutrients or food items), score range, index components, nutritional references, correlations performed, validation and relationship with an outcome (if existing). Two studies developed instruments to assess the quality of breakfast, three analysed lunch, one evaluated dinner and one was applied to all types of meals and snacks. All meal quality indices reviewed were based on the evaluation of presence or absence of food groups and relative contributions of nutrients, according to food-based guidelines or nutrient references, adapting the daily dietary recommendations to one specific meal. Most of the indices included three items as components for meal quality assessment: (I) total fat or some specific type of fat, (II) fruits and vegetables and (III) cereals or whole grains. This systematic review indicates aspects that need further research, particularly the numerous approaches to assessing meals considering different foods and nutrients, and the need for validation studies of meal indices.

77 FR 34393 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-11

...: National Institute of Child Health and Human Development Initial Review Group; Biobehavioral and Behavioral Sciences Subcommittee. Date: June 25-26, 2012. Time: 8:00 a.m. to 5:00 p.m. Agenda: To review and evaluate...

Reporting of meta-analyses of randomized controlled trials with a focus on drug safety: an empirical assessment.

PubMed

Hammad, Tarek A; Neyarapally, George A; Pinheiro, Simone P; Iyasu, Solomon; Rochester, George; Dal Pan, Gerald

2013-01-01

Due to the sparse nature of serious drug-related adverse events (AEs), meta-analyses combining data from several randomized controlled trials (RCTs) to evaluate drug safety issues are increasingly being conducted and published, influencing clinical and regulatory decision making. Evaluation of meta-analyses involves the assessment of both the individual constituent trials and the approaches used to combine them. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting framework is designed to enhance the reporting of systematic reviews and meta-analyses. However, PRISMA may not cover all critical elements useful in the evaluation of meta-analyses with a focus on drug safety particularly in the regulatory-public health setting. This work was conducted to (1) evaluate the adherence of a sample of published drug safety-focused meta-analyses to the PRISMA reporting framework, (2) identify gaps in this framework based on key aspects pertinent to drug safety, and (3) stimulate the development and validation of a more comprehensive reporting tool that incorporates elements unique to drug safety evaluation. We selected a sample of meta-analyses of RCTs based on review of abstracts from high-impact journals as well as top medical specialty journals between 2009 and 2011. We developed a preliminary reporting framework based on PRISMA with specific additional reporting elements critical for the evaluation of drug safety meta-analyses of RCTs. The reporting of pertinent elements in each meta-analysis was reviewed independently by two authors; discrepancies in the independent evaluations were resolved through discussions between the two authors. A total of 27 meta-analyses, 12 from highest impact journals, 13 from specialty medical journals, and 2 from Cochrane reviews, were identified and evaluated. The great majority (>85%) of PRISMA elements were addressed in more than half of the meta-analyses reviewed. However, the majority of meta-analyses (>60%) did not address most (>80%) of the additional reporting elements critical for the evaluation of drug safety. Some of these elements were not addressed in any of the reviewed meta-analyses. This review included a sample of meta-analyses, with a focus on drug safety, recently published in high-impact journals; therefore, we may have underestimated the extent of the reporting problem across all meta-analyses of drug safety. Furthermore, temporal trends in reporting could not be evaluated in this review because of the short time interval selected. While the majority of PRISMA elements were addressed by most studies reviewed, the majority of studies did not address most of the additional safety-related elements. These findings highlight the need for the development and validation of a drug safety reporting framework and the importance of the current initiative by the Council for International Organizations of Medical Sciences (CIOMS) to create a guidance document for drug safety information synthesis/meta-analysis, which may improve reporting, conduct, and evaluation of meta-analyses of drug safety and inform clinical and regulatory decision making.

Understanding the Federal Proposal Review Process.

ERIC Educational Resources Information Center

Cavin, Janis I.

Information on the peer review process for the evaluation of federal grant proposals is presented to help college grants administrators and faculty develop good proposals. This guidebook provides an overview of the policies and conventions that govern the review and selection of proposals for funding, and details the review procedures of the…

Considerations for Clinical Review of Cellular Therapy Products: Perspectives of the China Food and Drug Administration Center for Drug Evaluation.

PubMed

Liu, Yantong; Zhao, Chenyang; Gao, Liucun; Yang, Huan; He, Ruyi; Gao, Chenyan

2018-02-01

With increasing numbers of technical developments and clinical studies, pioneering cellular/gene therapies are now available that could cure life-threatening disease. Cellular/gene therapy products are broad-ranging and complicated, and thereby bring challenges for clinical review by regulatory agencies. This review discusses principles for the clinical review of cellular therapy products, including protection of clinical trial populations, pharmacodynamics, pharmacokinetics, dose evaluation, clinical efficacy, clinical safety, and risk-management plans. Based on these principles, key points in the clinical review of chimeric antigen receptor T-cell therapy are also discussed.

Evaluation: Review of the Past, Preview of the Future.

ERIC Educational Resources Information Center

Smith, M. F.

1994-01-01

This paper summarized contributors' ideas about evaluation as a field and where it is going. Topics discussed were qualitative versus quantitative debate; evaluation's purpose; professionalization; program failure; program development; evaluators as advocates; evaluation knowledge; evaluation expansion; and methodology and design. (SLD)

Health Care System Reforms in Developing Countries

PubMed Central

Han, Wei

2012-01-01

This article proposes a critical but non-systematic review of recent health care system reforms in developing countries. The literature reports mixed results as to whether reforms improve the financial protection of the poor or not. We discuss the reasons for these differences by comparing three representative countries: Mexico, Vietnam, and China. First, the design of the health care system reform, as well as the summary of its evaluation, is briefly described for each country. Then, the discussion is developed along two lines: policy design and evaluation methodology. The review suggests that i) background differences, such as social development, poverty level, and population health should be considered when taking other countries as a model; ii) although demand-side reforms can be improved, more attention should be paid to supply-side reforms; and iii) the findings of empirical evaluation might be biased due to the evaluation design, the choice of outcome, data quality, and evaluation methodology, which should be borne in mind when designing health care system reforms. PMID:25170464

25 CFR 224.132 - How does the Director conduct a periodic review and evaluation?

Code of Federal Regulations, 2011 CFR

2011-04-01

... 25 Indians 1 2011-04-01 2011-04-01 false How does the Director conduct a periodic review and evaluation? 224.132 Section 224.132 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF...

An evaluation of psychometric properties of caregiver burden outcome measures used in caregivers of children with cerebral palsy: a systematic review protocol.

PubMed

Dambi, Jermaine M; Jelsma, Jennifer; Mlambo, Tecla; Chiwaridzo, Matthew; Dangarembizi-Munambah, Nyaradzai; Corten, Lieselotte

2016-03-09

Cerebral palsy (CP) is the most common, life-long paediatric disability. Taking care of a child with CP often results in caregiver burden/strain in the long run. As caregivers play an essential role in the rehabilitation of these children, it is therefore important to routinely screen for health outcomes in informal caregivers. Consequently, a plethora of caregiver burden outcome measures have been developed; however, there is a dearth of evidence of the most psychometrically sound tools. Therefore, the broad objective of this systematic review is to evaluate the psychometrical properties and clinical utility of tools used to measure caregiver burden in caregivers of children with CP. This is a systematic review for the evaluation of the psychometric properties of caregiver burden outcome tools. Two independent and blinded reviewers will search articles on PubMed, Scopus, Web of Science, CINAHL, PsychINFO and Africa-Wide Google Scholar. Information will be analysed using predefined criteria. Thereafter, three independent reviewers will then screen the retrieved articles. The methodological quality of studies on the development and validation of the identified tools will be evaluated using the four point COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Finally, the psychometric properties of the tools which were developed and validated from methodological sound studies will then be analysed using predefined criteria. The proposed systematic review will give an extensive review of the psychometrical properties of tools used to measure caregiver burden in caregivers of children with CP. We hope to identify tools that can be used to accurately screen for caregiver burden both in clinical setting and for research purposes. PROSPERO CRD42015028026.

Assessment of the NASA Flight Assurance Review Program

NASA Technical Reports Server (NTRS)

Holmes, J.; Pruitt, G.

1983-01-01

The NASA flight assurance review program to develop minimum standard guidelines for flight assurance reviews was assessed. Documents from NASA centers and NASA headquarters to determine current design review practices and procedures were evaluated. Six reviews were identified for the recommended minimum. The practices and procedures used at the different centers to incorporate the most effective ones into the minimum standard review guidelines were analyzed and guidelines for procedures, personnel and responsibilies, review items/data checklist, and feedback and closeout were defined. The six recommended reviews and the minimum standards guidelines developed for flight assurance reviews are presented. Observations and conclusions for further improving the NASA review and quality assurance process are outlined.

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

PubMed

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and evaluation in MHPSS programs in humanitarian settings within low- and middle-income countries. This scoping review of the terminology commonly used to describe monitoring and evaluation practices and their focus within MHPSS programming highlights areas of importance for the development of a more standardized approach to monitoring and evaluation.

Heavy vehicle driver workload assessment. Task 4, review of workload and related research

DOT National Transportation Integrated Search

This report reviews literature on workload measures and related research. It depicts the preliminary development of a theoretical basis for relating driving workload to highway safety and a selective review of driver performance evaluation, workload ...

Biomass Program 2007 Program Peer Review - Full Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

76 FR 26736 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-05-09

... National Institute of Child Health & Human Development; Notice of Closed Meeting Pursuant to section 10(d... Institute of Child Health and Human Development Special Emphasis Panel, Systematic Review of Neonatal Medicine. Date: May 23, 2011. Time: 1 p.m. to 3 p.m. Agenda: To review and evaluate grant applications...

25 CFR 224.131 - What is a periodic review and evaluation?

Code of Federal Regulations, 2011 CFR

2011-04-01

... 224.131 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews... the Director performs to monitor a tribe's performance of activities associated with the development...

25 CFR 224.131 - What is a periodic review and evaluation?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 224.131 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF DETERMINATION ACT Periodic Reviews... the Director performs to monitor a tribe's performance of activities associated with the development...

75 FR 22575 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-29

... impact of the PITC on child care quality and children's development. The evaluation is conducted by... children's language, social and cognitive development. Baseline data collection took place 2007; follow-up... Review: Extension. Title: Study of the Program for Infant Toddler Care. Frequency: Once. Affected Public...

High Resolution Visualization Applied to Future Heavy Airlift Concept Development and Evaluation

NASA Technical Reports Server (NTRS)

FordCook, A. B.; King, T.

2012-01-01

This paper explores the use of high resolution 3D visualization tools for exploring the feasibility and advantages of future military cargo airlift concepts and evaluating compatibility with existing and future payload requirements. Realistic 3D graphic representations of future airlifters are immersed in rich, supporting environments to demonstrate concepts of operations to key personnel for evaluation, feedback, and development of critical joint support. Accurate concept visualizations are reviewed by commanders, platform developers, loadmasters, soldiers, scientists, engineers, and key principal decision makers at various stages of development. The insight gained through the review of these physically and operationally realistic visualizations is essential to refining design concepts to meet competing requirements in a fiscally conservative defense finance environment. In addition, highly accurate 3D geometric models of existing and evolving large military vehicles are loaded into existing and proposed aircraft cargo bays. In this virtual aircraft test-loading environment, materiel developers, engineers, managers, and soldiers can realistically evaluate the compatibility of current and next-generation airlifters with proposed cargo.

Tool for Human-Systems Integration Assessment: HSI Scorecard

NASA Technical Reports Server (NTRS)

Whitmore, Nihriban; Sandor, Aniko; McGuire, Kerry M.; Berdich, Debbie

2009-01-01

This paper describes the development and rationale for a human-systems integration (HSI) scorecard that can be used in reviews of vehicle specification and design. This tool can be used to assess whether specific HSI related criteria have been met as part of a project milestone or critical event, such as technical reviews, crew station reviews, mockup evaluations, or even review of major plans or processes. Examples of HSI related criteria include Human Performance Capabilities, Health Management, Human System Interfaces, Anthropometry and Biomechanics, and Natural and Induced Environments. The tool is not intended to evaluate requirements compliance and verification, but to review how well the human related systems have been considered for the specific event and to identify gaps and vulnerabilities from an HSI perspective. The scorecard offers common basis, and criteria for discussions among system managers, evaluators, and design engineers. Furthermore, the scorecard items highlight the main areas of system development that need to be followed during system lifecycle. The ratings provide a repeatable quantitative measure to what has been often seen as only subjective commentary. Thus, the scorecard is anticipated to be a useful HSI tool to communicate review results to the institutional and the project office management.

A Review of Urban Low-carbon Traffic Assessment

NASA Astrophysics Data System (ADS)

Chen, Jing; Yao, Jingjing

2017-12-01

Transportation not only promote social and economic development, but also improve people’s living standards, but its high energy consumption and high pollution brought a series of energy and environmental problems. In order to reduce the impact on the environment, countries are developing low-carbon transport as part of the socio-economic development mentioned on the agenda. On the basis of understanding the background and connotation of low-carbon transportation, this paper reviews and collates the evaluation index system and evaluation method of urban low-carbon transportation, which is used to provide reference for urban low-carbon transportation research.

The DLESE Evaluation Toolkit Project

NASA Astrophysics Data System (ADS)

Buhr, S. M.; Barker, L. J.; Marlino, M.

2002-12-01

The Evaluation Toolkit and Community project is a new Digital Library for Earth System Education (DLESE) collection designed to raise awareness of project evaluation within the geoscience education community, and to enable principal investigators, teachers, and evaluators to implement project evaluation more readily. This new resource is grounded in the needs of geoscience educators, and will provide a virtual home for a geoscience education evaluation community. The goals of the project are to 1) provide a robust collection of evaluation resources useful for Earth systems educators, 2) establish a forum and community for evaluation dialogue within DLESE, and 3) disseminate the resources through the DLESE infrastructure and through professional society workshops and proceedings. Collaboration and expertise in education, geoscience and evaluation are necessary if we are to conduct the best possible geoscience education. The Toolkit allows users to engage in evaluation at whichever level best suits their needs, get more evaluation professional development if desired, and access the expertise of other segments of the community. To date, a test web site has been built and populated, initial community feedback from the DLESE and broader community is being garnered, and we have begun to heighten awareness of geoscience education evaluation within our community. The web site contains features that allow users to access professional development about evaluation, search and find evaluation resources, submit resources, find or offer evaluation services, sign up for upcoming workshops, take the user survey, and submit calendar items. The evaluation resource matrix currently contains resources that have met our initial review. The resources are currently organized by type; they will become searchable on multiple dimensions of project type, audience, objectives and evaluation resource type as efforts to develop a collection-specific search engine mature. The peer review criteria and process for ensuring that the site contains robust and useful resources has been drafted and received initial feedback from the project advisory board, which consists of members of every segment of the target audience. The review criteria are based upon DLESE peer review criteria, the MERLOT digital library peer review criteria, digital resource evaluation criteria, and evaluation best practices. In geoscience education, as in most endeavors, improvements are made by asking questions and acting upon information about successes and failures; project evaluation can be thought of as the systematic process of asking these questions and gathering the right information. The Evaluation Toolkit seeks to help principal investigators, teachers, and evaluators use the evaluation process to improve our projects and our field.

76 FR 36526 - Notice of Submission for OMB Review

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-22

... DEPARTMENT OF EDUCATION Notice of Submission for OMB Review AGENCY: Department of Education... the Office of Information and Regulatory Affairs, Attention: Education Desk Officer, Office of... Development Type of Review: New. Title of Collection: Evaluation of the Education for Homeless Children and...

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Optimizing Department of Defense Acquisition Development Test and Evaluation Scheduling

DTIC Science & Technology

2015-06-01

CPM Critical Path Method DOD Department of Defense DT&E development test and evaluation EMD engineering and manufacturing development GAMS...these, including the Program Evaluation Review Technique (PERT), the Critical Path Method ( CPM ), and the resource- constrained project-scheduling...problem (RCPSP). These are of particular interest to this thesis as the current scheduling method uses elements of the PERT/ CPM , and the test

Evaluating clinical librarian services: a systematic review.

PubMed

Brettle, Alison; Maden-Jenkins, Michelle; Anderson, Lucy; McNally, Rosalind; Pratchett, Tracey; Tancock, Jenny; Thornton, Debra; Webb, Anne

2011-03-01

  Previous systematic reviews have indicated limited evidence and poor quality evaluations of clinical librarian (CL) services. Rigorous evaluations should demonstrate the value of CL services, but guidance is needed before this can be achieved.   To undertake a systematic review which examines models of CL services, quality, methods and perspectives of clinical librarian service evaluations.   Systematic review methodology and synthesis of evidence, undertaken collaboratively by a group of 8 librarians to develop research and critical appraisal skills.   There are four clear models of clinical library service provision. Clinical librarians are effective in saving health professionals time, providing relevant, useful information and high quality services. Clinical librarians have a positive effect on clinical decision making by contributing to better informed decisions, diagnosis and choice of drug or therapy. The quality of CL studies is improving, but more work is needed on reducing bias and providing evidence of specific impacts on patient care. The Critical Incident Technique as part of a mixed method approach appears to offer a useful approach to demonstrating impact.   This systematic review provides practical guidance regarding the evaluation of CL services. It also provides updated evidence regarding the effectiveness and impact of CL services. The approach used was successful in developing research and critical appraisal skills in a group of librarians. © 2010 The authors. Health Information and Libraries Journal © 2010 Health Libraries Group.

Modernizing methodology for the WHO assessment of substances for the international drug control conventions.

PubMed

Danenberg, E; Sorge, L A; Wieniawski, W; Elliott, S; Amato, L; Scholten, W K

2013-08-01

The WHO Executive Board revised the guidance that governs the procedures for the WHO review of psychoactive substances for international drug control in 2010. To meet the standards defined in these guidelines, the current evaluation methodology at WHO must be an evidence-based assessment. We describe the history of substance evaluation from 1912 to the present and the development of the evaluation methods over time including a description of the current assessment system, using reports from WHO and its predecessor, the League of Nations. Furthermore, we describe the current review system. We found that some substances under international control were never reviewed; other substances were reviewed decades ago. We argue that assessments do not have unlimited validity, and therefore, substances need to be re-assessed periodically, as already recommended by the Expert Committee on Drug Dependence in 1982. We propose that the evaluation time be shortened; that the influence of the route of administration and/or dosage form of the preparation is considered in the evaluation; and we recommend studying national and regional assessment systems and adopting their best practices. With this article, we make a case for the inclusion of systematic review and other methods of comprehensive analysis of substance evaluation to arrive at a process of equal rigour and quality as already applied by WHO for the development of treatment guidelines. Copyright © 2013 World Health Organization. Published by Elsevier Ireland Ltd.. All rights reserved.

A Statewide School Tobacco Policy Review: Process, Results, and Implications.

ERIC Educational Resources Information Center

Stephens, Yvonne D.; English, Gary

2002-01-01

Reviewed all district tobacco policies in New York state, developing a policy rubric to assess five policy components (policy development/oversight/communication, purpose and goals, tobacco-free environment, tobacco use prevention education, and assistance to overcome addiction). School policies were evaluated for compliance with state and federal…

78 FR 19490 - Disease, Disability, and Injury Prevention and Control Special Emphasis Panel (SEP): Initial Review

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-01

... DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for Disease Control and Prevention Disease... announced below concerns Development of an Evidenced-- Informed Mall Walking Program Resource Guide, Special... review, discussion, and evaluation of ``Development of an Evidenced--Informed Mall Walking Program...

How to prepare a systematic review of economic evaluations for clinical practice guidelines: database selection and search strategy development (part 2/3).

PubMed

Thielen, F W; Van Mastrigt, Gapg; Burgers, L T; Bramer, W M; Majoie, Hjm; Evers, Smaa; Kleijnen, J

2016-12-01

This article is part of the series "How to prepare a systematic review of economic evaluations (EES) for informing evidence-based healthcare decisions", in which a five-step approach is proposed. Areas covered: This paper focuses on the selection of relevant databases and developing a search strategy for detecting EEs, as well as on how to perform the search and how to extract relevant data from retrieved records. Expert commentary: Thus far, little has been published on how to conduct systematic review EEs. Moreover, reliable sources of information, such as the Health Economic Evaluation Database, have ceased to publish updates. Researchers are thus left without authoritative guidance on how to conduct SR-EEs. Together with van Mastrigt et al. we seek to fill this gap.

Using heuristic evaluations to assess the safety of health information systems.

PubMed

Carvalho, Christopher J; Borycki, Elizabeth M; Kushniruk, Andre W

2009-01-01

Health information systems (HISs) are typically seen as a mechanism for reducing medical errors. There is, however, evidence to prove that technology may actually be the cause of errors. As a result, it is crucial to fully test any system prior to its implementation. At present, evidence-based evaluation heuristics do not exist for assessing aspects of interface design that lead to medical errors. A three phase study was conducted to develop evidence-based heuristics for evaluating interfaces. Phase 1 consisted of a systematic review of the literature. In Phase 2 a comprehensive list of 33 evaluation heuristics was developed based on the review that could be used to test for potential technology induced errors. Phase 3 involved applying these healthcare specific heuristics to evaluate a HIS.

Electrophysiology of Cranial Nerve Testing: Spinal Accessory and Hypoglossal Nerves.

PubMed

Stino, Amro M; Smith, Benn E

2018-01-01

Multiple techniques have been developed for the electrodiagnostic evaluation of cranial nerves XI and XII. Each of these carries both benefits and limitations, with more techniques and data being available in the literature for spinal accessory than hypoglossal nerve evaluation. Spinal accessory and hypoglossal neuropathy are relatively uncommon cranial mononeuropathies that may be evaluated in the outpatient electrodiagnostic laboratory setting. A review of available literature using PubMed was conducted regarding electrodiagnostic technique in the evaluation of spinal accessory and hypoglossal nerves searching for both routine nerve conduction studies and repetitive nerve conduction studies. The review provided herein provides a resource by which clinical neurophysiologists may develop and implement clinical and research protocols for the evaluation of both of these lower cranial nerves in the outpatient setting.

Developmental Neurotoxicology: History and Outline of ...

EPA Pesticide Factsheets

The present work provides a brief review of basic concepts in developmental neurotoxicology, as well as current representative testing guidelines for evaluating developmental neurotoxicity (DNT) of xenobiotics. Historically, DNT was initially recognized as a “functional” teratogenicity: the main concern was that prenatal and/or early postnatal exposures to chemicals during critical periods of central nervous system (CNS) development would cause later functional abnormalities of the brain. Current internationally harmonized DNT study guidelines are thus intended to predict adverse effects of test compounds on the developing CNS by observing such postnatal parameters as motor activity, startle response, and learning and memory, as well as neropathological alterations. The reliability of current DNT study guidelines and sensitivity of testing methodologies recommended in these guidelines have been confirmed by retrospective evaluations of the many international and domestic collaborative validation studies in developed nations including Japan. Invited review with brief review of basic concepts in developmental neurotoxicology, as well as current representative testing guidelines for evaluating developmental neurotoxicity (DNT) of xenobiotics.

A critical literature review of health economic evaluations of rotavirus vaccination

PubMed Central

Aballéa, Samuel; Millier, Aurélie; Quilici, Sibilia; Caroll, Stuart; Petrou, Stavros; Toumi, Mondher

2013-01-01

Two licensed vaccines are available to prevent RVGE in infants. A worldwide critical review of economic evaluations of these vaccines was conducted. The objective was to describe differences in methodologies, assumptions and inputs and determine the key factors driving differences in conclusions. 68 economic evaluations were reviewed. RV vaccination was found to be cost-effective in developing countries, while conclusions varied between studies in developed countries. Many studies found that vaccination was likely to be cost-effective under some scenarios, such as lower prices scenarios, inclusion of herd protection, and/or adoption of a societal perspective. Other reasons for variability included uncertainty around healthcare visits incidence and lack of consensus on quality of life (QoL) valuation for infants and caregivers. New evidence on the vaccination effectiveness in real-world, new ways of modeling herd protection and assessments of QoL in children could help more precisely define the conditions under which RV vaccination would be cost-effective in developed countries. PMID:23571226

Incident reviews in UK maternity units: a systematic appraisal of the quality of local guidelines.

PubMed

Shah, Anjali; Mohamed-Ahmed, Olaa; Peirsegaele, Philippe; McClymont, Charlotte; Knight, Marian

2015-03-14

Maternity care is recognised as a particularly high-risk speciality that is subject to investigation and inquiry, and improvements in risk management have been recommended. However, the quality of guidelines for local reviews of maternity incidents is unknown. The aim of the study is to appraise the quality of local guidance on conducting reviews of severe maternity incidents in the National Health Service. Guidelines for incident reviews were requested from all 211 consultant-led maternity units in the UK during 2012. The Appraisal of Guidelines for Research and Evaluation Instrument (AGREE II) was used to evaluate the quality of guidelines. The methods used for reviewing an incident, the people involved in the review and the methods for disseminating the outcomes of the reviews were also examined. Guidelines covering 148 (70%) of all NHS maternity units in the UK were received for evaluation. Most guidelines (55%) received were of good or high quality. The median score on 'scope and purpose' (86%), concerned with the aims and target population of the guideline, was higher than for other domains. Median scores were: 'stakeholder involvement' (representation of users' views) 56%, 'rigour of development' (process used to develop guideline) 34%, 'clarity of presentation' 78%, 'applicability' (organisational and cost implications of applying guideline) 56% and 'editorial independence' 0%. Most guidelines (81%) recommended a range of health professionals review serious maternity incidents using root cause analysis. Findings were most often disseminated at meetings, in reports and in newsletters. Many guidelines (69%) stated lessons learnt from incidents would be audited. Overall, local guidance for the review of maternity incidents was mostly of good or high quality. Stakeholder participation in guideline development could be widened, and editorial independence more clearly stated. It was unclear in over a quarter of guidelines whether changes in practice in response to review recommendations were audited or monitored; such auditing should be mandatory. Further research is required to examine the translation of guidance into practice by evaluating the quality of local reviews of maternity incidents.

78 FR 48179 - National Institute of Neurological Disorders and Stroke; Notice of Closed Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-07

... Disorders and Stroke Special Emphasis Panel; Review Career Development Awards. Date: August 14, 2013. Time: 2:00 p.m. to 3:00 p.m. Agenda: To review and evaluate grant applications. Place: National Institutes...). Contact Person: Raul A. Saavedra, Ph.D., Scientific Review Officer, Scientific Review Branch, Division of...

Progress in centralised ethics review processes: Implications for multi-site health evaluations.

PubMed

Prosser, Brenton; Davey, Rachel; Gibson, Diane

2015-04-01

Increasingly, public sector programmes respond to complex social problems that intersect specific fields and individual disciplines. Such responses result in multi-site initiatives that can span nations, jurisdictions, sectors and organisations. The rigorous evaluation of public sector programmes is now a baseline expectation. For evaluations of large and complex multi-site programme initiatives, the processes of ethics review can present a significant challenge. However in recent years, there have been new developments in centralised ethics review processes in many nations. This paper provides the case study of an evaluation of a national, inter-jurisdictional, cross-sector, aged care health initiative and its encounters with Australian centralised ethics review processes. Specifically, the paper considers progress against the key themes of a previous five-year, five nation study (Fitzgerald and Phillips, 2006), which found that centralised ethics review processes would save time, money and effort, as well as contribute to more equitable workloads for researchers and evaluators. The paper concludes with insights for those charged with refining centralised ethics review processes, as well as recommendations for future evaluators of complex multi-site programme initiatives. Copyright © 2015 Elsevier Ltd. All rights reserved.

Systematic Review of Educational Interventions for Looked-After Children and Young People: Recommendations for Intervention Development and Evaluation

ERIC Educational Resources Information Center

Evans, Rhiannon; Brown, Rachel; Rees, Gwyther; Smith, Philip

2017-01-01

Looked-after children and young people (LACYP) are educationally disadvantaged compared to the general population. A systematic review was conducted of randomised controlled trials evaluating interventions aimed at LACYP aged =18 years. Restrictions were not placed on delivery setting or delivery agent. Intervention outcomes were: academic skills;…

25 CFR 224.133 - What must the Director do after a periodic review and evaluation?

Code of Federal Regulations, 2011 CFR

2011-04-01

... 25 Indians 1 2011-04-01 2011-04-01 false What must the Director do after a periodic review and evaluation? 224.133 Section 224.133 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF...

25 CFR 224.134 - How often must the Director conduct a periodic review and evaluation?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 25 Indians 1 2010-04-01 2010-04-01 false How often must the Director conduct a periodic review and evaluation? 224.134 Section 224.134 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF...

25 CFR 224.134 - How often must the Director conduct a periodic review and evaluation?

Code of Federal Regulations, 2011 CFR

2011-04-01

... 25 Indians 1 2011-04-01 2011-04-01 false How often must the Director conduct a periodic review and evaluation? 224.134 Section 224.134 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF...

25 CFR 224.133 - What must the Director do after a periodic review and evaluation?

Code of Federal Regulations, 2010 CFR

2010-04-01

... 25 Indians 1 2010-04-01 2010-04-01 false What must the Director do after a periodic review and evaluation? 224.133 Section 224.133 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR ENERGY AND MINERALS TRIBAL ENERGY RESOURCE AGREEMENTS UNDER THE INDIAN TRIBAL ENERGY DEVELOPMENT AND SELF...

Teacher Evaluation: Alternate Measures of Student Growth. Q&A with Brian Gill. REL Mid-Atlantic Webinar

ERIC Educational Resources Information Center

Regional Educational Laboratory Mid-Atlantic, 2013

2013-01-01

This webinar described the findings of our literature review on alternative measures of student growth that are used in teacher evaluation. The review focused on two types of alternative growth measures: statistical growth/value-added models and teacher-developed student learning objectives. This Q&A addressed the questions participants had…

Evaluation of health risks for contaminated aquifers.

PubMed Central

Piver, W T; Jacobs, T L; Medina, M A

1997-01-01

This review focuses on progress in the development of transport models for heterogeneous contaminated aquifers, the use of predicted contaminant concentrations in groundwater for risk assessment for heterogeneous human populations, and the evaluation of aquifer remediation technologies. Major limitations and areas for continuing research for all methods presented in this review are identified. Images Figure 2. PMID:9114282

Developing core economic outcome sets for asthma studies: a protocol for a systematic review.

PubMed

Hounsome, Natalia; Fitzsimmons, Deborah; Phillips, Ceri; Patel, Anita

2017-08-11

Core outcome sets are standardised lists of outcomes, which should be measured and reported in all clinical studies of a specific condition. This study aims to develop core outcome sets for economic evaluations in asthma studies. Economic outcomes include items such as costs, resource use or quality-adjusted life years. The starting point in developing core outcome sets will be conducting a systematic literature review to establish a preliminary list of reporting items to be considered for inclusion in the core outcome set. We will conduct literature searches of peer-reviewed studies published from January 1990 to January 2017. These will include any comparative or observational studies (including economic models) and systematic reviews reporting economic outcomes. All identified economic outcomes will be tabulated together with the major study characteristics, such as population, study design, the nature and intensity of the intervention, mode of data collection and instrument(s) used to derive an outcome. We will undertake a 'realist synthesis review' to analyse the identified economic outcomes. The outcomes will be summarised in the context of evaluation perspectives, types of economic evaluation and methodological approaches. Parallel to undertaking a systematic review, we will conduct semistructured interviews with stakeholders (including people with personal experience of asthma, health professionals, researchers and decision makers) in order to explore additional outcomes which have not been considered, or used, in published studies. The list of outcomes generated from the systematic review and interviews with stakeholders will form the basis of a Delphi survey to refine the identified outcomes into a core outcome set. The review will not involve access to individual-level data. Findings from our systematic review will be communicated to a broad range of stakeholders including clinical guideline developers, research funders, trial registries, ethics committees and other regulators. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Systematic Review of Empirically Evaluated School-Based Gambling Education Programs.

PubMed

Keen, Brittany; Blaszczynski, Alex; Anjoul, Fadi

2017-03-01

Adolescent problem gambling prevalence rates are reportedly five times higher than in the adult population. Several school-based gambling education programs have been developed in an attempt to reduce problem gambling among adolescents; however few have been empirically evaluated. The aim of this review was to report the outcome of studies empirically evaluating gambling education programs across international jurisdictions. A systematic review following guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement searching five academic databases: PubMed, Scopus, Medline, PsycINFO, and ERIC, was conducted. A total of 20 papers and 19 studies were included after screening and exclusion criteria were applied. All studies reported intervention effects on cognitive outcomes such as knowledge, perceptions, and beliefs. Only nine of the studies attempted to measure intervention effects on behavioural outcomes, and only five of those reported significant changes in gambling behaviour. Of these five, methodological inadequacies were commonly found including brief follow-up periods, lack of control comparison in post hoc analyses, and inconsistencies and misclassifications in the measurement of gambling behaviour, including problem gambling. Based on this review, recommendations are offered for the future development and evaluation of school-based gambling education programs relating to both methodological and content design and delivery considerations.

Dementia training programmes for staff working in general hospital settings - a systematic review of the literature.

PubMed

Scerri, Anthony; Innes, Anthea; Scerri, Charles

2017-08-01

Although literature describing and evaluating training programmes in hospital settings increased in recent years, there are no reviews that summarise these programmes. This review sought to address this, by collecting the current evidence on dementia training programmes directed to staff working in general hospitals. Literature from five databases were searched, based on a number of inclusion criteria. The selected studies were summarised and data was extracted and compared using narrative synthesis based on a set of pre-defined categories. Methodological quality was assessed. Fourteen peer-reviewed studies were identified with the majority being pre-test post-test investigations. No randomised controlled trials were found. Methodological quality was variable with selection bias being the major limitation. There was a great variability in the development and mode of delivery although, interdisciplinary ward based, tailor-made, short sessions using experiential and active learning were the most utilised. The majority of the studies mainly evaluated learning, with few studies evaluating changes in staff behaviour/practices and patients' outcomes. This review indicates that high quality studies are needed that especially evaluate staff behaviours and patient outcomes and their sustainability over time. It also highlights measures that could be used to develop and deliver training programmes in hospital settings.

Systematic review protocol of interventions to improve the psychological well-being of general practitioners.

PubMed

Murray, Marylou; Murray, Lois; Donnelly, Michael

2015-09-22

The challenges and complexities faced by general practitioners are increasing, and there are concerns about their well-being. Consequently, attention has been directed towards developing and evaluating interventions and strategies to improve general practitioner well-being and their capacity to cope with workplace challenges. This systematic review aims to evaluate research evidence regarding the effectiveness of interventions designed to improve general practitioner well-being. Eligible studies will include programmes developed to improve psychological well-being that have assessed outcomes using validated tools pertaining to well-being and related outcomes. Only programmes that have been evaluated using controlled study designs will be reviewed. An appropriately developed search strategy will be applied to six electronic databases: the Cochrane Database of Systematic Reviews, MEDLINE, Embase, CINAHL, PsycINFO and Web of Science. Studies will be screened in two stages by two independent reviewers. A third reviewer will arbitrate when required. Pre-specified inclusion and exclusion criteria will be assessed during a pilot phase early on in the review process. The Cochrane data extraction form will be adapted and applied to each eligible study by two independent reviewers, and each study will be appraised critically using standardised checklists from the Cochrane Handbook. Methodological quality will be taken into account in the analysis of the data and the synthesis of results. A narrative synthesis will be undertaken if data is unsuited to a meta-analysis. The systematic review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidance. This will be the first systematic review on this topic, and the evidence synthesis will aid decision-making by general practitioners, policy makers and planners regarding ways in which to improve GP well-being. Findings will be disseminated at general practitioner meetings, conferences and in professional and peer-reviewed journals. PROSPERO CRD42015017899.

Development and evaluation of 'briefing notes' as a novel knowledge translation tool to aid the implementation of sex/gender analysis in systematic reviews: a pilot study.

PubMed

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E; Shea, Beverley; O'Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly 'briefing note' format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group's focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations.

Electronic health records implementation: an evaluation of information system impact and contingency factors.

PubMed

Nguyen, Lemai; Bellucci, Emilia; Nguyen, Linh Thuy

2014-11-01

This paper provides a review of EHR (electronic health record) implementations around the world and reports on findings including benefits and issues associated with EHR implementation. A systematic literature review was conducted from peer-reviewed scholarly journal publications from the last 10 years (2001-2011). The search was conducted using various publication collections including: Scopus, Embase, Informit, Medline, Proquest Health and Medical Complete. This paper reports on our analysis of previous empirical studies of EHR implementations. We analysed data based on an extension of DeLone and McLean's information system (IS) evaluation framework. The extended framework integrates DeLone and McLean's dimensions, including information quality, system quality, service quality, intention of use and usage, user satisfaction and net benefits, together with contingent dimensions, including systems development, implementation attributes and organisational aspects, as identified by Van der Meijden and colleagues. A mix of evidence-based positive and negative impacts of EHR was found across different evaluation dimensions. In addition, a number of contingent factors were found to contribute to successful implementation of EHR. This review does not include white papers or industry surveys, non-English papers, or those published outside the review time period. This review confirms the potential of this technology to aid patient care and clinical documentation; for example, in improved documentation quality, increased administration efficiency, as well as better quality, safety and coordination of care. Common negative impacts include changes to workflow and work disruption. Mixed observations were found on EHR quality, adoption and satisfaction. The review warns future implementers of EHR to carefully undertake the technology implementation exercise. The review also informs healthcare providers of contingent factors that potentially affect EHR development and implementation in an organisational setting. Our findings suggest a lack of socio-technical connectives between the clinician, the patient and the technology in developing and implementing EHR and future developments in patient-accessible EHR. In addition, a synthesis of DeLone and McLean's framework and Van der Meijden and colleagues' contingent factors has been found useful in comprehensively understanding and evaluating EHR implementations. Crown Copyright © 2014. Published by Elsevier Ireland Ltd. All rights reserved.

Drug interactions evaluation: An integrated part of risk assessment of therapeutics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Lei; Reynolds, Kellie S.; Zhao, Ping

2010-03-01

Pharmacokinetic drug interactions can lead to serious adverse events or decreased drug efficacy. The evaluation of a new molecular entity's (NME's) drug-drug interaction potential is an integral part of risk assessment during drug development and regulatory review. Alteration of activities of enzymes or transporters involved in the absorption, distribution, metabolism, or excretion of a new molecular entity by concomitant drugs may alter drug exposure, which can impact response (safety or efficacy). The recent Food and Drug Administration (FDA) draft drug interaction guidance ( (http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/ucm072101.pdf)) highlights the methodologies and criteria that may be used to guide drug interaction evaluation by industrymore » and regulatory agencies and to construct informative labeling for health practitioner and patients. In addition, the Food and Drug Administration established a 'Drug Development and Drug Interactions' website to provide up-to-date information regarding evaluation of drug interactions ( (http://www.fda.gov/Drugs/DevelopmentApprovalProcess/DevelopmentResources/DrugInteractionsLabeling/ucm080499.htm)). This review summarizes key elements in the FDA drug interaction guidance and new scientific developments that can guide the evaluation of drug-drug interactions during the drug development process.« less

Motor Rehabilitation Using Kinect: A Systematic Review.

PubMed

Da Gama, Alana; Fallavollita, Pascal; Teichrieb, Veronica; Navab, Nassir

2015-04-01

Interactive systems are being developed with the intention to help in the engagement of patients on various therapies. Amid the recent technological advances, Kinect™ from Microsoft (Redmond, WA) has helped pave the way on how user interaction technology facilitates and complements many clinical applications. In order to examine the actual status of Kinect developments for rehabilitation, this article presents a systematic review of articles that involve interactive, evaluative, and technical advances related to motor rehabilitation. Systematic research was performed in the IEEE Xplore and PubMed databases using the key word combination "Kinect AND rehabilitation" with the following inclusion criteria: (1) English language, (2) page number >4, (3) Kinect system for assistive interaction or clinical evaluation, or (4) Kinect system for improvement or evaluation of the sensor tracking or movement recognition. Quality assessment was performed by QualSyst standards. In total, 109 articles were found in the database research, from which 31 were included in the review: 13 were focused on the development of assistive systems for rehabilitation, 3 in evaluation, 3 in the applicability category, 7 on validation of Kinect anatomic and clinical evaluation, and 5 on improvement techniques. Quality analysis of all included articles is also presented with their respective QualSyst checklist scores. Research and development possibilities and future works with the Kinect for rehabilitation application are extensive. Methodological improvements when performing studies on this area need to be further investigated.

Alternative approaches to forestry research evaluation: an assessment.

Treesearch

Pamela J. Jakes; Earl C. Leatherberry

1986-01-01

Reviews research evaluation techniques in a variety of fields an assesses the usefulness of various approaches or combinations of approaches for forestry research evaluation. Presents an evaluation framework that will help users develop an approach suitable for their specific problem.

Early economic evaluation of emerging health technologies: protocol of a systematic review

PubMed Central

2014-01-01

Background The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. Methods/design This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. Discussion This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives. PMID:25055987

Early economic evaluation of emerging health technologies: protocol of a systematic review.

PubMed

Pham, Ba'; Tu, Hong Anh Thi; Han, Dolly; Pechlivanoglou, Petros; Miller, Fiona; Rac, Valeria; Chin, Warren; Tricco, Andrea C; Paulden, Mike; Bielecki, Joanna; Krahn, Murray

2014-07-23

The concept of early health technology assessment, discussed well over a decade, has now been collaboratively implemented by industry, government, and academia to select and expedite the development of emerging technologies that may address the needs of patients and health systems. Early economic evaluation is essential to assess the value of emerging technologies, but empirical data to inform the current practice of early evaluation is limited. We propose a systematic review of early economic evaluation studies in order to better understand the current practice. This protocol describes a systematic review of economic evaluation studies of regulated health technologies in which the evaluation is conducted prior to regulatory approval and when the technology effectiveness is not well established. Included studies must report an economic evaluation, defined as the comparative analysis of alternatives with respect to their associated costs and health consequences, and must evaluate some regulated health technology such as pharmaceuticals, biologics, high-risk medical devices, or biomarkers. We will conduct the literature search on multiple databases, including MEDLINE, EMBASE, the Centre for Reviews and Dissemination Databases, and EconLit. Additional citations will be identified via scanning reference lists and author searching. We suspect that many early economic evaluation studies are unpublished, especially those conducted for internal use only. Additionally, we use a chain-referral sampling approach to identify authors of unpublished studies who work in technology discovery and development, starting out with our contact lists and authors who published relevant studies. Citation screening and full-text review will be conducted by pairs of reviewers. Abstracted data will include those related to the decision context and decision problem of the early evaluation, evaluation methods (e.g., data sources, methods, and assumptions used to identify, measure, and value the likely effectiveness and the costs and consequences of the new technology, handling of uncertainty), and whether the study results adequately address the main study question or objective. Data will be summarized overall and stratified by publication status. This study is timely to inform early economic evaluation practice, given the international trend in early health technology assessment initiatives.

Short message service (SMS) applications for disease prevention in developing countries.

PubMed

Déglise, Carole; Suggs, L Suzanne; Odermatt, Peter

2012-01-12

The last decade has witnessed unprecedented growth in the number of mobile phones in the developing world, thus linking millions of previously unconnected people. The ubiquity of mobile phones, which allow for short message service (SMS), provides new and innovative opportunities for disease prevention efforts. The aim of this review was to describe the characteristics and outcomes of SMS interventions for disease prevention in developing countries and provide recommendations for future work. A systematic search of peer-reviewed and gray literature was performed for papers published in English, French, and German before May 2011 that describe SMS applications for disease prevention in developing countries. A total of 34 SMS applications were described, among which 5 had findings of an evaluation reported. The majority of SMS applications were pilot projects in various levels of sophistication; nearly all came from gray literature sources. Many applications were initiated by the project with modes of intervention varying between one-way or two-way communication, with or without incentives, and with educative games. Evaluated interventions were well accepted by the beneficiaries. The primary barriers identified were language, timing of messages, mobile network fluctuations, lack of financial incentives, data privacy, and mobile phone turnover. This review illustrates that while many SMS applications for disease prevention exist, few have been evaluated. The dearth of peer-reviewed studies and the limited evidence found in this systematic review highlight the need for high-quality efficacy studies examining behavioral, social, and economic outcomes of SMS applications and mobile phone interventions aimed to promote health in developing country contexts.

Short Message Service (SMS) Applications for Disease Prevention in Developing Countries

PubMed Central

Suggs, L. Suzanne; Odermatt, Peter

2012-01-01

Background The last decade has witnessed unprecedented growth in the number of mobile phones in the developing world, thus linking millions of previously unconnected people. The ubiquity of mobile phones, which allow for short message service (SMS), provides new and innovative opportunities for disease prevention efforts. Objective The aim of this review was to describe the characteristics and outcomes of SMS interventions for disease prevention in developing countries and provide recommendations for future work. Methods A systematic search of peer-reviewed and gray literature was performed for papers published in English, French, and German before May 2011 that describe SMS applications for disease prevention in developing countries. Results A total of 34 SMS applications were described, among which 5 had findings of an evaluation reported. The majority of SMS applications were pilot projects in various levels of sophistication; nearly all came from gray literature sources. Many applications were initiated by the project with modes of intervention varying between one-way or two-way communication, with or without incentives, and with educative games. Evaluated interventions were well accepted by the beneficiaries. The primary barriers identified were language, timing of messages, mobile network fluctuations, lack of financial incentives, data privacy, and mobile phone turnover. Conclusion This review illustrates that while many SMS applications for disease prevention exist, few have been evaluated. The dearth of peer-reviewed studies and the limited evidence found in this systematic review highlight the need for high-quality efficacy studies examining behavioral, social, and economic outcomes of SMS applications and mobile phone interventions aimed to promote health in developing country contexts. PMID:22262730

Electricity from biomass: A development strategy

NASA Astrophysics Data System (ADS)

1992-04-01

The purpose of this document is to review the current status of biomass power technology and to evaluate the future directions for development that could significantly enhance the contribution of biomass power to U.S. production of electricity. This document reviews the basic principles of biomass electric systems, the previous contributions of industry and the National Biomass Energy Programs to technology development, and the options for future technology development. It discusses the market for biomass electric technology and future needs for electric power production to help establish a market-oriented development strategy. It projects trends in the performance and cost of the technology and examines the changing dynamics of the power generation market place to evaluate specific opportunities for biomass power development. In a separate document, the Biomass Power Program Five Year R&D Plan, the details of schedules, funding, and roles of participating R&D organizations within the R&D program funded by the U.S. Department of Energy (DOE) are presented. In evaluating the future directions for research and development, two cases are examined.

Herbal medicine for idiopathic central precocious puberty: A protocol for a systematic review of controlled trials.

PubMed

Lee, Hye Lim; Lee, Yoo Been; Choi, Jun-Yong; Lee, Ju Ah

2018-03-01

Herbal medicine is widely used in East Asia to treat idiopathic central precocious puberty (ICPP). Most of the available clinical trials that investigated herbal medicine for ICPP have been included in this review. This systematic review will assess the efficacy and safety of herbal medicine for ICPP. Eleven databases, including Asian databases, will be searched for studies conducted through 2018. We will include randomized controlled trials assessing herbal medicine for ICPP. The risk of bias will be evaluated using the Cochrane risk of bias assessment tool, and confidence in the cumulative evidence will be evaluated using the Grading of Recommendations Assessment, Development, and Evaluation instrument. This systematic review will be published in a peer-reviewed journal and disseminated both electronically and in print. The review will be updated to inform and guide health care practices. PROSPER 2018 CRD42018087988.

A hybrid method for evaluating enterprise architecture implementation.

PubMed

Nikpay, Fatemeh; Ahmad, Rodina; Yin Kia, Chiam

2017-02-01

Enterprise Architecture (EA) implementation evaluation provides a set of methods and practices for evaluating the EA implementation artefacts within an EA implementation project. There are insufficient practices in existing EA evaluation models in terms of considering all EA functions and processes, using structured methods in developing EA implementation, employing matured practices, and using appropriate metrics to achieve proper evaluation. The aim of this research is to develop a hybrid evaluation method that supports achieving the objectives of EA implementation. To attain this aim, the first step is to identify EA implementation evaluation practices. To this end, a Systematic Literature Review (SLR) was conducted. Second, the proposed hybrid method was developed based on the foundation and information extracted from the SLR, semi-structured interviews with EA practitioners, program theory evaluation and Information Systems (ISs) evaluation. Finally, the proposed method was validated by means of a case study and expert reviews. This research provides a suitable foundation for researchers who wish to extend and continue this research topic with further analysis and exploration, and for practitioners who would like to employ an effective and lightweight evaluation method for EA projects. Copyright © 2016 Elsevier Ltd. All rights reserved.

Vending machine assessment methodology. A systematic review.

PubMed

Matthews, Melissa A; Horacek, Tanya M

2015-07-01

The nutritional quality of food and beverage products sold in vending machines has been implicated as a contributing factor to the development of an obesogenic food environment. How comprehensive, reliable, and valid are the current assessment tools for vending machines to support or refute these claims? A systematic review was conducted to summarize, compare, and evaluate the current methodologies and available tools for vending machine assessment. A total of 24 relevant research studies published between 1981 and 2013 met inclusion criteria for this review. The methodological variables reviewed in this study include assessment tool type, study location, machine accessibility, product availability, healthfulness criteria, portion size, price, product promotion, and quality of scientific practice. There were wide variations in the depth of the assessment methodologies and product healthfulness criteria utilized among the reviewed studies. Of the reviewed studies, 39% evaluated machine accessibility, 91% evaluated product availability, 96% established healthfulness criteria, 70% evaluated portion size, 48% evaluated price, 52% evaluated product promotion, and 22% evaluated the quality of scientific practice. Of all reviewed articles, 87% reached conclusions that provided insight into the healthfulness of vended products and/or vending environment. Product healthfulness criteria and complexity for snack and beverage products was also found to be variable between the reviewed studies. These findings make it difficult to compare results between studies. A universal, valid, and reliable vending machine assessment tool that is comprehensive yet user-friendly is recommended. Copyright © 2015 Elsevier Ltd. All rights reserved.

Translating New Science Into the Drug Review Process

PubMed Central

Rouse, Rodney; Kruhlak, Naomi; Weaver, James; Burkhart, Keith; Patel, Vikram; Strauss, David G.

2017-01-01

In 2011, the US Food and drug Administration (FDA) developed a strategic plan for regulatory science that focuses on developing new tools, standards, and approaches to assess the safety, efficacy, quality, and performance of FDA-regulated products. In line with this, the Division of Applied Regulatory Science was created to move new science into the Center for Drug Evaluation and Research (CDER) review process and close the gap between scientific innovation and drug review. The Division, located in the Office of Clinical Pharmacology, is unique in that it performs mission-critical applied research and review across the translational research spectrum including in vitro and in vivo laboratory research, in silico computational modeling and informatics, and integrated clinical research covering clinical pharmacology, experimental medicine, and postmarket analyses. The Division collaborates with Offices throughout CDER, across the FDA, other government agencies, academia, and industry. The Division is able to rapidly form interdisciplinary teams of pharmacologists, biologists, chemists, computational scientists, and clinicians to respond to challenging regulatory questions for specific review issues and for longer-range projects requiring the development of predictive models, tools, and biomarkers to speed the development and regulatory evaluation of safe and effective drugs. This article reviews the Division’s recent work and future directions, highlighting development and validation of biomarkers; novel humanized animal models; translational predictive safety combining in vitro, in silico, and in vivo clinical biomarkers; chemical and biomedical informatics tools for safety predictions; novel approaches to speed the development of complex generic drugs, biosimilars, and antibiotics; and precision medicine. PMID:29568713

Management systems research study

NASA Technical Reports Server (NTRS)

Bruno, A. V.

1975-01-01

The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.

Do economic evaluation studies inform effective healthcare resource allocation in Iran? A critical review of the literature.

PubMed

Haghparast-Bidgoli, Hassan; Kiadaliri, Aliasghar Ahmad; Skordis-Worrall, Jolene

2014-01-01

To aid informed health sector decision-making, data from sufficient high quality economic evaluations must be available to policy makers. To date, no known study has analysed the quantity and quality of available Iranian economic evaluation studies. This study aimed to assess the quantity, quality and targeting of economic evaluation studies conducted in the Iranian context. The study systematically reviewed full economic evaluation studies (n = 30) published between 1999 and 2012 in international and local journals. The findings of the review indicate that although the literature on economic evaluation in Iran is growing, these evaluations were of poor quality and suffer from several major methodological flaws. Furthermore, the review reveals that economic evaluation studies have not addressed the major health problems in Iran. While the availability of evidence is no guarantee that it will be used to aid decision-making, the absence of evidence will certainly preclude its use. Considering the deficiencies in the data identified by this review, current economic evaluations cannot be a useful source of information for decision makers in Iran. To improve the quality and overall usefulness of economic evaluations we would recommend; 1) developing clear national guidelines for the conduct of economic evaluations, 2) highlighting priority areas where information from such studies would be most useful and 3) training researchers and policy makers in the calculation and use of economic evaluation data.

Do economic evaluation studies inform effective healthcare resource allocation in Iran? A critical review of the literature

PubMed Central

2014-01-01

To aid informed health sector decision-making, data from sufficient high quality economic evaluations must be available to policy makers. To date, no known study has analysed the quantity and quality of available Iranian economic evaluation studies. This study aimed to assess the quantity, quality and targeting of economic evaluation studies conducted in the Iranian context. The study systematically reviewed full economic evaluation studies (n = 30) published between 1999 and 2012 in international and local journals. The findings of the review indicate that although the literature on economic evaluation in Iran is growing, these evaluations were of poor quality and suffer from several major methodological flaws. Furthermore, the review reveals that economic evaluation studies have not addressed the major health problems in Iran. While the availability of evidence is no guarantee that it will be used to aid decision-making, the absence of evidence will certainly preclude its use. Considering the deficiencies in the data identified by this review, current economic evaluations cannot be a useful source of information for decision makers in Iran. To improve the quality and overall usefulness of economic evaluations we would recommend; 1) developing clear national guidelines for the conduct of economic evaluations, 2) highlighting priority areas where information from such studies would be most useful and 3) training researchers and policy makers in the calculation and use of economic evaluation data. PMID:25050084

Measuring organizational and individual factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2012-01-01

Background Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. Study selection: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. Conclusions Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice. PMID:23241168

Mobile Applications for Patient-centered Care Coordination: A Review of Human Factors Methods Applied to their Design, Development, and Evaluation

PubMed Central

Westbrook, J. I.

2015-01-01

Summary Objectives To examine if human factors methods were applied in the design, development, and evaluation of mobile applications developed to facilitate aspects of patient-centered care coordination. Methods We searched MEDLINE and EMBASE (2013-2014) for studies describing the design or the evaluation of a mobile health application that aimed to support patients’ active involvement in the coordination of their care. Results 34 papers met the inclusion criteria. Applications ranged from tools that supported self-management of specific conditions (e.g. asthma) to tools that provided coaching or education. Twelve of the 15 papers describing the design or development of an app reported the use of a human factors approach. The most frequently used methods were interviews and surveys, which often included an exploration of participants’ current use of information technology. Sixteen papers described the evaluation of a patient application in practice. All of them adopted a human factors approach, typically an examination of the use of app features and/or surveys or interviews which enquired about patients’ views of the effects of using the app on their behaviors (e.g. medication adherence), knowledge, and relationships with healthcare providers. No study in our review assessed the impact of mobile applications on health outcomes. Conclusion The potential of mobile health applications to assist patients to more actively engage in the management of their care has resulted in a large number of applications being developed. Our review showed that human factors approaches are nearly always adopted to some extent in the design, development, and evaluation of mobile applications. PMID:26293851

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

How Can We Assess and Evaluate the Competitive Advantage of a Country's Human Resource Development System?

ERIC Educational Resources Information Center

Oh, Hunseok; Ryu, Hyue-Hyun; Choi, Myungweon

2013-01-01

The purpose of this study was to develop an index to assess and evaluate the competitive advantage of a country's human resource development system. Based on an extensive literature review, a theoretical model of a human resource development system at the national level (named National Human Resource Development: NHRD) was constructed. The…

Evaluation and use of the Materials and Test (MATT) Data System for quality of construction and management review : final report.

DOT National Transportation Integrated Search

1985-12-01

This report documents the review of the MATerials and Test (MATT) Data System to check the validity of data within the system. A computer program to generate the quality level of a construction material was developed. Programs were also developed to ...

Pesticide Label Review Training

EPA Pesticide Factsheets

This training will help ensure that reviewers evaluate labels according to four core principles. It also will help pesticide registrants developing labels understand what EPA expects of pesticide labels, and what the Agency generally finds acceptable.

Using the Medical Research Council framework for the development and evaluation of complex interventions in a theory-based infant feeding intervention to prevent childhood obesity: the baby milk intervention and trial.

PubMed

Lakshman, Rajalakshmi; Griffin, Simon; Hardeman, Wendy; Schiff, Annie; Kinmonth, Ann Louise; Ong, Ken K

2014-01-01

We describe our experience of using the Medical Research Council framework on complex interventions to guide the development and evaluation of an intervention to prevent obesity by modifying infant feeding behaviours. We reviewed the epidemiological evidence on early life risk factors for obesity and interventions to prevent obesity in this age group. The review suggested prevention of excess weight gain in bottle-fed babies and appropriate weaning as intervention targets; hence we undertook systematic reviews to further our understanding of these behaviours. We chose theory and behaviour change techniques that demonstrated evidence of effectiveness in altering dietary behaviours. We subsequently developed intervention materials and evaluation tools and conducted qualitative studies with mothers (intervention recipients) and healthcare professionals (intervention deliverers) to refine them. We developed a questionnaire to assess maternal attitudes and feeding practices to understand the mechanism of any intervention effects. In addition to informing development of our specific intervention and evaluation materials, use of the Medical Research Council framework has helped to build a generalisable evidence base for early life nutritional interventions. However, the process is resource intensive and prolonged, and this should be taken into account by public health research funders. This trial is registered with ISRTCN: 20814693 Baby Milk Trial.

Evaluation and treatment of childhood physical abuse and neglect: a review.

PubMed

Cummings, Marissa; Berkowitz, Steven J

2014-01-01

According to 2010 CDC estimates, 1 in 5 US children have experienced maltreatment. Risk factors for child maltreatment include child characteristics such as non-compliance and diagnostic conditions that increase caregiver burden. Parent characteristic risk factors include parental mental illness and low social support. New developments in radiologic evaluation of child maltreatment will be reviewed. New findings in evidence based psychotherapies for childhood maltreatment will be discussed. A review of the role of pharmacotherapy in child maltreatment cases will also be presented. New evidence from prevention models targeting young mothers and families are also reviewed.

Program Evaluation of Services for the Homeless: Challenges and Strategies.

ERIC Educational Resources Information Center

Mercier, Celine; And Others

1992-01-01

Research strategies, including types of evaluations, designs, and indicators, developed to assess programs for chronic alcoholics and mentally ill homeless people in Canada are reviewed. Findings from previous evaluations are summarized, and the implications for evaluation practice are considered. (SLD)

Job and Work Evaluation: A Literature Review.

ERIC Educational Resources Information Center

Heneman, Robert L.

2003-01-01

Describes advantages and disadvantages of work evaluation methods: ranking, market pricing, banding, classification, single-factor, competency, point-factor, and factor comparison. Compares work evaluation perspectives: traditional, realist, market advocate, strategist, organizational development, social reality, contingency theory, competency,…

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions.

PubMed

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-11-15

Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation.

[Development of guidance for the approval process of brand-new medical products and regenerative medicine products].

PubMed

Niimi, Shingo

2015-01-01

Ministry of Health, Labour and Weltare has been conducting development of guidance for the approval process of brand-new medical products/development of guidance for medical devices in collaboration with Ministry of Economy, Trade and Industry as part of measures to promote practical use of brand-new medical products since 2005. The objective of this project is to expedite the processes from developmental process of medical devices to approval review and to introduce the medical devices to medical front quickly.. Ministry of Health, Labour and Welfare side has been making guidance for the guide in approval process of brand-new medical products and regeneration medicine products to aim at acceleration and facilitation of development and approval process of innovative medical products. Twenty-two of the guidance have been issued as director of the evaluation and licensing division. The evaluation index about safety and efficacy required for medical devices and regenerative medicine products in progress were put together in these guidance and useful for medical devices developer to understand the point at the approved review. Therefore, I think that the evaluation index could also contribute to the efficient product development. The guidance about implantable artificial heart is issued as the representative example which was useful in the approved review.

Liquid biopsy on chip: a paradigm shift towards the understanding of cancer metastasis.

PubMed

Tadimety, Amogha; Syed, Abeer; Nie, Yuan; Long, Christina R; Kready, Kasia M; Zhang, John X J

2017-01-23

This comprehensive review serves as a guide for developing scalable and robust liquid biopsies on chip for capture, detection, and analysis of circulating tumor cells (CTCs). Liquid biopsy, the detection of biomarkers from body fluids, has proven challenging because of CTC rarity and the heterogeneity of CTCs shed from tumors. The review starts with the underlying biological mechanisms that make liquid biopsy a challenge before moving into an evaluation of current technological progress. Then, a framework for evaluation of the technologies is presented with special attention to throughput, capture rate, and cell viability for analysis. Technologies for CTC capture, detection, and analysis will be evaluated based on these criteria, with a focus on current approaches, limitations and future directions. The paper provides a critical review for microchip developers as well as clinical investigators to build upon the existing progress towards the goal of designing CTC capture, detection, and analysis platforms.

Developing Statistical Physics Course Handout on Distribution Function Materials Based on Science, Technology, Engineering, and Mathematics

NASA Astrophysics Data System (ADS)

Riandry, M. A.; Ismet, I.; Akhsan, H.

2017-09-01

This study aims to produce a valid and practical statistical physics course handout on distribution function materials based on STEM. Rowntree development model is used to produce this handout. The model consists of three stages: planning, development and evaluation stages. In this study, the evaluation stage used Tessmer formative evaluation. It consists of 5 stages: self-evaluation, expert review, one-to-one evaluation, small group evaluation and field test stages. However, the handout is limited to be tested on validity and practicality aspects, so the field test stage is not implemented. The data collection technique used walkthroughs and questionnaires. Subjects of this study are students of 6th and 8th semester of academic year 2016/2017 Physics Education Study Program of Sriwijaya University. The average result of expert review is 87.31% (very valid category). One-to-one evaluation obtained the average result is 89.42%. The result of small group evaluation is 85.92%. From one-to-one and small group evaluation stages, averagestudent response to this handout is 87,67% (very practical category). Based on the results of the study, it can be concluded that the handout is valid and practical.

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services.

PubMed

Briss, P A; Zaza, S; Pappaioanou, M; Fielding, J; Wright-De Agüero, L; Truman, B I; Hopkins, D P; Mullen, P D; Thompson, R S; Woolf, S H; Carande-Kulis, V G; Anderson, L; Hinman, A R; McQueen, D V; Teutsch, S M; Harris, J R

2000-01-01

Systematic reviews and evidence-based recommendations are increasingly important for decision making in health and medicine. Over the past 20 years, information on the science of synthesizing research results has exploded. However, some approaches to systematic reviews of the effectiveness of clinical preventive services and medical care may be less appropriate for evaluating population-based interventions. Furthermore, methods for linking evidence to recommendations are less well developed than methods for synthesizing evidence. The Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) will evaluate and make recommendations on population-based and public health interventions. This paper provides an overview of the Guide's process to systematically review evidence and translate that evidence into recommendations. The Guide reviews evidence on effectiveness, the applicability of effectiveness data, (i.e., the extent to which available effectiveness data is thought to apply to additional populations and settings), the intervention's other effects (i.e., important side effects), economic impact, and barriers to implementation of interventions. The steps for obtaining and evaluating evidence into recommendations involve: (1) forming multidisciplinary chapter development teams, (2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions in each chapter; (3) selecting interventions to be evaluated; (4) searching for and retrieving evidence; (5) assessing the quality of and summarizing the body of evidence of effectiveness; (6) translating the body of evidence of effectiveness into recommendations; (7) considering information on evidence other than effectiveness; and (8) identifying and summarizing research gaps. Systematic reviews of and evidence-based recommendations for population-health interventions are challenging and methods will continue to evolve. However, using an evidence-based approach to identify and recommend effective interventions directed at specific public health goals may reduce errors in how information is collected and interpreted, identify important gaps in current knowledge thus guiding further research, and enhance the Guide users' ability to assess whether recommendations are valid and prudent from their own perspectives. Over time, all of these advantages could help to increase agreement regarding appropriate community health strategies and help to increase their implementation.

Measuring the youth bullying experience: a systematic review of the psychometric properties of available instruments.

PubMed

Vessey, Judith; Strout, Tania D; DiFazio, Rachel L; Walker, Allison

2014-12-01

Bullying is a significant problem in schools and measuring this concept remains problematic. The purposes of this study were to (1) identify the published self-report measures developed to assess youth bullying; (2) evaluate their psychometric properties and instrument characteristics; and (3) evaluate the quality of identified psychometric papers evaluating youth bullying measures. A systematic review of the literature was conducted using 4 electronic databases. Data extraction and appraisal of identified instruments were completed using a standardized method and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Thirty-one articles describing 27 self-report instruments were evaluated in our analysis. Quality assessments ranged from 18% to 91%, with 6 papers reaching or exceeding a quality score of 75%. Limited evidence supporting the reliability, validity, and responsiveness of existing youth bullying measures was identified. Evidence supporting the psychometric soundness of the instruments identified was limited. Many measures were in early development and additional evaluation is necessary to validate their psychometric properties. A pool of instruments possesses acceptable initial psychometric dependability for selected assessment purposes. These findings have significant implications for assessing youth bullying and designing and evaluating school-based interventions. © 2014, American School Health Association.

Evaluation of a youth agency's supervision practices: A mixed-method approach.

PubMed

Gosselin, Julie; Valiquette-Tessier, Sophie-Claire; Vandette, Marie-Pier; Romano, Elisa

2015-10-01

This research presents the findings from an evaluation and organizational development initiative that was requested by a Canadian youth agency working in a large urban setting. A team of four researchers affiliated with the Center for Research on Educational and Community Services (CRECS) at the University of Ottawa conducted the evaluation. The purpose of the evaluation was to identify the supervision needs and challenges of coordinators and front line staff, assess the efficiency of the current supervision practices, and evaluate the supervisors' and supervisees' satisfaction with these current practices. A literature review was performed to help provide a clear definition of 'supervision' and the different professional roles it encompasses. Additionally, research evidence pertaining both to what contributes to supervision efficacy and supervisor competency was reviewed to distill the most robust findings in the existing literature. The lines of evidence consisted of a document and file review, an online employee survey, group discussions (i.e. focus groups), and interviews with key informants. The results of the evaluation helped the research team formulate recommendations to the agency for the development of enhanced supervision practices across its various service areas. Copyright © 2015 Elsevier Ltd. All rights reserved.

75 FR 7489 - National Cancer Institute; Notice of Closed Meetings

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-19

... review and evaluate grant applications. Place: Legacy Hotel and Meeting Center, 1775 Rockville Pike, Rockville, MD 20852. Contact Person: Lalita D. Palekar, PhD, Scientific Review Officer, Special Review and... Institute Special Emphasis Panel; NCI Cancer Nanotechnology Training (R25) and Career Development Award (K99...

EPA OFFICE OF RESEARCH AND DEVELOPMENT GUIDELINES FOR TECHNICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide direction f...

STRATEGIES FOR EVALUATING INDICATORS BASED ON GUIDELINES FROM THE ENVIRONMENTAL PROTECTION AGENCY'S OFFICE OF RESEARCH AND DEVELOPMENT.

EPA Science Inventory

The Environmental Protection Agency's Office of Research and Development (ORD) has prepared technical guidelines to evaluate the suitability of ecological indicators for monitoring programs. The guidelines were adopted by ORD to provide a consistent framework for indicator review...

The quality of dying and death measurement instruments: A systematic psychometric review.

PubMed

Gutiérrez Sánchez, Daniel; Pérez Cruzado, David; Cuesta-Vargas, Antonio I

2018-04-19

To identify instruments that could assess the quality of dying and death and their psychometric properties. To assess the methodological quality of studies on measurement properties. A high quality of death is regarded as a goal at the end of life and, therefore, an assessment of the end of life experience is essential. Many instruments have been developed to evaluate the quality of dying and death. The selection of the most appropriate measure to be used in clinical and research settings is crucial. Psychometric systematic review. We systematically searched ProQuest Medline, SciELO and ProQuest PsycINFO from 1970 - May 2016. Identification and evaluation of instruments that assessed quality of dying and death. Papers were evaluated by two independent reviewers according to the COSMIN checklist with a 4-point scale. A total of 19 studies were included in this review. Seven instruments were found that were specifically designed for assessing quality of dying and death. A retrospective carer proxy report to evaluate this construct was used in most of the papers. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Many instruments have been developed to assess the quality of dying and death. The Quality of Dying and Death Questionnaire is the best available measure of the quality of dying and death. It is the only questionnaire identified in this review where all psychometric properties according to the COSMIN checklist have been evaluated. © 2018 John Wiley & Sons Ltd.

The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME Guide No. 42.

PubMed

Yepes-Rios, Monica; Dudek, Nancy; Duboyce, Rita; Curtis, Jerri; Allard, Rhonda J; Varpio, Lara

2016-11-01

Many clinical educators feel unprepared and/or unwilling to report unsatisfactory trainee performance. This systematic review consolidates knowledge from medical, nursing, and dental literature on the experiences and perceptions of evaluators or assessors with this failure to fail phenomenon. We searched the English language literature in CINAHL, EMBASE, and MEDLINE from January 2005 to January 2015. Qualitative and quantitative studies were included. Following our review protocol, registered with BEME, reviewers worked in pairs to identify relevant articles. The investigators participated in thematic analysis of the qualitative data reported in these studies. Through several cycles of analysis, discussion and reflection, the team identified the barriers and enablers to failing a trainee. From 5330 articles, we included 28 publications in the review. The barriers identified were (1) assessor's professional considerations, (2) assessor's personal considerations, (3) trainee related considerations, (4) unsatisfactory evaluator development and evaluation tools, (5) institutional culture and (6) consideration of available remediation for the trainee. The enablers identified were: (1) duty to patients, to society, and to the profession, (2) institutional support such as backing a failing evaluation, support from colleagues, evaluator development, and strong assessment systems, and (3) opportunities for students after failing. The inhibiting and enabling factors to failing an underperforming trainee were common across the professions included in this study, across the 10 years of data, and across the educational continuum. We suggest that these results can inform efforts aimed at addressing the failure to fail problem.

Assessment and Evaluation of National Human Resource Development System Competitiveness in Emerging Countries

ERIC Educational Resources Information Center

Oh, HunSeok; Seo, DongIn; Kim, JuSeuk; Yoo, SangOk; Seong, HeeChang

2015-01-01

This study assessed and evaluated the competitiveness of national human resource development (NHRD) systems in emerging countries with potential for growth. The literature on emerging countries and NHRD systems was reviewed. The study developed a model mechanism with forty-one indices and nine sub-components for the NHRD system assessment in…

Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development.

ERIC Educational Resources Information Center

Mosher, Paul H.

1979-01-01

Reviews the history, literature, and methodology of collection evaluation or assessment in American research libraries; discusses current problems, tools, and methodology of evaluation; and describes an ongoing collection evaluation program at the Stanford University Libraries. (Author/MBR)

Peer Review Documents Related to the Evaluation of ...

EPA Pesticide Factsheets

BMDS is one of the Agency's premier tools for estimating risk assessments, therefore the validity and reliability of its statistical models are of paramount importance. This page provides links to peer review and expert summaries of the BMDS application and its models as they were developed and eventually released documenting the rigorous review process taken to provide the best science tools available for statistical modeling. This page provides links to peer reviews and expert summaries of the BMDS applications and its models as they were developed and eventually released.

Effects and effectiveness of dynamic arm supports: a technical review.

PubMed

van der Heide, Loek A; Gelderblom, Gert Jan; de Witte, Luc P

2015-01-01

Numerous dynamic arm supports have been developed in recent decades to increase independence in the performance of activities of daily living. Much effort and money have been spent on their development and prescription, yet insight into their effects and effectiveness is lacking. This article is a systematic review of evaluations of dynamic arm supports. The 8 technical evaluations, 12 usability evaluations, and 27 outcome studies together make 47 evaluations. Technical evaluations were often used as input for new developments and directed at balancing quality, forces and torques, and range of motion of prototypes. Usability studies were mostly single-measure designs that had varying results as to whether devices were usable for potential users. An increased ability to perform activities of daily living and user satisfaction were reported in outcome studies. However, the use of dynamic arm supports in the home situation was reported to be low. Gaining insight into why devices are not used when their developers believe them to be effective seems crucial for every new dynamic arm support developed. The methodological quality of the outcome studies was often low, so it is important that this is improved in the future.

Guidelines for review and evaluation of backcalculation results

DOT National Transportation Integrated Search

2006-02-01

This document presets a new approach to determining layered elastic moduli from in situ load-deflection data, which was developed under the Federal Highway Administration's project for reviewing Long-Term Pavement Performance (LTPP) backcalculation d...

32 CFR 206.4 - Proposal development and review.

Code of Federal Regulations, 2011 CFR

2011-07-01

...) The NSEP will use a two-stage review process in order to evaluate a broad range of proposal ideas. In...-stage process, potential grantees are given an opportunity to present their ideas without creating a...

32 CFR 206.4 - Proposal development and review.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) The NSEP will use a two-stage review process in order to evaluate a broad range of proposal ideas. In...-stage process, potential grantees are given an opportunity to present their ideas without creating a...

Systematic Review of Chloroprene

EPA Science Inventory

This document was developed in support of EPA's response to Request for Correction (RFC) #17002: Integrated Risk Information System; Toxicological Review of Chloroprene. The document describes the IRIS Program's evaluation of the literature published after the 2010 finalization o...

Why Micros?

ERIC Educational Resources Information Center

Myers, Darlene

1983-01-01

Discusses development of the first computers; identifies five generations of computers; reviews projections for sales and proliferation of microcomputers into the marketplace; outlines procedures for selecting microcomputers and evaluating software; and reviews several articles on microcomputers centering on user requirements. (MBR)

Framework and criteria for program evaluation in the Office of Conservation and Renewable Energy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This study addresses the development of a framework and generic criteria for conducting program evaluation in the Office of Conservation and Renewable Energy. The evaluation process is intended to provide the Assistant Secretary with comprehensive and consistent evaluation data for management decisions regarding policy and strategy, crosscutting energy impacts and resource allocation and justification. The study defines evaluation objectives, identifies basic information requirements (criteria), and identifies a process for collecting evaluation results at the basic program level, integrating the results, and summarizing information upward through the CE organization to the Assistant Secretary. Methods are described by which initial criteria weremore » tested, analyzed, and refined for CE program applicability. General guidelines pertaining to evaluation and the Sunset Review requirements are examined and various types, designs, and models for evaluation are identified. Existing CE evaluation reports are reviewed and comments on their adequacy for meeting current needs are provided. An inventory and status survey of CE program evaluation activities is presented, as are issues, findings, and recommendations pertaining to CE evaluation and Sunset Review requirements. Also, sources of data for use in evaluation and the Sunset Review response are identified. An inventory of CE evaluation-related documents and reports is provided.« less

Participant-Directed Evaluation: Using Teachers' Own Inquiries to Evaluate Professional Development in Technology Integration

ERIC Educational Resources Information Center

Ham, Vince

2010-01-01

Considering the high levels of time and money invested in teacher professional development programmes in information technologies over recent decades, questions arise as to how effective these programmes have been and by whose lights we are to judge. Based on a critical review of the evaluations of several of our own action-research-based…

Improving access to psychosocial interventions for common mental health problems in the United Kingdom: narrative review and development of a conceptual model for complex interventions

PubMed Central

2012-01-01

Background In the United Kingdom and worldwide, there is significant policy interest in improving the quality of care for patients with mental health disorders and distress. Improving quality of care means addressing not only the effectiveness of interventions but also the issue of limited access to care. Research to date into improving access to mental health care has not been strongly rooted within a conceptual model, nor has it systematically identified the different elements of the patient journey from identification of illness to receipt of care. This paper set out to review core concepts underlying patient access to mental health care, synthesise these to develop a conceptual model of access, and consider the implications of the model for the development and evaluation of interventions for groups with poor access to mental health care such as older people and ethnic minorities. Methods Narrative review of the literature to identify concepts underlying patient access to mental health care, and synthesis into a conceptual model to support the delivery and evaluation of complex interventions to improve access to mental health care. Results The narrative review adopted a process model of access to care, incorporating interventions at three levels. The levels comprise (a) community engagement (b) addressing the quality of interactions in primary care and (c) the development and delivery of tailored psychosocial interventions. Conclusions The model we propose can form the basis for the development and evaluation of complex interventions in access to mental health care. We highlight the key methodological challenges in evaluating the overall impact of access interventions, and assessing the relative contribution of the different elements of the model. PMID:22889290

Protocol: a systematic review of studies developing and/or evaluating search strategies to identify prognosis studies.

PubMed

Corp, Nadia; Jordan, Joanne L; Hayden, Jill A; Irvin, Emma; Parker, Robin; Smith, Andrea; van der Windt, Danielle A

2017-04-20

Prognosis research is on the rise, its importance recognised because chronic health conditions and diseases are increasingly common and costly. Prognosis systematic reviews are needed to collate and synthesise these research findings, especially to help inform effective clinical decision-making and healthcare policy. A detailed, comprehensive search strategy is central to any systematic review. However, within prognosis research, this is challenging due to poor reporting and inconsistent use of available indexing terms in electronic databases. Whilst many published search filters exist for finding clinical trials, this is not the case for prognosis studies. This systematic review aims to identify and compare existing methodological filters developed and evaluated to identify prognosis studies of any of the three main types: overall prognosis, prognostic factors, and prognostic [risk prediction] models. Primary studies reporting the development and/or evaluation of methodological search filters to retrieve any type of prognosis study will be included in this systematic review. Multiple electronic bibliographic databases will be searched, grey literature will be sought from relevant organisations and websites, experts will be contacted, and citation tracking of key papers and reference list checking of all included papers will be undertaken. Titles will be screened by one person, and abstracts and full articles will be reviewed for inclusion independently by two reviewers. Data extraction and quality assessment will also be undertaken independently by two reviewers with disagreements resolved by discussion or by a third reviewer if necessary. Filters' characteristics and performance metrics reported in the included studies will be extracted and tabulated. To enable comparisons, filters will be grouped according to database, platform, type of prognosis study, and type of filter for which it was intended. This systematic review will identify all existing validated prognosis search filters and synthesise evidence about their applicability and performance. These findings will identify if current filters provide a proficient means of searching electronic bibliographic databases or if further prognosis filters are needed and can feasibly be developed for systematic searches of prognosis studies.

Space station attached payload program support

NASA Technical Reports Server (NTRS)

Estes, Maurice G., Jr.; Brown, Bardle D.

1989-01-01

The USRA is providing management and technical support for the peer review of the Space Station Freedom Attached Payload proposals. USRA is arranging for consultants to evaluate proposals, arranging meeting facilities for the reviewers to meet in Huntsville, Alabama and management of the actual review meetings. Assistance in developing an Experiment Requirements Data Base and Engineering/Technical Assessment support for the MSFC Technical Evaluation Team is also being provided. The results of the project will be coordinated into a consistent set of reviews and reports by USRA. The strengths and weaknesses analysis provided by the peer panel reviewers will by used NASA personnel in the selection of experiments for implementation on the Space Station Freedom.

The development of search filters for adverse effects of surgical interventions in medline and Embase.

PubMed

Golder, Su; Wright, Kath; Loke, Yoon Kong

2018-06-01

Search filter development for adverse effects has tended to focus on retrieving studies of drug interventions. However, a different approach is required for surgical interventions. To develop and validate search filters for medline and Embase for the adverse effects of surgical interventions. Systematic reviews of surgical interventions where the primary focus was to evaluate adverse effect(s) were sought. The included studies within these reviews were divided randomly into a development set, evaluation set and validation set. Using word frequency analysis we constructed a sensitivity maximising search strategy and this was tested in the evaluation and validation set. Three hundred and fifty eight papers were included from 19 surgical intervention reviews. Three hundred and fifty two papers were available on medline and 348 were available on Embase. Generic adverse effects search strategies in medline and Embase could achieve approximately 90% relative recall. Recall could be further improved with the addition of specific adverse effects terms to the search strategies. We have derived and validated a novel search filter that has reasonable performance for identifying adverse effects of surgical interventions in medline and Embase. However, we appreciate the limitations of our methods, and recommend further research on larger sample sizes and prospective systematic reviews. © 2018 The Authors Health Information and Libraries Journal published by John Wiley & Sons Ltd on behalf of Health Libraries Group.

Development, implementation and evaluation of a patient handoff tool to improve safety in orthopaedic surgery.

PubMed

Gagnier, Joel J; Derosier, Joseph M; Maratt, Joseph D; Hake, Mark E; Bagian, James P

2016-06-01

To develop, implement and test the effect of a handoff tool for orthopaedic trauma residents that reduces adverse events associated with the omission of critical information and the transfer of erroneous information. Components of this project included a literature review, resident surveys and observations, checklist development and refinement, implementation and evaluation of impact on adverse events through a chart review of a prospective cohort compared with a historical control group. Large teaching hospital. Findings of a literature review were presented to orthopaedic residents, epidemiologists, orthopaedic surgeons and patient safety experts in face-to-face meetings, during which we developed and refined the contents of a resident handoff tool. The tool was tested in an orthopaedic trauma service and its impact on adverse events was evaluated through a chart review. The handoff tool was developed and refined during the face-to-face meetings and a pilot implementation. Adverse event data were collected on 127 patients (n = 67 baseline period; n = 60 test period). A handoff tool for use by orthopaedic residents. Adverse events in patients handed off by orthopaedic trauma residents. After controlling for age, gender and comorbidities, testing resulted in fewer events per person (25-27% reduction; P < 0.10). Preliminary evidence suggests that our resident handoff tool may contribute to a decrease in adverse events in orthopaedic patients. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

The nature and evaluation of commercial expert system building tools, revision 1

NASA Technical Reports Server (NTRS)

Gevarter, William B.

1987-01-01

This memorandum reviews the factors that constitute an Expert System Building Tool (ESBT) and evaluates current tools in terms of these factors. Evaluation of these tools is based on their structure and their alternative forms of knowledge representation, inference mechanisms and developer end-user interfaces. Next, functional capabilities, such as diagnosis and design, are related to alternative forms of mechanization. The characteristics and capabilities of existing commercial tools are then reviewed in terms of these criteria.

The NIHR Invention for Innovation (i4i) Programme: A Review of Progress and Contributions to Innovation in Healthcare Technologies.

PubMed

Marjanovic, Sonja; Krapels, Joachim; Sousa, Sonia; Castle-Clarke, Sophie; Horvath, Veronika; Chataway, Joanna

2015-11-30

The National Institute for Health Research (NIHR) Invention for Innovation (i4i) programme supports the development of innovative medical technologies for patient benefit. The i4i product development stream involves collaborative projects between at least two partners from academia, the NHS and industry. Medical technology innovators apply for funding for one to three years, through a peer review-based process that includes presentation to a selection panel. The funding and business advice provided by i4i support the development of early-stage innovations, generally at proof of concept and prototype stages. Since its inception the product development stream has identified and supported 170 projects, led by 146 principal investigators (PIs). RAND Europe evaluated the programme, with the aim of identifying its outputs and impacts and examining the factors influencing performance. The evaluation findings should help inform the future of the programme. The evaluation used a multi-method approach, including a focused review of background information from i4i, scoping interviews with key informants, a survey of programme participants and case studies of projects representing diverse technologies and health needs.

Development of a Rating Form to Evaluate Grant Applications to the Hogg Foundation for Mental Health

ERIC Educational Resources Information Center

Whaley, Arthur L.; Rodriguez, Reymundo; Alexander, Laurel A.

2006-01-01

Reliance on subjective grant proposal review methods leads private philanthropies to underfund mental health programs, even when foundations have mental health focuses. This article describes a private mental health foundation's efforts to increase the objectivity of its proposal review process by developing a reliable, valid proposal rating form.…

Semi-Analytical Models of CO2 Injection into Deep Saline Aquifers: Evaluation of the Area of Review and Leakage through Abandoned Wells

EPA Science Inventory

This presentation will provide a conceptual preview of an Area of Review (AoR) tool being developed by EPA’s Office of Research and Development that applies analytic and semi-analytical mathematical solutions to elucidate potential risks associated with geologic sequestration of ...

Faculty Development: Not Just a Bandwagon.

ERIC Educational Resources Information Center

Hipps, Opal S.

1978-01-01

Considers problems in traditional faculty development programs, comments on the relation between faculty development and evaluation, and reviews the instructional development model, the organizational development approach, and the personal development model. Offers suggestions for nursing faculties and administrators in organizing a nursing…

A Critical Appraisal of and Recommendations for Faculty Development

PubMed Central

Guglielmo, B. Joseph; Edwards, David J.; Franks, Andrea S.; Naughton, Cynthia A.; Schonder, Kristine S.; Stamm, Pamela L.; Thornton, Phillip; Popovich, Nicholas G.

2011-01-01

The 2009-2010 American Association of Colleges of Pharmacy (AACP) Council of Faculties Faculty Affairs Committee reviewed published literature assessing the scope and outcomes of faculty development for tenure and promotion. Relevant articles were identified via a PubMed search, review of pharmacy education journals, and identification of position papers from major healthcare professions academic organizations. While programs intended to enhance faculty development were described by some healthcare professions, relatively little specific to pharmacy has been published and none of the healthcare professions have adequately evaluated the impact of various faculty-development programs on associated outcomes. The paucity of published information strongly suggests a lack of outcomes-oriented faculty-development programs in colleges and schools of pharmacy. Substantial steps are required toward the development and scholarly evaluation of faculty-development programs. As these programs are developed and assessed, evaluations must encompass all faculty subgroups, including tenure- and nontenure track faculty members, volunteer faculty members, women, and underrepresented minorities. This paper proposes AACP, college and school, and department-level recommendations intended to ensure faculty success in achieving tenure and promotion. PMID:21931460

HFE Process Guidance and Standards for potential application to updating NRC guidance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jacques Hugo; J. J. Persensky

2012-07-01

The U.S. Nuclear Regulatory Commission (NRC) reviews and evaluates the human factors engineering (HFE) programs of applicants for nuclear power plant construction permits, operating licenses, standard design certifications, and combined operating licenses. The purpose of these safety reviews is to help ensure that personnel performance and reliability are appropriately supported. Detailed design review procedures and guidance for the evaluations is provided in three key documents: the Standard Review Plan (NUREG-0800), the HFE Program Review Model (NUREG-0711), and the Human-System Interface Design Review Guidelines (NUREG-0700). These documents were last revised in 2007, 2004 and 2002, respectively. The NRC is committed tomore » the periodic update and improvement of these guidance documents to ensure that they remain state-of-the-art design evaluation tools. Thus, the NRC has initiated a project with BNL to update the NRC guidance to remain current with recent research on human performance, advances in HFE methods and tools, and new technology. INL supported Brookhaven National Lab (BNL) to update the detailed HFE review criteria contained in NUREG-0711 and NUREG-0700 based on (1) feedback obtained from end users, (2) the results of NRC research and development efforts supporting the NRC staff’s HFE safety reviews, and (3) other material the project staff identify as applicable to the update effort. INL submitted comments on development plans and sections of NUREGs 0800, 0711, and 0700. The contractor prepared the report attached here as the deliverable for this work.« less

Traveler Phase 1A Joint Review

NASA Technical Reports Server (NTRS)

St. John, Clint; Scofield, Jan; Skoog, Mark; Flock, Alex; Williams, Ethan; Guirguis, Luke; Loudon, Kevin; Sutherland, Jeffrey; Lehmann, Richard; Garland, Michael;

Health services research evaluation principles. Broadening a general framework for evaluating health information technology.

PubMed

Sockolow, P S; Crawford, P R; Lehmann, H P

2012-01-01

Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned. Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks. A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR. The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged. We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

78 FR 2379 - Agency Information Collection Activities; Comment Request; Impact Evaluation of Math Professional...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-11

...; Comment Request; Impact Evaluation of Math Professional Development AGENCY: IES/NCES, Department of... of Math Professional Development. OMB Control Number: 1850-NEW. Type of Review: New information... requests clearance to recruit and collect data from districts, schools, and teachers for a study of math...

U.S. EPA OFFICE OF RESEARCH AND DEVELOPMENT GUIDELINES FOR TECHNICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide direction f...

The Teachers' Perspective on Teacher Professional Development Evaluation

ERIC Educational Resources Information Center

Chen, Yu-Fen

2013-01-01

This study constructs indicators and weights that can be used in the professional development evaluation (PDE) of elementary school teachers. The indicators were constructed using data collected from literature reviews, interviews with experts, and questionnaire surveys. The Fuzzy Analytic Hierarchy Process (FAPH) was used to analyze the collected…

Report to the administrator by the NASA Aerospace Safety Advisory Panel on the Skylab program. Volume 1: Summary report. [systems management evaluation and design analysis

NASA Technical Reports Server (NTRS)

1973-01-01

Contractor and NASA technical management for the development and manufacture of the Skylab modules is reviewed with emphasis on the following management controls: configuration and interface management; vendor control; and quality control of workmanship. A review of the modified two-stage Saturn V launch vehicle which focused on modifications to accommodate the Skylab payload; resolution of prior flight anomalies; and changes in personnel and management systems is presented along with an evaluation of the possible age-life and storage problems for the Saturn 1-B launch vehicle. The NASA program management's visibility and control of contractor operations, systems engineering and integration, the review process for the evaluation of design and flight hardware, and the planning process for mission operations are investigated. It is concluded that the technical management system for development and fabrication of the modules, spacecraft, and launch vehicles, the process of design and hardware acceptance reviews, and the risk assessment activities are satisfactory. It is indicated that checkout activity, integrated testing, and preparations for and execution of mission operation require management attention.

General Criteria for Evaluating Social Programs.

ERIC Educational Resources Information Center

Shipman, Stephanie

1989-01-01

A framework of general evaluation criteria for ensuring the comprehensiveness of program reviews and appropriate and fair comparison of children's programs is outlined. It has two components: (1) descriptive; and (2) evaluative. The framework was developed by researchers at the General Accounting Office for evaluation of federal programs. (TJH)

The Human Activity of Evaluation Theorizing.

ERIC Educational Resources Information Center

Alkin, Marvin C.; Ellett, Frederick, Jr.

Theorizing about evaluation should be conceptualized as a human activity governed by certain strategies and principles. The theories advanced by various evaluators have changed over the years, thus illustrating ten principles of evaluation. The starting point for theory development or modification is self-reflection and review of one's own…

Methodological reviews of economic evaluations in health care: what do they target?

PubMed

Hutter, Maria-Florencia; Rodríguez-Ibeas, Roberto; Antonanzas, Fernando

2014-11-01

An increasing number of published studies of economic evaluations of health technologies have been reviewed and summarized with different purposes, among them to facilitate decision-making processes. These reviews have covered different aspects of economic evaluations, using a variety of methodological approaches. The aim of this study is to analyze the methodological characteristics of the reviews of economic evaluations in health care, published during the period 1990-2010, to identify their main features and the potential missing elements. This may help to develop a common procedure for elaborating these kinds of reviews. We performed systematic searches in electronic databases (Scopus, Medline and PubMed) of methodological reviews published in English, period 1990-2010. We selected the articles whose main purpose was to review and assess the methodology applied in the economic evaluation studies. We classified the data according to the study objectives, period of the review, number of reviewed studies, methodological and non-methodological items assessed, medical specialty, type of disease and technology, databases used for the review and their main conclusions. We performed a descriptive statistical analysis and checked how generalizability issues were considered in the reviews. We identified 76 methodological reviews, 42 published in the period 1990-2001 and 34 during 2002-2010. The items assessed most frequently (by 70% of the reviews) were perspective, type of economic study, uncertainty and discounting. The reviews also described the type of intervention and disease, funding sources, country in which the evaluation took place, type of journal and author's characteristics. Regarding the intertemporal comparison, higher frequencies were found in the second period for two key methodological items: the source of effectiveness data and the models used in the studies. However, the generalizability issues that apparently are creating a growing interest in the economic evaluation literature did not receive as much attention in the reviews of the second period. The remaining items showed similar frequencies in both periods. Increasingly more reviews of economic evaluation studies aim to analyze the application of methodological principles, and offer summaries of papers classified by either diseases or health technologies. These reviews are useful for finding literature trends, aims of studies and possible deficiencies in the implementation of methods of specific health interventions. As no significant methodological improvement was clearly detected in the two periods analyzed, it would be convenient to pay more attention to the methodological aspects of the reviews.

Developmental procedures for the clinical practice guidelines for conscious sedation in dentistry for the Korean Academy of Dental Sciences.

PubMed

An, So-Youn; Seo, Kwang-Suk; Kim, Seungoh; Kim, Jongbin; Lee, Deok-Won; Hwang, Kyung-Gyun; Kim, Hyun Jeong

2016-12-01

Evidence-based clinical practice guidelines (CPGs) are defined as "statements that are scientifically reviewed about evidence and systematically developed to assist in the doctors' and patients' decision making in certain clinical situations." This recommendation aims to promote good clinical practice for the provision of safe and effective practices of conscious sedation in dentistry. The development of this clinical practice guideline was conducted by performing a systematic search of the literature for evidence-based CPGs. Existing guidelines, relevant systematic reviews, policy documents, legislation, or other recommendations were reviewed and appraised. To supplement this information, key questions were formulated by the Guideline Development Group and used as the basis for designing systematic literature search strategies to identify literature that may address these questions. Guideline documents were evaluated through a review of domestic and international databases for the development of a renewing of existing conscious sedation guidelines for dentistry. Clinical practice guidelines were critically appraised for their methodologies using Appraisal of guidelines for research and evaluation (AGREE) II. A total of 12 existing CPGs were included and 13 recommendations were made in a range of general, adult, and pediatric areas. The clinical practice guidelines for conscious sedation will be reviewed in 5 years' time for further updates to reflect significant changes in the field.

Development of a conceptual model evaluating the humanistic and economic burden of Crohn's disease: implications for patient-reported outcomes measurement and economic evaluation.

PubMed

Gater, Adam; Kitchen, Helen; Heron, Louise; Pollard, Catherine; Håkan-Bloch, Jonas; Højbjerre, Lise; Hansen, Brian Bekker; Strandberg-Larsen, Martin

2015-01-01

The primary objective of this review is to develop a conceptual model for Crohn's disease (CD) outlining the disease burden for patients, healthcare systems and wider society, as reported in the scientific literature. A search was conducted using MEDLINE, PsycINFO, EconLit, Health Economic Evaluation Database and Centre for Reviews and Dissemination databases. Patient-reported outcome (PRO) measures widely used in CD were reviewed according to the US FDA PRO Guidance for Industry. The resulting conceptual model highlights the characterization of CD by gastrointestinal disturbances, extra-intestinal and systemic symptoms. These symptoms impact physical functioning, ability to complete daily activities, emotional wellbeing, social functioning, sexual functioning and ability to work. Gaps in conceptual coverage and evidence of reliability and validity for some PRO measures were noted. Review findings also highlight the substantial direct and indirect costs associated with CD. Evidence from the literature confirms the substantial burden of CD to patients and wider society; however, future research is still needed to further understand burden from the perspective of patients and to accurately understand the economic burden of disease. Challenges with existing PRO measures also suggest the need for future research to refine or develop new measures.

Evaluation of current trends and recent development in insulin therapy for management of diabetes mellitus.

PubMed

Nawaz, Muhammad Sarfraz; Shah, Kifayat Ullah; Khan, Tahir Mehmood; Rehman, Asim Ur; Rashid, Haroon Ur; Mahmood, Sajid; Khan, Shahzeb; Farrukh, Muhammad Junaid

2017-12-01

Diabetes mellitus is a major health problem in developing countries. There are various insulin therapies to manage diabetes mellitus. This systematic review evaluates various insulin therapies for management of diabetes mellitus worldwide. This review also focuses on recent developments being explored for better management of diabetes mellitus. We reviewed a number of published articles from 2002 to 2016 to find out the appropriate management of diabetes mellitus. The paramount parameters of the selected studies include the insulin type & its dose, type of diabetes, duration and comparison of different insulin protocols. In addition, various newly developed approaches for insulin delivery with potential output have also been evaluated. A great variability was observed in managing diabetes mellitus through insulin therapy and the important controlling factors found for this therapy include; dose titration, duration of insulin use, type of insulin used and combination therapy of different insulin. A range of research articles on current trends and recent advances in insulin has been summarized, which led us to the conclusion that multiple daily insulin injections or continuous subcutaneous insulin infusion (insulin pump) is the best method to manage diabetes mellitus. In future perspectives, development of the oral and inhalant insulin would be a tremendous breakthrough in Insulin therapy. Copyright © 2017 Diabetes India. Published by Elsevier Ltd. All rights reserved.

A review and evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of phase 5. Design and evaluation of STI systems: A selected, annotated bibliography

NASA Technical Reports Server (NTRS)

Pinelli, T. E.; Hinnebusch, P. A.; Jaffe, J. M.

1981-01-01

A selected, annotated bibliography of literature citations related to the design and evaluation of STI systems is presented. The use of manual and machine-readable literature searches; the review of numerous books, periodicals reports, and papers; and the selection and annotation of literature citations were required. The bibliography was produced because the information was needed to develop the methodology for the review and evaluation project, and a survey of the literature did not reveal the existence of a single published source of information pertinent to the subject. Approximately 200 citations are classified in four subject areas. The areas include information - general; information systems - design and evaluation, including information products and services; information - use and need; and information - economics.

Test techniques for evaluating flight displays

NASA Technical Reports Server (NTRS)

Haworth, Loran A.; Newman, Richard L.

1993-01-01

The rapid development of graphics technology allows for greater flexibility in aircraft displays, but display evaluation techniques have not kept pace. Historically, display evaluation has been based on subjective opinion and not on the actual aircraft/pilot performance. Existing electronic display specifications and evaluation techniques are reviewed. A display rating technique analogous to handling qualities ratings was developed and is recommended for future evaluations. The choice of evaluation pilots is also discussed and the use of a limited number of trained evaluators is recommended over the use of a large number of operational pilots.

Assessing public health policy approaches to level-up the gradient in health inequalities: the Gradient Evaluation Framework.

PubMed

Davies, J K; Sherriff, N S

2014-03-01

This paper seeks to introduce and analyse the development of the Gradient Evaluation Framework (GEF) to facilitate evaluation of policy actions for their current or future use in terms of their 'gradient friendliness'. In particular, this means their potential to level-up the gradient in health inequalities by addressing the social determinants of health and thereby reducing decision-makers' chances of error when developing such policy actions. A qualitative developmental study to produce a policy-based evaluation framework. The scientific basis of GEF was developed using a comprehensive consensus-building process. This process followed an initial narrative review, based on realist review principles, which highlighted the need for production of a dedicated evaluation framework. The consensus-building process included expert workshops, a pretesting phase, and external peer review, together with support from the Gradient project Scientific Advisory Group and all Gradient project partners, including its Project Steering Committee. GEF is presented as a flexible policy tool resulting from a consensus-building process involving experts from 13 European countries. The theoretical foundations which underpin GEF are discussed, together with a range of practical challenges. The importance of systematic evaluation at each stage of the policy development and implementation cycle is highlighted, as well as the socio-political context in which policy actions are located. GEF offers potentially a major contribution to the public health field in the form of a practical, policy-relevant and common frame of reference for the evaluation of public health interventions that aim to level-up the social gradient in health inequalities. Further research, including the need for practical field testing of GEF and the exploration of alternative presentational formats, is recommended. Copyright © 2013 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Examining Values, Use, and Role in Evaluation: Prospects for a Broadened View

ERIC Educational Resources Information Center

Boulay, David A.; Han, Heeyoung

2008-01-01

This article reviews evaluation studies published in the HRD (human resource development) field. The authors further discuss general evaluation theories in terms of value, use, and evaluator role. The comparison of this literature suggests that evaluation in HRD has been limited by narrow perspectives. The authors attribute this narrow notion of…

An Introduction to Context and Its Role in Evaluation Practice

ERIC Educational Resources Information Center

Fitzpatrick, Jody L.

2012-01-01

Evaluators have written about the need to consider context in conducting evaluations, but most such admonitions are broad. Context is not developed fully. This chapter reviews the evaluation literature on context and discusses the two areas in which context has been more carefully considered by evaluators: the culture of program participants when…

Social marketing of water and sanitation products: a systematic review of peer-reviewed literature.

PubMed

Evans, W D; Pattanayak, S K; Young, S; Buszin, J; Rai, S; Bihm, Jasmine Wallace

2014-06-01

Like commercial marketing, social marketing uses the 4 "Ps" and seeks exchange of value between the marketer and consumer. Behaviors such as handwashing, and products such as those for oral rehydration treatment (ORT), can be marketed like commercial products in developing countries. Although social marketing in these areas is growing, there has been no systematic review of the current state of practice, research and evaluation. We searched the literature for published peer-reviewed studies available through major online publication databases. We identified manuscripts in the health, social science, and business literature on social marketing that used at least one of the 4 Ps of marketing and had a behavioral objective targeting the behaviors or products related to improving water and sanitation. We developed formalized decision rules and applied them in identifying articles for review. We initially identified 117 articles and reviewed a final set of 32 that met our criteria. Social marketing is a widespread strategy. Marketing efforts have created high levels of awareness of health threats and solutions, including behavior change and socially marketed products. There is widespread use of the 4 Ps of marketing, with price interventions being the least common. Evaluations show consistent improvements in behavioral mediators but mixed results in behavior change. Interventions have successfully used social marketing following widely recommended strategies. Future evaluations need to focus on mediators that explain successful behavior change in order to identify best practices and improve future programs. More rigorous evaluations including quasi-experimental designs and randomized trials are needed. More consistent reporting of evaluation results that permits meta-analysis of effects is needed. Copyright © 2014 Elsevier Ltd. All rights reserved.

NOAA Education: Adventures in Strategic Planning, External Review, and Evaluation

NASA Astrophysics Data System (ADS)

Michalopoulos, C.

2010-12-01

Since late 2007, the National Oceanic and Atmospheric Administration has undertaken the development of a 20-year Education Strategic Plan, has undergone an external review by the National Research Council of the National Academies, and has drafted a guiding document on an agency-wide approach for monitoring and evaluation of its education activities and programs. This presentation will review all these processes with special emphasis on lessons learned and on the implications of each one on NOAA’s ability to improve and better coordinate its educational portfolio.

French Immersion Research Relevant to Decisions in Ontario. Review and Evaluation Bulletins, Number 1.

ERIC Educational Resources Information Center

Parkin, Michael; And Others

Canadian research relevant to French immersion program development in Ontario is reviewed and summarized. The review includes studies on six program or instructional aspects: (1) attitudes and motivation of immersion students and parents; (2) achievement of immersion students in English language arts and other subjects; (3) French proficiency and…

Research in Teaching Reading to Disadvantaged Learners: A Critical Review and Evaluation of Research.

ERIC Educational Resources Information Center

Webster, Staten W.

This review of reading research literature deals with three major areas. First, 10 problems that inhibit the educational development of disadvantaged learners are identified and discussed. Secondly, programs designed to aid these students are reviewed. They include reading programs for preschool, elementary school, and secondary school age groups…

Developing Competency-Based Activities and Evaluation Instruments for the Advertising Service Area of Distribution. Final Report. Leadership Development Series: Advertising Services.

ERIC Educational Resources Information Center

Pittsburgh Univ., PA. Div. of Teacher Development.

To provide materials for a national exchange program and a Pennsylvania activities bank, a project was designed to produce materials for teacher-coordinators of high school distributive education. The project objectives were to (1) review and evaluate competencies necessary for advertising service careers, (2) develop activities and evaluative…

"It's Better than Catching Frogs": Understanding the Importance of Local Context in the Development of Inclusive School Self-Evaluation in Lao PDR

ERIC Educational Resources Information Center

Grimes, Peter; Sayarath, Khomvanh; Outhaithany, Sithath

2012-01-01

This article is an account of a project in Laos which aimed to support schools in evaluating and developing responsiveness to diversity in student populations. Teachers, students and members of the community were involved in review, evaluation and leadership of change to improve learning and participation for all school-aged members of the…

Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK

ERIC Educational Resources Information Center

Rienties, Bart; Boroowa, Avinash; Cross, Simon; Kubiak, Chris; Mayles, Kevin; Murphy, Sam

2016-01-01

There is an urgent need to develop an evidence-based framework for learning analytics whereby stakeholders can manage, evaluate, and make decisions about which types of interventions work well and under which conditions. In this article, we will work towards developing a foundation of an Analytics4Action Evaluation Framework (A4AEF) that is…

Practicality of Evaluating Soft Errors in Commercial sub-90 nm CMOS for Space Applications

NASA Technical Reports Server (NTRS)

Pellish, Jonathan A.; LaBel, Kenneth A.

2010-01-01

The purpose of this presentation is to: Highlight space memory evaluation evolution, Review recent developments regarding low-energy proton direct ionization soft errors, Assess current space memory evaluation challenges, including increase of non-volatile technology choices, and Discuss related testing and evaluation complexities.

Usage-Based Collection Evaluation with a Curricular Focus

ERIC Educational Resources Information Center

Kohn, Karen C.

2013-01-01

Systematic evaluation of a library's collection can be a useful tool for collection development. After reviewing three evaluation methods and their usefulness for our small academic library, I undertook a usage-based evaluation, focusing on narrow segments of our collection that served specific undergraduate courses. For each section, I collected…

Instruments for measuring mental health recovery: a systematic review.

PubMed

Sklar, Marisa; Groessl, Erik J; O'Connell, Maria; Davidson, Larry; Aarons, Gregory A

2013-12-01

Persons in recovery, providers, and policymakers alike are advocating for recovery-oriented mental health care, with the promotion of recovery becoming a prominent feature of mental health policy in the United States and internationally. One step toward creating a recovery-oriented system of care is to use recovery-oriented outcome measures. Numerous instruments have been developed to assess progress towards mental health recovery. This review identifies instruments of mental health recovery and evaluates the appropriateness of their use including their psychometric properties, ease of administration, and service-user involvement in their development. A literature search using the Medline and Psych-INFO databases was conducted, identifying 21 instruments for potential inclusion in this review, of which thirteen met inclusion criteria. Results suggest only three instruments (25%) have had their psychometric properties assessed in three or more unique samples of participants. Ease of administration varied between instruments, and for the majority of instruments, development included service user involvement. This review updates and expands previous reviews of instruments to assess mental health recovery. As mental health care continues to transform to a recovery-oriented model of service delivery, this review may facilitate selection of appropriate assessments of mental health recovery for systems to use in evaluating and improving the care they provide. © 2013.

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Development and pilot test of a process to identify research needs from a systematic review.

PubMed

Saldanha, Ian J; Wilson, Lisa M; Bennett, Wendy L; Nicholson, Wanda K; Robinson, Karen A

2013-05-01

To ensure appropriate allocation of research funds, we need methods for identifying high-priority research needs. We developed and pilot tested a process to identify needs for primary clinical research using a systematic review in gestational diabetes mellitus. We conducted eight steps: abstract research gaps from a systematic review using the Population, Intervention, Comparison, Outcomes, and Settings (PICOS) framework; solicit feedback from the review authors; translate gaps into researchable questions using the PICOS framework; solicit feedback from multidisciplinary stakeholders at our institution; establish consensus among multidisciplinary external stakeholders on the importance of the research questions using the Delphi method; prioritize outcomes; develop conceptual models to highlight research needs; and evaluate the process. We identified 19 research questions. During the Delphi method, external stakeholders established consensus for 16 of these 19 questions (15 with "high" and 1 with "medium" clinical benefit/importance). We pilot tested an eight-step process to identify clinically important research needs. Before wider application of this process, it should be tested using systematic reviews of other diseases. Further evaluation should include assessment of the usefulness of the research needs generated using this process for primary researchers and funders. Copyright © 2013 Elsevier Inc. All rights reserved.

Updates on ultrasound research in implant dentistry: a systematic review of potential clinical indications.

PubMed

Bhaskar, Vaishnavi; Chan, Hsun-Liang; MacEachern, Mark; Kripfgans, Oliver D

2018-05-23

Ultrasonography has shown promising diagnostic value in dental implant imaging research; however, exactly how ultrasound was used and at what stage of implant therapy it can be applied has not been systematically evaluated. Therefore, the aim of this review is to investigate potential indications of ultrasound use in the three implant treatment phases, namely planning, intraoperative and postoperative phase. Eligible manuscripts were searched in major databases with a combination of key words related to the use of ultrasound imaging in implant therapy. An initial search yielded 414 articles, after further review, 28 articles were finally included for this systematic review. Ultrasound was found valuable, though at various development stages, for evaluating (1) soft tissues, (2) hard tissues (3) vital structures and (4) implant stability. B-mode, the main function to image anatomical structures of interest, has been evaluated in pre-clinical and clinical studies. Quantitative ultrasound parameters, e.g. sound speed and amplitude, are being developed to evaluate implant-bone stability, mainly in simulation and pre-clinical studies. Ultrasound could be potentially useful in all 3 treatment phases. In the planning phase, ultrasound could evaluate vital structures, tissue biotype, ridge width/density, and cortical bone thickness. During surgery, it can provide feedback by identifying vital structures and bone boundary. At follow-up visits, it could evaluate marginal bone level and implant stability. Understanding the current status of ultrasound imaging research for implant therapy would be extremely beneficial for accelerating translational research and its use in dental clinics.

Ozone (O3) Standards - Integrated Science Assessments from Current Review

EPA Pesticide Factsheets

The integrated science assessment (ISA) is a comprehensive review, synthesis, and evaluation of the most policy-relevant science, including key science judgments that are important to inform the development of the risk and exposure assessments, and more.

Developing an Instrument for Self-Evaluation of Teaching and Learning Competencies: A Review of Faculty Professional Development and the Changing Higher Education Landscape in Singapore

ERIC Educational Resources Information Center

Cheong, Grace

2017-01-01

This paper forms part of a doctoral study focused on the development and validation of an instrument for the self-evaluation of teaching and learning competencies for the purpose of faculty professional development. The rapid expansion of the higher education sector in Singapore has called for new approaches to university teaching that are…

Using archived data to measure operational benefits of ITS investments, volume 1 : ramp meters.

DOT National Transportation Integrated Search

2004-06-01

develop two case study evaluations for Oregon, including an evaluation of the COMET incident management program and the : Portland ramp metering system. The COMET evaluation will include a thorough literature review of other incident management : pro...

78 FR 53152 - Submission for OMB Review; Comment Request: Palliative Care: Conversations Matter Evaluation

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-28

...; Comment Request: Palliative Care: Conversations Matter Evaluation SUMMARY: Under the provisions of Section... must be requested in writing. Proposed Collection: Palliative Care: Conversations Matter Evaluation... Use of Information Collection: NINR developed Palliative Care: Conversations Matter, a pediatric...

Evaluation of a PhD Program: Paving the Way.

ERIC Educational Resources Information Center

Germain, Carol P.; And Others

1994-01-01

During the evolution of an evaluation process for the University of Pennsylvania's doctoral program in nursing, a task force developed criteria and sources for program evaluation and surveyed students, alumni, and faculty to write a self-study report for external reviewers. (JOW)

Development and Evaluation of ‘Briefing Notes’ as a Novel Knowledge Translation Tool to Aid the Implementation of Sex/Gender Analysis in Systematic Reviews: A Pilot Study

PubMed Central

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E.; Shea, Beverley; O’Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

Background There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly ‘briefing note’ format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Methods Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Results Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group’s focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Conclusions Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations. PMID:25372876

Anorexia nervosa and cancer: a protocol for a systematic review and meta-analysis of observational studies.

PubMed

Catalá-López, Ferrán; Hutton, Brian; Driver, Jane A; Ridao, Manuel; Valderas, José M; Gènova-Maleras, Ricard; Forés-Martos, Jaume; Alonso-Arroyo, Adolfo; Saint-Gerons, Diego Macías; Vieta, Eduard; Valencia, Alfonso; Tabarés-Seisdedos, Rafael

2017-07-11

Anorexia nervosa is characterized by a severe restriction of caloric intake, low body weight, fear of gaining weight or of becoming fat, and disturbance of body image. Pathogenesis of the disorder may include genetic predisposition, hormonal changes and a combination of environmental, psychosocial, and cultural factors. Cancer is the second leading cause of death worldwide. At present, no systematic reviews and meta-analyses have evaluated the risk of cancer in people with anorexia nervosa. The objective of this study will be to evaluate the association between anorexia nervosa and the risk of developing or dying from cancer. This study protocol is part of a systematic collection and assessment of multiple systematic reviews and meta-analyses (umbrella review) evaluating the association of cancer and multiple central nervous system disorders. We designed a specific protocol for a new systematic review and meta-analysis of observational studies of anorexia nervosa with risk of developing or dying from any cancer. Data sources will be PubMed, Embase, Scopus, Web of Science, and manual screening of references. Observational studies (case-control and cohort) in humans that examined the association between anorexia nervosa and risk of developing or dying from cancer will be sought. The primary outcomes will be cancer incidence and cancer mortality in association with anorexia nervosa. Secondary outcomes will be site-specific cancer incidence and mortality, respectively. Screening of abstracts and full texts, and data abstraction will be performed by two team members independently. Conflicts at all levels of screening and abstraction will be resolved through discussion. The quality of studies will be assessed by using the Ottawa-Newcastle scale by two team members independently. Random effects models will be conducted where appropriate. Subgroup and additional analyses will be conducted to explore the potential sources of heterogeneity. The World Cancer Research Fund (WCRF)/American Institute for Cancer Research (AICR) criteria and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach will be used for determining the quality of evidence for cancer outcomes. Findings from this systematic review will inform an ongoing umbrella review on cancer and central nervous system disorders. Our systematic review and meta-analysis of observational studies will establish the extent of the epidemiological evidence underlying the association between anorexia nervosa and cancer. PROSPERO CRD42017067462.

Occupational Analysis for Human Resource Development: A Review of Utility of the Task Inventory. Research Report No. 25.

ERIC Educational Resources Information Center

Moore, Brian E.

A review of the issues concerning the field of occupational analysis was undertaken in order to indicate the comparative strengths and weaknesses of the task inventory (TI). Specifically, the significance of the TI was assessed for reliability and validity, job analysis and evaluation, occupational restructuring and career ladder development, and…

75 FR 19980 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-04-16

... Institute of Child Health and Human Development Special Emphasis Panel; Gene Therapy for Urea Cycle Disorders. Date: April 30, 2010. Time: 1:30 p.m. to 3 p.m. Agenda: To review and evaluate grant applications... prior to the meeting due to the timing limitations imposed by the review and funding cycle. (Catalogue...

Using a Template to Facilitate External Peer Preview of Curriculum: A Variation on the PRoT Theme

ERIC Educational Resources Information Center

Sealey, Rebecca

2013-01-01

Peer reviewing of teaching and curriculum in Higher Education is a common practice aimed at both quality assurance and professional development. External review of curriculum prior to implementation appears less common. The aim of this project was to develop, implement and evaluate a user-friendly process for external peer preview of teaching…

Evaluating employee assistance programs. A review of methods, outcomes, and future directions.

PubMed

Jerrell, J M; Rightmyer, J F

1982-01-01

Renewed interest in assisting troubled employees has led to an upsurge in the development of employee assistance programs, coupled with demands for demonstrable effectiveness. This review examines the nature and scope of these programs, their administrative and methodological context, and the types and outcomes of evaluation studies conducted thus far. Proposals for improving future investigations through a number of different approaches and strategies are then made.

78 FR 29375 - Eunice Kennedy Shriver National Institute of Child Health & Human Development; Notice of Closed...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-20

... sections 552b(c)(4) and 552b(c)(6), Title 5 U.S.C., as amended. The grant applications and the discussions... Cardiovascular Health. Date: May 23, 2013. Time: 1:00 p.m. to 4:00 p.m. Agenda: To review and evaluate grant....m. to 4:30 p.m. Agenda: To review and evaluate grant applications. Place: Embassy Suites at the...

A Review on VSC-HVDC Reliability Modeling and Evaluation Techniques

NASA Astrophysics Data System (ADS)

Shen, L.; Tang, Q.; Li, T.; Wang, Y.; Song, F.

2017-05-01

With the fast development of power electronics, voltage-source converter (VSC) HVDC technology presents cost-effective ways for bulk power transmission. An increasing number of VSC-HVDC projects has been installed worldwide. Their reliability affects the profitability of the system and therefore has a major impact on the potential investors. In this paper, an overview of the recent advances in the area of reliability evaluation for VSC-HVDC systems is provided. Taken into account the latest multi-level converter topology, the VSC-HVDC system is categorized into several sub-systems and the reliability data for the key components is discussed based on sources with academic and industrial backgrounds. The development of reliability evaluation methodologies is reviewed and the issues surrounding the different computation approaches are briefly analysed. A general VSC-HVDC reliability evaluation procedure is illustrated in this paper.

Biomarkers of exposure, sensitivity and disease

NASA Technical Reports Server (NTRS)

Brooks, A. L.

1999-01-01

PURPOSE: This review is to evaluate the use of biomarkers as an indication of past exposure to radiation or other environmental insults, individual sensitivity and risk for the development of late occurring disease. OVERVIEW: Biomarkers can be subdivided depending on their applications. Markers of exposure and dose can be used to reconstruct and predict past accidental or occupational exposures when limited or no physical measurements were available. Markers of risk or susceptibility can help identify sensitivity individuals that are at increased risk for development of spontaneous disease and may help predict the increased risk in sensitive individuals associated with environmental or therapeutic radiation exposures. Markers of disease represent the initial cellular or molecular changes that occur during disease development. Each of these types of biomarkers serves a unique purpose. OUTLINE: This paper concentrates on biomarkers of dose and exposure and provides a brief review of biomarkers of sensitivity and disease. The review of biomarkers of dose and exposure will demonstrate the usefulness of biomarkers in evaluation of physical factors associated with radiation exposure, such as LET, doserate and dose distribution. It will also evaluate the use of biomarkers to establish relationships that exist between exposure parameters such as energy deposition, environmental concentration of radioactive materials, alpha traversals and dose. In addition, the importance of biological factors on the magnitude of the biomarker response will be reviewed. Some of the factors evaluated will be the influence of species, tissue, cell types and genetic background. The review will demonstrate that markers of sensitivity and disease often have little usefulness in dose-reconstruction and, by the same token, many markers of dose or exposure may not be applicable for prediction of sensitivity or risk.

24 CFR 597.401 - Periodic performance reviews.

Code of Federal Regulations, 2011 CFR

2011-04-01

... Development (Continued) OFFICE OF ASSISTANT SECRETARY FOR COMMUNITY PLANNING AND DEVELOPMENT, DEPARTMENT OF... regularly evaluate the progress of the strategic plan in each designated Empowerment Zone and Enterprise...

Patient- and Caregiver-Reported Assessment Tools for Palliative Care: Summary of the 2017 Agency for Healthcare Research and Quality Technical Brief.

PubMed

Aslakson, Rebecca A; Dy, Sydney M; Wilson, Renee F; Waldfogel, Julie; Zhang, Allen; Isenberg, Sarina R; Blair, Alex; Sixon, Joshua; Lorenz, Karl A; Robinson, Karen A

2017-12-01

Assessment tools are data collection instruments that are completed by or with patients or caregivers and which collect data at the individual patient or caregiver level. The objectives of this study are to 1) summarize palliative care assessment tools completed by or with patients or caregivers and 2) identify needs for future tool development and evaluation. We completed 1) a systematic review of systematic reviews; 2) a supplemental search of previous reviews and Web sites, and/or 3) a targeted search for primary articles when no tools existed in a domain. Paired investigators screened search results, assessed risk of bias, and abstracted data. We organized tools by domains from the National Consensus Project Clinical Practice Guidelines for Palliative Care and selected the most relevant, recent, and highest quality systematic review for each domain. We included 10 systematic reviews and identified 152 tools (97 from systematic reviews and 55 from supplemental sources). Key gaps included no systematic review for pain and few tools assessing structural, cultural, spiritual, or ethical/legal domains, or patient-reported experience with end-of-life care. Psychometric information was available for many tools, but few studies evaluated responsiveness (sensitivity to change) and no studies compared tools. Few to no tools address the spiritual, ethical, or cultural domains or patient-reported experience with end-of-life care. While some data exist on psychometric properties of tools, the responsiveness of different tools to change and/or comparisons between tools have not been evaluated. Future research should focus on developing or testing tools that address domains for which few tools exist, evaluating responsiveness, and comparing tools. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Communication skills assessment in the final postgraduate years to established practice: a systematic review.

PubMed

Gillis, Amy E; Morris, Marie C; Ridgway, Paul F

2015-01-01

Communication breakdown is a factor in the majority of all instances of medical error. Despite the importance, a relative paucity of time is invested in communication skills in postgraduate curricula. Our objective is to systematically review the literature to identify the current tools used to assess communication skills in postgraduate trainees in the latter 2 years of training and in established practice. Two reviewers independently reviewed the literature identifying communication skill assessment tools, for postgraduate trainees in the latter 2 years of training and in established practice following Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, and inclusion/exclusion criteria from January 1990 to 15 August 2014. PubMed/CINAHL/ERIC/EMBASE/PsycInfo/Psyc Articles/Cochrane. 222 articles were identified; after review, 34 articles fulfilled criteria for complete evaluation; the majority (26) had a high level of evidence scoring 3 or greater on the Best Evidence Medical Education guide. 22 articles used objective structured clinical examination/standardised patient (SP)-based formats in an assessment or training capacity. Evaluation tools included author-developed questionnaires and validated tools. Nineteen articles demonstrated an educational initiative. The reviewed literature is heterogeneous for objectives and measurement techniques for communication. Observed interactions, with patients or SPs, is the current favoured method of evaluation using author-developed questionnaires. The role of self-evaluation of skill level is questioned. The need for a validated assessment tool for communication skills is highlighted. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Evidence used in model-based economic evaluations for evaluating pharmacogenetic and pharmacogenomic tests: a systematic review protocol

PubMed Central

Peters, Jaime L; Cooper, Chris; Buchanan, James

2015-01-01

Introduction Decision models can be used to conduct economic evaluations of new pharmacogenetic and pharmacogenomic tests to ensure they offer value for money to healthcare systems. These models require a great deal of evidence, yet research suggests the evidence used is diverse and of uncertain quality. By conducting a systematic review, we aim to investigate the test-related evidence used to inform decision models developed for the economic evaluation of genetic tests. Methods and analysis We will search electronic databases including MEDLINE, EMBASE and NHS EEDs to identify model-based economic evaluations of pharmacogenetic and pharmacogenomic tests. The search will not be limited by language or date. Title and abstract screening will be conducted independently by 2 reviewers, with screening of full texts and data extraction conducted by 1 reviewer, and checked by another. Characteristics of the decision problem, the decision model and the test evidence used to inform the model will be extracted. Specifically, we will identify the reported evidence sources for the test-related evidence used, describe the study design and how the evidence was identified. A checklist developed specifically for decision analytic models will be used to critically appraise the models described in these studies. Variations in the test evidence used in the decision models will be explored across the included studies, and we will identify gaps in the evidence in terms of both quantity and quality. Dissemination The findings of this work will be disseminated via a peer-reviewed journal publication and at national and international conferences. PMID:26560056

Global Health Security Agenda: Joint External Evaluation and Legislation-A 1-Year Review.

PubMed

Forzley, Michele

In 2014, the IHR Review Committee recommended moving from exclusive self-evaluation to a combination of domestic and independent experts and began the process in conjunction with stakeholders to develop the Joint External Evaluation tool. The tool was launched in February 2016, and at the 2016 WHA, the IHR Review Committee recommended that all states parties should undertake assessments of their core capacities using the JEE tool and results of other evaluation processes such as the OIE PVS. A goal was set to conduct 50 country JEE assessments prior to WHA 2017. It is notable that legislation was added as a separate element of the JEE tool coupled with 2 indicators. Given the importance of law to the development discourse today, more needs to be done with the JEE with regards to legislation for the benefits of the law to be realized in global health security and overall in health outcomes. As we are at the 1-year anniversary of the tool, and WHO has begun a review of the JEE tool and requests for feedback are circulating, this article focuses on the JEE element of legislation and proposes some simple and substantive fixes. Considering the importance of law in the context of the GHSA, the results of the JEE tool are reviewed, and, drawing on the author's experience with the tool and other IHR and GHSA legal assessments, a case is made for a significant revision of the tool section on legislation and the manner in which the subject of legislation is integrated during the evaluation process.

77 FR 28359 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-14

... Policy Development; Evaluation of the 21st Century Community Learning Centers State Competitions SUMMARY: This study will examine state subgrant competitions conducted under the 21st Century Community Learning Centers (CCLC) program in order to glean ``lessons learned'' that can inform efforts to improve the state...

Submission Patterns: "Measurement and Evaluation in Counseling and Development" Author and Article Characteristics from 1990 to 2009

ERIC Educational Resources Information Center

Erford, Bradley T.; Miller, Emily M.; Duncan, Kelly; Erford, Breann M.

2010-01-01

Submission patterns of articles accepted for publication in "Measurement and Evaluation in Counseling and Development" from 1990 to 2009 are reviewed. Trends are analyzed in article content (i.e., type, issue, statistical procedures) and author demographic characteristics (e.g., sex, nation of domicile, professional title, departmental…

Development of the implant surgical technique and assessment rating system

PubMed Central

Park, Jung-Chul; Hwang, Ji-Wan; Lee, Jung-Seok; Jung, Ui-Won; Choi, Seong-Ho; Cho, Kyoo-Sung; Chai, Jung-Kiu

2012-01-01

Purpose There has been no attempt to establish an objective implant surgical evaluation protocol to assess residents' surgical competence and improve their surgical outcomes. The present study presents a newly developed assessment and rating system and simulation model that can assist the teaching staffs to evaluate the surgical events and surgical skills of residents objectively. Methods Articles published in peer-reviewed English journals were selected using several scientific databases and subsequently reviewed regarding surgical competence and assessment tools. Particularly, medical journals reporting rating and evaluation protocols for various types of medical surgeries were thoroughly analyzed. Based on these studies, an implant surgical technique assessment and rating system (iSTAR) has been developed. Also, a specialized dental typodont was developed for the valid and reliable assessment of surgery. Results The iSTAR consists of two parts including surgical information and task-specific checklists. Specialized simulation model was subsequently produced and can be used in combination with iSTAR. Conclusions The assessment and rating system provided may serve as a reference guide for teaching staffs to evaluate the residents' implant surgical techniques. PMID:22413071

Researching evaluation influence: a review of the literature.

PubMed

Herbert, James Leslie

2014-10-01

The impact of an evaluation is an important consideration in designing and carrying out evaluations. Evaluation influence is a way of thinking about the effect that an evaluation can have in the broadest possible terms, which its proponents argue will lead to a systematic body of evidence about influential evaluation practices. This literature review sets out to address three research questions: How have researchers defined evaluation influence; how is this reflected in the research; and what does the research suggest about the utility of evaluation influence as a conceptual framework. Drawing on studies that had cited one of the key evaluation influence articles and conducted original research on some aspect of influence this article reviewed the current state of the literature toward the goal of developing a body of evidence about how to practice influential evaluation. Twenty-eight studies were found that have drawn on evaluation influence, which were categorized into (a) descriptive studies, (b) analytical studies, and (c) hypothesis testing. Despite the prominence of evaluation influence in the literature, there is slow progress toward a persuasive body of literature. Many of the studies reviewed offered vague and inconsistent definitions and have applied influence in an unspecified way in the research. It is hoped that this article will stimulate interest in the systematic study of influence mechanisms, leading to improvements in the potential for evaluation to affect positive social change. © The Author(s) 2014.

An overview of systematic review.

PubMed

Baker, Kathy A; Weeks, Susan Mace

2014-12-01

Systematic review is an invaluable tool for the practicing clinician. A well-designed systematic review represents the latest and most complete information available on a particular topic or intervention. This article highlights the key elements of systematic review, what it is and is not, and provides an overview of several reputable organizations supporting the methodological development and conduct of systematic review. Important aspects for evaluating the quality of a systematic review are also included. Copyright © 2014 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Menstrual migraine: a review of current and developing pharmacotherapies for women.

PubMed

Allais, G; Chiarle, Giulia; Sinigaglia, Silvia; Benedetto, Chiara

2018-02-01

Migraine is one of the most common neurological disorders in the general population. It affects 18% of women and 6% of men. In more than 50% of women migraineurs the occurrence of migraine attacks correlates strongly with the perimenstrual period. Menstrual migraine is highly debilitating, less responsive to therapy, and attacks are longer than those not correlated with menses. Menstrual migraine requires accurate evaluation and targeted therapy, that we aim to recommend in this review. Areas covered: This review of the literature provides an overview of currently available pharmacological therapies (especially with triptans, anti-inflammatory drugs, hormonal strategies) and drugs in development (in particular those acting on calcitonin gene-related peptide) for the treatment of acute migraine attacks and the prophylaxis of menstrual migraine. The studies reviewed here were retrieved from the Medline database as of June 2017. Expert opinion: The treatment of menstrual migraine is highly complex. Accurate evaluation of its characteristics is prerequisite to selecting appropriate therapy. An integrated approach involving neurologists and gynecologists is essential for patient management and for continuous updating on new therapies under development.

[Quality Assurance in Sociomedical Evaluation by Peer Review: A Pilot Project of the German Statutory Pension Insurance].

PubMed

Strahl, A; Gerlich, C; Wolf, H-D; Gehrke, J; Müller-Garnn, A; Vogel, H

2016-03-01

The sociomedical evaluation by the German Pension Insurance serves the purpose of determining entitlement to disability pensions. A quality assurance concept for the sociomedical evaluation was developed, which is based on a peer Review process. Peer review is an established process of external quality assurance in health care. The review is based on a hierarchically constructed manual that was evaluated in this pilot project. The database consists of 260 medical reports for disability pension of 12 pension insurance agencies. 771 reviews from 19 peers were included in the evaluation of the inter-rater reliability. Kendall's coefficient of concordance W for more than 2 raters is used as primary measure of inter-rater reliability. Reliability appeared to be heterogeneous. Kendalls W varies for the particular criteria from 0.09 to 0.88 and reached for primary criterion reproducibility a value of 0.37. The reliability of the manual seemed acceptable in the context of existing research data and is in line with existing peer review research outcomes. Nevertheless, the concordance is limited and requires optimisation. Starting points for improvement can be seen in a systematic training and regular user meetings of the peers involved. © Georg Thieme Verlag KG Stuttgart · New York.

Assessing Technical Competence in Surgical Trainees: A Systematic Review.

PubMed

Szasz, Peter; Louridas, Marisa; Harris, Kenneth A; Aggarwal, Rajesh; Grantcharov, Teodor P

2015-06-01

To systematically examine the literature describing the methods by which technical competence is assessed in surgical trainees. The last decade has witnessed an evolution away from time-based surgical education. In response, governing bodies worldwide have implemented competency-based education paradigms. The definition of competence, however, remains elusive, and the impact of these education initiatives in terms of assessment methods remains unclear. A systematic review examining the methods by which technical competence is assessed was conducted by searching MEDLINE, EMBASE, PsychINFO, and the Cochrane database of systematic reviews. Abstracts of retrieved studies were reviewed and those meeting inclusion criteria were selected for full review. Data were retrieved in a systematic manner, the validity and reliability of the assessment methods was evaluated, and quality was assessed using the Grading of Recommendations Assessment, Development and Evaluation classification. Of the 6814 studies identified, 85 studies involving 2369 surgical residents were included in this review. The methods used to assess technical competence were categorized into 5 groups; Likert scales (37), benchmarks (31), binary outcomes (11), novel tools (4), and surrogate outcomes (2). Their validity and reliability were mostly previously established. The overall Grading of Recommendations Assessment, Development and Evaluation for randomized controlled trials was high and low for the observational studies. The definition of technical competence continues to be debated within the medical literature. The methods used to evaluate technical competence predominantly include instruments that were originally created to assess technical skill. Very few studies identify standard setting approaches that differentiate competent versus noncompetent performers; subsequently, this has been identified as an area with great research potential.

Interventions to support people with dementia and their caregivers during the transition from home care to nursing home care: A systematic review.

PubMed

Müller, Christian; Lautenschläger, Sindy; Meyer, Gabriele; Stephan, Astrid

2017-06-01

During the transition of people with dementia from home to nursing home family caregivers often feel burdened. We aimed to 1) identify interventions which support people with dementia and their caregivers in the transition from home care to nursing home care, 2) synthesize the evidence for efficacy of these interventions, and 3) examine whether the identified interventions have been systematically developed, evaluated and implemented according to the Medical Research Council guidance on complex interventions. A systematic review of randomised controlled trials was conducted according to the recommendations specified in the Cochrane Handbook for Intervention Reviews. The review protocol was registered in PROSPERO (2015: CRD42015019839). Reporting follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. MEDLINE, CENTRAL, PsycINFO, CINAHL, OTseeker, and PEDro, were searched. Other sources included Google Scholar, and ALOIS. Two reviewers independently assessed the eligibility of the articles. Data extraction was performed by one reviewer and verified independently by another. The Cochrane Risk of Bias tool was used for critical appraisal. Development and evaluation of the identified interventions were assessed, taking the Medical Research Council guidance into account. Review findings were synthesized narratively. The search yielded 1278 records. Five studies were included, all conducted in the United States (4 RCTs and 1 cRCT with a total of 695 participants). The psychosocial interventions were individual and family counseling via telephone or ad hoc all of which addressed only informal caregivers. The intervention components, content and mode of delivery differed widely with inconsistent results. Significant intervention effects were found for the reduction of caregivers' depressive symptoms, burden, feeling of guilt, emotional distress, overload, and interactions with staff. Other outcomes, i.e. stress, placement adaptation, role overload, and role captivity, were not statistically significantly affected. The assessment for bias risk across studies varied from moderate to low. Only two studies tested the feasibility of the intervention before full scale evaluation, none evaluated the implementation process according to the Medical Research Council framework. We identified only a few studies with heterogeneous outcomes; evidence regarding the effectiveness of psychosocial interventions is thus insufficient. Further research is needed focusing on the development and evaluation of complex psychosocial interventions and more well-designed RCTs with larger sample sizes based on a rigorous methodology. Reporting on feasibility and implementation processes of interventions should be guaranteed, since it is crucial to evaluate transferability across care settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

The evaluation of research papers in the XXI century. The Open Peer Discussion system of the World Economics Association.

PubMed

Ietto-Gillies, Grazia

2012-01-01

The paper starts with a brief discussion of the traditional peer review (TPR) system of research evaluation, its role, and the criticisms levelled at it. An analysis of specific problems in economics leads to a full discussion of the Open Peer Review (OPR) system developed by the World Economics Association (WEA) and the principles behind it. The system is open in the following two respects: (a) disclosure of names of authors and reviewers; and (b) inclusivity of potential reviewers in terms of paradigmatic approaches, country, and community. The paper then discusses the applicability of the same system to other disciplines. In doing so, it stressed the aims of various evaluation systems and the possible pitfalls of rating systems. It also speculates on the future of journal publication.

Comparison of the validity of direct pediatric developmental evaluation versus developmental screening by parent report

USDA-ARS?s Scientific Manuscript database

To compare the validity of direct pediatric developmental evaluation with developmental screening by parent report, parents completed a developmental screen (the Child Development Review), a pediatrician performed a direct developmental evaluation (Capute Scales), and a psychologist administered the...

Ozone (O3) Standards - Integrated Science Assessments from Review Completed in 2015

EPA Pesticide Factsheets

The integrated science assessment (ISA) is a comprehensive review, synthesis, and evaluation of the most policy-relevant science, including key science judgments that are important to inform the development of the risk and exposure assessments, and more.

Economics methods in Cochrane systematic reviews of health promotion and public health related interventions

PubMed Central

Shemilt, Ian; Mugford, Miranda; Drummond, Michael; Eisenstein, Eric; Mallender, Jacqueline; McDaid, David; Vale, Luke; Walker, Damian

2006-01-01

Background Provision of evidence on costs alongside evidence on the effects of interventions can enhance the relevance of systematic reviews to decision-making. However, patterns of use of economics methods alongside systematic review remain unclear. Reviews of evidence on the effects of interventions are published by both the Cochrane and Campbell Collaborations. Although it is not a requirement that Cochrane or Campbell Reviews should consider economic aspects of interventions, many do. This study aims to explore and describe approaches to incorporating economics methods in a selection of Cochrane systematic reviews in the area of health promotion and public health, to help inform development of methodological guidance on economics for reviewers. Methods The Cochrane Database of Systematic Reviews was searched using a search strategy for potential economic evaluation studies. We included current Cochrane reviews and review protocols retrieved using the search that are also identified as relevant to health promotion or public health topics. A reviewer extracted data which describe the economics components of included reviews. Extracted data were summarised in tables and analysed qualitatively. Results Twenty-one completed Cochrane reviews and seven review protocols met inclusion criteria. None incorporate formal economic evaluation methods. Ten completed reviews explicitly aim to incorporate economics studies and data. There is a lack of transparent reporting of methods underpinning the incorporation of economics studies and data. Some reviews are likely to exclude useful economics studies and data due to a failure to incorporate search strategies tailored to the retrieval of such data or use of key specialist databases, and application of inclusion criteria designed for effectiveness studies. Conclusion There is a need for consistency and transparency in the reporting and conduct of the economics components of Cochrane reviews, as well as regular dialogue between Cochrane reviewers and economists to develop increased capacity for economic analyses alongside such reviews. Use of applicable economics methods in Cochrane reviews can help provide the international context within which economics data can be interpreted and assessed as a preliminary to full economic evaluation. PMID:17107612

Review of the Human Resources, Finance, and Information Technology Operations of the Seattle Public Schools

ERIC Educational Resources Information Center

Council of the Great City Schools, 2008

2008-01-01

In late 2007, the Council of the Great City Schools conducted a high-level management review of the school district's human resources, financial, and technology operations to: (1) Review and evaluate the leadership, management, organization, and operations of the respective departments; and (2) Develop recommendations and proposals that would…

Measuring quality of care: considering conceptual approaches to quality indicator development and evaluation.

PubMed

Stelfox, Henry T; Straus, Sharon E

2013-12-01

In this article, we describe one approach for developing and evaluating quality indicators. We focus on describing different conceptual approaches to quality indicator development, review one approach for developing quality indicators, outline how to evaluate quality indicators once developed, and discuss quality indicator maintenance. The key steps for developing quality indicators include specifying a clear goal for the indicators; using methodologies to incorporate evidence, expertise, and patient perspectives; and considering contextual factors and logistics of implementation. The Strategic Framework Board and the National Quality Measure Clearinghouse have developed criteria for evaluating quality indicators that complement traditional psychometric evaluations. Optimal strategies for quality indicator maintenance and dissemination have not been determined, but experiences with clinical guideline maintenance may be informative. For quality indicators to effectively guide quality improvement efforts, they must be developed, evaluated, maintained, and implemented using rigorous evidence-informed practices. Copyright © 2013 Elsevier Inc. All rights reserved.

[Principles for the evaluation of telemedicine applications: Results of a systematic review and consensus process].

PubMed

Arnold, Katrin; Scheibe, Madlen; Müller, Olaf; Schmitt, Jochen

2016-11-01

The limited number of telemedicine applications being transferred to standard medical care in Germany may to some extent be explained by deficits in the current evaluation practice. Effectiveness and cost effectiveness can only be demonstrated to decision makers and potential users with methodologically sound and fully published evaluations. There is a lack of well-founded and mandatory standards for adequate, comparable evaluations of telemedicine applications. As part of the project CCS Telehealth Eastern Saxony (CCS THOS), a systematic review on evaluation concepts for telemedicine applications (search period until September 2014, databases Medline, Embase, HTA-Database, DARE, NHS EED) as well as an additional selective literature search were conducted. Suggestions for evaluation fundamentals were derived from the results. These suggestions were subjected to a formal consensus process (nominal group process) with relevant stakeholder groups (healthcare payers, healthcare providers, health policy representatives, researchers). 19 papers were included in the systematic review. In accordance with the predefined inclusion criteria, each presented an evaluation concept for telemedicine applications that was based upon a systematic review and/or a consensus process. Via a formal consensus process, the suggestions for evaluation principles derived from the review and the selective literature search (23 papers) resulted in ten agreed evaluation principles. Eight of them were unanimously agreed upon, two were arrived at with one abstention each. The principles enclose criteria for the planning, conduct and reporting of telemedicine evaluations. Adherence to them is obligatory for users of the telemedical infrastructure provided by CCS THOS. Furthermore, right from the beginning the intention was very much for these principles to be seized upon by other projects and initiatives. The agreed evaluation principles for telemedicine applications are the first in Germany to be based both upon evidence and consensus. Due to the methodology of development, they have a strong scientific and health policy legitimation. Therefore, and because of their general applicability, adherence to these principles beyond the context of the telemedicine platform developed within CCS THOS is recommended, namely throughout the German telemedicine scene. Copyright © 2016. Published by Elsevier GmbH.

Computer simulation models of pre-diabetes populations: a systematic review protocol

PubMed Central

Khurshid, Waqar; Pagano, Eva; Feenstra, Talitha

2017-01-01

Introduction Diabetes is a major public health problem and prediabetes (intermediate hyperglycaemia) is associated with a high risk of developing diabetes. With evidence supporting the use of preventive interventions for prediabetes populations and the discovery of novel biomarkers stratifying the risk of progression, there is a need to evaluate their cost-effectiveness across jurisdictions. In diabetes and prediabetes, it is relevant to inform cost-effectiveness analysis using decision models due to their ability to forecast long-term health outcomes and costs beyond the time frame of clinical trials. To support good implementation and reimbursement decisions of interventions in these populations, models should be clinically credible, based on best available evidence, reproducible and validated against clinical data. Our aim is to identify recent studies on computer simulation models and model-based economic evaluations of populations of individuals with prediabetes, qualify them and discuss the knowledge gaps, challenges and opportunities that need to be addressed for future evaluations. Methods and analysis A systematic review will be conducted in MEDLINE, Embase, EconLit and National Health Service Economic Evaluation Database. We will extract peer-reviewed studies published between 2000 and 2016 that describe computer simulation models of the natural history of individuals with prediabetes and/or decision models to evaluate the impact of interventions, risk stratification and/or screening on these populations. Two reviewers will independently assess each study for inclusion. Data will be extracted using a predefined pro forma developed using best practice. Study quality will be assessed using a modelling checklist. A narrative synthesis of all studies will be presented, focussing on model structure, quality of models and input data, and validation status. Ethics and dissemination This systematic review is exempt from ethics approval because the work is carried out on published documents. The findings of the review will be disseminated in a related peer-reviewed journal and presented at conferences. Reviewregistration number CRD42016047228. PMID:28982807

Usability and acceptability of balance exergames in older adults: A scoping review.

PubMed

Nawaz, Ather; Skjæret, Nina; Helbostad, Jorunn Lægdheim; Vereijken, Beatrix; Boulton, Elisabeth; Svanaes, Dag

2016-12-01

Serious games (exergames) have the potential to be effective for postural balance and increasing muscle strength. Several games have been developed to increase physical fitness and balance among older adults. However, it is unclear to which degree usability and acceptability of exergames for older adults have been evaluated. The aim of this study was to summarize usability evaluation and acceptability of studies in older adults. We conducted a scoping review on studies focusing on usability of exergames for older adults. The result shows that older adults consider usability and acceptability of exercise video games good. The review shows that longitudinal studies mainly use off-the-shelf exergame and evaluated game effectiveness and acceptability, whereas cross-sectional studies focus on interactional experience. Studies varied in their approaches to measure usability and acceptability of exergames for older adults. There is a need for a systematic developmental approach to involve older adults in development of exergames for longitudinal studies. © The Author(s) 2015.

Developing android-based science instructional media to improve scientific literacy of junior high school students

NASA Astrophysics Data System (ADS)

Farida, I. I.; Jumadi; Wilujeng; Senam

2018-04-01

The aims of this study are: to develop android-based science instructional media and to reveal the characteristic, the quality, and the effectiveness of android-based science instructional media with global warming topic to increase junior high school students’ scientific literacy. This study is a development research. The instructional media were reviewed by a media expert, a material expert, science teachers, peer reviewers, and students. The data was collected using media evaluation questionnaires. The results of the study showed that: (1) the android-based science instructional media has characteristics including interesting visualization, easy to use, flexible, and practical, (2) the android-based science instructional media was appropriate for teaching, in terms of material evaluation aspects, media evaluation aspects, and based on student test results, and (3) the android-based science instructional media can effectively used for teaching.

Towards developing standard operating procedures for pre-clinical testing in the mdx mouse model of Duchenne muscular dystrophy

PubMed Central

Grounds, Miranda D.; Radley, Hannah G.; Lynch, Gordon S.; Nagaraju, Kanneboyina; De Luca, Annamaria

2008-01-01

This review discusses various issues to consider when developing standard operating procedures for pre-clinical studies in the mdx mouse model of Duchenne muscular dystrophy (DMD). The review describes and evaluates a wide range of techniques used to measure parameters of muscle pathology in mdx mice and identifies some basic techniques that might comprise standardised approaches for evaluation. While the central aim is to provide a basis for the development of standardised procedures to evaluate efficacy of a drug or a therapeutic strategy, a further aim is to gain insight into pathophysiological mechanisms in order to identify other therapeutic targets. The desired outcome is to enable easier and more rigorous comparison of pre-clinical data from different laboratories around the world, in order to accelerate identification of the best pre-clinical therapies in the mdx mouse that will fast-track translation into effective clinical treatments for DMD. PMID:18499465

Trends in utilization of FDA expedited drug development and approval programs, 1987-2014: cohort study.

PubMed

Kesselheim, Aaron S; Wang, Bo; Franklin, Jessica M; Darrow, Jonathan J

2015-09-23

To evaluate the use of special expedited development and review pathways at the US Food and Drug Administration over the past two decades. Cohort study. FDA approved novel therapeutics between 1987 and 2014. Publicly available sources provided each drug's year of approval, their innovativeness (first in class versus not first in class), World Health Organization Anatomic Therapeutic Classification, and which (if any) of the FDA's four primary expedited development and review programs or designations were associated with each drug: orphan drug, fast track, accelerated approval, and priority review. Logistic regression models evaluated trends in the proportion of drugs associated with each of the four expedited development and review programs. To evaluate the number of programs associated with each approved drug over time, Poisson models were employed, with the number of programs as the dependent variable and a linear term for year of approval. The difference in trends was compared between drugs that were first in class and those that were not. The FDA approved 774 drugs during the study period, with one third representing first in class agents. Priority review (43%) was the most prevalent of the four programs, with accelerated approval (9%) the least common. There was a significant increase of 2.6% per year in the number of expedited review and approval programs granted to each newly approved agent (incidence rate ratio 1.026, 95% confidence interval 1.017 to 1.035, P<0.001), and a 2.4% increase in the proportion of drugs associated with at least one such program (odds ratio 1.024, 95% confidence interval 1.006 to 1.043, P=0.009). Driving this trend was an increase in the proportion of approved, non-first in class drugs associated with at least one program for drugs (P=0.03 for interaction). In the past two decades, drugs newly approved by the FDA have been associated with an increasing number of expedited development or review programs. Though expedited programs should be strictly limited to drugs providing noticeable clinical advances, this trend is being driven by drugs that are not first in class and thus potentially less innovative. © Kesselheim et al 2015.

Automatically extracting the significant aspects evaluated in game reviews

NASA Astrophysics Data System (ADS)

Fong, Chiok Hoong; Ng, Yen Kaow

2017-04-01

Understanding the criteria (or "aspects") that reviewers use to evaluate games is important to game developers and publishers, since this will give them important input on how to improve their products. Techniques for the extraction of such aspects have been studied by others, albeit not specific to the gaming industry. In this paper we demonstrate an aspect extraction and analysis system specific to computer games. The system extracts game review texts from a list of known websites and automatically extracts candidate aspects from the review text using techniques from natural language processing and sentiment analysis. It then ranks the candidate aspects using the HITS algorithm. To evaluate the correctness of the extracted aspects, we used the system to calculate an overall score for each game by aggregating its highly-rated aspects, weighted by the importance of the respective aspects. The aggregated scores resulted in a ranking of games, which we compared to a known ranking from a popular website - the rankings showed overall consistency, which suggests that the system has extracted valuable aspects from the reviews. Using the extracted aspect, our system also facilitates the analysis of a game, by evaluating how review articles have rated its performance in these extracted aspects.

A Practitioner Friendly and Scientifically Robust Training Evaluation Approach

ERIC Educational Resources Information Center

Griffin, Richard

2012-01-01

Purpose: This article seeks to review the current state of workplace learning evaluation, to set out the rationale for evaluation along with the barriers that practitioners face when seeking to assess the effectiveness of training and development. Finally, it aims to propose a scientifically robust and practitioner friendly approach to evaluation.…

75 FR 69086 - Submission for OMB review; comment request; NCCAM Office of Communications and Public Liaison...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-10

...) formative and (2) evaluative research of a variety of print and online materials, outreach activities, and... evaluative research on existing materials and messages, as part of OCPL's ongoing effort to develop a comprehensive program of testing and evaluation of all of its communications strategies. This evaluative...

75 FR 61763 - Submission for OMB Review; Comment Request; NCCAM Office of Communications and Public Liaison...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-06

...) formative and (2) evaluative research of a variety of print and online materials, outreach activities, and... evaluative research on existing materials and messages, as part of OCPL's ongoing effort to develop a comprehensive program of testing and evaluation of all of its communications strategies. This evaluative...

[Study review of biological, social and environmental factors associated with aggressive behavior].

PubMed

Mendes, Deise Daniela; Mari, Jair de Jesus; Singer, Marina; Barros, Gustavo Machado; Mello, Andréa F

2009-10-01

To study the risk factors related to the development of aggressive behavior. A search was carried out in two electronic databases, Medline and SciElo by retrospective studies, longitudinal and review that assessed risk factors for the development of aggressive behavior. There were selected 11 longitudinal studies (8 prospective and 3 case-control studies) and a cross sectional study that evaluated the risk factors and socio-biological related to aggressive behavior. Five studies have evaluated gene expression, five evaluated exposure to tobacco, alcohol and cocaine in the prenatal period, one evaluated the effect of early malnutrition on the development of aggressive behavior and one assessed the impact of child maltreatment. The main biological factors were: genetic (low expression of the monoamine oxidase gene and serotonin transporter gene, variations in transporter and dopamine receptor genes), exposure to substances during intrauterine development (tobacco, alcohol and cocaine) and nutrition (malnutrition). The main environmental factors were: child abuse, poverty, crime and antisocial behavior in childhood, while the highest level of evidence was related to early neglect. The interaction between biological and environmental factors can be catalyzed by a hostile environment, increasing the risk for the development of aggressive behavior.

Prioritizing guideline topics: development and evaluation of a practical tool.

PubMed

Ketola, Eeva; Toropainen, Erja; Kaila, Minna; Luoto, Riitta; Mäkelä, Marjukka

2007-08-01

A clear process for selecting and adopting clinical practice guidelines in the new topic areas is needed. The aim of this study is to design and develop a practical tool to assess guideline topics that have been suggested to the organization responsible for producing guidelines. We carried out an iterative development, feasibility and validation study of a guideline topic prioritization tool. The setting included the guideline producer organization and the tax-funded health care system. In the first stage of the tool development, participants were researchers, members of the Current Care Board and experts from health care organizations. In the second stage, the evaluation was done internally within the project by three independent reviewers. The main outcome measures were responses to an evaluation questionnaire, qualitative process feedback and analysis of the performance of the instrument on a random set of guidelines. Evaluations by three independent reviewers revealed good agreement and face validity with respect to its feasibility as a planning tool at the guideline board level. Feedback from board members suggested that the instrument is useful in prioritizing guideline topics. This instrument was accepted for use by the Board. Further developments are needed to ensure feedback and acceptability of the instrument by those proposing topics.

A Research Elective Course on Dietary Supplements to Engage Doctor of Pharmacy Students in Primary Literature Evaluation and Scholarly Activity.

PubMed

Islam, Mohammed A; Gunaseelan, Simi; Khan, Seher A

2015-12-01

To develop and implement a research elective course to enhance skills of pharmacy students on primary literature evaluation and evidence-based practice on dietary supplements and generate scholarly publications. A 2 credit hour independent research elective course was designed and implemented in the third-year doctor of pharmacy curriculum. The course involved student-led research activities that included formulating research project, reviewing of primary literature, collection and evaluation of data, and writing of review articles for publication in peer-reviewed journals. An online survey was administered to evaluate students' perceptions of the course. Students successfully completed the course. The course resulted in peer-reviewed publications through student-faculty collaboration. Pharmacy students enrolled in the elective course perceived that the course helped them enhance their analytical reasoning, critical thinking and drug-literature evaluation skills, gain evidence-based knowledge, and apply the knowledge into practice during their advanced pharmacy practice experiences community pharmacy rotations. The course provided opportunity to the pharmacy students to not only critically search and evaluate the literature but also publish in peer-reviewed journals. Other pharmacy schools/colleges can adopt this course model to create opportunities for student-faculty collaborations toward scholarly accomplishments. © The Author(s) 2014.

Assessing the economic impact of Rx-to-OTC switches: systematic review and guidelines for future development.

PubMed

Cohen, J; Millier, A; Karray, S; Toumi, M

2013-01-01

Switching drugs from prescription to non-prescription status (Rx-to-OTC) presents a unique set of challenges and opportunities to policy-makers and the industry in terms of managing health outcomes, pharmaceutical spending, and steering of consumer choices of therapy. Decision-analytic models are used to address uncertainty and produce reasonable estimates of the economic impact of switches for payers. This article presents a critical literature review of existing models which assess the economic impact of Rx-to-OTC switches, and provides guidelines in which future economic evaluations of Rx-to-OTC switches could be improved. A comprehensive search strategy was implemented in Medline and Embase, to retrieve published economic evaluations on Rx-to-OTC switches from 1995-2010. The research digest of the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) was reviewed for potentially relevant abstracts for the past 3 years. Each model used was critically evaluated in terms of structure, relevance of inputs, methodology used, and robustness of results. Worldwide, the economic impact of Rx-to-OTC switches has only been evaluated in a total of 12 peer-reviewed publications. Ten out of 12 studies were US-based, and two European-based. The models covered various disease categories, including allergy, hypercholesterolemia, gastroenterology, contraception, pulmonology, and virology. Seventy-five per cent of the models predicted cost savings for payers and patients. Limitations of the models mainly included use of strong assumptions and non-inclusion of specific populations due to lack of data. Guidelines were developed to help future model development. They cover structural issues on decision context, health states, and clinical outcomes, and other considerations for model specifications. Although reviewed studies lacked quality, this review of economic evidence of Rx-to-OTC switches suggests that switches may produce cost savings to public and private payers. This is especially important in light of the trend towards more switches.

Changing Habits of Practice

PubMed Central

Bowen, Judith L; Salerno, Stephen M; Chamberlain, John K; Eckstrom, Elizabeth; Chen, Helen L; Brandenburg, Suzanne

2005-01-01

Purpose The majority of health care, both for acute and chronic conditions, is delivered in the ambulatory setting. Despite repeated proposals for change, the majority of internal medicine residency training still occurs in the inpatient setting. Substantial changes in ambulatory education are needed to correct the current imbalance. To assist educators and policy makers in this process, this paper reviews the literature on ambulatory education and makes recommendations for change. Methods The authors searched the Medline, Psychlit, and ERIC databases from 2000 to 2004 for studies that focused specifically on curriculum, teaching, and evaluation of internal medicine residents in the ambulatory setting to update previous reviews. Studies had to contain primary data and were reviewed for methodological rigor and relevance. Results Fifty-five studies met criteria for review. Thirty-five of the studies focused on specific curricular areas and 11 on ambulatory teaching methods. Five involved evaluating performance and 4 focused on structural issues. No study evaluated the overall effectiveness of ambulatory training or investigated the effects of current resident continuity clinic microsystems on education. Conclusion This updated review continues to identify key deficiencies in ambulatory training curriculum and faculty skills. The authors make several recommendations: (1) Make training in the ambulatory setting a priority. (2) Address systems problems in practice environments. (3) Create learning experiences appropriate to the resident's level of development. (4) Teach and evaluate in the examination room. (5) Expand subspecialty-based training to the ambulatory setting. (6) Make faculty development a priority. (7) Create and fund multiinstitutional educational research consortia. PMID:16423112

AgRISTARS. Preliminary technical results review of FY81 experiments, volume 2: Fiscal year 1981/1982 "corn and soybeans pilot" experiment

NASA Technical Reports Server (NTRS)

1981-01-01

The performance of the technology exhibited significant proportion estimation errors, specifically, high mean error in both corn and soybeans area estimation. The data systems, technical approaches, and data assessment of the pilot experiment were reviewed. Results of proportion estimations procedure performance evaluations, and sensitivity evaluations are presented. The role of the pilot experiment in foreign technology development is discussed.

77 FR 57563 - Notice of Submission for OMB Review; Office of Planning, Evaluation and Policy Development...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-18

... review of recent research on the identification of ELs with special needs, and (2) case studies of six school districts and three schools in each district. Findings will be descriptive in nature. The study is...

CRITICAL REVIEW OF EPIDEMIOLOGIC STUDIES RELATED TO INGESTED ASBESTOS

EPA Science Inventory

Thirteen epidemiologic studies of ingested asbestos conducted in five areas of the U.S. and Canada were reviewed and evaluated for the definitiveness and applicability regarding the development of ambient water quality standards. One or more studies found male or female associati...

76 FR 4925 - Center for Scientific Review; Notice of Closed Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-27

... Development Study Section. Date: February 7-8, 2011. Time: 8 a.m. to 5 p.m. Agenda: To review and evaluate... Assistance Program Nos. 93.306, Comparative Medicine; 93.333, Clinical Research, 93.306, 93.333, 93.337, 93...

Guidelines for the Formulation of Collection Development Policies

ERIC Educational Resources Information Center

Library Resources and Technical, 1977

1977-01-01

Guidelines are presented for library collection development activities which include: budgeting and allocation, the formulation of collection development policies, the development of review programs to assist in the solution of space problems, and the description and evaluation of library collections. (Author/AP)

Relation of completeness of reporting of health research to journals’ endorsement of reporting guidelines: systematic review

PubMed Central

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F

2014-01-01

Objective To assess whether the completeness of reporting of health research is related to journals’ endorsement of reporting guidelines. Design Systematic review. Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed “evaluations”) (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals’ websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors’ analysis, a mean summed score. Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. Conclusions The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals’ endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals’ endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews. PMID:24965222

Interventions for domestic violence among pregnant women in low- and middle-income countries: a systematic review protocol.

PubMed

Sapkota, Diksha; Baird, Kathleen; Saito, Amornrat; Anderson, Debra

2017-12-12

Violence during pregnancy is a global problem, associated with serious health risks for both the mother and baby. Evaluation of interventions targeted for reducing or controlling domestic violence (DV) is still in its infancy, and the majority of findings are primarily from high-income countries (HICs). Therefore, there is an urgent need for generating evidence of DV interventions among pregnant women in low- and middle-income countries (LMICs). Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines will be employed to structure the review. A comprehensive search will be carried out via electronic databases including MEDLINE, CINAHL, Scopus, Embase, Web of Science, PsycINFO, and The Cochrane library. Gray literature will also be scrutinized for potential articles. An optimal search strategy has been developed following consultations with subject-matter experts and librarians. This search strategy will be adapted to the different databases. Experimental studies evaluating DV interventions among pregnant women from LMICs will be included in the review. The review will only include literature written in English. Two reviewers will independently screen and assess studies for inclusion in the review. A third author will resolve any discrepancies between the reviewers. Risk of bias will be assessed based on the Cochrane risk of bias assessment tool, and overall quality of the evidence will be judged using Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) criteria. Findings will be presented with the narrative synthesis, and if applicable, they will be further quantified using random-effects meta-analysis. Effect size, risk ratio for dichotomous variables, and standardized mean differences for continuous variables will be calculated for each outcome using Review Manager 5.3. Systematic reviews to evaluate the efficacy of interventions to address DV within the perinatal context have been limited. Hence, no one intervention has emerged as substantially effective towards addressing perinatal DV and associated health consequences. The evidence generated from this systematic review will inform researchers and policy makers about the effectiveness of existing DV interventions among pregnant women in LMICs and provide recommendations for future research in this area. This in turn will contribute towards violence prevention in LMICs. PROSPERO CRD42017073938.

A systematic review of recent clinical practice guidelines and best practice statements for the evaluation of the infertile male.

PubMed

Esteves, Sandro C; Chan, Peter

2015-09-01

We systematically identified and reviewed the methods and consistency of recommendations of recently developed clinical practice guidelines (CPG) and best practice statements (BPS) on the evaluation of the infertile male. MEDLINE and related engines as well as guidelines' Web sites were searched for CPG and BPS written in English on the general evaluation of male infertility published between January 2008 and April 2015. Four guidelines were identified, all of which reported to have been recently updated. Systematic review was not consistently used in the BPS despite being reported in the CPG. Only one of them reported having a patient representative in its development team. The CPG issued by the European Association of Urology (EAU) graded some recommendations and related that to levels (but not quality) of evidence. Overall, the BPS issued respectively by the American Urological Association and American Society for Reproductive Medicine concurred with each other, but both differed from the EAU guidelines with regard to methods of collection, extraction and interpretation of data. None of the guidelines incorporated health economics. Important specific limitations of conventional semen analysis results were ignored by all guidelines. Besides variation in the methodological quality, implementation strategies were not reported in two out of four guidelines. While the various panels of experts who contributed to the development of the CPG and BPS reviewed should be commended on their tremendous efforts aiming to establish a clinical standard in both the evaluation and management of male infertility, we recognized inconsistencies in the methodology of their synthesis and in the contents of their final recommendations. These discrepancies pose a barrier in the general implementation of these guidelines and may limit their utility in standardizing clinical practice or improving health-related outcomes. Continuous efforts are needed to generate high-quality evidence to allow further development of these important guidelines for the evaluation and management of males suffering from infertility.

Music Interventions and Child Development: A Critical Review and Further Directions

PubMed Central

Dumont, Elisabeth; Syurina, Elena V.; Feron, Frans J. M.; van Hooren, Susan

2017-01-01

Research on the impact of music interventions has indicated positive effects on a variety of skills. These findings suggest musical interventions may have further potential to support educational processes and development of children. This paper reviews the latest evidence on the effect of musical interventions on the development of primary school-aged children. Four electronic databases were searched from January 2010 through June 2016 using music, music instruction, music education, music lesson, music training, development, child, student, and pupil as key words for the search. Two reviewers independently evaluated the studies to determine whether they met the stated inclusion criteria. Studies were compared on study setup, methodological quality, intervention components, outcome variables, and efficacy. A review of these selected studies (n = 46) suggestive beneficial effects of music intervention on development of children, although clear conclusions cannot be drawn. Possible influencing factors that might contribute to the outcome of intervention are reviewed and recommendations for further research are made. PMID:29033877

Review of operations in the Virginia Department of Transportation's project development process.

DOT National Transportation Integrated Search

2007-01-01

The Virginia Department of Transportation's (VDOT's) project development process (PDP) directs how construction projects are developed. The purpose of this study was to evaluate the manner in which operations is currently considered throughout the PD...

Gender counts: A systematic review of evaluations of gender-integrated health interventions in low- and middle-income countries.

PubMed

Schriver, Brittany; Mandal, Mahua; Muralidharan, Arundati; Nwosu, Anthony; Dayal, Radhika; Das, Madhumita; Fehringer, Jessica

2017-11-01

As a result of new global priorities, there is a growing need for high-quality evaluations of gender-integrated health programmes. This systematic review examined 99 peer-reviewed articles on evaluations of gender-integrated (accommodating and transformative) health programmes with regard to their theory of change (ToC), study design, gender integration in data collection, analysis, and gender measures used. Half of the evaluations explicitly described a ToC or conceptual framework (n = 50) that guided strategies for their interventions. Over half (61%) of the evaluations used quantitative methods exclusively; 11% used qualitative methods exclusively; and 28% used mixed methods. Qualitative methods were not commonly detailed. Evaluations of transformative interventions were less likely than those of accommodating interventions to employ randomised control trials. Two-thirds of the reviewed evaluations reported including at least one specific gender-related outcome (n = 18 accommodating, n = 44 transformative). To strengthen evaluations of gender-integrated programmes, we recommend use of ToCs, explicitly including gender in the ToC, use of gender-sensitive measures, mixed-method designs, in-depth descriptions of qualitative methods, and attention to gender-related factors in data collection logistics. We also recommend further research to develop valid and reliable gender measures that are globally relevant.

Development and Evaluation of a Positive Youth Development Course for University Students in Hong Kong

PubMed Central

Shek, Daniel T. L.; Sun, Rachel C. F.; Chui, Y. H.; Lit, S. W.; Yuen, Walter W.; Chung, Yida Y. H.; Ngai, S. W.

2012-01-01

With higher education, university graduates are important elements of the labor force in knowledge-based economies. With reference to the mental health and developmental problems in university students, there is a need to review university's role in nurturing holistic development of students. Based on the positive youth development approach, it is argued that promoting intrapersonal competencies is an important strategy to facilitate holistic development of young people in Hong Kong. In The Hong Kong Polytechnic University, a course entitled Tomorrow's Leader focusing on positive youth development constructs to promote student well-being will be offered on a compulsory basis starting from 2012/13 academic year under the new undergraduate curriculum structure. The proposed course was piloted in 2010/11 school year. Different evaluation strategies, including objective outcome evaluation, subjective outcome evaluation, process evaluation, and qualitative evaluation, are being carried out to evaluate the developed course. Preliminary evaluation findings based on the piloting experience in 2010/11 academic year are presented in this paper. PMID:22619630

Research Capacity Strengthening in Low and Middle Income Countries - An Evaluation of the WHO/TDR Career Development Fellowship Programme.

PubMed

Käser, Michael; Maure, Christine; Halpaap, Beatrice M M; Vahedi, Mahnaz; Yamaka, Sara; Launois, Pascal; Casamitjana, Núria

2016-05-01

Between August 2012 and April 2013 the Career Development Fellowship programme of the Special Programme for Research and Training in Tropical Diseases (World Health Organization) underwent an external evaluation to assess its past performance and determine recommendations for future programme development and continuous performance improvement. The programme provides a year-long training experience for qualified researchers from low and middle income countries at pharmaceutical companies or product development partnerships. Independent evaluators from the Swiss Tropical and Public Health Institute and the Barcelona Institute for Global Health used a results-based methodology to review the programme. Data were gathered through document review, surveys, and interviews with a range of programme participants. The final evaluation report found the Career Development Fellowship to be relevant to organizers' and programme objectives, efficient in its operations, and effective in its training scheme, which was found to address needs and gaps for both fellows and their home institutions. Evaluators found that the programme has the potential for impact and sustainability beyond the programme period, especially with the successful reintegration of fellows into their home institutions, through which newly-developed skills can be shared at the institutional level. Recommendations included the development of a scheme to support the re-integration of fellows into their home institutions post-fellowship and to seek partnerships to facilitate the scaling-up of the programme. The impact of the Professional Membership Scheme, an online professional development tool launched through the programme, beyond the scope of the Career Development Fellowship programme itself to other applications, has been identified as a positive unintended outcome. The results of this evaluation may be of interest for other efforts in the field of research capacity strengthening in LMICs or, generally, to other professional development schemes of a similar structure.

Developing and refining the methods for a 'one-stop shop' for research evidence about health systems.

PubMed

Lavis, John N; Wilson, Michael G; Moat, Kaelan A; Hammill, Amanda C; Boyko, Jennifer A; Grimshaw, Jeremy M; Flottorp, Signe

2015-02-25

Policymakers, stakeholders and researchers have not been able to find research evidence about health systems using an easily understood taxonomy of topics, know when they have conducted a comprehensive search of the many types of research evidence relevant to them, or rapidly identify decision-relevant information in their search results. To address these gaps, we developed an approach to building a 'one-stop shop' for research evidence about health systems. We developed a taxonomy of health system topics and iteratively refined it by drawing on existing categorization schemes and by using it to categorize progressively larger bundles of research evidence. We identified systematic reviews, systematic review protocols, and review-derived products through searches of Medline, hand searches of several databases indexing systematic reviews, hand searches of journals, and continuous scanning of listservs and websites. We developed an approach to providing 'added value' to existing content (e.g., coding systematic reviews according to the countries in which included studies were conducted) and to expanding the types of evidence eligible for inclusion (e.g., economic evaluations and health system descriptions). Lastly, we developed an approach to continuously updating the online one-stop shop in seven supported languages. The taxonomy is organized by governance, financial, and delivery arrangements and by implementation strategies. The 'one-stop shop', called Health Systems Evidence, contains a comprehensive inventory of evidence briefs, overviews of systematic reviews, systematic reviews, systematic review protocols, registered systematic review titles, economic evaluations and costing studies, health reform descriptions and health system descriptions, and many types of added-value coding. It is continuously updated and new content is regularly translated into Arabic, Chinese, English, French, Portuguese, Russian, and Spanish. Policymakers and stakeholders can now easily access and use a wide variety of types of research evidence about health systems to inform decision-making and advocacy. Researchers and research funding agencies can use Health Systems Evidence to identify gaps in the current stock of research evidence and domains that could benefit from primary research, systematic reviews, and review overviews.

Utilization of functional near infrared spectroscopy for non-invasive evaluation

NASA Astrophysics Data System (ADS)

Halim, A. A. A.; Laili, M. H.; Aziz, N. A.; Laili, A. R.; Salikin, M. S.; Rusop, M.

2016-07-01

The goal of this brief review is to report the techniques of functional near infrared spectroscopy for non-invasive evaluation in human study. The development of functional near infrared spectroscopy (fNIRS) technologies has advanced quantification signal using multiple wavelength and detector to solve the propagation of light inside the tissues including the absorption, scattering coefficient and to define the light penetration into tissues multilayers. There are a lot of studies that demonstrate signal from fNIRS which can be used to evaluate the changes of oxygenation level and measure the limitation of muscle performance in human brain and muscle tissues. Comprehensive reviews of diffuse reflectance based on beer lambert law theory were presented in this paper. The principle and development of fNIRS instrumentation is reported in detail.

Sports Injury Surveillance Systems: A Review of Methods and Data Quality.

PubMed

Ekegren, Christina L; Gabbe, Belinda J; Finch, Caroline F

2016-01-01

Data from sports injury surveillance systems are a prerequisite to the development and evaluation of injury prevention strategies. This review aimed to identify ongoing sports injury surveillance systems and determine whether there are gaps in our understanding of injuries in certain sport settings. A secondary aim was to determine which of the included surveillance systems have evaluated the quality of their data, a key factor in determining their usefulness. A systematic search was carried out to identify (1) publications presenting methodological details of sports injury surveillance systems within clubs and organisations; and (2) publications describing quality evaluations and the quality of data from these systems. Data extracted included methodological details of the surveillance systems, methods used to evaluate data quality, and results of these evaluations. Following literature search and review, a total of 15 sports injury surveillance systems were identified. Data relevant to each aim were summarised descriptively. Most systems were found to exist within professional and elite sports. Publications concerning data quality were identified for seven (47%) systems. Validation of system data through comparison with alternate sources has been undertaken for only four systems (27%). This review identified a shortage of ongoing injury surveillance data from amateur and community sport settings and limited information about the quality of data in professional and elite settings. More surveillance systems are needed across a range of sport settings, as are standards for data quality reporting. These efforts will enable better monitoring of sports injury trends and the development of sports safety strategies.

Community interventions providing care and support to orphans and vulnerable children: a review of evaluation evidence.

PubMed

Schenk, Katie D

2009-07-01

Children affected by HIV in their families and communities face multiple risks to their health, education and psychosocial wellbeing. Community interventions for children who have been orphaned or rendered vulnerable take many forms, including educational assistance, home-based care, legal protection and psychosocial support. Despite a recent influx of funding for programme implementation, there exists little evidence to inform policymakers about whether their investments are improving the lives of vulnerable children and meeting key benchmarks including the Millennium Development Goals. This paper reviews the current evidence base on evaluations of community interventions for orphans and vulnerable children (OVC) in high HIV-prevalence African settings, focusing on studies' methodologies. Sources reviewed include published research studies and evidence from the unpublished programmatic "grey literature" located through database and internet searches. A total of 21 studies, varying in scope and generalisability, were identified. Interventions reviewed address children's wellbeing through various strategies within their communities. Evaluation methodologies reflect quantitative and qualitative approaches, including surveys (with and without baseline or comparison data), costing studies, focus groups, interviews, case studies, and participatory review techniques. Varied study methodologies reflect diverse research questions, various intervention types, and the challenges associated with evaluating complex interventions; highlighting the need to broaden the research paradigm in order to build the evidence base by including quasi-experimental and process evaluation approaches, and seeking further insights through participatory qualitative methodologies and costing studies. Although findings overall indicate the value of community interventions in effecting measurable improvements in child and family wellbeing, the quality and rigour of evidence is varied. A strategic research agenda is urgently needed to inform resource allocation and programme management decisions. Immediate imperatives include building local technical capacity to conduct quantitative and qualitative evaluation research, and strengthening monitoring and evaluation systems to collect process and outcome data (including costing) on key support models. Donors and implementers must support the collection of sound empirical evidence to inform the development and scale-up of OVC programmes.

Peer-supported review of teaching: an evaluation.

PubMed

Thampy, Harish; Bourke, Michael; Naran, Prasheena

2015-09-01

Peer-supported review (also called peer observation) of teaching is a commonly implemented method of ascertaining teaching quality that supplements student feedback. A large variety of scheme formats with rather differing purposes are described in the literature. They range from purely formative, developmental formats that facilitate a tutor's reflection of their own teaching to reaffirm strengths and identify potential areas for development through to faculty- or institution-driven summative quality assurance-based schemes. Much of the current literature in this field focuses within general higher education and on the development of rating scales, checklists or observation tools to help guide the process. This study reports findings from a qualitative evaluation of a purely formative peer-supported review of teaching scheme that was implemented for general practice clinical tutors at our medical school and describes tutors' attitudes and perceived benefits and challenges when undergoing observation.

Risk factors of the upper limb disorders among cashiers in grocery retail industries: A review

NASA Astrophysics Data System (ADS)

Zuhaidi, Muhammad Fareez Ahmad; Nasrull Abdol Rahman, Mohd

2017-08-01

Cashiers have been appointed as one of top ten occupations in developing musculoskeletal disorders (MSDs) particularly on the upper limb. Many of the workers are still in high risk injury due to incorrect workstations and lack of employee education in basic biomechanical principles. Normally, cashiers are exposed in several risk factors such as awkward and static postures, repetition motion and forceful exertions. Thus, cashiers in supermarket are considered at risk from developing upper limb disorders (ULDs). This review evaluates selected papers that have studied risk factors of the upper limb disorders among cashiers in grocery retail industries. In addition, other studies from related industry were reviewed as applicable. In order to understand risk factors of the upper limb disorders among cashiers, it is recommended that future studies are needed in evaluating these risk factors among cashiers.

Ci4SeR--curation interface for semantic resources--evaluation with adverse drug reactions.

PubMed

Souvignet, Julien; Asfari, Hadyl; Declerck, Gunnar; Lardon, Jérémy; Trombert-Paviot, Béatrice; Jaulent, Marie-Christine; Bousquet, Cédric

2014-01-01

Evaluation and validation have become a crucial problem for the development of semantic resources. We developed Ci4SeR, a Graphical User Interface to optimize the curation work (not taking into account structural aspects), suitable for any type of resource with lightweight description logic. We tested it on OntoADR, an ontology of adverse drug reactions. A single curator has reviewed 326 terms (1020 axioms) in an estimated time of 120 hours (2.71 concepts and 8.5 axioms reviewed per hour) and added 1874 new axioms (15.6 axioms per hour). Compared with previous manual endeavours, the interface allows increasing the speed-rate of reviewed concepts by 68% and axiom addition by 486%. A wider use of Ci4SeR would help semantic resources curation and improve completeness of knowledge modelling.

How Do I Review Thee? Let Me Count the Ways: A Comparison of Research Grant Proposal Review Criteria Across US Federal Funding Agencies.

PubMed

Falk-Krzesinski, Holly J; Tobin, Stacey C

While Elizabeth Barrett Browning counted 25 ways in which she loves her husband in her poem, "How Do I Love Thee? Let me Count the Ways," we identified only eight ways to evaluate the potential for success of a federal research grant proposal. This may be surprising, as it seems upon initial glance of the review criteria used by various federal funding agencies that each has its own distinct set of "rules" regarding the review of grant proposals for research and scholarship. Much of the grantsmanship process is dependent upon the review criteria, which represent the funders' desired impact of the research. But since most funders that offer research grants share the overarching goals of supporting research that (1) fits within its mission and (2) will bring a strong return on its financial investment, the review criteria used to evaluate research grant proposals are based on a similar set of fundamental questions. In this article, we compare the review criteria of 10 US federal agencies that support research through grant programs, and demonstrate that there are actually only a small and finite number of ways that a grant proposal can be evaluated. Though each funding agency may use slightly different wording, we found that the majority of the agencies' criteria address eight key questions. Within the highly competitive landscape of research grant funding, new researchers must find support for their research agendas and established investigators and research development offices must consider ways to diversify their funding portfolios, yet all may be discouraged by the apparent myriad of differences in review criteria used by various funding agencies. Guided by research administrators and research development professionals, recognizing that grant proposal review criteria are similar across funding agencies may help lower the barrier to applying for federal funding for new and early career researchers, or facilitate funding portfolio diversification for experienced researchers. Grantmakers are furthermore provided valuable guidance to develop and refine their own proposal review criteria.

How Do I Review Thee? Let Me Count the Ways: A Comparison of Research Grant Proposal Review Criteria Across US Federal Funding Agencies

PubMed Central

Falk-Krzesinski, Holly J.; Tobin, Stacey C.

2016-01-01

While Elizabeth Barrett Browning counted 25 ways in which she loves her husband in her poem, “How Do I Love Thee? Let me Count the Ways,” we identified only eight ways to evaluate the potential for success of a federal research grant proposal. This may be surprising, as it seems upon initial glance of the review criteria used by various federal funding agencies that each has its own distinct set of “rules” regarding the review of grant proposals for research and scholarship. Much of the grantsmanship process is dependent upon the review criteria, which represent the funders’ desired impact of the research. But since most funders that offer research grants share the overarching goals of supporting research that (1) fits within its mission and (2) will bring a strong return on its financial investment, the review criteria used to evaluate research grant proposals are based on a similar set of fundamental questions. In this article, we compare the review criteria of 10 US federal agencies that support research through grant programs, and demonstrate that there are actually only a small and finite number of ways that a grant proposal can be evaluated. Though each funding agency may use slightly different wording, we found that the majority of the agencies’ criteria address eight key questions. Within the highly competitive landscape of research grant funding, new researchers must find support for their research agendas and established investigators and research development offices must consider ways to diversify their funding portfolios, yet all may be discouraged by the apparent myriad of differences in review criteria used by various funding agencies. Guided by research administrators and research development professionals, recognizing that grant proposal review criteria are similar across funding agencies may help lower the barrier to applying for federal funding for new and early career researchers, or facilitate funding portfolio diversification for experienced researchers. Grantmakers are furthermore provided valuable guidance to develop and refine their own proposal review criteria. PMID:27274713

A Narrative Review of Problem-Based Learning with School-Aged Children: Implementation and Outcomes

ERIC Educational Resources Information Center

Jerzembek, Gabi; Murphy, Simon

2013-01-01

This paper reviews empirical studies that have evaluated the impact of problem-based learning (PBL) on school-aged pupils, in order to summarise how it has been implemented and to assess its effects on academic and personal development. Following electronic searches of PsychINFO, the British Education Index and the Cochrane review database, six…

Influence of forest and rangeland management on anadromous fish habitat in Western North America: rehabilitating and enhancing stream habitat—1. Review and evaluation.

Treesearch

James D. Hall; Calvin O. Baker

1982-01-01

The literature and many published documents on rehabilitating and enhancing stream habitat for salmonid fishes are reviewed. The historical development and conceptual basis for habitat management are considered, followed by a review of successful and unsuccessful techniques for manipulation of spawning, rearing, and riparian habitat. Insufficient attention to...

A review of logistic regression models used to predict post-fire tree mortality of western North American conifers

Treesearch

Travis Woolley; David C. Shaw; Lisa M. Ganio; Stephen Fitzgerald

2012-01-01

Logistic regression models used to predict tree mortality are critical to post-fire management, planning prescribed bums and understanding disturbance ecology. We review literature concerning post-fire mortality prediction using logistic regression models for coniferous tree species in the western USA. We include synthesis and review of: methods to develop, evaluate...

[Prognostic factors for schizophrenia during first psychotic episode].

PubMed

Cano, Juan F; Fierro-Urresta, Marco; Vanegas, Claudia R; Alzate, Marcela; Olarte, Ana; Cendales, Ricardo; Córdoba, Rodrigo N

2007-01-01

Reviewing the available literature regarding prognosis for first psychotic episode for developing schizophrenia. A systematic review of studies which have evaluated prognostic determinants for the first psychotic episode and its relationship to schizophrenia was made. 161 articles were reviewed which fulfilled the search criteria and which were adjusted to the purpose of the study. Duration of untreated psychosis (DUP), pre-morbid functioning level, the presence or predominance of negative symptoms, co-morbid consumption of psychoactive substances and psychosocial state were the most influential characteristics for developing schizophrenia in patients presenting a first psychotic episode.

Flight testing techniques for the evaluation of light aircraft stability derivatives: A review and analysis

NASA Technical Reports Server (NTRS)

Smetana, F. O.; Summery, D. C.; Johnson, W. D.

1972-01-01

Techniques quoted in the literature for the extraction of stability derivative information from flight test records are reviewed. A recent technique developed at NASA's Langley Research Center was regarded as the most productive yet developed. Results of tests of the sensitivity of this procedure to various types of data noise and to the accuracy of the estimated values of the derivatives are reported. Computer programs for providing these initial estimates are given. The literature review also includes a discussion of flight test measuring techniques, instrumentation, and piloting techniques.

Statistical Process Control in the Practice of Program Evaluation.

ERIC Educational Resources Information Center

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Academic Planning through Program Review: Can It Work?

ERIC Educational Resources Information Center

Fernandez, Thomas V.; Raab, Marjorie K.

Nassau Community College (NCC) is currently working with a program evaluation model in which faculty from one department serve as peer evaluation consultants to direct the self-evaluations of other departments. The four functional objectives initially motivating the development of NCC's plan directed that: real decisions about academic programs…

75 FR 64309 - Components for Evaluation of Direct-Reading Monitors for Gases and Vapors and Addendum

Federal Register 2010, 2011, 2012, 2013, 2014

2010-10-19

... Direct-Reading Monitors for Gases and Vapors: Hazard Detection in First Responder Environments.'' The.../docket/review/docket220 . The document expands the 1995 method development and evaluation experimental... evaluating direct-reading monitors for hazard detection in First Responder environments. The 1995 document...

Creating a Culture of Continuous Assessment to Improve Student Learning through Curriculum Review

ERIC Educational Resources Information Center

Kalu, Frances; Dyjur, Patti

2018-01-01

This chapter describes a curriculum review framework that fosters continuous assessment through collaboration with multiple stakeholders, alignment with program level learning outcomes, evaluation based on multiple sources of evidence, and facilitated development of action plans to improve student learning.

E-Learning Systems: Promises and Pitfalls

ERIC Educational Resources Information Center

Chan, Carlyle H.; Robbins, Lisa I.

2006-01-01

Objective: This review examines the use of e-learning systems in psychiatric education. Method: The authors review the Instructional System Design process, focusing on ADDIE (Analysis, Design, Development, Implementation, and Evaluation). The authors also report on two representative teaching projects, discussing the planning, work, and assessment…

Measuring team factors thought to influence the success of quality improvement in primary care: a systematic review of instruments

PubMed Central

2013-01-01

Background Measuring team factors in evaluations of Continuous Quality Improvement (CQI) may provide important information for enhancing CQI processes and outcomes; however, the large number of potentially relevant factors and associated measurement instruments makes inclusion of such measures challenging. This review aims to provide guidance on the selection of instruments for measuring team-level factors by systematically collating, categorizing, and reviewing quantitative self-report instruments. Methods Data sources: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments; reference lists of systematic reviews; and citations and references of the main report of instruments. Study selection: To determine the scope of the review, we developed and used a conceptual framework designed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). We included papers reporting development or use of an instrument measuring factors relevant to teamwork. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarizing and comparing instruments. Instrument content was categorized using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. Results We identified 192 potentially relevant instruments, 170 of which were analyzed to develop the taxonomy. Eighty-one instruments measured constructs relevant to CQI teams in primary care, with content covering teamwork context (45 instruments measured enabling conditions or attitudes to teamwork), team process (57 instruments measured teamwork behaviors), and team outcomes (59 instruments measured perceptions of the team or its effectiveness). Forty instruments were included for full review, many with a strong theoretical basis. Evidence supporting measurement properties was limited. Conclusions Existing instruments cover many of the factors hypothesized to contribute to QI success. With further testing, use of these instruments measuring team factors in evaluations could aid our understanding of the influence of teamwork on CQI outcomes. Greater consistency in the factors measured and choice of measurement instruments is required to enable synthesis of findings for informing policy and practice. PMID:23410500

Assisting allied health in performance evaluation: a systematic review.

PubMed

Lizarondo, Lucylynn; Grimmer, Karen; Kumar, Saravana

2014-11-14

Performance evaluation raises several challenges to allied health practitioners and there is no agreed approach to measuring or monitoring allied health service performance. The aim of this review was to examine the literature on performance evaluation in healthcare to assist in the establishment of a framework that can guide the measurement and evaluation of allied health clinical service performance. This review determined the core elements of a performance evaluation system, tools for evaluating performance, and barriers to the implementation of performance evaluation. A systematic review of the literature was undertaken. Five electronic databases were used to search for relevant articles: MEDLINE, Embase, CINAHL, PsychInfo, and Academic Search Premier. Articles which focussed on any allied health performance evaluation or those which examined performance in health care in general were considered in the review. Content analysis was used to synthesise the findings from individual articles. A total of 37 articles were included in the review. The literature suggests there are core elements involved in performance evaluation which include prioritising clinical areas for measurement, setting goals, selecting performance measures, identifying sources of feedback, undertaking performance measurement, and reporting the results to relevant stakeholders. The literature describes performance evaluation as multi-dimensional, requiring information or data from more than one perspective to provide a rich assessment of performance. A range of tools or instruments are available to capture various perspectives and gather a comprehensive picture of health care quality. Every allied health care delivery system has different performance needs and will therefore require different approaches. However, there are core processes that can be used as a framework to evaluate allied health performance. A careful examination of barriers to performance evaluation and subsequent tailoring of strategies to overcome these barriers should be undertaken to achieve the aims of performance evaluation. The findings of this review should inform the development of a standardised framework that can be used to measure and evaluate allied health performance. Future research should explore the utility and overall impact of such framework in allied health service delivery.

Self-management programs for Aboriginal and Torres Strait Islander Peoples with chronic conditions: A rapid review.

PubMed

Moore, Ellie; Lawn, Sharon; Oster, Candice; Morello, Andrea

2017-01-01

Objectives Review the evidence for the effectiveness of chronic condition self-management programs applied to Aboriginal and Torres Strait Islander Peoples. Methods A rapid review methodology was followed to develop an evidence summary from peer-reviewed and grey literature. Results Only seven peer-reviewed studies were identified. The evidence indicated that group programs, particularly the Stanford Program, and structured individual chronic condition self-management programs were of good quality for Aboriginal and Torres Strait Islander Peoples, although these need to be integrated into practice in order to see the greatest benefits. The Flinders Program showed promise as a standardised program with content designed specifically with and for these populations. Numerous grey literature sources were identified, many using strong participatory approaches developed locally within Aboriginal and Torres Strait Islander Peoples. However, few of these programs have been subject to rigorous evaluation. Discussion Despite the significant focus on chronic condition self-management programs to help address the burden of disease for Aboriginal and Torres Strait Islander Peoples, few studies exist that have been properly evaluated. The Closing the Gap Principles developed by the Australian Institute of Health and Welfare offer important guidance for how to proceed to maximise engagement, cultural appropriateness and ownership of program initiatives.

An assessment of DREAM, appendix E

NASA Technical Reports Server (NTRS)

Riddle, W. E.

1980-01-01

The design realization, evaluation and modelling (DREAM) system is evaluated. A short history of the DREAM research project is given as well as the significant characteristics of DREAM as a development environment. The design notation which is the basis for the DREAM system is reviewed, and the development tools envisioned as part of DREAM are discussed. Insights into development environments and their production are presented and used to make suggestions for future work in the area of development environments.

Honduras geothermal development: Regulations and opportunities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goff, S.J.; Winchester, W.W.

1994-09-01

The US Department of Energy (DOE) through the Assistant Secretary for Policy, Planning, and Evaluation funded a project to review and evaluate existing power sector laws and regulations in Honduras. Also included in the scope of the project was a review of regulations pertaining to the privatization of state-run companies. We paid particular attention to regulations which might influence opportunities to develop and commercialize Honduras` geothermal resources. We believe that Honduras is well on the road to attracting foreign investment and has planned or has already in place much of the infrastructure and legal guarantees which encourage the influx ofmore » private funds from abroad. In addition, in light of current power rationing and Honduras` new and increasing awareness of the negative effects of power sector development on the environment, geothermal energy development is even more attractive. Combined, these factors create a variety of opportunities. The potential for private sector development of geothermal positive.« less

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

ERIC Educational Resources Information Center

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Validation of a Tool Evaluating Educational Apps for Smart Education

ERIC Educational Resources Information Center

Lee, Jeong-Sook; Kim, Sung-Wan

2015-01-01

The purpose of this study is to develop and validate an evaluation tool of educational apps for smart education. Based on literature reviews, a potential model for evaluating educational apps was suggested. An evaluation tool consisting of 57 survey items was delivered to 156 students in middle and high schools. An exploratory factor analysis was…

Evaluating mobile phone applications for health behaviour change: A systematic review.

PubMed

McKay, Fiona H; Cheng, Christina; Wright, Annemarie; Shill, Jane; Stephens, Hugh; Uccellini, Mary

2018-01-01

Introduction Increasing smartphones access has allowed for increasing development and use of smart phone applications (apps). Mobile health interventions have previously relied on voice or text-based short message services (SMS), however, the increasing availability and ease of use of apps has allowed for significant growth of smartphone apps that can be used for health behaviour change. This review considers the current body of knowledge relating to the evaluation of apps for health behaviour change. The aim of this review is to investigate approaches to the evaluation of health apps to identify any current best practice approaches. Method A systematic review was conducted. Data were collected and analysed in September 2016. Thirty-eight articles were identified and have been included in this review. Results Articles were published between 2011- 2016, and 36 were reviews or evaluations of apps related to one or more health conditions, the remaining two reported on an investigation of the usability of health apps. Studies investigated apps relating to the following areas: alcohol, asthma, breastfeeding, cancer, depression, diabetes, general health and fitness, headaches, heart disease, HIV, hypertension, iron deficiency/anaemia, low vision, mindfulness, obesity, pain, physical activity, smoking, weight management and women's health. Conclusion In order to harness the potential of mobile health apps for behaviour change and health, we need better ways to assess the quality and effectiveness of apps. This review is unable to suggest a single best practice approach to evaluate mobile health apps. Few measures identified in this review included sufficient information or evaluation, leading to potentially incomplete and inaccurate information for consumers seeking the best app for their situation. This is further complicated by a lack of regulation in health promotion generally.

Clinical Practice Guideline: Safe Medication Use in the ICU.

PubMed

Kane-Gill, Sandra L; Dasta, Joseph F; Buckley, Mitchell S; Devabhakthuni, Sandeep; Liu, Michael; Cohen, Henry; George, Elisabeth L; Pohlman, Anne S; Agarwal, Swati; Henneman, Elizabeth A; Bejian, Sharon M; Berenholtz, Sean M; Pepin, Jodie L; Scanlon, Mathew C; Smith, Brian S

2017-09-01

To provide ICU clinicians with evidence-based guidance on safe medication use practices for the critically ill. PubMed, Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, CINAHL, Scopus, and ISI Web of Science for relevant material to December 2015. Based on three key components: 1) environment and patients, 2) the medication use process, and 3) the patient safety surveillance system. The committee collectively developed Population, Intervention, Comparator, Outcome questions and quality of evidence statements pertaining to medication errors and adverse drug events addressing the key components. A total of 34 Population, Intervention, Comparator, Outcome questions, five quality of evidence statements, and one commentary on disclosure was developed. Subcommittee members were assigned selected Population, Intervention, Comparator, Outcome questions or quality of evidence statements. Subcommittee members completed their Grading of Recommendations Assessment, Development, and Evaluation of the question with his/her quality of evidence assessment and proposed strength of recommendation, then the draft was reviewed by the relevant subcommittee. The subcommittee collectively reviewed the evidence profiles for each question they developed. After the draft was discussed and approved by the entire committee, then the document was circulated among all members for voting on the quality of evidence and strength of recommendation. The committee followed the principles of the Grading of Recommendations Assessment, Development, and Evaluation system to determine quality of evidence and strength of recommendations. This guideline evaluates the ICU environment as a risk for medication-related events and the environmental changes that are possible to improve safe medication use. Prevention strategies for medication-related events are reviewed by medication use process node (prescribing, distribution, administration, monitoring). Detailed considerations to an active surveillance system that includes reporting, identification, and evaluation are discussed. Also, highlighted is the need for future research for safe medication practices that is specific to critically ill patients.

Low health literacy and evaluation of online health information: a systematic review of the literature.

PubMed

Diviani, Nicola; van den Putte, Bas; Giani, Stefano; van Weert, Julia Cm

2015-05-07

Recent years have witnessed a dramatic increase in consumer online health information seeking. The quality of online health information, however, remains questionable. The issue of information evaluation has become a hot topic, leading to the development of guidelines and checklists to design high-quality online health information. However, little attention has been devoted to how consumers, in particular people with low health literacy, evaluate online health information. The main aim of this study was to review existing evidence on the association between low health literacy and (1) people's ability to evaluate online health information, (2) perceived quality of online health information, (3) trust in online health information, and (4) use of evaluation criteria for online health information. Five academic databases (MEDLINE, PsycINFO, Web of Science, CINAHL, and Communication and Mass-media Complete) were systematically searched. We included peer-reviewed publications investigating differences in the evaluation of online information between people with different health literacy levels. After abstract and full-text screening, 38 articles were included in the review. Only four studies investigated the specific role of low health literacy in the evaluation of online health information. The other studies examined the association between educational level or other skills-based proxies for health literacy, such as general literacy, and outcomes. Results indicate that low health literacy (and related skills) are negatively related to the ability to evaluate online health information and trust in online health information. Evidence on the association with perceived quality of online health information and use of evaluation criteria is inconclusive. The findings indicate that low health literacy (and related skills) play a role in the evaluation of online health information. This topic is therefore worth more scholarly attention. Based on the results of this review, future research in this field should (1) specifically focus on health literacy, (2) devote more attention to the identification of the different criteria people use to evaluate online health information, (3) develop shared definitions and measures for the most commonly used outcomes in the field of evaluation of online health information, and (4) assess the relationship between the different evaluative dimensions and the role played by health literacy in shaping their interplay.

Low Health Literacy and Evaluation of Online Health Information: A Systematic Review of the Literature

PubMed Central

van den Putte, Bas; Giani, Stefano; van Weert, Julia CM

2015-01-01

Background Recent years have witnessed a dramatic increase in consumer online health information seeking. The quality of online health information, however, remains questionable. The issue of information evaluation has become a hot topic, leading to the development of guidelines and checklists to design high-quality online health information. However, little attention has been devoted to how consumers, in particular people with low health literacy, evaluate online health information. Objective The main aim of this study was to review existing evidence on the association between low health literacy and (1) people’s ability to evaluate online health information, (2) perceived quality of online health information, (3) trust in online health information, and (4) use of evaluation criteria for online health information. Methods Five academic databases (MEDLINE, PsycINFO, Web of Science, CINAHL, and Communication and Mass-media Complete) were systematically searched. We included peer-reviewed publications investigating differences in the evaluation of online information between people with different health literacy levels. Results After abstract and full-text screening, 38 articles were included in the review. Only four studies investigated the specific role of low health literacy in the evaluation of online health information. The other studies examined the association between educational level or other skills-based proxies for health literacy, such as general literacy, and outcomes. Results indicate that low health literacy (and related skills) are negatively related to the ability to evaluate online health information and trust in online health information. Evidence on the association with perceived quality of online health information and use of evaluation criteria is inconclusive. Conclusions The findings indicate that low health literacy (and related skills) play a role in the evaluation of online health information. This topic is therefore worth more scholarly attention. Based on the results of this review, future research in this field should (1) specifically focus on health literacy, (2) devote more attention to the identification of the different criteria people use to evaluate online health information, (3) develop shared definitions and measures for the most commonly used outcomes in the field of evaluation of online health information, and (4) assess the relationship between the different evaluative dimensions and the role played by health literacy in shaping their interplay. PMID:25953147

Consumer evaluation of food with nutritional benefits: a systematic review and narrative synthesis.

PubMed

Mogendi, Joseph Birundu; De Steur, Hans; Gellynck, Xavier; Makokha, Anselimo

2016-06-01

As a consequence of the growing interest in, and development of, various types of food with nutritional benefits, the modern consumer views their kitchen cabinet more and more as a medicine cabinet. Given that consumer evaluation of food is considered key to the successful production, marketing and finally consumption of food, a procedure commonly used in medical fields was employed to systematically review and summarize evidence of consumer evaluation studies on nutritious foods. The focus is primarily on consumer understanding of nutritious food and the underlying determinants of consumer evaluation. Our results highlight four groups of key determinants: (1) nutrition knowledge and information; (2) attitudes, beliefs, perceptions and behavioural determinants; (3) price, process and product characteristics; and (4) socio-demographics. The findings also point to the importance of understanding consumer acceptance as one many concepts in the consumer evaluation process, and provide support for developing appropriate strategies for improving health and well-being of consumers.

State of the States 2009. Renewable Energy Development and the Role of Policy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Doris, Elizabeth; McLaren, Joyce; Healey, Victoria

2009-10-01

This report tracks the progress of U.S. renewable energy development at the state level, with metrics on development status and reviews of relevant policies. The analysis offers state-by-state policy suggestions and develops performance-based evaluation metrics to accelerate and improve renewable energy development.

Conceptualizing and Evaluating Professional Development for School Leaders

ERIC Educational Resources Information Center

Goldring, Ellen B.; Preston, Courtney; Huff, Jason

2012-01-01

In this paper, we present a review of the field of professional development for school leaders. The paper sets out a framework for defining what professional development is, articulates criteria to define "high quality" professional development, and describes goals for professional development. It then critiques the research on…

Systematic review of measurement properties of self-reported instruments for evaluating self-care in adults.

PubMed

Matarese, Maria; Lommi, Marzia; De Marinis, Maria Grazia

2017-06-01

The aims of this study were as follows: to identify instruments developed to assess self-care in healthy adults; to determine the theory on which they were based; their validity and reliability properties and to synthesize the evidence on their measurement properties. Many instruments have been developed to assess self-care in many different populations and conditions. Clinicians and researchers should select the most appropriate self-care instrument based on the knowledge of their measurement properties. Systematic review of measurement instruments according to the protocol recommended by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. PubMed, Embase, PsycINFO, Scopus and CINAHL databases were searched from inception to December 2015. Studies testing measurement properties of self-report instruments assessing self-care in healthy adults, published in the English language and in peer review journals were selected. Two reviewers independently appraised the methodological quality of the studies with the COSMIN checklist and the quality of results using specific quality criteria. Twenty-six articles were included in the review testing the measurement properties of nine instruments. Seven instruments were based on Orem's Self-care theory. Not all the measurement properties were evaluated for the identified instruments. No self-care instrument showed strong evidence supporting the evaluated measurement properties. Despite the development of several instruments to assess self-care in the adult population, no instrument can be fully recommended to clinical nurses and researchers. Further studies of high methodological quality are needed to confirm the measurement properties of these instruments. © 2016 John Wiley & Sons Ltd.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

Review of recent developments in the field of magnesium corrosion: Recent developments in Mg corrosion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Atrens, Andrej; Song, Guang -Ling; Liu, Ming

2015-01-07

This paper provides a review of recent developments in the field of Mg corrosion and puts those into context. This includes considerations of corrosion manifestations, material influences, surface treatment, anodization, coatings, inhibition, biodegradable medical applications, stress corrosion cracking, flammability, corrosion mechanisms for HP Mg, critical evaluation of corrosion mechanisms, and concluding remarks. There has been much research recently, and much research continues in this area. In conclusion, this is expected to produce significantly better, more-corrosion-resistant Mg alloys.

How Do Contextual Factors Influence Implementation and Receipt of Positive Youth Development Programs Addressing Substance Use and Violence? A Qualitative Meta-Synthesis of Process Evaluations.

PubMed

Dickson, Kelly; Melendez-Torres, G J; Fletcher, Adam; Hinds, Kate; Thomas, James; Stansfield, Claire; Murphy, Simon; Campbell, Rona; Bonell, Chris

2018-05-01

Positive youth development (PYD) often aims to prevent tobacco, alcohol, and drugs use and violence. We systematically reviewed PYD interventions, synthesizing process, and outcomes evidence. Synthesis of outcomes, published elsewhere, found no overall evidence of reducing substance use or violence but notable variability of fidelity. Our synthesis of process evaluations examined how implementation varied and was influenced by context. Process evaluations of PYD aiming to reduce substance use and violence. Study Inclusion Criteria: Overall review published since 1985; written in English; focused on youth aged 11 to 18 years; focused on interventions addressing multiple positive assets; reported on theory, process, or outcomes; and concerned with reducing substance use or violence. Synthesis of process evaluations examined how implementation varies with or is influenced by context. Two reviewers in parallel. Thematic synthesis. We identified 12 reports. Community engagement enhanced program appeal. Collaboration with other agencies could broaden the activities offered. Calm but authoritative staff increased acceptability. Staff continuity underpinned diverse activities and durable relationships. Empowering participants were sometimes in tension with requiring them to engage in diverse activities. Our systematic review identified factors that might help improve the fidelity and acceptability of PYD interventions. Addressing these might enable PYD to fulfill its potential as a means of promoting health.

CRITICAL EVALUATION OF ECOLOGICAL INDICATORS

EPA Science Inventory

EPA's Office of Research and Development (ORD) has prepared fifteen technical guidelines to evaluate the suitability of an ecological indicator in a monitoring program. The guidelines were fashioned to provide a consistent framework for indicator review and to provide guidance fo...

Procedures for evaluating corrosion-inhibiting admixtures for structural concrete

DOT National Transportation Integrated Search

2000-06-01

The objectives of this research were to (1) develop procedures for evaluating and qualifying corrosion-inhibiting admixtures (CIAs) and (2) recommend performance criteria for their acceptance. Phase I work included a literature review of CIAs, the re...

Measuring parent food practices: a systematic review of existing measures and examination of instruments

PubMed Central

2013-01-01

During the last decade, there has been a rapid increase in development of instruments to measure parent food practices. Because these instruments often measure different constructs, or define common constructs differently, an evaluation of these instruments is needed. A systematic review of the literature was conducted to identify existing measures of parent food practices and to assess the quality of their development. The initial search used terms capturing home environment, parenting behaviors, feeding practices and eating behaviors, and was performed in October of 2009 using PubMed/Medline, PsychInfo, Web of knowledge (ISI), and ERIC, and updated in July of 2012. A review of titles and abstracts was used to narrow results, after which full articles were retrieved and reviewed. Only articles describing development of measures of parenting food practices designed for families with children 2-12 years old were retained for the current review. For each article, two reviewers extracted data and appraised the quality of processes used for instrument development and evaluation. The initial search yielded 28,378 unique titles; review of titles and abstracts narrowed the pool to 1,352 articles; from which 57 unique instruments were identified. The review update yielded 1,772 new titles from which14 additional instruments were identified. The extraction and appraisal process found that 49% of instruments clearly identified and defined concepts to be measured, and 46% used theory to guide instrument development. Most instruments (80%) had some reliability testing, with internal consistency being the most common (79%). Test-retest or inter-rater reliability was reported for less than half the instruments. Some form of validity evidence was reported for 84% of instruments. Construct validity was most commonly presented (86%), usually with analysis of associations with child diet or weight/BMI. While many measures of food parenting practices have emerged, particularly in recent years, few have demonstrated solid development methods. Substantial variation in items across different scales/constructs makes comparison between instruments extremely difficult. Future efforts should be directed toward consensus development of food parenting practices constructs and measures. PMID:23688157

Using systematic review in occupational safety and health.

PubMed

Howard, John; Piacentino, John; MacMahon, Kathleen; Schulte, Paul

2017-11-01

Evaluation of scientific evidence is critical in developing recommendations to reduce risk. Healthcare was the first scientific field to employ a systematic review approach for synthesizing research findings to support evidence-based decision-making and it is still the largest producer and consumer of systematic reviews. Systematic reviews in the field of occupational safety and health are being conducted, but more widespread use and adoption would strengthen assessments. In 2016, NIOSH asked RAND to develop a framework for applying the traditional systematic review elements to the field of occupational safety and health. This paper describes how essential systematic review elements can be adapted for use in occupational systematic reviews to enhance their scientific quality, objectivity, transparency, reliability, utility, and acceptability. Published 2017. This article is a U.S. Government work and is in the public domain in the USA.

Optimizing the post-graduate institutional program evaluation process.

PubMed

Lypson, Monica L; Prince, Mark E P; Kasten, Steven J; Osborne, Nicholas H; Cohan, Richard H; Kowalenko, Terry; Dougherty, Paul J; Reynolds, R Kevin; Spires, M Catherine; Kozlow, Jeffrey H; Gitlin, Scott D

2016-02-17

Reviewing program educational efforts is an important component of postgraduate medical education program accreditation. The post-graduate review process has evolved over time to include centralized oversight based on accreditation standards. The institutional review process and the impact on participating faculty are topics not well described in the literature. We conducted multiple Plan-Do-Study-Act (PDSA) cycles to identify and implement areas for change to improve productivity in our institutional program review committee. We also conducted one focus group and six in-person interviews with 18 committee members to explore their perspectives on the committee's evolution. One author (MLL) reviewed the transcripts and performed the initial thematic coding with a PhD level research associate and identified and categorized themes. These themes were confirmed by all participating committee members upon review of a detailed summary. Emergent themes were triangulated with the University of Michigan Medical School's Admissions Executive Committee (AEC). We present an overview of adopted new practices to the educational program evaluation process at the University of Michigan Health System that includes standardization of meetings, inclusion of resident members, development of area content experts, solicitation of committed committee members, transition from paper to electronic committee materials, and focus on continuous improvement. Faculty and resident committee members identified multiple improvement areas including the ability to provide high quality reviews of training programs, personal and professional development, and improved feedback from program trainees. A standing committee that utilizes the expertise of a group of committed faculty members and which includes formal resident membership has significant advantages over ad hoc or other organizational structures for program evaluation committees.

Zymomonas mobilis as a model system for production of biofuels and biochemicals

DOE PAGES

Yang, Shihui; Fei, Qiang; Zhang, Yaoping; ...

2016-09-15

Zymomonas mobilis is a natural ethanologen with many desirable industrial biocatalyst characteristics. In this review, we will discuss work to develop Z. mobilis as a model system for biofuel production from the perspectives of substrate utilization, development for industrial robustness, potential product spectrum, strain evaluation and fermentation strategies. Lastly, this review also encompasses perspectives related to classical genetic tools and emerging technologies in this context.

Zymomonas mobilis as a model system for production of biofuels and biochemicals

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yang, Shihui; Fei, Qiang; Zhang, Yaoping

Zymomonas mobilis is a natural ethanologen with many desirable industrial biocatalyst characteristics. In this review, we will discuss work to develop Z. mobilis as a model system for biofuel production from the perspectives of substrate utilization, development for industrial robustness, potential product spectrum, strain evaluation and fermentation strategies. Lastly, this review also encompasses perspectives related to classical genetic tools and emerging technologies in this context.

BODY IMAGE IN CHILDHOOD: AN INTEGRATIVE LITERATURE REVIEW.

PubMed

Neves, Clara Mockdece; Cipriani, Flávia Marcelle; Meireles, Juliana Fernandes Filgueiras; Morgado, Fabiane Frota da Rocha; Ferreira, Maria Elisa Caputo

2017-01-01

To analyse the scientific literature regarding the evaluation of body image in children through an integrative literature review. An intersection of the keywords "body image" AND "child" was conducted in Scopus, Medline and Virtual Health Library (BVS - Biblioteca Virtual de Saúde) databases. The electronic search was based on studies published from January 2013 to January 2016, in order to verify the most current investigations on the subject. Exclusion criteria were: articles in duplicate; no available summaries; not empirical; not assessing any component of body image; the sample did not consider the target age of this research (0 to 12 years old) and/or considered clinical populations; besides articles not fully available. 7,681 references were identified, and, after the exclusion criteria were implemented, 33 studies were analysed. Results showed that the perceptual and attitudinal dimensions focusing on body dissatisfaction were explored, mainly evaluated by silhouette scales. Intervention programs were developed internationally to prevent negative body image in children. The studies included in this review evaluated specific aspects of body image in children, especially body perception and body dissatisfaction. The creation of specific tools for children to evaluate body image is recommended to promote the psychosocial well being of individuals throughout human development.

Implants for orthodontic anchorage

PubMed Central

Zheng, Xiaowen; Sun, Yannan; Zhang, Yimei; Cai, Ting; Sun, Feng; Lin, Jiuxiang

2018-01-01

Abstract Implantanchorage continues to receive much attention as an important orthodontic anchorage. Since the development of orthodontic implants, the scope of applications has continued to increase. Although multiple reviews detailing implants have been published, no comprehensive evaluations have been performed. Thus, the purpose of this study was to comprehensively evaluate the effects of implants based on data published in review articles. An electronic search of the Cochrane Library, Medline, Embase, Ebsco and Sicencedirect for reviews with “orthodontic” and “systematic review or meta analysis” in the title, abstract, keywords, or full text was performed. A subsequent manual search was then performed to identify reviews concerning orthodontic implants. A manual search of the orthodontic journals American Journal of Orthodontics and Dentofacial Orthopedics (AJODO), European Journal of Orthodontics (EJO), and Angle Othodontist was also performed. Such systematic reviews that evaluated the efficacy and safety of orthodontic implants were used to indicate success rates and molar movements. A total of 23 reviews were included in the analysis. The quality of each review was assessed using a measurement tool for Assessment of Multiple Systematic Reviews (AMSTAR), and the review chosen to summarize outcomes had a quality score of >6. Most reviews were less than moderate quality. Success rates of implants ranged in a broad scope, and movement of the maxillary first molar was superior with implants compared with traditional anchorage. PMID:29595673

76 FR 42167 - Rehabilitation Research and Development Service Scientific Merit Review Board; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2011-07-18

... subcommittees of the Board will meet to evaluate merit review applications: August 9--Rehabilitation Engineering... Rehabilitation. August 16--Rehabilitation Engineering and Prosthetics/Orthotics. August 16-17--Psychological Health and Social Reintegration; Sensory Systems/Communication; Spinal Cord Injury; and Career...

75 FR 52373 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2010-08-25

... Administration. Type of Review: NEW. Title of Collection: Evaluation of the Technology-Based Learning Grants. OMB... technology based learning. The initiative increases worker access to training while stimulating the development of innovative models and uses for technology based learning in the public workforce system. For...

Evaluation and Development of Pavement Scores, Performance Models and Needs Estimates for the TXDOT Pavement Management Information System : Final Report

DOT National Transportation Integrated Search

2012-10-01

This project conducted a thorough review of the existing Pavement Management Information System (PMIS) database, : performance models, needs estimates, utility curves, and scores calculations, as well as a review of District practices : concerning th...

Using Customer Reviews to Build Critical Reading Skills

ERIC Educational Resources Information Center

Rice, Mary

2007-01-01

Junior high school teacher Mary Rice designs a consumer research unit that cultivates students' critical reading and thinking skills. As students learn how to develop and revise criteria for evaluating the reliability of online information, they read customer reviews, research products, and present their findings orally.

76 FR 54746 - Notice of Submission for OMB Review

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-02

... Development Type of Review: New. Title of Collection: Analysis of State Bullying Laws and Policies. OMB... conducting an analysis of bullying laws and policies. Evaluation, Management and Training Associates, Inc. is... anti- bullying laws and policies. The purpose of the study is to describe bullying policy...

Formative Evaluation Information from Scripts, Scratch Tracks, and Rough Cuts: A Comparison.

ERIC Educational Resources Information Center

Burton, John K.; Aversa, Frances M.

1979-01-01

To assess how early in the development of content materials for a televised course learner review should occur, data were gathered from adult students who reviewed either the script, scratch track audiotape, or rough cut videotape for a course on Japan. (Author/JEG)

An Annotated Bibliography of MANPRINT-Related Assessments and Evaluations Conducted by the U.S. Army, 2nd Edition: 1953 to 2009. Volume 3 - Test and Evaluation Reports

DTIC Science & Technology

2010-02-01

bibliography of the 583 MA reports reviewed by this paper . MANPRINT Asssessments are performed according to the direction of AR 602-2. They consist of an...bibliography of the 443 T&ERs reviewed by this paper . A T&ER is a system evaluation performed according to AR 73-1 for all systems in development in the...of the Defense Technical Information Center (DTIC) web page: https://dtic-stinet.dtic.mil/.  National Technical Information Service (NTIS): http

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research.

PubMed

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-04-18

Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

PRISMA-Children (C) and PRISMA-Protocol for Children (P-C) Extensions: a study protocol for the development of guidelines for the conduct and reporting of systematic reviews and meta-analyses of newborn and child health research

PubMed Central

Kapadia, Mufiza Z; Askie, Lisa; Hartling, Lisa; Contopoulos-Ioannidis, Despina; Bhutta, Zulfiqar A; Soll, Roger; Moher, David; Offringa, Martin

2016-01-01

Introduction Paediatric systematic reviews differ from adult systematic reviews in several key aspects such as considerations of child tailored interventions, justifiable comparators, valid outcomes and child sensitive search strategies. Available guidelines, including PRISMA-P (2015) and PRISMA (2009), do not cover all the complexities associated with reporting systematic reviews in the paediatric population. Using a collaborative, multidisciplinary structure, we aim to develop evidence-based and consensus-based PRISMA-P-C (Protocol for Children) and PRISMA-C (Children) Extensions to guide paediatric systematic review protocol and completed review reporting. Methods and analysis This project's methodology follows published recommendations for developing reporting guidelines and involves the following six phases; (1) establishment of a steering committee representing key stakeholder groups; (2) a scoping review to identify potential Extension items; (3) three types of consensus activities including meetings of the steering committee to achieve high-level decisions on the content and methodology of the Extensions, a survey of key stakeholders to generate a list of possible items to include in the Extensions and a formal consensus meeting to select the reporting items to add to, or modify for, the Extension; (4) the preliminary checklist items generated in phase III will be evaluated against the existing evidence and reporting practices in paediatric systematic reviews; (5) extension statements and explanation and elaboration documents will provide detailed advice for each item and examples of good reporting; (6) development and implementation of effective knowledge translation of the extension checklist, and an evaluation of the Extensions by key stakeholders. Ethics and Dissemination This protocol was considered a quality improvement project by the Hospital for Sick Children's Ethics Committee and did not require ethical review. The resultant checklists, jointly developed with all relevant stakeholders, will be disseminated through peer-reviewed journals as well as national and international conference presentations. Endorsement of the checklist will be sought simultaneously in multiple journals. PMID:27091820

The Uses and Consequences of Literacy in the Daily Lives of Ordinary People: From an Evaluation of Adult Literacy Organization of Zimbabwe (ALOZ).

ERIC Educational Resources Information Center

Bhola, H. S.

To evaluate the Adult Literacy Organization of Zimbabwe (ALOZ), an organization whose aim is to achieve universal literacy in Zimbabwe, a study interviewed officials at ALOZ, the United States Agency for International Development (USAID), and other institutions involved in literacy development; reviewed relevant literature and documents;…

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

PubMed

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration

PubMed Central

Liberati, Alessandro; Altman, Douglas G; Tetzlaff, Jennifer; Mulrow, Cynthia; Gøtzsche, Peter C; Ioannidis, John P A; Clarke, Mike; Devereaux, P J; Kleijnen, Jos; Moher, David

2009-01-01

Systematic reviews and meta-analyses are essential to summarise evidence relating to efficacy and safety of healthcare interventions accurately and reliably. The clarity and transparency of these reports, however, are not optimal. Poor reporting of systematic reviews diminishes their value to clinicians, policy makers, and other users. Since the development of the QUOROM (quality of reporting of meta-analysis) statement—a reporting guideline published in 1999—there have been several conceptual, methodological, and practical advances regarding the conduct and reporting of systematic reviews and meta-analyses. Also, reviews of published systematic reviews have found that key information about these studies is often poorly reported. Realising these issues, an international group that included experienced authors and methodologists developed PRISMA (preferred reporting items for systematic reviews and meta-analyses) as an evolution of the original QUOROM guideline for systematic reviews and meta-analyses of evaluations of health care interventions. The PRISMA statement consists of a 27-item checklist and a four-phase flow diagram. The checklist includes items deemed essential for transparent reporting of a systematic review. In this explanation and elaboration document, we explain the meaning and rationale for each checklist item. For each item, we include an example of good reporting and, where possible, references to relevant empirical studies and methodological literature. The PRISMA statement, this document, and the associated website (www.prisma-statement.org/) should be helpful resources to improve reporting of systematic reviews and meta-analyses. PMID:19622552

Systematic review of positive youth development programs for adolescents with chronic illness.

PubMed

Maslow, Gary R; Chung, Richard J

2013-05-01

The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.

Food Safety Evaluation Based on Near Infrared Spectroscopy and Imaging: A Review.

PubMed

Fu, Xiaping; Ying, Yibin

2016-08-17

In recent years, due to the increasing consciousness of food safety and human health, much progress has been made in developing rapid and nondestructive techniques for the evaluation of food hazards, food authentication, and traceability. Near infrared (NIR) spectroscopy and imaging techniques have gained wide acceptance in many fields because of their advantages over other analytical techniques. Following a brief introduction of NIR spectroscopy and imaging basics, this review mainly focuses on recent NIR spectroscopy and imaging applications for food safety evaluation, including (1) chemical hazards detection; (2) microbiological hazards detection; (3) physical hazards detection; (4) new technology-induced food safety concerns; and (5) food traceability. The review shows NIR spectroscopy and imaging to be effective tools that will play indispensable roles for food safety evaluation. In addition, on-line/real-time applications of these techniques promise to be a huge growth field in the near future.

Quality evaluation in health care services based on customer-provider relationships.

PubMed

Eiriz, Vasco; Figueiredo, José António

2005-01-01

To develop a framework for evaluating the quality of Portuguese health care organisations based on the relationship between customers and providers, to define key variables related to the quality of health care services based on a review of the available literature, and to establish a conceptual framework in order to test the framework and variables empirically. Systematic review of the literature. Health care services quality should not be evaluated exclusively by customers. Given the complexity, ambiguity and heterogeneity of health care services, the authors develop a framework for health care evaluation based on the relationship between customers (patients, their relatives and citizens) and providers (managers, doctors, other technical staff and non-technical staff), and considering four quality items (customer service orientation, financial performance, logistical functionality and level of staff competence). This article identifies important changes in the Portuguese health care industry, such as the ownership of health care providers. At the same time, customers are changing their attitudes towards health care, becoming much more concerned and demanding of health services. These changes are forcing Portuguese private and public health care organisations to develop more marketing-oriented services. This article recognises the importance of quality evaluation of health care services as a means of increasing customer satisfaction and organisational efficiency, and develops a framework for health care evaluation based on the relationship between customers and providers.

Development and evaluation of a quality score for abstracts

PubMed Central

Timmer, Antje; Sutherland, Lloyd R; Hilsden, Robert J

2003-01-01

Background The evaluation of abstracts for scientific meetings has been shown to suffer from poor inter observer reliability. A measure was developed to assess the formal quality of abstract submissions in a standardized way. Methods Item selection was based on scoring systems for full reports, taking into account published guidelines for structured abstracts. Interrater agreement was examined using a random sample of submissions to the American Gastroenterological Association, stratified for research type (n = 100, 1992–1995). For construct validity, the association of formal quality with acceptance for presentation was examined. A questionnaire to expert reviewers evaluated sensibility items, such as ease of use and comprehensiveness. Results The index comprised 19 items. The summary quality scores showed good interrater agreement (intra class coefficient 0.60 – 0.81). Good abstract quality was associated with abstract acceptance for presentation at the meeting. The instrument was found to be acceptable by expert reviewers. Conclusion A quality index was developed for the evaluation of scientific meeting abstracts which was shown to be reliable, valid and useful. PMID:12581457

34 CFR 300.324 - Development, review, and revision of IEP.

Code of Federal Regulations, 2011 CFR

2011-07-01

... mode; and (v) Consider whether the child needs assistive technology devices and services. (3... EDUCATION OF CHILDREN WITH DISABILITIES Evaluations, Eligibility Determinations, Individualized Education.... (a) Development of IEP—(1) General. In developing each child's IEP, the IEP Team must consider— (i...

34 CFR 300.324 - Development, review, and revision of IEP.

Code of Federal Regulations, 2013 CFR

2013-07-01

... mode; and (v) Consider whether the child needs assistive technology devices and services. (3... EDUCATION OF CHILDREN WITH DISABILITIES Evaluations, Eligibility Determinations, Individualized Education.... (a) Development of IEP—(1) General. In developing each child's IEP, the IEP Team must consider— (i...

34 CFR 300.324 - Development, review, and revision of IEP.

Code of Federal Regulations, 2012 CFR

2012-07-01

... mode; and (v) Consider whether the child needs assistive technology devices and services. (3... EDUCATION OF CHILDREN WITH DISABILITIES Evaluations, Eligibility Determinations, Individualized Education.... (a) Development of IEP—(1) General. In developing each child's IEP, the IEP Team must consider— (i...

34 CFR 300.324 - Development, review, and revision of IEP.

Code of Federal Regulations, 2010 CFR

2010-07-01

... mode; and (v) Consider whether the child needs assistive technology devices and services. (3... EDUCATION OF CHILDREN WITH DISABILITIES Evaluations, Eligibility Determinations, Individualized Education.... (a) Development of IEP—(1) General. In developing each child's IEP, the IEP Team must consider— (i...

34 CFR 300.324 - Development, review, and revision of IEP.

Code of Federal Regulations, 2014 CFR

2014-07-01

... mode; and (v) Consider whether the child needs assistive technology devices and services. (3... EDUCATION OF CHILDREN WITH DISABILITIES Evaluations, Eligibility Determinations, Individualized Education.... (a) Development of IEP—(1) General. In developing each child's IEP, the IEP Team must consider— (i...

Opportunities for Improved Management Efficiency of the Head Start Program: Performance Evaluation and High Risk Determination.

ERIC Educational Resources Information Center

Gall, Mary Sheila

This report provides results of a review of the methodology used by the Office of Human Development Services (HDS) to measure Head Start performance and to control high risk Head Start agencies. The review was performed at HDS headquarters and regional locations nationwide. The review was based on a sample of 200 Head Start agencies and focused on…

Developing Tools for Identifying Employer and Employee Satisfaction of Nursing New Graduates in China

PubMed Central

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Purpose. Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. Methods. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. Results. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. Conclusions. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study. PMID:25097876

Developing tools for identifying employer and employee satisfaction of nursing new graduates in China.

PubMed

Fan, Yuying; Li, Qiujie; Yang, Shufen; Guo, Ying; Yang, Libin; Zhao, Shibin

2014-01-01

Researchers developed evaluation tools measuring employment relevant satisfaction for nursing new graduates. The evaluation tools were designed to be relevant to nursing managers who make employment decisions and nursing new graduates who were just employed. In-depth interviews and an expert panel were established to review the activities that evaluate the employee and employer satisfaction of nursing new graduates. Based on individual interviews and literature review, evaluation items were selected. A two-round Delphi study was then conducted from September 2008 to May 2009 with a panel of experts from a range of nursing colleges in China. The response rate was 100% and Kendall's W was 0.73 in the second round of Delphi study. After two rounds of Delphi surveys, a list of 5 employee satisfaction items and 4 employer satisfaction items was identified for nursing new graduates. The findings of this study identified a different but multidimensional set of factors for employment relevant satisfaction, which confirmed the importance of certain fundamental aspects of practice. We developed the evaluation tools to assess the employer and employee satisfaction of nursing new graduates, which provided a database for further study.

The Society for Implementation Research Collaboration Instrument Review Project: a methodology to promote rigorous evaluation.

PubMed

Lewis, Cara C; Stanick, Cameo F; Martinez, Ruben G; Weiner, Bryan J; Kim, Mimi; Barwick, Melanie; Comtois, Katherine A

2015-01-08

Identification of psychometrically strong instruments for the field of implementation science is a high priority underscored in a recent National Institutes of Health working meeting (October 2013). Existing instrument reviews are limited in scope, methods, and findings. The Society for Implementation Research Collaboration Instrument Review Project's objectives address these limitations by identifying and applying a unique methodology to conduct a systematic and comprehensive review of quantitative instruments assessing constructs delineated in two of the field's most widely used frameworks, adopt a systematic search process (using standard search strings), and engage an international team of experts to assess the full range of psychometric criteria (reliability, construct and criterion validity). Although this work focuses on implementation of psychosocial interventions in mental health and health-care settings, the methodology and results will likely be useful across a broad spectrum of settings. This effort has culminated in a centralized online open-access repository of instruments depicting graphical head-to-head comparisons of their psychometric properties. This article describes the methodology and preliminary outcomes. The seven stages of the review, synthesis, and evaluation methodology include (1) setting the scope for the review, (2) identifying frameworks to organize and complete the review, (3) generating a search protocol for the literature review of constructs, (4) literature review of specific instruments, (5) development of an evidence-based assessment rating criteria, (6) data extraction and rating instrument quality by a task force of implementation experts to inform knowledge synthesis, and (7) the creation of a website repository. To date, this multi-faceted and collaborative search and synthesis methodology has identified over 420 instruments related to 34 constructs (total 48 including subconstructs) that are relevant to implementation science. Despite numerous constructs having greater than 20 available instruments, which implies saturation, preliminary results suggest that few instruments stem from gold standard development procedures. We anticipate identifying few high-quality, psychometrically sound instruments once our evidence-based assessment rating criteria have been applied. The results of this methodology may enhance the rigor of implementation science evaluations by systematically facilitating access to psychometrically validated instruments and identifying where further instrument development is needed.

Evaluation of the New Mexico ignition interlock program.

DOT National Transportation Integrated Search

2010-11-01

This Evaluation of the New Mexico Ignition Interlock Program begins by summarizing the development of : alcohol ignition interlock devices, laws, and programs during the past 22 years. It then reviews the laws that : were written in New Mexico from 1...

Developing a GDOT pavement marking handbook using field test deck evaluation and long-term performance analysis : final report.

DOT National Transportation Integrated Search

2015-12-01

This research project comprehensively reviewed the state departments of transportations (DOTs) practices on : selecting and inspecting pavement marking materials (PMMs) and evaluated pavement marking : retroreflectivity data collected on the Georg...

Evaluation of Ethanol Fuel Blends in EPA MOVES2014 Model

DOT National Transportation Integrated Search

2016-01-01

In this report, the methodology and prediction effects of the MOVES model development are reviewed and evaluated in relation to the use of ethanol fuel blends. Particular attention is placed on mid-level ethanol fuel blends (containing between ...

Improving the Efficiency and Quality of the Value Assessment Process for Companion Diagnostic Tests: The Companion test Assessment Tool (CAT).

PubMed

Canestaro, William J; Pritchard, Daryl E; Garrison, Louis P; Dubois, Robert; Veenstra, David L

2015-08-01

Companion diagnostic tests (CDTs) have emerged as a vital technology in the effective use of an increasing number of targeted drug therapies. Although CDTs can offer a multitude of potential benefits, assessing their value within a health technology appraisal process can be challenging because of a complex array of factors that influence clinical and economic outcomes. To develop a user-friendly tool to assist managed care and other health care decision makers in screening companion tests and determining whether an intensive technology review is necessary and, if so, where the review should be focused to improve efficiency. First, we conducted a systematic literature review of CDT cost-effectiveness studies to identify value drivers. Second, we conducted key informant interviews with a diverse group of stakeholders to elicit feedback and solicit any additional value drivers and identify desirable attributes for an evidence review tool. A draft tool was developed based on this information that captured value drivers, usability features, and had a particular focus on practical use by nonexperts. Finally, the tool was pilot tested with test developers and managed care evidence evaluators to assess face-validity and usability. The tool was also evaluated using several diverse examples of existing companion diagnostics and refined accordingly. We identified 65 cost-effectiveness studies of companion diagnostic technologies. The following factors were most commonly identified as value drivers from our literature review: clinical validity of testing; efficacy, safety, and cost of baseline and alternative treatments; cost and mortality of health states; and biomarker prevalence and testing cost. Stakeholders identified the following additional factors that they believed influenced the overall value of a companion test: regulatory status, actionability, utility, and market penetration. These factors were used to maximize the efficiency of the evidence review process. Stakeholders also stated that a tool should be easy to use and time efficient. Cognitive interviews with stakeholders led to minor changes in the draft tool to improve usability and relevance. The final tool consisted of 4 sections: (1) eligibility for review (2 questions), (2) prioritization of review (3 questions), (3) clinical review (3 questions), and (4) economic review (5 questions). Although the evaluation of CDTs can be challenging because of limited evidence and the added complexity of incorporating a diagnostic test into drug treatment decisions, using a pragmatic tool to identify tests that do not need extensive evaluation may improve the efficiency and effectiveness of CDT value assessments.

78 FR 15955 - Draft Guidance for Industry and Review Staff on Formal Dispute Resolution: Appeals Above the...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-13

... Drug Information, Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New... and Development (HFM-40), Center for Biologics Evaluation and Research, Food and Drug Administration..., Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New Hampshire Ave., Bldg. 22...

Pregnancy and You. Courseware Evaluation for Vocational and Technical Education.

ERIC Educational Resources Information Center

Sarle, Ruth; And Others

This courseware evaluation rates the "Pregnancy and You" program, developed by Intellectual Software and sold by Career Aids, Inc. The courseware was rated by a team of home economists participating in a network designed to identify and evaluate courseware and disseminate reviews for vocational and technical teachers, media staff, and…

Assessing International Evaluations. An Example from USAID's Democracy and Governance Program

ERIC Educational Resources Information Center

Bollen, Kenneth; Paxton, Pamela; Morishima, Rumi

2005-01-01

Each year, hundreds of millions of dollars are spent in international and bilateral aid programs to assist developing countries in expanding democratic governance. Evaluating these efforts' effectiveness is important given the vast needs of the client population. This article reviews a sample of evaluations of the United States Agency for…

Evaluating Technology-Based Educational Interventions: A Review of Two Projects

ERIC Educational Resources Information Center

Adamo-Villani, Nicoletta; Dib, Hazar

2013-01-01

The article discusses current evaluation methodologies used to assess the usability, user enjoyment, and pedagogical efficacy of virtual learning environments (VLEs) and serious games. It also describes the evaluations of two recently developed projects: a virtual learning environment that employs a fantasy 3D world to engage deaf and hearing…

A Conceptual Framework for the Evaluation of Emergency Risk Communications

PubMed Central

Lin, Leesa; Gamhewage, Gaya M.

2017-01-01

Objectives. To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). Methods. The framework proposed is based on a systematic review of the scientific literature (2001–2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. Results. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees’ data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Conclusions. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies. PMID:28892436

A Conceptual Framework for the Evaluation of Emergency Risk Communications.

PubMed

Savoia, Elena; Lin, Leesa; Gamhewage, Gaya M

2017-09-01

To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). The framework proposed is based on a systematic review of the scientific literature (2001-2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees' data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies.

A Program Evaluation of the New Annual Professional Performance Review (APPR) Teacher Evaluation System in New York

ERIC Educational Resources Information Center

Morris, Genelle

2013-01-01

Policy makers and educators across the nation are incorporating new standards and assessments into evaluation systems, designed to impact teacher effectiveness and student achievement. New York is one of the states that have developed a teacher evaluation system, now fully implemented in all of its 697 public school districts. As the results from…

Developments in purification methods for obtaining and evaluation of collagen derived endogenous angioinhibitors

PubMed Central

Gunda, Venugopal; Verma, Raj K.; Pawar, Smita C.; Sudhakar, Yakkanti A.

2013-01-01

Collagen constitutes one of the vital components of the basement membrane scaffolds. Non-collagenous domains (NC1) derived from collagens exhibit potent anti-angiogenic properties, thus attaining significance in regulation of angiogenesis promoted diseases. Individual NC1 domains essential for anti-angiogenic evaluations are generally obtained through purification of individual non-collagenous domains, which have undergone steady developments for enhancing the yields, purpose of biological evaluations and solubility based on the nature of different NC1 domains. This review focuses on the method developments in obtaining biologically active NC1 domains and for specific evaluations in different scenarios. PMID:24215863

Issues in the incorporation of economic perspectives and evidence into Cochrane reviews

PubMed Central

2013-01-01

Background Methods for systematic reviews of the effects of health interventions have focused mainly on addressing the question of 'What works?’ or 'Is this intervention effective in achieving one or more specific outcomes?’ Addressing the question 'Is it worth it given the resources available?’ has received less attention. This latter question can be addressed by applying an economic lens to the systematic review process. This paper reflects on the value and desire for the consideration by end users for coverage of an economic perspective in a Cochrane review and outlines two potential approaches and future directions. Methods Two frameworks to guide review authors who are seeking to include an economic perspective are outlined. The first involves conducting a full systematic review of economic evaluations that is integrated into a review of intervention effects. The second involves developing a brief economic commentary. The two approaches share a set of common stages but allow the tailoring of the economic component of the Cochrane review to the skills and resources available to the review team. Results The number of studies using the methods outlined in the paper is limited, and further examples are needed both to explore the value of these approaches and to further develop them. The rate of progress will hinge on the organisational leadership, capacity and resources available to the CCEMG, author teams and other Cochrane entities. Particular methodological challenges to overcome relate to understanding the key economic trade-offs and casual relationships for a given decision problem and informing the development of evaluations designed to support local decision-makers. Conclusions Methods for incorporating economic perspectives and evidence into Cochrane intervention reviews are established. Their role is not to provide a precise estimate of 'cost-effectiveness’ but rather to help end-users of Cochrane reviews to determine the implications of the economic components of reviews for their own specific decisions. PMID:24050504

Issues in the incorporation of economic perspectives and evidence into Cochrane reviews.

PubMed

Shemilt, Ian; McDaid, David; Marsh, Kevin; Henderson, Catherine; Bertranou, Evelina; Mallander, Jacqueline; Drummond, Mike; Mugford, Miranda; Vale, Luke

2013-09-20

Methods for systematic reviews of the effects of health interventions have focused mainly on addressing the question of 'What works?' or 'Is this intervention effective in achieving one or more specific outcomes?' Addressing the question 'Is it worth it given the resources available?' has received less attention. This latter question can be addressed by applying an economic lens to the systematic review process.This paper reflects on the value and desire for the consideration by end users for coverage of an economic perspective in a Cochrane review and outlines two potential approaches and future directions. Two frameworks to guide review authors who are seeking to include an economic perspective are outlined. The first involves conducting a full systematic review of economic evaluations that is integrated into a review of intervention effects. The second involves developing a brief economic commentary. The two approaches share a set of common stages but allow the tailoring of the economic component of the Cochrane review to the skills and resources available to the review team. The number of studies using the methods outlined in the paper is limited, and further examples are needed both to explore the value of these approaches and to further develop them. The rate of progress will hinge on the organisational leadership, capacity and resources available to the CCEMG, author teams and other Cochrane entities. Particular methodological challenges to overcome relate to understanding the key economic trade-offs and casual relationships for a given decision problem and informing the development of evaluations designed to support local decision-makers. Methods for incorporating economic perspectives and evidence into Cochrane intervention reviews are established. Their role is not to provide a precise estimate of 'cost-effectiveness' but rather to help end-users of Cochrane reviews to determine the implications of the economic components of reviews for their own specific decisions.

The biospeckle method for the investigation of agricultural crops: A review

NASA Astrophysics Data System (ADS)

Zdunek, Artur; Adamiak, Anna; Pieczywek, Piotr M.; Kurenda, Andrzej

2014-01-01

Biospeckle is a nondestructive method for the evaluation of living objects. It has been applied to medicine, agriculture and microbiology for monitoring processes related to the movement of material particles. Recently, this method is extensively used for evaluation of quality of agricultural crops. In the case of botanical materials, the sources of apparent biospeckle activity are the Brownian motions and biological processes such as cyclosis, growth, transport, etc. Several different applications have been shown to monitor aging and maturation of samples, organ development and the detection and development of defects and diseases. This review will focus on three aspects: on the image analysis and mathematical methods for biospeckle activity evaluation, on published applications to botanical samples, with special attention to agricultural crops, and on interpretation of the phenomena from a biological point of view.

Behavioral Bibliotherapy: A Review of Self-Help Behavior Therapy Manuals

ERIC Educational Resources Information Center

Glasgow, Russell E.; Rosen, Gerald M.

1978-01-01

Describes the organizing concepts and strategies for the development and evaluation of self-help behavioral treatment manuals. Reviews programs that have been published or empirically tested for the treatment of phobias, smoking, obesity, sexual dysfunction, assertiveness, child behavior problems, study skills, and physical fitness, as well as…

Nutrition. Learning Activity Package.

ERIC Educational Resources Information Center

Lee, Carolyn

This learning activity package on nutrition is one of a series of 12 titles developed for use in health occupations education programs. Materials in the package include objectives, a list of materials needed, a list of definitions, information sheets, reviews (self evaluations) of portions of the content, and answers to reviews. These topics are…

Shock & Anaphylactic Shock. Learning Activity Package.

ERIC Educational Resources Information Center

Hime, Kirsten

This learning activity package on shock and anaphylactic shock is one of a series of 12 titles developed for use in health occupations education programs. Materials in the package include objectives, a list of materials needed, information sheets, reviews (self evaluations) of portions of the content, and answers to reviews. These topics are…

77 FR 8846 - Notice of Submission for OMB Review

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-15

..., Evaluation and Policy Development Type of Review: New. Title of Collection: 21st Century Community Learning Centers: Lessons Learned Guides. OMB Control Number: Pending. Total Estimated Number of Annual Responses... guides for the 21st Century Community Learning Centers (21st CCLC) program that will assist the U.S...

A Review of Reading Motivation Scales

ERIC Educational Resources Information Center

Davis, Marcia H.; Tonks, Stephen M.; Hock, Michael; Wang, Wenhao; Rodriguez, Aldo

2018-01-01

Reading motivation is a critical contributor to reading achievement and has the potential to influence its development. Educators, researchers, and evaluators need to select the best reading motivation scales for their research and classroom. The goals of this review were to identify a set of reading motivation student self-report scales used in…

Oral Hygiene. Learning Activity Package.

ERIC Educational Resources Information Center

Hime, Kirsten

This learning activity package on oral hygiene is one of a series of 12 titles developed for use in health occupations education programs. Materials in the package include objectives, a list of materials needed, a list of definitions, information sheets, reviews (self evaluations) of portions of the content, and answers to reviews. These topics…

Grooming. Learning Activity Package.

ERIC Educational Resources Information Center

Stark, Pamela

This learning activity package on grooming for health workers is one of a series of 12 titles developed for use in health occupations education programs. Materials in the package include objectives, a list of materials needed, information sheets, reviews (self evaluations) of portions of the content, and answers to reviews. These topics are…

Higher Education and Curriculum Innovation for Sustainable Development in India

ERIC Educational Resources Information Center

Chhokar, Kiran Banga

2010-01-01

Purpose: The purpose of this paper is to analyze and profile significant national developments in higher education for sustainable development in India and to compare different educational approaches emerging in connection with education for sustainable development. Design/methodology/approach: This is an evaluative review of contrasting…

Community Participation in Schools in Developing Countries: Characteristics, Methods and Outcomes

ERIC Educational Resources Information Center

Russell, Kenneth A.

2009-01-01

This study examines how communities participate in schools across diverse contexts in developing countries and the results attributed to community participation. It reviews evaluations of participatory approaches to education in developing countries to answer two basic questions: 1) How do communities participate in school in developing countries?…

Technical and Economic Evaluation of Advanced Air Cargo Systems

NASA Technical Reports Server (NTRS)

Whitehead, A. H., Jr.

1978-01-01

The current air cargo environment and the relevance of advanced technology aircraft in enhancing the efficiency of the 1990 air cargo system are discussed. NASA preliminary design studies are shown to indicate significant potential gains in aircraft efficiency and operational economics for future freighter concepts. Required research and technology elements are outlined to develop a better base for evaluating advanced design concepts. Current studies of the market operation are reviewed which will develop design criteria for a future dedicated cargo transport. Design features desirable in an all-freighter design are reviewed. NASA-sponsored studies of large, distributed-load freighters are reviewed and these designs are compared to current wide-body aircraft. These concepts vary in gross takeoff weight from 0.5 Gg (one million lbs.) to 1.5 Gg (three million lbs.) and are found to exhibit economic advantages over conventional design concepts.

Motivational Interviewing and Medication Review in Coronary Heart Disease (MIMeRiC): Intervention Development and Protocol for the Process Evaluation.

PubMed

Östbring, Malin Johansson; Eriksson, Tommy; Petersson, Göran; Hellström, Lina

2018-01-30

Trials of complex interventions are often criticized for being difficult to interpret because the effects of apparently similar interventions vary across studies dependent on context, targeted groups, and the delivery of the intervention. The Motivational Interviewing and Medication Review in Coronary heart disease (MIMeRiC) trial is a randomized controlled trial (RCT) of an intervention aimed at improving pharmacological secondary prevention. Guidelines for the development and evaluation of complex interventions have recently highlighted the need for better reporting of the development of interventions, including descriptions of how the intervention is assumed to work, how this theory informed the process evaluation, and how the process evaluation relates to the outcome evaluation. This paper aims to describe how the intervention was designed and developed. The aim of the process evaluation is to better understand how and why the intervention in the MIMeRiC trial was effective or not effective. The research questions for evaluating the process are based on the conceptual model of change processes assumed in the intervention and will be analyzed by qualitative and quantitative methods. Quantitative data are used to evaluate the medication review in terms of drug-related problems, to describe how patients' beliefs about medicines are affected by the intervention, and to evaluate the quality of motivational interviewing. Qualitative data will be used to analyze whether patients experienced the intervention as intended, how cardiologists experienced the collaboration and intervention, and how the intervention affected patients' overall experience of care after coronary heart disease. The development and piloting of the intervention are described in relation to the theoretical framework. Data for the process evaluation will be collected until March 2018. Some process evaluation questions will be analyzed before, and others will be analyzed after the outcomes of the MIMeRiC RCT are known. This paper describes the framework for the design of the intervention tested in the MIMeRiC trial, development of the intervention from the pilot stage to the complete trial intervention, and the framework and methods for the process evaluation. Providing the protocol of the process evaluation allows prespecification of the processes that will be evaluated, because we hypothesize that they will determine the outcomes of the MIMeRiC trial. This protocol also constitutes a contribution to the new field of process evaluations as made explicit in health services research and clinical trials of complex interventions. ©Malin Johansson Östbring, Tommy Eriksson, Göran Petersson, Lina Hellström. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 30.01.2018.

Evaluation of carbon nanotubes and graphene as reinforcements for UHMWPE-based composites in arthroplastic applications: A review.

PubMed

Puértolas, J A; Kurtz, S M

2014-11-01

In this review we have evaluated the state of the art of CNT/UHMWPE and graphene/UHMWPE composites from four different points of view: mechanical properties, chemical stability, wear resistance and biocompatibility. The performance of these new carbonaceous composites allows us to conclude that these materials have overcome a first step on the way to developing into an alternative to the current HXLPEs used in orthopedic applications. Copyright © 2014 Elsevier Ltd. All rights reserved.

Materials technology for Stirling space power converters

NASA Technical Reports Server (NTRS)

Baggenstoss, William; Mittendorf, Donald

1992-01-01

This program was conducted in support of the NASA LeRC development of the Stirling power converter (SPC) for space power applications. The objectives of this contract were: (1) to perform a technology review and analyses to support the evaluation of materials issues for the SPC; (2) to evaluate liquid metal compatibility issues of the SPC; (3) to evaluate and define a transient liquid phase diffusion bonding (TLPDB) process for the SPC joints to the Udimet 720 heater head; and (4) to evaluate alternative (to the TLPDB) joining techniques. In the technology review, several aspects of the current Stirling design were examined including the power converter assembly process, materials joining, gas bearings, and heat exchangers. The supporting analyses included GLIMPS power converter simulation in support of the materials studies, and system level analysis in support of the technology review. The liquid metal compatibility study evaluated process parameters for use in the Stirling power converter. The alternative joining techniques study looked at the applicability of various joining techniques to the Stirling power converter requirements.

Review of evaluation on ecological carrying capacity: The progress and trend of methodology

NASA Astrophysics Data System (ADS)

Wang, S. F.; Xu, Y.; Liu, T. J.; Ye, J. M.; Pan, B. L.; Chu, C.; Peng, Z. L.

2018-02-01

The ecological carrying capacity (ECC) has been regarded as an important reference to indicate the level of regional sustainable development since the very beginning of twenty-first century. By a brief review of the main progress in ECC evaluation methodologies in recent five years, this paper systematically discusses the features and differences of these methods and expounds the current states and future development trend of ECC methodology. The result shows that further exploration in terms of the dynamic, comprehensive and intelligent assessment technologies needs to be provided in order to form a unified and scientific ECC methodology system and to produce a reliable basis for environmental-economic decision-makings.

Evaluation of potential surface rupture and review of current seismic hazards program at the Los Alamos National Laboratory. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-12-09

This report summarizes the authors review and evaluation of the existing seismic hazards program at Los Alamos National Laboratory (LANL). The report recommends that the original program be augmented with a probabilistic analysis of seismic hazards involving assignment of weighted probabilities of occurrence to all potential sources. This approach yields a more realistic evaluation of the likelihood of large earthquake occurrence particularly in regions where seismic sources may have recurrent intervals of several thousand years or more. The report reviews the locations and geomorphic expressions of identified fault lines along with the known displacements of these faults and last knowmore » occurrence of seismic activity. Faults are mapped and categorized into by their potential for actual movement. Based on geologic site characterization, recommendations are made for increased seismic monitoring; age-dating studies of faults and geomorphic features; increased use of remote sensing and aerial photography for surface mapping of faults; the development of a landslide susceptibility map; and to develop seismic design standards for all existing and proposed facilities at LANL.« less

The economics of medicines optimization: policy developments, remaining challenges and research priorities

PubMed Central

Faria, Rita; Barbieri, Marco; Light, Kate; Elliott, Rachel A.; Sculpher, Mark

2014-01-01

Background This review scopes the evidence on the effectiveness and cost-effectiveness of interventions to improve suboptimal use of medicines in order to determine the evidence gaps and help inform research priorities. Sources of data Systematic searches of the National Health Service (NHS) Economic Evaluation Database, the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. Areas of agreement The majority of the studies evaluated interventions to improve adherence, inappropriate prescribing and prescribing errors. Areas of controversy Interventions tend to be specific to a particular stage of the pathway and/or to a particular disease and have mostly been evaluated for their effect on intermediate or process outcomes. Growing points Medicines optimization offers an opportunity to improve health outcomes and efficiency of healthcare. Areas timely for developing research The available evidence is insufficient to assess the effectiveness and cost-effectiveness of interventions to address suboptimal medicine use in the UK NHS. Decision modelling, evidence synthesis and elicitation have the potential to address the evidence gaps and help prioritize research. PMID:25190760

Testing and Evaluation of Passive Radiation Detection Equipment for Homeland Security

DOE PAGES

West, David L.; Wood, Nathan L.; Forrester, Christina D.

2017-12-01

This article is concerned with test and evaluation methods for passive radiation detection equipment used in homeland security applications. The different types of equipment used in these applications are briefly reviewed and then test and evaluation methods discussed. The primary emphasis is on the test and evaluation standards developed by the American National Standards Institute’s N42 committees. Commonalities among the standards are then reviewed as well as examples of unique aspects for specific equipment types. Throughout, sample test configurations and results from testing and evaluation at Oak Ridge National Laboratory are given. The article concludes with a brief discussion ofmore » typical tests and evaluations not covered by the N42 standards and some examples of test and evaluation that involve the end users of the equipment.« less

Testing and Evaluation of Passive Radiation Detection Equipment for Homeland Security

DOE Office of Scientific and Technical Information (OSTI.GOV)

West, David L.; Wood, Nathan L.; Forrester, Christina D.

This article is concerned with test and evaluation methods for passive radiation detection equipment used in homeland security applications. The different types of equipment used in these applications are briefly reviewed and then test and evaluation methods discussed. The primary emphasis is on the test and evaluation standards developed by the American National Standards Institute’s N42 committees. Commonalities among the standards are then reviewed as well as examples of unique aspects for specific equipment types. Throughout, sample test configurations and results from testing and evaluation at Oak Ridge National Laboratory are given. The article concludes with a brief discussion ofmore » typical tests and evaluations not covered by the N42 standards and some examples of test and evaluation that involve the end users of the equipment.« less

SU-E-J-275: Review - Computerized PET/CT Image Analysis in the Evaluation of Tumor Response to Therapy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lu, W; Wang, J; Zhang, H

Purpose: To review the literature in using computerized PET/CT image analysis for the evaluation of tumor response to therapy. Methods: We reviewed and summarized more than 100 papers that used computerized image analysis techniques for the evaluation of tumor response with PET/CT. This review mainly covered four aspects: image registration, tumor segmentation, image feature extraction, and response evaluation. Results: Although rigid image registration is straightforward, it has been shown to achieve good alignment between baseline and evaluation scans. Deformable image registration has been shown to improve the alignment when complex deformable distortions occur due to tumor shrinkage, weight loss ormore » gain, and motion. Many semi-automatic tumor segmentation methods have been developed on PET. A comparative study revealed benefits of high levels of user interaction with simultaneous visualization of CT images and PET gradients. On CT, semi-automatic methods have been developed for only tumors that show marked difference in CT attenuation between the tumor and the surrounding normal tissues. Quite a few multi-modality segmentation methods have been shown to improve accuracy compared to single-modality algorithms. Advanced PET image features considering spatial information, such as tumor volume, tumor shape, total glycolytic volume, histogram distance, and texture features have been found more informative than the traditional SUVmax for the prediction of tumor response. Advanced CT features, including volumetric, attenuation, morphologic, structure, and texture descriptors, have also been found advantage over the traditional RECIST and WHO criteria in certain tumor types. Predictive models based on machine learning technique have been constructed for correlating selected image features to response. These models showed improved performance compared to current methods using cutoff value of a single measurement for tumor response. Conclusion: This review showed that computerized PET/CT image analysis holds great potential to improve the accuracy in evaluation of tumor response. This work was supported in part by the National Cancer Institute Grant R01CA172638.« less

Successful chronic disease care for Aboriginal Australians requires cultural competence.

PubMed

Liaw, Siaw Teng; Lau, Phyllis; Pyett, Priscilla; Furler, John; Burchill, Marlene; Rowley, Kevin; Kelaher, Margaret

2011-06-01

To review the literature to determine the attributes of culturally appropriate healthcare to inform the design of chronic disease management (CDM) models for Aboriginal patients in urban general practice. A comprehensive conceptual framework, drawing on the Access to Care, Pathway to Care, Chronic Care, Level of Connectedness, and Cultural Security, Cultural Competency and Cultural Respect models, was developed to define the search strategy, inclusion criteria and appraisal methods for the literature review. Selected papers were reviewed in detail if they examined a chronic disease intervention for an Aboriginal population and reported on its evaluation, impacts or outcomes. In the 173 papers examined, only 11 programs met the inclusion criteria. All were programs conducted in rural and remote Aboriginal community-controlled health services. Successful chronic disease care and interventions require adequate Aboriginal community engagement, utilising local knowledge, strong leadership, shared responsibilities, sustainable resources and integrated data and systems. These success factors fitted within the conceptual framework developed. Research and development of culturally appropriate CDM models concurrently in both urban and rural settings will enable more rigorous evaluation, leading to stronger evidence for best practice. A partnership of mainstream and Aboriginal-controlled health services is essential to successfully 'close the gap'. Findings will inform and guide the development, implementation and evaluation of culturally appropriate CDM in mainstream general practice and primary care. © 2011 The Authors. ANZJPH © 2011 Public Health Association of Australia.

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review.

PubMed

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F; Moher, David

2014-06-25

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Systematic review. Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score. 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Not registered; no known register currently accepts protocols for methodology systematic reviews. © Stevens et al 2014.

KC-135 Winglet Program Review

NASA Technical Reports Server (NTRS)

1982-01-01

The results of a joint NASA/USAF program to develop flight test winglets on a KC-135 aircraft are reviewed. The winglet development from concept through wind tunnel and flight tests is discussed. Predicted, wind tunnel, and flight test results are compared for the performance, loads and flutter characteristics of the winglets. The flight test winglets had a variable winglet cant and incidence angle capability which enabled a limited evaluation of the effects of these geometry changes.

Evaluating markers for the early detection of cancer: overview of study designs and methods.

PubMed

Baker, Stuart G; Kramer, Barnett S; McIntosh, Martin; Patterson, Blossom H; Shyr, Yu; Skates, Steven

2006-01-01

The field of cancer biomarker development has been evolving rapidly. New developments both in the biologic and statistical realms are providing increasing opportunities for evaluation of markers for both early detection and diagnosis of cancer. To review the major conceptual and methodological issues in cancer biomarker evaluation, with an emphasis on recent developments in statistical methods together with practical recommendations. We organized this review by type of study: preliminary performance, retrospective performance, prospective performance and cancer screening evaluation. For each type of study, we discuss methodologic issues, provide examples and discuss strengths and limitations. Preliminary performance studies are useful for quickly winnowing down the number of candidate markers; however their results may not apply to the ultimate target population, asymptomatic subjects. If stored specimens from cohort studies with clinical cancer endpoints are available, retrospective studies provide a quick and valid way to evaluate performance of the markers or changes in the markers prior to the onset of clinical symptoms. Prospective studies have a restricted role because they require large sample sizes, and, if the endpoint is cancer on biopsy, there may be bias due to overdiagnosis. Cancer screening studies require very large sample sizes and long follow-up, but are necessary for evaluating the marker as a trigger of early intervention.

Applications of hyperspectral imaging in chicken meat safety and quality detection and evaluation: a review.

PubMed

Xiong, Zhenjie; Xie, Anguo; Sun, Da-Wen; Zeng, Xin-An; Liu, Dan

2015-01-01

Currently, the issue of food safety and quality is a great public concern. In order to satisfy the demands of consumers and obtain superior food qualities, non-destructive and fast methods are required for quality evaluation. As one of these methods, hyperspectral imaging (HSI) technique has emerged as a smart and promising analytical tool for quality evaluation purposes and has attracted much interest in non-destructive analysis of different food products. With the main advantage of combining both spectroscopy technique and imaging technique, HSI technique shows a convinced attitude to detect and evaluate chicken meat quality objectively. Moreover, developing a quality evaluation system based on HSI technology would bring economic benefits to the chicken meat industry. Therefore, in recent years, many studies have been conducted on using HSI technology for the safety and quality detection and evaluation of chicken meat. The aim of this review is thus to give a detailed overview about HSI and focus on the recently developed methods exerted in HSI technology developed for microbiological spoilage detection and quality classification of chicken meat. Moreover, the usefulness of HSI technique for detecting fecal contamination and bone fragments of chicken carcasses are presented. Finally, some viewpoints on its future research and applicability in the modern poultry industry are proposed.

Systematic review of economic analyses in patient safety: a protocol designed to measure development in the scope and quality of evidence

PubMed Central

Carter, Alexander W; Mandavia, Rishi; Mayer, Erik; Marti, Joachim; Mossialos, Elias; Darzi, Ara

2017-01-01

Introduction Recent avoidable failures in patient care highlight the ongoing need for evidence to support improvements in patient safety. According to the most recent reviews, there is a dearth of economic evidence related to patient safety. These reviews characterise an evidence gap in terms of the scope and quality of evidence available to support resource allocation decisions. This protocol is designed to update and improve on the reviews previously conducted to determine the extent of methodological progress in economic analyses in patient safety. Methods and analysis A broad search strategy with two core themes for original research (excluding opinion pieces and systematic reviews) in ‘patient safety’ and ‘economic analyses’ has been developed. Medline, Econlit and National Health Service Economic Evaluation Database bibliographic databases will be searched from January 2007 using a combination of medical subject headings terms and research-derived search terms (see table 1). The method is informed by previous reviews on this topic, published in 2012. Screening, risk of bias assessment (using the Cochrane collaboration tool) and economic evaluation quality assessment (using the Drummond checklist) will be conducted by two independent reviewers, with arbitration by a third reviewer as needed. Studies with a low risk of bias will be assessed using the Drummond checklist. High-quality economic evaluations are those that score >20/35. A qualitative synthesis of evidence will be performed using a data collection tool to capture the study design(s) employed, population(s), setting(s), disease area(s), intervention(s) and outcome(s) studied. Methodological quality scores will be compared with previous reviews where possible. Effect size(s) and estimate uncertainty will be captured and used in a quantitative synthesis of high-quality evidence, where possible. Ethics and dissemination Formal ethical approval is not required as primary data will not be collected. The results will be disseminated through a peer-reviewed publication, presentations and social media. Trial registration number CRD42017057853. PMID:28821527

Cervical spondylotic myelopathy: methodological approaches to evaluate the literature and establish best evidence.

PubMed

Skelly, Andrea C; Hashimoto, Robin E; Norvell, Daniel C; Dettori, Joseph R; Fischer, Dena J; Wilson, Jefferson R; Tetreault, Lindsay A; Fehlings, Michael G

2013-10-15

Review of methods. To provide a detailed description of the methods undertaken in the articles in this focus issue pertaining to cervical spondylotic myelopathy (CSM) and ossification of the posterior longitudinal ligament (OPLL) and to describe the process used to develop summary statements and clinical recommendations regarding factors associated with the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. We present methods used in conducting the systematic, evidence-based reviews and development of expert panel summary statements and clinical recommendations of the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Our intent is that clinicians will combine the information from these systematic reviews, narrative reviews, and primary research studies with an understanding of their own capacities and experience to better manage patients with CSM or OPLL and consider future research for the diagnosis and treatment of these diseases. For the systematic reviews, which make up the bulk of the studies in this focus issue, a systematic search and critical review of the English language literature was undertaken for articles published on the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Articles were screened for relevance using a priori criteria and relevant articles were critically reviewed. Whether an article was included for review depended on whether the study question was descriptive, one of therapy, or one of prognosis. The strength of evidence for the overall body of literature in each topic area was determined by 2 independent reviewers considering risk of bias, consistency, directness, and precision of results using a modification of the Grading of Recommendation Assessment, Development and Evaluation criteria. Disagreements were resolved by consensus. Findings from articles meeting inclusion criteria were summarized. From these summaries, summary statements or clinical recommendations were formulated among subject experts through a modified Delphi process using the Grading of Recommendation Assessment, Development and Evaluation approach. Methods for the 2 primary research studies and the narrative reviews are also reviewed. Because of the nature of questions that needed to be addressed, not all studies in this focus issue were amenable to systematic review. As a result, this focus issue consists of several different article types, including 1 research protocol, 2 primary research studies, 2 narrative literature reviews, 7 systematic reviews, and 3 articles that combine a systematic review component with either a narrative section (n = 2) or a provider survey (n = 1). In general, the strength of evidence ratings ranged from insufficient to moderate. Summary statements or clinical recommendations were made according to available evidence and study type: 16 summary statements were made across 8 articles, and 17 clinical recommendations were made across 9 articles. Three articles had both summary statements and clinical recommendations, 5 had summary statements only, 6 had clinical recommendations only, and 1 (the research protocol) was not amenable to either. Systematic reviews, narrative reviews, and primary research studies were undertaken to understand the mechanisms, diagnosis, progression, and treatment of CSM and OPLL and to provide summary statements and clinical recommendations. This article reports the methods used in the studies in this focus issue. SUMMARY STATEMENTS: The objectives of this focus issue were met using a variety of article and study designs, each of which has some unique methodological aspects associated with it. The reader should refer to the full article in this issue for additional details specific to that topic. The methods for systematic review follow accepted standards for rigor and, together with the application of Grading of Recommendation Assessment, Development and Evaluation, are intended to allow for transparency in the process for creating the clinical recommendation.

E-tongue: a tool for taste evaluation.

PubMed

Gupta, Himanshu; Sharma, Aarti; Kumar, Suresh; Roy, Saroj K

2010-01-01

Taste has an important role in the development of oral pharmaceuticals. With respect to patient acceptability and compliance, taste is one of the prime factors determining the market penetration and commercial success of oral formulations, especially in pediatric medicine. Taste assessment is one important quality-control parameter for evaluating taste-masked formulations. Hence, pharmaceutical industries invest time, money and resources into developing palatable and pleasant-tasting products. The primary method for the taste measurement of a drug substance or a formulation is by human sensory evaluation, in which tasting a sample is relayed to inspectors. However, this method is impractical for early stage drug development because the test in humans is expensive and the taste of a drug candidate may not be important to the final product. Therefore, taste-sensing analytical devices, which can detect tastes, have been replacing the taste panelists. In the present review we are presenting different aspect of electronic tongue. The review article also discussed some useful patents and instrument with respect to E-tongue.

Monitoring product safety in the postmarketing environment.

PubMed

Sharrar, Robert G; Dieck, Gretchen S

2013-10-01

The safety profile of a medicinal product may change in the postmarketing environment. Safety issues not identified in clinical development may be seen and need to be evaluated. Methods of evaluating spontaneous adverse experience reports and identifying new safety risks include a review of individual reports, a review of a frequency distribution of a list of the adverse experiences, the development and analysis of a case series, and various ways of examining the database for signals of disproportionality, which may suggest a possible association. Regulatory agencies monitor product safety through a variety of mechanisms including signal detection of the adverse experience safety reports in databases and by requiring and monitoring risk management plans, periodic safety update reports and postauthorization safety studies. The United States Food and Drug Administration is working with public, academic and private entities to develop methods for using large electronic databases to actively monitor product safety. Important identified risks will have to be evaluated through observational studies and registries.

Waste-to-energy: A review of life cycle assessment and its extension methods.

PubMed

Zhou, Zhaozhi; Tang, Yuanjun; Chi, Yong; Ni, Mingjiang; Buekens, Alfons

2018-01-01

This article proposes a comprehensive review of evaluation tools based on life cycle thinking, as applied to waste-to-energy. Habitually, life cycle assessment is adopted to assess environmental burdens associated with waste-to-energy initiatives. Based on this framework, several extension methods have been developed to focus on specific aspects: Exergetic life cycle assessment for reducing resource depletion, life cycle costing for evaluating its economic burden, and social life cycle assessment for recording its social impacts. Additionally, the environment-energy-economy model integrates both life cycle assessment and life cycle costing methods and judges simultaneously these three features for sustainable waste-to-energy conversion. Life cycle assessment is sufficiently developed on waste-to-energy with concrete data inventory and sensitivity analysis, although the data and model uncertainty are unavoidable. Compared with life cycle assessment, only a few evaluations are conducted to waste-to-energy techniques by using extension methods and its methodology and application need to be further developed. Finally, this article succinctly summarises some recommendations for further research.

Modeling of ETL-Processes and Processed Information in Clinical Data Warehousing.

PubMed

Tute, Erik; Steiner, Jochen

2018-01-01

Literature describes a big potential for reuse of clinical patient data. A clinical data warehouse (CDWH) is a means for that. To support management and maintenance of processes extracting, transforming and loading (ETL) data into CDWHs as well as to ease reuse of metadata between regular IT-management, CDWH and secondary data users by providing a modeling approach. Expert survey and literature review to find requirements and existing modeling techniques. An ETL-modeling-technique was developed extending existing modeling techniques. Evaluation by exemplarily modeling existing ETL-process and a second expert survey. Nine experts participated in the first survey. Literature review yielded 15 included publications. Six existing modeling techniques were identified. A modeling technique extending 3LGM² and combining it with openEHR information models was developed and evaluated. Seven experts participated in the evaluation. The developed approach can help in management and maintenance of ETL-processes and could serve as interface between regular IT-management, CDWH and secondary data users.

Models, measurement, and strategies in developing critical-thinking skills.

PubMed

Brunt, Barbara A

2005-01-01

Health care professionals must use critical-thinking skills to solve increasingly complex problems. Educators need to help nurses develop their critical-thinking skills to maintain and enhance their competence. This article reviews various models of critical thinking, as well as methods used to evaluate critical thinking. Specific educational strategies to develop nurses' critical-thinking skills are discussed. Additional research studies are needed to determine how the process of nursing practice can nurture and develop critical-thinking skills, and which strategies are most effective in developing and evaluating critical thinking.

Quality Assessment of Clinical Practice Guidelines for Respiratory Diseases in China: A Systematic Appraisal.

PubMed

Jiang, Mei; Liao, Li-Yue; Liu, Xiao-Qing; He, Wei-Qun; Guan, Wei-Jie; Chen, Hao; Li, Yi-Min

2015-09-01

There has been a significant increase in the publication of clinical practice guidelines (CPGs) for respiratory diseases in China. However, little is known about the quality and potential impacts of these CPGs. Our objective was to critically evaluate the quality of Chinese CPGs for respiratory diseases that were published in peer-reviewed medical journals. A systematic search of scientific literature published between 1979 and 2013 was undertaken to identify and select CPGs that were related to respiratory diseases. Four Chinese databases (the Chinese Biomedical Literature database [CBM], the China National Knowledge Infrastructure [CNKI], the VIP database, and the WANFANG database) were used. The quality of eligible guidelines was assessed independently by four reviewers using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The overall agreement among reviewers was evaluated using an intraclass correlation coefficient. A total of 109 guidelines published in 27 medical journals from 1979 to 2013 were evaluated. The overall agreement among reviewers was considered good (intraclass correlation coefficient, 0.838; 95% CI, 0.812-0.862). The scores of the six AGREE domains were low: 57.3% for scope and purpose (range, 4.2%-80.5%), 23.8% for stakeholder involvement (range, 2.8%-54.2%), 7.7% for rigor of development (range, 0%-27.1%), 59.8% for clarity and presentation (range, 22.2%-80.6%), 10.9% for applicability (range, 0%-22.9%), and 0.6% for editorial independence (range, 0%-16.7%). Scores for all guidelines were below 60%, and only three guidelines (2.8%) were recommended for clinical practice with modifications. The quality of the guidelines was low, and stakeholder involvement, rigor of development, applicability, and editorial independence should be considered in the future development of CPGs for respiratory diseases in China.

24 CFR 597.401 - Periodic performance reviews.

Code of Federal Regulations, 2013 CFR

2013-04-01

... HOUSING AND URBAN DEVELOPMENT COMMUNITY FACILITIES URBAN EMPOWERMENT ZONES AND ENTERPRISE COMMUNITIES... regularly evaluate the progress of the strategic plan in each designated Empowerment Zone and Enterprise... will also commission evaluations of the Empowerment Zone program as a whole by an impartial third party...

24 CFR 597.401 - Periodic performance reviews.

Code of Federal Regulations, 2012 CFR

2012-04-01

... HOUSING AND URBAN DEVELOPMENT COMMUNITY FACILITIES URBAN EMPOWERMENT ZONES AND ENTERPRISE COMMUNITIES... regularly evaluate the progress of the strategic plan in each designated Empowerment Zone and Enterprise... will also commission evaluations of the Empowerment Zone program as a whole by an impartial third party...

24 CFR 597.401 - Periodic performance reviews.

Code of Federal Regulations, 2014 CFR

2014-04-01

... HOUSING AND URBAN DEVELOPMENT COMMUNITY FACILITIES URBAN EMPOWERMENT ZONES AND ENTERPRISE COMMUNITIES... regularly evaluate the progress of the strategic plan in each designated Empowerment Zone and Enterprise... will also commission evaluations of the Empowerment Zone program as a whole by an impartial third party...

Curriculum Development and Evaluation in the Arts.

ERIC Educational Resources Information Center

Day, Michael D.

1980-01-01

In this paper some of the distinctive qualities of the arts are reviewed and implications for curriculum and evaluation are discussed. For this discussion the visual arts serve as the exemplar from the several arts for discussion of subject content, learning, and assessment. (Author)

24 CFR 597.401 - Periodic performance reviews.

Code of Federal Regulations, 2010 CFR

2010-04-01

... HOUSING AND URBAN DEVELOPMENT COMMUNITY FACILITIES URBAN EMPOWERMENT ZONES AND ENTERPRISE COMMUNITIES... regularly evaluate the progress of the strategic plan in each designated Empowerment Zone and Enterprise... will also commission evaluations of the Empowerment Zone program as a whole by an impartial third party...

Development and validation of an algorithm for laser application in wound treatment 1

PubMed Central

da Cunha, Diequison Rite; Salomé, Geraldo Magela; Massahud, Marcelo Renato; Mendes, Bruno; Ferreira, Lydia Masako

2017-01-01

ABSTRACT Objective: To develop and validate an algorithm for laser wound therapy. Method: Methodological study and literature review. For the development of the algorithm, a review was performed in the Health Sciences databases of the past ten years. The algorithm evaluation was performed by 24 participants, nurses, physiotherapists, and physicians. For data analysis, the Cronbach’s alpha coefficient and the chi-square test for independence was used. The level of significance of the statistical test was established at 5% (p<0.05). Results: The professionals’ responses regarding the facility to read the algorithm indicated: 41.70%, great; 41.70%, good; 16.70%, regular. With regard the algorithm being sufficient for supporting decisions related to wound evaluation and wound cleaning, 87.5% said yes to both questions. Regarding the participants’ opinion that the algorithm contained enough information to support their decision regarding the choice of laser parameters, 91.7% said yes. The questionnaire presented reliability using the Cronbach’s alpha coefficient test (α = 0.962). Conclusion: The developed and validated algorithm showed reliability for evaluation, wound cleaning, and use of laser therapy in wounds. PMID:29211197

A review of micro-powder injection moulding as a microfabrication technique

NASA Astrophysics Data System (ADS)

Attia, Usama M.; Alcock, Jeffrey R.

2011-04-01

Micro-powder injection moulding (µPIM) is a fast-developing micro-manufacturing technique for the production of metal and ceramic components. Shape complexity, dimensional accuracy, replication fidelity, material variety combined with high-volume capabilities are some of the key advantages of the technology. This review assesses the capabilities and limitations of µPIM as a micro-manufacturing technique by reviewing the latest developments in the area and by considering potential improvements. The basic elements of the process chain, variant processes and simulation attempts are discussed and evaluated. Challenges and research gaps are highlighted, and potential areas for improvement are presented.

Fiber optic hydrogen sensors: a review

NASA Astrophysics Data System (ADS)

Yang, Minghong; Dai, Jixiang

2014-12-01

Hydrogen is one of the next generation energies in the future, which shows promising applications in aerospace and chemical industries. Hydrogen leakage monitoring is very dangerous and important because of its low ignition energy, high combustion efficiency, and smallest molecule. This paper reviews the state-of-art development of the fiber optic hydrogen sensing technology. The main developing trends of fiber optic hydrogen sensors are based on two kinds of hydrogen sensitive materials, i.e. palladium-alloy thin films and Pt-doped WO3 coatings. In this review work, the advantages and disadvantages of these two kinds of sensing technologies will be evaluated.

ACR Appropriateness Criteria® Chronic Extremity Joint Pain-Suspected Inflammatory Arthritis.

PubMed

Jacobson, Jon A; Roberts, Catherine C; Bencardino, Jenny T; Appel, Marc; Arnold, Erin; Baccei, Steven J; Cassidy, R Carter; Chang, Eric Y; Fox, Michael G; Greenspan, Bennett S; Gyftopoulos, Soterios; Hochman, Mary G; Mintz, Douglas N; Newman, Joel S; Rosenberg, Zehava S; Shah, Nehal A; Small, Kirstin M; Weissman, Barbara N

2017-05-01

Evaluation for suspected inflammatory arthritis as a cause for chronic extremity joint pain often relies on imaging. This review first discusses the characteristic osseous and soft tissue abnormalities seen with inflammatory arthritis and how they may be imaged. It is essential that imaging results are interpreted in the context of clinical and serologic results to add specificity as there is significant overlap of imaging findings among the various types of arthritis. This review provides recommendations for imaging evaluation of specific types of inflammatory arthritis, including rheumatoid arthritis, seronegative spondyloarthropathy, gout, calcium pyrophosphate dihydrate disease (or pseudogout), and erosive osteoarthritis. The American College of Radiology Appropriateness Criteria are evidence-based guidelines for specific clinical conditions that are reviewed annually by a multidisciplinary expert panel. The guideline development and revision include an extensive analysis of current medical literature from peer-reviewed journals and the application of well-established methodologies (RAND/UCLA Appropriateness Method and Grading of Recommendations Assessment, Development, and Evaluation or GRADE) to rate the appropriateness of imaging and treatment procedures for specific clinical scenarios. In those instances where evidence is lacking or equivocal, expert opinion may supplement the available evidence to recommend imaging or treatment. Copyright © 2017 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Review of early assessment models of innovative medical technologies.

PubMed

Fasterholdt, Iben; Krahn, Murray; Kidholm, Kristian; Yderstræde, Knud Bonnet; Pedersen, Kjeld Møller

2017-08-01

Hospitals increasingly make decisions regarding the early development of and investment in technologies, but a formal evaluation model for assisting hospitals early on in assessing the potential of innovative medical technologies is lacking. This article provides an overview of models for early assessment in different health organisations and discusses which models hold most promise for hospital decision makers. A scoping review of published studies between 1996 and 2015 was performed using nine databases. The following information was collected: decision context, decision problem, and a description of the early assessment model. 2362 articles were identified and 12 studies fulfilled the inclusion criteria. An additional 12 studies were identified and included in the review by searching reference lists. The majority of the 24 early assessment studies were variants of traditional cost-effectiveness analysis. Around one fourth of the studies presented an evaluation model with a broader focus than cost-effectiveness. Uncertainty was mostly handled by simple sensitivity or scenario analysis. This review shows that evaluation models using known methods assessing cost-effectiveness are most prevalent in early assessment, but seems ill-suited for early assessment in hospitals. Four models provided some usable elements for the development of a hospital-based model. Crown Copyright © 2017. Published by Elsevier B.V. All rights reserved.

Canadian Guidelines for Controlled Pediatric Donation After Circulatory Determination of Death-Summary Report.

PubMed

Weiss, Matthew J; Hornby, Laura; Rochwerg, Bram; van Manen, Michael; Dhanani, Sonny; Sivarajan, V Ben; Appleby, Amber; Bennett, Mary; Buchman, Daniel; Farrell, Catherine; Goldberg, Aviva; Greenberg, Rebecca; Singh, Ram; Nakagawa, Thomas A; Witteman, William; Barter, Jill; Beck, Allon; Coughlin, Kevin; Conradi, Alf; Cupido, Cynthia; Dawson, Rosanne; Dipchand, Anne; Freed, Darren; Hornby, Karen; Langlois, Valerie; Mack, Cheryl; Mahoney, Meagan; Manhas, Deepak; Tomlinson, Christopher; Zavalkoff, Samara; Shemie, Sam D

2017-11-01

Create trustworthy, rigorous, national clinical practice guidelines for the practice of pediatric donation after circulatory determination of death in Canada. We followed a process of clinical practice guideline development based on World Health Organization and Canadian Medical Association methods. This included application of Grading of Recommendations Assessment, Development, and Evaluation methodology. Questions requiring recommendations were generated based on 1) 2006 Canadian donation after circulatory determination of death guidelines (not pediatric specific), 2) a multidisciplinary symposium of national and international pediatric donation after circulatory determination of death leaders, and 3) a scoping review of the pediatric donation after circulatory determination of death literature. Input from these sources drove drafting of actionable questions and Good Practice Statements, as defined by the Grading of Recommendations Assessment, Development, and Evaluation group. We performed additional literature reviews for all actionable questions. Evidence was assessed for quality using Grading of Recommendations Assessment, Development, and Evaluation and then formulated into evidence profiles that informed recommendations through the evidence-to-decision framework. Recommendations were revised through consensus among members of seven topic-specific working groups and finalized during meetings of working group leads and the planning committee. External review was provided by pediatric, critical care, and critical care nursing professional societies and patient partners. We generated 63 Good Practice Statements and seven Grading of Recommendations Assessment, Development, and Evaluation recommendations covering 1) ethics, consent, and withdrawal of life-sustaining therapy, 2) eligibility, 3) withdrawal of life-sustaining therapy practices, 4) ante and postmortem interventions, 5) death determination, 6) neonatal pediatric donation after circulatory determination of death, 7) cardiac and innovative pediatric donation after circulatory determination of death, and 8) implementation. For brevity, 48 Good Practice Statement and truncated justification are included in this summary report. The remaining recommendations, detailed methodology, full Grading of Recommendations Assessment, Development, and Evaluation tables, and expanded justifications are available in the full text report. This process showed that rigorous, transparent clinical practice guideline development is possible in the domain of pediatric deceased donation. Application of these recommendations will increase access to pediatric donation after circulatory determination of death across Canada and may serve as a model for future clinical practice guideline development in deceased donation.

Developing mathematics edutainment media for Android based on students’ understanding and interest: a teachers’ review

NASA Astrophysics Data System (ADS)

Setyaningrum, W.; Waryanto, N. H.

2018-03-01

This paper aimed to describe the development of interactive edutainment mathematics media using Construct 2 software for grade 7 Junior High School, and to determine the quality of the interactive edutainment media developed in regards to improve students’ understanding and interest. This research employs Research and Development design, which media was developed using ADDIE model consisting of analysing, designing, developing, implementing and evaluating. This paper focuses on the steps of development and validity of the interactive media from teachers’ point of view. The teachers review focuses on three aspects – instructional, audio-visual and operational design. The review suggested that the media was very good in regard to the three aspects, with the average score was 144.55 from the maximum score of 175. Several contexts used in the game, however, need to be adjusted to students age.

Structured implicit review: a new method for monitoring nursing care quality.

PubMed

Pearson, M L; Lee, J L; Chang, B L; Elliott, M; Kahn, K L; Rubenstein, L V

2000-11-01

Nurses' independent decisions about assessment, treatment, and nursing interventions for hospitalized patients are important determinants of quality of care. Physician peer implicit review of medical records has been central to Medicare quality management and is considered the gold standard for reviewing physician care, but peer implicit review of nursing processes of care has not received similar attention. The objective of this study was to develop and evaluate nurse structured implicit review (SIR) methods. We developed SIR instruments for rating the quality of inpatient nursing care for congestive heart failure (CHF) and cerebrovascular accident (CVA). Nurse reviewers used the SIR form to rate a nationally representative sample of randomly selected medical records for each disease from 297 acute care hospitals in 5 states (collected by the RAND-HCFA Prospective Payment System study). The study subjects were elderly Medicare inpatients with CHF (n = 291) or CVA (n = 283). We developed and tested scales reflecting domains of nursing process, evaluated interrater and interitem reliability, and assessed the extent to which items and scales predicted overall ratings of the quality of nursing care. Interrater reliability for 14 of 16 scales (CHF) or 10 of 16 scales (CVA) was > or = 0.40. Interitem reliability was > 0.80 for all but 1 scale (both diseases). Functional Assessment, Physical Assessment, and Medication Tracking ratings were the strongest predictors of overall nursing quality ratings (P < 0.001 for each). Nurse peer review with SIR has adequate interrater and excellent scale reliabilities and can be a valuable tool for assessing nurse performance.

Development and Evaluation of a Success Index for Professionals in Postgraduate Training Programs

DTIC Science & Technology

1993-02-26

15 Predicting Success among Program Participants .... ......... .. 16 AEGD Success and Career Success .......... ................ .. 16...10), and general career success (8). Hough applied the principle of behavioral consistency and aspects of the biographical inventory to develop and...the opportunity to evaluate how measures of success in AEGD translate into career success . The 90 AERs were reviewed by two experienced senior dental

Evaluation of the Healthy School Meals Initiative in Texas Private Schools and Residential Child Care Institutions for Federal Fiscal Years 1997 and 1998.

ERIC Educational Resources Information Center

Ahmad, Mahassen

In 1995 the United States Department of Agriculture (USDA) developed the Health School Menus Initiative (HSMI) to ensure that school age children are provided meals that are consistent with dietary guidelines and current nutrition information. The USDA developed review instruments to evaluate the implementation of the HSMI nationwide. These…

Habitat Suitability Index Models: Black-shouldered kite

USGS Publications Warehouse

Faanes, Craig A.; Howard, Rebecca J.

1987-01-01

A review and synthesis of existing information were used to develop a model for evaluating black-shouldered kite habitat quality. The model is scaled to produce an index between 0 (unsuitable habitat) to 1.0 (optimal habitat). Habitat suitability index models are designed for use with the Habitat Evaluation Procedures previously developed by the U.S. Fish and Wildlife Service. Guidelines for model application are provided.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhou, Nan; Williams, Christopher

This report is intended to answer the question: “What international experiences with ‘eco-cities’ can help the central Chinese government evaluate the performance of Chinese cities that pursue ‘lowcarbon’ urban development?” To answer this question, we reviewed the literature on eco-cities and closely related concepts, surveyed performance indicators used to evaluate sustainable urban development around the world, and compiled case studies of exceptional eco- and sustainable cities.

Los Angeles Community College District Campus Child Development Centers' Measures of Effectiveness Project. Second Evaluation Report, Fiscal Year 1983-1984.

ERIC Educational Resources Information Center

Carfagna-Hunt, Karen; And Others

The Los Angeles Community College District (LACCD) provides a Campus Child Development Center (CCDC) educational program for the preschool children of its college students at all nine of its campuses. In 1983-84, on-site, peer review team visits were conducted to evaluate the centers in terms of their achievement of six program objectives. The…

The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search

PubMed Central

2014-01-01

Background Health promotion by and with Aboriginal and Torres Strait Islander (hereafter Indigenous) Australians is critically important given a wide gap in health parity compared to other Australians. The development and implementation of step-by-step guides, instruments, packages, frameworks or resources has provided a feasible and low-resource strategy for strengthening evidence-informed health promotion practice. Yet there has been little assessment of where and how these tools are implemented or their effectiveness. This paper reviews the characteristics, implementation and effects of Indigenous health promotion tools. Methods Indigenous health promotion tools were identified through a systematic literature search including a prior scoping study, eight databases, references of other reviews and the authors’ knowledge (n = 1494). Documents in the peer reviewed and grey literature were included if they described or evaluated tools designed, recommended or used for strengthening Indigenous Australian health promotion. Eligible publications were entered into an Excel spreadsheet and documented tools classified according to their characteristics, implementation and effects. Quality was appraised using the Dictionary for Effective Public Health Practice Project (EPHPP) and Critical Appraisal Skills Program (CASP) tools for quantitative and qualitative studies respectively. Results The review found that Indigenous health promotion tools were widely available. Of 74 publications that met inclusion criteria, sixty (81%) documented tools developed specifically for the Indigenous Australian population. All tools had been developed in reference to evidence; but only 22/74 (30%) publications specified intended or actual implementation, and only 11/74 (15%) publications evaluated impacts of the implemented tools. Impacts included health, environmental, community, organisational and health care improvements. The quality of impact evaluations was strong for only five (7%) studies. Conclusions The small number and generally moderate quality of implementation and evaluation studies means that little is known about how tools work to strengthen Indigenous health promotion practice. The findings suggest that rather than continuing to invest in tool development, practitioners, policy makers and researchers could evaluate the implementation and effects of existing tools and publish the results. There is a need for long-term investment in research to review the current use of health promotion tools and the factors that are likely to enhance their implementation. PMID:25012401

Rigour of development does not AGREE with recommendations in practice guidelines on the use of ice for acute ankle sprains.

PubMed

Van de Velde, S; Heselmans, A; Donceel, P; Vandekerckhove, P; Ramaekers, D; Aertgeerts, B

2011-09-01

OBJECTIVE This study evaluated whether the Appraisal of Guidelines Research and Evaluation (AGREE) rigour of development score of practice guidelines on ice for acute ankle sprains is related to the convergence between recommendations. DESIGN The authors systematically reviewed guidelines on ice for acute ankle sprains. Four appraisers independently used the AGREE instrument to evaluate the rigour of development of selected guidelines. For each guideline, one reviewer listed the cited evidence on ice and calculated a cited evidence score. The authors plotted the recommended durations and numbers of ice applications over the standardised rigour of development score to explore the relationships. DATA SOURCES Three reviewers searched for guidelines in Medline, Embase, Sportdiscus, PEDro, G-I-N Guideline Library, Trip Database, SumSearch, National Guideline Clearinghouse and the Health Technology Assessment database, and conducted a web-based search for guideline development organisations. ELIGIBILITY CRITERIA Eligible guidelines had a development methodology that included a process to search or use results from scientific studies and the participation of an expert group to formulate recommendations. RESULTS The authors identified 21 guidelines, containing clinically significant variations in recommended durations and numbers of ice applications. The median standardised rigour of development score was 57% (IQR 18 to 77). Variations occurred evenly among guidelines with low moderate or high rigour scores. The median evidence citation score in the guidelines was 7% (IQR 0 to 61). CONCLUSIONS There is no relationship between the rigour of development score and the recommendations in guidelines on ice for acute ankle sprains. The guidelines suffered from methodological problems which were not captured by the AGREE instrument.

Analysis of Six Reviews on the Quality of Instruments for the Evaluation of Interprofessional Education in German-Speaking Countries.

PubMed

Ehlers, Jan P; Kaap-Fröhlich, Sylvia; Mahler, Cornelia; Scherer, Theresa; Huber, Marion

2017-01-01

Background: More and more institutions worldwide and in German-speaking countries are developing and establishing interprofessional seminars in undergraduate education of health professions. In order to evaluate the different didactic approaches and different outcomes regarding the anticipated interprofessional competencies, it is necessary to apply appropriate instruments. Cross-cultural instruments are particularly helpful for international comparability. The Interprofessional Education working group of the German Medical Association (GMA) aims at identifying existing instruments for the evaluation of interprofessional education in order to make recommendations for German-speaking countries. Methods: Systematic literature research was performed on the websites of international interprofessional organisations (CAIPE, EIPEN, AIPEN), as well as in the PubMed and Cinahl databases. Reviews focusing on quantitative instruments to evaluate competencies according to the modified Kirkpatrick competency levels were searched for. Psychometrics, language/country and setting, in which the instrument was applied, were recorded. Results: Six reviews out of 73 literature research hits were included. A large number of instruments were identified; however, their psychometrics and the applied setting were very heterogeneous. The instruments can mainly be assigned to Kirkpatrick levels 1, 2a & 2b. Most instruments have been developed in English but their psychometrics were not always reported rigorously. Only very few instruments are available in German. Conclusion: It is difficult to find appropriate instruments in German. Internationally, there are different approaches and objectives in the measurement and evaluation of interprofessional competencies. The question arises whether it makes sense to translate existing instruments or to go through the lengthy process of developing new ones. The evaluation of interprofessional seminars with quantitative instruments remains mainly on Kirkpatrick levels 1 and 2. Levels 3 and 4 can probably only be assessed with qualitative or mixed methods. German language instruments are necessary.

Analysis of Six Reviews on the Quality of Instruments for the Evaluation of Interprofessional Education in German-Speaking Countries

PubMed Central

Ehlers, Jan P.; Kaap-Fröhlich, Sylvia; Mahler, Cornelia; Scherer, Theresa; Huber, Marion

2017-01-01

Background: More and more institutions worldwide and in German-speaking countries are developing and establishing interprofessional seminars in undergraduate education of health professions. In order to evaluate the different didactic approaches and different outcomes regarding the anticipated interprofessional competencies, it is necessary to apply appropriate instruments. Cross-cultural instruments are particularly helpful for international comparability. The Interprofessional Education working group of the German Medical Association (GMA) aims at identifying existing instruments for the evaluation of interprofessional education in order to make recommendations for German-speaking countries. Methods: Systematic literature research was performed on the websites of international interprofessional organisations (CAIPE, EIPEN, AIPEN), as well as in the PubMed and Cinahl databases. Reviews focusing on quantitative instruments to evaluate competencies according to the modified Kirkpatrick competency levels were searched for. Psychometrics, language/country and setting, in which the instrument was applied, were recorded. Results: Six reviews out of 73 literature research hits were included. A large number of instruments were identified; however, their psychometrics and the applied setting were very heterogeneous. The instruments can mainly be assigned to Kirkpatrick levels 1, 2a & 2b. Most instruments have been developed in English but their psychometrics were not always reported rigorously. Only very few instruments are available in German. Conclusion: It is difficult to find appropriate instruments in German. Internationally, there are different approaches and objectives in the measurement and evaluation of interprofessional competencies. The question arises whether it makes sense to translate existing instruments or to go through the lengthy process of developing new ones. The evaluation of interprofessional seminars with quantitative instruments remains mainly on Kirkpatrick levels 1 and 2. Levels 3 and 4 can probably only be assessed with qualitative or mixed methods. German language instruments are necessary. PMID:28890927

Developing Guidelines for Assessing Visual Analytics Environments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Scholtz, Jean

2011-07-01

In this paper, we develop guidelines for evaluating visual analytic environments based on a synthesis of reviews for the entries to the 2009 Visual Analytics Science and Technology (VAST) Symposium Challenge and from a user study with professional intelligence analysts. By analyzing the 2009 VAST Challenge reviews we gained a better understanding of what is important to our reviewers, both visualization researchers and professional analysts. We also report on a small user study with professional analysts to determine the important factors that they use in evaluating visual analysis systems. We then looked at guidelines developed by researchers in various domainsmore » and synthesized these into an initial set for use by others in the community. In a second part of the user study, we looked at guidelines for a new aspect of visual analytic systems – the generation of reports. Future visual analytic systems have been challenged to help analysts generate their reports. In our study we worked with analysts to understand the criteria they used to evaluate the quality of analytic reports. We propose that this knowledge will be useful as researchers look at systems to automate some of the report generation.1 Based on these efforts, we produced some initial guidelines for evaluating visual analytic environment and for evaluation of analytic reports. It is important to understand that these guidelines are initial drafts and are limited in scope because of the type of tasks for which the visual analytic systems used in the studies in this paper were designed. More research and refinement is needed by the Visual Analytics Community to provide additional evaluation guidelines for different types of visual analytic environments.« less

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review.

PubMed

Finch, Emma; Lethlean, Jennifer; Rose, Tanya; Fleming, Jennifer; Theodoros, Deborah; Cameron, Ashley; Coleman, Adele; Copland, David; McPhail, Steven M

2018-03-01

A key feature of health professionals' training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning? Systematic review of published literature. Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction. A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students' clinical skills. Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students' communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.

Non-Intrusive Load Monitoring Assessment: Literature Review and Laboratory Protocol

DOE Office of Scientific and Technical Information (OSTI.GOV)

Butner, R. Scott; Reid, Douglas J.; Hoffman, Michael G.

2013-07-01

To evaluate the accuracy of NILM technologies, a literature review was conducted to identify any test protocols or standardized testing approaches currently in use. The literature review indicated that no consistent conventions were currently in place for measuring the accuracy of these technologies. Consequently, PNNL developed a testing protocol and metrics to provide the basis for quantifying and analyzing the accuracy of commercially available NILM technologies. This report discusses the results of the literature review and the proposed test protocol and metrics in more detail.

Pharmacological interventions to treat phlebitis: systematic review.

PubMed

dos Reis, Paula Elaine Diniz; Silveira, Renata Cristina de Campos Pereira; Vasques, Christiane Inocêncio; de Carvalho, Emilia Campos

2009-01-01

This study presents a systematic review for evaluating effective pharmacological actions for the treatment of phlebitis stemming from infusion therapy. The studies reviewed were categorized according to the type of therapeutic approach proposed by the author and by the level of evidence presented. The review found that topical nitroglycerin and notoginseny were more effective in the reduction of the inflammatory process when compared with other proposed alternatives. Nevertheless, the development of research related to possible alternatives for the treatment of phlebitis is important.

Directed Test Review and Self-Evaluation Using a Microcomputer

PubMed Central

Franklin, Kenneth J.; Hodder, Richard A.; Riordan, Daniel D.; Manning, Randolph

1981-01-01

Medical students adopt various review strategies to prepare for the tests administered by the National Board of Medical Examiners (NBME). The Uniformed Services University Board Review System (UBRS) was created to fill a perceived need by some students for a directed, intensive study aid based on questions in NBME format. In its current form, it is a useful adjunct for directed study, development of test-taking skills, and review of course material in any subject to which it is applied.

Are cancer-related decision aids appropriate for socially disadvantaged patients? A systematic review of US randomized controlled trials.

PubMed

Enard, Kimberly R; Dolan Mullen, Patricia; Kamath, Geetanjali R; Dixon, Nickell M; Volk, Robert J

2016-06-06

Shared decision-making (SDM) is considered a key component of high quality cancer care and may be supported by patient decision aids (PtDAs). Many patients, however, face multiple social disadvantages that may influence their ability to fully participate in SDM or to use PtDAs; additionally, these social disadvantages are among the determinants of health associated with greater cancer risk, unwarranted variations in care and worse outcomes. The purpose of this systematic review is to describe the extent to which disadvantaged social groups in the United States (US) have been included in trials of cancer-related PtDAs and to highlight strategies, lessons learned and future opportunities for developing and evaluating PtDAs that are appropriate for disadvantaged populations. We selected cancer-related US studies from the Cochrane 2014 review of PtDAs and added RCTs meeting Cochrane criteria from searches of PubMed, CINAHL, PsycINFO (January 2010 to December 2013); and reference lists. Two reviewers independently screened titles/abstracts; three reviewers independently screened full text articles, performed data extraction and assessed: 1) inclusion of participants based on seven indicators of social disadvantage (limited education; female gender; uninsured or Medicaid status; non-U.S. nativity; non-White race or Hispanic ethnicity; limited English proficiency; low-literacy), and 2) attention to social disadvantage in the development or evaluation of PtDAs. Twenty-three of 39 eligible RCTs included participants from at least one disadvantaged subgroup, most frequently racial/ethnic minorities or individuals with limited education and/or low-literacy. Seventeen studies discussed strategies and lessons learned in attending to the needs of disadvantaged social groups in PtDA development; 14 studies targeted disadvantaged groups or addressed subgroup differences in PtDA evaluation. The diversity of the US population is represented in a majority of cancer-related PtDA RCTs, but fewer studies have tailored PtDAs to address the multiple social disadvantages that may impact patients' participation in SDM. More detailed attention to the comprehensive range of social factors that determine cancer risk, variations in care and outcomes is needed in the development and evaluation of PtDAs for disadvantaged populations. Registered 24 October 2014 in PROSPERO International prospective register of systematic reviews ( CRD42014014470 ).

A systematic review of posture and psychosocial factors as contributors to upper quadrant musculoskeletal pain in children and adolescents.

PubMed

Prins, Yolandi; Crous, Lynette; Louw, Q A

2008-01-01

Musculoskeletal pain has become a major symptomatic complaint among children and adolescents and is increasingly occurring at a younger age. This systematic review was done to evaluate the evidence for the contribution of posture and psychosocial factors to the development of upper quadrant musculoskeletal pain in children and adolescents. The review describes the measurement tools used to assess musculoskeletal pain, sitting posture, and psychosocial factors. Two independent reviewers searched seven databases for observational studies that included prospective and cross-sectional study designs. Ten studies were extracted and assessed by two reviewers using the Critical Appraisal Form-Quantitative Studies (Law et al, 1998). The studies measured upper quadrant musculoskeletal pain as an outcome measure. Five studies evaluated sitting posture and found an association between the duration of static sitting and upper quadrant musculoskeletal pain. Six studies measured psychosocial factors of which depression, stress, and psychosomatic symptoms were the factors most commonly found to influence the development of upper quadrant musculoskeletal pain. The eligible studies used different pain measurement tools and different measurement tools to assess sitting posture and psychosocial factors. This review concludes that the duration of sitting posture and psychosocial factors may influence the experience of musculoskeletal pain among children and adolescents.

Implementation and evaluation of a peer review process for advanced practice nurses in a university hospital setting.

PubMed

Bergum, Shelly K; Canaan, Talitha; Delemos, Christi; Gall, Elizabeth Funke; McCracken, Bonnie; Rowen, Dave; Salvemini, Steve; Wiens, Kimberly

2017-07-01

Over the past decade, implementation of the peer review process for the development of the advanced practice nurse (APN) has been emphasized. However, little exists in the literature regarding APN peer review. The peer review process is intended to help demonstrate competency of care, enhance quality improvement measures, and foster the professional growth of the APN. APNs serving on a professional governance council within a university teaching hospital developed a model of peer review for APNs. Nine months after the tool was implemented, an anonymous follow-up survey was conducted. A follow-up request was sent 4 weeks later to increase the number of respondents. Likert scales were used to elicit subjective data regarding the process. Of 81 APNs who participated in the survey, more than half (52%) felt that the process would directly improve their professional practice. Survey results show that the peer review process affected APN professional practice positively. Additional research might include pathways for remediation and education of staff, evaluation of alternate methods to improve application to clinical practice, and collection of outcome data. The models presented provide a foundation for future refinement to accommodate different APN practice settings. ©2017 American Association of Nurse Practitioners.

Using Qualitative Research to Inform Development of Professional Guidelines: A Case Study of the Society of Critical Care Medicine Family-Centered Care Guidelines.

PubMed

Coombs, Maureen A; Davidson, Judy E; Nunnally, Mark E; Wickline, Mary A; Curtis, J Randall

2017-08-01

To explore the importance, challenges, and opportunities using qualitative research to enhance development of clinical practice guidelines, using recent guidelines for family-centered care in the ICU as an example. In developing the Society of Critical Care Medicine guidelines for family-centered care in the neonatal ICU, PICU, and adult ICU, we developed an innovative adaptation of the Grading of Recommendations, Assessments, Development and Evaluations approach to explicitly incorporate qualitative research. Using Grading of Recommendations, Assessments, Development and Evaluations and the Council of Medical Specialty Societies principles, we conducted a systematic review of qualitative research to establish family-centered domains and outcomes. Thematic analyses were undertaken on study findings and used to support Population, Intervention, Comparison, Outcome question development. We identified and employed three approaches using qualitative research in these guidelines. First, previously published qualitative research was used to identify important domains for the Population, Intervention, Comparison, Outcome questions. Second, this qualitative research was used to identify and prioritize key outcomes to be evaluated. Finally, we used qualitative methods, member checking with patients and families, to validate the process and outcome of the guideline development. In this, a novel report, we provide direction for standardizing the use of qualitative evidence in future guidelines. Recommendations are made to incorporate qualitative literature review and appraisal, include qualitative methodologists in guideline taskforce teams, and develop training for evaluation of qualitative research into guideline development procedures. Effective methods of involving patients and families as members of guideline development represent opportunities for future work.

You can't improve what you don't measure: Safety climate measures available in the German-speaking countries to support safety culture development in healthcare.

PubMed

Manser, Tanja; Brösterhaus, Mareen; Hammer, Antje

2016-01-01

Safety climate measurement is a key input into safety culture development. The aim of this review is to provide an overview of the safety climate measures that have been evaluated for their psychometric properties in a German-speaking country and to make recommendations on how to use them in quality and patient safety improvement. A systematic search strategy was implemented to obtain relevant articles. PubMed and Web of Science databases were searched, and 128 abstracts were identified. After application of limits, 33 full texts were retrieved for subsequent evaluation. Studies were included on the basis of predetermined inclusion criteria and independent assessment by two reviewers. Publications were reviewed concerning healthcare setting, target group, safety culture dimensions covered and results of their psychometric evaluation. This review identified 11 instruments for safety climate assessment in different healthcare settings (i. e. hospitals, nursing homes, primary care, dental care and community pharmacy) for which acceptable to good internal consistency was reported. We observed wide variability concerning the number of dimensions (1 to 14; in some cases including outcome dimensions) and items (9 to 128) that the instruments were comprised of. Nevertheless, consistency with regard to the thematic areas covered was rather high. While there is clear evidence that we can assess safety climate in healthcare, the application of safety climate measures by quality and patient safety practitioners has so far been rather limited. This review bridges this gap between research and improvement practice by highlighting the central role of safety climate assessment in a mixed methods approach to inform safety culture development. Copyright © 2016. Published by Elsevier GmbH.

A critical appraisal of guidelines for the management of knee osteoarthritis using Appraisal of Guidelines Research and Evaluation criteria

PubMed Central

Poitras, Stéphane; Avouac, Jérôme; Rossignol, Michel; Avouac, Bernard; Cedraschi, Christine; Nordin, Margareta; Rousseaux, Chantal; Rozenberg, Sylvie; Savarieau, Bernard; Thoumie, Philippe; Valat, Jean-Pierre; Vignon, Éric; Hilliquin, Pascal

2007-01-01

Clinical practice guidelines have been elaborated to summarize evidence related to the management of knee osteoarthritis and to facilitate uptake of evidence-based knowledge by clinicians. The objectives of the present review were summarizing the recommendations of existing guidelines on knee osteoarthritis, and assessing the quality of the guidelines using a standardized and validated instrument – the Appraisal of Guidelines Research and Evaluation (AGREE) tool. Internet medical literature databases from 2001 to 2006 were searched for guidelines, with six guidelines being identified. Thirteen clinician researchers participated in the review. Each reviewer was trained in the AGREE instrument. The guidelines were distributed to four groups of three or four reviewers, each group reviewing one guideline with the exception of one group that reviewed two guidelines. One independent evaluator reviewed all guidelines. All guidelines effectively addressed only a minority of AGREE domains. Clarity/presentation was effectively addressed in three out of six guidelines, scope/purpose and rigour of development in two guidelines, editorial independence in one guideline, and stakeholder involvement and applicability in none. The clinical management recommendation tended to be similar among guidelines, although interventions addressed varied. Acetaminophen was recommended for initial pain treatment, combined with exercise and education. Nonsteroidal anti-inflammatory drugs were recommended if acetaminophen failed to control pain, but cautiously because of gastrointestinal risks. Surgery was recommended in the presence of persistent pain and disability. Education and activity management interventions were superficially addressed in most guidelines. Guideline creators should use the AGREE criteria when developing guidelines. Innovative and effective methods of knowledge translation to health professionals are needed. PMID:18062805

An optimal search filter for retrieving systematic reviews and meta-analyses

PubMed Central

2012-01-01

Background Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity. PMID:22512835

Evaluation methods used on health information systems (HISs) in Iran and the effects of HISs on Iranian healthcare: a systematic review.

PubMed

Ahmadian, Leila; Nejad, Simin Salehi; Khajouei, Reza

2015-06-01

The most important goal of a health information system (HIS) is improvement of quality, effectiveness and efficiency of health services. To achieve this goal, health care systems should be evaluated continuously. The aim of this paper was to study the impacts of HISs in Iran and the methods used for their evaluation. We systematically searched all English and Persian papers evaluating health information systems in Iran that were indexed in SID, Magiran, Iran medex, PubMed and Embase databases until June 2013. A data collection form was designed to extract required data such as types of systems evaluated, evaluation methods and tools. In this study, 53 out of 1103 retrieved articles were selected as relevant and reviewed by the authors. This study indicated that 28 studies used questionnaires to evaluate the system and in 27 studies the study instruments were distributed within a research population. In 26 papers the researchers collected the information by means of interviews, observations, heuristic evaluation and the review of documents and records. The main effects of the evaluated systems in health care settings were improving quality of services, reducing time, increasing accessibility to information, reducing costs and decreasing medical errors. Evaluation of health information systems is central to their development and enhancement, and to understanding their effect on health and health services. Despite numerous evaluation methods available, the reviewed studies used a limited number of methods to evaluate HIS. Additionally, the studies mainly discussed the positive effects of HIS on health care services. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

The clinical effectiveness and cost-effectiveness of testing for cytochrome P450 polymorphisms in patients with schizophrenia treated with antipsychotics: a systematic review and economic evaluation.

PubMed

Fleeman, N; McLeod, C; Bagust, A; Beale, S; Boland, A; Dundar, Y; Jorgensen, A; Payne, K; Pirmohamed, M; Pushpakom, S; Walley, T; de Warren-Penny, P; Dickson, R

2010-01-01

To determine whether testing for cytochrome P450 (CYP) polymorphisms in adults entering antipsychotic treatment for schizophrenia leads to improvement in outcomes, is useful in medical, personal or public health decision-making, and is a cost-effective use of health-care resources. The following electronic databases were searched for relevant published literature: Cochrane Controlled Trials Register, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effectiveness, EMBASE, Health Technology Assessment database, ISI Web of Knowledge, MEDLINE, PsycINFO, NHS Economic Evaluation Database, Health Economic Evaluation Database, Cost-effectiveness Analysis (CEA) Registry and the Centre for Health Economics website. In addition, publicly available information on various genotyping tests was sought from the internet and advisory panel members. A systematic review of analytical validity, clinical validity and clinical utility of CYP testing was undertaken. Data were extracted into structured tables and narratively discussed, and meta-analysis was undertaken when possible. A review of economic evaluations of CYP testing in psychiatry and a review of economic models related to schizophrenia were also carried out. For analytical validity, 46 studies of a range of different genotyping tests for 11 different CYP polymorphisms (most commonly CYP2D6) were included. Sensitivity and specificity were high (99-100%). For clinical validity, 51 studies were found. In patients tested for CYP2D6, an association between genotype and tardive dyskinesia (including Abnormal Involuntary Movement Scale scores) was found. The only other significant finding linked the CYP2D6 genotype to parkinsonism. One small unpublished study met the inclusion criteria for clinical utility. One economic evaluation assessing the costs and benefits of CYP testing for prescribing antidepressants and 28 economic models of schizophrenia were identified; none was suitable for developing a model to examine the cost-effectiveness of CYP testing. Tests for determining genotypes appear to be accurate although not all aspects of analytical validity were reported. Given the absence of convincing evidence from clinical validity studies, the lack of clinical utility and economic studies, and the unsuitability of published schizophrenia models, no model was developed; instead key features and data requirements for economic modelling are presented. Recommendations for future research cover both aspects of research quality and data that will be required to inform the development of future economic models.

A scoping review about conference objectives and evaluative practices: how do we get more out of them?

PubMed

Neves, Justin; Lavis, John N; Ranson, M Kent

2012-08-02

Large multi-day conferences have often been criticized as ineffective ways to improve social outcomes and to influence policy or practice. Unfortunately, many conference evaluations have also been inadequate in determining the impact of a conference on its associated social sector, with little evidence gathered or analyzed to substantiate or refute these criticisms. The aim of this scoping review is to investigate and report stakeholders' objectives for planning or participating in large multi-day conferences and how these objectives are being evaluated. We conducted a scoping review supplemented by a small number of key informant interviews. Eight bibliographic databases were systematically searched to identify papers describing conference objectives and/or evaluations. We developed a conference evaluation framework based on theoretical models and empirical findings, which structured the descriptive synthesis of the data. We identified 3,073 potential papers for review, of which 44 were included in this study. Our evaluation framework connects five key elements in planning a conference and its evaluation (number in brackets refers to number of themes identified): conference objectives (8), purpose of evaluation (7), evaluation methods (5), indicators of success (9) and theories/models (8). Further analysis of indicators of success identified three categories of indicators with differing scopes (i.e. immediate, prospective or follow-up) as well as empirical links between the purpose of evaluations and these indicators. Conference objectives and evaluations were largely correlated with the type of conference (i.e. academic, political/governmental or business) but diverse overall. While much can be done to improve the quality and usefulness of conference evaluations, there are innovative assessments that are currently being utilized by some conferences and warrant further investigation. This review provides conference evaluators and organizers a simple resource to improve their own assessments by highlighting and categorizing potential objectives and evaluation strategies.

A scoping review about conference objectives and evaluative practices: how do we get more out of them?

PubMed Central

2012-01-01

Large multi-day conferences have often been criticized as ineffective ways to improve social outcomes and to influence policy or practice. Unfortunately, many conference evaluations have also been inadequate in determining the impact of a conference on its associated social sector, with little evidence gathered or analyzed to substantiate or refute these criticisms. The aim of this scoping review is to investigate and report stakeholders’ objectives for planning or participating in large multi-day conferences and how these objectives are being evaluated. We conducted a scoping review supplemented by a small number of key informant interviews. Eight bibliographic databases were systematically searched to identify papers describing conference objectives and/or evaluations. We developed a conference evaluation framework based on theoretical models and empirical findings, which structured the descriptive synthesis of the data. We identified 3,073 potential papers for review, of which 44 were included in this study. Our evaluation framework connects five key elements in planning a conference and its evaluation (number in brackets refers to number of themes identified): conference objectives (8), purpose of evaluation (7), evaluation methods (5), indicators of success (9) and theories/models (8). Further analysis of indicators of success identified three categories of indicators with differing scopes (i.e. immediate, prospective or follow-up) as well as empirical links between the purpose of evaluations and these indicators. Conference objectives and evaluations were largely correlated with the type of conference (i.e. academic, political/governmental or business) but diverse overall. While much can be done to improve the quality and usefulness of conference evaluations, there are innovative assessments that are currently being utilized by some conferences and warrant further investigation. This review provides conference evaluators and organizers a simple resource to improve their own assessments by highlighting and categorizing potential objectives and evaluation strategies. PMID:22857399

PEACE CORPS, CONGRESSIONAL PRESENTATION, FISCAL YEAR 1967.

ERIC Educational Resources Information Center

Peace Corps, Washington, DC.

THIS REPORT TO CONGRESS DISCUSSES THE HISTORY, FINANCIAL POLICY, VOLUNTEER PROGRAMS, AND RATIONALE OF THE PEACE CORPS, WITH EMPHASIS ON PLANS TO IMPROVE TRAINING AND EXPAND ITS PROGRAM. PEACE CORPS TEACHING, COMMUNITY DEVELOPMENT, AGRICULTURAL DEVELOPMENT, AND HEALTH EDUCATION IN VARIOUS DEVELOPING COUNTRIES ARE REVIEWED AND EVALUATED. A PROPOSAL…

Production Plan and Formative Evaluation Report.

ERIC Educational Resources Information Center

Castle, Thomas J.; And Others

1981-01-01

Instructional development projects in Medical Terminology and Orientation to Hearing Aids are reviewed to demonstrate the procedural steps used and the interactive dynamics employed by development teams at the National Technical Institute for the Deaf. Six references are provided. (MER)

Not All Rubrics Are Equal: A Review of Rubrics for Evaluating the Quality of Open Educational Resources

ERIC Educational Resources Information Center

Yuan, Min; Recker, Mimi

2015-01-01

The rapid growth in Internet technologies has led to a proliferation in the number of Open Educational Resources (OER), making the evaluation of OER quality a pressing need. In response, a number of rubrics have been developed to help guide the evaluation of OER quality; these, however, have had little accompanying evaluation of their utility or…

A Brief History of the Evaluation of VET in Australia. Review of Research.

ERIC Educational Resources Information Center

McDonald, Rod; Hayton, Geoff

The history and current state of evaluation of vocational education and training (VET) in Australia was examined. The study's main conclusion was that, despite its important potential, evaluation has thus far been little used for the improvement of VET in Australia. Other conclusions of the study were as follows: (1) little development of…

Supervision, support and mentoring interventions for health practitioners in rural and remote contexts: an integrative review and thematic synthesis of the literature to identify mechanisms for successful outcomes.

PubMed

Moran, Anna M; Coyle, Julia; Pope, Rod; Boxall, Dianne; Nancarrow, Susan A; Young, Jennifer

2014-02-13

To identify mechanisms for the successful implementation of support strategies for health-care practitioners in rural and remote contexts. This is an integrative review and thematic synthesis of the empirical literature that examines support interventions for health-care practitioners in rural and remote contexts. This review includes 43 papers that evaluated support strategies for the rural and remote health workforce. Interventions were predominantly training and education programmes with limited evaluations of supervision and mentoring interventions. The mechanisms associated with successful outcomes included: access to appropriate and adequate training, skills and knowledge for the support intervention; accessible and adequate resources; active involvement of stakeholders in programme design, implementation and evaluation; a needs analysis prior to the intervention; external support, organisation, facilitation and/or coordination of the programme; marketing of the programme; organisational commitment; appropriate mode of delivery; leadership; and regular feedback and evaluation of the programme. Through a synthesis of the literature, this research has identified a number of mechanisms that are associated with successful support interventions for health-care practitioners in rural and remote contexts. This research utilised a methodology developed for studying complex interventions in response to the perceived limitations of traditional systematic reviews. This synthesis of the evidence will provide decision-makers at all levels with a collection of mechanisms that can assist the development and implementation of support strategies for staff in rural and remote contexts.

Supervision, support and mentoring interventions for health practitioners in rural and remote contexts: an integrative review and thematic synthesis of the literature to identify mechanisms for successful outcomes

PubMed Central

2014-01-01

Objective To identify mechanisms for the successful implementation of support strategies for health-care practitioners in rural and remote contexts. Design This is an integrative review and thematic synthesis of the empirical literature that examines support interventions for health-care practitioners in rural and remote contexts. Results This review includes 43 papers that evaluated support strategies for the rural and remote health workforce. Interventions were predominantly training and education programmes with limited evaluations of supervision and mentoring interventions. The mechanisms associated with successful outcomes included: access to appropriate and adequate training, skills and knowledge for the support intervention; accessible and adequate resources; active involvement of stakeholders in programme design, implementation and evaluation; a needs analysis prior to the intervention; external support, organisation, facilitation and/or coordination of the programme; marketing of the programme; organisational commitment; appropriate mode of delivery; leadership; and regular feedback and evaluation of the programme. Conclusion Through a synthesis of the literature, this research has identified a number of mechanisms that are associated with successful support interventions for health-care practitioners in rural and remote contexts. This research utilised a methodology developed for studying complex interventions in response to the perceived limitations of traditional systematic reviews. This synthesis of the evidence will provide decision-makers at all levels with a collection of mechanisms that can assist the development and implementation of support strategies for staff in rural and remote contexts. PMID:24521004

34 CFR 303.521 - Fees.

Code of Federal Regulations, 2010 CFR

2010-07-01

... SERVICES, DEPARTMENT OF EDUCATION EARLY INTERVENTION PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES... charged to parents: (1) Implementing the child find requirements in § 303.321. (2) Evaluation and... coordinative activities related to— (i) The development, review, and evaluation of IFSPs in §§ 303.340 through...

34 CFR 303.521 - Fees.

Code of Federal Regulations, 2011 CFR

2011-07-01

... SERVICES, DEPARTMENT OF EDUCATION EARLY INTERVENTION PROGRAM FOR INFANTS AND TODDLERS WITH DISABILITIES... charged to parents: (1) Implementing the child find requirements in § 303.321. (2) Evaluation and... coordinative activities related to— (i) The development, review, and evaluation of IFSPs in §§ 303.340 through...

Evaluation of Video Detection Systems and Development of Application Guidelines at Signalized Intersections

DOT National Transportation Integrated Search

2010-07-01

This report documents the results of a study on evaluating three major video imaging vehicle detection systems (VIVDS) currently deployed in Nevadas urban areas. The report first provides a brief review of the features and functions of some major ...

Classifying Adverse Events in the Dental Office.

PubMed

Kalenderian, Elsbeth; Obadan-Udoh, Enihomo; Maramaldi, Peter; Etolue, Jini; Yansane, Alfa; Stewart, Denice; White, Joel; Vaderhobli, Ram; Kent, Karla; Hebballi, Nutan B; Delattre, Veronique; Kahn, Maria; Tokede, Oluwabunmi; Ramoni, Rachel B; Walji, Muhammad F

2017-06-30

Dentists strive to provide safe and effective oral healthcare. However, some patients may encounter an adverse event (AE) defined as "unnecessary harm due to dental treatment." In this research, we propose and evaluate two systems for categorizing the type and severity of AEs encountered at the dental office. Several existing medical AE type and severity classification systems were reviewed and adapted for dentistry. Using data collected in previous work, two initial dental AE type and severity classification systems were developed. Eight independent reviewers performed focused chart reviews, and AEs identified were used to evaluate and modify these newly developed classifications. A total of 958 charts were independently reviewed. Among the reviewed charts, 118 prospective AEs were found and 101 (85.6%) were verified as AEs through a consensus process. At the end of the study, a final AE type classification comprising 12 categories, and an AE severity classification comprising 7 categories emerged. Pain and infection were the most common AE types representing 73% of the cases reviewed (56% and 17%, respectively) and 88% were found to cause temporary, moderate to severe harm to the patient. Adverse events found during the chart review process were successfully classified using the novel dental AE type and severity classifications. Understanding the type of AEs and their severity are important steps if we are to learn from and prevent patient harm in the dental office.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA has finalized its Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide. This assessment addresses the potential carcinogenicity from long-term inhalation exposure to ethylene oxide. Now final, this assessment updates the carcinogenicity information in EPA’s 1985 Health Assessment Document. EPA’s program and regional offices may use this assessment to inform decisions to protect human health. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. Consistent with the May 2009 IRIS assessment development process, all written comments on IRIS assessments submitted by other federal agencies and White House Offices are made publicly available. Accordingly, interagency comments and the interagency science consultation materials provided to other agencies, including interagency review drafts of the IRIS Toxicological Review of Ammonia and the charge to external peer reviewers, are posted on this site.

Cost collection and analysis for health economic evaluation.

PubMed

Smith, Kristine A; Rudmik, Luke

2013-08-01

To improve the understanding of common health care cost collection, estimation, analysis, and reporting methodologies. Ovid MEDLINE (1947 to December 2012), Cochrane Central register of Controlled Trials, Database of Systematic Reviews, Health Technology Assessment, and National Health Service Economic Evaluation Database. This article discusses the following cost collection methods: defining relevant resources, quantification of consumed resources, and resource valuation. It outlines the recommendations for cost reporting in economic evaluations and reviews the techniques on how to handle cost data uncertainty. Last, it discusses the controversial topics of future costs and patient productivity losses. Health care cost collection and estimation can be challenging, and an organized approach is required to optimize accuracy of economic evaluation outcomes. Understanding health care cost collection and estimation techniques will improve both critical appraisal and development of future economic evaluations.

A Strategic Governance Review for Multi-Organizational Systems of Education, Training, and Professional Development.

ERIC Educational Resources Information Center

Daley, Glenn A.; Levy, Dina G.; Kaganoff, Tessa; Augustine, Catherine A.; Benjamin, Roger; Bikson, Tora K.; Gates, Susan M.; Moini, Joy S.

A study was conducted to develop tools for describing and evaluating external governance in the U.S. Department of Defense's (DoD's) multiorganizational system of education, training, and professional development. An exploratory conceptual framework and taxonomy for understanding external governance in the DoD context was developed, and the…

A Review of Mathematical Models for Leukemia and Lymphoma

PubMed Central

Clapp, Geoffrey; Levy, Doron

2014-01-01

Recently, there has been significant activity in the mathematical community, aimed at developing quantitative tools for studying leukemia and lymphoma. Mathematical models have been applied to evaluate existing therapies and to suggest novel therapies. This article reviews the recent contributions of mathematical modeling to leukemia and lymphoma research. These developments suggest that mathematical modeling has great potential in this field. Collaboration between mathematicians, clinicians, and experimentalists can significantly improve leukemia and lymphoma therapy. PMID:26744598

A Review of Classical Methods of Item Analysis.

ERIC Educational Resources Information Center

French, Christine L.

Item analysis is a very important consideration in the test development process. It is a statistical procedure to analyze test items that combines methods used to evaluate the important characteristics of test items, such as difficulty, discrimination, and distractibility of the items in a test. This paper reviews some of the classical methods for…

A Content Analysis of Kindergarten-12th Grade School-Based Nutrition Interventions: Taking Advantage of Past Learning

ERIC Educational Resources Information Center

Roseman, Mary G.; Riddell, Martha C.; Haynes, Jessica N.

2011-01-01

Objective: To review the literature, identifying proposed recommendations for school-based nutrition interventions, and evaluate kindergarten through 12th grade school-based nutrition interventions conducted from 2000-2008. Design: Proposed recommendations from school-based intervention reviews were developed and used in conducting a content…

45 CFR 1355.35 - Program improvement plans.

Code of Federal Regulations, 2013 CFR

2013-10-01

... developed jointly by title IV-E agency and Federal staff in consultation with the review team; (ii) Identify... how the action steps in the plan build on and make progress over prior program improvement plans; (vii... evaluated jointly by the title IV-E agency and ACF, in collaboration with other members of the review team...