[Function of the present systematic evaluation in establishment of guidance for clinical practice].

PubMed

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

[Principles for the evaluation of telemedicine applications: Results of a systematic review and consensus process].

PubMed

Arnold, Katrin; Scheibe, Madlen; Müller, Olaf; Schmitt, Jochen

2016-11-01

The limited number of telemedicine applications being transferred to standard medical care in Germany may to some extent be explained by deficits in the current evaluation practice. Effectiveness and cost effectiveness can only be demonstrated to decision makers and potential users with methodologically sound and fully published evaluations. There is a lack of well-founded and mandatory standards for adequate, comparable evaluations of telemedicine applications. As part of the project CCS Telehealth Eastern Saxony (CCS THOS), a systematic review on evaluation concepts for telemedicine applications (search period until September 2014, databases Medline, Embase, HTA-Database, DARE, NHS EED) as well as an additional selective literature search were conducted. Suggestions for evaluation fundamentals were derived from the results. These suggestions were subjected to a formal consensus process (nominal group process) with relevant stakeholder groups (healthcare payers, healthcare providers, health policy representatives, researchers). 19 papers were included in the systematic review. In accordance with the predefined inclusion criteria, each presented an evaluation concept for telemedicine applications that was based upon a systematic review and/or a consensus process. Via a formal consensus process, the suggestions for evaluation principles derived from the review and the selective literature search (23 papers) resulted in ten agreed evaluation principles. Eight of them were unanimously agreed upon, two were arrived at with one abstention each. The principles enclose criteria for the planning, conduct and reporting of telemedicine evaluations. Adherence to them is obligatory for users of the telemedical infrastructure provided by CCS THOS. Furthermore, right from the beginning the intention was very much for these principles to be seized upon by other projects and initiatives. The agreed evaluation principles for telemedicine applications are the first in Germany to be based both upon evidence and consensus. Due to the methodology of development, they have a strong scientific and health policy legitimation. Therefore, and because of their general applicability, adherence to these principles beyond the context of the telemedicine platform developed within CCS THOS is recommended, namely throughout the German telemedicine scene. Copyright © 2016. Published by Elsevier GmbH.

The Marketing Audit as a Method of the Evaluation of the Marketing Plan

NASA Astrophysics Data System (ADS)

Vaňa, Kamil; Černá, Ľubica

2012-12-01

The growing complexity of the current market environment needs a more systematic evaluation process of the organizational marketing performance to deal with the dynamic market. This paper deals with marketing audit as a comprehensive assessment of all angles of marketing operation in an organization and also deals with systematic evaluation of plans, objectives, strategies, activities and organizational structure as well as marketing staff.

Evaluating the Validity of Systematic Reviews to Identify Empirically Supported Treatments

ERIC Educational Resources Information Center

Slocum, Timothy A.; Detrich, Ronnie; Spencer, Trina D.

2012-01-01

The "best available evidence" is one of the three basic inputs into evidence-based practice. This paper sets out a framework for evaluating the quality of systematic reviews that are intended to identify empirically supported interventions as a way of summarizing the best available evidence. The premise of this paper is that the process of…

Systematic procedure for designing processes with multiple environmental objectives.

PubMed

Kim, Ki-Joo; Smith, Raymond L

2005-04-01

Evaluation of multiple objectives is very important in designing environmentally benign processes. It requires a systematic procedure for solving multiobjective decision-making problems due to the complex nature of the problems, the need for complex assessments, and the complicated analysis of multidimensional results. In this paper, a novel systematic procedure is presented for designing processes with multiple environmental objectives. This procedure has four steps: initialization, screening, evaluation, and visualization. The first two steps are used for systematic problem formulation based on mass and energy estimation and order of magnitude analysis. In the third step, an efficient parallel multiobjective steady-state genetic algorithm is applied to design environmentally benign and economically viable processes and to provide more accurate and uniform Pareto optimal solutions. In the last step a new visualization technique for illustrating multiple objectives and their design parameters on the same diagram is developed. Through these integrated steps the decision-maker can easily determine design alternatives with respect to his or her preferences. Most importantly, this technique is independent of the number of objectives and design parameters. As a case study, acetic acid recovery from aqueous waste mixtures is investigated by minimizing eight potential environmental impacts and maximizing total profit. After applying the systematic procedure, the most preferred design alternatives and their design parameters are easily identified.

Using Analytic Hierarchy Process in Textbook Evaluation

ERIC Educational Resources Information Center

Kato, Shigeo

2014-01-01

This study demonstrates the application of the analytic hierarchy process (AHP) in English language teaching materials evaluation, focusing in particular on its potential for systematically integrating different components of evaluation criteria in a variety of teaching contexts. AHP is a measurement procedure wherein pairwise comparisons are made…

A Systematic Review of Sound-Based Intervention Programs to Improve Participation in Education for Children with Sensory Processing and Integration Challenges

ERIC Educational Resources Information Center

Villasenor, Romana F.; Smith, Sarah L.; Jewell, Vanessa D.

2018-01-01

This systematic review evaluates current evidence for using sound-based interventions (SBIs) to improve educational participation for children with challenges in sensory processing and integration. Databases searched included CINAHL, MEDLINE Complete, PsychINFO, ERIC, Web of Science, and Cochrane. No studies explicitly measured participation-level…

CALIBRATION OF SUBSURFACE BATCH AND REACTIVE-TRANSPORT MODELS INVOLVING COMPLEX BIOGEOCHEMICAL PROCESSES

EPA Science Inventory

In this study, the calibration of subsurface batch and reactive-transport models involving complex biogeochemical processes was systematically evaluated. Two hypothetical nitrate biodegradation scenarios were developed and simulated in numerical experiments to evaluate the perfor...

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

Guideline for Performing Systematic Approach to Evaluate and Qualify Legacy Documents that Support Advanced Reactor Technology Activity

DOE Office of Scientific and Technical Information (OSTI.GOV)

Honma, George

The establishment of a systematic process for the evaluation of historic technology information for use in advanced reactor licensing is described. Efforts are underway to recover and preserve Experimental Breeder Reactor II and Fast Flux Test Facility historical data. These efforts have generally emphasized preserving information from data-acquisition systems and hard-copy reports and entering it into modern electronic formats suitable for data retrieval and examination. The guidance contained in this document has been developed to facilitate consistent and systematic evaluation processes relating to quality attributes of historic technical information (with focus on sodium-cooled fast reactor (SFR) technology) that will bemore » used to eventually support licensing of advanced reactor designs. The historical information may include, but is not limited to, design documents for SFRs, research-and-development (R&D) data and associated documents, test plans and associated protocols, operations and test data, international research data, technical reports, and information associated with past U.S. Nuclear Regulatory Commission (NRC) reviews of SFR designs. The evaluation process is prescribed in terms of SFR technology, but the process can be used to evaluate historical information for any type of advanced reactor technology. An appendix provides a discussion of typical issues that should be considered when evaluating and qualifying historical information for advanced reactor technology fuel and source terms, based on current light water reactor (LWR) requirements and recent experience gained from Next Generation Nuclear Plant (NGNP).« less

Self Evaluation of Organizations.

ERIC Educational Resources Information Center

Pooley, Richard C.

Evaluation within human service organizations is defined in terms of accepted evaluation criteria, with reasonable expectations shown and structured into a model of systematic evaluation practice. The evaluation criteria of program effort, performance, adequacy, efficiency and process mechanisms are discussed, along with measurement information…

[Methodology for construction of a panel of indicators for monitoring and evaluation of unified health system (SUS) management].

PubMed

Tamaki, Edson Mamoru; Tanaka, Oswaldo Yoshimi; Felisberto, Eronildo; Alves, Cinthia Kalyne de Almeida; Drumond Junior, Marcos; Bezerra, Luciana Caroline de Albuquerque; Calvo, Maria Cristina Marino; Miranda, Alcides Silva de

2012-04-01

This study sought to develop methodology for the construction of a Panel for the Monitoring and Evaluation of Management of the Unified Health System (SUS). The participative process used in addition to the systematization conducted made it possible to identify an effective strategy for building management tools in partnership with researchers, academic institutions and managers of the SUS. The final systematization of the Panel selected indicators for the management of the SUS in terms of Demand, Inputs, Processes, Outputs and Outcomes in order to provide a simple, versatile and useful tool for evaluation at any level of management and more transparent and easier communication with all stakeholders in decision-making. Taking the management of the SUS as the scope of these processes and practices in all normative aspects enabled dialog between systemic theories and those which consider the centrality of the social actor in the decision-making process.

Systematic documentation of new vaccine introduction in selected countries of the Latin American Region.

PubMed

de Oliveira, Lúcia H; Toscano, Cristiana M; Sanwogou, N Jennifer; Ruiz-Matus, Cuauhtémoc; Tambini, Gina; Roses-Periago, Mirta; Andrus, Jon K

2013-07-02

Countries in Latin America were among the first developing countries to introduce new vaccines, particularly rotavirus (RV) and pneumococcal conjugate vaccines (PCVs), into their national immunization schedules. Experiences and lessons learned from these countries are valuable to donors, immunization partners, and policy makers in other countries wishing to make informed decisions on vaccine introduction. In order to enhance knowledge and promote understanding of the process of new vaccine introduction in the Latin American Region, with particular focus on RV and PCV, we conducted a systematic qualitative assessment. We evaluated the decision-making process, documented the structure in place, and reviewed key factors pertaining to new vaccine introduction. These include country morbidity and mortality data available prior to vaccine introduction, funding sources and mechanisms for vaccine introduction, challenges of implementation, and assessment of vaccine impact. From March 2010 to April 2011, we evaluated a subset of countries that had introduced RV and/or PCV in the past five years through interviews with key informants at the country level and through a systematic review of published data, gray literature, official technical documents, and country-specific health indicators. Countries evaluated were Bolivia, Brazil, Nicaragua, Peru, and Venezuela. In all countries, the potential of new vaccines to reduce mortality, as established by Millennium Development Goal 4, was an important consideration leading to vaccine introduction. Several factors-the availability of funds, the existence of sufficient evidence for vaccine introduction, and the feasibility of sustainable financing-were identified as crucial components of the decision-making process in the countries evaluated. The decision making process regarding new vaccine introduction in the countries evaluated does not follow a systematic approach. Nonetheless, existing evidence on efficacy, potential impact, and cost-effectiveness of vaccine introduction, even if not local data, was important in the decision making process for vaccine introduction. Copyright © 2013 Elsevier Ltd. All rights reserved.

Intervention quality is not routinely assessed in Cochrane systematic reviews of radiation therapy interventions.

PubMed

Abdul Rahim, Mohamad R; James, Melissa L; Hickey, Brigid E

2017-10-01

The aim of this study was to maximise the benefits from clinical trials involving technological interventions such as radiation therapy. High compliance to the quality assurance protocols is crucial. We assessed whether the quality of radiation therapy intervention was evaluated in Cochrane systematic reviews. We searched 416 published Cochrane systematic reviews and identified 67 Cochrane systematic reviews that investigated radiation therapy or radiotherapy as an intervention. For each systematic review, either quality assurance or quality control for the intervention was identified by a description of such processes in the published systematic reviews. Of the 67 Cochrane systematic reviews studied, only two mentioned quality assurance or quality control. Our findings revealed that 65 of 67 (97%) Cochrane systematic reviews of radiation therapy interventions failed to consider the quality of the intervention. We suggest that advice about the evaluation of intervention quality be added to author support materials. © 2017 The Royal Australian and New Zealand College of Radiologists.

Life Cycle Comparison of Waste-to-Energy to Sanitary Landfill

EPA Science Inventory

Life cycle assessment (LCA) can be used to evaluate the environmental footprint of products, processes, and services. An LCA allows decision makers to compare products and processes through systematic evaluation of supply chains. Also known as a “cradle-to-grave” approach, LCA ev...

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

PubMed

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

Practitioner Review: The Effectiveness of Solution Focused Brief Therapy with Children and Families: A Systematic and Critical Evaluation of the Literature from 1990-2010

ERIC Educational Resources Information Center

Bond, Caroline; Woods, Kevin; Humphrey, Neil; Symes, Wendy; Green, Lorraine

2013-01-01

Background and scope: Solution focused brief therapy (SFBT) is a strengths-based therapeutic approach, emphasizing the resources that people possess and how these can be applied to a positive change process. The current study provides a systematic review of the SFBT evidence base and a critical evaluation of the use and application of SFBT in…

On the Evaluation of Curriculum Reforms

ERIC Educational Resources Information Center

Hopmann, Stefan Thomas

2003-01-01

The paper considers the current international trend towards standards-based evaluation in a historical and comparative perspective. Based on a systematization of evaluation perspectives and tools, two basic patterns of curriculum control are discussed: process evaluation, and product evaluation. Whereas the first type has dominated the Continental…

SYSTEMATIC SCANNING ELECTRON MICROSCOPY TECHNIQUE FOR EVALUATING COMBINED BIOLOIGCAL/GRANULAR ACTIVATED CARBON TREATMENT PROCESSES

EPA Science Inventory

A systematic scanning election microscope analytical technique has been developed to examine granular activated carbon used a a medium for biomass attachment in liquid waste treatment. The procedure allows for the objective monitoring, comparing, and trouble shooting of combined ...

Repositioning an Academic Department to Stimulate Growth

ERIC Educational Resources Information Center

Elrod, Cassandra C.; Daughton, William J.; Murray, Susan L.; Fisher, Caroline M.; Flachsbart, Barry B.

2011-01-01

The complexity of the market in higher education, and the lack of literature regarding marketing, particularly branding, at the academic department level, presented an opportunity to establish a systematic process for evaluating an academic department's brand meaning. A process for evaluating a brand's meaning for an academic department is…

The systematic review as a research process in music therapy.

PubMed

Hanson-Abromeit, Deanna; Sena Moore, Kimberly

2014-01-01

Music therapists are challenged to present evidence on the efficacy of music therapy treatment and incorporate the best available research evidence to make informed healthcare and treatment decisions. Higher standards of evidence can come from a variety of sources including systematic reviews. To define and describe a range of research review methods using examples from music therapy and related literature, with emphasis on the systematic review. In addition, the authors provide a detailed overview of methodological processes for conducting and reporting systematic reviews in music therapy. The systematic review process is described in five steps. Step 1 identifies the research plan and operationalized research question(s). Step 2 illustrates the identification and organization of the existing literature related to the question(s). Step 3 details coding of data extracted from the literature. Step 4 explains the synthesis of coded findings and analysis to answer the research question(s). Step 5 describes the strength of evidence evaluation and results presentation for practice recommendations. Music therapists are encouraged to develop and conduct systematic reviews. This methodology contributes to review outcome credibility and can determine how information is interpreted and used by clinicians, clients or patients, and policy makers. A systematic review is a methodologically rigorous research method used to organize and evaluate extant literature related to a clinical problem. Systematic reviews can assist music therapists in managing the ever-increasing literature, making well-informed evidence based practice and research decisions, and translating existing music-based and nonmusic based literature to clinical practice and research development. © the American Music Therapy Association 2014. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Analysis of context factors in compulsory and incentive strategies for improving attraction and retention of health workers in rural and remote areas: a systematic review.

PubMed

Liu, Xiaoyun; Dou, Lixia; Zhang, Huan; Sun, Yang; Yuan, Beibei

2015-07-21

Current literature systematically reports that interventions to attract and retain health workers in underserved areas need to be context specific but rarely defines what that means. In this systematic review, we try to summarize and analyse context factors influencing the implementation of interventions to attract and retain rural health workers. We searched online databases, relevant websites and reference lists of selected literature to identify studies on compulsory rural service programmes and financial incentives. Forty studies were selected. Information regarding context factors at macro, meso and micro levels was extracted and synthesized. Macro-level context factors include political, economic and social factors. Meso-level factors include health system factors such as maldistribution of health workers, growing private sector, decentralization and health financing. Micro-level factors refer to the policy implementation process including funding sources, administrative agency, legislation process, monitoring and evaluation. Macro-, meso- and micro-level context factors can play different roles in agenda setting, policy formulation and implementation of health interventions to attract and retain rural health workers. These factors should be systematically considered in the different stages of policy process and evaluation.

Systematic and Scalable Testing of Concurrent Programs

DTIC Science & Technology

2013-12-16

The evaluation of CHESS [107] checked eight different programs ranging from process management libraries to a distributed execution engine to a research...tool (§3.1) targets systematic testing of scheduling nondeterminism in multi- threaded components of the Omega cluster management system [129], while...tool for systematic testing of multithreaded com- ponents of the Omega cluster management system [129]. In particular, §3.1.1 defines a model for

Consumption of ultra-processed foods and body fat during childhood and adolescence: a systematic review.

PubMed

Costa, Caroline Santos; Del-Ponte, Bianca; Assunção, Maria Cecília Formoso; Santos, Iná Silva

2018-01-01

To review the available literature on the association between consumption of ultra-processed foods and body fat during childhood and adolescence. A systematic review was conducted in the PubMed, Web of Science and LILACS databases. Studies that evaluated the association between consumption of ultra-processed food (exposure) and body fat (outcome) during childhood and adolescence were eligible. Healthy children and adolescents. Twenty-six studies that evaluated groups of ultra-processed foods (such as snacks, fast foods, junk foods and convenience foods) or specific ultra-processed foods (soft drinks/sweetened beverages, sweets, chocolate and ready-to-eat cereals) were selected. Most of the studies (n 15) had a cohort design. Consumption was generally evaluated by means of FFQ or food records; and body composition, by means of double indirect methods (bioelectrical impedance analysis and skinfolds). Most of the studies that evaluated consumption of groups of ultra-processed foods and soft drinks/sweetened beverages found positive associations with body fat. Our review showed that most studies have found positive associations between consumption of ultra-processed food and body fat during childhood and adolescence. There is a need to use a standardized classification that considers the level of food processing to promote comparability between studies.

Effective Supervisory Conferences: Strategies for Modifying Teacher Behavior.

ERIC Educational Resources Information Center

Young, David B.

This paper holds that the "supervisory" function should be basically one of teaching teachers rather than evaluation of teaching styles, with the consultant on teaching guiding a teacher in the systematic analysis and modification of his teaching performance through a systematic decisionmaking process. In the first half of this paper supervisory…

Study Sensitivity: Evaluating the Ability to Detect Effects in Systematic Reviews of Chemical Exposures

PubMed Central

Cooper, Glinda S.; Lunn, Ruth M.; Ågerstrand, Marlene; Glenn, Barbara S.; Kraft, Andrew D.; Luke, April M.; Ratcliffe, Jennifer M.

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as “sensitivity”, is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. PMID:27156196

Intelligent process mapping through systematic improvement of heuristics

NASA Technical Reports Server (NTRS)

Ieumwananonthachai, Arthur; Aizawa, Akiko N.; Schwartz, Steven R.; Wah, Benjamin W.; Yan, Jerry C.

1992-01-01

The present system for automatic learning/evaluation of novel heuristic methods applicable to the mapping of communication-process sets on a computer network has its basis in the testing of a population of competing heuristic methods within a fixed time-constraint. The TEACHER 4.1 prototype learning system implemented or learning new postgame analysis heuristic methods iteratively generates and refines the mappings of a set of communicating processes on a computer network. A systematic exploration of the space of possible heuristic methods is shown to promise significant improvement.

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals

PubMed Central

Beronius, Anna; Vandenberg, Laura N.

2016-01-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs. PMID:26847432

Using systematic reviews for hazard and risk assessment of endocrine disrupting chemicals.

PubMed

Beronius, Anna; Vandenberg, Laura N

2015-12-01

The possibility that endocrine disrupting chemicals (EDCs) in our environment contribute to hormonally related effects and diseases observed in human and wildlife populations has caused concern among decision makers and researchers alike. EDCs challenge principles traditionally applied in chemical risk assessment and the identification and assessment of these compounds has been a much debated topic during the last decade. State of the science reports and risk assessments of potential EDCs have been criticized for not using systematic and transparent approaches in the evaluation of evidence. In the fields of medicine and health care, systematic review methodologies have been developed and used to enable objectivity and transparency in the evaluation of scientific evidence for decision making. Lately, such approaches have also been promoted for use in the environmental health sciences and risk assessment of chemicals. Systematic review approaches could provide a tool for improving the evaluation of evidence for decision making regarding EDCs, e.g. by enabling systematic and transparent use of academic research data in this process. In this review we discuss the advantages and challenges of applying systematic review methodology in the identification and assessment of EDCs.

New Developments in the Technology Readiness Assessment Process in US DOE-EM - 13247

DOE Office of Scientific and Technical Information (OSTI.GOV)

Krahn, Steven; Sutter, Herbert; Johnson, Hoyt

2013-07-01

A Technology Readiness Assessment (TRA) is a systematic, metric-based process and accompanying report that evaluates the maturity of the technologies used in systems; it is designed to measure technology maturity using the Technology Readiness Level (TRL) scale pioneered by the National Aeronautics and Space Administration (NASA) in the 1980's. More recently, DoD has adopted and provided systematic guidance for performing TRAs and determining TRLs. In 2007 the GAO recommended that the DOE adopt the NASA/DoD methodology for evaluating technology maturity. Earlier, in 2006-2007, DOE-EM had conducted pilot TRAs on a number of projects at Hanford and Savannah River. In Marchmore » 2008, DOE-EM issued a process guide, which established TRAs as an integral part of DOE-EM's Project Management Critical Decision Process. Since the development of its detailed TRA guidance in 2008, DOE-EM has continued to accumulate experience in the conduct of TRAs and the process for evaluating technology maturity. DOE has developed guidance on TRAs applicable department-wide. DOE-EM's experience with the TRA process, the evaluations that led to recently developed proposed revisions to the DOE-EM TRA/TMP Guide; the content of the proposed changes that incorporate the above lessons learned and insights are described. (authors)« less

[Opportunity and challenge of post-marketing evaluation of traditional Chinese medicine].

PubMed

Du, Xiao-Xi; Song, Hai-Bo; Ren, Jing-Tian; Yang, Le; Guo, Xiao-Xin; Pang, Yu

2014-09-01

Post-marketing evaluation is a process which evaluate the risks and benefits of drug clinical application comprehensively and systematically, scientific and systematic results of post-marketing evaluation not only can provide data support for clinical application of traditional Chinese medicine, but also can be a reliable basis for the supervision department to develop risk control measures. With the increasing demands for treatment and prevention of disease, traditional Chinese medicine has been widely used, and security issues are also exposed. How to find risk signal of traditional Chinese medicine in the early stages, carry out targeted evaluation work and control risk timely have become challenges in the development of traditional Chinese medicine industry.

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards

PubMed Central

Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A. Metin

2015-01-01

Background Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. Objectives To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. Methods A systematic review was completed for the period 2000–2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Results Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Conclusions Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing. PMID:26418859

A Systematic Review of Reporting Tools Applicable to Sexual and Reproductive Health Programmes: Step 1 in Developing Programme Reporting Standards.

PubMed

Kågesten, Anna; Tunçalp, Ӧzge; Ali, Moazzam; Chandra-Mouli, Venkatraman; Tran, Nhan; Gülmezoglu, A Metin

2015-01-01

Complete and accurate reporting of programme preparation, implementation and evaluation processes in the field of sexual and reproductive health (SRH) is essential to understand the impact of SRH programmes, as well as to guide their replication and scale-up. To provide an overview of existing reporting tools and identify core items used in programme reporting with a focus on programme preparation, implementation and evaluation processes. A systematic review was completed for the period 2000-2014. Reporting guidelines, checklists and tools, irrespective of study design, applicable for reporting on programmes targeting SRH outcomes, were included. Two independent reviewers screened the title and abstract of all records. Full texts were assessed in duplicate, followed by data extraction on the focus, content area, year of publication, validation and description of reporting items. Data was synthesized using an iterative thematic approach, where items related to programme preparation, implementation and evaluation in each tool were extracted and aggregated into a consolidated list. Out of the 3,656 records screened for title and abstracts, full texts were retrieved for 182 articles, out of which 108 were excluded. Seventy-four full text articles corresponding to 45 reporting tools were retained for synthesis. The majority of tools were developed for reporting on intervention research (n = 15), randomized controlled trials (n = 8) and systematic reviews (n = 7). We identified a total of 50 reporting items, across three main domains and corresponding sub-domains: programme preparation (objective/focus, design, piloting); programme implementation (content, timing/duration/location, providers/staff, participants, delivery, implementation outcomes), and programme evaluation (process evaluation, implementation barriers/facilitators, outcome/impact evaluation). Over the past decade a wide range of tools have been developed to improve the reporting of health research. Development of Programme Reporting Standards (PRS) for SRH can fill a significant gap in existing reporting tools. This systematic review is the first step in the development of such standards. In the next steps, we will draft a preliminary version of the PRS based on the aggregate list of identified items, and finalize the tool using a consensus process among experts and user-testing.

Science-based regulatory and policy considerations in nutrition.

PubMed

Schneeman, Barbara

2015-05-01

Scientific evidence is necessary for the development of effective and enforceable regulations and government policy. To use scientific information appropriately, a systematic approach is needed for review and evaluation of the evidence. Federal agencies in the United States have developed useful approaches for such a review and evaluation to develop nutrition labeling, including health claims, and for updating of the Dietary Guidelines for Americans. The WHO is using a systematic evaluation process to update its recommendations on diet and health. The results of such reviews also highlight research needs to address relevant gaps in our knowledge. © 2015 American Society for Nutrition.

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

PubMed

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

The evolution of the cancer formulary review in Canada: Can centralization improve the use of economic evaluation?

PubMed

Wranik, W Dominika; Gambold, Liesl; Hanson, Natasha; Levy, Adrian

2017-04-01

Public reimbursement of drugs is a costly proposition for health care systems. Decisions to add drugs to the public formulary are often guided by review processes and committees. The evolution of the formulary review process in Canada's publicly funded health system is characterized by increased centralization and systematization. In the past, the review of evidence and recommendation was conducted at the regional level, but was replaced with the pan-Canadian Oncology Drug Review in 2011. We assess the extent to which centralization and systematization of the review process have responded to past challenges, focusing on the use of economic evaluation in the process. Past challenges with economic evaluation experienced by regionalized review committees were identified from literature and qualitative data collected in the province of Nova Scotia. We categorize these using a typology with a macro-, meso, and micro-level hierarchy, which provides a useful framework for understanding at which level change is required, and who has the authority to influence change. Using grounded theory methods, we identify approaches used by Nova Scotia past committee members to compensate for perceived shortcomings of the process. These include an undue reliance on other committee members, on the multidisciplinarity of the committee, and on past decisions. Using a policy analysis approach, we argue that centralization and systematization of the review process only partially address the shortcomings of the previous regionalized process. Lessons from Canada can inform policy discussions across all health systems, where similar challenges with the formulary review process have been identified. © 2016 The Authors. The International Journal of Health Planning and Management published by John Wiley & Sons Ltd. © 2016 The Authors. The International Journal of Health Planning and Management published by John Wiley & Sons Ltd.

"Learning to Play with New Friends": Systematic Quality Development Work in a Leisure-Time Centre

ERIC Educational Resources Information Center

Lager, Karin

2016-01-01

This article explores the recontextualisation of systematic quality development work (Sqdw) in a leisure-time centre. Two teachers' processes of planning, organisation, documentation and evaluation were investigated, the aim being to explore the recontextualisation of Sqdw in practice. The study is thus a case study of these teachers' practice…

Consumer evaluation of food with nutritional benefits: a systematic review and narrative synthesis.

PubMed

Mogendi, Joseph Birundu; De Steur, Hans; Gellynck, Xavier; Makokha, Anselimo

2016-06-01

As a consequence of the growing interest in, and development of, various types of food with nutritional benefits, the modern consumer views their kitchen cabinet more and more as a medicine cabinet. Given that consumer evaluation of food is considered key to the successful production, marketing and finally consumption of food, a procedure commonly used in medical fields was employed to systematically review and summarize evidence of consumer evaluation studies on nutritious foods. The focus is primarily on consumer understanding of nutritious food and the underlying determinants of consumer evaluation. Our results highlight four groups of key determinants: (1) nutrition knowledge and information; (2) attitudes, beliefs, perceptions and behavioural determinants; (3) price, process and product characteristics; and (4) socio-demographics. The findings also point to the importance of understanding consumer acceptance as one many concepts in the consumer evaluation process, and provide support for developing appropriate strategies for improving health and well-being of consumers.

Improving the Way Higher Education Institutions Study Themselves: Use and Impact of Academic Improvement Systems. Professional File. Number 118, Fall 2010

ERIC Educational Resources Information Center

Bender, Kim K.; Jonson, Jessica L.; Siller, Thomas J.

2010-01-01

Can higher education institutions continue using planning and self-evaluation processes that are decades old without any reform? Several recent monographs urge institutions to embrace continuous improvement processes that engage systematic planning and department self-evaluation across whole campuses, but they do not show institutions how to do…

Validation of virtual learning object to support the teaching of nursing care systematization.

PubMed

Salvador, Pétala Tuani Candido de Oliveira; Mariz, Camila Maria Dos Santos; Vítor, Allyne Fortes; Ferreira Júnior, Marcos Antônio; Fernandes, Maria Isabel Domingues; Martins, José Carlos Amado; Santos, Viviane Euzébia Pereira

2018-01-01

to describe the content validation process of a Virtual Learning Object to support the teaching of nursing care systematization to nursing professionals. methodological study, with quantitative approach, developed according to the methodological reference of Pasquali's psychometry and conducted from March to July 2016, from two-stage Delphi procedure. in the Delphi 1 stage, eight judges evaluated the Virtual Object; in Delphi 2 stage, seven judges evaluated it. The seven screens of the Virtual Object were analyzed as to the suitability of its contents. The Virtual Learning Object to support the teaching of nursing care systematization was considered valid in its content, with a Total Content Validity Coefficient of 0.96. it is expected that the Virtual Object can support the teaching of nursing care systematization in light of appropriate and effective pedagogical approaches.

Teaching Process Design through Integrated Process Synthesis

ERIC Educational Resources Information Center

Metzger, Matthew J.; Glasser, Benjamin J.; Patel, Bilal; Hildebrandt, Diane; Glasser, David

2012-01-01

The design course is an integral part of chemical engineering education. A novel approach to the design course was recently introduced at the University of the Witwatersrand, Johannesburg, South Africa. The course aimed to introduce students to systematic tools and techniques for setting and evaluating performance targets for processes, as well as…

Study sensitivity: Evaluating the ability to detect effects in systematic reviews of chemical exposures.

PubMed

Cooper, Glinda S; Lunn, Ruth M; Ågerstrand, Marlene; Glenn, Barbara S; Kraft, Andrew D; Luke, April M; Ratcliffe, Jennifer M

2016-01-01

A critical step in systematic reviews of potential health hazards is the structured evaluation of the strengths and weaknesses of the included studies; risk of bias is a term often used to represent this process, specifically with respect to the evaluation of systematic errors that can lead to inaccurate (biased) results (i.e. focusing on internal validity). Systematic review methods developed in the clinical medicine arena have been adapted for use in evaluating environmental health hazards; this expansion raises questions about the scope of risk of bias tools and the extent to which they capture the elements that can affect the interpretation of results from environmental and occupational epidemiology studies and in vivo animal toxicology studies, (the studies typically available for assessment of risk of chemicals). One such element, described here as "sensitivity", is a measure of the ability of a study to detect a true effect or hazard. This concept is similar to the concept of the sensitivity of an assay; an insensitive study may fail to show a difference that truly exists, leading to a false conclusion of no effect. Factors relating to study sensitivity should be evaluated in a systematic manner with the same rigor as the evaluation of other elements within a risk of bias framework. We discuss the importance of this component for the interpretation of individual studies, examine approaches proposed or in use to address it, and describe how it relates to other evaluation components. The evaluation domains contained within a risk of bias tool can include, or can be modified to include, some features relating to study sensitivity; the explicit inclusion of these sensitivity criteria with the same rigor and at the same stage of study evaluation as other bias-related criteria can improve the evaluation process. In some cases, these and other features may be better addressed through a separate sensitivity domain. The combined evaluation of risk of bias and sensitivity can be used to identify the most informative studies, to evaluate the confidence of the findings from individual studies and to identify those study elements that may help to explain heterogeneity across the body of literature. Copyright © 2016. Published by Elsevier Ltd.

Health information systems evaluation frameworks: A systematic review.

PubMed

Eslami Andargoli, Amirhossein; Scheepers, Helana; Rajendran, Diana; Sohal, Amrik

2017-01-01

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems. This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs. A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review. Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies. Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluating healthcare priority setting at the meso level: A thematic review of empirical literature

PubMed Central

Waithaka, Dennis; Tsofa, Benjamin; Barasa, Edwine

2018-01-01

Background: Decentralization of health systems has made sub-national/regional healthcare systems the backbone of healthcare delivery. These regions are tasked with the difficult responsibility of determining healthcare priorities and resource allocation amidst scarce resources. We aimed to review empirical literature that evaluated priority setting practice at the meso (sub-national) level of health systems. Methods: We systematically searched PubMed, ScienceDirect and Google scholar databases and supplemented these with manual searching for relevant studies, based on the reference list of selected papers. We only included empirical studies that described and evaluated, or those that only evaluated priority setting practice at the meso-level. A total of 16 papers were identified from LMICs and HICs. We analyzed data from the selected papers by thematic review. Results: Few studies used systematic priority setting processes, and all but one were from HICs. Both formal and informal criteria are used in priority-setting, however, informal criteria appear to be more perverse in LMICs compared to HICs. The priority setting process at the meso-level is a top-down approach with minimal involvement of the community. Accountability for reasonableness was the most common evaluative framework as it was used in 12 of the 16 studies. Efficiency, reallocation of resources and options for service delivery redesign were the most common outcome measures used to evaluate priority setting. Limitations: Our study was limited by the fact that there are very few empirical studies that have evaluated priority setting at the meso-level and there is likelihood that we did not capture all the studies. Conclusions: Improving priority setting practices at the meso level is crucial to strengthening health systems. This can be achieved through incorporating and adapting systematic priority setting processes and frameworks to the context where used, and making considerations of both process and outcome measures during priority setting and resource allocation. PMID:29511741

Benchmarking: A strategic overview of a key management tool

Treesearch

Chris Leclair

1999-01-01

Benchmarking is a continuous, systematic process for evaluating the products, services, and work processes of organizations in an effort to identifY best practices for possible adoption in support of the objectives of enhanced activity service delivery and organizational effectiveness.

Standards for Evaluation of Instructional Materials with Respect to Social Content.

ERIC Educational Resources Information Center

California State Dept. of Education, Sacramento. Curriculum Framework and Instructional Materials Unit.

The purpose of this document is to provide reasonable, systematic standards for evaluation of instructional materials upon which evaluators may base their judgments, so that the results of the evaluation process will be as nearly consistent and therefore, as equitable, as possible. The guidelines are based on the social content requirements of the…

Disability Policy Evaluation: Combining Logic Models and Systems Thinking.

PubMed

Claes, Claudia; Ferket, Neelke; Vandevelde, Stijn; Verlet, Dries; De Maeyer, Jessica

2017-07-01

Policy evaluation focuses on the assessment of policy-related personal, family, and societal changes or benefits that follow as a result of the interventions, services, and supports provided to those persons to whom the policy is directed. This article describes a systematic approach to policy evaluation based on an evaluation framework and an evaluation process that combine the use of logic models and systems thinking. The article also includes an example of how the framework and process have recently been used in policy development and evaluation in Flanders (Belgium), as well as four policy evaluation guidelines based on relevant published literature.

Systematic review automation technologies

PubMed Central

2014-01-01

Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time. PMID:25005128

Governance for public health and health equity: The Tröndelag model for public health work.

PubMed

Lillefjell, Monica; Magnus, Eva; Knudtsen, Margunn SkJei; Wist, Guri; Horghagen, Sissel; Espnes, Geir Arild; Maass, Ruca; Anthun, Kirsti Sarheim

2018-06-01

Multi-sectoral governance of population health is linked to the realization that health is the property of many societal systems. This study aims to contribute knowledge and methods that can strengthen the capacities of municipalities regarding how to work more systematically, knowledge-based and multi-sectoral in promoting health and health equity in the population. Process evaluation was conducted, applying a mixed-methods research design, combining qualitative and quantitative data collection methods. Processes strengthening systematic and multi-sectoral development, implementation and evaluation of research-based measures to promote health, quality of life, and health equity in, for and with municipalities were revealed. A step-by-step model, that emphasizes the promotion of knowledge-based, systematic, multi-sectoral public health work, as well as joint ownership of local resources, initiatives and policies has been developed. Implementation of systematic, knowledge-based and multi-sectoral governance of public health measures in municipalities demand shared understanding of the challenges, updated overview of the population health and impact factors, anchoring in plans, new skills and methods for selection and implementation of measures, as well as development of trust, ownership, shared ethics and goals among those involved.

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

PubMed

McInnes, Matthew D F; Moher, David; Thombs, Brett D; McGrath, Trevor A; Bossuyt, Patrick M; Clifford, Tammy; Cohen, Jérémie F; Deeks, Jonathan J; Gatsonis, Constantine; Hooft, Lotty; Hunt, Harriet A; Hyde, Christopher J; Korevaar, Daniël A; Leeflang, Mariska M G; Macaskill, Petra; Reitsma, Johannes B; Rodin, Rachel; Rutjes, Anne W S; Salameh, Jean-Paul; Stevens, Adrienne; Takwoingi, Yemisi; Tonelli, Marcello; Weeks, Laura; Whiting, Penny; Willis, Brian H

2018-01-23

Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

How Do Contextual Factors Influence Implementation and Receipt of Positive Youth Development Programs Addressing Substance Use and Violence? A Qualitative Meta-Synthesis of Process Evaluations.

PubMed

Dickson, Kelly; Melendez-Torres, G J; Fletcher, Adam; Hinds, Kate; Thomas, James; Stansfield, Claire; Murphy, Simon; Campbell, Rona; Bonell, Chris

2018-05-01

Positive youth development (PYD) often aims to prevent tobacco, alcohol, and drugs use and violence. We systematically reviewed PYD interventions, synthesizing process, and outcomes evidence. Synthesis of outcomes, published elsewhere, found no overall evidence of reducing substance use or violence but notable variability of fidelity. Our synthesis of process evaluations examined how implementation varied and was influenced by context. Process evaluations of PYD aiming to reduce substance use and violence. Study Inclusion Criteria: Overall review published since 1985; written in English; focused on youth aged 11 to 18 years; focused on interventions addressing multiple positive assets; reported on theory, process, or outcomes; and concerned with reducing substance use or violence. Synthesis of process evaluations examined how implementation varies with or is influenced by context. Two reviewers in parallel. Thematic synthesis. We identified 12 reports. Community engagement enhanced program appeal. Collaboration with other agencies could broaden the activities offered. Calm but authoritative staff increased acceptability. Staff continuity underpinned diverse activities and durable relationships. Empowering participants were sometimes in tension with requiring them to engage in diverse activities. Our systematic review identified factors that might help improve the fidelity and acceptability of PYD interventions. Addressing these might enable PYD to fulfill its potential as a means of promoting health.

Improving data collection processes for routine evaluation of treatment cost-effectiveness.

PubMed

Monto, Sari; Penttilä, Riku; Kärri, Timo; Puolakka, Kari; Valpas, Antti; Talonpoika, Anna-Maria

2016-04-01

The healthcare system in Finland has begun routine collection of health-related quality of life (HRQoL) information for patients in hospitals to support more systematic cost-effectiveness analysis (CEA). This article describes the systematic collection of HRQoL survey data, and addresses challenges in the implementation of patient surveys and acquisition of cost data in the case hospital. Challenges include problems with incomplete data and undefined management processes. In order to support CEA of hospital treatments, improvements are sought from the process management literature and in the observation of healthcare professionals. The article has been written from an information system and process management perspective, concluding that process ownership, automation of data collection and better staff training are keys to generating more reliable data.

Relation of completeness of reporting of health research to journals’ endorsement of reporting guidelines: systematic review

PubMed Central

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F

2014-01-01

Objective To assess whether the completeness of reporting of health research is related to journals’ endorsement of reporting guidelines. Design Systematic review. Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed “evaluations”) (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals’ websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors’ analysis, a mean summed score. Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. Conclusions The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals’ endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals’ endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews. PMID:24965222

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Dental Students' Use of AMSTAR to Critically Appraise Systematic Reviews.

PubMed

Teich, Sorin T; Heima, Masahiro; Lang, Lisa

2015-09-01

The idea of basing clinical procedures upon evidence gathered by observation is less than 200 years old, with the first set of evidence-based position papers dating back only to the early 1970s. The relationship between evidence-based education and health outcomes is difficult to test and may be indirect, but teaching critical appraisal skills may be beneficial in developing knowledge. Systematic reviews have a central role in the process of clinical decision making in practice and therefore should be of high quality, following a rigorous protocol that can be evaluated with validated tools. The aim of this study was to assess how dental students utilized the Assessment of Multiple Systematic Reviews (AMSTAR) appraisal tool to evaluate systematic reviews in the context of a treatment planning course. During the in-class final exam, students were required to appraise the quality of a systematic review and to justify their answers. Of the 74 third-year students who took the exam, 100% answered all questions on the AMSTAR form. The mean number of correct answers was nine (SD=1.047, Min=6, Max=10), with no student providing all 11 correct answers. The fact that nearly 90% of the students provided eight or more correct answers suggests that AMSTAR can be used by students to evaluate the methodological quality of systematic reviews. It also was evident that although the AMSTAR tool requires less than 15 minutes to complete an evaluation, using it requires extensive training and repetition to achieve consistent and reliable results.

What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review.

PubMed

Bach-Mortensen, Anders Malthe; Montgomery, Paul

2018-01-22

The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of support, resources and clarity on appropriate outcome indicators suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements. Future efforts should address the application of EBP as part of the commissioning process of TSOs.

Adopting Health Behavior Change Theory throughout the Clinical Practice Guideline Process

ERIC Educational Resources Information Center

Ceccato, Natalie E.; Ferris, Lorraine E.; Manuel, Douglas; Grimshaw, Jeremy M.

2007-01-01

Adopting a theoretical framework throughout the clinical practice guideline (CPG) process (development, dissemination, implementation, and evaluation) can be useful in systematically identifying, addressing, and explaining behavioral influences impacting CPG uptake and effectiveness. This article argues that using a theoretical framework should…

Consensus Recommendations for Systematic Evaluation of Drug-Drug Interaction Evidence for Clinical Decision Support

PubMed Central

Scheife, Richard T.; Hines, Lisa E.; Boyce, Richard D.; Chung, Sophie P.; Momper, Jeremiah; Sommer, Christine D.; Abernethy, Darrell R.; Horn, John; Sklar, Stephen J.; Wong, Samantha K.; Jones, Gretchen; Brown, Mary; Grizzle, Amy J.; Comes, Susan; Wilkins, Tricia Lee; Borst, Clarissa; Wittie, Michael A.; Rich, Alissa; Malone, Daniel C.

2015-01-01

Background Healthcare organizations, compendia, and drug knowledgebase vendors use varying methods to evaluate and synthesize evidence on drug-drug interactions (DDIs). This situation has a negative effect on electronic prescribing and medication information systems that warn clinicians of potentially harmful medication combinations. Objective To provide recommendations for systematic evaluation of evidence from the scientific literature, drug product labeling, and regulatory documents with respect to DDIs for clinical decision support. Methods A conference series was conducted to develop a structured process to improve the quality of DDI alerting systems. Three expert workgroups were assembled to address the goals of the conference. The Evidence Workgroup consisted of 15 individuals with expertise in pharmacology, drug information, biomedical informatics, and clinical decision support. Workgroup members met via webinar from January 2013 to February 2014. Two in-person meetings were conducted in May and September 2013 to reach consensus on recommendations. Results We developed expert-consensus answers to three key questions: 1) What is the best approach to evaluate DDI evidence?; 2) What evidence is required for a DDI to be applicable to an entire class of drugs?; and 3) How should a structured evaluation process be vetted and validated? Conclusion Evidence-based decision support for DDIs requires consistent application of transparent and systematic methods to evaluate the evidence. Drug information systems that implement these recommendations should be able to provide higher quality information about DDIs in drug compendia and clinical decision support tools. PMID:25556085

Seeking consent for research with indigenous communities: a systematic review.

PubMed

Fitzpatrick, Emily F M; Martiniuk, Alexandra L C; D'Antoine, Heather; Oscar, June; Carter, Maureen; Elliott, Elizabeth J

2016-10-22

When conducting research with Indigenous populations consent should be sought from both individual participants and the local community. We aimed to search and summarise the literature about methods for seeking consent for research with Indigenous populations. A systematic literature search was conducted for articles that describe or evaluate the process of seeking informed consent for research with Indigenous participants. Guidelines for ethical research and for seeking consent with Indigenous people are also included in our review. Of 1447 articles found 1391 were excluded (duplicates, irrelevant, not in English); 56 were relevant and included. Articles were categorised into original research that evaluated the consent process (n = 5) or publications detailing the process of seeking consent (n = 13) and guidelines for ethical research (n = 38). Guidelines were categorised into international (n = 8); national (n = 20) and state/regional/local guidelines (n = 10). In five studies based in Australia, Canada and The United States of America the consent process with Indigenous people was objectively evaluated. In 13 other studies interpreters, voice recording, videos, pictures, flipcharts and "plain language" forms were used to assist in seeking consent but these processes were not evaluated. Some Indigenous organisations provide examples of community-designed resources for seeking consent and describe methods of community engagement, but none are evaluated. International, national and local ethical guidelines stress the importance of upholding Indigenous values but fail to specify methods for engaging communities or obtaining individual consent. In the 'Grey literature' concerns about the consent process are identified but no solutions are offered. Consultation with Indigenous communities is needed to determine how consent should be sought from the community and the individual, and how to evaluate this process.

OPPE, FPPE, QPS, and why the alphabet soup of physician assessment is essential for safer patient care.

PubMed

Loftus, Michael L

Creating a successful quality and patient safety program requires a multifaceted approach that systematically reviews overall systems and processes, but also creates a standardized framework for evaluating individual practitioner performance on a routine basis. There are two required elements of competency assessment that are typically tied to the hospital credentialing process: ongoing professional practice evaluation (OPPE) and focused professional practice evaluation (FPPE). Each of these processes are mandated by the Joint Commission, and form an important cornerstone for ensuring adequate physician performance and knowledge base. Copyright © 2017. Published by Elsevier Inc.

Integration of care for hypertension and diabetes: a scoping review assessing the evidence from systematic reviews and evaluating reporting.

PubMed

Yiu, Kristy C; Rohwer, Anke; Young, Taryn

2018-06-20

With the rise in pre-mature mortality rate from non-communicable disease (NCD), there is a need for evidence-based interventions. We evaluated existing systematic reviews on effectiveness of integration of healthcare services, in particular with focus on delivery of care designed to improve health and process outcomes in people with multi-morbidity, where at least one of the conditions was diabetes or hypertension. We searched MEDLINE, EMBASE, Cochrane Library, and Health Evidence to November 8, 2016 and consulted experts. One review author screened titles, abstracts and two review authors independently screened short listed full-texts and selected reviews for inclusion. We considered systematic reviews evaluating integration of care, compared to usual care, for people with multi-morbidity. One review author extracted data and another author verified it. Two review authors independently evaluated risk of bias using ROBIS and AMSTAR. Inter-rater reliability was analysed for ROBIS and AMSTAR using Cohen's kappa and percent agreement. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was used to assess reporting. We identified five systematic reviews on integration of care. Four reviews focused on comorbid diabetes and depression and two covered hypertension and comorbidities of cardiovascular disease, depression, or diabetes. Interventions were poorly described. The health outcomes evaluated included risk of all-cause mortality, measures of depression, cholesterol levels, HbA1c levels, effect of depression on HbA1c levels, symptom improvement, systolic blood pressure, and hypertension control. Process outcomes included access and utilisation of healthcare services, costs, and quality of care. Overall, three reviews had a low and medium risk of bias according to ROBIS and AMSTAR respectively, while two reviews had high risk of bias as judged by both ROBIS and AMSTAR. Findings have demonstrated that collaborative care in general resulted in better health and process outcomes when compared to usual care for both depression and diabetes and hypertension and diabetes. Several knowledge gaps were identified on integration of care for comorbidities with diabetes and/or hypertension: limited research on this topic for hypertension, limited reviews that included primary studies based in low-middle income countries, and limited reviews on collaborative care for communicable and NCDs.

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies.

PubMed

Esteban, Eva; Coenen, Michaela; Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Leonardi, Matilde; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C; Kovačič, Dare S; Ivandic, Ivana; Sabariego, Carla

2018-05-18

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe.

Views and Experiences of Persons with Chronic Diseases about Strategies that Aim to Integrate and Re-Integrate Them into Work: A Systematic Review of Qualitative Studies

PubMed Central

Ito, Elizabeth; Gruber, Sonja; Scaratti, Chiara; Roka, Olga; Vasilou, Evdokia; Muñoz-Murillo, Amalia; Ávila, Carolina C.; Kovačič, Dare S.; Ivandic, Ivana

2018-01-01

The effectiveness of strategies targeting professional integration and reintegration strongly depends on the experiences of participants. The aim of this systematic literature review is to synthesize European qualitative studies exploring views and experiences of persons with chronic conditions regarding strategies for integration and reintegration into work. The systematic search was conducted in Medline, PsycINFO, CDR-HTA, CDR-DARE and Cochrane Systematic Reviews. Overall, 24 studies published in English between January 2011 and April 2016 were included. Most studies were carried out in Nordic countries or in the UK, and most participants were persons with either mental or musculoskeletal disorders. Ten themes emerged: individual and holistic approach, clarity of strategy and processes, timing of rehabilitation processes, experience with professionals, at the workplace and with peer groups, changes in the understanding of health and work, active involvement in the process, competencies development and motivating aspects of work. Findings highlight, among others, the need to actively involve participants in the return to work process and to provide timely and clearly structured processes and interventions. This review provides stakeholders key information to develop, plan, implement and evaluate interventions to integrate and re-integrate persons with chronic conditions into work in Europe. PMID:29783671

Systematic iteration between model and methodology: A proposed approach to evaluating unintended consequences.

PubMed

Morell, Jonathan A

2018-06-01

This article argues that evaluators could better deal with unintended consequences if they improved their methods of systematically and methodically combining empirical data collection and model building over the life cycle of an evaluation. This process would be helpful because it can increase the timespan from when the need for a change in methodology is first suspected to the time when the new element of the methodology is operational. The article begins with an explanation of why logic models are so important in evaluation, and why the utility of models is limited if they are not continually revised based on empirical evaluation data. It sets the argument within the larger context of the value and limitations of models in the scientific enterprise. Following will be a discussion of various issues that are relevant to model development and revision. What is the relevance of complex system behavior for understanding predictable and unpredictable unintended consequences, and the methods needed to deal with them? How might understanding of unintended consequences be improved with an appreciation of generic patterns of change that are independent of any particular program or change effort? What are the social and organizational dynamics that make it rational and adaptive to design programs around single-outcome solutions to multi-dimensional problems? How does cognitive bias affect our ability to identify likely program outcomes? Why is it hard to discern change as a result of programs being embedded in multi-component, continually fluctuating, settings? The last part of the paper outlines a process for actualizing systematic iteration between model and methodology, and concludes with a set of research questions that speak to how the model/data process can be made efficient and effective. Copyright © 2017 Elsevier Ltd. All rights reserved.

Benefits of the NADE Certification Process: Self-Knowledge, Informed Choices & Programmatic Strength

ERIC Educational Resources Information Center

Greci, Dana

2016-01-01

Research shows that systematic, ongoing program evaluation is needed to adequately assess the effectiveness of developmental programs. Ongoing evaluation provides both (1) validation of programs to educational institutions and legislators; and (2) impetus for program improvement. The author of this article works in the Developmental Education…

Luminescent microporous metal–organic framework with functional Lewis basic sites on the pore surface: Quantifiable evaluation of luminescent sensing mechanisms towards Fe{sup 3+}

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jin, Jun-Cheng; Technology Promotion Center of Nano Composite Material of Biomimetic Sensor and Detecting Technology, Preparation and Application, Anhui Provincial Laboratory West Anhui University, Anhui 237012; Guo, Rui-Li

2016-11-15

A systematic study has been conducted on a novel luminescent metal-organic framework, ([Zn(bpyp)(L-OH)]·DMF·2H{sub 2}O){sub n} (1), to explore its sensing mechanisms to Fe{sup 3+}. Structure analyses show that compound 1 exist pyridine N atoms and -OH groups on the pore surface for specific sensing of metal ions via Lewis acid-base interactions. On this consideration, the quenching mechanisms are studied and the processes are controlled by multiple mechanisms in which dynamic and static mechanisms are calculated, achieving the quantification evaluation of the quenching process. This work not only achieves the quantitative evaluation of the luminescence quenching but also provides certain insightsmore » into the quenching process, and the possible mechanisms explored in this work may inspire future research and design of target luminescent metal-organic frameworks (LMOFs) with specific functions. - Graphical abstract: A systematic study has been conducted on a novel luminescent metal-organic framework to explore its sensing mechanisms to Fe{sup 3+}. The quenching mechanisms are studied and the processes are controlled by multiple mechanisms in which dynamic and static mechanisms are calculated, achieving the quantification evaluation of the quenching process. - Highlights: • A novel porous luminescent MOF containing uncoordinated groups in interlayer channels was successfully synthesized. • The compound 1 can exhibit significant luminescent sensitivity to Fe{sup 3+}, which make its good candidate as luminescent sensor. • The corresponding dynamic and static quenching constants are calculated, achieving the quantification evaluation of the quenching process.« less

A Fifteen-Year Forecast of Information-Processing Technology. Final Report.

ERIC Educational Resources Information Center

Bernstein, George B.

This study developed a variation of the DELPHI approach, a polling technique for systematically soliciting opinions from experts, to produce a technological forecast of developments in the information-processing industry. SEER (System for Event Evaluation and Review) combines the more desirable elements of existing techniques: (1) intuitive…

Historical Research: Guidelines for Graduate Students.

ERIC Educational Resources Information Center

Nel, Johanna

Overviews of the process of historical research and the writing of a successful historical essay or dissertation are presented. Historical research is defined as the systematic process of collecting and objectively evaluating data related to past occurrences to arrive at conclusions about the causes, effects, or trends of past events that may be…

Developing and Implementing a Process for the Review of Nonacademic Units.

ERIC Educational Resources Information Center

Brown, Marilyn K.

1989-01-01

A major research university's recently developed process for systematic evaluation of nonacademic units is described, and the steps in its development and implementation are outlined: review of literature on organizational effectiveness; survey of peer institutions; development of guidelines for review; and implementation in several campus units.…

Quality assessment of systematic reviews on alveolar socket preservation.

PubMed

Moraschini, V; Barboza, E Dos S P

2016-09-01

The aim of this overview was to evaluate and compare the quality of systematic reviews, with or without meta-analysis, that have evaluated studies on techniques or biomaterials used for the preservation of alveolar sockets post tooth extraction in humans. An electronic search was conducted without date restrictions using the Medline/PubMed, Cochrane Library, and Web of Science databases up to April 2015. Eligibility criteria included systematic reviews, with or without meta-analysis, focused on the preservation of post-extraction alveolar sockets in humans. Two independent authors assessed the quality of the included reviews using AMSTAR and the checklist proposed by Glenny et al. in 2003. After the selection process, 12 systematic reviews were included. None of these reviews obtained the maximum score using the quality assessment tools implemented, and the results of the analyses were highly variable. A significant statistical correlation was observed between the scores of the two checklists. A wide structural and methodological variability was observed between the systematic reviews published on the preservation of alveolar sockets post tooth extraction. None of the reviews evaluated obtained the maximum score using the two quality assessment tools implemented. Copyright © 2016 International Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Older adults' perspectives on the process of becoming users of assistive technology: a qualitative systematic review and meta-synthesis.

PubMed

Larsen, Stina Meyer; Mortensen, Rikke Falgreen; Kristensen, Hanne Kaae; Hounsgaard, Lise

2018-04-22

To identify, synthesize, and evaluate existing literature concerning the process of becoming a user of assistive technology (AT). A systematic review and meta-synthesis were carried out. Five bibliographic databases (MEDLINE via PubMed, CINAHL, Web of Science, PsycINFO and SocINDEX) were systematically searched up to 13 th of March 2017, using two sets of search terms: (i) elderly and synonyms and (ii) assistive technology and similar words, and combined with a qualitative research filter. Articles were screened, read and critically assessed. The meta-synthesis was guided by Ricoeur's theory of interpretation. Seventeen out of 4645 articles were included. Five phases emerged relating to the process of becoming a user of AT: phase A: Evaluating need, phase B: Acknowledging need, phase C: Incorporating the AT into daily life, phase D: Using the AT, and phase E: Future use. Three transitions, describing factors essential to moving from one phase to the next, were identified; from phase A-B: Valued activities are threatened, from phase B-C: Obtaining the AT and from phase C-D: Trust in the AT. No transition was identified from phase D-E. The meta-synthesis led to a deeper understanding of the process of older adults becoming users of AT, by exploring findings across the included articles. The identified phases and transitions in the systematic review serve as an analytical framework for understanding the process from the older adult's perspective. This review advocates for using a client-centred approach throughout the entire delivery process. Implications for rehabilitation The process of the older adult becoming a user of AT involves an individualized time factor, and this supports the practice of individualized follow-up. The process of becoming a user of AT is closely related to self-image; healthcare professionals should support not only the use of AT but also the older adult's emotional adjustment to a new self-image. The process is highly influenced by the older adult's social context; healthcare professionals should consider involving the client's social network in the AT delivery process.

[Coordination among healthcare levels: systematization of tools and measures].

PubMed

Terraza Núñez, Rebeca; Vargas Lorenzo, Ingrid; Vázquez Navarrete, María Luisa

2006-01-01

Improving healthcare coordination is a priority in many healthcare systems, particularly in chronic health problems in which a number of professionals and services intervene. There is an abundance of coordination strategies and mechanisms that should be systematized so that they can be used in the most appropriate context. The present article aims to analyse healthcare coordination and its instruments using the organisational theory. Coordination mechanisms can be classified according to two basic processes used to coordinate activities: programming and feedback. The optimal combination of mechanisms will depend on three factors: the degree to which healthcare activities are differentiated, the volume and type of interdependencies, and the level of uncertainty. Historically, healthcare services have based coordination on skills standardization and, most recently, on processes standardization, through clinical guidelines, maps, and plans. Their utilisation is unsatisfactory in chronic diseases involving intervention by several professionals with reciprocal interdependencies, variability in patients' response to medical interventions, and a large volume of information to be processed. In this case, mechanisms based on feedback, such as working groups, linking professionals and vertical information systems, are more effective. To date, evaluation of healthcare coordination has not been conducted systematically, using structure, process and results indicators. The different strategies and instruments have been applied mainly to long-term care and mental health and one of the challenges to healthcare coordination is to extend and evaluate their use throughout the healthcare continuum.

How is genetic testing evaluated? A systematic review of the literature.

PubMed

Pitini, Erica; De Vito, Corrado; Marzuillo, Carolina; D'Andrea, Elvira; Rosso, Annalisa; Federici, Antonio; Di Maria, Emilio; Villari, Paolo

2018-05-01

Given the rapid development of genetic tests, an assessment of their benefits, risks, and limitations is crucial for public health practice. We performed a systematic review aimed at identifying and comparing the existing evaluation frameworks for genetic tests. We searched PUBMED, SCOPUS, ISI Web of Knowledge, Google Scholar, Google, and gray literature sources for any documents describing such frameworks. We identified 29 evaluation frameworks published between 2000 and 2017, mostly based on the ACCE Framework (n = 13 models), or on the HTA process (n = 6), or both (n = 2). Others refer to the Wilson and Jungner screening criteria (n = 3) or to a mixture of different criteria (n = 5). Due to the widespread use of the ACCE Framework, the most frequently used evaluation criteria are analytic and clinical validity, clinical utility and ethical, legal and social implications. Less attention is given to the context of implementation. An economic dimension is always considered, but not in great detail. Consideration of delivery models, organizational aspects, and consumer viewpoint is often lacking. A deeper analysis of such context-related evaluation dimensions may strengthen a comprehensive evaluation of genetic tests and support the decision-making process.

Is compensation "bad for health"? A systematic meta-review.

PubMed

Spearing, Natalie M; Connelly, Luke B

2011-01-01

There is a common perception that injury compensation has a negative impact on health status, and systematic reviews supporting this thesis have been used to influence policy and practice decisions. This study evaluates the quality of the empirical evidence of a negative correlation between injury compensation and health outcomes, based on systematic reviews involving both verifiable and non-verifiable injuries. Systematic meta-review (a "review of reviews"). PubMED, CINAHL, EMBASE, PEDro, PsycInfo, EconLit, Lexis, ABI/INFORM, The Cochrane Library, and the AHRQ EPC were searched from the date of their inception to August 2008, and hand searches were conducted. Selection criteria were established a priori. Included systematic reviews examined the impact of compensation on health, involved adults, were published in English and used a range of outcome measures. Two investigators independently applied standard instruments to evaluate the methodological quality of the included reviews. Data on compensation scheme design (i.e., the intervention) and outcome measures were also extracted. Eleven systematic reviews involving verifiable and non-verifiable injuries met the inclusion criteria. Nine reviews reported an association between compensation and poor health outcomes. All of them were affected by the generally low quality of the primary (observational) research in this field, the heterogeneous nature of compensation laws (schemes) and legal processes for seeking compensation, and the difficulties in measuring compensation in relation to health. Notwithstanding the limitations of the research in this field, one higher quality review examining a single compensation process and relying on primary studies using health outcome (rather than proxy) measures found strong evidence of no association between litigation and poor health following whiplash, challenging the general belief that legal processes have a negative impact on health status. Moves to alter scheme design and limit access to compensation on the basis that it is "bad for health" are therefore premature, as evidence of such an association is unclear. 2009 Elsevier Ltd. All rights reserved.

Implementation of Systematic Review Tools in IRIS | Science ...

EPA Pesticide Factsheets

Currently, the number of chemicals present in the environment exceeds the ability of public health scientists to efficiently screen the available data in order to produce well-informed human health risk assessments in a timely manner. For this reason, the US EPA’s Integrated Risk Information System (IRIS) program has started implementing new software tools into the hazard characterization workflow. These automated tools aid in multiple phases of the systematic review process including scoping and problem formulation, literature search, and identification and screening of available published studies. The increased availability of these tools lays the foundation for automating or semi-automating multiple phases of the systematic review process. Some of these software tools include modules to facilitate a structured approach to study quality evaluation of human and animal data, although approaches are generally lacking for assessing complex mechanistic information, in particular “omics”-based evidence tools are starting to become available to evaluate these types of studies. We will highlight how new software programs, online tools, and approaches for assessing study quality can be better integrated to allow for a more efficient and transparent workflow of the risk assessment process as well as identify tool gaps that would benefit future risk assessments. Disclaimer: The views expressed here are those of the authors and do not necessarily represent the view

Test Item Analysis: An Educator Professionalism Approach

ERIC Educational Resources Information Center

Hamzah, Mohd Sahandri Gani; Abdullah, Saifuddin Kumar

2011-01-01

The evaluation of learning is a systematic process involving testing, measuring and evaluation. In the testing step, a teacher needs to choose the best instrument that can test the minds of students. Testing will produce scores or marks with many variations either in homogeneous or heterogeneous forms that will be used to categorize the scores…

An Overview on Evaluation of E-Learning/Training Response Time Considering Artificial Neural Networks Modeling

ERIC Educational Resources Information Center

Mustafa, Hassan M. H.; Tourkia, Fadhel Ben; Ramadan, Ramadan Mohamed

2017-01-01

The objective of this piece of research is to interpret and investigate systematically an observed brain functional phenomenon which is associated with proceeding of e-learning processes. More specifically, this work addresses an interesting and challenging educational issue concerned with dynamical evaluation of elearning performance considering…

Regional Medical Program; Guidelines for Evaluation.

ERIC Educational Resources Information Center

Dean, Gary S., And Others

This set of guidelines was written to provide a systematic explanation of the process of evaluation applied to Regional Medical Programs, as required by Public Law 89-239. Goals of the programs are the improvement of health care of patients suffering from heart disease, cancer, stroke and related diseases and improvement in the practice of health…

Making progress with the automation of systematic reviews: principles of the International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

Beller, Elaine; Clark, Justin; Tsafnat, Guy; Adams, Clive; Diehl, Heinz; Lund, Hans; Ouzzani, Mourad; Thayer, Kristina; Thomas, James; Turner, Tari; Xia, Jun; Robinson, Karen; Glasziou, Paul

2018-05-19

Systematic reviews (SR) are vital to health care, but have become complicated and time-consuming, due to the rapid expansion of evidence to be synthesised. Fortunately, many tasks of systematic reviews have the potential to be automated or may be assisted by automation. Recent advances in natural language processing, text mining and machine learning have produced new algorithms that can accurately mimic human endeavour in systematic review activity, faster and more cheaply. Automation tools need to be able to work together, to exchange data and results. Therefore, we initiated the International Collaboration for the Automation of Systematic Reviews (ICASR), to successfully put all the parts of automation of systematic review production together. The first meeting was held in Vienna in October 2015. We established a set of principles to enable tools to be developed and integrated into toolkits.This paper sets out the principles devised at that meeting, which cover the need for improvement in efficiency of SR tasks, automation across the spectrum of SR tasks, continuous improvement, adherence to high quality standards, flexibility of use and combining components, the need for a collaboration and varied skills, the desire for open source, shared code and evaluation, and a requirement for replicability through rigorous and open evaluation.Automation has a great potential to improve the speed of systematic reviews. Considerable work is already being done on many of the steps involved in a review. The 'Vienna Principles' set out in this paper aim to guide a more coordinated effort which will allow the integration of work by separate teams and build on the experience, code and evaluations done by the many teams working across the globe.

Conducting systematic reviews of economic evaluations.

PubMed

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other types of evidence. The updated JBI guidance will be useful for researchers wanting to synthesize evidence about economic questions, either as stand-alone reviews or part of comprehensive or mixed method evidence reviews. Although the updated methodology produced by the work of the working group has improved the JBI guidance for systematic reviews of economic evaluations, there are areas where further work is required. These include adjusting the critical appraisal tool to separate out questions addressing intervention cost and effectiveness measurement; providing more explicit guidance for assessing generalizability of findings; and offering a more robust method for evidence synthesis that facilitates achieving the more ambitious review objectives.

Are we measuring what matters in health technology assessment of disease management? Systematic literature review.

PubMed

Steuten, Lotte; Vrijhoef, Bert; Severens, Hans; van Merode, Frits; Spreeuwenberg, Cor

2006-01-01

An overview was produced of indicators currently used to assess disease management programs and, based on these findings, provide a framework regarding sets of indicators that should be used when taking the aims and types of disease management programs into account. A systematic literature review was performed. Thirty-six studies met the inclusion criteria. It appeared that a link between aims of disease management and evaluated structure, process, as well as outcome indicators does not exist in a substantial part of published studies on disease management of diabetes and asthma/chronic obstructive pulmonary disease, especially when efficiency of care is concerned. Furthermore, structure indicators are largely missing from the evaluations, although these are of major importance for the interpretation of outcomes for purposes of decision-making. Efficiency of disease management is mainly evaluated by means of process indicators; the use of outcome indicators is less common. Within a framework, structure, process, and outcome indicators for effectiveness and efficiency are recommended for each type of disease management program. The link between aims of disease management and evaluated structure, process, and outcome indicators does not exist in a substantial part of published studies on disease management. The added value of this study mainly lies in the development of a framework to guide the choice of indicators for health technology assessment of disease management.

Design and Simulation Plant Layout Using Systematic Layout Planning

NASA Astrophysics Data System (ADS)

Suhardini, D.; Septiani, W.; Fauziah, S.

2017-12-01

This research aims to design the factory layout of PT. Gunaprima Budiwijaya in order to increase production capacity. The problem faced by this company is inappropriate layout causes cross traffic on the production floor. The re-layout procedure consist of these three steps: analysing the existing layout, designing plant layout based on SLP and evaluation and selection of alternative layout using Simulation Pro model version 6. Systematic layout planning is used to re-layout not based on the initial layout. This SLP produces four layout alternatives, and each alternative will be evaluated based on two criteria, namely cost of material handling using Material Handling Evaluation Sheet (MHES) and processing time by simulation. The results showed that production capacity is increasing as much as 37.5% with the addition of the machine and the operator, while material handling cost was reduced by improvement of the layout. The use of systematic layout planning method reduces material handling cost of 10,98% from initial layout or amounting to Rp1.229.813,34.

Pilot Guidelines for Improving Instructional Materials Through the Process of Learner Verification and Revision.

ERIC Educational Resources Information Center

Educational Products Information Exchange Inst., Stony Brook, NY.

Learner Verification and Revision (LVR) Process of Instructional Materials is an ongoing effort for the improvement of instructional materials based on systematic feedback from learners who have used the materials. This evaluation gives publishers a method of identifying instructional strengths and weaknesses of a product and provides an…

A computer-based tutorial structure for teaching and applying a complex process

Treesearch

Daniel L. Schmoldt; William G Bradshaw

1991-01-01

Economic accountability concerns for wildfire prevention planning have led to the development of an ignition management approach to fire problems. The Fire Loss Prevention Planning Process (FLPPP) systematizes fire problem analyses and concomitantly establishes a means for evaluating prescribed prevention programs. However, new users of the FLPPP have experienced...

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties.

PubMed

Mansutti, Irene; Saiani, Luisa; Grassetti, Luca; Palese, Alvisa

2017-03-01

The clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date. The aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available. A systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines). The Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016. The included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used. The search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated. Clinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement. Copyright © 2017 Elsevier Ltd. All rights reserved.

Making effective referrals: a knowledge-management approach.

PubMed Central

Einbinder, J. S.; Klein, D. A.; Safran, C. S.

1997-01-01

Patients and physicians often choose specially consultants with only limited knowledge of the available options. Access to information about specialists that was directly relevant to patient and clinician preferences could improve the effectiveness of the referral process. We have developed a prescriptive representation of the process of selecting consultants. This "referral map," based on decision theory, uses patient and provider preferences elicited through a literature review and interviews with physicians and provides a formal framework for representing referral knowledge and for evaluating referral options. Our method suggests that the goals and processes of selecting consultants can be managed more systematically using explicit repositories. Such systematic management promises to have a beneficial impact on the delivery of health care, as well as on patient satisfaction. PMID:9357642

Process evaluation of the Enabling Mothers toPrevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial.

PubMed

Knowlden, Adam P; Sharma, Manoj

2014-09-01

Family-and-home-based interventions are an important vehicle for preventing childhood obesity. Systematic process evaluations have not been routinely conducted in assessment of these interventions. The purpose of this study was to plan and conduct a process evaluation of the Enabling Mothers to Prevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial. The trial was composed of two web-based, mother-centered interventions for prevention of obesity in children between 4 and 6 years of age. Process evaluation used the components of program fidelity, dose delivered, dose received, context, reach, and recruitment. Categorical process evaluation data (program fidelity, dose delivered, dose exposure, and context) were assessed using Program Implementation Index (PII) values. Continuous process evaluation variables (dose satisfaction and recruitment) were assessed using ANOVA tests to evaluate mean differences between groups (experimental and control) and sessions (sessions 1 through 5). Process evaluation results found that both groups (experimental and control) were equivalent, and interventions were administered as planned. Analysis of web-based intervention process objectives requires tailoring of process evaluation models for online delivery. Dissemination of process evaluation results can advance best practices for implementing effective online health promotion programs. © 2014 Society for Public Health Education.

A Systematic Literature Review on Evaluation of Digital Tools for Authoring Evidence-Based Clinical Guidelines.

PubMed

Khodambashi, Soudabeh; Nytrø, Øystein

2017-01-01

To facilitate the clinical guideline (GL) development process, different groups of researchers have proposed tools that enable computer-supported tools for authoring and publishing GLs. In a previous study we interviewed GL authors in different Norwegian institutions and identified tool shortcomings. In this follow-up study our goal is to explore to what extent GL authoring tools have been evaluated by researchers, guideline organisations, or GL authors. This article presents results from a systematic literature review of evaluation (including usability) of GL authoring tools. A controlled database search and backward snow-balling were used to identify relevant articles. From the 12692 abstracts found, 188 papers were fully reviewed and 26 papers were identified as relevant. The GRADEPro tool has attracted some evaluation, however popular tools and platforms such as DECIDE, Doctor Evidence, JBI-SUMARI, G-I-N library have not been subject to specific evaluation from an authoring perspective. Therefore, we found that little attention was paid to the evaluation of the tools in general. We could not find any evaluation relevant to how tools integrate and support the complex GL development workflow. The results of this paper are highly relevant to GL authors, tool developers and GL publishing organisations in order to improve and control the GL development and maintenance process.

Cervical screening programmes: can automation help? Evidence from systematic reviews, an economic analysis and a simulation modelling exercise applied to the UK.

PubMed

Willis, B H; Barton, P; Pearmain, P; Bryan, S; Hyde, C

2005-03-01

To assess the effectiveness and cost-effectiveness of adding automated image analysis to cervical screening programmes. Searching of all major electronic databases to the end of 2000 was supplemented by a detailed survey for unpublished UK literature. Four systematic reviews were conducted according to recognised guidance. The review of 'clinical effectiveness' included studies assessing reproducibility and impact on health outcomes and processes in addition to evaluations of test accuracy. A discrete event simulation model was developed, although the economic evaluation ultimately relied on a cost-minimisation analysis. The predominant finding from the systematic reviews was the very limited amount of rigorous primary research. None of the included studies refers to the only commercially available automated image analysis device in 2002, the AutoPap Guided Screening (GS) System. The results of the included studies were debatably most compatible with automated image analysis being equivalent in test performance to manual screening. Concerning process, there was evidence that automation does lead to reductions in average slide processing times. In the PRISMATIC trial this was reduced from 10.4 to 3.9 minutes, a statistically significant and practically important difference. The economic evaluation tentatively suggested that the AutoPap GS System may be efficient. The key proviso is that credible data become available to support that the AutoPap GS System has test performance and processing times equivalent to those obtained for PAPNET. The available evidence is still insufficient to recommend implementation of automated image analysis systems. The priority for action remains further research, particularly the 'clinical effectiveness' of the AutoPap GS System. Assessing the cost-effectiveness of introducing automation alongside other approaches is also a priority.

The Clinimetric Properties of Instruments Measuring Home Hazards for Older People at Risk of Falling: A Systematic Review.

PubMed

Romli, Muhammad Hibatullah; Mackenzie, Lynette; Lovarini, Meryl; Tan, Maw Pin; Clemson, Lindy

2018-03-01

Home hazards are associated with falls among older people living in the community. However, evaluating home hazards is a complex process as environmental factors vary according to geography, culture, and architectural design. As a result, many health practitioners commonly use nonstandardized assessment methods that may lead to inaccurate findings. Thus, the aim of this systematic review was to identify standardized instruments for evaluating home hazards related to falls and evaluate the clinimetric properties of these instruments for use by health practitioners. A systematic search was conducted in the Medline, CINAHL, AgeLine, Web of Science databases, and the University of Sydney Library CrossSearch Engine. Study screening, assessment, and quality ratings were conducted independently. Thirty-six studies were identified describing 19 instruments and three assessment techniques. The clinimetric properties varied between instruments. The Home Falls and Accidents Screening Tool, Home Safety Self-Assessment Tool, In-Home Occupational Performance Evaluation, and Westmead Home Safety Assessment were the instruments with high potential for evaluating home hazards associated with falls. Health practitioners can choose the most appropriate instruments for their practice, as a range of standardized instruments with established clinimetric properties are available.

Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science.

PubMed

Boudreau, Kevin J; Guinan, Eva C; Lakhani, Karim R; Riedl, Christoph

2016-10-01

Selecting among alternative projects is a core management task in all innovating organizations. In this paper, we focus on the evaluation of frontier scientific research projects. We argue that the "intellectual distance" between the knowledge embodied in research proposals and an evaluator's own expertise systematically relates to the evaluations given. To estimate relationships, we designed and executed a grant proposal process at a leading research university in which we randomized the assignment of evaluators and proposals to generate 2,130 evaluator-proposal pairs. We find that evaluators systematically give lower scores to research proposals that are closer to their own areas of expertise and to those that are highly novel. The patterns are consistent with biases associated with boundedly rational evaluation of new ideas. The patterns are inconsistent with intellectual distance simply contributing "noise" or being associated with private interests of evaluators. We discuss implications for policy, managerial intervention, and allocation of resources in the ongoing accumulation of scientific knowledge.

In-hospital experiences of families of potential organ donors: A systematic review and qualitative synthesis

PubMed Central

Dicks, Sean Glenton; Ranse, Kristen; van Haren, Frank MP; Boer, Douglas P

2017-01-01

Information and compassion assist families of potential organ donors to make informed decisions. However, psychological implications of the in-hospital process are not well described with past research focusing on decision-making. To enhance understanding and improve service delivery, a systematic review was conducted. Inductive analysis and synthesis utilised Grounded Theory Methodology within a systems theory framework and contributed to a model proposing that family and staff form a System of Systems with shared responsibility for process outcomes. This model can guide evaluation and improvement of care and will be tested by means of a longitudinal study of family experiences. PMID:28680696

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review.

PubMed

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F; Moher, David

2014-06-25

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Systematic review. Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score. 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Not registered; no known register currently accepts protocols for methodology systematic reviews. © Stevens et al 2014.

Novel determinants of mammalian primary microRNA processing revealed by systematic evaluation of hairpin-containing transcripts and human genetic variation

PubMed Central

Roden, Christine; Gaillard, Jonathan; Kanoria, Shaveta; Rennie, William; Barish, Syndi; Cheng, Jijun; Pan, Wen; Liu, Jun; Cotsapas, Chris; Ding, Ye; Lu, Jun

2017-01-01

Mature microRNAs (miRNAs) are processed from hairpin-containing primary miRNAs (pri-miRNAs). However, rules that distinguish pri-miRNAs from other hairpin-containing transcripts in the genome are incompletely understood. By developing a computational pipeline to systematically evaluate 30 structural and sequence features of mammalian RNA hairpins, we report several new rules that are preferentially utilized in miRNA hairpins and govern efficient pri-miRNA processing. We propose that a hairpin stem length of 36 ± 3 nt is optimal for pri-miRNA processing. We identify two bulge-depleted regions on the miRNA stem, located ∼16–21 nt and ∼28–32 nt from the base of the stem, that are less tolerant of unpaired bases. We further show that the CNNC primary sequence motif selectively enhances the processing of optimal-length hairpins. We predict that a small but significant fraction of human single-nucleotide polymorphisms (SNPs) alter pri-miRNA processing, and confirm several predictions experimentally including a disease-causing mutation. Our study enhances the rules governing mammalian pri-miRNA processing and suggests a diverse impact of human genetic variation on miRNA biogenesis. PMID:28087842

Measuring diagnoses: ICD code accuracy.

PubMed

O'Malley, Kimberly J; Cook, Karon F; Price, Matt D; Wildes, Kimberly Raiford; Hurdle, John F; Ashton, Carol M

2005-10-01

To examine potential sources of errors at each step of the described inpatient International Classification of Diseases (ICD) coding process. The use of disease codes from the ICD has expanded from classifying morbidity and mortality information for statistical purposes to diverse sets of applications in research, health care policy, and health care finance. By describing a brief history of ICD coding, detailing the process for assigning codes, identifying where errors can be introduced into the process, and reviewing methods for examining code accuracy, we help code users more systematically evaluate code accuracy for their particular applications. We summarize the inpatient ICD diagnostic coding process from patient admission to diagnostic code assignment. We examine potential sources of errors at each step and offer code users a tool for systematically evaluating code accuracy. Main error sources along the "patient trajectory" include amount and quality of information at admission, communication among patients and providers, the clinician's knowledge and experience with the illness, and the clinician's attention to detail. Main error sources along the "paper trail" include variance in the electronic and written records, coder training and experience, facility quality-control efforts, and unintentional and intentional coder errors, such as misspecification, unbundling, and upcoding. By clearly specifying the code assignment process and heightening their awareness of potential error sources, code users can better evaluate the applicability and limitations of codes for their particular situations. ICD codes can then be used in the most appropriate ways.

State Data Use Spotlight: Tennessee. Transforming State Systems to Improve Outcomes for Children with Disabilities

ERIC Educational Resources Information Center

Ruedel, Kristin; Nelson, Gena; Bailey, Tessie

2018-01-01

The Tennessee Department of Education (TDOE) discovered that infants and toddlers who were referred for Part C services and initially found ineligible for a full evaluation through screening were being re-referred and later found eligible for services at a high rate. This report presents the systematic evaluation process that TDOE's Tennessee…

An Evaluation Model To Select an Integrated Learning System in a Large, Suburban School District.

ERIC Educational Resources Information Center

Curlette, William L.; And Others

The systematic evaluation process used in Georgia's DeKalb County School System to purchase comprehensive instructional software--an integrated learning system (ILS)--is described, and the decision-making model for selection is presented. Selection and implementation of an ILS were part of an instructional technology plan for the DeKalb schools…

The Use of Intervention Mapping to Develop a Tailored Web-Based Intervention, Condom-HIM

PubMed Central

2017-01-01

Background Many HIV (human immunodeficiency virus) prevention interventions are currently being implemented and evaluated, with little information published on their development. A framework highlighting the method of development of an intervention can be used by others wanting to replicate interventions or develop similar interventions to suit other contexts and settings. It provides researchers with a comprehensive development process of the intervention. Objective The objective of this paper was to describe how a systematic approach, intervention mapping, was used to develop a tailored Web-based intervention to increase condom use among HIV-positive men who have sex with men. Methods The intervention was developed in consultation with a multidisciplinary team composed of academic researchers, community members, Web designers, and the target population. Intervention mapping involved a systematic process of 6 steps: (1) needs assessment; (2) identification of proximal intervention objectives; (3) selection of theory-based intervention methods and practical strategies; (4) development of intervention components and materials; (5) adoption, implementation, and maintenance; and (6) evaluation planning. Results The application of intervention mapping resulted in the development of a tailored Web-based intervention for HIV-positive men who have sex with men, called Condom-HIM. Conclusions Using intervention mapping as a systematic process to develop interventions is a feasible approach that specifically integrates the use of theory and empirical findings. Outlining the process used to develop a particular intervention provides clarification on the conceptual use of experimental interventions in addition to potentially identifying reasons for intervention failures. PMID:28428162

Exploring the Potential for and Promise of Incorporating Distributive and Procedural Justices into Post-Secondary Assessment of Student Learning

ERIC Educational Resources Information Center

Grace, Christine Cooper

2017-01-01

This paper explores the potential of incorporating constructs of distributive justice and procedural justice into summative assessment of student learning in higher education. I systematically compare the process used by managers to evaluate employee performance in organizations--performance appraisal (PA)--with processes used by professors to…

A systematic approach to the interpretation of preoperative staging MRI for rectal cancer.

PubMed

Taylor, Fiona G M; Swift, Robert I; Blomqvist, Lennart; Brown, Gina

2008-12-01

The purpose of this article is to provide an aid to the systematic evaluation of MRI in staging rectal cancer. MRI has been shown to be an effective tool for the accurate preoperative staging of rectal cancer. In the Magnetic Resonance Imaging and Rectal Cancer European Equivalence Study (MERCURY), imaging workshops were held for participating radiologists to ensure standardization of scan acquisition techniques and interpretation of the images. In this article, we report how the information was obtained and give examples of the images and how they are interpreted, with the aim of providing a systematic approach to the reporting process.

PRISM: Priority Symptom Management Project phase I: assessment.

PubMed

Ropka, M E; Spencer-Cisek, P

2001-01-01

To provide an overview of the process, goals, and outcome recommendations from the assessment phase of the Oncology Nursing Society's Priority Symptom Management (PRISM) project and to provide the foundation for a series of evidence-based practice and qualitative systematic review articles generated from the first phase of PRISM. Published articles, abstracts, and books; computerized databases; nonpublished research; personal communications; and proceedings of the PRISM summit meeting. Symptom management is a key component in quality cancer care. The assessment phase of PRISM yielded systematic reviews with an evidence-based framework to evaluate key symptoms, developed a framework for teaching and evaluating other symptoms, and recommended future ONS initiatives. Outcome recommendations from the PRISM summit targeted practice; professional and public education; research; and health policy. These activities provide background for subsequent evidence-based practice and qualitative systematic review articles that will focus on cancer symptom management.

The economics of health information technology in medication management: a systematic review of economic evaluations.

PubMed

O'Reilly, Daria; Tarride, Jean-Eric; Goeree, Ron; Lokker, Cynthia; McKibbon, K Ann

2012-01-01

To conduct a systematic review and synthesis of the evidence surrounding the cost-effectiveness of health information technology (HIT) in the medication process. Peer-reviewed electronic databases and gray literature were searched to identify studies on HIT used to assist in the medication management process. Articles including an economic component were reviewed for further screening. For this review, full cost-effectiveness analyses, cost-utility analyses and cost-benefit analyses, as well as cost analyses, were eligible for inclusion and synthesis. The 31 studies included were heterogeneous with respect to the HIT evaluated, setting, and economic methods used. Thus the data could not be synthesized, and a narrative review was conducted. Most studies evaluated computer decision support systems in hospital settings in the USA, and only five of the studied performed full economic evaluations. Most studies merely provided cost data; however, useful economic data involves far more input. A full economic evaluation includes a full enumeration of the costs, synthesized with the outcomes of the intervention. The quality of the economic literature in this area is poor. A few studies found that HIT may offer cost advantages despite their increased acquisition costs. However, given the uncertainty that surrounds the costs and outcomes data, and limited study designs, it is difficult to reach any definitive conclusion as to whether the additional costs and benefits represent value for money. Sophisticated concurrent prospective economic evaluations need to be conducted to address whether HIT interventions in the medication management process are cost-effective.

Capturing security requirements for software systems.

PubMed

El-Hadary, Hassan; El-Kassas, Sherif

2014-07-01

Security is often an afterthought during software development. Realizing security early, especially in the requirement phase, is important so that security problems can be tackled early enough before going further in the process and avoid rework. A more effective approach for security requirement engineering is needed to provide a more systematic way for eliciting adequate security requirements. This paper proposes a methodology for security requirement elicitation based on problem frames. The methodology aims at early integration of security with software development. The main goal of the methodology is to assist developers elicit adequate security requirements in a more systematic way during the requirement engineering process. A security catalog, based on the problem frames, is constructed in order to help identifying security requirements with the aid of previous security knowledge. Abuse frames are used to model threats while security problem frames are used to model security requirements. We have made use of evaluation criteria to evaluate the resulting security requirements concentrating on conflicts identification among requirements. We have shown that more complete security requirements can be elicited by such methodology in addition to the assistance offered to developers to elicit security requirements in a more systematic way.

Capturing security requirements for software systems

PubMed Central

El-Hadary, Hassan; El-Kassas, Sherif

2014-01-01

Security is often an afterthought during software development. Realizing security early, especially in the requirement phase, is important so that security problems can be tackled early enough before going further in the process and avoid rework. A more effective approach for security requirement engineering is needed to provide a more systematic way for eliciting adequate security requirements. This paper proposes a methodology for security requirement elicitation based on problem frames. The methodology aims at early integration of security with software development. The main goal of the methodology is to assist developers elicit adequate security requirements in a more systematic way during the requirement engineering process. A security catalog, based on the problem frames, is constructed in order to help identifying security requirements with the aid of previous security knowledge. Abuse frames are used to model threats while security problem frames are used to model security requirements. We have made use of evaluation criteria to evaluate the resulting security requirements concentrating on conflicts identification among requirements. We have shown that more complete security requirements can be elicited by such methodology in addition to the assistance offered to developers to elicit security requirements in a more systematic way. PMID:25685514

Treatment of severe and moderate acute malnutrition in low- and middle-income settings: a systematic review, meta-analysis and Delphi process

PubMed Central

2013-01-01

Background Globally, moderate acute malnutrition (MAM) and severe acute malnutrition (SAM) affect approximately 52 million children under five. This systematic review evaluates the effectiveness of interventions for SAM including the World Health Organization (WHO) protocol for inpatient management and community-based management with ready-to-use-therapeutic food (RUTF), as well as interventions for MAM in children under five years in low- and middle-income countries. Methods We systematically searched the literature and included 14 studies in the meta-analysis. Study quality was assessed using CHERG adaptation of GRADE criteria. A Delphi process was undertaken to complement the systematic review in estimating case fatality and recovery rates that were necessary for modelling in the Lives Saved Tool (LiST). Results Case fatality rates for inpatient treatment of SAM using the WHO protocol ranged from 3.4% to 35%. For community-based treatment of SAM, children given RUTF were 51% more likely to achieve nutritional recovery than the standard care group. For the treatment of MAM, children in the RUSF group were significantly more likely to recover and less likely to be non-responders than in the CSB group. In both meta-analyses, weight gain in the intervention group was higher, and although statistically significant, these differences were small. Overall limitations in our analysis include considerable heterogeneity in many outcomes and an inability to evaluate intervention effects separate from commodity effect. The Delphi process indicated that adherence to standardized protocols for the treatment of SAM and MAM should have a marked positive impact on mortality and recovery rates; yet, true consensus was not achieved. Conclusions Gaps in our ability to estimate effectiveness of overall treatment approaches for SAM and MAM persist. In addition to further impact studies conducted in a wider range of settings, more high quality program evaluations need to be conducted and the results disseminated. PMID:24564235

Research Questions and Priorities for Tuberculosis: A Survey of Published Systematic Reviews and Meta-Analyses

PubMed Central

Nicolau, Ioana; Ling, Daphne; Tian, Lulu; Lienhardt, Christian; Pai, Madhukar

2012-01-01

Background Systematic reviews are increasingly informing policies in tuberculosis (TB) care and control. They may also be a source of questions for future research. As part of the process of developing the International Roadmap for TB Research, we did a systematic review of published systematic reviews on TB, to identify research priorities that are most frequently suggested in reviews. Methodology/Principal Findings We searched EMBASE, MEDLINE, Web of Science, and the Cochrane Library for systematic reviews and meta-analyses on any aspect of TB published between 2005 and 2010. One reviewer extracted data and a second reviewer independently extracted data from a random subset of included studies. In total, 137 systematic reviews, with 141 research questions, were included in this review. We used the UK Health Research Classification System (HRCS) to help us classify the research questions and priorities. The three most common research topics were in the area of detection, screening and diagnosis of TB (32.6%), development and evaluation of treatments and therapeutic interventions (23.4%), and TB aetiology and risk factors (19.9%). The research priorities determined were mainly focused on the discovery and evaluation of bacteriological TB tests and drug-resistant TB tests and immunological tests. Other important topics of future research were genetic susceptibility linked to TB and disease determinants attributed to HIV/TB. Evaluation of drug treatments for TB, drug-resistant TB and HIV/TB were also frequently proposed research topics. Conclusions Systematic reviews are a good source of key research priorities. Findings from our survey have informed the development of the International Roadmap for TB Research by the TB Research Movement. PMID:22848764

A systematic approach for evaluating and scoring human data.

PubMed

Money, Chris D; Tomenson, John A; Penman, Michael G; Boogaard, Peter J; Jeffrey Lewis, R

2013-07-01

An approach is described for how the quality of human data can be systematically assessed and categorised. The approach mirrors the animal data quality considerations set out by Klimisch et al., in order that human data quality can be addressed in a complementary manner and to help facilitate transparent (and repeatable) weight of evidence comparisons. Definitions are proposed for the quality and adequacy of data. Quality is differentiated into four categories. A description of how the scheme can be used for evaluating data reliability, especially for use when contributing entries to the IUCLID database, is shown. A discussion of how the criteria might also be used when determining overall data relevance is included. The approach is intended to help harmonise human data evaluation processes worldwide. Copyright © 2013 Elsevier Inc. All rights reserved.

Motivational Implications of Faculty Performance Standards

ERIC Educational Resources Information Center

Hardre, Patricia L.; Kollmann, Sherry L.

2012-01-01

Expectations and how they are communicated influence employees' motivation, effort, goals, efficacy and performance. This study examined faculty performance evaluation standards and processes of 60 academic departments in research universities for motivationally relevant elements. Characteristics were systematically analysed to understand their…

Systematic evaluation of atmospheric chemistry-transport model CHIMERE

NASA Astrophysics Data System (ADS)

Khvorostyanov, Dmitry; Menut, Laurent; Mailler, Sylvain; Siour, Guillaume; Couvidat, Florian; Bessagnet, Bertrand; Turquety, Solene

2017-04-01

Regional-scale atmospheric chemistry-transport models (CTM) are used to develop air quality regulatory measures, to support environmentally sensitive decisions in the industry, and to address variety of scientific questions involving the atmospheric composition. Model performance evaluation with measurement data is critical to understand their limits and the degree of confidence in model results. CHIMERE CTM (http://www.lmd.polytechnique.fr/chimere/) is a French national tool for operational forecast and decision support and is widely used in the international research community in various areas of atmospheric chemistry and physics, climate, and environment (http://www.lmd.polytechnique.fr/chimere/CW-articles.php). This work presents the model evaluation framework applied systematically to the new CHIMERE CTM versions in the course of the continuous model development. The framework uses three of the four CTM evaluation types identified by the Environmental Protection Agency (EPA) and the American Meteorological Society (AMS): operational, diagnostic, and dynamic. It allows to compare the overall model performance in subsequent model versions (operational evaluation), identify specific processes and/or model inputs that could be improved (diagnostic evaluation), and test the model sensitivity to the changes in air quality, such as emission reductions and meteorological events (dynamic evaluation). The observation datasets currently used for the evaluation are: EMEP (surface concentrations), AERONET (optical depths), and WOUDC (ozone sounding profiles). The framework is implemented as an automated processing chain and allows interactive exploration of the results via a web interface.

Moving toward the automation of the systematic review process: a summary of discussions at the second meeting of International Collaboration for the Automation of Systematic Reviews (ICASR).

PubMed

O'Connor, Annette M; Tsafnat, Guy; Gilbert, Stephen B; Thayer, Kristina A; Wolfe, Mary S

2018-01-09

The second meeting of the International Collaboration for Automation of Systematic Reviews (ICASR) was held 3-4 October 2016 in Philadelphia, Pennsylvania, USA. ICASR is an interdisciplinary group whose aim is to maximize the use of technology for conducting rapid, accurate, and efficient systematic reviews of scientific evidence. Having automated tools for systematic review should enable more transparent and timely review, maximizing the potential for identifying and translating research findings to practical application. The meeting brought together multiple stakeholder groups including users of summarized research, methodologists who explore production processes and systematic review quality, and technologists such as software developers, statisticians, and vendors. This diversity of participants was intended to ensure effective communication with numerous stakeholders about progress toward automation of systematic reviews and stimulate discussion about potential solutions to identified challenges. The meeting highlighted challenges, both simple and complex, and raised awareness among participants about ongoing efforts by various stakeholders. An outcome of this forum was to identify several short-term projects that participants felt would advance the automation of tasks in the systematic review workflow including (1) fostering better understanding about available tools, (2) developing validated datasets for testing new tools, (3) determining a standard method to facilitate interoperability of tools such as through an application programming interface or API, and (4) establishing criteria to evaluate the quality of tools' output. ICASR 2016 provided a beneficial forum to foster focused discussion about tool development and resources and reconfirm ICASR members' commitment toward systematic reviews' automation.

Managing fear in public health campaigns: a theory-based formative evaluation process.

PubMed

Cho, Hyunyi; Witte, Kim

2005-10-01

The HIV/AIDS infection rate of Ethiopia is one of the world's highest. Prevention campaigns should systematically incorporate and respond to at-risk population's existing beliefs, emotions, and perceived barriers in the message design process to effectively promote behavior change. However, guidelines for conducting formative evaluation that are grounded in proven risk communication theory and empirical data analysis techniques are hard to find. This article provides a five-step formative evaluation process that translates theory and research for developing effective messages for behavior change. Guided by the extended parallel process model, the five-step process helps message designers manage public's fear surrounding issues such as HIV/AIDS. An entertainment education project that used the process to design HIV/AIDS prevention messages for Ethiopian urban youth is reported. Data were collected in five urban regions of Ethiopia and analyzed according to the process to develop key messages for a 26-week radio soap opera.

Pharmacological interventions to treat phlebitis: systematic review.

PubMed

dos Reis, Paula Elaine Diniz; Silveira, Renata Cristina de Campos Pereira; Vasques, Christiane Inocêncio; de Carvalho, Emilia Campos

2009-01-01

This study presents a systematic review for evaluating effective pharmacological actions for the treatment of phlebitis stemming from infusion therapy. The studies reviewed were categorized according to the type of therapeutic approach proposed by the author and by the level of evidence presented. The review found that topical nitroglycerin and notoginseny were more effective in the reduction of the inflammatory process when compared with other proposed alternatives. Nevertheless, the development of research related to possible alternatives for the treatment of phlebitis is important.

RECOVER evidence and knowledge gap analysis on veterinary CPR. Part 1: Evidence analysis and consensus process: collaborative path toward small animal CPR guidelines.

PubMed

Boller, Manuel; Fletcher, Daniel J

2012-06-01

To describe the methodology used by the Reassessment Campaign on Veterinary Resuscitation (RECOVER) to evaluate the scientific evidence relevant to small animal CPR and to compose consensus-based clinical CPR guidelines for dogs and cats. This report is part of a series of 7 articles on the RECOVER evidence and knowledge gap analysis and consensus-based small animal CPR guidelines. It describes the organizational structure of RECOVER, the evaluation process employed, consisting of standardized literature searches, the analysis of relevant articles according to study design, species and predefined quality markers, and the drafting of clinical CPR guidelines based on these data. Therefore, this article serves as the methodology section for the subsequent 6 RECOVER articles. Academia, referral practice. RECOVER is a collaborative initiative that systematically evaluated the evidence on 74 topics relevant to small animal CPR and generated 101 clinical CPR guidelines from this analysis. All primary contributors were veterinary specialists, approximately evenly split between academic institutions and private referral practices. The evidence evaluation and guideline drafting processes were conducted according to a predefined sequence of steps designed to reduce bias and increase the repeatability of the findings, including multiple levels of review, culminating in a consensus process. Many knowledge gaps were identified that will allow prioritization of research efforts in veterinary CPR. Collaborative systematic evidence review is organizationally challenging but feasible and effective in veterinary medicine. More experience is needed to refine the process. © Veterinary Emergency and Critical Care Society 2012.

Evidence-based Nursing Education - a Systematic Review of Empirical Research

PubMed Central

Reiber, Karin

2011-01-01

The project „Evidence-based Nursing Education – Preparatory Stage“, funded by the Landesstiftung Baden-Württemberg within the programme Impulsfinanzierung Forschung (Funding to Stimulate Research), aims to collect information on current research concerned with nursing education and to process existing data. The results of empirical research which has already been carried out were systematically evaluated with aim of identifying further topics, fields and matters of interest for empirical research in nursing education. In the course of the project, the available empirical studies on nursing education were scientifically analysed and systematised. The over-arching aim of the evidence-based training approach – which extends beyond the aims of this project - is the conception, organisation and evaluation of vocational training and educational processes in the caring professions on the basis of empirical data. The following contribution first provides a systematic, theoretical link to the over-arching reference framework, as the evidence-based approach is adapted from thematically related specialist fields. The research design of the project is oriented towards criteria introduced from a selection of studies and carries out a two-stage systematic review of the selected studies. As a result, the current status of research in nursing education, as well as its organisation and structure, and questions relating to specialist training and comparative education are introduced and discussed. Finally, the empirical research on nursing training is critically appraised as a complementary element in educational theory/psychology of learning and in the ethical tradition of research. This contribution aims, on the one hand, to derive and describe the methods used, and to introduce the steps followed in gathering and evaluating the data. On the other hand, it is intended to give a systematic overview of empirical research work in nursing education. In order to preserve a holistic view of the research field and methods, detailed individual findings are not included. PMID:21818237

Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science

PubMed Central

Boudreau, Kevin J.; Guinan, Eva C.; Lakhani, Karim R.; Riedl, Christoph

2016-01-01

Selecting among alternative projects is a core management task in all innovating organizations. In this paper, we focus on the evaluation of frontier scientific research projects. We argue that the “intellectual distance” between the knowledge embodied in research proposals and an evaluator’s own expertise systematically relates to the evaluations given. To estimate relationships, we designed and executed a grant proposal process at a leading research university in which we randomized the assignment of evaluators and proposals to generate 2,130 evaluator–proposal pairs. We find that evaluators systematically give lower scores to research proposals that are closer to their own areas of expertise and to those that are highly novel. The patterns are consistent with biases associated with boundedly rational evaluation of new ideas. The patterns are inconsistent with intellectual distance simply contributing “noise” or being associated with private interests of evaluators. We discuss implications for policy, managerial intervention, and allocation of resources in the ongoing accumulation of scientific knowledge. PMID:27746512

Evaluation of animal models of neurobehavioral disorders

PubMed Central

van der Staay, F Josef; Arndt, Saskia S; Nordquist, Rebecca E

2009-01-01

Animal models play a central role in all areas of biomedical research. The process of animal model building, development and evaluation has rarely been addressed systematically, despite the long history of using animal models in the investigation of neuropsychiatric disorders and behavioral dysfunctions. An iterative, multi-stage trajectory for developing animal models and assessing their quality is proposed. The process starts with defining the purpose(s) of the model, preferentially based on hypotheses about brain-behavior relationships. Then, the model is developed and tested. The evaluation of the model takes scientific and ethical criteria into consideration. Model development requires a multidisciplinary approach. Preclinical and clinical experts should establish a set of scientific criteria, which a model must meet. The scientific evaluation consists of assessing the replicability/reliability, predictive, construct and external validity/generalizability, and relevance of the model. We emphasize the role of (systematic and extended) replications in the course of the validation process. One may apply a multiple-tiered 'replication battery' to estimate the reliability/replicability, validity, and generalizability of result. Compromised welfare is inherent in many deficiency models in animals. Unfortunately, 'animal welfare' is a vaguely defined concept, making it difficult to establish exact evaluation criteria. Weighing the animal's welfare and considerations as to whether action is indicated to reduce the discomfort must accompany the scientific evaluation at any stage of the model building and evaluation process. Animal model building should be discontinued if the model does not meet the preset scientific criteria, or when animal welfare is severely compromised. The application of the evaluation procedure is exemplified using the rat with neonatal hippocampal lesion as a proposed model of schizophrenia. In a manner congruent to that for improving animal models, guided by the procedure expounded upon in this paper, the developmental and evaluation procedure itself may be improved by careful definition of the purpose(s) of a model and by defining better evaluation criteria, based on the proposed use of the model. PMID:19243583

Towards Systematic Benchmarking of Climate Model Performance

NASA Astrophysics Data System (ADS)

Gleckler, P. J.

2014-12-01

The process by which climate models are evaluated has evolved substantially over the past decade, with the Coupled Model Intercomparison Project (CMIP) serving as a centralizing activity for coordinating model experimentation and enabling research. Scientists with a broad spectrum of expertise have contributed to the CMIP model evaluation process, resulting in many hundreds of publications that have served as a key resource for the IPCC process. For several reasons, efforts are now underway to further systematize some aspects of the model evaluation process. First, some model evaluation can now be considered routine and should not require "re-inventing the wheel" or a journal publication simply to update results with newer models. Second, the benefit of CMIP research to model development has not been optimal because the publication of results generally takes several years and is usually not reproducible for benchmarking newer model versions. And third, there are now hundreds of model versions and many thousands of simulations, but there is no community-based mechanism for routinely monitoring model performance changes. An important change in the design of CMIP6 can help address these limitations. CMIP6 will include a small set standardized experiments as an ongoing exercise (CMIP "DECK": ongoing Diagnostic, Evaluation and Characterization of Klima), so that modeling groups can submit them at any time and not be overly constrained by deadlines. In this presentation, efforts to establish routine benchmarking of existing and future CMIP simulations will be described. To date, some benchmarking tools have been made available to all CMIP modeling groups to enable them to readily compare with CMIP5 simulations during the model development process. A natural extension of this effort is to make results from all CMIP simulations widely available, including the results from newer models as soon as the simulations become available for research. Making the results from routine performance tests readily accessible will help advance a more transparent model evaluation process.

An Econometric Approach to Evaluate Navy Advertising Efficiency.

DTIC Science & Technology

1996-03-01

This thesis uses an econometric approach to systematically and comprehensively analyze Navy advertising and recruiting data to determine Navy... advertising cost efficiency in the Navy recruiting process. Current recruiting and advertising cost data are merged into an appropriate data base and...evaluated using multiple regression techniques to find assessments of the relationships between Navy advertising expenditures and recruit contracts attained

Evaluating the Quality of Learning Environments and Teaching Practice in Special Schools

ERIC Educational Resources Information Center

Hedegaard-Soerensen, Lotte; Tetler, Susan

2016-01-01

This article reports on findings of a study which objective is the development of an instrument for systematic evaluation and improvement of the quality of teaching in special schools. The article describes the research process which led to the construction of the instrument as well as the way teachers can use the instrument to improve the quality…

Evaluating mesenchymal stem cell therapy for sepsis with preclinical meta-analyses prior to initiating a first-in-human trial

PubMed Central

Lalu, Manoj M; Sullivan, Katrina J; Mei, Shirley HJ; Moher, David; Straus, Alexander; Fergusson, Dean A; Stewart, Duncan J; Jazi, Mazen; MacLeod, Malcolm; Winston, Brent; Marshall, John; Hutton, Brian; Walley, Keith R; McIntyre, Lauralyn

2016-01-01

Evaluation of preclinical evidence prior to initiating early-phase clinical studies has typically been performed by selecting individual studies in a non-systematic process that may introduce bias. Thus, in preparation for a first-in-human trial of mesenchymal stromal cells (MSCs) for septic shock, we applied systematic review methodology to evaluate all published preclinical evidence. We identified 20 controlled comparison experiments (980 animals from 18 publications) of in vivo sepsis models. Meta-analysis demonstrated that MSC treatment of preclinical sepsis significantly reduced mortality over a range of experimental conditions (odds ratio 0.27, 95% confidence interval 0.18–0.40, latest timepoint reported for each study). Risk of bias was unclear as few studies described elements such as randomization and no studies included an appropriately calculated sample size. Moreover, the presence of publication bias resulted in a ~30% overestimate of effect and threats to validity limit the strength of our conclusions. This novel prospective application of systematic review methodology serves as a template to evaluate preclinical evidence prior to initiating first-in-human clinical studies. DOI: http://dx.doi.org/10.7554/eLife.17850.001 PMID:27870924

Instruments to assess the perception of physicians in the decision-making process of specific clinical encounters: a systematic review

PubMed Central

Légaré, France; Moher, David; Elwyn, Glyn; LeBlanc, Annie; Gravel, Karine

2007-01-01

Background The measurement of processes and outcomes that reflect the complexity of the decision-making process within specific clinical encounters is an important area of research to pursue. A systematic review was conducted to identify instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. Methods For every year available up until April 2007, PubMed, PsycINFO, Current Contents, Dissertation Abstracts and Sociological Abstracts were searched for original studies in English or French. Reference lists from retrieved studies were also consulted. Studies were included if they reported a self-administered instrument evaluating physicians' perceptions of the decision-making process within specific clinical encounters, contained sufficient description to permit critical appraisal and presented quantitative results based on administering the instrument. Two individuals independently assessed the eligibility of the instruments and abstracted information on their conceptual underpinnings, main evaluation domain, development, format, reliability, validity and responsiveness. They also assessed the quality of the studies that reported on the development of the instruments with a modified version of STARD. Results Out of 3431 records identified and screened for evaluation, 26 potentially relevant instruments were assessed; 11 met the inclusion criteria. Five instruments were published before 1995. Among those published after 1995, five offered a corresponding patient version. Overall, the main evaluation domains were: satisfaction with the clinical encounter (n = 2), mutual understanding between health professional and patient (n = 2), mental workload (n = 1), frustration with the clinical encounter (n = 1), nurse-physician collaboration (n = 1), perceptions of communication competence (n = 2), degree of comfort with a decision (n = 1) and information on medication (n = 1). For most instruments (n = 10), some reliability and validity criteria were reported in French or English. Overall, the mean number of items on the modified version of STARD was 12.4 (range: 2 to 18). Conclusion This systematic review provides a critical appraisal and repository of instruments that assess the perception physicians have of the decision-making process within specific clinical encounters. More research is needed to pursue the validation of the existing instruments and the development of patient versions. This will help researchers capture the complexity of the decision-making process within specific clinical encounters. PMID:17937801

IT as an enabler of sustainable use of data from innovative technical components for assisted living.

PubMed

Knaup, Petra; Schöpe, Lothar

2012-01-01

The authors see the major potential of systematically processing data from AAL-technology in higher sustainability, higher technology acceptance, higher security, higher robustness, higher flexibility and better integration in existing structures and processes. This potential is currently underachieved and not yet systematically promoted. The authors have written a position paper on potential and necessity of substantial IT research enhancing Ambient Assisted Living (AAL) applications. This paper summarizes the most important challenges in the fields health care, data protection, operation and user interfaces. Research in medical informatics is necessary among others in the fields flexible authorization concept, medical information needs, algorithms to evaluate user profiles and visualization of aggregated data.

Curriculum Mapping in Academic Libraries

ERIC Educational Resources Information Center

Buchanan, Heidi; Webb, Katy Kavanagh; Houk, Amy Harris; Tingelstad, Catherine

2015-01-01

Librarians at four different academic institutions concurrently completed curriculum mapping projects using varying methods to analyze their information literacy instruction. Curriculum mapping is a process for systematically evaluating components of an instructional program for cohesiveness, proper sequencing, and goal achievement. There is a…

[Input on monitoring and evaluation practices of government management of Brazilian Municipal Health Departments].

PubMed

Miranda, Alcides Silva de; Carvalho, André Luis Bonifácio de; Cavalcante, Caio Garcia Correia Sá

2012-04-01

What do the leaders of the Municipal Health Service (SMS) report and say about the systematic monitoring and evaluation of their own government management? The purpose of this paper is to provide input for the formulation of plausible hypotheses about such institutional processes and practices based on information produced in an exploratory study. This is a multiple case study with quantitative and qualitative analysis of answers to a semi-structured questionnaire given to government officials of a systematic sample of 577 Municipal Health Services (10.4% of the total in Brazil). They were selected and stratified by proportional distribution among states and by the population size of municipalities. In general, it shows that approximately half of the respondents use information from Health Monitoring Evaluations to orient decision-making, planning and other management approaches. This proportion tends to decrease in cities with smaller populations. There are specific and significant gaps in financial, personnel and crisis management. The evidence from the hypotheses highlights the fact that these processes are still at an early stage.

Using Process Data to Understand Outcomes in Sexual Health Promotion: An Example from a Review of School-Based Programmes to Prevent Sexually Transmitted Infections

ERIC Educational Resources Information Center

Shepherd, J.; Harden, A.; Barnett-Page, E.; Kavanagh, J.; Picot, J.; Frampton, G. K.; Cooper, K.; Hartwell, D.; Clegg, A.

2014-01-01

This article discusses how process indicators can complement outcomes as part of a comprehensive explanatory evaluation framework, using the example of skills-based behavioural interventions to prevent sexually transmitted infections and promote sexual health among young people in schools. A systematic review was conducted, yielding 12 eligible…

Evaluating stakeholder management performance using a stakeholder report card: the next step in theory and practice.

PubMed

Malvey, Donna; Fottler, Myron D; Slovensky, Donna J

2002-01-01

In the highly competitive health care environment, the survival of an organization may depend on how well powerful stakeholders are managed. Yet, the existing strategic stakeholder management process does not include evaluation of stakeholder management performance. To address this critical gap, this paper proposes a systematic method for evaluation using a stakeholder report card. An example of a physician report card based on this methodology is presented.

Creating a Culture of Safety Around Bar-Code Medication Administration: An Evidence-Based Evaluation Framework.

PubMed

Kelly, Kandace; Harrington, Linda; Matos, Pat; Turner, Barbara; Johnson, Constance

2016-01-01

Bar-code medication administration (BCMA) effectiveness is contingent upon compliance with best-practice protocols. We developed a 4-phased BCMA evaluation program to evaluate the degree of integration of current evidence into BCMA policies, procedures, and practices; identify barriers to best-practice BCMA use; and modify BCMA practice in concert with changes to the practice environment. This program provides an infrastructure for frontline nurses to partner with hospital leaders to continually evaluate and improve BCMA using a systematic process.

Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries.

PubMed

Angelis, Aris; Lange, Ansgar; Kanavos, Panos

2018-01-01

Although health technology assessment (HTA) systems base their decision making process either on economic evaluations or comparative clinical benefit assessment, a central aim of recent approaches to value measurement, including value based assessment and pricing, points towards the incorporation of supplementary evidence and criteria that capture additional dimensions of value. To study the practices, processes and policies of value-assessment for new medicines across eight European countries and the role of HTA beyond economic evaluation and clinical benefit assessment. A systematic (peer review and grey) literature review was conducted using an analytical framework examining: (1) 'Responsibilities and structure of HTA agencies'; (2) 'Evidence and evaluation criteria considered in HTAs'; (3) 'Methods and techniques applied in HTAs'; and (4) 'Outcomes and implementation of HTAs'. Study countries were France, Germany, England, Sweden, Italy, Netherlands, Poland and Spain. Evidence from the literature was validated and updated through two rounds of feedback involving primary data collection from national experts. All countries assess similar types of evidence; however, the specific criteria/endpoints used, their level of provision and requirement, and the way they are incorporated (e.g. explicitly vs. implicitly) varies across countries, with their relative importance remaining generally unknown. Incorporation of additional 'social value judgements' (beyond clinical benefit assessment) and economic evaluation could help explain heterogeneity in coverage recommendations and decision-making. More comprehensive and systematic assessment procedures characterised by increased transparency, in terms of selection of evaluation criteria, their importance and intensity of use, could lead to more rational evidence-based decision-making, possibly improving efficiency in resource allocation, while also raising public confidence and fairness.

Academic/State/Federal collaborations and the improvement of practices in disaster mental health services and evaluation.

PubMed

Watson, Patricia J; Ruzek, Josef I

2009-05-01

Academic, state, and federal agencies collaborated over the last 9 years to improve disaster mental health services and evaluation. This process, which included literature reviews, a number of expert panels, and case studies, is described. The products resulting from this process have included the development of a systematic cross-site evaluation of the federally funded crisis counseling program and field guides for interventions aimed at providing services to distressed individuals in the immediate aftermath of disasters and to individuals needing resilience skills training weeks or months after the event. Future improvement of disaster mental health services calls for continued research, evaluation, training, and intervention development.

Integrated Response Time Evaluation Methodology for the Nuclear Safety Instrumentation System

NASA Astrophysics Data System (ADS)

Lee, Chang Jae; Yun, Jae Hee

2017-06-01

Safety analysis for a nuclear power plant establishes not only an analytical limit (AL) in terms of a measured or calculated variable but also an analytical response time (ART) required to complete protective action after the AL is reached. If the two constraints are met, the safety limit selected to maintain the integrity of physical barriers used for preventing uncontrolled radioactivity release will not be exceeded during anticipated operational occurrences and postulated accidents. Setpoint determination methodologies have actively been developed to ensure that the protective action is initiated before the process conditions reach the AL. However, regarding the ART for a nuclear safety instrumentation system, an integrated evaluation methodology considering the whole design process has not been systematically studied. In order to assure the safety of nuclear power plants, this paper proposes a systematic and integrated response time evaluation methodology that covers safety analyses, system designs, response time analyses, and response time tests. This methodology is applied to safety instrumentation systems for the advanced power reactor 1400 and the optimized power reactor 1000 nuclear power plants in South Korea. The quantitative evaluation results are provided herein. The evaluation results using the proposed methodology demonstrate that the nuclear safety instrumentation systems fully satisfy corresponding requirements of the ART.

Rigor + Results = Impact: Measuring Impact with Integrity (Invited)

NASA Astrophysics Data System (ADS)

Davis, H. B.; Scalice, D.

2013-12-01

Are you struggling to measure and explain the impact of your EPO efforts? The NASA Astrobiology Institute (NAI) is using an evaluation process to determine the impact of its 15 EPO projects with over 200 activities. What is the current impact? How can it be improved in the future? We have developed a process that preserves autonomy at the project implementation level while still painting a picture of the entire portfolio. The impact evaluation process looks at an education/public outreach activity through its entire project cycle. Working with an external evaluator, education leads: 1) rate the quality/health of an activity in each stage of its cycle, and 2) determine the impact based on the results of the evaluation and the rigor of the methods used. The process has created a way to systematically codify a project's health and its impact, while offering support for improving both impact and how it is measured.

Development and evaluation of 'briefing notes' as a novel knowledge translation tool to aid the implementation of sex/gender analysis in systematic reviews: a pilot study.

PubMed

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E; Shea, Beverley; O'Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly 'briefing note' format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group's focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations.

Variations in structures, processes and outcomes of community mental health teams for older people: a systematic review of the literature.

PubMed

Abendstern, M; Harrington, V; Brand, C; Tucker, S; Wilberforce, M; Challis, D

2012-01-01

In the UK and elsewhere, specialist community mental health teams (CMHTs) are central to the provision of comprehensive services for older people with mental ill health. Recent guidance documents suggest a core set of attributes that such teams should encompass. This article reports on a systematic literature review undertaken to collate existing evidence regarding the structures and processes of CMHTs for older people and to evaluate evidence linking approaches to effectiveness. Relevant publications were identified via systematic searches, both electronic and manual. Searches were limited to the UK for descriptions of organisation and practice but included international literature where comparisons between different CMHT arrangements were evaluated. Empirical, peer-reviewed studies from 1989 onward were included, extended to non peer-reviewed nationally or regionally representative reports, published after 1998, for the descriptive element. Forty-five studies met inclusion criteria of which seven provided comparative outcome data. All but one were UK based. The most robust evidence related to research conducted in exemplar teams. Limited evidence was found regarding the effectiveness of many of the core attributes recommended in policy directives although their presence was reported in much of the literature. The contrast between presentation and evaluation of attributes is stark. Whilst some gaps can be filled from related fields, further research is required that moves beyond description to evaluation of the impact of team design on service user outcomes in order to inform future policy directives and practice guidance. A framework for an evidence-based model of CMHTs for older people is provided.

Assessing oral health-related quality of life in children and adolescents: a systematic review and standardized comparison of available instruments.

PubMed

Zaror, Carlos; Pardo, Yolanda; Espinoza-Espinoza, Gerardo; Pont, Àngels; Muñoz-Millán, Patricia; Martínez-Zapata, María José; Vilagut, Gemma; Forero, Carlos G; Garin, Olatz; Alonso, Jordi; Ferrer, Montse

2018-03-22

To obtain a systematic and standardized evaluation of the current evidence on development process, metric properties, and administration issues of oral health-related quality of life instruments available for children and adolescents. A systematic search until October 2016 was conducted in PubMed, Embase, Lilacs, SciELO, and Cochrane databases. Articles with information regarding the development process, metric properties, and administration issues of pediatric instruments measuring oral health-related quality of life were eligible for inclusion. Two researchers independently evaluated each instrument applying the Evaluating Measures of Patient-Reported Outcomes (EMPRO) tool. An overall and seven attribute-specific EMPRO scores were calculated (range 0-100, worst to best): measurement model, reliability, validity, responsiveness, interpretability, burden, and alternative forms. We identified 18 instruments evaluated in 132 articles. From five instruments designed for preschoolers, the Early Childhood Oral Health Impact Scale (ECOHIS) obtained the highest overall EMPRO score (82.2). Of nine identified for schoolchildren and adolescents, the best rated instrument was the Child Perceptions Questionnaire 11-14 (82.1). Among the four instruments developed for any age, the Family Impact Scale (FIS) obtained the highest scores (80.3). The evidence supports the use of the ECOHIS for preschoolers, while the age is a key factor when choosing among the four recommended instruments for schoolchildren and adolescents. Instruments for specific conditions, symptoms, or treatments need further research on metric properties. Our results facilitate decision-making on the correct oral health-related quality of life instrument selection for any certain study purpose and population during the childhood and adolescence life cycle.

Measuring Diagnoses: ICD Code Accuracy

PubMed Central

O'Malley, Kimberly J; Cook, Karon F; Price, Matt D; Wildes, Kimberly Raiford; Hurdle, John F; Ashton, Carol M

2005-01-01

Objective To examine potential sources of errors at each step of the described inpatient International Classification of Diseases (ICD) coding process. Data Sources/Study Setting The use of disease codes from the ICD has expanded from classifying morbidity and mortality information for statistical purposes to diverse sets of applications in research, health care policy, and health care finance. By describing a brief history of ICD coding, detailing the process for assigning codes, identifying where errors can be introduced into the process, and reviewing methods for examining code accuracy, we help code users more systematically evaluate code accuracy for their particular applications. Study Design/Methods We summarize the inpatient ICD diagnostic coding process from patient admission to diagnostic code assignment. We examine potential sources of errors at each step and offer code users a tool for systematically evaluating code accuracy. Principle Findings Main error sources along the “patient trajectory” include amount and quality of information at admission, communication among patients and providers, the clinician's knowledge and experience with the illness, and the clinician's attention to detail. Main error sources along the “paper trail” include variance in the electronic and written records, coder training and experience, facility quality-control efforts, and unintentional and intentional coder errors, such as misspecification, unbundling, and upcoding. Conclusions By clearly specifying the code assignment process and heightening their awareness of potential error sources, code users can better evaluate the applicability and limitations of codes for their particular situations. ICD codes can then be used in the most appropriate ways. PMID:16178999

Systematic monitoring and evaluation of M7 scanner performance and data quality

NASA Technical Reports Server (NTRS)

Stewart, S.; Christenson, D.; Larsen, L.

1974-01-01

An investigation was conducted to provide the information required to maintain data quality of the Michigan M7 Multispectral scanner by systematic checks on specific system performance characteristics. Data processing techniques which use calibration data gathered routinely every mission have been developed to assess current data quality. Significant changes from past data quality are thus identified and attempts made to discover their causes. Procedures for systematic monitoring of scanner data quality are discussed. In the solar reflective region, calculations of Noise Equivalent Change in Radiance on a permission basis are compared to theoretical tape-recorder limits to provide an estimate of overall scanner performance. M7 signal/noise characteristics are examined.

Final Report: Towards an Emergent Model of Technology Adoption for Accelerating the Diffusion of Residential Solar PV

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rai, Varun

This project sought to enable electric utilities in Texas to accelerate diffusion of residential solar photovoltaic (PV) by systematically identifying and targeting existing barriers to PV adoption. A core goal of the project was to develop an integrated research framework that combines survey research, econometric modeling, financial modeling, and implementation and evaluation of pilot projects to study the PV diffusion system. This project considered PV diffusion as an emergent system, with attention to the interactions between the constituent parts of the PV socio-technical system including: economics of individual decision-making; peer and social influences; behavioral responses; and information and transaction costs.more » We also conducted two pilot projects, which have yielded new insights into behavioral and informational aspects of PV adoption. Finally, this project has produced robust and generalizable results that will provide deeper insights into the technology-diffusion process that will be applicable for the design of utility programs for other technologies such as home-energy management systems and plug-in electric vehicles. When we started this project in 2013 there was little systematic research on characterizing the decision-making process of households interested in adopting PV. This project was designed to fill that research gap by analyzing the PV adoption process from the consumers' decision-making perspective and with the objective to systematically identifying and addressing the barriers that consumers face in the adoption of PV. The two key components of that decision-making process are consumers' evaluation of: (i) uncertainties and non-monetary costs associated with the technology and (ii) the direct monetary cost-benefit. This project used an integrated approach to study both the non-monetary and the monetary components of the consumer decision-making process.« less

The Use of Intervention Mapping to Develop a Tailored Web-Based Intervention, Condom-HIM.

PubMed

Miranda, Joyal; Côté, José

2017-04-19

Many HIV (human immunodeficiency virus) prevention interventions are currently being implemented and evaluated, with little information published on their development. A framework highlighting the method of development of an intervention can be used by others wanting to replicate interventions or develop similar interventions to suit other contexts and settings. It provides researchers with a comprehensive development process of the intervention. The objective of this paper was to describe how a systematic approach, intervention mapping, was used to develop a tailored Web-based intervention to increase condom use among HIV-positive men who have sex with men. The intervention was developed in consultation with a multidisciplinary team composed of academic researchers, community members, Web designers, and the target population. Intervention mapping involved a systematic process of 6 steps: (1) needs assessment; (2) identification of proximal intervention objectives; (3) selection of theory-based intervention methods and practical strategies; (4) development of intervention components and materials; (5) adoption, implementation, and maintenance; and (6) evaluation planning. The application of intervention mapping resulted in the development of a tailored Web-based intervention for HIV-positive men who have sex with men, called Condom-HIM. Using intervention mapping as a systematic process to develop interventions is a feasible approach that specifically integrates the use of theory and empirical findings. Outlining the process used to develop a particular intervention provides clarification on the conceptual use of experimental interventions in addition to potentially identifying reasons for intervention failures. ©Joyal Miranda, José Côté. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 19.04.2017.

Revision of the Competency Standards for Occupational Therapy Driver Assessors: An overview of the evidence for the inclusion of cognitive and perceptual assessments within fitness-to-drive evaluations.

PubMed

Fields, Sally M; Unsworth, Carolyn A

2017-08-01

Determination of fitness-to-drive after illness or injury is a complex process typically requiring a comprehensive driving assessment, including off-road and on-road assessment components. The competency standards for occupational therapy driver assessors (Victoria, Australia) define the requirements for performance of a comprehensive driving assessment, and we are currently revising these. Assessment of cognitive and perceptual skills forms an important part of the off-road assessment. The aim of this systematic review of systematic reviews (known as an overview) is to identify what evidence exists for including assessment of cognitive and perceptual skills within fitness-to-drive evaluations to inform revision of the competency standards. Five electronic databases (MEDLINE, CINAHL, PsycINFO, The Cochrane Library, OT Seeker) were systematically searched. Systematic review articles were appraised by two authors for eligibility. Methodological quality was independently assessed using the AMSTAR tool. Narrative analysis was conducted to summarise the content of eligible reviews. A total of 1228 results were retrieved. Fourteen reviews met the inclusion criteria. Reviews indicated that the components of cognition and perception most frequently identified as being predictive of fitness-to-drive were executive function (n = 13), processing speed (n = 12), visuospatial skills, attention, memory and mental flexibility (n = 11). Components less indicative were perception, concentration (n = 10), praxis (n = 9), language (n = 7) and neglect (n = 6). This overview of systematic reviews supports the inclusion of assessment of a range of cognitive and perceptual skills as key elements in a comprehensive driver assessment and therefore should be included in the revised competency standards for occupational therapy driver assessors. © 2017 Occupational Therapy Australia.

AHRQ series paper 3: identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the effective health-care program.

PubMed

Whitlock, Evelyn P; Lopez, Sarah A; Chang, Stephanie; Helfand, Mark; Eder, Michelle; Floyd, Nicole

2010-05-01

This article discusses the identification, selection, and refinement of topics for comparative effectiveness systematic reviews within the Agency for Healthcare Research and Quality's Effective Health Care (EHC) program. The EHC program seeks to align its research topic selection with the overall goals of the program, impartially and consistently apply predefined criteria to potential topics, involve stakeholders to identify high-priority topics, be transparent and accountable, and continually evaluate and improve processes. A topic prioritization group representing stakeholder and scientific perspectives evaluates topic nominations that fit within the EHC program (are "appropriate") to determine how "important" topics are as considered against seven criteria. The group then judges whether a new comparative effectiveness systematic review would be a duplication of existing research syntheses, and if not duplicative, if there is adequate type and volume of research to conduct a new systematic review. Finally, the group considers the "potential value and impact" of a comparative effectiveness systematic review. As the EHC program develops, ongoing challenges include ensuring the program addresses truly unmet needs for synthesized research because national and international efforts in this arena are uncoordinated, as well as engaging a range of stakeholders in program decisions while also achieving efficiency and timeliness.

The economics of health information technology in medication management: a systematic review of economic evaluations

PubMed Central

Tarride, Jean-Eric; Goeree, Ron; Lokker, Cynthia; McKibbon, K Ann

2011-01-01

Objective To conduct a systematic review and synthesis of the evidence surrounding the cost-effectiveness of health information technology (HIT) in the medication process. Materials and methods Peer-reviewed electronic databases and gray literature were searched to identify studies on HIT used to assist in the medication management process. Articles including an economic component were reviewed for further screening. For this review, full cost-effectiveness analyses, cost-utility analyses and cost-benefit analyses, as well as cost analyses, were eligible for inclusion and synthesis. Results The 31 studies included were heterogeneous with respect to the HIT evaluated, setting, and economic methods used. Thus the data could not be synthesized, and a narrative review was conducted. Most studies evaluated computer decision support systems in hospital settings in the USA, and only five of the studied performed full economic evaluations. Discussion Most studies merely provided cost data; however, useful economic data involves far more input. A full economic evaluation includes a full enumeration of the costs, synthesized with the outcomes of the intervention. Conclusion The quality of the economic literature in this area is poor. A few studies found that HIT may offer cost advantages despite their increased acquisition costs. However, given the uncertainty that surrounds the costs and outcomes data, and limited study designs, it is difficult to reach any definitive conclusion as to whether the additional costs and benefits represent value for money. Sophisticated concurrent prospective economic evaluations need to be conducted to address whether HIT interventions in the medication management process are cost-effective. PMID:21984590

DOE Office of Scientific and Technical Information (OSTI.GOV)

Szoka de Valladares, M.R.; Mack, S.

The DOE Hydrogen Program needs to develop criteria as part of a systematic evaluation process for proposal identification, evaluation and selection. The H Scan component of this process provides a framework in which a project proposer can fully describe their candidate technology system and its components. The H Scan complements traditional methods of capturing cost and technical information. It consists of a special set of survey forms designed to elicit information so expert reviewers can assess the proposal relative to DOE specified selection criteria. The Analytic Hierarchy Process (AHP) component of the decision process assembles the management defined evaluation andmore » selection criteria into a coherent multi-level decision construct by which projects can be evaluated in pair-wise comparisons. The AHP model will reflect management`s objectives and it will assist in the ranking of individual projects based on the extent to which each contributes to management`s objectives. This paper contains a detailed description of the products and activities associated with the planning and evaluation process: The objectives or criteria; the H Scan; and The Analytic Hierarchy Process (AHP).« less

The Relation between Academic Aptitude and Commitment to Teaching among MSU Students. Research and Evaluation in Teacher Education. Program Evaluation Series No. 5.

ERIC Educational Resources Information Center

Byers, Joe L.

An overview and analysis is presented of the Vance and Schlechty Study (1982) of education majors which indicated that there is a negative selection process which systematically attracts and holds in the teaching profession young people with modest verbal and mathematical abilities. Three factors, operating singly or in combination, were…

Towards improved and more routine Earth system model evaluation in CMIP

DOE PAGES

Eyring, Veronika; Gleckler, Peter J.; Heinze, Christoph; ...

2016-11-01

The Coupled Model Intercomparison Project (CMIP) has successfully provided the climate community with a rich collection of simulation output from Earth system models (ESMs) that can be used to understand past climate changes and make projections and uncertainty estimates of the future. Confidence in ESMs can be gained because the models are based on physical principles and reproduce many important aspects of observed climate. More research is required to identify the processes that are most responsible for systematic biases and the magnitude and uncertainty of future projections so that more relevant performance tests can be developed. At the same time,more » there are many aspects of ESM evaluation that are well established and considered an essential part of systematic evaluation but have been implemented ad hoc with little community coordination. Given the diversity and complexity of ESM analysis, we argue that the CMIP community has reached a critical juncture at which many baseline aspects of model evaluation need to be performed much more efficiently and consistently. We provide a perspective and viewpoint on how a more systematic, open, and rapid performance assessment of the large and diverse number of models that will participate in current and future phases of CMIP can be achieved, and announce our intention to implement such a system for CMIP6. Accomplishing this could also free up valuable resources as many scientists are frequently "re-inventing the wheel" by re-writing analysis routines for well-established analysis methods. A more systematic approach for the community would be to develop and apply evaluation tools that are based on the latest scientific knowledge and observational reference, are well suited for routine use, and provide a wide range of diagnostics and performance metrics that comprehensively characterize model behaviour as soon as the output is published to the Earth System Grid Federation (ESGF). The CMIP infrastructure enforces data standards and conventions for model output and documentation accessible via the ESGF, additionally publishing observations (obs4MIPs) and reanalyses (ana4MIPs) for model intercomparison projects using the same data structure and organization as the ESM output. This largely facilitates routine evaluation of the ESMs, but to be able to process the data automatically alongside the ESGF, the infrastructure needs to be extended with processing capabilities at the ESGF data nodes where the evaluation tools can be executed on a routine basis. Efforts are already underway to develop community-based evaluation tools, and we encourage experts to provide additional diagnostic codes that would enhance this capability for CMIP. And, at the same time, we encourage the community to contribute observations and reanalyses for model evaluation to the obs4MIPs and ana4MIPs archives. The intention is to produce through the ESGF a widely accepted quasi-operational evaluation framework for CMIP6 that would routinely execute a series of standardized evaluation tasks. Over time, as this capability matures, we expect to produce an increasingly systematic characterization of models which, compared with early phases of CMIP, will more quickly and openly identify the strengths and weaknesses of the simulations. This will also reveal whether long-standing model errors remain evident in newer models and will assist modelling groups in improving their models. Finally, this framework will be designed to readily incorporate updates, including new observations and additional diagnostics and metrics as they become available from the research community.« less

A systematic and critical review on bioanalytical method validation using the example of simultaneous quantitation of antidiabetic agents in blood.

PubMed

Fachi, Mariana Millan; Leonart, Letícia Paula; Cerqueira, Letícia Bonancio; Pontes, Flavia Lada Degaut; de Campos, Michel Leandro; Pontarolo, Roberto

2017-06-15

A systematic and critical review was conducted on bioanalytical methods validated to quantify combinations of antidiabetic agents in human blood. The aim of this article was to verify how the validation process of bioanalytical methods is performed and the quality of the published records. The validation assays were evaluated according to international guidelines. The main problems in the validation process are pointed out and discussed to help researchers to choose methods that are truly reliable and can be successfully applied for their intended use. The combination of oral antidiabetic agents was chosen as these are some of the most studied drugs and several methods are present in the literature. Moreover, this article may be applied to the validation process of all bioanalytical. Copyright © 2017 Elsevier B.V. All rights reserved.

[Report quality evaluation of systematic review or Meta-analysis published in China Journal of Chinese Materia Medica].

PubMed

Zhang, Yan; Yu, Dan-Dan; Cui, De-Hua; Liao, Xing; Guo, Hua

2018-03-01

To evaluate the report quality of intervention-related systematic reviews or Meta-analysis published in China Journal of Chinese Materia Medica, we searched CNKI and China Journal of Chinese Materia Medica webpages to collect intervention-related systematic reviews or Meta-analysis since the first issue of the magazine. A total of 40 systematic reviews or Meta-analysis reports were included, including one network Meta-analysis. According to the PRISMA statement published in 2009, the report quality of the systematic reviews or Meta-analysis was evaluated. According to the results, 3 had the low quality, 30 had the medium quality, and 7 had the high quality. The average score for all of items was 30 points (21-30.5 points for the medium quality). The 17 high-quality (31-40 points) report items were title, rationale, objectives, information sources, study selection, data collection process, data items, risk of bias in individual studies, summary measures, risk of bias across studies, study selection, study characteristics, risk of bias within studies, results of individual studies, synthesis of results, risk of bias across studies and funding; the 4 medium-quality (21-30.5 points) reporting items were eligibility criteria, search, limitations and conclusions; and the 6 low-quality (<=20.5 points) reporting items were structured summary, protocol and registration, synthesis of results, additional analysis (No.16), additional analysis (No.23) and summary of evidence. Through the analysis, it is found that the report quality of intervention-related systematic reviews or Meta-analysis published in China Journal of Chinese Materia Medica is medium, and it is necessary to improve the quality standard of the report. Copyright© by the Chinese Pharmaceutical Association.

Numerical Implementation of Indicators and Statistical Control Tools in Monitoring and Evaluating CACEI-ISO Indicators of Study Program in Industrial Process by Systematization

ERIC Educational Resources Information Center

Ayala, Gabriela Cota; Real, Francia Angélica Karlos; Ivan, Ramirez Alvarado Edqar

2016-01-01

The research was conducted to determine if the study program of the career of industrial processes Technological University of Chihuahua, 1 year after that it was certified by CACEI, continues achieving the established indicators and ISO 9001: 2008, implementing quality tools, monitoring of essential indicators are determined, flow charts are…

Pyrotechnic hazards classification and evaluation program. Phase 2, segment 3: Test plan for determining hazards associated with pyrotechnic manufacturing processes

NASA Technical Reports Server (NTRS)

1971-01-01

A comprehensive test plan for determining the hazards associated with pyrotechnic manufacturing processes is presented. The rationale for each test is based on a systematic analysis of historical accounts of accidents and a detailed study of the characteristics of each manufacturing process. The most hazardous manufacturing operations have been determined to be pressing, mixing, reaming, and filling. The hazard potential of a given situation is evaluated in terms of the probabilities of initiation, communication, and transition to detonation (ICT). The characteristics which affect the ICT probabilities include the ignition mechanisms which are present either in normal or abnormal operation, the condition and properties of the pyrotechnic material, and the configuration of the processing equipment. Analytic expressions are derived which describe the physical conditions of the system, thus permitting a variety of processes to be evaluated in terms of a small number of experiments.

Systematic information processing style and perseverative worry.

PubMed

Dash, Suzanne R; Meeten, Frances; Davey, Graham C L

2013-12-01

This review examines the theoretical rationale for conceiving of systematic information processing as a proximal mechanism for perseverative worry. Systematic processing is characterised by detailed, analytical thought about issue-relevant information, and in this way, is similar to the persistent, detailed processing of information that typifies perseverative worry. We review the key features and determinants of systematic processing, and examine the application of systematic processing to perseverative worry. We argue that systematic processing is a mechanism involved in perseverative worry because (1) systematic processing is more likely to be deployed when individuals feel that they have not reached a satisfactory level of confidence in their judgement and this is similar to the worrier's striving to feel adequately prepared, to have considered every possible negative outcome/detect all potential danger, and to be sure that they will successfully cope with perceived future problems; (2) systematic processing and worry are influenced by similar psychological cognitive states and appraisals; and (3) the functional neuroanatomy underlying systematic processing is located in the same brain regions that are activated during worrying. This proposed mechanism is derived from core psychological processes and offers a number of clinical implications, including the identification of psychological states and appraisals that may benefit from therapeutic interventions for worry-based problems. © 2013.

Systematic dissemination of a preschool physical activity intervention to the control preschools

PubMed Central

Howie, Erin K.; Brewer, Alisa E.; Brown, William H.; Saunders, Ruth P.; Pate, Russell R.

2016-01-01

For public health interventions to have a meaningful impact on public health, they must be disseminated to the wider population. Systematic planning and evaluation of dissemination efforts can aid translation from experimental trials to larger dissemination programs. The Study of Health and Activity in Preschool Environments (SHAPES) was a group-randomized intervention trial conducted in 16 preschools that successfully increased the physical activity of preschool age children. Following the completion of the research study protocol, the intervention was abbreviated, modified and implemented in four preschools who participated as control preschools in the original research study. The purposes of the current study were to describe the process of refining the intervention for dissemination to the control preschools, and to assess the acceptability of the resulting abbreviated intervention delivery. Five overarching behavioral objectives, informed by process evaluation, data from the original trial and collaboration with intervention teachers, were used to guide the implementation. Teachers in the dissemination classrooms reported high levels of acceptability, potential for sustainability of the program, and positive results in knowledge, skills, and child outcomes. Researchers can include a systematic approach to dissemination of effective intervention elements to the control participants in experimental studies to inform future dissemination efforts and begin to bridge the dissemination gap. PMID:27107302

Adaptive Management and Monitoring as Fundamental Tools to Effective Salt Marsh Restoration

EPA Science Inventory

Adaptive management as applied to ecological restoration is a systematic decision-making process in which the results of restoration activities are repeatedly monitored and evaluated to provide guidance that can be used in determining any necessary future restoration actions. In...

20 CFR 416.919s - Authorizing and monitoring the consultative examination.

Code of Federal Regulations, 2011 CFR

2011-04-01

...) A process for orientation, training, and review of new consultative examination providers, with.... (7) procedures for the ongoing review of consultative examination results to ensure compliance with...) Procedures for evaluating claimant reactions to key providers; and (11) A program of systematic, onsite...

High speed ground penetrating radar for road pavement and bridge structural inspection and maintenance : final report.

DOT National Transportation Integrated Search

2016-06-30

The overarching objective of this research is the development of a systematic methodology of employing GPR, including instruments, subsequent data processing and interpretation that can be used regularly as part of a roadway pavement and bridge evalu...

What research tells us about knowledge transfer strategies to improve public health in low-income countries: a scoping review.

PubMed

Siron, Stéphanie; Dagenais, Christian; Ridde, Valéry

2015-11-01

This study describes the current state of research on knowledge transfer strategies to improve public health in low-income countries, to identify the knowledge gaps on this topic. In this scoping review, a descriptive and systematic process was used to analyse, for each article retained, descriptions of research context and methods, types of knowledge transfer activities and results reported. 28 articles were analysed. They dealt with the evaluation of transfer strategies that employed multiple activities, mostly targeting health professionals and women with very young children. Most often these studies used quantitative designs and measurements of instrumental use with some methodological shortcomings. Results were positive and suggested recommendations for improving professional practices, knowledge and health-related behaviours. The review highlights the great diversity of transfer strategies used, strategies and many conditions for knowledge use. The review provides specific elements for understanding the transfer processes in low-income countries and highlights the need for systematic evaluation of the conditions for research results utilization.

Studies on semantic priming effects in right hemisphere stroke: A systematic review

PubMed Central

Müller, Juliana de Lima; de Salles, Jerusa Fumagalli

2013-01-01

The role of the right cerebral hemisphere (RH) associated with semantic priming effects (SPEs) must be better understood, since the consequences of RH damage on SPE are not yet well established. OBJECTIVE The aim of this article was to investigate studies analyzing SPEs in patients affected by stroke in the RH through a systematic review, verifying whether there are deficits in SPEs, and whether performance varies depending on the type of semantic processing evaluated or stimulus in the task. METHODS A search was conducted on the LILACS, PUBMED and PSYCINFO databases. RESULTS Out of the initial 27 studies identified, 11 remained in the review. Difficulties in SPEs were shown in five studies. Performance does not seem to vary depending on the type of processing, but on the type of stimulus used. CONCLUSION This ability should be evaluated in individuals that have suffered a stroke in the RH in order to provide treatments that will contribute to their recovery PMID:29213834

Critical Analysis of Dual-Probe Heat-Pulse Technique Applied to Measuring Thermal Diffusivity

NASA Astrophysics Data System (ADS)

Bovesecchi, G.; Coppa, P.; Corasaniti, S.; Potenza, M.

2018-07-01

The paper presents an analysis of the experimental parameters involved in application of the dual-probe heat pulse technique, followed by a critical review of methods for processing thermal response data (e.g., maximum detection and nonlinear least square regression) and the consequent obtainable uncertainty. Glycerol was selected as testing liquid, and its thermal diffusivity was evaluated over the temperature range from - 20 °C to 60 °C. In addition, Monte Carlo simulation was used to assess the uncertainty propagation for maximum detection. It was concluded that maximum detection approach to process thermal response data gives the closest results to the reference data inasmuch nonlinear regression results are affected by major uncertainties due to partial correlation between the evaluated parameters. Besides, the interpolation of temperature data with a polynomial to find the maximum leads to a systematic difference between measured and reference data, as put into evidence by the Monte Carlo simulations; through its correction, this systematic error can be reduced to a negligible value, about 0.8 %.

A Schema of Denial: The Influence of Rape Myth Acceptance on Beliefs, Attitudes, and Processing of Affirmative Consent Campaign Messages.

PubMed

Silver, Nathan; Hovick, Shelly R

2018-05-29

This study aims to examine the influence of rape myth acceptance (RMA) and the perceived salience of sexual violence on the cognitive processing of an affirmative consent campaign active on the campus where research was conducted. As part of a midcourse evaluation of the Consent is Sexy (CIS) campaign (N = 285), a subsample of participants who reported prior exposure to campaign posters (N = 182) was asked to review four campaign posters and indicate the extent to which they processed the message in the posters systematically. Robust gender differences in perceived salience of sexual violence, supportive attitudes, and perceived behavioral control (PBC) toward establishing consent were mediated by RMA. Moreover, robust gender differences in the systematic processing of the campaign were mediated by RMA and perceived salience in serial. Implications of the influence of rape myths and perceived salience on the cognitive processing of affirmed consent campaigns are discussed with respect to both campaign message design and implementation.

Evaluation of anti-sticking layers performances for 200mm wafer scale Smart NILTM process through surface and defectivity characterizations

NASA Astrophysics Data System (ADS)

Delachat, F.; Phillipe, J.-C.; Larrey, V.; Fournel, F.; Bos, S.; Teyssèdre, H.; Chevalier, Xavier; Nicolet, Célia; Navarro, Christophe; Cayrefourcq, Ian

2018-03-01

In this work, an evaluation of various ASL processes for 200 mm wafer scale in the HERCULES® NIL equipment platform available at the CEA-Leti through the INSPIRE program is reported. The surface and adherence energies were correlated to the AFM and defectivity results in order to select the most promising ASL process for high resolution etch mask applications. The ASL performances of the selected process were evaluated by multiple working stamp fabrication using unpatterned and patterned masters though defectivity monitoring on optical based-inspection tools. Optical and SEM defect reviews were systematically performed. Multiple working stamps fabrication without degradation of the master defectivity was witnessed. This evaluation enabled to benchmark several ASL solutions based on the grafted technology develop by ARKEMA in order to reduce and optimize the soft stamp defectivity prior to its replication and therefore considerably reduce the final imprint defectivity for the Smart NIL process.

Informed consent and decision-making about adult-to-adult living donor liver transplantation: a systematic review of empirical research.

PubMed

Gordon, Elisa J; Daud, Amna; Caicedo, Juan Carlos; Cameron, Kenzie A; Jay, Colleen; Fryer, Jonathan; Beauvais, Nicole; Skaro, Anton; Baker, Talia

2011-12-27

Adult-to-adult living donor liver transplantation (LDLT) is a complex procedure that poses serious health risks to and provides no direct health benefit for the donor. Because of this uneven risk-benefit ratio, ensuring donor autonomy through informed consent is critical. To assess the current knowledge pertaining to informed consent for LDLT, we conducted a systematic review of the empirical literature on donors' decision-making process, comprehension about risks and outcomes, and information needs for LDLT. Of the 1423 identified articles, 24 met final review criteria, representing the perspective of approximately 2789 potential and actual donors. As donors' decisions to donate often occur before evaluation, they often make uninformed decisions. The review found that 88% to 95% of donors reported understanding information clinicians disclosed about risks and benefits. However, donors reported unmet information needs, knowledge gaps regarding risks, and unanticipated complications. Few donors reported feeling pressure to donate. Most studies were limited by cultural differences, small sample sizes, inconsistent measures, and poor methodological approaches. This systematic review suggests that informed consent for LDLT is sub-optimal as donors do not adequately appreciate disclosed information during the informed consent process, despite United Network for Organ Sharing/CMS regulations requiring formal psychological evaluation of donor candidates. Interventions are needed to improve donor-clinician communication during the LDLT informed consent process such as through the use of comprehension assessment tools and e-health educational tools that leverage adult learning theory to effectively convey LDLT outcome data.

Validation Process Methods

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lewis, John E.; English, Christine M.; Gesick, Joshua C.

This report documents the validation process as applied to projects awarded through Funding Opportunity Announcements (FOAs) within the U.S. Department of Energy Bioenergy Technologies Office (DOE-BETO). It describes the procedures used to protect and verify project data, as well as the systematic framework used to evaluate and track performance metrics throughout the life of the project. This report also describes the procedures used to validate the proposed process design, cost data, analysis methodologies, and supporting documentation provided by the recipients.

Using media to impact health policy-making: an integrative systematic review.

PubMed

Bou-Karroum, Lama; El-Jardali, Fadi; Hemadi, Nour; Faraj, Yasmine; Ojha, Utkarsh; Shahrour, Maher; Darzi, Andrea; Ali, Maha; Doumit, Carine; Langlois, Etienne V; Melki, Jad; AbouHaidar, Gladys Honein; Akl, Elie A

2017-04-18

Media interventions can potentially play a major role in influencing health policies. This integrative systematic review aimed to assess the effects of planned media interventions-including social media-on the health policy-making process. Eligible study designs included randomized and non-randomized designs, economic studies, process evaluation studies, stakeholder analyses, qualitative methods, and case studies. We electronically searched Medline, EMBASE, Communication and Mass Media Complete, Cochrane Central Register of Controlled Trials, and the WHO Global Health Library. We followed standard systematic review methodology for study selection, data abstraction, and risk of bias assessment. Twenty-one studies met our eligibility criteria: 10 evaluation studies using either quantitative (n = 7) or qualitative (n = 3) designs and 11 case studies. None of the evaluation studies were on social media. The findings of the evaluation studies suggest that media interventions may have a positive impact when used as accountability tools leading to prioritizing and initiating policy discussions, as tools to increase policymakers' awareness, as tools to influence policy formulation, as awareness tools leading to policy adoption, and as awareness tools to improve compliance with laws and regulations. In one study, media-generated attention had a negative effect on policy advocacy as it mobilized opponents who defeated the passage of the bills that the media intervention advocated for. We judged the confidence in the available evidence as limited due to the risk of bias in the included studies and the indirectness of the evidence. There is currently a lack of reliable evidence to guide decisions on the use of media interventions to influence health policy-making. Additional and better-designed, conducted, and reported primary research is needed to better understand the effects of media interventions, particularly social media, on health policy-making processes, and the circumstances under which media interventions are successful. PROSPERO 2015: CRD42015020243.

Cochrane Qualitative and Implementation Methods Group guidance series-paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews.

PubMed

Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin; Noyes, Jane

2018-05-01

The Cochrane Qualitative and Implementation Methods Group develops and publishes guidance on the synthesis of qualitative and mixed-method evidence from process evaluations. Despite a proliferation of methods for the synthesis of qualitative research, less attention has focused on how to integrate these syntheses within intervention effectiveness reviews. In this article, we report updated guidance from the group on approaches, methods, and tools, which can be used to integrate the findings from quantitative studies evaluating intervention effectiveness with those from qualitative studies and process evaluations. We draw on conceptual analyses of mixed methods systematic review designs and the range of methods and tools that have been used in published reviews that have successfully integrated different types of evidence. We outline five key methods and tools as devices for integration which vary in terms of the levels at which integration takes place; the specialist skills and expertise required within the review team; and their appropriateness in the context of limited evidence. In situations where the requirement is the integration of qualitative and process evidence within intervention effectiveness reviews, we recommend the use of a sequential approach. Here, evidence from each tradition is synthesized separately using methods consistent with each tradition before integration takes place using a common framework. Reviews which integrate qualitative and process evaluation evidence alongside quantitative evidence on intervention effectiveness in a systematic way are rare. This guidance aims to support review teams to achieve integration and we encourage further development through reflection and formal testing. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluating supplier quality performance using fuzzy analytical hierarchy process

NASA Astrophysics Data System (ADS)

Ahmad, Nazihah; Kasim, Maznah Mat; Rajoo, Shanmugam Sundram Kalimuthu

2014-12-01

Evaluating supplier quality performance is vital in ensuring continuous supply chain improvement, reducing the operational costs and risks towards meeting customer's expectation. This paper aims to illustrate an application of Fuzzy Analytical Hierarchy Process to prioritize the evaluation criteria in a context of automotive manufacturing in Malaysia. Five main criteria were identified which were quality, cost, delivery, customer serviceand technology support. These criteria had been arranged into hierarchical structure and evaluated by an expert. The relative importance of each criteria was determined by using linguistic variables which were represented as triangular fuzzy numbers. The Center of Gravity defuzzification method was used to convert the fuzzy evaluations into their corresponding crisps values. Such fuzzy evaluation can be used as a systematic tool to overcome the uncertainty evaluation of suppliers' performance which usually associated with human being subjective judgments.

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement.

PubMed

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50-70% concept coverage, indicating the need for continued expansion of the terminology.

Design, Development, and Initial Evaluation of a Terminology for Clinical Decision Support and Electronic Clinical Quality Measurement

PubMed Central

Lin, Yanhua; Staes, Catherine J; Shields, David E; Kandula, Vijay; Welch, Brandon M; Kawamoto, Kensaku

2015-01-01

When coupled with a common information model, a common terminology for clinical decision support (CDS) and electronic clinical quality measurement (eCQM) could greatly facilitate the distributed development and sharing of CDS and eCQM knowledge resources. To enable such scalable knowledge authoring and sharing, we systematically developed an extensible and standards-based terminology for CDS and eCQM in the context of the HL7 Virtual Medical Record (vMR) information model. The development of this terminology entailed three steps: (1) systematic, physician-curated concept identification from sources such as the Health Information Technology Standards Panel (HITSP) and the SNOMED-CT CORE problem list; (2) concept de-duplication leveraging the Unified Medical Language System (UMLS) MetaMap and Metathesaurus; and (3) systematic concept naming using standard terminologies and heuristic algorithms. This process generated 3,046 concepts spanning 68 domains. Evaluation against representative CDS and eCQM resources revealed approximately 50–70% concept coverage, indicating the need for continued expansion of the terminology. PMID:26958220

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren.

PubMed

Helitzer, D L; Davis, S M; Gittelsohn, J; Going, S B; Murray, D M; Snyder, P; Steckler, A B

1999-04-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used.

Process evaluations of task sharing interventions for perinatal depression in low and middle income countries (LMIC): a systematic review and qualitative meta-synthesis.

PubMed

Munodawafa, Memory; Mall, Sumaya; Lund, Crick; Schneider, Marguerite

2018-03-23

Perinatal depression is common in low and middle income countries (LAMICs). Task sharing interventions have been implemented to treat perinatal depression in these settings, as a way of dealing with staff shortages. Task sharing allows lay health workers to provide services for less complex cases while being trained and supervised by specialists. Randomized controlled trials suggest that these interventions can be effective but there is limited qualitative information exploring barriers and facilitators to their implementation. This systematic review aims to systematically review current qualitative evidence of process evaluations of task sharing interventions for perinatal depression in LAMICs in relation to the United Kingdom (UK) Medical Research Council (MRC) framework for conducting process evaluations. We searched Medline/ PubMed, PsycINFO, Scopus, Cochrane Library and Web of science for studies from LAMICS using search terms under the broad categories of: (a) "maternal depression'" (b) "intervention" (c) "lay counsellor" OR "community health worker" OR "non-specialist" and (d) "LAMICs". Abstracts were independently reviewed for inclusion by two authors. Full text articles were screened and data for included articles were extracted using a standard data extraction sheet. Qualitative synthesis of qualitative evidence was conducted. 8420 articles were identified from initial searches. Of these, 26 full text articles were screened for eligibility with only three studies meeting the inclusion criteria. Main findings revealed that participants identified the following crucial factors: contextual factors included physical location, accessibility and cultural norms. Implementation factors included acceptability of the intervention and characteristics of the personnel. Mechanisms included counsellor factors such as motivating and facilitating trust; intervention factors such as use of stories and visual aids, and understandability of the content; and participant factors such as shared experience, meeting learning needs, and meeting expectations. While task sharing has been suggested as an effective way of filling the treatment gap for perinatal depression, there is a paucity of qualitative research exploring barriers and facilitators to implementing these interventions. Qualitative process evaluations are crucial for the development of culturally relevant interventions.

How do illness-anxious individuals process health-threatening information? A systematic review of evidence for the cognitive-behavioral model.

PubMed

Leonidou, Chrysanthi; Panayiotou, Georgia

2018-08-01

According to the cognitive-behavioral model, illness anxiety is developed and maintained through biased processing of health-threatening information and maladaptive responses to such information. This study is a systematic review of research that attempted to validate central tenets of the cognitive-behavioral model regarding etiological and maintenance mechanisms in illness anxiety. Sixty-two studies, including correlational and experimental designs, were identified through a systematic search of databases and were evaluated for their quality. Outcomes were synthesized following a qualitative thematic approach under categories of theoretically driven mechanisms derived from the cognitive-behavioral model: attention, memory and interpretation biases, perceived awareness and inaccuracy in perception of somatic sensations, negativity bias, emotion dysregulation, and behavioral avoidance. Findings partly support the cognitive-behavioral model, but several of its hypothetical mechanisms only receive weak support due to the scarcity of relevant studies. Directions for future research are suggested based on identified gaps in the existing literature. Copyright © 2018 Elsevier Inc. All rights reserved.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention--convened meeting.

PubMed

Broussard, Cheryl S; Frey, Meghan T; Hernandez-Diaz, Sonia; Greene, Michael F; Chambers, Christina D; Sahin, Leyla; Collins Sharp, Beth A; Honein, Margaret A

2014-09-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. Published by Elsevier Inc.

Developing a systematic approach to safer medication use during pregnancy: summary of a Centers for Disease Control and Prevention—convened meeting

PubMed Central

Broussard, Cheryl S.; Frey, Meghan T.; Hernandez-Diaz, Sonia; Greene, Michael F.; Chambers, Christina D.; Sahin, Leyla; Collins Sharp, Beth A.; Honein, Margaret A.

2015-01-01

To address information gaps that limit informed clinical decisions on medication use in pregnancy, the Centers for Disease Control and Prevention (CDC) solicited expert input on a draft prototype outlining a systematic approach to evaluating the quality and strength of existing evidence for associated risks. The draft prototype outlined a process for the systematic review of available evidence and deliberations by a panel of experts to inform clinical decision making for managing health conditions in pregnancy. At an expert meeting convened by the CDC in January 2013, participants divided into working groups discussed decision points within the prototype. This report summarizes their discussions of best practices for formulating an expert review process, developing evidence summaries and treatment guidance, and disseminating information. There is clear recognition of current knowledge gaps and a strong collaboration of federal partners, academic experts, and professional organizations willing to work together toward safer medication use during pregnancy. PMID:24881821

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews

PubMed Central

2013-01-01

Background Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. Methods This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. Results A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. Conclusion There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words) PMID:23331384

Effectiveness of Pilates exercise in treating people with chronic low back pain: a systematic review of systematic reviews.

PubMed

Wells, Cherie; Kolt, Gregory S; Marshall, Paul; Hill, Bridget; Bialocerkowski, Andrea

2013-01-19

Systematic reviews provide clinical practice recommendations that are based on evaluation of primary evidence. When systematic reviews with the same aims have different conclusions, it is difficult to ascertain which review reported the most credible and robust findings. This study examined five systematic reviews that have investigated the effectiveness of Pilates exercise in people with chronic low back pain. A four-stage process was used to interpret findings of the reviews. This process included comparison of research questions, included primary studies, and the level and quality of evidence of systematic reviews. Two independent reviewers assessed the level of evidence and the methodological quality of systematic reviews, using the National Health and Medical Research Council hierarchy of evidence, and the Revised Assessment of Multiple Systematic Reviews respectively. Any disagreements were resolved by a third researcher. A high level of consensus was achieved between the reviewers. Conflicting findings were reported by the five systematic reviews regarding the effectiveness of Pilates in reducing pain and disability in people with chronic low back pain. Authors of the systematic reviews included primary studies that did not match their questions in relation to treatment or population characteristics. A total of ten primary studies were identified across five systematic reviews. Only two of the primary studies were included in all of the reviews due to different inclusion criteria relating to publication date and status, definition of Pilates, and methodological quality. The level of evidence of reviews was low due to the methodological design of the primary studies. The methodological quality of reviews varied. Those which conducted a meta-analysis obtained higher scores. There is inconclusive evidence that Pilates is effective in reducing pain and disability in people with chronic low back pain. This is due to the small number and poor methodological quality of primary studies. The Revised Assessment of Multiple Systematic Reviews provides a useful method of appraising the methodological quality of systematic reviews. Individual item scores, however, should be examined in addition to total scores, so that significant methodological flaws of systematic reviews are not missed, and results are interpreted appropriately. (348 words).

Evaluating the Psychometric Characteristics of Generated Multiple-Choice Test Items

ERIC Educational Resources Information Center

Gierl, Mark J.; Lai, Hollis; Pugh, Debra; Touchie, Claire; Boulais, André-Philippe; De Champlain, André

2016-01-01

Item development is a time- and resource-intensive process. Automatic item generation integrates cognitive modeling with computer technology to systematically generate test items. To date, however, items generated using cognitive modeling procedures have received limited use in operational testing situations. As a result, the psychometric…

20 CFR 404.1519s - Authorizing and monitoring the consultative examination.

Code of Federal Regulations, 2011 CFR

2011-04-01

... evaluating claimant reactions to key providers; and (11) A program of systematic, onsite reviews of key...) A process for orientation, training, and review of new consultative examination providers, with....1519m. (7) Procedures for the ongoing review of consultative examination results to ensure compliance...

Integrating the Curriculum: Quality and Relevance for Special Needs Children.

ERIC Educational Resources Information Center

Wessel, Janet A.

A comprehensive, integrated physical education system that has quality and relevance for handicapped students and their nonhandicapped peers is proposed. The Achievement Based Curriculum (ABC) Model is a systematic decision-making process for an instructional system that incorporates curriculum, instruction, assessment, and evaluation in one…

The neural correlates of moral decision-making: A systematic review and meta-analysis of moral evaluations and response decision judgements.

PubMed

Garrigan, Beverley; Adlam, Anna L R; Langdon, Peter E

2016-10-01

The aims of this systematic review were to determine: (a) which brain areas are consistently more active when making (i) moral response decisions, defined as choosing a response to a moral dilemma, or deciding whether to accept a proposed solution, or (ii) moral evaluations, defined as judging the appropriateness of another's actions in a moral dilemma, rating moral statements as right or wrong, or identifying important moral issues; and (b) shared and significantly different activation patterns for these two types of moral judgements. A systematic search of the literature returned 28 experiments. Activation likelihood estimate analysis identified the brain areas commonly more active for moral response decisions and for moral evaluations. Conjunction analysis revealed shared activation for both types of moral judgement in the left middle temporal gyrus, cingulate gyrus, and medial frontal gyrus. Contrast analyses found no significant clusters of increased activation for the moral evaluations-moral response decisions contrast, but found that moral response decisions additionally activated the left and right middle temporal gyrus and the right precuneus. Making one's own moral decisions involves different brain areas compared to judging the moral actions of others, implying that these judgements may involve different processes. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Investigation of dimensional variation in parts manufactured by fused deposition modeling using Gauge Repeatability and Reproducibility

NASA Astrophysics Data System (ADS)

Mohamed, Omar Ahmed; Hasan Masood, Syed; Lal Bhowmik, Jahar

2018-02-01

In the additive manufacturing (AM) market, the question is raised by industry and AM users on how reproducible and repeatable the fused deposition modeling (FDM) process is in providing good dimensional accuracy. This paper aims to investigate and evaluate the repeatability and reproducibility of the FDM process through a systematic approach to answer this frequently asked question. A case study based on the statistical gage repeatability and reproducibility (gage R&R) technique is proposed to investigate the dimensional variations in the printed parts of the FDM process. After running the simulation and analysis of the data, the FDM process capability is evaluated, which would help the industry for better understanding the performance of FDM technology.

[Evaluation of nursing care systematization through the phases of nursing process performance and registration in a teaching hospital].

PubMed

Reppetto, Maria Angela; de Souza, Mariana Fernandes

2005-01-01

This descriptive study was carried out in a teaching hospital at São Paulo city and had as objective to identify the phases performance and registration of nursing care systematization and the most frequent nursing diagnoses. Data were collected retrospectively from 135 patients records of three units: Cardiology, Adult Infectious Diseases and Neurosurgery, from January to July, 2002. The phases: history, nursing diagnoses, prescription, evolution and assessment were performed and registered in the three units, however, it was verified systematization gaps performance related to nursing diagnoses registered without the realization of nursing history and nursing prescriptions without evolution. The most frequent nursing diagnosis in the three units was risk for infection.

Measuring the Impact of Employment-Related Social Programs. A Primer on the Evaluation of Employment and Training, Vocational Education, Vocational Rehabilitation, and Other Job-Oriented Programs.

ERIC Educational Resources Information Center

Borus, Michael E.

An approach and methodology for the systematic measurement of the impact of employment-related social programs is presented in this primer. Chapter 1 focuses on evaluation as the third step (the first two being planning and operation) in the process of program implementation. Chapter 2 examines the impacts of social programs. Topics include…

An approach to addressing subpopulation considerations in systematic reviews: the experience of reviewers supporting the U.S. Preventive Services Task Force.

PubMed

Whitlock, Evelyn P; Eder, Michelle; Thompson, Jamie H; Jonas, Daniel E; Evans, Corinne V; Guirguis-Blake, Janelle M; Lin, Jennifer S

2017-03-02

Guideline developers and other users of systematic reviews need information about whether a medical or preventive intervention is likely to benefit or harm some patients more (or less) than the average in order to make clinical practice recommendations tailored to these populations. However, guidance is lacking on how to include patient subpopulation considerations into the systematic reviews upon which guidelines are often based. In this article, we describe methods developed to consistently consider the evidence for relevant subpopulations in systematic reviews conducted to support primary care clinical preventive service recommendations made by the U.S. Preventive Services Task Force (USPSTF). Our approach is grounded in our experience conducting systematic reviews for the USPSTF and informed by a review of existing guidance on subgroup analysis and subpopulation issues. We developed and refined our approach based on feedback from the Subpopulation Workgroup of the USPSTF and pilot testing on reviews being conducted for the USPSTF. This paper provides processes and tools for incorporating evidence-based identification of important sources of potential heterogeneity of intervention effects into all phases of systematic reviews. Key components of our proposed approach include targeted literature searches and key informant interviews to identify the most important subpopulations a priori during topic scoping, a framework for assessing the credibility of subgroup analyses reported in studies, and structured investigation of sources of heterogeneity of intervention effects. Further testing and evaluation are necessary to refine this proposed approach and demonstrate its utility to the producers and users of systematic reviews beyond the context of the USPSTF. Gaps in the evidence on important subpopulations identified by routinely applying this process in systematic reviews will also inform future research needs.

Systematic review of the psychometric properties and theoretical grounding of instruments evaluating self-care in people with type 2 diabetes mellitus.

PubMed

Caro-Bautista, Jorge; Martín-Santos, Francisco Javier; Morales-Asencio, Jose Miguel

2014-06-01

To determine the psychometric properties and theoretical grounding of instruments that evaluate self-care behaviour or barriers in people with type 2 diabetes. There are many instruments designed to evaluate self-care behaviour or barriers in this population, but knowledge about their psychometric validation processes is lacking. Systematic review. We conducted a search for psychometric or validation studies published between January 1990-December 2012. We carried out searches in Pubmed, CINAHL, PsycINFO, ProQuolid, BibliPRO and Google SCHOLAR to identify instruments that evaluated self-care behaviours or barriers to diabetes self-care. We conducted a systematic review with the following inclusion criteria: Psychometric or clinimetric validation studies that included patients with type 2 diabetes (exclusively or partially) and which analysed self-care behaviour or barriers to self-care and proxies like self-efficacy or empowerment, from a multidimensional approach. Language: Spanish or English. Two authors independently assessed the quality of the studies and extracted data using Terwee's proposed criteria: psychometrics properties, dimensionality, theoretical ground and population used for validation through each included instrument. Sixteen instruments achieved the inclusion criteria for the review. We detected important methodological flaws in many of the selected instruments. Only the Self-management Profile for Type 2 Diabetes and Problem Areas in Diabetes Scale met half of Terwee's quality criteria. There are no instruments for identifying self-care behaviours or barriers elaborated with a strong validation process. Further research should be carried out to provide patients, clinicians and researchers with valid and reliable instruments that are methodologically solid and theoretically grounded. © 2013 John Wiley & Sons Ltd.

Evaluating the performance of free-formed surface parts using an analytic network process

NASA Astrophysics Data System (ADS)

Qian, Xueming; Ma, Yanqiao; Liang, Dezhi

2018-03-01

To successfully design parts with a free-formed surface, the critical issue of how to evaluate and select a favourable evaluation strategy before design is raised. The evaluation of free-formed surface parts is a multiple criteria decision-making (MCDM) problem that requires the consideration of a large number of interdependent factors. The analytic network process (ANP) is a relatively new MCDM method that can systematically deal with all kinds of dependences. In this paper, the factors, which come from the life-cycle and influence the design of free-formed surface parts, are proposed. After analysing the interdependence among these factors, a Hybrid ANP (HANP) structure for evaluating the part’s curved surface is constructed. Then, a HANP evaluation of an impeller is presented to illustrate the application of the proposed method.

Evaluating Health Advice in a Web 2.0 Environment: The Impact of Multiple User-Generated Factors on HIV Advice Perceptions.

PubMed

Walther, Joseph B; Jang, Jeong-Woo; Hanna Edwards, Ashley A

2018-01-01

Unlike traditional media, social media systems often present information of different types from different kinds of contributors within a single message pane, a juxtaposition of potential influences that challenges traditional health communication processing. One type of social media system, question-and-answer advice systems, provides peers' answers to health-related questions, which yet other peers read and rate. Responses may appear good or bad, responders may claim expertise, and others' aggregated evaluations of an answer's usefulness may affect readers' judgments. An experiment explored how answer feasibility, expertise claims, and user-generated ratings affected readers' assessments of advice about anonymous HIV testing. Results extend the heuristic-systematic model of persuasion (Chaiken, 1980) and warranting theory (Walther & Parks, 2002). Information that is generally associated with both systematic and heuristic processes influenced readers' evaluations. Moreover, content-level cues affected judgments about message sources unexpectedly. When conflicting cues were present, cues with greater warranting value (consensus user-generated ratings) had greater influence on outcomes than less warranted cues (self-promoted expertise). Findings present a challenge to health professionals' concerns about the reliability of online health information systems.

Empirical studies on usability of mHealth apps: a systematic literature review.

PubMed

Zapata, Belén Cruz; Fernández-Alemán, José Luis; Idri, Ali; Toval, Ambrosio

2015-02-01

The release of smartphones and tablets, which offer more advanced communication and computing capabilities, has led to the strong emergence of mHealth on the market. mHealth systems are being used to improve patients' lives and their health, in addition to facilitating communication between doctors and patients. Researchers are now proposing mHealth applications for many health conditions such as dementia, autism, dysarthria, Parkinson's disease, and so on. Usability becomes a key factor in the adoption of these applications, which are often used by people who have problems when using mobile devices and who have a limited experience of technology. The aim of this paper is to investigate the empirical usability evaluation processes described in a total of 22 selected studies related to mHealth applications by means of a Systematic Literature Review. Our results show that the empirical evaluation methods employed as regards usability could be improved by the adoption of automated mechanisms. The evaluation processes should also be revised to combine more than one method. This paper will help researchers and developers to create more usable applications. Our study demonstrates the importance of adapting health applications to users' need.

Evaluating Payments for Environmental Services: Methodological Challenges

PubMed Central

2016-01-01

Over the last fifteen years, Payments for Environmental Services (PES) schemes have become very popular environmental policy instruments, but the academic literature has begun to question their additionality. The literature attempts to estimate the causal effect of these programs by applying impact evaluation (IE) techniques. However, PES programs are complex instruments and IE methods cannot be directly applied without adjustments. Based on a systematic review of the literature, this article proposes a framework for the methodological process of designing an IE for PES schemes. It revises and discusses the methodological choices at each step of the process and proposes guidelines for practitioners. PMID:26910850

Natural language processing systems for capturing and standardizing unstructured clinical information: A systematic review.

PubMed

Kreimeyer, Kory; Foster, Matthew; Pandey, Abhishek; Arya, Nina; Halford, Gwendolyn; Jones, Sandra F; Forshee, Richard; Walderhaug, Mark; Botsis, Taxiarchis

2017-09-01

We followed a systematic approach based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses to identify existing clinical natural language processing (NLP) systems that generate structured information from unstructured free text. Seven literature databases were searched with a query combining the concepts of natural language processing and structured data capture. Two reviewers screened all records for relevance during two screening phases, and information about clinical NLP systems was collected from the final set of papers. A total of 7149 records (after removing duplicates) were retrieved and screened, and 86 were determined to fit the review criteria. These papers contained information about 71 different clinical NLP systems, which were then analyzed. The NLP systems address a wide variety of important clinical and research tasks. Certain tasks are well addressed by the existing systems, while others remain as open challenges that only a small number of systems attempt, such as extraction of temporal information or normalization of concepts to standard terminologies. This review has identified many NLP systems capable of processing clinical free text and generating structured output, and the information collected and evaluated here will be important for prioritizing development of new approaches for clinical NLP. Copyright © 2017 Elsevier Inc. All rights reserved.

False memories and confabulation.

PubMed

Johnson, M K; Raye, C L

1998-04-01

Memory distortions range from the benign (thinking you mailed a check that you only thought about mailing), to the serious (confusing what you heard after a crime with what you actually saw), to the fantastic (claiming you piloted a spaceship). We review theoretical ideas and empirical evidence about the source monitoring processes underlying both true and false memories. Neuropsychological studies show that certain forms of brain damage (such as combined frontal and medial-temporal lesions) might result in profound source confusions, called confabulations. Neuroimaging techniques provide new evidence regarding more specific links between underlying brain mechanisms and the normal cognitive processes involved in evaluating memories. One hypothesis is that the right prefrontal cortex (PFC) subserves heuristic judgments based on easily assessed qualities (such as familiarity or perceptual detail) and the left PFC (or the right and left PFC together) subserves more systematic judgments requiring more careful analysis of memorial qualities or retrieval and evaluation of additional supporting or disconfirming information. Such heuristic and systematic processes can be disrupted not only by brain damage but also, for example, by hypnosis, social demands and motivational factors, suggesting caution in the methods used by `memory exploring' professions (therapists, police officers, lawyers, etc.) in order to avoid inducing false memories.

High-pressure homogenization associated hydrothermal process of palygorskite for enhanced adsorption of Methylene blue

NASA Astrophysics Data System (ADS)

Zhang, Zhifang; Wang, Wenbo; Wang, Aiqin

2015-02-01

Palygorskite (PAL) was modified by a high-pressure homogenization assisted hydrothermal process. The effects of modification on the morphology, structure and physicochemical properties of PAL were systematically investigated by Field-emission scanning electron microscopy (FESEM), Transmission electron microscopy (TEM), Fourier transform infrared spectrometry (FTIR), Brunauer-Emmett-Teller (BET) analysis, X-ray diffraction (XRD) and Zeta potential analysis techniques, and the adsorption properties were systematically evaluated using Methylene blue (MB) as the model dye. The results revealed that the crystal bundles were disaggregated and the PAL nanorods became more even after treated via associated high-pressure homogenization and hydrothermal process, and the crystal bundles were dispersed as nanorods. The intrinsic crystal structure of PAL was remained after hydrothermal treatment, and the pore size calculated by the BET method was increased. The adsorption properties of PAL for MB were evidently improved (from 119 mg/g to 171 mg/g) after modification, and the dispersion of PAL before hydrothermal reaction is favorable to the adsorption. The desorption evaluation confirms that the modified PAL has stronger affinity with MB, which is benefit to fabricate a stable organic-inorganic hybrid pigment.

The advantages and limitations of guideline adaptation frameworks.

PubMed

Wang, Zhicheng; Norris, Susan L; Bero, Lisa

2018-05-29

The implementation of evidence-based guidelines can improve clinical and public health outcomes by helping health professionals practice in the most effective manner, as well as assisting policy-makers in designing optimal programs. Adaptation of a guideline to suit the context in which it is intended to be applied can be a key step in the implementation process. Without taking the local context into account, certain interventions recommended in evidence-based guidelines may be infeasible under local conditions. Guideline adaptation frameworks provide a systematic way of approaching adaptation, and their use may increase transparency, methodological rigor, and the quality of the adapted guideline. This paper presents a number of adaptation frameworks that are currently available. We aim to compare the advantages and limitations of their processes, methods, and resource implications. These insights into adaptation frameworks can inform the future development of guidelines and systematic methods to optimize their adaptation. Recent adaptation frameworks show an evolution from adapting entire existing guidelines, to adapting specific recommendations extracted from an existing guideline, to constructing evidence tables for each recommendation that needs to be adapted. This is a move towards more recommendation-focused, context-specific processes and considerations. There are still many gaps in knowledge about guideline adaptation. Most of the frameworks reviewed lack any evaluation of the adaptation process and outcomes, including user satisfaction and resources expended. The validity, usability, and health impact of guidelines developed via an adaptation process have not been studied. Lastly, adaptation frameworks have not been evaluated for use in low-income countries. Despite the limitations in frameworks, a more systematic approach to adaptation based on a framework is valuable, as it helps to ensure that the recommendations stay true to the evidence while taking local needs into account. The utilization of frameworks in the guideline implementation process can be optimized by increasing the understanding and upfront estimation of resource and time needed, capacity building in adaptation methods, and increasing the adaptability of the source recommendation document.

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature.

PubMed

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability.

Program Review: A Critical Analysis of Departmental Effectiveness. Revised.

ERIC Educational Resources Information Center

Huffman, Zoula; And Others

Describing the evaluation and planning process at Mississippi Gulf Coast Community College, this document presents guidelines, procedures, and indicators used at the college for the systematic review of academic departmental effectiveness. First, the five-column program review model used at the college is outlined and the purposes of review are…

Development Research of a Teachers' Educational Performance Support System: The Practices of Design, Development, and Evaluation

ERIC Educational Resources Information Center

Hung, Wei-Chen; Smith, Thomas J.; Harris, Marian S.; Lockard, James

2010-01-01

This study adopted design and development research methodology (Richey & Klein, "Design and development research: Methods, strategies, and issues," 2007) to systematically investigate the process of applying instructional design principles, human-computer interaction, and software engineering to a performance support system (PSS) for behavior…

In Transit...Making the Change to Metrics.

ERIC Educational Resources Information Center

Farnsworth, Briant J.; And Others

1980-01-01

Granite School District (Utah) developed a systematic, effective, and cost-efficient teacher inservice program which provides a basic understanding of metrics, materials and methods for direct classroom use, and evaluation of the learning process, through the use of self-contained, three-phase modules for home or school use. (Author/SB)

The Louisiana Accelerated Schools Project First Year Evaluation Report.

ERIC Educational Resources Information Center

St. John, Edward P.; And Others

The Louisiana Accelerated Schools Project (LASP) is a statewide network of schools that are changing from the traditional mode of schooling for at-risk students, which stresses remediation, to one of acceleration, which stresses accelerated learning for all students. The accelerated schools process provides a systematic approach to the…

Evaluating a Technology Supported Interactive Response System during the Laboratory Section of a Histology Course

ERIC Educational Resources Information Center

Rinaldi, Vera D.; Lorr, Nancy A.; Williams, Kimberly

2017-01-01

Monitoring of student learning through systematic formative assessment is important for adjusting pedagogical strategies. However, traditional formative assessments, such as quizzes and written assignments, may not be sufficiently timely for making adjustments to a learning process. Technology supported formative assessment tools assess student…

Teaching Evidence-based Medicine Using Literature for Problem Solving.

ERIC Educational Resources Information Center

Mottonen, Merja; Tapanainen, Paivi; Nuutinen, Matti; Rantala, Heikki; Vainionpaa, Leena; Uhari, Matti

2001-01-01

Evidence-based medicine--the process of using research findings systematically as the basis for clinical decisions--can be taught using problem-solving teaching methods. Evaluates whether it was possible to motivate students to use the original literature by giving them selected patient problems to solve. (Author/ASK)

The Taxonomy of Intervention Intensity

ERIC Educational Resources Information Center

Fuchs, Lynn S.; Fuchs, Douglas; Malone, Amelia S.

2016-01-01

The purpose of this article is to describe the Taxonomy of Intervention Intensity, which articulates 7 dimensions for evaluating and building intervention intensity. We explain the Taxonomy's dimensions of intensity. In explaining the Taxonomy, we rely on a case study to illustrate how the Taxonomy can systematize the process by which special…

The effect of a geriatric evaluation on treatment decisions and outcome for older cancer patients - A systematic review.

PubMed

Hamaker, Marije E; Te Molder, Marthe; Thielen, Noortje; van Munster, Barbara C; Schiphorst, Anandi H; van Huis, Lieke H

2018-04-06

The aim of this systematic review is to summarise all available data on the effect of a geriatric evaluation on the multidisciplinary treatment of older cancer patients, focussing on oncologic treatment decisions, the implementation of non-oncologic interventions and the impact on treatment outcome. A systematic search in MEDLINE and EMBASE for studies on the effect of a geriatric evaluation on oncologic and non-oncologic treatment decisions and outcome for older cancer patients. 36 publications from 35 studies were included. After a geriatric evaluation, the oncologic treatment plan was altered in a median of 28% of patients (range 8-54%), primarily to a less intensive treatment option. Non-oncologic interventions were recommended in a median of 72% of patients (range 26-100%), most commonly involving social issues (39%), nutritional status (32%) and polypharmacy (31%). Effect on treatment outcome was varying, with a trend towards a positive effect on treatment completion (positive effect in 75% of studies) and treatment-related toxicity/ complications (55% of studies). A geriatric evaluation affects oncologic and non-oncologic treatment and appears to improve treatment tolerance and completion for older cancer patients. Fine-tuning the decision-making process for this growing patient population will require more specific and robust data on the effect of a geriatric evaluation on relevant oncologic and non-oncologic outcomes such as survival and quality of life. Copyright © 2017. Published by Elsevier Ltd.

A Systematic Approach of Employing Quality by Design Principles: Risk Assessment and Design of Experiments to Demonstrate Process Understanding and Identify the Critical Process Parameters for Coating of the Ethylcellulose Pseudolatex Dispersion Using Non-Conventional Fluid Bed Process.

PubMed

Kothari, Bhaveshkumar H; Fahmy, Raafat; Claycamp, H Gregg; Moore, Christine M V; Chatterjee, Sharmista; Hoag, Stephen W

2017-05-01

The goal of this study was to utilize risk assessment techniques and statistical design of experiments (DoE) to gain process understanding and to identify critical process parameters for the manufacture of controlled release multiparticulate beads using a novel disk-jet fluid bed technology. The material attributes and process parameters were systematically assessed using the Ishikawa fish bone diagram and failure mode and effect analysis (FMEA) risk assessment methods. The high risk attributes identified by the FMEA analysis were further explored using resolution V fractional factorial design. To gain an understanding of the processing parameters, a resolution V fractional factorial study was conducted. Using knowledge gained from the resolution V study, a resolution IV fractional factorial study was conducted; the purpose of this IV study was to identify the critical process parameters (CPP) that impact the critical quality attributes and understand the influence of these parameters on film formation. For both studies, the microclimate, atomization pressure, inlet air volume, product temperature (during spraying and curing), curing time, and percent solids in the coating solutions were studied. The responses evaluated were percent agglomeration, percent fines, percent yield, bead aspect ratio, median particle size diameter (d50), assay, and drug release rate. Pyrobuttons® were used to record real-time temperature and humidity changes in the fluid bed. The risk assessment methods and process analytical tools helped to understand the novel disk-jet technology and to systematically develop models of the coating process parameters like process efficiency and the extent of curing during the coating process.

Utilization of Clinical Trials Registries in Obstetrics and Gynecology Systematic Reviews.

PubMed

Bibens, Michael E; Chong, A Benjamin; Vassar, Matt

2016-02-01

To evaluate the use of clinical trials registries in published obstetrics and gynecologic systematic reviews and meta-analyses. We performed a metaepidemiologic study of systematic reviews between January 1, 2007, and December 31, 2015, from six obstetric and gynecologic journals (Obstetrics & Gynecology, Obstetrical & Gynecological Survey, Human Reproduction Update, Gynecologic Oncology, British Journal of Obstetrics and Gynaecology, and American Journal of Obstetrics & Gynecology). All systematic reviews included after exclusions were independently reviewed to determine whether clinical trials registries had been included as part of the search process. Studies that reported using a trials registry were further examined to determine whether trial data were included in the analysis of these systematic reviews. Our initial search resulted in 292 articles, which was narrowed to 256 after exclusions. Of the 256 systematic reviews meeting our selection criteria, 47 (18.4%) used a clinical trials registry. Eleven of the 47 (23.4%) systematic reviews found unpublished data and two included unpublished data in their results. A majority of systematic reviews in clinical obstetrics and gynecology journals do not conduct searches of clinical trials registries or do not make use of data obtained from these searches. Failure to make use of such data may lead to an inaccurate summary of available evidence and may contribute to an overrepresentation of published, statistically significant outcomes.

[Reevaluation for systematic reviews for traditional Chinese medicine injections for coronary disease].

PubMed

Yin, Xiu-Ping; Xie, Yan-Ming; Liao, Xing; Luo, Man

2016-11-01

To reevaluate the systematic reviews for traditional Chinese medicine(TCM) injections for treating coronary disease, data in four Chinese databases and PubMed, Embase, Cochrane Library, Wed of Science OVID from inception until May 2016 were searched. We extracted data according to the AMSTAR and PRISMA checklists to evaluate the methodological quality and reporting characteristics of included literatures. A total of 69 systematic reviews were included, involving 24 TCM injections, which showed certain efficacy in treating coronary disease, and whose main outcome indexes included alleviation of symptoms of angina pectoris and electrocardiogram. In all of the systematic reviews, the duration of follow-up were not reported. Six systematic reviews reported TCM typing. In the 44 system reviews, 1 335 reports mentioned 4 137 adverse events. According to the results of AMSTAR and PRISMA checklists, the quality assessment scores about included studies were not high, and most of the systematic reviews suffered heterogeneity and irrational processing of forest plots. In conclusion, TCM injections in the treatment of coronary disease have a wide range and positive effects. However, affected by the low quality of systematic reviews and the production of reevaluation, the study had some limitations. Therefore, the systematic reviews shall be further improved, in order to provide more advanced clinical evidences to clinicians. Copyright© by the Chinese Pharmaceutical Association.

Development and Evaluation of ‘Briefing Notes’ as a Novel Knowledge Translation Tool to Aid the Implementation of Sex/Gender Analysis in Systematic Reviews: A Pilot Study

PubMed Central

Doull, Marion; Welch, Vivian; Puil, Lorri; Runnels, Vivien; Coen, Stephanie E.; Shea, Beverley; O’Neill, Jennifer; Borkhoff, Cornelia; Tudiver, Sari; Boscoe, Madeline

2014-01-01

Background There is increasing recognition of sex/gender differences in health and the importance of identifying differential effects of interventions for men and women. Yet, to whom the research evidence does or does not apply, with regard to sex/gender, is often insufficiently answered. This is also true for systematic reviews which synthesize results of primary studies. A lack of analysis and reporting of evidence on sex/gender raises concerns about the applicability of systematic reviews. To bridge this gap, this pilot study aimed to translate knowledge about sex/gender analysis (SGA) into a user-friendly ‘briefing note’ format and evaluate its potential in aiding the implementation of SGA in systematic reviews. Methods Our Sex/Gender Methods Group used an interactive process to translate knowledge about sex/gender into briefing notes, a concise communication tool used by policy and decision makers. The briefing notes were developed in collaboration with three Cochrane Collaboration review groups (HIV/AIDS, Hypertension, and Musculoskeletal) who were also the target knowledge users of the briefing notes. Briefing note development was informed by existing systematic review checklists, literature on sex/gender, in-person and virtual meetings, and consultation with topic experts. Finally, we held a workshop for potential users to evaluate the notes. Results Each briefing note provides tailored guidance on considering sex/gender to reviewers who are planning or conducting systematic reviews and includes the rationale for considering sex/gender, with examples specific to each review group’s focus. Review authors found that the briefing notes provided welcome guidance on implementing SGA that was clear and concise, but also identified conceptual and implementation challenges. Conclusions Sex/gender briefing notes are a promising knowledge translation tool. By encouraging sex/gender analysis and equity considerations in systematic reviews, the briefing notes can assist systematic reviewers in ensuring the applicability of research evidence, with the goal of improved health outcomes for diverse populations. PMID:25372876

A systematic scoping review of the evidence for consumer involvement in organisations undertaking systematic reviews: focus on Cochrane.

PubMed

Morley, Richard F; Norman, Gill; Golder, Su; Griffith, Polly

2016-01-01

Cochrane is the largest international producer of systematic reviews of clinical trial evidence. We looked for published evidence that reports where consumers (patients and the public) have been involved in Cochrane systematic reviews, and also in reviews published by other organisations.We found 36 studies that reported about consumer involvement either in individual systematic reviews, or in other organisations. The studies showed that consumers were involved in reviews in a range of different ways: coordinating and producing reviews, making reviews more accessible, and spreading the results of reviews ("knowledge transfer"). The most common role was commenting on reviews ("peer reviewing"). Consumers also had other general roles, for example in educating people about evidence or helping other consumers. There were some interesting examples of new ways of involving consumers. The studies showed that most consumers came from rich and English speaking countries. There was little evidence about how consumer involvement had changed the reviews ("impact"). The studies found that consumer involvement needed to be properly supported.In future we believe that more research should be done to understand what kind of consumer involvement has the best impact; that more review authors should report how consumers have been involved; and that consumers who help with reviews should come from more varied backgrounds. Background Cochrane is the largest international producer of systematic reviews, and is committed to consumer involvement in the production and dissemination of its reviews. The review aims to systematically scope the evidence base for consumer involvement in organisations which commission, undertake or support systematic reviews; with an emphasis on Cochrane. Methods In June 2015 we searched six databases and other sources for studies of consumer involvement in organisations which commission, undertake or support systematic reviews, or in individual systematic review processes. All types of reports and evaluations were eligible. Included studies were combined in a narrative synthesis structured by the level of evaluation and the type of involvement. Results We identified 36 relevant studies. Eleven of these were evaluations at the level of a whole organisation; seven of these studied consumer involvement in Cochrane. Ten studies examined individual Cochrane review groups. Twelve studies reported on individual reviews; only two of these were Cochrane reviews. Finally, three studies were themselves syntheses of other studies. The included studies reported varying levels of consumer involvement across a wide range of activities related to review design and conduct. These included activities such as priority setting and outcome definition as well as review-specific roles such as acting as peer referees and producing plain language summaries. The level of satisfaction and awareness of impact was generally higher in studies focused on individual Cochrane review groups than in the organisation-wide studies. Conclusions There was evidence of highly variable levels and types of consumer involvement within and beyond Cochrane, but limited evidence for what makes the most effective methods and levels of involving consumers in review production. Where evidence of impact was found at the level of individual reviews and review groups it underlined the need for properly resourced and supported processes in order to derive the greatest benefit from the lived experiences of consumers who are willing to be involved. Where reviews do involve consumers, their contribution to the final result could be more clearly identified. More rigorous evaluations are needed to determine the best approach to achieving this. Trial registration Not applicable.

The quality of instruments to assess the process of shared decision making: A systematic review.

PubMed

Gärtner, Fania R; Bomhof-Roordink, Hanna; Smith, Ian P; Scholl, Isabelle; Stiggelbout, Anne M; Pieterse, Arwen H

2018-01-01

To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument's content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations.

Process evaluation in a multisite, primary obesity-prevention trial in American Indian schoolchildren1–3

PubMed Central

Helitzer, Deborah L; Davis, Sally M; Gittelsohn, Joel; Going, Scott B; Murray, David M; Snyder, Patricia; Steckler, Allan B

2016-01-01

We describe the development, implementation, and use of the process evaluation component of a multisite, primary obesity prevention trial for American Indian schoolchildren. We describe the development and pilot testing of the instruments, provide some examples of the criteria for instrument selection, and provide examples of how process evaluation results were used to document and refine intervention components. The theoretical and applied framework of the process evaluation was based on diffusion theory, social learning theory, and the desire for triangulation of multiple modes of data collection. The primary objectives of the process evaluation were to systematically document the training process, content, and implementation of 4 components of the intervention. The process evaluation was developed and implemented collaboratively so that it met the needs of both the evaluators and those who would be implementing the intervention components. Process evaluation results revealed that observation and structured interviews provided the most informative data; however, these methods were the most expensive and time consuming and required the highest level of skill to undertake. Although the literature is full of idealism regarding the uses of process evaluation for formative and summative purposes, in reality, many persons are sensitive to having their work evaluated in such an in-depth, context-based manner as is described. For this reason, use of structured, quantitative, highly objective tools may be more effective than qualitative methods, which appear to be more dependent on the skills and biases of the researcher and the context in which they are used. PMID:10195608

Sustainability in Health care by Allocating Resources Effectively (SHARE) 6: investigating methods to identify, prioritise, implement and evaluate disinvestment projects in a local healthcare setting.

PubMed

Harris, Claire; Allen, Kelly; Brooke, Vanessa; Dyer, Tim; Waller, Cara; King, Richard; Ramsey, Wayne; Mortimer, Duncan

2017-05-25

This is the sixth in a series of papers reporting Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. The SHARE program was established to investigate a systematic, integrated, evidence-based approach to disinvestment within a large Australian health service. This paper describes the methods employed in undertaking pilot disinvestment projects. It draws a number of lessons regarding the strengths and weaknesses of these methods; particularly regarding the crucial first step of identifying targets for disinvestment. Literature reviews, survey, interviews, consultation and workshops were used to capture and process the relevant information. A theoretical framework was adapted for evaluation and explication of disinvestment projects, including a taxonomy for the determinants of effectiveness, process of change and outcome measures. Implementation, evaluation and costing plans were developed. Four literature reviews were completed, surveys were received from 15 external experts, 65 interviews were conducted, 18 senior decision-makers attended a data gathering workshop, 22 experts and local informants were consulted, and four decision-making workshops were undertaken. Mechanisms to identify disinvestment targets and criteria for prioritisation and decision-making were investigated. A catalogue containing 184 evidence-based opportunities for disinvestment and an algorithm to identify disinvestment projects were developed. An Expression of Interest process identified two potential disinvestment projects. Seventeen additional projects were proposed through a non-systematic nomination process. Four of the 19 proposals were selected as pilot projects but only one reached the implementation stage. Factors with potential influence on the outcomes of disinvestment projects are discussed and barriers and enablers in the pilot projects are summarised. This study provides an in-depth insight into the experience of disinvestment in one local healthcare service. To our knowledge, this is the first paper to report the process of disinvestment from identification, through prioritisation and decision-making, to implementation and evaluation, and finally explication of the processes and outcomes.

Executive summary: evaluating the evidence base to support the inclusion of infants and children from birth to 24 mo of age in the Dietary Guidelines for Americans—“the B-24 Project”123

PubMed Central

Raghavan, Ramkripa; Porter, Alexandra; Obbagy, Julie E; Spahn, Joanne M

2014-01-01

The Dietary Guidelines for Americans (DGA) are the cornerstone of US government efforts to promote health and prevent disease through diet and nutrition. The DGA currently provides guidelines for ages ≥2 y. In an effort to determine the strength of the evidence to support the inclusion of infants and children from birth to age 24 mo, the partner agencies led by the Department of Health and Human Services Office of Disease Prevention and Health Promotion and the USDA Center for Nutrition Program and Policy initiated the project entitled “Evaluating the evidence base to support the inclusion of infants and children from birth to 24 months of age in the Dietary Guidelines for Americans—the B-24 Project.” This project represents the first step in the process of applying systematic reviews to the process of deciding whether the evidence is sufficient to include this age group in future editions of the DGA. This supplement includes the B-24 Executive Summary, which describes the B-24 Project and the deliberations of the 4 working groups during the process of developing priority topics for the systematic review, and a research agenda to address the critical gaps. Also included in this supplement issue is an article on the Nutrition Evidence Library methodology for developing systematic review questions and articles from the invited content presenters at the B-24 Prime meeting. PMID:24500158

Multiuser virtual worlds in healthcare education: A systematic review.

PubMed

Liaw, Sok Ying; Carpio, Guiller Augustin C; Lau, Ying; Tan, Seng Chee; Lim, Wee Shiong; Goh, Poh Sun

2018-06-01

The use of multiuser virtual worlds (MUVWs) for collaborative learning has generated interest among healthcare educators. Published evidence to support its use is growing, but none has synthesized the evidence to guide future work. This study sought to provide a comprehensive and systematic evaluation of MUVWs in healthcare education. A systematic review METHODS: A systematic search of five databases including CINAHL, Cochrane library, EMBASE, PubMed, and Scopus, was conducted from inception up to January 2017. Two independent researchers selected studies that met the inclusion criteria and assessed for methodological quality using the Medical Education Research Study Quality Instrument (MERSQI). A total of 18 studies were reviewed and their data were synthesized narratively using a 3-P model (presage-process-product). Average scores in the MERSQI for methodological quality are 10/18, which is modest. A rally by the government or professional bodies towards more collaborative working among healthcare professionals is a key driver behind implementing MUVWs. Funding is important for its development and evaluation. Team training in acute care and communication training were the most frequent learning objectives, and predominant learning activities include practice on simulation scenario and debriefing. Two-thirds of the studies did not explain their theoretical framework that underpinned their design and implementation of MUVWs. While MUVWs in healthcare education is generally well-received, learning outcomes remain inconclusive. Despite a growth of studies on the use of MUVW in healthcare education, there is a need for more understanding of the application of theories to inform the learning activities. Therefore, we suggest educators to incorporate a theoretical model to explain the learning processes behind MUVWs. To improve the quality of evidence, we call for researchers to employ a more rigorous and broader approach to evaluation that explicates longer-term outcomes, including cost benefit analyses. Copyright © 2018 Elsevier Ltd. All rights reserved.

The impact of health information technology on organ transplant care: A systematic review.

PubMed

Niazkhani, Zahra; Pirnejad, Habibollah; Rashidi Khazaee, Parviz

2017-04-01

Health Information Technology (HIT) has a potential to promote transplant care. However, a systematic appraisal on how HIT application has so far affected transplant care is greatly missing from the literature. We systematically reviewed trials that evaluated HIT impact on process and patient outcomes as well as costs in organ transplant care. A systematic search was conducted in OVID versions of MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane, and IEEE databases from January 1990 to December 2015. Studies were included if they: (i) evaluated HIT interventions; (ii) reported results for organ transplant population; (iii) reported quantitative data on process, patient, and cost outcomes; and (iv) used a randomized controlled trial or quasi-experimental study design. Primarily, 12,440 publications were identified; from which ten met inclusion criteria. Among HIT systems, uses of clinical decision support systems (CDSS) targeting different aspects of the complex organ transplant care were common. In terms of process outcomes, HIT positively impacted the timeliness of care, laboratory and medication management practices such as promoting therapeutic or diagnostic protocol compliance by clinicians, and reducing medication errors. Regarding patient outcomes, HIT demonstrated a beneficial impact on the percentage of post-transplant patients with normal lab values and decreasing immunosuppressive toxicity and also deviation from the predefined immunosuppressive therapeutic window. However, in terms of mortality, readmission, rejection, and antiviral resistance rates, the impact was not clearly established in the literature. Finally, these systems were associated with savings in the costs of transplant care in three studies. This is the first study reviewing HIT impact on transplant care outcomes. CDSSs have mainly been reported to support transplant care in realizing the above-mentioned benefits. However, to make conclusions, more evidence with less risk of bias is warranted. Several gaps in the literature, including comparison of the impact of commercial systems in different transplant settings, was identified which can motivate future research. Copyright © 2017 Elsevier B.V. All rights reserved.

Economic evaluation of vaccines in Canada: A systematic review.

PubMed

Chit, Ayman; Lee, Jason K H; Shim, Minsup; Nguyen, Van Hai; Grootendorst, Paul; Wu, Jianhong; Van Exan, Robert; Langley, Joanne M

2016-05-03

Economic evaluations should form part of the basis for public health decision making on new vaccine programs. While Canada's national immunization advisory committee does not systematically include economic evaluations in immunization decision making, there is increasing interest in adopting them. We therefore sought to examine the extent and quality of economic evaluations of vaccines in Canada. We conducted a systematic review of economic evaluations of vaccines in Canada to determine and summarize: comprehensiveness across jurisdictions, studied vaccines, funding sources, study designs, research quality, and changes over time. Searches in multiple databases were conducted using the terms "vaccine," "economics" and "Canada." Descriptive data from eligible manuscripts was abstracted and three authors independently evaluated manuscript quality using a 7-point Likert-type scale scoring tool based on criteria from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). 42/175 articles met the search criteria. Of these, Canada-wide studies were most common (25/42), while provincial studies largely focused on the three populous provinces of Ontario, Quebec and British Columbia. The most common funding source was industry (17/42), followed by government (7/42). 38 studies used mathematical models estimating expected economic benefit while 4 studies examined post-hoc data on established programs. Studies covered 10 diseases, with 28/42 addressing pediatric vaccines. Many studies considered cost-utility (22/42) and the majority of these studies reported favorable economic results (16/22). The mean quality score was 5.9/7 and was consistent over publication date, funding sources, and disease areas. We observed diverse approaches to evaluate vaccine economics in Canada. Given the increased complexity of economic studies evaluating vaccines and the impact of results on public health practice, Canada needs improved, transparent and consistent processes to review and assess the findings of the economic evaluations of vaccines.

["So I have no way of measuring": a portrait of health education groups in the city of São Paulo, Brazil].

PubMed

Vincha, Kellem Regina Rosendo; Vieira, Viviane Laudelino; Guerra, Lúcia Dias da Silva; Botelho, Fernanda Cangussu; Pava-Cárdenas, Alexandra; Cervato-Mancuso, Ana Maria

2017-09-28

: The study analyzed the social representations of primary health care professionals on evaluative processes of groups that work with food and nutrition, and described the educational strategies used in this care. This was a qualitative study from 2012 to 2014 in the city of São Paulo, Brazil, in which 48 interviews were analyzed. In the analysis of the interviews, for classification of the educational strategies in learning categories and contents, Bogdan & Biklen and Zabala were used, respectively. The evaluative processes used the collective subject discourse technique, based on Jodelet's social representations. Three learning contents were found in the educational strategies and four social representations of the evaluative processes which combined to reveal the presence of a conflict by a practice directed by the work process to quantitative and individual evaluative criteria and a health-promoting practice that used inclusive approaches and participant evaluation. In this practice, the study implicitly identified the presence of autonomy in health. The study revealed the need to acknowledge and systematize group planning as an educational tool that qualifies and empowers comprehensive care.

Reducing healthcare costs facilitated by surgical auditing: a systematic review.

PubMed

Govaert, Johannes Arthuur; van Bommel, Anne Charlotte Madeline; van Dijk, Wouter Antonie; van Leersum, Nicoline Johanneke; Tollenaar, Robertus Alexandre Eduard Mattheus; Wouters, Michael Wilhemus Jacobus Maria

2015-07-01

Surgical auditing has been developed in order to benchmark and to facilitate quality improvement. The aim of this review is to determine if auditing combined with systematic feedback of information on process and outcomes of care results in lower costs of surgical care. A systematic search of published literature before 21-08-2013 was conducted in Pubmed, Embase, Web of Science, and Cochrane Library. Articles were selected if they met the inclusion criteria of describing a surgical audit with cost-evaluation. The systematic search resulted in 3608 papers. Six studies were identified as relevant, all showing a positive effect of surgical auditing on quality of healthcare and therefore cost savings was reported. Cost reductions ranging from $16 to $356 per patient were seen in audits evaluating general or vascular procedures. The highest potential cost reduction was described in a colorectal surgical audit (up to $1,986 per patient). All six identified articles in this review describe a reduction in complications and thereby a reduction in costs due to surgical auditing. Surgical auditing may be of greater value when high-risk procedures are evaluated, since prevention of adverse events in these procedures might be of greater clinical and therefore of greater financial impact. This systematic review shows that surgical auditing can function as a quality instrument and therefore as a tool to reduce costs. Since evidence is scarce so far, further studies should be performed to investigate if surgical auditing has positive effects to turn the rising healthcare costs around. In the future, incorporating (actual) cost analyses and patient-related outcome measures would increase the audits' value and provide a complete overview of the value of healthcare.

Statistical Process Control: A Quality Tool for a Venous Thromboembolic Disease Registry.

PubMed

Posadas-Martinez, Maria Lourdes; Rojas, Liliana Paloma; Vazquez, Fernando Javier; De Quiros, Fernan Bernaldo; Waisman, Gabriel Dario; Giunta, Diego Hernan

2016-01-01

We aim to describe Statistical Control Process as a quality tool for the Institutional Registry of Venous Thromboembolic Disease (IRTD), a registry developed in a community-care tertiary hospital in Buenos Aires, Argentina. The IRTD is a prospective cohort. The process of data acquisition began with the creation of a computerized alert generated whenever physicians requested imaging or laboratory study to diagnose venous thromboembolism, which defined eligible patients. The process then followed a structured methodology for patient's inclusion, evaluation, and posterior data entry. To control this process, process performance indicators were designed to be measured monthly. These included the number of eligible patients, the number of included patients, median time to patient's evaluation, and percentage of patients lost to evaluation. Control charts were graphed for each indicator. The registry was evaluated in 93 months, where 25,757 patients were reported and 6,798 patients met inclusion criteria. The median time to evaluation was 20 hours (SD, 12) and 7.7% of the total was lost to evaluation. Each indicator presented trends over time, caused by structural changes and improvement cycles, and therefore the central limit suffered inflexions. Statistical process control through process performance indicators allowed us to control the performance of the registry over time to detect systematic problems. We postulate that this approach could be reproduced for other clinical registries.

Evaluation Methods for Assessing Users’ Psychological Experiences of Web-Based Psychosocial Interventions: A Systematic Review

PubMed Central

Howson, Moira; Ritchie, Linda; Carter, Philip D; Parry, David Tudor; Koziol-McLain, Jane

2016-01-01

Background The use of Web-based interventions to deliver mental health and behavior change programs is increasingly popular. They are cost-effective, accessible, and generally effective. Often these interventions concern psychologically sensitive and challenging issues, such as depression or anxiety. The process by which a person receives and experiences therapy is important to understanding therapeutic process and outcomes. While the experience of the patient or client in traditional face-to-face therapy has been evaluated in a number of ways, there appeared to be a gap in the evaluation of patient experiences of therapeutic interventions delivered online. Evaluation of Web-based artifacts has focused either on evaluation of experience from a computer Web-design perspective through usability testing or on evaluation of treatment effectiveness. Neither of these methods focuses on the psychological experience of the person while engaged in the therapeutic process. Objective This study aimed to investigate what methods, if any, have been used to evaluate the in situ psychological experience of users of Web-based self-help psychosocial interventions. Methods A systematic literature review was undertaken of interdisciplinary databases with a focus on health and computer sciences. Studies that met a predetermined search protocol were included. Results Among 21 studies identified that examined psychological experience of the user, only 1 study collected user experience in situ. The most common method of understanding users’ experience was through semistructured interviews conducted posttreatment or questionnaires administrated at the end of an intervention session. The questionnaires were usually based on standardized tools used to assess user experience with traditional face-to-face treatment. Conclusions There is a lack of methods specified in the literature to evaluate the interface between Web-based mental health or behavior change artifacts and users. Main limitations in the research were the nascency of the topic and cross-disciplinary nature of the field. There is a need to develop and deliver methods of understanding users’ psychological experiences while using an intervention. PMID:27363519

The Use of Instructional Design in Educational Technology for Effective Teaching and Learning

ERIC Educational Resources Information Center

Gillani, Syeda Nosheen; Gujjar, Aijaz Ahmed; Choudhry, Bushra Naoreen

2008-01-01

Educationists are of the opinion that the educational problems relating to quantity and quality could be tackled by the proper utilization of instructional technology. Instructional technology is a systematic way of designing, carrying out and evaluating the teaching learning process. Instructional technology makes instruction more effective,…

Connecting Diversity Efforts in the Workplace with Business Mission, Goals, and Objectives.

ERIC Educational Resources Information Center

Johnson, Sandra J.

1994-01-01

Discusses the management and evaluation of diversity in the workforce and emphasizes the need to link diversity issues with organizational goals and performance needs. Differences between a "quick fix" and systematic action are examined; distinctions between a program and a process are explained; and measuring results of diversity…

Impediments to Quality Research in Business Education in Nigeria Tertiary Institutions

ERIC Educational Resources Information Center

Umoru, Titus A.

2013-01-01

Research is a systematic investigation towards increasing the sum of human knowledge. Research in business education is aimed at increasing knowledge in the discipline and providing solutions to problems relating to curriculum, program evaluation and overall improvement in the teaching and learning process. There is no doubt that very high quality…

Applying Information and Communication Technologies to Language Teaching and Research: An Overview

ERIC Educational Resources Information Center

Pareja-Lora, Antonio; Rodríguez-Arancón, Pilar; Calle-Martínez, Cristina

2016-01-01

Currently, there is an international change in education that includes the development of new learning programmes and policies, such as (a) bilingual education programmes, (b) the Bologna process, with an emphasis on a more autonomous way of learning, or (c) the systematic evaluation and assessment of students and educational results. These…

Emergency Presentations to an Inner-City Psychiatric Service for Children and Adolescents

ERIC Educational Resources Information Center

Dil, L. M.; Vuijk, P. J.

2012-01-01

Psychiatric emergency services for children and adolescents vary in process, structure and outcome. There are few systematic studies on the type and prevalence of psychiatric problems encountered, related circumstances or resulting interventions. Evidence in these areas is important in evaluation of the function of mental health services in the…

Advanced Materials Technology

NASA Technical Reports Server (NTRS)

Blankenship, C. P. (Compiler); Teichman, L. A. (Compiler)

1982-01-01

Composites, polymer science, metallic materials (aluminum, titanium, and superalloys), materials processing technology, materials durability in the aerospace environment, ceramics, fatigue and fracture mechanics, tribology, and nondestructive evaluation (NDE) are discussed. Research and development activities are introduced to the nonaerospace industry. In order to provide a convenient means to help transfer aerospace technology to the commercial mainstream in a systematic manner.

Application of activated carbon derived from scrap tires for adsorption of Rhodamine B.

PubMed

Li, Li; Liu, Shuangxi; Zhu, Tan

2010-01-01

Activated carbon derived from solid hazardous waste scrap tires was evaluated as a potential adsorbent for cationic dye removal. The adsorption process with respect to operating parameters was investigated to evaluate the adsorption characteristics of the activated pyrolytic tire char (APTC) for Rhodamine B (RhB). Systematic research including equilibrium, kinetics and thermodynamic studies was performed. The results showed that APTC was a potential adsorbent for RhB with a higher adsorption capacity than most adsorbents. Solution pH and temperature exert significant influence while ionic strength showed little effect on the adsorption process. The adsorption equilibrium data obey Langmuir isotherm and the kinetic data were well described by the pseudo second-order kinetic model. The adsorption process followed intra-particle diffusion model with more than one process affecting the adsorption process. Thermodynamic study confirmed that the adsorption was a physisorption process with spontaneous, endothermic and random characteristics.

Optimization and purification of l-asparaginase from fungi: A systematic review.

PubMed

Souza, Paula Monteiro; de Freitas, Marcela Medeiros; Cardoso, Samuel Leite; Pessoa, Adalberto; Guerra, Eliete Neves Silva; Magalhães, Pérola Oliveira

2017-12-01

The purpose of this systematic review was to identify the available literature of the l-asparaginase producing fungi. This study followed the Preferred Reporting Items for Systematic Reviews. The search was conducted on five databases: LILACS, PubMed, Science Direct, Scopus and Web of Science up until July 20th, 2016, with no time or language restrictions. The reference list of the included studies was crosschecked and a partial gray literature search was undertaken. The methodology of the selected studies was evaluated using GRADE. Asparaginase production, optimization using statistical design, purification and characterization were the main evaluated outcomes. Of the 1686 initially gathered studies, 19 met the inclusion criteria after a two-step selection process. Nine species of fungi were reported in the selected studies, out of which 13 studies optimized the medium composition using statistical design for enhanced asparaginase production and six reported purification and characterization of the enzyme. The genera Aspergillus were identified as producers of asparaginase in both solid and submerged fermentation and l-asparagine was the amino acid most used as nitrogen source. This systematic review demonstrated that different fungi produce l-asparaginase, which possesses a potential in leukemia treatment. However, further investigations are required to confirm the promising effect of these fungal enzymes. Copyright © 2017 Elsevier B.V. All rights reserved.

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

PubMed

Heinen, Maud M; Bartholomew, L Kay; Wensing, Michel; van de Kerkhof, Peter; van Achterberg, Theo

2006-05-01

The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a needs-assessment. A multidisciplinary project group of health care workers and patients was involved in all five IM steps; formulating proximal program objectives, selecting methods and strategies, producing program components, planning for adoption and implementation and planning for evaluation. Several systematic literature reviews and original studies were performed to support this process. Social Cognitive Theory was selected as the main theory behind the program 'Lively Legs' and was combined with elements of Goal-Setting Theory, the precaution adoption model and motivational interviewing. The program is conducted through health counseling by dermatology nurses and was successfully pre-tested. Also, an implementation and evaluation plan were made. Intervention mapping helped us to succeed in developing a lifestyle program with clear goals and methods, operational strategies and materials and clear procedures. Coaching leg ulcer patients towards adherence with compression therapy and healthy lifestyles should be taken on without delay. Systematic development of lifestyle programs for other patient groups should be encouraged.

Cervical spondylotic myelopathy: methodological approaches to evaluate the literature and establish best evidence.

PubMed

Skelly, Andrea C; Hashimoto, Robin E; Norvell, Daniel C; Dettori, Joseph R; Fischer, Dena J; Wilson, Jefferson R; Tetreault, Lindsay A; Fehlings, Michael G

2013-10-15

Review of methods. To provide a detailed description of the methods undertaken in the articles in this focus issue pertaining to cervical spondylotic myelopathy (CSM) and ossification of the posterior longitudinal ligament (OPLL) and to describe the process used to develop summary statements and clinical recommendations regarding factors associated with the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. We present methods used in conducting the systematic, evidence-based reviews and development of expert panel summary statements and clinical recommendations of the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Our intent is that clinicians will combine the information from these systematic reviews, narrative reviews, and primary research studies with an understanding of their own capacities and experience to better manage patients with CSM or OPLL and consider future research for the diagnosis and treatment of these diseases. For the systematic reviews, which make up the bulk of the studies in this focus issue, a systematic search and critical review of the English language literature was undertaken for articles published on the mechanisms, diagnosis, progression, and treatment of CSM and OPLL. Articles were screened for relevance using a priori criteria and relevant articles were critically reviewed. Whether an article was included for review depended on whether the study question was descriptive, one of therapy, or one of prognosis. The strength of evidence for the overall body of literature in each topic area was determined by 2 independent reviewers considering risk of bias, consistency, directness, and precision of results using a modification of the Grading of Recommendation Assessment, Development and Evaluation criteria. Disagreements were resolved by consensus. Findings from articles meeting inclusion criteria were summarized. From these summaries, summary statements or clinical recommendations were formulated among subject experts through a modified Delphi process using the Grading of Recommendation Assessment, Development and Evaluation approach. Methods for the 2 primary research studies and the narrative reviews are also reviewed. Because of the nature of questions that needed to be addressed, not all studies in this focus issue were amenable to systematic review. As a result, this focus issue consists of several different article types, including 1 research protocol, 2 primary research studies, 2 narrative literature reviews, 7 systematic reviews, and 3 articles that combine a systematic review component with either a narrative section (n = 2) or a provider survey (n = 1). In general, the strength of evidence ratings ranged from insufficient to moderate. Summary statements or clinical recommendations were made according to available evidence and study type: 16 summary statements were made across 8 articles, and 17 clinical recommendations were made across 9 articles. Three articles had both summary statements and clinical recommendations, 5 had summary statements only, 6 had clinical recommendations only, and 1 (the research protocol) was not amenable to either. Systematic reviews, narrative reviews, and primary research studies were undertaken to understand the mechanisms, diagnosis, progression, and treatment of CSM and OPLL and to provide summary statements and clinical recommendations. This article reports the methods used in the studies in this focus issue. SUMMARY STATEMENTS: The objectives of this focus issue were met using a variety of article and study designs, each of which has some unique methodological aspects associated with it. The reader should refer to the full article in this issue for additional details specific to that topic. The methods for systematic review follow accepted standards for rigor and, together with the application of Grading of Recommendation Assessment, Development and Evaluation, are intended to allow for transparency in the process for creating the clinical recommendation.

Collection, processing and dissemination of data for the national solar demonstration program

NASA Technical Reports Server (NTRS)

Day, R. E.; Murphy, L. J.; Smok, J. T.

1978-01-01

A national solar data system developed for the DOE by IBM provides for automatic gathering, conversion, transfer, and analysis of demonstration site data. NASA requirements for this system include providing solar site hardware, engineering, data collection, and analysis. The specific tasks include: (1) solar energy system design/integration; (2) developing a site data acquisition subsystem; (3) developing a central data processing system; (4) operating the test facility at Marshall Space Flight Center; (5) collecting and analyzing data. The systematic analysis and evaluation of the data from the National Solar Data System is reflected in a monthly performance report and a solar energy system performance evaluation report.

Systematic review protocol of interventions to improve the psychological well-being of general practitioners.

PubMed

Murray, Marylou; Murray, Lois; Donnelly, Michael

2015-09-22

The challenges and complexities faced by general practitioners are increasing, and there are concerns about their well-being. Consequently, attention has been directed towards developing and evaluating interventions and strategies to improve general practitioner well-being and their capacity to cope with workplace challenges. This systematic review aims to evaluate research evidence regarding the effectiveness of interventions designed to improve general practitioner well-being. Eligible studies will include programmes developed to improve psychological well-being that have assessed outcomes using validated tools pertaining to well-being and related outcomes. Only programmes that have been evaluated using controlled study designs will be reviewed. An appropriately developed search strategy will be applied to six electronic databases: the Cochrane Database of Systematic Reviews, MEDLINE, Embase, CINAHL, PsycINFO and Web of Science. Studies will be screened in two stages by two independent reviewers. A third reviewer will arbitrate when required. Pre-specified inclusion and exclusion criteria will be assessed during a pilot phase early on in the review process. The Cochrane data extraction form will be adapted and applied to each eligible study by two independent reviewers, and each study will be appraised critically using standardised checklists from the Cochrane Handbook. Methodological quality will be taken into account in the analysis of the data and the synthesis of results. A narrative synthesis will be undertaken if data is unsuited to a meta-analysis. The systematic review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidance. This will be the first systematic review on this topic, and the evidence synthesis will aid decision-making by general practitioners, policy makers and planners regarding ways in which to improve GP well-being. Findings will be disseminated at general practitioner meetings, conferences and in professional and peer-reviewed journals. PROSPERO CRD42015017899.

A systematic review of training interventions addressing sexual violence against marginalized at-risk groups of women.

PubMed

Kouta, Christiana; Pithara, Christalla; Zobnina, Anna; Apostolidou, Zoe; Christodoulou, Josie; Papadakaki, Maria; Chliaoutakis, Joannes

2015-12-01

Women from marginalized groups working in occupations such as domestic work are at increased risk for sexual violence. Scarce evidence exists about training interventions targeting such groups. The article aims to identify community and workplace-based training interventions aiming to increase capacity among marginalized at-risk women to deal with sexual violence. A systematic review was applied. Inclusion criteria were English language published between 2003 and 2013; reporting on delivery and/or evaluation; focusing on any form of sexual violence; delivered to professionals, affected or at-risk women; targeting migrant, at-risk women or domestic workers. Data were extracted on the setting, content, evaluation process and target population. Four studies which focused on prevention or responding to sexual violence were included. One study provided sexual violence training to vulnerable female and one provided a HIV prevention intervention to marginalized women. Learning objectives included increasing knowledge around issues of sexual violence and/or gender and human rights, prevention and response strategies. Two studies aimed to train trainers. All studies conducted an outcome evaluation and two a process evaluation. It seems there is a gap on participatory empowerment training for marginalized women. Community train-the-trainer interventions are imperative to protect themselves and deal with the risk of sexual violence. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Influence of the breathing pattern on the learning process: a systematic review of literature.

PubMed

Ribeiro, Genef Caroline Andrade; Dos Santos, Isadora Diniz; Santos, Ana Claudia Nascimento; Paranhos, Luiz Renato; César, Carla Patrícia Hernandez Alves Ribeiro

2016-01-01

Mouth breathing leads to negative consequences on quality of life, especially in school-age children. To determine whether the breathing pattern influences children's learning process. This systematic review was carried out according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) instructions, with no restrictions regarding the year of publication and language, created based on the clinical question formulation according to the Problem/Patient/Population, Intervention/Indicator, Comparison, Outcome (PICO) strategy: "Is the mouth-breathing child more likely to have learning disabilities when compared to nasal breathers?" in the SciELO, PubMed, LILACS, and Scopus electronic databases. Google Scholar was used to search the gray literature. The keywords "learning," "mouth breathing," and their equivalent terms in Portuguese were used in an integrated manner. The studies included in the review were observational, conducted with schoolchildren aged 7-11 years. Afterwards, the studies were evaluated regarding their methodological quality. The research was performed by two eligible reviewers. A total of 357 records were obtained, of which 43 records were duplicate. After applying the eligibility criteria, ten articles were included in the research scope. Half of the studies used a control group and otorhinolaryngological assessment, whereas a minority used validated (20%) and sample calculation protocols (10%). The evaluation procedures were varied. Overall, 80% of the articles showed a higher incidence of learning disabilities among mouth breathers. This systematic review has shown that mouth breathers are more likely to have learning difficulties than nasal breathers. Copyright © 2015 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Effect of resveratrol supplementation on cognitive performance and mood in adults: a systematic literature review and meta-analysis of randomized controlled trials.

PubMed

Marx, Wolfgang; Kelly, Jaimon T; Marshall, Skye; Cutajar, Jennifer; Annois, Brigitte; Pipingas, Andrew; Tierney, Audrey; Itsiopoulos, Catherine

2018-06-01

The aim of this systematic review was to evaluate clinical trial data regarding the effect of resveratrol supplementation on cognitive performance and mood in populations that are healthy and in the clinical setting. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a systematic literature review of randomized controlled trials was conducted. A meta-analysis was also conducted to determine treatment effect on the following cognitive domains and mental processes: processing speed, number facility, memory, and mood. Risk of bias was assessed using the Cochrane Collaboration Risk of Bias tool. Quality of the body of evidence was assessed by evidence for each outcome related to cognitive function for which data was assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE). Ten studies were included. Three studies found resveratrol supplementation significantly improved some measures of cognitive performance, 2 reported mixed findings, and 5 found no effect. When data were pooled, resveratrol supplementation had a significant effect on delayed recognition (standardized mean difference [SMD], 0.39; 95% confidence interval [CI], 0.08-0.70; I2 = 0%; P = 0.01; n = 3 studies; n = 166 participants) and negative mood (SMD, -0.18; 95%CI, -0.31 to -0.05; I2 = 0%; P = 0.006; n = 3 studies; n = 163 participants). Included studies generally had low risk of bias and were of moderate or high quality. The results of this review indicate that resveratrol supplementation might improve select measures of cognitive performance; however, the current literature is inconsistent and limited.

Clean-up and disposal process of polluted sediments from urban rivers.

PubMed

He, P J; Shao, L M; Gu, G W; Bian, C L; Xu, C

2001-10-01

In this paper, the discussion is concentrated on the properties of the polluted sediments and the combination of clean-up and disposal process for the upper layer heavily polluted sediments with good flowability. Based on the systematic analyses of various clean-up processes, a suitable engineering process has been evaluated and recommended. The process has been applied to the river reclamation in Yangpu District of Shanghai City, China. An improved centrifuge is used for dewatering the dredged sludge, which plays an important role in the combination of clean-up and disposal process. The assessment of the engineering process shows its environmental and technical economy feasibility, which is much better than that of traditional dredging-disposal processes.

A New Biogeochemical Computational Framework Integrated within the Community Land Model

NASA Astrophysics Data System (ADS)

Fang, Y.; Li, H.; Liu, C.; Huang, M.; Leung, L.

2012-12-01

Terrestrial biogeochemical processes, particularly carbon cycle dynamics, have been shown to significantly influence regional and global climate changes. Modeling terrestrial biogeochemical processes within the land component of Earth System Models such as the Community Land model (CLM), however, faces three major challenges: 1) extensive efforts in modifying modeling structures and rewriting computer programs to incorporate biogeochemical processes with increasing complexity, 2) expensive computational cost to solve the governing equations due to numerical stiffness inherited from large variations in the rates of biogeochemical processes, and 3) lack of an efficient framework to systematically evaluate various mathematical representations of biogeochemical processes. To address these challenges, we introduce a new computational framework to incorporate biogeochemical processes into CLM, which consists of a new biogeochemical module with a generic algorithm and reaction database. New and updated biogeochemical processes can be incorporated into CLM without significant code modification. To address the stiffness issue, algorithms and criteria will be developed to identify fast processes, which will be replaced with algebraic equations and decoupled from slow processes. This framework can serve as a generic and user-friendly platform to test out different mechanistic process representations and datasets and gain new insight on the behavior of the terrestrial ecosystems in response to climate change in a systematic way.

Learning process mapping heuristics under stochastic sampling overheads

NASA Technical Reports Server (NTRS)

Ieumwananonthachai, Arthur; Wah, Benjamin W.

1991-01-01

A statistical method was developed previously for improving process mapping heuristics. The method systematically explores the space of possible heuristics under a specified time constraint. Its goal is to get the best possible heuristics while trading between the solution quality of the process mapping heuristics and their execution time. The statistical selection method is extended to take into consideration the variations in the amount of time used to evaluate heuristics on a problem instance. The improvement in performance is presented using the more realistic assumption along with some methods that alleviate the additional complexity.

Improving child protection: a systematic review of training and procedural interventions.

PubMed

Carter, Y H; Bannon, M J; Limbert, C; Docherty, A; Barlow, J

2006-09-01

To synthesise published evidence regarding the effectiveness of training and procedural interventions aimed at improving the identification and management of child abuse and neglect by health professionals. Systematic review for the period 1994 to 2005 of studies that evaluated child protection training and procedural interventions. Main outcome measures were learning achievement, attitudinal change, and clinical behaviour. Seven papers that examined the effectiveness of procedural interventions and 15 papers that evaluated training programmes met the inclusion criteria. Critical appraisal showed that evaluation of interventions was on the whole poor. It was found that certain procedural interventions (such as the use of checklists and structured forms) can result in improved recording of important clinical information and may also alert clinical staff to the possibility of abuse. While a variety of innovative training programmes were identified, there was an absence of rigorous evaluation of their impact. However a small number of one-group pre- and post-studies suggest improvements in a range of attitudes necessary for successful engagement in the child protection process. Current evidence supports the use of procedural changes that improve the documentation of suspected child maltreatment and that enhance professional awareness. The lack of an evidence based approach to the implementation of child protection training may restrict the ability of all health professionals to fulfil their role in the child protection process. Formal evaluation of a variety of models for the delivery of this training is urgently needed with subsequent dissemination of results that highlight those found to be most effective.

Error Sources in Proccessing LIDAR Based Bridge Inspection

NASA Astrophysics Data System (ADS)

Bian, H.; Chen, S. E.; Liu, W.

2017-09-01

Bridge inspection is a critical task in infrastructure management and is facing unprecedented challenges after a series of bridge failures. The prevailing visual inspection was insufficient in providing reliable and quantitative bridge information although a systematic quality management framework was built to ensure visual bridge inspection data quality to minimize errors during the inspection process. The LiDAR based remote sensing is recommended as an effective tool in overcoming some of the disadvantages of visual inspection. In order to evaluate the potential of applying this technology in bridge inspection, some of the error sources in LiDAR based bridge inspection are analysed. The scanning angle variance in field data collection and the different algorithm design in scanning data processing are the found factors that will introduce errors into inspection results. Besides studying the errors sources, advanced considerations should be placed on improving the inspection data quality, and statistical analysis might be employed to evaluate inspection operation process that contains a series of uncertain factors in the future. Overall, the development of a reliable bridge inspection system requires not only the improvement of data processing algorithms, but also systematic considerations to mitigate possible errors in the entire inspection workflow. If LiDAR or some other technology can be accepted as a supplement for visual inspection, the current quality management framework will be modified or redesigned, and this would be as urgent as the refine of inspection techniques.

Evidence based post graduate training. A systematic review of reviews based on the WFME quality framework

PubMed Central

2011-01-01

Background A framework for high quality in post graduate training has been defined by the World Federation of Medical Education (WFME). The objective of this paper is to perform a systematic review of reviews to find current evidence regarding aspects of quality of post graduate training and to organise the results following the 9 areas of the WFME framework. Methods The systematic literature review was conducted in 2009 in Medline Ovid, EMBASE, ERIC and RDRB databases from 1995 onward. The reviews were selected by two independent researchers and a quality appraisal was based on the SIGN tool. Results 31 reviews met inclusion criteria. The majority of the reviews provided information about the training process (WFME area 2), the assessment of trainees (WFME area 3) and the trainees (WFME area 4). One review covered the area 8 'governance and administration'. No review was found in relation to the mission and outcomes, the evaluation of the training process and the continuous renewal (respectively areas 1, 7 and 9 of the WFME framework). Conclusions The majority of the reviews provided information about the training process, the assessment of trainees and the trainees. Indicators used for quality assessment purposes of post graduate training should be based on this evidence but further research is needed for some areas in particular to assess the quality of the training process. PMID:21977898

[Creativity and bipolar disorder].

PubMed

Maçkalı, Zeynep; Gülöksüz, Sinan; Oral, Timuçin

2014-01-01

The relationship between creativity and bipolar disorder has been an intriguing topic since ancient times. Early studies focused on describing characteristics of creative people. From the last quarter of the twentieth century, researchers began to focus on the relationship between mood disorders and creativity. Initially, the studies were based on biographical texts and the obtained results indicated a relationship between these two concepts. The limitations of the retrospective studies led the researchers to develop systematic investigations into this area. The systematic studies that have focused on artistic creativity have examined both the prevalence of mood disorders and the creative process. In addition, a group of researchers addressed the relationship in terms of affective temperaments. Through the end of the 90's, the scope of creativity was widened and the notion of everyday creativity was proposed. The emergence of this notion led researchers to investigate the associations of the creative process in ordinary (non-artist) individuals. In this review, the descriptions of creativity and creative process are mentioned. Also, the creative process is addressed with regards to bipolar disorder. Then, the relationship between creativity and bipolar disorder are evaluated in terms of aforementioned studies (biographical, systematic, psychobiographical, affective temperaments). In addition, a new model, the "Shared Vulnerability Model" which was developed to explain the relationship between creativity and psychopathology is introduced. Finally, the methodological limitations and the suggestions for resolving these limitations are included.

Pain management: a review of organisation models with integrated processes for the management of pain in adult cancer patients.

PubMed

Brink-Huis, Anita; van Achterberg, Theo; Schoonhoven, Lisette

2008-08-01

This paper reports a review of the literature conducted to identify organisation models in cancer pain management that contain integrated care processes and describe their effectiveness. Pain is experienced by 30-50% of cancer patients receiving treatment and by 70-90% of those with advanced disease. Efforts to improve pain management have been made through the development and dissemination of clinical guidelines. Early improvements in pain management were focussed on just one or two single processes such as pain assessment and patient education. Little is known about organisational models with multiple integrated processes throughout the course of the disease trajectory and concerning all stages of the care process. Systematic review. The review involved a systematic search of the literature, published between 1986-2006. Subject-specific keywords used to describe patients, disease, pain management interventions and integrated care processes, relevant for this review were selected using the thesaurus of the databases. Institutional models, clinical pathways and consultation services are three alternative models for the integration of care processes in cancer pain management. A clinical pathway is a comprehensive institutionalisation model, whereas a pain consultation service is a 'stand-alone' model that can be integrated in a clinical pathway. Positive patient and process outcomes have been described for all three models, although the level of evidence is generally low. Evaluation of the quality of pain management must involve standardised measurements of both patient and process outcomes. We recommend the development of policies for referrals to a pain consultation service. These policies can be integrated within a clinical pathway. To evaluate the effectiveness of pain management models standardised outcome measures are needed.

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review.

PubMed

Finch, Emma; Lethlean, Jennifer; Rose, Tanya; Fleming, Jennifer; Theodoros, Deborah; Cameron, Ashley; Coleman, Adele; Copland, David; McPhail, Steven M

2018-03-01

A key feature of health professionals' training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning? Systematic review of published literature. Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction. A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students' clinical skills. Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students' communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.

Efficiency of polymerization of bulk-fill composite resins: a systematic review.

PubMed

Reis, André Figueiredo; Vestphal, Mariana; Amaral, Roberto Cesar do; Rodrigues, José Augusto; Roulet, Jean-François; Roscoe, Marina Guimarães

2017-08-28

This systematic review assessed the literature to evaluate the efficiency of polymerization of bulk-fill composite resins at 4 mm restoration depth. PubMed, Cochrane, Scopus and Web of Science databases were searched with no restrictions on year, publication status, or article's language. Selection criteria included studies that evaluated bulk-fill composite resin when inserted in a minimum thickness of 4 mm, followed by curing according to the manufacturers' instructions; presented sound statistical data; and comparison with a control group and/or a reference measurement of quality of polymerization. The evidence level was evaluated by qualitative scoring system and classified as high-, moderate- and low- evidence level. A total of 534 articles were retrieved in the initial search. After the review process, only 10 full-text articles met the inclusion criteria. Most articles included (80%) were classified as high evidence level. Among several techniques, microhardness was the most frequently method performed by the studies included in this systematic review. Irrespective to the "in vitro" method performed, bulk fill RBCs were partially likely to fulfill the important requirement regarding properly curing in 4 mm of cavity depth measured by depth of cure and / or degree of conversion. In general, low viscosities BFCs performed better regarding polymerization efficiency compared to the high viscosities BFCs.

Disinfection of human skin allografts in tissue banking: a systematic review report.

PubMed

Johnston, C; Callum, J; Mohr, J; Duong, A; Garibaldi, A; Simunovic, N; Ayeni, O R

2016-12-01

The use of skin allografts to temporarily replace lost or damaged skin is practiced worldwide. Naturally occurring contamination can be present on skin or can be introduced at recovery or during processing. This contamination can pose a threat to allograft recipients. Bacterial culture and disinfection of allografts are mandated, but the specific practices and methodologies are not dictated by standards. A systematic review of literature from three databases found 12 research articles that evaluated bioburden reduction processes of skin grafts. The use of broad spectrum antibiotics and antifungal agents was the most frequently identified disinfection method reported demonstrating reductions in contamination rates. It was determined that the greatest reduction in the skin allograft contamination rates utilized 0.1 % peracetic acid or 25 kGy of gamma irradiation at lower temperatures.

Using MEDLINE Elemental Similarity to Assist in the Article Screening Process for Systematic Reviews.

PubMed

Ji, Xiaonan; Yen, Po-Yin

2015-08-31

Systematic reviews and their implementation in practice provide high quality evidence for clinical practice but are both time and labor intensive due to the large number of articles. Automatic text classification has proven to be instrumental in identifying relevant articles for systematic reviews. Existing approaches use machine learning model training to generate classification algorithms for the article screening process but have limitations. We applied a network approach to assist in the article screening process for systematic reviews using predetermined article relationships (similarity). The article similarity metric is calculated using the MEDLINE elements title (TI), abstract (AB), medical subject heading (MH), author (AU), and publication type (PT). We used an article network to illustrate the concept of article relationships. Using the concept, each article can be modeled as a node in the network and the relationship between 2 articles is modeled as an edge connecting them. The purpose of our study was to use the article relationship to facilitate an interactive article recommendation process. We used 15 completed systematic reviews produced by the Drug Effectiveness Review Project and demonstrated the use of article networks to assist article recommendation. We evaluated the predictive performance of MEDLINE elements and compared our approach with existing machine learning model training approaches. The performance was measured by work saved over sampling at 95% recall (WSS95) and the F-measure (F1). We also used repeated analysis over variance and Hommel's multiple comparison adjustment to demonstrate statistical evidence. We found that although there is no significant difference across elements (except AU), TI and AB have better predictive capability in general. Collaborative elements bring performance improvement in both F1 and WSS95. With our approach, a simple combination of TI+AB+PT could achieve a WSS95 performance of 37%, which is competitive to traditional machine learning model training approaches (23%-41% WSS95). We demonstrated a new approach to assist in labor intensive systematic reviews. Predictive ability of different elements (both single and composited) was explored. Without using model training approaches, we established a generalizable method that can achieve a competitive performance.

Key principles to improve programmes and interventions in complementary feeding.

PubMed

Lutter, Chessa K; Iannotti, Lora; Creed-Kanashiro, Hilary; Guyon, Agnes; Daelmans, Bernadette; Robert, Rebecca; Haider, Rukhsana

2013-09-01

Although there are some examples of successful complementary feeding programmes to promote healthy growth and prevent stunting at the community level, to date there are few, if any, examples of successful programmes at scale. A lack of systematic process and impact evaluations on pilot projects to generate lessons learned has precluded scaling up of effective programmes. Programmes to effect positive change in nutrition rarely follow systematic planning, implementation, and evaluation (PIE) processes to enhance effectiveness over the long term. As a result a set of programme-oriented key principles to promote healthy growth remains elusive. The purpose of this paper is to fill this gap by proposing a set of principles to improve programmes and interventions to promote healthy growth and development. Identifying such principles for programme success has three requirements: rethinking traditional paradigms used to promote improved infant and young child feeding; ensuring better linkages to delivery platforms; and, improving programming. Following the PIE model for programmes and learning from experiences from four relatively large-scale programmes described in this paper, 10 key principles are identified in the areas of programme planning, programme implementation, programme evaluation, and dissemination, replication, and scaling up. Nonetheless, numerous operational research questions remain, some of which are highlighted in this paper. © 2013 John Wiley & Sons Ltd.

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis.

PubMed

Bergeron, Mathieu; Lortie, Catherine L; Guitton, Matthieu J

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies.

Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis

PubMed Central

Bergeron, Mathieu; Lortie, Catherine L.; Guitton, Matthieu J.

2015-01-01

Classical peripheral vestibular disorders rehabilitation is a long and costly process. While virtual reality settings have been repeatedly suggested to represent possible tools to help the rehabilitation process, no systematic study had been conducted so far. We systematically reviewed the current literature to analyze the published protocols documenting the use of virtual reality settings for peripheral vestibular disorders rehabilitation. There is an important diversity of settings and protocols involving virtual reality settings for the treatment of this pathology. Evaluation of the symptoms is often not standardized. However, our results unveil a clear effect of virtual reality settings-based rehabilitation of the patients' symptoms, assessed by objectives tools such as the DHI (mean decrease of 27 points), changing symptoms handicap perception from moderate to mild impact on life. Furthermore, we detected a relationship between the duration of the exposure to virtual reality environments and the magnitude of the therapeutic effects, suggesting that virtual reality treatments should last at least 150 minutes of cumulated exposure to ensure positive outcomes. Virtual reality offers a pleasant and safe environment for the patient. Future studies should standardize evaluation tools, document putative side effects further, compare virtual reality to conventional physical therapy, and evaluate economical costs/benefits of such strategies. PMID:26556560

The process of collecting and evaluating evidences for the development of Guidelines for the management of rheumatoid arthritis, Japan College of Rheumatology 2014: Utilization of GRADE approach.

PubMed

Kojima, Masayo; Nakayama, Takeo; Kawahito, Yutaka; Kaneko, Yuko; Kishimoto, Mitsumasa; Hirata, Shintaro; Seto, Yohei; Endo, Hirahito; Ito, Hiromu; Kojima, Toshihisa; Nishida, Keiichiro; Matsushita, Isao; Tsutani, Kiichiro; Igarashi, Ataru; Kamatani, Naoyuki; Hasegawa, Mieko; Miyasaka, Nobuyuki; Yamanaka, Hisashi

2016-01-01

To describe the process of collecting and evaluating evidence for treating rheumatoid arthritis (RA) for developing clinical practice guidelines (CPGs) for rheumatologists in Japan. The task force comprised rheumatologists, epidemiologists, health economists, and patients. First, the critical outcomes were determined according to a three-round Delphi method, and eight topics with 88 clinical questions (CQs) were formulated. A systematic review of CQs was conducted using the Cochran Database of Systematic Reviews, MEDLINE, and Japana Centra Revvo Medicina (2003-2012). A questionnaire survey and focus group interview were performed to capture the patients' values and preferences. Data from the National Health Insurance drug price list and product information provided by pharmaceutical companies were collected to evaluate drug cost and safety. The GRADE approach was used to describe the evidence quality and determine the strength of recommendations. Recommendations were developed using a modified Delphi method by a multidisciplinary panel including patients. Eight meetings and frequent e-mail communications were conducted to draft a quality assessment of evidence and recommendations. For 88 CQs, recommendation statements were determined. Using the GRADE approach, new CPGs successfully addressed important clinical issues for treating RA patients. Timely updating of recommendations should be routinely considered.

Evaluation of Research Ethics Committees: Criteria for the Ethical Quality of the Review Process.

PubMed

Scherzinger, Gregor; Bobbert, Monika

2017-01-01

Repeatedly, adequacy, performance and quality of Ethics Committees that oversee medical research trials are being discussed. Although they play a crucial role in reviewing medical research and protecting human subjects, it is far from clear to what degree they fulfill the task they have been assigned to. This eventuates in the call for an evaluation of their activity and, in some places, led to the establishment of accreditation schemes. At the same time, IRBs have become subject of detailed legislation in the process of the ongoing global juridification of medical research. Unsurprisingly, there is a tendency to understand the evaluation of RECs as a question of controlling their legal compliance. This paper discusses the need for a quality evaluation of IRBs from an ethical point of view and, by systematically reviewing the major ethical guidelines for IRBs, proposes a system of criteria that should orientate any evaluation of IRBs.

Meta-analysis for genome-wide association studies using case-control design: application and practice

PubMed Central

2016-01-01

This review aimed to arrange the process of a systematic review of genome-wide association studies in order to practice and apply a genome-wide meta-analysis (GWMA). The process has a series of five steps: searching and selection, extraction of related information, evaluation of validity, meta-analysis by type of genetic model, and evaluation of heterogeneity. In contrast to intervention meta-analyses, GWMA has to evaluate the Hardy–Weinberg equilibrium (HWE) in the third step and conduct meta-analyses by five potential genetic models, including dominant, recessive, homozygote contrast, heterozygote contrast, and allelic contrast in the fourth step. The ‘genhwcci’ and ‘metan’ commands of STATA software evaluate the HWE and calculate a summary effect size, respectively. A meta-regression using the ‘metareg’ command of STATA should be conducted to evaluate related factors of heterogeneities. PMID:28092928

A framework for the damage evaluation of acoustic emission signals through Hilbert-Huang transform

NASA Astrophysics Data System (ADS)

Siracusano, Giulio; Lamonaca, Francesco; Tomasello, Riccardo; Garescì, Francesca; Corte, Aurelio La; Carnì, Domenico Luca; Carpentieri, Mario; Grimaldi, Domenico; Finocchio, Giovanni

2016-06-01

The acoustic emission (AE) is a powerful and potential nondestructive testing method for structural monitoring in civil engineering. Here, we show how systematic investigation of crack phenomena based on AE data can be significantly improved by the use of advanced signal processing techniques. Such data are a fundamental source of information that can be used as the basis for evaluating the status of the material, thereby paving the way for a new frontier of innovation made by data-enabled analytics. In this article, we propose a framework based on the Hilbert-Huang Transform for the evaluation of material damages that (i) facilitates the systematic employment of both established and promising analysis criteria, and (ii) provides unsupervised tools to achieve an accurate classification of the fracture type, the discrimination between longitudinal (P-) and traversal (S-) waves related to an AE event. The experimental validation shows promising results for a reliable assessment of the health status through the monitoring of civil infrastructures.

Evaluation of evidence-based literature and formulation of recommendations for the clinical preventive guidelines for immigrants and refugees in Canada

PubMed Central

Tugwell, Peter; Pottie, Kevin; Welch, Vivian; Ueffing, Erin; Chambers, Andrea; Feightner, John

2011-01-01

Background: This article describes the evidence review and guideline development method developed for the Clinical Preventive Guidelines for Immigrants and Refugees in Canada by the Canadian Collaboration for Immigrant and Refugee Health Guideline Committee. Methods: The Appraisal of Guidelines for Research and Evaluation (AGREE) best-practice framework was combined with the recently developed Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to produce evidence-based clinical guidelines for immigrants and refugees in Canada. Results: A systematic approach was designed to produce the evidence reviews and apply the GRADE approach, including building on evidence from previous systematic reviews, searching for and comparing evidence between general and specific immigrant populations, and applying the GRADE criteria for making recommendations. This method was used for priority health conditions that had been selected by practitioners caring for immigrants and refugees in Canada. Interpretation: This article outlines the 14-step method that was defined to standardize the guideline development process for each priority health condition. PMID:20573711

Applying the Analytic Hierarchy Process in healthcare research: A systematic literature review and evaluation of reporting.

PubMed

Schmidt, Katharina; Aumann, Ines; Hollander, Ines; Damm, Kathrin; von der Schulenburg, J-Matthias Graf

2015-12-24

The Analytic Hierarchy Process (AHP), developed by Saaty in the late 1970s, is one of the methods for multi-criteria decision making. The AHP disaggregates a complex decision problem into different hierarchical levels. The weight for each criterion and alternative are judged in pairwise comparisons and priorities are calculated by the Eigenvector method. The slowly increasing application of the AHP was the motivation for this study to explore the current state of its methodology in the healthcare context. A systematic literature review was conducted by searching the Pubmed and Web of Science databases for articles with the following keywords in their titles or abstracts: "Analytic Hierarchy Process," "Analytical Hierarchy Process," "multi-criteria decision analysis," "multiple criteria decision," "stated preference," and "pairwise comparison." In addition, we developed reporting criteria to indicate whether the authors reported important aspects and evaluated the resulting studies' reporting. The systematic review resulted in 121 articles. The number of studies applying AHP has increased since 2005. Most studies were from Asia (almost 30%), followed by the US (25.6%). On average, the studies used 19.64 criteria throughout their hierarchical levels. Furthermore, we restricted a detailed analysis to those articles published within the last 5 years (n = 69). The mean of participants in these studies were 109, whereas we identified major differences in how the surveys were conducted. The evaluation of reporting showed that the mean of reported elements was about 6.75 out of 10. Thus, 12 out of 69 studies reported less than half of the criteria. The AHP has been applied inconsistently in healthcare research. A minority of studies described all the relevant aspects. Thus, the statements in this review may be biased, as they are restricted to the information available in the papers. Hence, further research is required to discover who should be interviewed and how, how inconsistent answers should be dealt with, and how the outcome and stability of the results should be presented. In addition, we need new insights to determine which target group can best handle the challenges of the AHP.

Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.

PubMed

Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle

2016-06-10

The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.

Prevention of falls, malnutrition and pressure ulcers among older persons - nursing staff's experiences of a structured preventive care process.

PubMed

Lannering, Christina; Ernsth Bravell, Marie; Johansson, Linda

2017-05-01

A structured and systematic care process for preventive work, aimed to reduce falls, pressure ulcers and malnutrition among older people, has been developed in Sweden. The process involves risk assessment, team-based interventions and evaluation of results. Since development, this structured work process has become web-based and has been implemented in a national quality registry called 'Senior Alert' and used countrywide. The aim of this study was to describe nursing staff's experience of preventive work by using the structured preventive care process as outlined by Senior Alert. Eight focus group interviews were conducted during 2015 including staff from nursing homes and home-based nursing care in three municipalities. The interview material was subjected to qualitative content analysis. In this study, both positive and negative opinions were expressed about the process. The systematic and structured work flow seemed to only partly facilitate care providers to improve care quality by making better clinical assessments, performing team-based planned interventions and learning from results. Participants described lack of reliability in the assessments and varying opinions about the structure. Furthermore, organisational structures limited the preventive work. © 2016 John Wiley & Sons Ltd.

Developing an evidence-based Guide to Community Preventive Services--methods. The Task Force on Community Preventive Services.

PubMed

Briss, P A; Zaza, S; Pappaioanou, M; Fielding, J; Wright-De Agüero, L; Truman, B I; Hopkins, D P; Mullen, P D; Thompson, R S; Woolf, S H; Carande-Kulis, V G; Anderson, L; Hinman, A R; McQueen, D V; Teutsch, S M; Harris, J R

2000-01-01

Systematic reviews and evidence-based recommendations are increasingly important for decision making in health and medicine. Over the past 20 years, information on the science of synthesizing research results has exploded. However, some approaches to systematic reviews of the effectiveness of clinical preventive services and medical care may be less appropriate for evaluating population-based interventions. Furthermore, methods for linking evidence to recommendations are less well developed than methods for synthesizing evidence. The Guide to Community Preventive Services: Systematic Reviews and Evidence-Based Recommendations (the Guide) will evaluate and make recommendations on population-based and public health interventions. This paper provides an overview of the Guide's process to systematically review evidence and translate that evidence into recommendations. The Guide reviews evidence on effectiveness, the applicability of effectiveness data, (i.e., the extent to which available effectiveness data is thought to apply to additional populations and settings), the intervention's other effects (i.e., important side effects), economic impact, and barriers to implementation of interventions. The steps for obtaining and evaluating evidence into recommendations involve: (1) forming multidisciplinary chapter development teams, (2) developing a conceptual approach to organizing, grouping, selecting and evaluating the interventions in each chapter; (3) selecting interventions to be evaluated; (4) searching for and retrieving evidence; (5) assessing the quality of and summarizing the body of evidence of effectiveness; (6) translating the body of evidence of effectiveness into recommendations; (7) considering information on evidence other than effectiveness; and (8) identifying and summarizing research gaps. Systematic reviews of and evidence-based recommendations for population-health interventions are challenging and methods will continue to evolve. However, using an evidence-based approach to identify and recommend effective interventions directed at specific public health goals may reduce errors in how information is collected and interpreted, identify important gaps in current knowledge thus guiding further research, and enhance the Guide users' ability to assess whether recommendations are valid and prudent from their own perspectives. Over time, all of these advantages could help to increase agreement regarding appropriate community health strategies and help to increase their implementation.

Conceptualising the effectiveness of impact assessment processes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chanchitpricha, Chaunjit, E-mail: chaunjit@g.sut.ac.th; Bond, Alan, E-mail: alan.bond@uea.ac.uk; Unit for Environmental Sciences and Management School of Geo and Spatial Sciences, Internal Box 375, North West University

2013-11-15

This paper aims at conceptualising the effectiveness of impact assessment processes through the development of a literature-based framework of criteria to measure impact assessment effectiveness. Four categories of effectiveness were established: procedural, substantive, transactive and normative, each containing a number of criteria; no studies have previously brought together all four of these categories into such a comprehensive, criteria-based framework and undertaken systematic evaluation of practice. The criteria can be mapped within a cycle/or cycles of evaluation, based on the ‘logic model’, at the stages of input, process, output and outcome to enable the identification of connections between the criteria acrossmore » the categories of effectiveness. This framework is considered to have potential application in measuring the effectiveness of many impact assessment processes, including strategic environmental assessment (SEA), environmental impact assessment (EIA), social impact assessment (SIA) and health impact assessment (HIA). -- Highlights: • Conceptualising effectiveness of impact assessment processes. • Identification of factors influencing effectiveness of impact assessment processes. • Development of criteria within a framework for evaluating IA effectiveness. • Applying the logic model to examine connections between effectiveness criteria.« less

The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP)

PubMed Central

Moodie, Sheila T.; Malandrino, April C.; Richert, Frances M.; Clench, Debbie A.; Scollie, Susan D.

2011-01-01

This study proposed and evaluated a guideline for outcome evaluation for infants and children with hearing loss who wear hearing aids. The University of Western Ontario Pediatric Audiological Monitoring Protocol (UWO PedAMP) was developed following a critical review of pediatric outcome evaluation tools and was systematically examined by the Network of Pediatric Audiologists of Canada. It consists of tools to gather clinical process outcomes as well as functional caregiver reports. The UWO PedAMP was administered to a clinical population of infants and children with hearing aids. Sixty-eight children were administered the functional outcome evaluation tools (i.e., caregiver reports) a total of 133 times. Clinical process outcomes of hearing aid verification (e.g., real-ear-to-coupler difference) revealed typical aided audibility (e.g., Speech Intelligibility Index). Results for the LittlEARS® questionnaire revealed that typically developing children with hearing loss who wear hearing aids are meeting auditory development milestones. Children with mild to moderate comorbidities displayed typical auditory development during the 1st year of life after which development began to decline. Children with complex factors related to hearing aid use had lower scores on the LittlEARS, but auditory development was in parallel to norms. Parents’ Evaluation of Aural/Oral Performance (PEACH) results indicated no age effect on scoring for children above 2 years of age; however, the effect of degree of hearing loss was significant. This work provides clinicians with a systematic, evidence-based outcome evaluation protocol to implement as part of a complete pediatric hearing aid fitting. PMID:22194316

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

PubMed

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative. Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

A systematic review of nursing research priorities on health system and services in the Americas.

PubMed

Garcia, Alessandra Bassalobre; Cassiani, Silvia Helena De Bortoli; Reveiz, Ludovic

2015-03-01

To systematically review literature on priorities in nursing research on health systems and services in the Region of the Americas as a step toward developing a nursing research agenda that will advance the Regional Strategy for Universal Access to Health and Universal Health Coverage. This was a systematic review of the literature available from the following databases: Web of Science, PubMed, LILACS, and Google. Documents considered were published in 2008-2014; in English, Spanish, or Portuguese; and addressed the topic in the Region of the Americas. The documents selected had their priority-setting process evaluated according to the "nine common themes for good practice in health research priorities." A content analysis collected all study questions and topics, and sorted them by category and subcategory. Of 185 full-text articles/documents that were assessed for eligibility, 23 were selected: 12 were from peer-reviewed journals; 6 from nursing publications; 4 from Ministries of Health; and 1 from an international organization. Journal publications had stronger methodological rigor; the majority did not present a clear implementation or evaluation plan. After compiling the 444 documents' study questions and topics, the content analysis resulted in a document with 5 categories and 16 subcategories regarding nursing research priorities on health systems and services. Research priority-setting is a highly important process for health services improvement and resources optimization, but implementation and evaluation plans are rarely included. The resulting document will serve as basis for the development of a new nursing research agenda focused on health systems and services, and shaped to advance universal health coverage and universal access to health.

A New Learning Model on Physical Education: 5E Learning Cycle

ERIC Educational Resources Information Center

Senturk, Halil Evren; Camliyer, Huseyin

2016-01-01

Many fields of education at the moment, especially in physical and technological educations, use 5E learning cycle. The process is defined as five "E"s. These represent the verbs engage, explore, explain, elaborate and evaluate. The literature has been systematically reviewed and the results show that the 5E learning cycle is an untested…

Who Is the Real Owner? Or How a Simple Pepsi-Cola Story Can Help Students Build Critical Thinking Skills

ERIC Educational Resources Information Center

Galetcaia, Tatiana; Thiessen, Loreena

2010-01-01

Besides language competence, international students must develop a systematic approach to processing information and follow up with co-construction of the knowledge acquired. Critical thinking is a crucial principle commonly required in North American universities for evaluating academic texts. This practice may present certain difficulties for…

An Evaluation of the Conditions, Processes, and Consequences of Laptop Computing in K-12 Classrooms

ERIC Educational Resources Information Center

Cavanaugh, Cathy; Dawson, Kara; Ritzhaupt, Albert

2011-01-01

This article examines how laptop computing technology, teacher professional development, and systematic support resulted in changed teaching practices and increased student achievement in 47 K-12 schools in 11 Florida school districts. The overview of a large-scale study documents the type and magnitude of change in student-centered teaching,…

Hiring Good Colleagues: What You Need to Know about Interviewing New Teachers

ERIC Educational Resources Information Center

Clement, Mary C.

2013-01-01

Employers need a systematic approach for sorting and selecting the best new hires, and hiring may be enhanced by the use of teachers in the process. This article discusses information-rich job advertisements, behavior-based interview questions, and how to objectively evaluate candidates in preliminary and on-site interviews. Candidates' past…

Manualization, Feasibility, and Effectiveness of the School-Based Social Competence Intervention for Adolescents (SCI-A)

ERIC Educational Resources Information Center

Stichter, Janine P.; Herzog, Melissa J.; Owens, Sarah A.; Malugen, Emily

2016-01-01

Despite the movement toward identification of evidence-based practices (EBPs), there is a discrepancy in the availability of school-based EBPs targeting the unique needs of students with high functioning forms of autism and related social needs. Based on calls for systematic intervention development and evaluation processes, the current study…

The Touchstone Process: an ongoing critical evaluation of reiki in the scientific literature.

PubMed

Baldwin, Ann L; Vitale, Anne; Brownell, Elise; Scicinski, Jan; Kearns, Mary; Rand, William

2010-01-01

Reiki is used by a growing number of people but little is known about the scientific basis for its use. The Touchstone Process was developed as an ongoing process to systematically analyze published, peer-reviewed studies of Reiki, the results being made accessible to the public online. Thirteen scientifically qualified experts in the field of Reiki were assembled into 3 teams to retrieve, evaluate, and summarize articles using standardized, piloted evaluation forms. Summaries of 26 Reiki articles, including strengths and weaknesses, were posted on a newly developed Web site (www.centerforreikiresearch.org), together with an overall summary of the status of Reiki research and guidelines for future research: The Touchstone Process determined that only 12 articles were based on a robust experimental design and utilized well-established outcome parameters. Of these articles, 2 provided no support, 5 provided some support, and 5 demonstrated strong evidence for the use of Reiki as a healing modality. There is a need for further high-quality studies in this area.

Applying health economics for policy decision making: do devices differ from drugs?

PubMed

Sorenson, Corinna; Tarricone, Rosanna; Siebert, Markus; Drummond, Michael

2011-05-01

Medical devices pose unique challenges for economic evaluation and associated decision-making processes that differ from pharmaceuticals. We highlight and discuss these challenges in the context of cardiac device therapy, based on a systematic review of relevant economic evaluations. Key challenges include practical difficulties in conducting randomized clinical trials, allowing for a 'learning curve' and user characteristics, accounting for the wider organizational impacts of introducing new devices, and allowing for variations in product characteristics and prices over time.

Undergraduate medical education programme renewal: a longitudinal context, input, process and product evaluation study.

PubMed

Mirzazadeh, Azim; Gandomkar, Roghayeh; Hejri, Sara Mortaz; Hassanzadeh, Gholamreza; Koochak, Hamid Emadi; Golestani, Abolfazl; Jafarian, Ali; Jalili, Mohammad; Nayeri, Fatemeh; Saleh, Narges; Shahi, Farhad; Razavi, Seyed Hasan Emami

2016-02-01

The purpose of this study was to utilize the Context, Input, Process and Product (CIPP) evaluation model as a comprehensive framework to guide initiating, planning, implementing and evaluating a revised undergraduate medical education programme. The eight-year longitudinal evaluation study consisted of four phases compatible with the four components of the CIPP model. In the first phase, we explored the strengths and weaknesses of the traditional programme as well as contextual needs, assets, and resources. For the second phase, we proposed a model for the programme considering contextual features. During the process phase, we provided formative information for revisions and adjustments. Finally, in the fourth phase, we evaluated the outcomes of the new undergraduate medical education programme in the basic sciences phase. Information was collected from different sources such as medical students, faculty members, administrators, and graduates, using various qualitative and quantitative methods including focus groups, questionnaires, and performance measures. The CIPP model has the potential to guide policy makers to systematically collect evaluation data and to manage stakeholders' reactions at each stage of the reform in order to make informed decisions. However, the model may result in evaluation burden and fail to address some unplanned evaluation questions.

The clinical reasoning process in randomized clinical trials with patients with non-specific neck pain is incomplete: A systematic review.

PubMed

Maissan, Francois; Pool, Jan; de Raaij, Edwin; Mollema, Jürgen; Ostelo, Raymond; Wittink, Harriet

2018-06-01

Primarily to evaluate the completeness of the description of the clinical reasoning process in RCTs with patients with non-specific neck pain with an argued or diagnosed cause i.e. an impairment or activity limitation. Secondly, to determine the association between the completeness of the clinical reasoning process and the degree of risk of bias. Pubmed, Cinahl and PEDro were systematically searched from inception to July 2016. RCTs (n = 122) with patients with non-specific neck pain receiving physiotherapy treatment published in English were included. Data extraction included study characteristics and important features of the clinical reasoning process based on the Hypothesis-Oriented Algorithm for Clinicians II (HOAC II)]. Thirty-seven studies (30%) had a complete clinical reasoning process of which 8 (6%) had a 'diagnosed cause' and 29 (24%) had an 'argued cause'. The Spearmans rho association between the extent of the clinical reasoning process and the risk of bias was -0.2. In the majority of studies (70%) the described clinical reasoning process was incomplete. A very small proportion (6%) had a 'diagnosed cause'. Therefore, a better methodological quality does not necessarily imply a better described clinical reasoning process. Copyright © 2018 Elsevier Ltd. All rights reserved.

Interventions to support people with dementia and their caregivers during the transition from home care to nursing home care: A systematic review.

PubMed

Müller, Christian; Lautenschläger, Sindy; Meyer, Gabriele; Stephan, Astrid

2017-06-01

During the transition of people with dementia from home to nursing home family caregivers often feel burdened. We aimed to 1) identify interventions which support people with dementia and their caregivers in the transition from home care to nursing home care, 2) synthesize the evidence for efficacy of these interventions, and 3) examine whether the identified interventions have been systematically developed, evaluated and implemented according to the Medical Research Council guidance on complex interventions. A systematic review of randomised controlled trials was conducted according to the recommendations specified in the Cochrane Handbook for Intervention Reviews. The review protocol was registered in PROSPERO (2015: CRD42015019839). Reporting follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. MEDLINE, CENTRAL, PsycINFO, CINAHL, OTseeker, and PEDro, were searched. Other sources included Google Scholar, and ALOIS. Two reviewers independently assessed the eligibility of the articles. Data extraction was performed by one reviewer and verified independently by another. The Cochrane Risk of Bias tool was used for critical appraisal. Development and evaluation of the identified interventions were assessed, taking the Medical Research Council guidance into account. Review findings were synthesized narratively. The search yielded 1278 records. Five studies were included, all conducted in the United States (4 RCTs and 1 cRCT with a total of 695 participants). The psychosocial interventions were individual and family counseling via telephone or ad hoc all of which addressed only informal caregivers. The intervention components, content and mode of delivery differed widely with inconsistent results. Significant intervention effects were found for the reduction of caregivers' depressive symptoms, burden, feeling of guilt, emotional distress, overload, and interactions with staff. Other outcomes, i.e. stress, placement adaptation, role overload, and role captivity, were not statistically significantly affected. The assessment for bias risk across studies varied from moderate to low. Only two studies tested the feasibility of the intervention before full scale evaluation, none evaluated the implementation process according to the Medical Research Council framework. We identified only a few studies with heterogeneous outcomes; evidence regarding the effectiveness of psychosocial interventions is thus insufficient. Further research is needed focusing on the development and evaluation of complex psychosocial interventions and more well-designed RCTs with larger sample sizes based on a rigorous methodology. Reporting on feasibility and implementation processes of interventions should be guaranteed, since it is crucial to evaluate transferability across care settings. Copyright © 2017 Elsevier Ltd. All rights reserved.

A new evaluation tool to obtain practice-based evidence of worksite health promotion programs.

PubMed

Dunet, Diane O; Sparling, Phillip B; Hersey, James; Williams-Piehota, Pamela; Hill, Mary D; Hanssen, Carl; Lawrenz, Frances; Reyes, Michele

2008-10-01

The Centers for Disease Control and Prevention developed the Swift Worksite Assessment and Translation (SWAT) evaluation method to identify promising practices in worksite health promotion programs. The new method complements research studies and evaluation studies of evidence-based practices that promote healthy weight in working adults. We used nationally recognized program evaluation standards of utility, feasibility, accuracy, and propriety as the foundation for our 5-step method: 1) site identification and selection, 2) site visit, 3) post-visit evaluation of promising practices, 4) evaluation capacity building, and 5) translation and dissemination. An independent, outside evaluation team conducted process and summative evaluations of SWAT to determine its efficacy in providing accurate, useful information and its compliance with evaluation standards. The SWAT evaluation approach is feasible in small and medium-sized workplace settings. The independent evaluation team judged SWAT favorably as an evaluation method, noting among its strengths its systematic and detailed procedures and service orientation. Experts in worksite health promotion evaluation concluded that the data obtained by using this evaluation method were sufficient to allow them to make judgments about promising practices. SWAT is a useful, business-friendly approach to systematic, yet rapid, evaluation that comports with program evaluation standards. The method provides a new tool to obtain practice-based evidence of worksite health promotion programs that help prevent obesity and, more broadly, may advance public health goals for chronic disease prevention and health promotion.

Evaluating Quality of Decision-Making Processes in Medicines' Development, Regulatory Review, and Health Technology Assessment: A Systematic Review of the Literature

PubMed Central

Bujar, Magdalena; McAuslane, Neil; Walker, Stuart R.; Salek, Sam

2017-01-01

Introduction: Although pharmaceutical companies, regulatory authorities, and health technology assessment (HTA) agencies have been increasingly using decision-making frameworks, it is not certain whether these enable better quality decision making. This could be addressed by formally evaluating the quality of decision-making process within those organizations. The aim of this literature review was to identify current techniques (tools, questionnaires, surveys, and studies) for measuring the quality of the decision-making process across the three stakeholders. Methods: Using MEDLINE, Web of Knowledge, and other Internet-based search engines, a literature review was performed to systematically identify techniques for assessing quality of decision making in medicines development, regulatory review, and HTA. A structured search was applied using key words and a secondary review was carried out. In addition, the measurement properties of each technique were assessed and compared. Ten Quality Decision-Making Practices (QDMPs) developed previously were then used as a framework for the evaluation of techniques identified in the review. Due to the variation in studies identified, meta-analysis was inappropriate. Results: This review identified 13 techniques, where 7 were developed specifically to assess decision making in medicines' development, regulatory review, or HTA; 2 examined corporate decision making, and 4 general decision making. Regarding how closely each technique conformed to the 10 QDMPs, the 13 techniques assessed a median of 6 QDMPs, with a mode of 3 QDMPs. Only 2 techniques evaluated all 10 QDMPs, namely the Organizational IQ and the Quality of Decision Making Orientation Scheme (QoDoS), of which only one technique, QoDoS could be applied to assess decision making of both individuals and organizations, and it possessed generalizability to capture issues relevant to companies as well as regulatory authorities. Conclusion: This review confirmed a general paucity of research in this area, particularly regarding the development and systematic application of techniques for evaluating quality decision making, with no consensus around a gold standard. This review has identified QoDoS as the most promising available technique for assessing decision making in the lifecycle of medicines and the next steps would be to further test its validity, sensitivity, and reliability. PMID:28443022

Systematically evaluating interfaces for RNA-seq analysis from a life scientist perspective.

PubMed

Poplawski, Alicia; Marini, Federico; Hess, Moritz; Zeller, Tanja; Mazur, Johanna; Binder, Harald

2016-03-01

RNA-sequencing (RNA-seq) has become an established way for measuring gene expression in model organisms and humans. While methods development for refining the corresponding data processing and analysis pipeline is ongoing, protocols for typical steps have been proposed and are widely used. Several user interfaces have been developed for making such analysis steps accessible to life scientists without extensive knowledge of command line tools. We performed a systematic search and evaluation of such interfaces to investigate to what extent these can indeed facilitate RNA-seq data analysis. We found a total of 29 open source interfaces, and six of the more widely used interfaces were evaluated in detail. Central criteria for evaluation were ease of configuration, documentation, usability, computational demand and reporting. No interface scored best in all of these criteria, indicating that the final choice will depend on the specific perspective of users and the corresponding weighting of criteria. Considerable technical hurdles had to be overcome in our evaluation. For many users, this will diminish potential benefits compared with command line tools, leaving room for future improvement of interfaces. © The Author 2015. Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.

A systematic review of leadership training for medical students.

PubMed

Lyons, Oscar; Su'a, Bruce; Locke, Michelle; Hill, Andrew

2018-01-19

Leadership is increasingly being recognised as an essential requirement for doctors. Many medical schools are in the process of developing formal leadership training programmes, but it remains to be elucidated what characteristics make such programmes effective, and to what extent current programmes are effective, beyond merely positive learner reactions. This review's objective was to investigate the effectiveness of undergraduate medical leadership curricula and to explore common features of effective curricula. A systematic literature search was conducted. Articles describing and evaluating undergraduate medical leadership curricula were included. Outcomes were stratified and analysed according to a modified Kirkpatrick's model for evaluating educational outcomes. Eleven studies met inclusion criteria. Leadership curricula evaluated were markedly heterogeneous in their duration and composition. The majority of studies utilised pre- and post- intervention questionnaires for evaluation. Two studies described randomised controlled trials with objective measures. Outcomes were broadly positive. Only one study reported neutral outcomes. A wide range of leadership curricula have shown subjective effectiveness, including short interventions. There is limited objective evidence however, and few studies have measured effectiveness at the system and patient levels. Further research is needed investigating objective and downstream outcomes, and use of standard frameworks for evaluation will facilitate effective comparison of initiatives.

Need for Systematic Retrofit Analysis in Multifamily Buildings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Malhotra, Mini; Im, Piljae

2014-01-01

Multifamily housing offers high potential for energy savings through retrofits. A comprehensive energy audit with systematic evaluation of alternative energy measures is one of the key steps to realizing the full energy savings potential. However, this potential often remains unrealized when the selection of measures is (1) based on a one-size-fits-all approach originating from accustomed practices, (2) intended merely to meet code-compliance requirements, and/or (3) influenced by owner renter split incentive. In such cases, the benefits of comprehensive energy auditing are disregarded in view of the apparent difficulty in diagnosing multifamily buildings, evaluating alternative measures, and installing customized sets ofmore » measures. This paper highlights some of the barriers encountered in a multifamily housing retrofit project in Georgia and demonstrates the merits of systematic retrofit analysis by identifying opportunities for higher energy savings and improved comfort and indoor air quality that were missed in this project. The study uses a whole-building energy analysis conducted for a 10-unit, low-rise, multifamily building of a 110-unit apartment complex. The analysis projected a 24% energy savings from the measures installed in the building with a payback period of 10 years. Further analysis with a systematic evaluation of alternative measures showed that without compromising on the objectives of durability, livability, and appearance of the building, energy savings of up to 34% were achievable with a payback period of 7 years. The paper concludes by outlining recommendations that may benefit future retrofit projects by improving the audit process, streamlining tasks, and achieving higher energy savings.« less

KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors.

PubMed

Lentine, Krista L; Kasiske, Bertram L; Levey, Andrew S; Adams, Patricia L; Alberú, Josefina; Bakr, Mohamed A; Gallon, Lorenzo; Garvey, Catherine A; Guleria, Sandeep; Li, Philip Kam-Tao; Segev, Dorry L; Taler, Sandra J; Tanabe, Kazunari; Wright, Linda; Zeier, Martin G; Cheung, Michael; Garg, Amit X

2017-08-01

The 2017 Kidney Disease: Improving Global Outcomes (KDIGO) Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors is intended to assist medical professionals who evaluate living kidney donor candidates and provide care before, during and after donation. The guideline development process followed the Grades of Recommendation Assessment, Development, and Evaluation (GRADE) approach and guideline recommendations are based on systematic reviews of relevant studies that included critical appraisal of the quality of the evidence and the strength of recommendations. However, many recommendations, for which there was no evidence or no systematic search for evidence was undertaken by the Evidence Review Team, were issued as ungraded expert opinion recommendations. The guideline work group concluded that a comprehensive approach to risk assessment should replace decisions based on assessments of single risk factors in isolation. Original data analyses were undertaken to produce a "proof-in-concept" risk-prediction model for kidney failure to support a framework for quantitative risk assessment in the donor candidate evaluation and defensible shared decision making. This framework is grounded in the simultaneous consideration of each candidate's profile of demographic and health characteristics. The processes and framework for the donor candidate evaluation are presented, along with recommendations for optimal care before, during, and after donation. Limitations of the evidence are discussed, especially regarding the lack of definitive prospective studies and clinical outcome trials. Suggestions for future research, including the need for continued refinement of long-term risk prediction and novel approaches to estimating donation-attributable risks, are also provided.In citing this document, the following format should be used: Kidney Disease: Improving Global Outcomes (KDIGO) Living Kidney Donor Work Group. KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors. Transplantation. 2017;101(Suppl 8S):S1-S109.

Systematic Review of Health Economic Evaluation Studies Developed in Brazil from 1980 to 2013.

PubMed

Decimoni, Tassia Cristina; Leandro, Roseli; Rozman, Luciana Martins; Craig, Dawn; Iglesias, Cynthia P; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2018-01-01

Brazil has sought to use economic evaluation to support healthcare decision-making processes. While a number of health economic evaluations (HEEs) have been conducted, no study has systematically reviewed the quality of Brazilian HEE. The objective of this systematic review was to provide an overview regarding the state of HEE research and to evaluate the number, characteristics, and quality of reporting of published HEE studies conducted in a Brazilian setting. We systematically searched electronic databases (MEDLINE, EMBASE, Latin American, and Caribbean Literature on Health Sciences Database, Scientific Electronic Library Online, NHS Economic Evaluation Database, health technology assessment Database, Bireme, and Biblioteca Virtual em Saúde Economia da Saúde ); citation indexes (SCOPUS, Web of Science), and Sistema de Informação da Rede Brasileira de Avaliação de Tecnologia em Saúde . Partial and full HEEs published between 1980 and 2013 that referred to a Brazilian setting were considered for inclusion. In total, 535 studies were included in the review, 36.8% of these were considered to be full HEE. The category of healthcare technologies more frequently assessed were procedures (34.8%) and drugs (28.8%) which main objective was treatment (72.1%). Forty-four percent of the studies reported their funding source and 36% reported a conflict of interest. Overall, the full HEE quality of reporting was satisfactory. But some items were generally poorly reported and significant improvement is required: (1) methods used to estimate healthcare resource use quantities and unit costs, (2) methods used to estimate utility values, (3) sources of funding, and (4) conflicts of interest. A steady number of HEE have been published in Brazil since 1980. To improve their contribution to inform national healthcare policy efforts need to be made to enhance the quality of reporting of HEEs and promote improvements in the way HEEs are designed, implemented (i.e., using sound methods for HEEs) and reported.

A systematic literature review of automated clinical coding and classification systems

PubMed Central

Williams, Margaret; Fenton, Susan H; Jenders, Robert A; Hersh, William R

2010-01-01

Clinical coding and classification processes transform natural language descriptions in clinical text into data that can subsequently be used for clinical care, research, and other purposes. This systematic literature review examined studies that evaluated all types of automated coding and classification systems to determine the performance of such systems. Studies indexed in Medline or other relevant databases prior to March 2009 were considered. The 113 studies included in this review show that automated tools exist for a variety of coding and classification purposes, focus on various healthcare specialties, and handle a wide variety of clinical document types. Automated coding and classification systems themselves are not generalizable, nor are the results of the studies evaluating them. Published research shows these systems hold promise, but these data must be considered in context, with performance relative to the complexity of the task and the desired outcome. PMID:20962126

[Neuromuscular electric stimulation therapy in otorhinolaryngology].

PubMed

Miller, S; Kühn, D; Jungheim, M; Schwemmle, C; Ptok, M

2014-02-01

Animal experiments have shown that after specific nerve traumatization, neuromuscular electrostimulation (NMES) can promote nerve regeneration and reduce synkinesia without negatively interfering with normal regeneration processes. NMES is used routinely in physical rehabilitation medicine. This systematic literature search in the Cochrane Central Register of Controlled Trials, the Cochrane Database of Systematic Reviews, the DAHTA database, the Health Technology Assessment Database and MEDLINE or PubMed considered studies on the use of NMES in otorhinolaryngology that have been published in German or English. The search identified 180 studies. These were evaluated and relevant studies were included in the further evaluation. In the fields of otorhinolaryngology and phoniatry/paediatric audiology, clinical studies investigating the effects of NMES on facial and laryngeal paresis, as well as dysphonia and dysphagia have been carried out. The evidence collected to date is encouraging; particularly for the treatment of certain forms of dysphagia and laryngeal paresis.

A systematic literature review of automated clinical coding and classification systems.

PubMed

Stanfill, Mary H; Williams, Margaret; Fenton, Susan H; Jenders, Robert A; Hersh, William R

2010-01-01

Clinical coding and classification processes transform natural language descriptions in clinical text into data that can subsequently be used for clinical care, research, and other purposes. This systematic literature review examined studies that evaluated all types of automated coding and classification systems to determine the performance of such systems. Studies indexed in Medline or other relevant databases prior to March 2009 were considered. The 113 studies included in this review show that automated tools exist for a variety of coding and classification purposes, focus on various healthcare specialties, and handle a wide variety of clinical document types. Automated coding and classification systems themselves are not generalizable, nor are the results of the studies evaluating them. Published research shows these systems hold promise, but these data must be considered in context, with performance relative to the complexity of the task and the desired outcome.

Appraisal of systematic reviews on the management of peri-implant diseases with two methodological tools.

PubMed

Faggion, Clovis Mariano; Monje, Alberto; Wasiak, Jason

2018-06-01

This study aimed to evaluate and compare the performance of two methodological instruments to appraise systematic reviews and to identify potential disagreements of systematic review authors regarding risk of bias (RoB) evaluation of randomized controlled trials (RCTs) included in systematic reviews on peri-implant diseases. We searched Medline, Web of Science, Cochrane Library, PubMed Central, and Google Scholar for systematic reviews on peri-implant diseases published before July 11, 2017. Two authors independently evaluated the RoB and methodological quality of the systematic reviews by applying the Risk of Bias in Systematic Reviews (ROBIS) tool and Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist, respectively. We assessed the RoB scores of the same RCTs published in different systematic reviews. Of the 32 systematic reviews identified, 23 reviews addressed the clinical topic of peri-implantitis. A high RoB was detected for most systematic reviews (n=25) using ROBIS, whilst five systematic reviews displayed low methodological quality by AMSTAR. Almost 30% of the RoB comparisons (for the same RCTs) had different RoB ratings across systematic reviews. The ROBIS tool appears to provide more conservative results than AMSTAR checklist. Considerable disagreement was found among systematic review authors rating the same RCT included in different systematic reviews. © 2018 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Formative process evaluation for implementing a social marketing intervention to increase walking among African Americans in the Positive Action for Today's Health trial.

PubMed

Coulon, Sandra M; Wilson, Dawn K; Griffin, Sarah; St George, Sara M; Alia, Kassandra A; Trumpeter, Nevelyn N; Wandersman, Abraham K; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-12-01

Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today's Health trial. We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities.

[Definition of "Safety and Hygiene Packages" as a management model for the Hospital Hygiene Service (HHS)].

PubMed

Raponi, Matteo; Damiani, Gianfranco; Vincenti, Sara; Wachocka, Malgorzata; Boninti, Federica; Bruno, Stefania; Quaranta, Gianluigi; Moscato, Umberto; Boccia, Stefania; Ficarra, Maria Giovanna; Specchia, Maria Lucia; Posteraro, Brunella; Berloco, Filippo; Celani, Fabrizio; Ricciardi, Walter; Laurenti, Patrizia

2014-01-01

The purpose of this research is to identify and formalize the Hospital Hygiene Service activities and products, evaluating them in a cost accounting management view. The ultimate aim, is to evaluate the financial adverse events prevention impact, in an Hospital Hygiene Service management. A three step methodology based on affinity grouping activities, was employed. This methodology led us to identify 4 action areas, with 23 related productive processes, and 86 available safety packages. Owing to this new methodology, we was able to implement a systematic evaluation of the furnished services.

Impact of e-alert for detection of acute kidney injury on processes of care and outcomes: protocol for a systematic review and meta-analysis.

PubMed

Lachance, Philippe; Villeneuve, Pierre-Marc; Wilson, Francis P; Selby, Nicholas M; Featherstone, Robin; Rewa, Oleksa; Bagshaw, Sean M

2016-05-05

Acute kidney injury (AKI) is a common complication in hospitalised patients. It imposes significant risk for major morbidity and mortality. Moreover, patients suffering an episode of AKI consume considerable health resources. Recently, a number of studies have evaluated the implementation of automated electronic alerts (e-alerts) configured from electronic medical records (EMR) and clinical information systems (CIS) to warn healthcare providers of early or impending AKI in hospitalised patients. The impact of e-alerts on care processes, patient outcomes and health resource use, however, remains uncertain. We will perform a systematic review to describe and appraise e-alerts for AKI, and evaluate their impact on processes of care, clinical outcomes and health services use. In consultation with a research librarian, a search strategy will be developed and electronic databases (ie, MEDLINE, EMBASE, CINAHL, Cochrane Library and Inspec via Engineering Village) searched. Selected grey literature sources will also be searched. Search themes will focus on e-alerts and AKI. Citation screening, selection, quality assessment and data abstraction will be performed in duplicate. The primary analysis will be narrative; however, where feasible, pooled analysis will be performed. Each e-alert will be described according to trigger, type of alert, target recipient and degree of intrusiveness. Pooled effect estimates will be described, where applicable. Our systematic review will synthesise the literature on the value of e-alerts to detect AKI, and their impact on processes, patient-centred outcomes and resource use, and also identify key knowledge gaps and barriers to implementation. This is a fundamental step in a broader research programme aimed to understand the ideal structure of e-alerts, target population and methods for implementation, to derive benefit. Research ethics approval is not required for this review. CRD42016033033. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Using formative research to lay the foundation for community level HIV prevention efforts: an example from the AIDS Community Demonstration Projects.

PubMed Central

Higgins, D L; O'Reilly, K; Tashima, N; Crain, C; Beeker, C; Goldbaum, G; Elifson, C S; Galavotti, C; Guenther-Grey, C

1996-01-01

The AIDS Community Demonstration Projects provided community-level HIV prevention interventions to historically hard-to-reach groups at high risk for HIV infection. The projects operated under a common research protocol which encompassed formative research, intervention delivery, process evaluation, and outcome evaluation. A formative research process specifically focusing on intervention development was devised to assist project staff in identifying, prioritizing, accessing, and understanding the intervention target groups. This process was central to the creation of interventions that were acceptable and unique to the target populations. Intended to be rapid, the process took 6 months to complete. Drawn from the disciplines of anthropology, community psychology, sociology, and public health, the formative research process followed distinct steps which included (a) defining the populations at high-risk for HIV; (b) gathering information about these populations through interviews with persons who were outside of, but who had contact with, the target groups (such as staff from the health department and alcohol and drug treatment facilities, as well as persons who interacted in an informal manner with the target groups, such as clerks in neighborhood grocery stores and bartenders); (c) interviewing people with access to the target populations (gatekeepers), and conducting observations in areas where these high-risk groups were reported to gather (from previous interviews); (d) interviewing members of these groups at high risk for HIV infection or transmission; and (e) systematically integrating information throughout the process. Semistructured interview schedules were used for all data collection in this process. This standardized systematic method yielded valuable information about the focal groups in each demonstration project site. The method, if adopted by others, would assist community intervention specialists in developing interventions that are culturally appropriate and meaningful to their respective target populations. PMID:8862154

Optimization Of PVDF-TrFE Processing Conditions For The Fabrication Of Organic MEMS Resonators

PubMed Central

Ducrot, Pierre-Henri; Dufour, Isabelle; Ayela, Cédric

2016-01-01

This paper reports a systematic optimization of processing conditions of PVDF-TrFE piezoelectric thin films, used as integrated transducers in organic MEMS resonators. Indeed, despite data on electromechanical properties of PVDF found in the literature, optimized processing conditions that lead to these properties remain only partially described. In this work, a rigorous optimization of parameters enabling state-of-the-art piezoelectric properties of PVDF-TrFE thin films has been performed via the evaluation of the actuation performance of MEMS resonators. Conditions such as annealing duration, poling field and poling duration have been optimized and repeatability of the process has been demonstrated. PMID:26792224

Optimization Of PVDF-TrFE Processing Conditions For The Fabrication Of Organic MEMS Resonators.

PubMed

Ducrot, Pierre-Henri; Dufour, Isabelle; Ayela, Cédric

2016-01-21

This paper reports a systematic optimization of processing conditions of PVDF-TrFE piezoelectric thin films, used as integrated transducers in organic MEMS resonators. Indeed, despite data on electromechanical properties of PVDF found in the literature, optimized processing conditions that lead to these properties remain only partially described. In this work, a rigorous optimization of parameters enabling state-of-the-art piezoelectric properties of PVDF-TrFE thin films has been performed via the evaluation of the actuation performance of MEMS resonators. Conditions such as annealing duration, poling field and poling duration have been optimized and repeatability of the process has been demonstrated.

Ensuring Cross-Cultural Equivalence in Translation of Research Consents and Clinical Documents

PubMed Central

Lee, Cheng-Chih; Li, Denise; Arai, Shoshana; Puntillo, Kathleen

2010-01-01

The aim of this article is to describe a formal process used to translate research study materials from English into traditional Chinese characters. This process may be useful for translating documents for use by both research participants and clinical patients. A modified Brislin model was used as the systematic translation process. Four bilingual translators were involved, and a Flaherty 3-point scale was used to evaluate the translated documents. The linguistic discrepancies that arise in the process of ensuring cross-cultural congruency or equivalency between the two languages are presented to promote the development of patient-accessible cross-cultural documents. PMID:18948451

Cost-effectiveness of pharmaceutical management for osteoarthritis pain: a systematic review of the literature and recommendations for future economic evaluation.

PubMed

Xie, Feng; Tanvejsilp, Pimwara; Campbell, Kaitryn; Gaebel, Kathryn

2013-05-01

Osteoarthritis (OA) is a highly prevalent and chronic condition characterized by pain and physical disability. Currently, many treatments are available, and they primarily target pain relief. The objectives of this study were to systematically review economic evaluations for pharmaceutical management of OA pain and to provide methodological recommendations for future economic evaluation. Published literature was identified by searching the following bibliographic databases: MEDLINE (1948-16 November 2011) with In-Process records and EMBASE (1980-2011 Week 47) via Ovid; The Cochrane Library (Issue 4 of 4, 2011) and the Health Economic Evaluations Database (HEED) via Wiley; and PubMed (for non-MEDLINE records). The main search terms were OA and economic evaluations. Two reviewers independently screened all identified articles and extracted the data from those included in the final review. Twelve articles reporting the cost-effectiveness of various pharmaceuticals were included, with five being trial-based and seven being model-based economic evaluations. The mean health economics quality score of the included articles was 84 (minimum-maximum: 63-99). These evaluations varied in study design, treatments compared, and outcomes measured. The existing economic evaluations on pharmaceutical management of OA pain were of acceptable quality. Comparability of economic evaluations could be improved by selecting standard comparators, adopting a longer time horizon, and directly measuring health utilities.

Indigenous health program evaluation design and methods in Australia: a systematic review of the evidence.

PubMed

Lokuge, Kamalini; Thurber, Katherine; Calabria, Bianca; Davis, Meg; McMahon, Kathryn; Sartor, Lauren; Lovett, Raymond; Guthrie, Jill; Banks, Emily

2017-10-01

Indigenous Australians experience a disproportionately higher burden of disease compared to non-Indigenous Australians. High-quality evaluation of Indigenous health programs is required to inform health and health services improvement. We aimed to quantify methodological and other characteristics of Australian Indigenous health program evaluations published in the peer-reviewed literature. Systematic review of peer-reviewed literature (November 2009-2014) on Indigenous health program evaluation. We identified 118 papers describing evaluations of 109 interventions; 72.0% were university/research institution-led. 82.2% of evaluations included a quantitative component; 49.2% utilised quantitative data only and 33.1% used both quantitative and qualitative data. The most common design was a before/after comparison (30.5%, n=36/118). 7.6% of studies (n=9/118) used an experimental design: six individual-level and three cluster-randomised controlled trials. 56.8% (67/118) reported on service delivery/process outcomes (versus health or health risk factor outcomes) only. Given the number of Indigenous health programs that are implemented, few evaluations overall are published in the peer-reviewed literature and, of these, few use optimal methodologies such as mixed methods and experimental design. Implications for public health: Multiple strategies are required to increase high-quality, accessible evaluation in Indigenous health, including supporting stronger research-policy-practice partnerships and capacity building for evaluation by health services and government. © 2017 The Authors.

Spacelab user implementation assessment study. Volume 1: Concept development and evaluation

NASA Technical Reports Server (NTRS)

1975-01-01

The total matrix of alternate Spacelab processing concepts and the rejection rationale utilized to reduce the matrix of 243 alternates to the final candidate processing concepts are developed. The work breakdown structure used for the systematic estimation and compilation of integration and checkout resources is presented along with descriptors of each element. Program models are provided of the space transportation system, the Spacelab, the orbiter, and the ATL that were used as the basis for the study trades, analyses, and optimizations. Resource requirements for all processing concepts are summarized along with the optimizations of the processing concepts. Concept evaluations including flight-rate sensitivities of the GSE, facilities, Spacelab hardware elements, and personnel are delineated. An analysis is presented of the applicability of the candidate concepts to potential spacelab users. The impact of the use of the western test range as an orbiter/spacelab launch site on the candidate processing concepts is evaluated. An assessment of the geographical co-location of experiment, Spacelab, and orbiter-cargo integration is included. Ownership options of the support module/system igloo are discussed.

Using text mining for study identification in systematic reviews: a systematic review of current approaches.

PubMed

O'Mara-Eves, Alison; Thomas, James; McNaught, John; Miwa, Makoto; Ananiadou, Sophia

2015-01-14

The large and growing number of published studies, and their increasing rate of publication, makes the task of identifying relevant studies in an unbiased way for inclusion in systematic reviews both complex and time consuming. Text mining has been offered as a potential solution: through automating some of the screening process, reviewer time can be saved. The evidence base around the use of text mining for screening has not yet been pulled together systematically; this systematic review fills that research gap. Focusing mainly on non-technical issues, the review aims to increase awareness of the potential of these technologies and promote further collaborative research between the computer science and systematic review communities. Five research questions led our review: what is the state of the evidence base; how has workload reduction been evaluated; what are the purposes of semi-automation and how effective are they; how have key contextual problems of applying text mining to the systematic review field been addressed; and what challenges to implementation have emerged? We answered these questions using standard systematic review methods: systematic and exhaustive searching, quality-assured data extraction and a narrative synthesis to synthesise findings. The evidence base is active and diverse; there is almost no replication between studies or collaboration between research teams and, whilst it is difficult to establish any overall conclusions about best approaches, it is clear that efficiencies and reductions in workload are potentially achievable. On the whole, most suggested that a saving in workload of between 30% and 70% might be possible, though sometimes the saving in workload is accompanied by the loss of 5% of relevant studies (i.e. a 95% recall). Using text mining to prioritise the order in which items are screened should be considered safe and ready for use in 'live' reviews. The use of text mining as a 'second screener' may also be used cautiously. The use of text mining to eliminate studies automatically should be considered promising, but not yet fully proven. In highly technical/clinical areas, it may be used with a high degree of confidence; but more developmental and evaluative work is needed in other disciplines.

Using process data to understand outcomes in sexual health promotion: an example from a review of school-based programmes to prevent sexually transmitted infections.

PubMed

Shepherd, J; Harden, A; Barnett-Page, E; Kavanagh, J; Picot, J; Frampton, G K; Cooper, K; Hartwell, D; Clegg, A

2014-08-01

This article discusses how process indicators can complement outcomes as part of a comprehensive explanatory evaluation framework, using the example of skills-based behavioural interventions to prevent sexually transmitted infections and promote sexual health among young people in schools. A systematic review was conducted, yielding 12 eligible outcome evaluations, 9 of which included a process evaluation. There were few statistically significant effects in terms of changes in sexual behaviour outcomes, but statistically significant effects were more common for knowledge and self-efficacy. Synthesis of the findings of the process evaluations identified a range of factors that might explain outcomes, and these were organized into two overarching categories: the implementation of interventions, and student engagement and intervention acceptability. Factors which supported implementation and engagement and acceptability included good quality teacher training, involvement and motivation of key school stakeholders and relevance and appeal to young people. Factors which had a negative impact included teachers' failure to comprehend the theoretical basis for behaviour change, school logistical problems and omission of topics that young people considered important. It is recommended that process indicators such as these be assessed in future evaluations of school-based sexual health behavioural interventions, as part of a logic model. © Crown copyright 2014.

Quantifying the process and outcomes of person-centered planning.

PubMed

Holburn, S; Jacobson, J W; Vietze, P M; Schwartz, A A; Sersen, E

2000-09-01

Although person-centered planning is a popular approach in the field of developmental disabilities, there has been little systematic assessment of its process and outcomes. To measure person-centered planning, we developed three instruments designed to assess its various aspects. We then constructed variables comprising both a Process and an Outcome Index using a combined rational-empirical method. Test-retest reliability and measures of internal consistency appeared adequate. Variable correlations and factor analysis were generally consistent with our conceptualization and resulting item and variable classifications. Practical implications for intervention integrity, program evaluation, and organizational performance are discussed.

Guidelines for performing systematic reviews in the development of toxicity factors.

PubMed

Schaefer, Heather R; Myers, Jessica L

2017-12-01

The Texas Commission on Environmental Quality (TCEQ) developed guidance on conducting systematic reviews during the development of chemical-specific toxicity factors. Using elements from publicly available frameworks, the TCEQ systematic review process was developed in order to supplement the existing TCEQ Guidelines for developing toxicity factors (TCEQ Regulatory Guidance 442). The TCEQ systematic review process includes six steps: 1) Problem Formulation; 2) Systematic Literature Review and Study Selection; 3) Data Extraction; 4) Study Quality and Risk of Bias Assessment; 5) Evidence Integration and Endpoint Determination; and 6) Confidence Rating. This document provides guidance on conducting a systematic literature review and integrating evidence from different data streams when developing chemical-specific reference values (ReVs) and unit risk factors (URFs). However, this process can also be modified or expanded to address other questions that would benefit from systematic review practices. The systematic review and evidence integration framework can improve regulatory decision-making processes, increase transparency, minimize bias, improve consistency between different risk assessments, and further improve confidence in toxicity factor development. Copyright © 2017 The Author(s). Published by Elsevier Inc. All rights reserved.

Steps toward improving ethical evaluation in health technology assessment: a proposed framework.

PubMed

Assasi, Nazila; Tarride, Jean-Eric; O'Reilly, Daria; Schwartz, Lisa

2016-06-06

While evaluation of ethical aspects in health technology assessment (HTA) has gained much attention during the past years, the integration of ethics in HTA practice still presents many challenges. In response to the increasing demand for expansion of health technology assessment (HTA) methodology to include ethical issues more systematically, this article reports on a multi-stage study that aimed at construction of a framework for improving the integration of ethics in HTA. The framework was developed through the following phases: 1) a systematic review and content analysis of guidance documents for ethics in HTA; 2) identification of factors influencing the integration of ethical considerations in HTA; 3) preparation of an action-oriented framework based on the key elements of the existing guidance documents and identified barriers to and facilitators of their implementation; and 4) expert consultation and revision of the framework. The proposed framework consists of three main components: an algorithmic flowchart, which exhibits the different steps of an ethical inquiry throughout the HTA process, including: defining the objectives and scope of the evaluation, stakeholder analysis, assessing organizational capacity, framing ethical evaluation questions, ethical analysis, deliberation, and knowledge translation; a stepwise guide, which focuses on the task objectives and potential questions that are required to be addressed at each step; and a list of some commonly recommended or used tools to help facilitate the evaluation process. The proposed framework can be used to support and promote good practice in integration of ethics into HTA. However, further validation of the framework through case studies and expert consultation is required to establish its utility for HTA practice.

Systematic Program Design: A Handbook for Volunteers. Appropriate Technologies for Development. Fourth Edition. Reprint R-44A.

ERIC Educational Resources Information Center

Peace Corps, Washington, DC. Information Collection and Exchange Div.

This manual is intended to assist volunteers and staff of volunteer organizations in the design of projects in various community and social service areas. The first section of the manual is a guidebook that addresses such aspects of the planning, implementation, and evaluation process as situational analysis, needs assessment, task-oriented…

Evaluation of different multidimensional LC-MS/MS pipelines for iTRAQ-based proteomic analysis of potato tubers in response to cold storage

USDA-ARS?s Scientific Manuscript database

Cold-induced sweetening in potato tubers is a costly problem for food industry. To systematically identify the proteins associated with this process, we employed a comparative proteomics approach using isobaric, stable isotope coded labels to compare the proteomes of potato tubers after 0 and 5 mont...

Methodology for applying monitored natural attenuation to petroleum hydrocarbon-contaminated ground-water systems with examples from South Carolina

USGS Publications Warehouse

Chapelle, Frank H.; Robertson, John F.; Landmeyer, James E.; Bradley, Paul M.

2000-01-01

These two sites illustrate how the efficiency of natural attenuation processes acting on petroleum hydrocarbons can be systematically evaluated using hydrologic, geochemical, and microbiologic methods.  These methods, in turn, can be used to assess the role that the natural attenuation of petroleum hydrocarbons can play in achieving overall site remediation.

Development and Validation of a Web-Based Module to Teach Metacognitive Learning Strategies to Students in Higher Education

ERIC Educational Resources Information Center

Singh, Oma B.

2009-01-01

This study used a design based-research (DBR) methodology to examine how an Instructional Systematic Design (ISD) process such as ADDIE (Analysis, Design, Development, Implementation, Evaluation) can be employed to develop a web-based module to teach metacognitive learning strategies to students in higher education. The goal of the study was…

Homeland Security and Capabilities-Based Planning: Improving National Preparedness

DTIC Science & Technology

2005-09-01

Caudle 2004; NEMA 2004; ASTHO 2004). Their concerns emphasized proceeding with what one called a fatally flawed process following artificially... norm for a number of years, a systematic collection, evaluation, and dissemination of lessons learned and better practices has only recently picked...intergovernmental relations for homeland security. National Emergency Management Association ( NEMA ). (2004). Letter to Sue Mencer. Lexington, KY: October 29

PARAGON: A Systematic, Integrated Approach to Aerosol Observation and Modeling

NASA Technical Reports Server (NTRS)

Diner, David J.; Kahn, Ralph A.; Braverman, Amy J.; Davies, Roger; Martonchik, John V.; Menzies, Robert T.; Ackerman, Thomas P.; Seinfeld, John H.; Anderson, Theodore L.; Charlson, Robert J.;

Alternative sites for LNG facilities in the Cook Inlet/Kenia Peninsula, Alaska area. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1975-10-02

The purpose of this study was to analyze alternate LNG sites in the Cook Inlet area, Alaska, with primary emphasis on sites not identified by the El Paso-Alaska LNG Company in Docket No. CP-75-96. The evaluation included a systematic gross elimination process of eleven major subregions of Cook Inlet to eight subregions based upon considerations of land use and status, proximity of volcanos and other detrimental geological features, unsafe approaches for maneuvering and docking transport vessels, and adverse meteorological and marine conditions. This initial elimination process was followed by a more detailed iterative process of location and evaluation of 26more » specific sites in terms of local adverse impacts to biotic communities, human populations, and present land use practices. The analysis and elimination process resulted in the eventual selection and ranking of three sites: (1) Nikiski; (2) Cape Starichkof; (3) Resurrection Bay East. (GRA)« less

Systems approach to managing educational quality in the engineering classroom

NASA Astrophysics Data System (ADS)

Grygoryev, Kostyantyn

Today's competitive environment in post-secondary education requires universities to demonstrate the quality of their programs in order to attract financing, and student and academic talent. Despite significant efforts devoted to improving the quality of higher education, systematic, continuous performance measurement and management still have not reached the level where educational outputs and outcomes are actually produced---the classroom. An engineering classroom is a complex environment in which educational inputs are transformed by educational processes into educational outputs and outcomes. By treating a classroom as a system, one can apply tools such as Structural Equation Modeling, Statistical Process Control, and System Dynamics in order to discover cause-and-effect relationships among the classroom variables, control the classroom processes, and evaluate the effect of changes to the course organization, content, and delivery, on educational processes and outcomes. Quality improvement is best achieved through the continuous, systematic application of efforts and resources. Improving classroom processes and outcomes is an iterative process that starts with identifying opportunities for improvement, designing the action plan, implementing the changes, and evaluating their effects. Once the desired objectives are achieved, the quality improvement cycle may start again. The goal of this research was to improve the educational processes and outcomes in an undergraduate engineering management course taught at the University of Alberta. The author was involved with the course, first, as a teaching assistant, and, then, as a primary instructor. The data collected from the course over four years were used to create, first, a static and, then, a dynamic model of a classroom system. By using model output and qualitative feedback from students, changes to the course organization and content were introduced. These changes led to a lower perceived course workload and increased the students' satisfaction with the instructor, but the students' overall satisfaction with the course did not change significantly, and their attitude toward the course subject actually became more negative. This research brought performance measurement to the level of a classroom, created a dynamic model of the classroom system based on the cause-and-effect relationships discovered by using statistical analysis, and used a systematic, continuous improvement approach to modify the course in order to improve selected educational processes and outcomes.

Promotional communications for influenza vaccination: a systematic review.

PubMed

Macdonald, Laura; Cairns, Georgina; Angus, Kathryn; de Andrade, Marisa

2013-01-01

The authors conducted a systematic review that aimed to map current practice and identify effective practice in promotional communications for seasonal influenza vaccination in Europe. They identified 22 studies from 7 European countries. Included studies were primarily outcome evaluations of communications promoting vaccination to health care workers and elderly adults. Evidence on communications to improve public acceptance was sparse. A range of communication approaches, methods, materials, and channels were used, frequently in combination. All forms of promotional communications have the potential to increase uptake in health care workers and can also improve uptake among patients. There was promising evidence that mass communication methods, delivered as standalone activities or as one component of a communication mix, can improve uptake in target populations. Education for health care workers and improved service delivery are common adjuncts to promotional communications that were associated with effectiveness. The evidence suggests that personalized communications, combined with improved service delivery, might boost rates of uptake among elderly adults. Future development of good practice could be enhanced by more systematic, theory-based intervention design and more detailed reporting of process and outcome evaluations. Vaccine hesitancy is increasingly prevalent; more policy and research to improve public acceptance should therefore be considered.

[Nursing care systematization at the intensive care unit (ICU) based on Wanda Horta's theory].

PubMed

Amante, Lúcia Nazareth; Rossetto, Annelise Paula; Schneider, Dulcinéia Ghizoni

2009-03-01

The purpose of this study was to implement the Nursing Care Systematization--Sistematização da Assistência de Enfermagem (SAE)--with Wanda Aguiar Horta's Theory of Basic Human Necessities and the North American Nursing Diagnosis Association's (NANDA) Nursing Diagnosis as its references. The starting point was the evaluation of the knowledge of the nursing team about the SAE, including their participation in this process. This is a qualitative study, performed in the Intensive Care Unit in a hospital in the city of Brusque, Santa Catarina, from October, 2006 to March, 2007. It was observed that the nursing professionals know little about SAE, but they are greatly interested in learning and developing it in their daily practice. In conclusion, it was possible to execute the healthcare systematization in an easy way, with the use of simple brochures that provided all the necessary information for the qualified development of nursing care.

Successful management of Barth syndrome: a systematic review highlighting the importance of a flexible and multidisciplinary approach.

PubMed

Reynolds, Stacey

2015-01-01

This review describes and summarizes the available evidence related to the treatment and management of Barth syndrome. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) standards were used to identify articles published between December 2004 and January 2015. The Cochrane Population, Intervention, Control, Outcome, Study Design (PICOS) approach was used to guide the article selection and evaluation process. Of the 128 articles screened, 28 articles matched the systematic review inclusion criteria. The results of this review indicate the need for a flexible and multidisciplinary approach to manage the symptoms most commonly associated with Barth syndrome. It is recommended that a comprehensive care team should include individuals with Barth syndrome, their family members and caregivers, as well as medical, rehabilitative, nutritional, psychological, and educational professionals. The evidence for specific treatments, therapies, and techniques for individuals with Barth syndrome is currently lacking in both quality and quantity.

Stages in the research process.

PubMed

Gelling, Leslie

2015-03-04

Research should be conducted in a systematic manner, allowing the researcher to progress from a general idea or clinical problem to scientifically rigorous research findings that enable new developments to improve clinical practice. Using a research process helps guide this process. This article is the first in a 26-part series on nursing research. It examines the process that is common to all research, and provides insights into ten different stages of this process: developing the research question, searching and evaluating the literature, selecting the research approach, selecting research methods, gaining access to the research site and data, pilot study, sampling and recruitment, data collection, data analysis, and dissemination of results and implementation of findings.

Implementation of a Systematic Accountability Framework in 2014 to Improve the Performance of the Nigerian Polio Program

PubMed Central

Tegegne, Sisay G.; MKanda, Pascal; Yehualashet, Yared G.; Erbeto, Tesfaye B.; Touray, Kebba; Nsubuga, Peter; Banda, Richard; Vaz, Rui G.

2016-01-01

Background. An accountability framework is a central feature of managing human and financial resources. One of its primary goals is to improve program performance through close monitoring of selected priority activities. The principal objective of this study was to determine the contribution of a systematic accountability framework to improving the performance of the World Health Organization (WHO)–Nigeria polio program staff, as well as the program itself. Methods. The effect of implementation of the accountability framework was evaluated using data on administrative actions and select process indicators associated with acute flaccid paralysis (AFP) surveillance, routine immunization, and polio supplemental immunization activities. Data were collected in 2014 during supportive supervision, using Magpi software (a company that provides service to collect data using mobile phones). A total of 2500 staff were studied. Results. Data on administrative actions and process indicators from quarters 2–4 in 2014 were compared. With respect to administrative actions, 1631 personnel (74%) received positive feedback (written or verbal commendation) in quarter 4 through the accountability framework, compared with 1569 (73%) and 1152 (61%) during quarters 3 and 2, respectively. These findings accorded with data on process indicators associated with AFP surveillance and routine immunization, showing statistically significant improvements in staff performance at the end of quarter 4, compared with other quarters. Conclusions. Improvements in staff performance and process indicators were observed for the WHO-Nigeria polio program after implementation of a systematic accountability framework. PMID:26823334

Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers and clinicians.

PubMed

Murthy, Lakshmi; Shepperd, Sasha; Clarke, Mike J; Garner, Sarah E; Lavis, John N; Perrier, Laure; Roberts, Nia W; Straus, Sharon E

2012-09-12

Systematic reviews provide a transparent and robust summary of existing research. However, health system managers, national and local policy makers and healthcare professionals can face several obstacles when attempting to utilise this evidence. These include constraints operating within the health system, dealing with a large volume of research evidence and difficulties in adapting evidence from systematic reviews so that it is locally relevant. In an attempt to increase the use of systematic review evidence in decision-making a number of interventions have been developed. These include summaries of systematic review evidence that are designed to improve the accessibility of the findings of systematic reviews (often referred to as information products) and changes to organisational structures, such as employing specialist groups to synthesise the evidence to inform local decision-making. To identify and assess the effects of information products based on the findings of systematic review evidence and organisational supports and processes designed to support the uptake of systematic review evidence by health system managers, policy makers and healthcare professionals. We searched The Cochrane Library, MEDLINE, EMBASE, CINAHL, Web of Science, and Health Economic Evaluations Database. We also handsearched two journals (Implementation Science and Evidence and Policy), Cochrane Colloquium abstracts, websites of key organisations and reference lists of studies considered for inclusion. Searches were run from 1992 to March 2011 on all databases, an update search to March 2012 was run on MEDLINE only. Randomised controlled trials (RCTs), interrupted time-series (ITS) and controlled before-after studies (CBA) of interventions designed to aid the use of systematic reviews in healthcare decision-making were considered. Two review authors independently extracted the data and assessed the study quality. We extracted the median value across similar outcomes for each study and reported the range of values for each median value. We calculated the median of the two middlemost values if an even number of outcomes were reported. We included eight studies evaluating the effectiveness of different interventions designed to support the uptake of systematic review evidence. The overall quality of the evidence was very low to moderate.Two cluster RCTs evaluated the effectiveness of multifaceted interventions, which contained access to systematic reviews relevant to reproductive health, to change obstetric care; the high baseline performance in some of the key clinical indicators limited the findings of these studies. There were no statistically significant effects on clinical practice for all but one of the clinical indicators in selected obstetric units in Thailand (median effect size 4.2%, range -11.2% to 18.2%) and none in Mexico (median effect size 3.5%, range 0.1% to 19.0%). In the second cluster RCT there were no statistically significant differences in selected obstetric units in the UK (median effect RR 0.92; range RR 0.57 to RR 1.10). One RCT evaluated the perceived understanding and ease of use of summary of findings tables in Cochrane Reviews. The median effect of the differences in responses for the acceptability of including summary of findings tables in Cochrane Reviews versus not including them was 16%, range 1% to 28%. One RCT evaluated the effect of an analgesic league table, derived from systematic review evidence, and there was no statistically significant effect on self-reported pain. Only one RCT evaluated an organisational intervention (which included a knowledge broker, access to a repository of systematic reviews and provision of tailored messages), and reported no statistically significant difference in evidence informed programme planning.Three interrupted time series studies evaluated the dissemination of printed bulletins based on evidence from systematic reviews. A statistically significant reduction in the rates of surgery for glue ear in children under 10 years (mean annual decline of -10.1%; 95% CI -7.9 to -12.3) and in children under 15 years (quarterly reduction -0.044; 95% CI -0.080 to -0.011) was reported. The distribution to general practitioners of a bulletin on the treatment of depression was associated with a statistically significant lower prescribing rate each quarter than that predicted by the rates of prescribing observed before the distribution of the bulletin (8.2%; P = 0.005). Mass mailing a printed bulletin which summarises systematic review evidence may improve evidence-based practice when there is a single clear message, if the change is relatively simple to accomplish, and there is a growing awareness by users of the evidence that a change in practice is required. If the intention is to develop awareness and knowledge of systematic review evidence, and the skills for implementing this evidence, a multifaceted intervention that addresses each of these aims may be required, though there is insufficient evidence to support this approach.

No Cost – Low Cost Compressed Air System Optimization in Industry

NASA Astrophysics Data System (ADS)

Dharma, A.; Budiarsa, N.; Watiniasih, N.; Antara, N. G.

2018-04-01

Energy conservation is a systematic, integrated of effort, in order to preserve energy sources and improve energy utilization efficiency. Utilization of energy in efficient manner without reducing the energy usage it must. Energy conservation efforts are applied at all stages of utilization, from utilization of energy resources to final, using efficient technology, and cultivating an energy-efficient lifestyle. The most common way is to promote energy efficiency in the industry on end use and overcome barriers to achieve such efficiency by using system energy optimization programs. The facts show that energy saving efforts in the process usually only focus on replacing tools and not an overall system improvement effort. In this research, a framework of sustainable energy reduction work in companies that have or have not implemented energy management system (EnMS) will be conducted a systematic technical approach in evaluating accurately a compressed-air system and potential optimization through observation, measurement and verification environmental conditions and processes, then processing the physical quantities of systems such as air flow, pressure and electrical power energy at any given time measured using comparative analysis methods in this industry, to provide the potential savings of energy saving is greater than the component approach, with no cost to the lowest cost (no cost - low cost). The process of evaluating energy utilization and energy saving opportunities will provide recommendations for increasing efficiency in the industry and reducing CO2 emissions and improving environmental quality.

The oxidative stability of omega-3 oil-in-water nanoemulsion systems suitable for functional food enrichment: A systematic review of the literature.

PubMed

Bush, Linda; Stevenson, Leo; Lane, Katie E

2017-10-23

There is growing demand for functional food products enriched with long chain omega-3 polyunsaturated fatty acids (LCω3PUFA). Nanoemulsions, systems with extremely small droplet sizes have been shown to increase LCω3PUFA bioavailability. However, nanoemulsion creation and processing methods may impact on the oxidative stability of these systems. The present systematic review collates information from studies that evaluated the oxidative stability of LCω3PUFA nanoemulsions suitable for use in functional foods. The systematic search identified seventeen articles published during the last 10 years. Researchers used a range of surfactants and antioxidants to create systems which were evaluated from 7 to 100 days of storage. Nanoemulsions were created using synthetic and natural emulsifiers, with natural sources offering equivalent or increased oxidative stability compared to synthetic sources, which is useful as consumers are demanding natural, cleaner label food products. Equivalent vegetarian sources of LCω3PUFA found in fish oils such as algal oils are promising as they provide direct sources without the need for conversion in the human metabolic pathway. Quillaja saponin is a promising natural emulsifier that can produce nanoemulsion systems with equivalent/increased oxidative stability in comparison to other emulsifiers. Further studies to evaluate the oxidative stability of quillaja saponin nanoemulsions combined with algal sources of LCω3PUFA are warranted.

CDO budgeting

NASA Astrophysics Data System (ADS)

Nesladek, Pavel; Wiswesser, Andreas; Sass, Björn; Mauermann, Sebastian

2008-04-01

The Critical dimension off-target (CDO) is a key parameter for mask house customer, affecting directly the performance of the mask. The CDO is the difference between the feature size target and the measured feature size. The change of CD during the process is either compensated within the process or by data correction. These compensation methods are commonly called process bias and data bias, respectively. The difference between data bias and process bias in manufacturing results in systematic CDO error, however, this systematic error does not take into account the instability of the process bias. This instability is a result of minor variations - instabilities of manufacturing processes and changes in materials and/or logistics. Using several masks the CDO of the manufacturing line can be estimated. For systematic investigation of the unit process contribution to CDO and analysis of the factors influencing the CDO contributors, a solid understanding of each unit process and huge number of masks is necessary. Rough identification of contributing processes and splitting of the final CDO variation between processes can be done with approx. 50 masks with identical design, material and process. Such amount of data allows us to identify the main contributors and estimate the effect of them by means of Analysis of variance (ANOVA) combined with multivariate analysis. The analysis does not provide information about the root cause of the variation within the particular unit process, however, it provides a good estimate of the impact of the process on the stability of the manufacturing line. Additionally this analysis can be used to identify possible interaction between processes, which cannot be investigated if only single processes are considered. Goal of this work is to evaluate limits for CDO budgeting models given by the precision and the number of measurements as well as partitioning the variation within the manufacturing process. The CDO variation splits according to the suggested model into contributions from particular processes or process groups. Last but not least the power of this method to determine the absolute strength of each parameter will be demonstrated. Identification of the root cause of this variation within the unit process itself is not scope of this work.

Economic evaluation of vaccines in Canada: A systematic review

PubMed Central

Chit, Ayman; Lee, Jason K. H.; Shim, Minsup; Nguyen, Van Hai; Grootendorst, Paul; Wu, Jianhong; Van Exan, Robert; Langley, Joanne M.

2016-01-01

ABSTRACT Background: Economic evaluations should form part of the basis for public health decision making on new vaccine programs. While Canada's national immunization advisory committee does not systematically include economic evaluations in immunization decision making, there is increasing interest in adopting them. We therefore sought to examine the extent and quality of economic evaluations of vaccines in Canada. Objective: We conducted a systematic review of economic evaluations of vaccines in Canada to determine and summarize: comprehensiveness across jurisdictions, studied vaccines, funding sources, study designs, research quality, and changes over time. Methods: Searches in multiple databases were conducted using the terms “vaccine,” “economics” and “Canada.” Descriptive data from eligible manuscripts was abstracted and three authors independently evaluated manuscript quality using a 7-point Likert-type scale scoring tool based on criteria from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Results: 42/175 articles met the search criteria. Of these, Canada-wide studies were most common (25/42), while provincial studies largely focused on the three populous provinces of Ontario, Quebec and British Columbia. The most common funding source was industry (17/42), followed by government (7/42). 38 studies used mathematical models estimating expected economic benefit while 4 studies examined post-hoc data on established programs. Studies covered 10 diseases, with 28/42 addressing pediatric vaccines. Many studies considered cost-utility (22/42) and the majority of these studies reported favorable economic results (16/22). The mean quality score was 5.9/7 and was consistent over publication date, funding sources, and disease areas. Conclusions: We observed diverse approaches to evaluate vaccine economics in Canada. Given the increased complexity of economic studies evaluating vaccines and the impact of results on public health practice, Canada needs improved, transparent and consistent processes to review and assess the findings of the economic evaluations of vaccines. PMID:26890128

The quality of instruments to assess the process of shared decision making: A systematic review

PubMed Central

Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

2018-01-01

Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of existing instruments, and the use of COSMIN-guidelines to help guarantee high-quality evaluations. PMID:29447193

Monitoring and Evaluating the Transition of Large-Scale Programs in Global Health

PubMed Central

Bao, James; Rodriguez, Daniela C; Paina, Ligia; Ozawa, Sachiko; Bennett, Sara

2015-01-01

Purpose: Donors are increasingly interested in the transition and sustainability of global health programs as priorities shift and external funding declines. Systematic and high-quality monitoring and evaluation (M&E) of such processes is rare. We propose a framework and related guiding questions to systematize the M&E of global health program transitions. Methods: We conducted stakeholder interviews, searched the peer-reviewed and gray literature, gathered feedback from key informants, and reflected on author experiences to build a framework on M&E of transition and to develop guiding questions. Findings: The conceptual framework models transition as a process spanning pre-transition and transition itself and extending into sustained services and outcomes. Key transition domains include leadership, financing, programming, and service delivery, and relevant activities that drive the transition in these domains forward include sustaining a supportive policy environment, creating financial sustainability, developing local stakeholder capacity, communicating to all stakeholders, and aligning programs. Ideally transition monitoring would begin prior to transition processes being implemented and continue for some time after transition has been completed. As no set of indicators will be applicable across all types of health program transitions, we instead propose guiding questions and illustrative quantitative and qualitative indicators to be considered and adapted based on the transition domains identified as most important to the particular health program transition. The M&E of transition faces new and unique challenges, requiring measuring constructs to which evaluators may not be accustomed. Many domains hinge on measuring “intangibles” such as the management of relationships. Monitoring these constructs may require a compromise between rigorous data collection and the involvement of key stakeholders. Conclusion: Monitoring and evaluating transitions in global health programs can bring conceptual clarity to the transition process, provide a mechanism for accountability, facilitate engagement with local stakeholders, and inform the management of transition through learning. Further investment and stronger methodological work are needed. PMID:26681706

Systematic comparisons between PRISM version 1.0.0, BAP, and CSMIP ground-motion processing

USGS Publications Warehouse

Kalkan, Erol; Stephens, Christopher

2017-02-23

A series of benchmark tests was run by comparing results of the Processing and Review Interface for Strong Motion data (PRISM) software version 1.0.0 to Basic Strong-Motion Accelerogram Processing Software (BAP; Converse and Brady, 1992), and to California Strong Motion Instrumentation Program (CSMIP) processing (Shakal and others, 2003, 2004). These tests were performed by using the MatLAB implementation of PRISM, which is equivalent to its public release version in Java language. Systematic comparisons were made in time and frequency domains of records processed in PRISM and BAP, and in CSMIP, by using a set of representative input motions with varying resolutions, frequency content, and amplitudes. Although the details of strong-motion records vary among the processing procedures, there are only minor differences among the waveforms for each component and within the frequency passband common to these procedures. A comprehensive statistical evaluation considering more than 1,800 ground-motion components demonstrates that differences in peak amplitudes of acceleration, velocity, and displacement time series obtained from PRISM and CSMIP processing are equal to or less than 4 percent for 99 percent of the data, and equal to or less than 2 percent for 96 percent of the data. Other statistical measures, including the Euclidian distance (L2 norm) and the windowed root mean square level of processed time series, also indicate that both processing schemes produce statistically similar products.

Evaluating Harms in the Assessment of Net Benefit: A Framework for Newborn Screening Condition Review

PubMed Central

Goldenberg, Aaron J.; Comeau, Anne Marie; Grosse, Scott D.; Tanksley, Susan; Prosser, Lisa A.; Ojodu, Jelili; Botkin, Jeffrey R.; Kemper, Alex R.; Green, Nancy S.

2016-01-01

Background The Department of Health and Human Services (HHS) Advisory Committee on Heritable Disorders in Newborns and Children (“Advisory Committee”) makes recommendations to the HHS Secretary regarding addition of new conditions to the national Recommended Uniform Screening Panel for newborns. The Advisory Committee’s decision-making process includes assessing the net benefit of screening for nominated conditions, informed by systematic evidence reviews generated by an independent Condition Review Workgroup. The evidence base regarding harms associated with screening for specific conditions is often more limited than that for benefits. Procedures The process for defining potential harms from newborn screening reviewed the frameworks from other public health evidence-based review processes, adapted to newborn screening by experts in systematic review, newborn screening programs and bioethics, with input from and approval by the Advisory Committee. Main findings To support the Advisory Committee’s review of nominated conditions, the Workgroup has developed a standardized approach to evaluation of harms and relevant gaps in the evidence. Types of harms include the physical burden to infants; psychosocial and logistic burdens to families from screening or diagnostic evaluation; increased risk of medical treatment for infants diagnosed earlier than children with clinical presentation; delayed diagnosis from false negative results; psychosocial harm from false positive results; uncertainty of clinical diagnosis, age of onset or clinical spectrum; and disparities in access to diagnosis or therapy. Conclusions Estimating the numbers of children at risk, the magnitude, timing and likelihood of harms will be integrated into Workgroup reports to the Advisory Committee. PMID:26833040

Development of a theory- and evidence-based intervention to enhance implementation of physical therapy guidelines for the management of low back pain

PubMed Central

2014-01-01

Background Systematic planning could improve the generally moderate effectiveness of interventions to enhance adherence to clinical practice guidelines. The aim of our study was to demonstrate how the process of Intervention Mapping was used to develop an intervention to address the lack of adherence to the national CPG for low back pain by Dutch physical therapists. Methods We systematically developed a program to improve adherence to the Dutch physical therapy guidelines for low back pain. Based on multi-method formative research, we formulated program and change objectives. Selected theory-based methods of change and practical applications were combined into an intervention program. Implementation and evaluation plans were developed. Results Formative research revealed influential determinants for physical therapists and practice quality managers. Self-regulation was appropriate because both the physical therapists and the practice managers needed to monitor current practice and make and implement plans for change. The program stimulated interaction between practice levels by emphasizing collective goal setting. It combined practical applications, such as knowledge transfer and discussion-and-feedback, based on theory-based methods, such as consciousness raising and active learning. The implementation plan incorporated the wider environment. The evaluation plan included an effect and process evaluation. Conclusions Intervention Mapping is a useful framework for formative data in program planning in the field of clinical guideline implementation. However, a decision aid to select determinants of guideline adherence identified in the formative research to analyse the problem may increase the efficiency of the application of the Intervention Mapping process. PMID:24428945

Development of a theory- and evidence-based intervention to enhance implementation of physical therapy guidelines for the management of low back pain.

PubMed

Rutten, Geert M; Harting, Janneke; Bartholomew, Leona K; Braspenning, Jozé C; van Dolder, Rob; Heijmans, Marcel Fgj; Hendriks, Erik Jm; Kremers, Stef Pj; van Peppen, Roland Ps; Rutten, Steven Tj; Schlief, Angelique; de Vries, Nanne K; Oostendorp, Rob Ab

2014-01-15

Systematic planning could improve the generally moderate effectiveness of interventions to enhance adherence to clinical practice guidelines. The aim of our study was to demonstrate how the process of Intervention Mapping was used to develop an intervention to address the lack of adherence to the national CPG for low back pain by Dutch physical therapists. We systematically developed a program to improve adherence to the Dutch physical therapy guidelines for low back pain. Based on multi-method formative research, we formulated program and change objectives. Selected theory-based methods of change and practical applications were combined into an intervention program. Implementation and evaluation plans were developed. Formative research revealed influential determinants for physical therapists and practice quality managers. Self-regulation was appropriate because both the physical therapists and the practice managers needed to monitor current practice and make and implement plans for change. The program stimulated interaction between practice levels by emphasizing collective goal setting. It combined practical applications, such as knowledge transfer and discussion-and-feedback, based on theory-based methods, such as consciousness raising and active learning. The implementation plan incorporated the wider environment. The evaluation plan included an effect and process evaluation. Intervention Mapping is a useful framework for formative data in program planning in the field of clinical guideline implementation. However, a decision aid to select determinants of guideline adherence identified in the formative research to analyse the problem may increase the efficiency of the application of the Intervention Mapping process.

Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review.

PubMed

Williams, Nefyn H; Hendry, Maggie; France, Barbara; Lewis, Ruth; Wilkinson, Clare

2007-12-01

Despite the health benefits of physical activity, most adults do not take the recommended amount of exercise. To assess whether exercise-referral schemes are effective in improving exercise participation in sedentary adults. Systematic review. Studies were identified by searching MEDLINE, CINAHL, EMBASE, AMED, PsycINFO, SPORTDiscus, The Cochrane Library and SIGLE until March 2007. Randomised controlled trials (RCTs), observational studies, process evaluations and qualitative studies of exercise-referral schemes, defined as referral by a primary care clinician to a programme that encouraged physical activity or exercise were included. RCT results were combined in a meta-analysis where there was sufficient homogeneity. Eighteen studies were included in the review. These comprised six RCTs, one non-randomised controlled study, four observational studies, six process evaluations and one qualitative study. In addition, two of the RCTs and two of the process evaluations incorporated a qualitative component. Results from five RCTs were combined in a meta-analysis. There was a statistically significant increase in the numbers of participants doing moderate exercise with a combined relative risk of 1.20 (95% confidence intervals = 1.06 to 1.35). This means that 17 sedentary adults would need to be referred for one to become moderately active. This small effect may be at least partly due to poor rates of uptake and adherence to the exercise schemes. Exercise-referral schemes have a small effect on increasing physical activity in sedentary people. The key challenge, if future exercise-referral schemes are to be commissioned by the NHS, is to increase uptake and improve adherence by addressing the barriers described in these studies.

Measuring research influence on drug policy: a case example of two epidemiological monitoring systems.

PubMed

Ritter, Alison; Lancaster, Kari

2013-01-01

Assessing the extent to which drug research influences and impacts upon policy decision-making needs to go beyond bibliometric analysis of academic citations. Policy makers do not necessarily access the academic literature, and policy processes are largely iterative and rely on interactions and relationships. Furthermore, media representation of research contributes to public opinion and can influence policy uptake. In this context, assessing research influence involves examining the extent to which a research project is taken up in policy documents, used within policy processes, and disseminated via the media. This three component approach is demonstrated using a case example of two ongoing illicit drug monitoring systems: the Illicit Drug Reporting System (IDRS) and the Ecstasy and related Drugs Reporting System (EDRS). Systematic searches for reference to the IDRS and/or EDRS within policy documents, across multiple policy processes (such as parliamentary inquiries) and in the media, in conjunction with analysis of the types of mentions in these three sources, enables an analysis of policy influence. The context for the research is also described as the foundation for the approach. The application of the three component approach to the case study demonstrates a practical and systematic retrospective approach to measure drug research influence. For example, the ways in which the IDRS and EDRS were mentioned in policy documents demonstrated research utilisation. Policy processes were inclusive of IDRS and EDRS findings, while the media analysis revealed only a small contribution in the context of wider media reporting. Consistent with theories of policy processes, assessing the extent of research influence requires a systematic analysis of policy documents and processes. Development of such analyses and associated methods will better equip researchers to evaluate the impact of research. Copyright © 2012 Elsevier B.V. All rights reserved.

Identification and verification of critical performance dimensions. Phase 1 of the systematic process redesign of drug distribution.

PubMed

Colen, Hadewig B; Neef, Cees; Schuring, Roel W

2003-06-01

Worldwide patient safety has become a major social policy problem for healthcare organisations. As in other organisations, the patients in our hospital also suffer from an inadequate distribution process, as becomes clear from incident reports involving medication errors. Medisch Spectrum Twente is a top primary-care, clinical, teaching hospital. The hospital pharmacy takes care of 1070 internal beds and 1120 beds in an affiliated psychiatric hospital and nursing homes. In the beginning of 1999, our pharmacy group started a large interdisciplinary research project to develop a safe, effective and efficient drug distribution system by using systematic process redesign. The process redesign includes both organisational and technological components. This article describes the identification and verification of critical performance dimensions for the design of drug distribution processes in hospitals (phase 1 of the systematic process redesign of drug distribution). Based on reported errors and related causes, we suggested six generic performance domains. To assess the role of the performance dimensions, we used three approaches: flowcharts, interviews with stakeholders and review of the existing performance using time studies and medication error studies. We were able to set targets for costs, quality of information, responsiveness, employee satisfaction, and degree of innovation. We still have to establish what drug distribution system, in respect of quality and cost-effectiveness, represents the best and most cost-effective way of preventing medication errors. We intend to develop an evaluation model, using the critical performance dimensions as a starting point. This model can be used as a simulation template to compare different drug distribution concepts in order to define the differences in quality and cost-effectiveness.

Measuring treatment outcomes in gambling disorders: a systematic review.

PubMed

Pickering, Dylan; Keen, Brittany; Entwistle, Gavin; Blaszczynski, Alex

2018-03-01

Considerable variation of outcome variables used to measure recovery in the gambling treatment literature has precluded effective cross-study evaluations and hindered the development of best-practice treatment methodologies. The aim of this systematic review was to describe current diffuse concepts of recovery in the gambling field by mapping the range of outcomes and measurement strategies used to evaluate treatments, and to identify more commonly accepted indices of recovery. A systematic search of six academic databases for studies evaluating treatments (psychological and pharmacological) for gambling disorders with a minimum 6-month follow-up. Data from eligible studies were tabulated and analysis conducted using a narrative approach. Guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Thirty-four studies were reviewed systematically (RCTs = 17, comparative designs = 17). Sixty-three different outcome measures were identified: 25 (39.7%) assessed gambling-specific constructs, 36 (57.1%) assessed non-gambling specific constructs, and two instruments were used across both categories (3.2%). Self-report instruments ranged from psychometrically validated to ad-hoc author-designed questionnaires. Units of measurement were inconsistent, particularly in the assessment of gambling behaviour. All studies assessed indices of gambling behaviour and/or symptoms of gambling disorder. Almost all studies (n = 30; 88.2%) included secondary measures relating to psychiatric comorbidities, psychological processes linked to treatment approach, or global functioning and wellbeing. In research on gambling disorders, the incorporation of broader outcome domains that extend beyond disorder-specific symptoms and behaviours suggests a multi-dimensional conceptualization of recovery. Development of a single comprehensive scale to measure all aspects of gambling recovery could help to facilitate uniform reporting practices across the field. © 2017 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of Addiction.

Registration factors that limit international mobility of people holding physiotherapy qualifications: A systematic review.

PubMed

Foo, Jonathan S; Storr, Michael; Maloney, Stephen

2016-06-01

There is no enforced international standardisation of the physiotherapy profession. Thus, registration is used in many countries to maintain standards of care and to protect the public. However, registration may also limit international workforce mobility. What is known about the professional registration factors that may limit the international mobility of people holding physiotherapy qualifications? Systematic review using an electronic database search and hand searching of the World Confederation for Physical Therapy and International Network of Physiotherapy Regulatory Authorities websites. Analysis was conducted using thematic analysis. 10 articles and eight websites were included from the search strategy. Data is representative of high-income English speaking countries. Four themes emerged regarding limitations to professional mobility: practice context, qualification recognition, verification of fitness to practice, and incidental limitations arising from the registration process. Professional mobility is limited by differences in physiotherapy education programmes, resulting in varying standards of competency. Thus, it is often necessary to verify clinical competencies through assessments, as well as determining professional attributes and ability to apply competencies in a different practice context, as part of the registration process. There has been little evaluation of registration practices, and at present, there is a need to re-evaluate current registration processes to ensure they are efficient and effective, thereby enhancing workforce mobility. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluation of Item Candidates: The PROMIS Qualitative Item Review

PubMed Central

DeWalt, Darren A.; Rothrock, Nan; Yount, Susan; Stone, Arthur A.

2009-01-01

One of the PROMIS (Patient-Reported Outcome Measurement Information System) network's primary goals is the development of a comprehensive item bank for patient-reported outcomes of chronic diseases. For its first set of item banks, PROMIS chose to focus on pain, fatigue, emotional distress, physical function, and social function. An essential step for the development of an item pool is the identification, evaluation, and revision of extant questionnaire items for the core item pool. In this work, we also describe the systematic process wherein items are classified for subsequent statistical processing by the PROMIS investigators. Six phases of item development are documented: identification of extant items, item classification and selection, item review and revision, focus group input on domain coverage, cognitive interviews with individual items, and final revision before field testing. Identification of items refers to the systematic search for existing items in currently available scales. Expert item review and revision was conducted by trained professionals who reviewed the wording of each item and revised as appropriate for conventions adopted by the PROMIS network. Focus groups were used to confirm domain definitions and to identify new areas of item development for future PROMIS item banks. Cognitive interviews were used to examine individual items. Items successfully screened through this process were sent to field testing and will be subjected to innovative scale construction procedures. PMID:17443114

Deep Boreholes Seals Subjected to High P, T conditions – Preliminary Experimental Studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Caporuscio, Florie Andre; Norskog, Katherine Elizabeth; Maner, James Lavada

The objective of this planned experimental work is to evaluate physio-chemical processes for ‘seal’ components and materials relevant to deep borehole disposal. These evaluations will encompass multi-laboratory efforts for the development of seals concepts and application of Thermal-Mechanical-Chemical (TMC) modeling work to assess barrier material interactions with subsurface fluids, their stability at high temperatures, and the implications of these processes to the evaluation of thermal limits. Deep borehole experimental work will constrain the Pressure, Temperature (P, T) conditions which “seal” material will experience in deep borehole crystalline rock repositories. The rocks of interest to this study include the silicic (graniticmore » gneiss) end members. The experiments will systematically add components to capture discrete changes in both water and EBS component chemistries.« less

Treatment decision-making in chronic diseases: What are the family members' roles, needs and attitudes? A systematic review.

PubMed

Lamore, Kristopher; Montalescot, Lucile; Untas, Aurélie

2017-12-01

This systematic review aims to examine the roles of family members (FMs) in treatment decision-making for adult patients without cognitive or psychiatric disorders affecting their ability to participate in decision-making. A comprehensive, systematic search of the Cochrane Library, PsycINFO, PubMed and ScienceDirect databases, with relevant keywords, was conducted. Two authors evaluated the eligibility of the studies independently, then cross-checked for accuracy. The quality of included studies were assessed using standardized criteria. Out of the 12.137 studies identified, 40 were included. Results highlighted the different roles and influences FMs have in the decision-making process. Moreover, several factors ranging from personal to cultural and family-related factors influence their level of involvement. Regardless of the illness, some similarities in family influence exist (e.g., social support). However, the type of family involvement varies according to the illness, the treatment choice and the patients' culture. FMs have an important role in the decision-making process. In fact, the final decision is often made by the patients after consulting their families. FMs can support both patients and medical teams, and thus facilitate the process. Physicians should include FMs in treatment decision-making when the patients and their FMs wish to be included. Copyright © 2017 Elsevier B.V. All rights reserved.

Rational decision-making in mental health: the role of systematic reviews.

PubMed

Gilbody, Simon M.; Petticrew, Mark

1999-09-01

BACKGROUND: "Systematic reviews" have come to be recognized as the most rigorous method of summarizing confusing and often contradictory primary research in a transparent and reproducible manner. Their greatest impact has been in the summarization of epidemiological literature - particularly that relating to clinical effectiveness. Systematic reviews also have a potential to inform rational decision-making in healthcare policy and to form a component of economic evaluation. AIMS OF THE STUDY: This article aims to introduce the rationale behind systematic reviews and, using examples from mental health, to introduce the strengths and limitations of systematic reviews, particularly in informing mental health policy and economic evaluation. METHODS: Examples are selected from recent controversies surrounding the introduction of new psychiatric drugs (anti-depressants and anti-schizophrenia drugs) and methods of delivering psychiatric care in the community (case management and assertive community treatment). The potential for systematic reviews to (i) produce best estimates of clinical efficacy and effectiveness, (ii) aid economic evaluation and policy decision-making and (iii) highlight gaps in the primary research knowledge base are discussed. Lastly examples are selected from outside mental health to show how systematic reviews have a potential to be explicitly used in economic and health policy evaluation. RESULTS: Systematic reviews produce the best estimates of clinical efficacy, which can form an important component of economic evaluation. Importantly, serious methodological flaws and areas of uncertainty in the primary research literature are identified within an explicit framework. Summary indices of clinical effectiveness can be produced, but it is difficult to produce such summary indices of cost effectiveness by pooling economic data from primary studies. Modelling is commonly used in economic and policy evaluation. Here, systematic reviews can provide the best estimates of effectiveness and, importantly, highlight areas of uncertainty that can be used in "sensitivity analysis". DISCUSSION: Systematic reviews are an important recent methodological advance, the potential for which has only begun to be realized in mental health. This use of systematic reviews is probably most advanced in producing critical summaries of clinical effectiveness data. Systematic reviews cannot produce valid and believable conclusions when the primary research literature is of poor quality. An important function of systematic reviews will be in highlighting this poor quality research which is of little use in mental health decision making. IMPLICATIONS FOR HEALTH PROVISION: Health care provision should be both clinically and cost effective. Systematic reviews are a key component in ensuring that this goal is achieved. IMPLICATIONS FOR HEALTH POLICIES: Systematic reviews have potential to inform health policy. Examples presented show that health policy is often made without due consideration of the research evidence. Systematic reviews can provide robust and believable answers, which can help inform rational decision-making. Importantly, systematic reviews can highlight the need for important primary research and can inform the design of this research such that it provides answers that will help in forming healthcare policy. IMPLICATIONS FOR FURTHER RESEARCH: Systematic reviews should precede costly (and often unnecessary) primary research. Many areas of health policy and practice have yet to be evaluated using systematic review methodology. Methods for the summarization of economic data are methodologically complex and deserve further research

Addressing equity in interventions to reduce air pollution in urban areas: a systematic review.

PubMed

Benmarhnia, Tarik; Rey, Lynda; Cartier, Yuri; Clary, Christelle M; Deguen, Séverine; Brousselle, Astrid

2014-12-01

We did a systematic review to assess quantitative studies investigating the association between interventions aiming to reduce air pollution, health benefits and equity effects. Three databases were searched for studies investigating the association between evaluated interventions aiming to reduce air pollution and heath-related benefits. We designed a two-stage selection process to judge how equity was assessed and we systematically determined if there was a heterogeneous effect of the intervention between subgroups or subareas. Of 145 identified articles, 54 were reviewed in-depth with eight satisfying the inclusion criteria. This systematic review showed that interventions aiming to reduce air pollution in urban areas have a positive impact on air quality and on mortality rates, but the documented effect on equity is less straightforward. Integration of equity in evidence-based public health is a great challenge nowadays. In this review we draw attention to the importance of considering equity in air pollution interventions. We also propose further methodological and theoretical challenges when assessing equity in interventions to reduce air pollution and we present opportunities to develop this research area.

Variation across mitochondrial gene trees provides evidence for systematic error: How much gene tree variation is biological?

PubMed

Richards, Emilie J; Brown, Jeremy M; Barley, Anthony J; Chong, Rebecca A; Thomson, Robert C

2018-02-19

The use of large genomic datasets in phylogenetics has highlighted extensive topological variation across genes. Much of this discordance is assumed to result from biological processes. However, variation among gene trees can also be a consequence of systematic error driven by poor model fit, and the relative importance of biological versus methodological factors in explaining gene tree variation is a major unresolved question. Using mitochondrial genomes to control for biological causes of gene tree variation, we estimate the extent of gene tree discordance driven by systematic error and employ posterior prediction to highlight the role of model fit in producing this discordance. We find that the amount of discordance among mitochondrial gene trees is similar to the amount of discordance found in other studies that assume only biological causes of variation. This similarity suggests that the role of systematic error in generating gene tree variation is underappreciated and critical evaluation of fit between assumed models and the data used for inference is important for the resolution of unresolved phylogenetic questions.

Selecting at-risk populations for sexually transmitted disease/HIV intervention studies.

PubMed

Wu, Zunyou; Rotheram-Borus, Mary Jane; Detels, Roger; Li, Li; Guan, Jihui; Liang, Guojun; Yap, Lorraine

2007-12-01

This paper describes one option to select populations for randomized, controlled trials (RCT). We used a popular opinion leader intervention in Fuzhou, China, to: (1) identify population selection criteria; (2) systematically examine the suitability of potential target populations and settings; (3) briefly evaluate risk and stability in the population; and (4) evaluate regional and organizational support among administrators and government officials. After comparing migrant villagers, truck drivers, factory workers, construction workers, and market employees in five regions of China, market employees in Fuzhou were identified as the optimal target population. Markets were the optimal sites for several reasons: (1) the population demonstrated a sufficient base rate of sexually transmitted diseases; (2) the population was stable over time; (3) a sufficient number of sites of manageable sizes were available; (4) stable networks existed; (5) local gatekeepers/stakeholders supported the intervention; (6) there was organizational capacity in the local health department to mount the intervention; (7) the demographic profile was similar across potential sites; and (8) the sites were sufficiently distanced to minimize contamination. Evaluating intervention efficacy in an RCT requires a time-consuming and rigorous process that systematically and routinely documents selection criteria, evaluates multiple populations, sites, and organizations for their appropriateness.

Continuous Evaluation in Ethics Education: A Case Study.

PubMed

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Muhlheim, M.D.; Belles, R.J.; Cletcher, J.W.

The Accident Sequence Precursor (ASP) Program involves the systematic review and evaluation of operational events that have occurred at light-water reactors to identify and categorize precursors to potential severe core damage accident sequences. The results of the ASP Program are published in an annual report. The most recent report, which contains the precursors for 1995, is NUREG/CR-4674, Volume 23, Precursors to Potential Severe Core Damage Accidents: 1995, A Status Report, published in April 1997. This article provides an overview of the ASP review and evaluation process and a summary of the results for 1995.

The economics of medicines optimization: policy developments, remaining challenges and research priorities

PubMed Central

Faria, Rita; Barbieri, Marco; Light, Kate; Elliott, Rachel A.; Sculpher, Mark

2014-01-01

Background This review scopes the evidence on the effectiveness and cost-effectiveness of interventions to improve suboptimal use of medicines in order to determine the evidence gaps and help inform research priorities. Sources of data Systematic searches of the National Health Service (NHS) Economic Evaluation Database, the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects. Areas of agreement The majority of the studies evaluated interventions to improve adherence, inappropriate prescribing and prescribing errors. Areas of controversy Interventions tend to be specific to a particular stage of the pathway and/or to a particular disease and have mostly been evaluated for their effect on intermediate or process outcomes. Growing points Medicines optimization offers an opportunity to improve health outcomes and efficiency of healthcare. Areas timely for developing research The available evidence is insufficient to assess the effectiveness and cost-effectiveness of interventions to address suboptimal medicine use in the UK NHS. Decision modelling, evidence synthesis and elicitation have the potential to address the evidence gaps and help prioritize research. PMID:25190760

'Keep fit' exercise interventions to improve health, fitness and well-being of children and young people who use wheelchairs: mixed-method systematic review protocol.

PubMed

O'Brien, Thomas D; Noyes, Jane; Spencer, Llinos Haf; Kubis, Hans-Peter; Hastings, Richard P; Edwards, Rhiannon T; Bray, Nathan; Whitaker, Rhiannon

2014-12-01

This mixed-method systematic review aims to establish the current evidence base for 'keep fit', exercise or physical activity interventions for children and young people who use wheelchairs. Nurses have a vital health promotion, motivational and monitoring role in optimizing the health and well-being of disabled children. Children with mobility impairments are prone to have low participation levels in physical activity, which reduces fitness and well-being. Effective physical activity interventions that are fun and engaging for children are required to promote habitual participation as part of a healthy lifestyle. Previous intervention programmes have been trialled, but little is known about the most effective types of exercise to improve the fitness of young wheelchair users. Mixed-method design using Cochrane systematic processes. Evidence regarding physiological and psychological effectiveness, health economics, user perspectives and service evaluations will be included and analysed under distinct streams. The project was funded from October 2012. Multiple databases will be searched using search strings combining relevant medical subheadings and intervention-specific terms. Articles will also be identified from ancestral references and by approaching authors to identify unpublished work. Only studies or reports evaluating the effectiveness, participation experiences or cost of a physical activity programme will be included. Separate analyses will be performed for each data stream, including a meta-analysis if sufficient homogeneity exists and thematic analyses. Findings across streams will be synthesized in an overarching narrative summary. Evidence from the first systematic review of this type will inform development of effective child-centred physical activity interventions and their evaluation. © 2014 John Wiley & Sons Ltd.

Memory effects of sedative drugs in children and adolescents--protocol for a systematic review.

PubMed

Viana, Karolline A; Daher, Anelise; Maia, Lucianne C; Costa, Paulo S; Martins, Carolina C; Paiva, Saul M; Costa, Luciane R

2016-02-18

Some sedatives used in children and adolescents can affect memory function. Memory impairment of traumatic experience can minimize the chance of future psychological trauma. Knowledge about the potential of different sedatives to produce amnesia can help in the decision-making process of choosing a sedative regimen. The aim of this systematic review is to evaluate the effect of different sedatives on memory of perioperative events in children and adolescents. Electronic databases and other sources, such as trial registers, gray literature, and conference abstracts will be searched. Randomized controlled trials will be included that assess memory of perioperative events in children and adolescents 2-19 years old receiving sedative drugs as premedication or as agents for procedural sedation in a medical or dental settings. The outcomes will be loss of memory after and before sedative administration (anterograde and retrograde amnesia). Two independent reviewers will perform screening, study selection, and data extraction. Disagreement at all levels will be resolved by consensus or by involving a third reviewer. Assessment of the risk of bias of included studies will be performed according to "Cochrane Collaboration's Tool for Assessing Risk of Bias in Randomized Trials." Clinical and methodological heterogeneity across studies will be evaluated to determine if it is possible to combine or not combine study results in a meta-analysis. To the best of our knowledge, there is no systematic review that specifically addresses this question. Findings from the review will be useful in the decision-making process about the best sedative for minimizing recall of the medical/dental event and possible psychological trauma. PROSPERO CRD42015017559.

Measurement properties of rheumatoid arthritis-specific quality-of-life questionnaires: systematic review of the literature.

PubMed

Lee, Jiyeon; Kim, Soo Hyun; Moon, Seung Hei; Lee, Eun-Hyun

2014-12-01

This study conducted a systematic review of the methodological quality of the psychometric evaluation process and the quality of measurement properties of rheumatoid arthritis (RA)-specific health-related quality-of-life (HRQOL) questionnaires with the purpose of obtaining the best evidence to help in the selection of the most appropriate instrument for measuring HRQOL in RA patients. A systematic literature search was performed to identify RA-specific HRQOL questionnaires in databases. The methodological quality of the studies was assessed using the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. The quality of the measurement properties was assessed using quality criteria. The evidence regarding the measurement properties was pooled using best-evidence synthesis, with considerations of the number and methodological quality of the studies, and the consistency of their findings in terms of the quality of the measurement properties. The search identified 37 studies describing 9 instruments. Best-evidence synthesis suggested that the Rheumatoid Arthritis Quality of Life (RAQoL) questionnaire had the strongest positive evidence, especially with respect to reliability, measurement error, and content validity, and moderate positive evidence with respect to hypothesis testing and responsiveness. The current evidence suggests that the best-validated instrument among the RA-specific HRQOL measures is the RAQoL questionnaire in terms of both methodological quality in the process of psychometric evaluation and the quality of the measurement properties. However, there is limited evidence regarding internal consistency and structural validity of the RAQoL. Further efforts are warranted to establish the psychometric quality of this questionnaire.

Canadian Association of Gastroenterology consensus guidelines on safety and quality indicators in endoscopy

PubMed Central

Armstrong, David; Barkun, Alan; Bridges, Ron; Carter, Rose; de Gara, Chris; Dubé, Catherine; Enns, Robert; Hollingworth, Roger; MacIntosh, Donald; Borgaonkar, Mark; Forget, Sylviane; Leontiadis, Grigorios; Meddings, Jonathan; Cotton, Peter; Kuipers, Ernst J; Valori, Roland

2012-01-01

BACKGROUND: Increasing use of gastrointestinal endoscopy, particularly for colorectal cancer screening, and increasing emphasis on health care quality, highlight the need for clearly defined, evidence-based processes to support quality improvement in endoscopy. OBJECTIVE: To identify processes and indicators of quality and safety relevant to high-quality endoscopy service delivery. METHODS: A multidisciplinary group of 35 voting participants developed recommendation statements and performance indicators. Systematic literature searches generated 50 initial statements that were revised iteratively following a modified Delphi approach using a web-based evaluation and voting tool. Statement development and evidence evaluation followed the AGREE (Appraisal of Guidelines, REsearch and Evaluation) and GRADE (Grading of Recommendations, Assessment, Development and Evaluation) guidelines. At the consensus conference, participants voted anonymously on all statements using a 6-point scale. Subsequent web-based voting evaluated recommendations for specific, individual quality indicators, safety indicators and mandatory endoscopy reporting fields. Consensus was defined a priori as agreement by 80% of participants. RESULTS: Consensus was reached on 23 recommendation statements addressing the following: ethics (statement 1: agreement 100%), facility standards and policies (statements 2 to 9: 90% to 100%), quality assurance (statements 10 to 13: 94% to 100%), training, education, competency and privileges (statements 14 to 19: 97% to 100%), endoscopy reporting standards (statements 20 and 21: 97% to 100%) and patient perceptions (statements 22 and 23: 100%). Additionally, 18 quality indicators (agreement 83% to 100%), 20 safety indicators (agreement 77% to 100%) and 23 recommended endoscopy-reporting elements (agreement 91% to 100%) were identified. DISCUSSION: The consensus process identified a clear need for high-quality clinical and outcomes research to support quality improvement in the delivery of endoscopy services. CONCLUSIONS: The guidelines support quality improvement in endoscopy by providing explicit recommendations on systematic monitoring, assessment and modification of endoscopy service delivery to yield benefits for all patients affected by the practice of gastrointestinal endoscopy. PMID:22308578

Optimization of Surfactant Mixtures and Their Interfacial Behavior for Advanced Oil Recovery

DOE Office of Scientific and Technical Information (OSTI.GOV)

Somasundaran, Prof. P.

2002-03-04

The objective of this project was to develop a knowledge base that is helpful for the design of improved processes for mobilizing and producing oil left untapped using conventional techniques. The main goal was to develop and evaluate mixtures of new or modified surfactants for improved oil recovery. In this regard, interfacial properties of novel biodegradable n-alkyl pyrrolidones and sugar-based surfactants have been studied systematically. Emphasis was on designing cost-effective processes compatible with existing conditions and operations in addition to ensuring minimal reagent loss.

Preoperative evaluation in infants and children: recommendations of the Italian Society of Pediatric and Neonatal Anesthesia and Intensive Care (SARNePI).

PubMed

Serafini, G; Ingelmo, P M; Astuto, M; Baroncini, S; Borrometi, F; Bortone, L; Ceschin, C; Gentili, A; Lampugnani, E; Mangia, G; Meneghini, L; Minardi, C; Montobbio, G; Pinzoni, F; Rosina, B; Rossi, C; Sahillioğlu, E; Sammartino, M; Sonzogni, R; Sonzogni, V; Tesoro, S; Tognon, C; Zadra, N

2014-04-01

The preoperative assessment involves the process of evaluating the patient's clinical condition, which is intended to define the physical status classification, eligibility for anesthesia and the risks associated with it, thus providing elements to select the most appropriate and individualized anesthetic plan. The aim of this recommendation was provide a framework reference for the preoperative evaluation assessment of pediatric patients undergoing elective surgery or diagnostic/therapeutic procedures. We obtained evidence concerning pediatric preoperative evaluation from a systematic search of the electronic databases MEDLINE and Embase between January 1998 and February 2012. We used the format developed by the Italian Center for Evaluation of the Effectiveness of Health Care's scoring system for assessing the level of evidence and strength of recommendations. We produce a set of consensus guidelines on the preoperative assessment and on the request for preoperative tests. A review of the existing literature supporting these recommendations is provided. In reaching consensus, emphasis was placed on the level of evidence, clinical relevance and the risk/benefit ratio. Preoperative evaluation is mandatory before any diagnostic or therapeutic procedure that requires the use of anesthesia or sedation. The systematic prescription of complementary tests in children should be abandoned, and replaced by a selective and rational prescription, based on the patient history and clinical examination performed during the preoperative evaluation.

Consistent Chemical Mechanism from Collaborative Data Processing

DOE PAGES

Slavinskaya, Nadezda; Starcke, Jan-Hendrik; Abbasi, Mehdi; ...

2016-04-01

Numerical tool of Process Informatics Model (PrIMe) is mathematically rigorous and numerically efficient approach for analysis and optimization of chemical systems. It handles heterogeneous data and is scalable to a large number of parameters. The Boundto-Bound Data Collaboration module of the automated data-centric infrastructure of PrIMe was used for the systematic uncertainty and data consistency analyses of the H 2/CO reaction model (73/17) and 94 experimental targets (ignition delay times). The empirical rule for evaluation of the shock tube experimental data is proposed. The initial results demonstrate clear benefits of the PrIMe methods for an evaluation of the kinetic datamore » quality and data consistency and for developing predictive kinetic models.« less

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pritychenko, B.; Mughabghab, S.F.

We present calculations of neutron thermal cross sections, Westcott factors, resonance integrals, Maxwellian-averaged cross sections and astrophysical reaction rates for 843 ENDF materials using data from the major evaluated nuclear libraries and European activation file. Extensive analysis of newly-evaluated neutron reaction cross sections, neutron covariances, and improvements in data processing techniques motivated us to calculate nuclear industry and neutron physics quantities, produce s-process Maxwellian-averaged cross sections and astrophysical reaction rates, systematically calculate uncertainties, and provide additional insights on currently available neutron-induced reaction data. Nuclear reaction calculations are discussed and new results are presented. Due to space limitations, the present papermore » contains only calculated Maxwellian-averaged cross sections and their uncertainties. The complete data sets for all results are published in the Brookhaven National Laboratory report.« less

Systematic Evaluation and Uncertainty Analysis of the Refuse-Derived Fuel Process in Taiwan.

PubMed

Chang, Ying-Hsi; Chang, Ni-Bin; Chen, W C

1998-06-01

In the last few years, Taiwan has set a bold agenda in solid waste recycling and incineration programs. Not only were the recycling activities and incineration projects promoted by government agencies, but the related laws and regulations were continuously promulgated by the Legislative Yen. The solid waste presorting process that is to be considered prior to the existing incineration facilities has received wide attention. This paper illustrates a thorough evaluation for the first refuse-derived fuel pilot process from both quantitative and qualitative aspects. The process is to be installed and integrated with a large-scale municipal incinerator. This pilot process, developed by an engineering firm in Tainan County, consists of standard unit operations of shredding, magnetic separation, trommel screening, and air classification. A series of sampling and analyses were initialized in order to characterize its potentials in the solid waste management system. The probabilistic modeling for various types o f waste pro perties derived in this analysis may provide a basic understanding of system reliability.

Analysis of Business Process at PT XYZ by Using SCOR Thread Diagram

NASA Astrophysics Data System (ADS)

Sembiring, M. T.; Rambe, H. C.

2017-03-01

Supply Chain Operations Reference (SCOR) is a standard supply chain performance evaluation model which is proposed by Supply Chain Council (SCC). SCOR makes companies can analyse and evaluate their supply chain performance. SCOR has Thread Diagram which describes business process simply and systematically to help the analysis of company’s business process. This research takes place in PT XYZ that is involved in Crude Palm Oil (CPO) industry. PT XYZ used to be the market leader of CPO industry but nowadays they have a trouble to compete with new competitors. The purpose of this study is to provide the input for PT XYZ business process improvement to enhance the competitiveness of the company with the others. The result obtained shows that there are two performance metrics that are not reached. The analysis of business process shows the lack of control role of PT XYZ to supplier and customer side which is going to be the suggestion of improvement.

''Are Chemistry Educational Apps Useful?''--A Quantitative Study with Three In-House Apps

ERIC Educational Resources Information Center

Ping, Grace Lee Yuan; Lok, Chang; Yeat, Tan Wei; Cherynn, Tan Jie Ying; Tan, Emelyn Sue Qing

2018-01-01

Three internally developed mobile apps, "3D Sym Op", "SM2 Chem" and "ARMolVis," available for free on both the Apple App Store and Google Play Store were evaluated in seven studies. Each study was a systematic process of Pre-Test, In-lecture App Demo, App Assisted Interactive Tutorials (AAITs) and/or Independent App…

Interhemispheric comparison of atmospheric circulation features as evaluated from Nimbus satellite data

NASA Technical Reports Server (NTRS)

Reiter, E. R.; Vonderhaar, T. H.; Lovill, J. E.; Adler, R.; Srivatsangam, S.; Fields, A.

1972-01-01

The report includes a complete analyses of O3 data inferred from Nimbus-3 measurements, a discussion of future areas of study, description of the regression and inversion methods developed to infer atmospheric temperature and tropopause characteristics, as well as the plan to process the satellite data for a systematic study of the relative circulation differences between Northern and Southern Hemispheres.

Evaluation of interventions for informed consent for randomised controlled trials (ELICIT): protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Gillies, Katie; Entwistle, Vikki; Treweek, Shaun P; Fraser, Cynthia; Williamson, Paula R; Campbell, Marion K

2015-10-27

The process of obtaining informed consent for participation in randomised controlled trials (RCTs) was established as a mechanism to protect participants against undue harm from research and allow people to recognise any potential risks or benefits associated with the research. A number of interventions have been put forward to improve this process. Outcomes reported in trials of interventions to improve the informed consent process for decisions about trial participation tend to focus on the 'understanding' of trial information. However, the operationalization of understanding as a concept, the tools used to measure it and the timing of the measurements are heterogeneous. A lack of clarity exists regarding which outcomes matter (to whom) and why. This inconsistency between studies results in difficulties when making comparisons across studies as evidenced in two recent systematic reviews of informed consent interventions. As such, no optimal method for measuring the impact of these interventions aimed at improving informed consent for RCTs has been identified. The project will adopt and adapt methodology previously developed and used in projects developing core outcome sets for assessment of clinical treatments. Specifically, the work will consist of three stages: 1) A systematic methodology review of existing outcome measures of trial informed consent interventions; 2) Interviews with key stakeholders to explore additional outcomes relevant for trial participation decisions; and 3) A Delphi study to refine the core outcome set for evaluation of trial informed consent interventions. All stages will include the stakeholders involved in the various aspects of RCT consent: users (that is, patients), developers (that is, trialists), deliverers (focusing on research nurses) and authorisers (that is, ethics committees). A final consensus meeting including all stakeholders will be held to review outcomes. The ELICIT study aims to develop a core outcome set for the evaluation of interventions intended to improve informed consent for RCTs for use in future RCTs and reviews, thereby improving the reliability and consistency of research in this area.

Systematic review of the effectiveness of training programs in writing for scholarly publication, journal editing, and manuscript peer review (protocol).

PubMed

Galipeau, James; Moher, David; Skidmore, Becky; Campbell, Craig; Hendry, Paul; Cameron, D William; Hébert, Paul C; Palepu, Anita

2013-06-17

An estimated $100 billion is lost to 'waste' in biomedical research globally, annually, much of which comes from the poor quality of published research. One area of waste involves bias in reporting research, which compromises the usability of published reports. In response, there has been an upsurge in interest and research in the scientific process of writing, editing, peer reviewing, and publishing (that is, journalology) of biomedical research. One reason for bias in reporting and the problem of unusable reports could be due to authors lacking knowledge or engaging in questionable practices while designing, conducting, or reporting their research. Another might be that the peer review process for journal publication has serious flaws, including possibly being ineffective, and having poorly trained and poorly motivated reviewers. Similarly, many journal editors have limited knowledge related to publication ethics. This can ultimately have a negative impact on the healthcare system. There have been repeated calls for better, more numerous training opportunities in writing for publication, peer review, and publishing. However, little research has taken stock of journalology training opportunities or evaluations of their effectiveness. We will conduct a systematic review to synthesize studies that evaluate the effectiveness of training programs in journalology. A comprehensive three-phase search approach will be employed to identify evaluations of training opportunities, involving: 1) forward-searching using the Scopus citation database, 2) a search of the MEDLINE In-Process and Non-Indexed Citations, MEDLINE, Embase, ERIC, and PsycINFO databases, as well as the databases of the Cochrane Library, and 3) a grey literature search. This project aims to provide evidence to help guide the journalological training of authors, peer reviewers, and editors. While there is ample evidence that many members of these groups are not getting the necessary training needed to excel at their respective journalology-related tasks, little is known about the characteristics of existing training opportunities, including their effectiveness. The proposed systematic review will provide evidence regarding the effectiveness of training, therefore giving potential trainees, course designers, and decision-makers evidence to help inform their choices and policies regarding the merits of specific training opportunities or types of training.

Framework for Selecting Best Practices in Public Health: A Systematic Literature Review

PubMed Central

de Colombani, Pierpaolo

2015-01-01

Evidence-based public health has commonly relied on findings from empirical studies, or research-based evidence. However, this paper advocates that practice-based evidence derived from programmes implemented in real-life settings is likely to be a more suitable source of evidence for inspiring and guiding public health programmes. Selection of best practices from the array of implemented programmes is one way of generating such practice-based evidence. Yet the lack of consensus on the definition and criteria for practice-based evidence and best practices has limited their application in public health so far. To address the gap in literature on practice-based evidence, this paper hence proposes measures of success for public health interventions by developing an evaluation framework for selection of best practices. The proposed framework was synthesised from a systematic literature review of peer-reviewed and grey literature on existing evaluation frameworks for public health programmes as well as processes employed by health-related organisations when selecting best practices. A best practice is firstly defined as an intervention that has shown evidence of effectiveness in a particular setting and is likely to be replicable to other situations. Regardless of the area of public health, interventions should be evaluated by their context, process and outcomes. A best practice should hence meet most, if not all, of eight identified evaluation criteria: relevance, community participation, stakeholder collaboration, ethical soundness, replicability, effectiveness, efficiency and sustainability. Ultimately, a standardised framework for selection of best practices will improve the usefulness and credibility of practice-based evidence in informing evidence-based public health interventions. Significance for public health Best practices are a valuable source of practice-based evidence on effective public health interventions implemented in real-life settings. Yet, despite the frequent branding of interventions as best practices or good practices, there is no consensus on the definition and desirable characteristics of such best practices. Hence, this is likely to be the first systematic review on the topic of best practices in public health. Having a single widely accepted framework for selecting best practices will ensure that the selection processes by different agencies are fair and comparable, as well as enable public health workers to better appreciate and adopt best practices in different settings. Ultimately, standardisation will improve the credibility and usefulness of practice-based evidence to that of research-based evidence. PMID:26753159

Framework for Selecting Best Practices in Public Health: A Systematic Literature Review.

PubMed

Ng, Eileen; de Colombani, Pierpaolo

2015-11-17

Evidence-based public health has commonly relied on findings from empirical studies, or research-based evidence. However, this paper advocates that practice-based evidence derived from programmes implemented in real-life settings is likely to be a more suitable source of evidence for inspiring and guiding public health programmes. Selection of best practices from the array of implemented programmes is one way of generating such practice-based evidence. Yet the lack of consensus on the definition and criteria for practice-based evidence and best practices has limited their application in public health so far. To address the gap in literature on practice-based evidence, this paper hence proposes measures of success for public health interventions by developing an evaluation framework for selection of best practices. The proposed framework was synthesised from a systematic literature review of peer-reviewed and grey literature on existing evaluation frameworks for public health programmes as well as processes employed by health-related organisations when selecting best practices. A best practice is firstly defined as an intervention that has shown evidence of effectiveness in a particular setting and is likely to be replicable to other situations. Regardless of the area of public health, interventions should be evaluated by their context, process and outcomes. A best practice should hence meet most, if not all, of eight identified evaluation criteria: relevance, community participation, stakeholder collaboration, ethical soundness, replicability, effectiveness, efficiency and sustainability. Ultimately, a standardised framework for selection of best practices will improve the usefulness and credibility of practice-based evidence in informing evidence-based public health interventions. Significance for public healthBest practices are a valuable source of practice-based evidence on effective public health interventions implemented in real-life settings. Yet, despite the frequent branding of interventions as best practices or good practices, there is no consensus on the definition and desirable characteristics of such best practices. Hence, this is likely to be the first systematic review on the topic of best practices in public health. Having a single widely accepted framework for selecting best practices will ensure that the selection processes by different agencies are fair and comparable, as well as enable public health workers to better appreciate and adopt best practices in different settings. Ultimately, standardisation will improve the credibility and usefulness of practice-based evidence to that of research-based evidence.

Lunar-base construction equipment and methods evaluation

NASA Technical Reports Server (NTRS)

Boles, Walter W.; Ashley, David B.; Tucker, Richard L.

1993-01-01

A process for evaluating lunar-base construction equipment and methods concepts is presented. The process is driven by the need for more quantitative, systematic, and logical methods for assessing further research and development requirements in an area where uncertainties are high, dependence upon terrestrial heuristics is questionable, and quantitative methods are seldom applied. Decision theory concepts are used in determining the value of accurate information and the process is structured as a construction-equipment-and-methods selection methodology. Total construction-related, earth-launch mass is the measure of merit chosen for mathematical modeling purposes. The work is based upon the scope of the lunar base as described in the National Aeronautics and Space Administration's Office of Exploration's 'Exploration Studies Technical Report, FY 1989 Status'. Nine sets of conceptually designed construction equipment are selected as alternative concepts. It is concluded that the evaluation process is well suited for assisting in the establishment of research agendas in an approach that is first broad, with a low level of detail, followed by more-detailed investigations into areas that are identified as critical due to high degrees of uncertainty and sensitivity.

Evaluating clinical ethics support in mental healthcare: a systematic literature review.

PubMed

Hem, Marit Helene; Pedersen, Reidar; Norvoll, Reidun; Molewijk, Bert

2015-06-01

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five studies were included. The ethics support activities described were moral case deliberations and ethics rounds. Different qualitative and quantitative research methods were utilized. The results show that (a) participants felt that they gained an increased insight into moral issues through systematic reflection; (b) there was improved cooperation among multidisciplinary team members; (c) it was uncertain whether clinical ethics support services led to better patient care; (d) the issue of patient and client participation is complex; and (e) the implementation process is challenging. Clinical ethics support services have mainly been studied through the experiences of the participating facilitators and healthcare professionals. Hence, there is limited knowledge of whether and how various types of clinical ethics support services influence the quality of care and how patients and relatives may evaluate clinical ethics support services. Based on the six excluded 'grey zone articles', in which there was an implicit focus on ethics reflection, other ways of working with ethical reflection in practice are discussed. Implementing and evaluating clinical ethics support services as approaches to clinical ethics support that are more integrated into the development of good practice are in focus. In order to meet some of the shortcomings of the field of clinical ethics support services, a research project that aims to strengthen ethics support in the mental health services, including patients' and caregivers' views on ethical challenges, is presented. © The Author(s) 2014.

Design of experiments applications in bioprocessing: concepts and approach.

PubMed

Kumar, Vijesh; Bhalla, Akriti; Rathore, Anurag S

2014-01-01

Most biotechnology unit operations are complex in nature with numerous process variables, feed material attributes, and raw material attributes that can have significant impact on the performance of the process. Design of experiments (DOE)-based approach offers a solution to this conundrum and allows for an efficient estimation of the main effects and the interactions with minimal number of experiments. Numerous publications illustrate application of DOE towards development of different bioprocessing unit operations. However, a systematic approach for evaluation of the different DOE designs and for choosing the optimal design for a given application has not been published yet. Through this work we have compared the I-optimal and D-optimal designs to the commonly used central composite and Box-Behnken designs for bioprocess applications. A systematic methodology is proposed for construction of the model and for precise prediction of the responses for the three case studies involving some of the commonly used unit operations in downstream processing. Use of Akaike information criterion for model selection has been examined and found to be suitable for the applications under consideration. © 2013 American Institute of Chemical Engineers.

Development process of an assessment tool for disruptive behavior problems in cross-cultural settings: the Disruptive Behavior International Scale – Nepal version (DBIS-N)

PubMed Central

Burkey, Matthew D.; Ghimire, Lajina; Adhikari, Ramesh P.; Kohrt, Brandon A.; Jordans, Mark J. D.; Haroz, Emily; Wissow, Lawrence

2017-01-01

Systematic processes are needed to develop valid measurement instruments for disruptive behavior disorders (DBDs) in cross-cultural settings. We employed a four-step process in Nepal to identify and select items for a culturally valid assessment instrument: 1) We extracted items from validated scales and local free-list interviews. 2) Parents, teachers, and peers (n=30) rated the perceived relevance and importance of behavior problems. 3) Highly rated items were piloted with children (n=60) in Nepal. 4) We evaluated internal consistency of the final scale. We identified 49 symptoms from 11 scales, and 39 behavior problems from free-list interviews (n=72). After dropping items for low ratings of relevance and severity and for poor item-test correlation, low frequency, and/or poor acceptability in pilot testing, 16 items remained for the Disruptive Behavior International Scale—Nepali version (DBIS-N). The final scale had good internal consistency (α=0.86). A 4-step systematic approach to scale development including local participation yielded an internally consistent scale that included culturally relevant behavior problems. PMID:28093575

A decision support system using analytical hierarchy process (AHP) for the optimal environmental reclamation of an open-pit mine

NASA Astrophysics Data System (ADS)

Bascetin, A.

2007-04-01

The selection of an optimal reclamation method is one of the most important factors in open-pit design and production planning. It also affects economic considerations in open-pit design as a function of plan location and depth. Furthermore, the selection is a complex multi-person, multi-criteria decision problem. The group decision-making process can be improved by applying a systematic and logical approach to assess the priorities based on the inputs of several specialists from different functional areas within the mine company. The analytical hierarchy process (AHP) can be very useful in involving several decision makers with different conflicting objectives to arrive at a consensus decision. In this paper, the selection of an optimal reclamation method using an AHP-based model was evaluated for coal production in an open-pit coal mine located at Seyitomer region in Turkey. The use of the proposed model indicates that it can be applied to improve the group decision making in selecting a reclamation method that satisfies optimal specifications. Also, it is found that the decision process is systematic and using the proposed model can reduce the time taken to select a optimal method.

Interventions to improve patient understanding of cancer clinical trial participation: a systematic review.

PubMed

Kao, C Y; Aranda, S; Krishnasamy, M; Hamilton, B

2017-03-01

Patient misunderstanding of cancer clinical trial participation is identified as a critical issue and researchers have developed and tested a variety of interventions to improve patient understanding. This systematic review identified nine papers published between 2000 and 2013, to evaluate the effects of interventions to improve patient understanding of cancer clinical trial participation. Types of interventions included audio-visual information, revised written information and a communication training workshop. Interventions were conducted alone or in combination with other forms of information provision. The nine papers, all with methodological limitations, reported mixed effects on a small range of outcomes regarding improved patient understanding of cancer clinical trial participation. The methodological limitations included: (1) the intervention development process was poorly described; (2) only a small element of the communication process was addressed; (3) studies lacked evidence regarding what information is essential and critical to enable informed consent; (4) studies lacked reliable and valid outcome measures to show that patients are sufficiently informed to provide consent; and (5) the intervention development process lacked a theoretical framework. Future research needs to consider these factors when developing interventions to improve communication and patient understanding during the informed consent process. © 2016 John Wiley & Sons Ltd.

Evaluating the effect of antioxidant agents on shear bond strength of tooth-colored restorative materials after bleaching: A systematic review.

PubMed

Feiz, Atiyeh; Mosleh, Hamid; Nazeri, Rahman

2017-07-01

The main objective of the present study was to make a systematic review of how antioxidant agents affect shear bond strength of tooth-colored restorative materials after bleaching. Electronic search was used to extract the related articles on the targeted key words such as "antioxidant", "dental bleaching" and "shear bond strength" (SBS) from MeSH, PubMed, Medline, and Cochrane electronic data bases. These articles were all published before 2016. Inclusion criteria were restricted to English journal articles concerning humans, clinical trials, cohorts and case-control studies. Therefore, systematic reviews, case reports, letters to editors, editorials and congress abstracts were excluded from the analysis. Most studies conducted on the issue have produced experimental data which are rather controversial, and there is no general agreement about the reported outcomes. As an illustration, most studies have not considered the relationship between the type of antioxidant materials and the shear bond strength. In point of fact, some researchers (e.g Kimyai et al.) have concluded that antioxidants like gel and solution leave similar effects on SBS. Alternatively, certain studies (e.g., Kunt et al.) have produced inconclusive data regarding the impact of one week postponement of the restorative process on SBS after the bleaching process. The results of the studies evaluating the role of various adhesive systems used after bleaching have demonstrated that regardless of the type of adhesive system used, applying antioxidants before restorative procedures can adversely affect the bleaching agents utilized for SBS. It has also been suggested that the type of the adhesive system used might be correlated with the magnitude of SBS. The results obtained from the systematic review of the articles under investigation reflected that the use of antioxidant agents, regardless of their type, form, concentration and duration of application, can improve SBS after bleaching. Copyright © 2017. Published by Elsevier Ltd.

Methodology for the Development of Antithrombotic Therapy and Prevention of Thrombosis Guidelines

PubMed Central

Norris, Susan L.; Schulman, Sam; Hirsh, Jack; Eckman, Mark H.; Akl, Elie A.; Crowther, Mark; Vandvik, Per Olav; Eikelboom, John W.; McDonagh, Marian S.; Lewis, Sandra Zelman; Gutterman, David D.; Cook, Deborah J.; Schünemann, Holger J.

2012-01-01

Background: To develop the Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: ACCP Evidence-Based Clinical Practice Guidelines (AT9), the American College of Chest Physicians (ACCP) assembled a panel of clinical experts, information scientists, decision scientists, and systematic review and guideline methodologists. Methods: Clinical areas were designated as articles, and a methodologist without important intellectual or financial conflicts of interest led a panel for each article. Only panel members without significant conflicts of interest participated in making recommendations. Panelists specified the population, intervention and alternative, and outcomes for each clinical question and defined criteria for eligible studies. Panelists and an independent evidence-based practice center executed systematic searches for relevant studies and evaluated the evidence, and where resources and evidence permitted, they created standardized tables that present the quality of the evidence and key results in a transparent fashion. Results: One or more recommendations relate to each specific clinical question, and each recommendation is clearly linked to the underlying body of evidence. Judgments regarding the quality of evidence and strength of recommendations were based on approaches developed by the Grades of Recommendations, Assessment, Development, and Evaluation Working Group. Panel members constructed scenarios describing relevant health states and rated the disutility associated with these states based on an additional systematic review of evidence regarding patient values and preferences for antithrombotic therapy. These ratings guided value and preference decisions underlying the recommendations. Each topic panel identified questions in which resource allocation issues were particularly important and, for these issues, experts in economic analysis provided additional searches and guidance. Conclusions: AT9 methodology reflects the current science of evidence-based clinical practice guideline development, with reliance on high-quality systematic reviews, a standardized process for quality assessment of individual studies and the body of evidence, an explicit process for translating the evidence into recommendations, disclosure of financial as well as intellectual conflicts of interest followed by management of disclosed conflicts, and extensive peer review. PMID:22315256

A Systematic Review of Cardiovascular Outcomes-Based Cost-Effectiveness Analyses of Lipid-Lowering Therapies.

PubMed

Wei, Ching-Yun; Quek, Ruben G W; Villa, Guillermo; Gandra, Shravanthi R; Forbes, Carol A; Ryder, Steve; Armstrong, Nigel; Deshpande, Sohan; Duffy, Steven; Kleijnen, Jos; Lindgren, Peter

2017-03-01

Previous reviews have evaluated economic analyses of lipid-lowering therapies using lipid levels as surrogate markers for cardiovascular disease. However, drug approval and health technology assessment agencies have stressed that surrogates should only be used in the absence of clinical endpoints. The aim of this systematic review was to identify and summarise the methodologies, weaknesses and strengths of economic models based on atherosclerotic cardiovascular disease event rates. Cost-effectiveness evaluations of lipid-lowering therapies using cardiovascular event rates in adults with hyperlipidaemia were sought in Medline, Embase, Medline In-Process, PubMed and NHS EED and conference proceedings. Search results were independently screened, extracted and quality checked by two reviewers. Searches until February 2016 retrieved 3443 records, from which 26 studies (29 publications) were selected. Twenty-two studies evaluated secondary prevention (four also assessed primary prevention), two considered only primary prevention and two included mixed primary and secondary prevention populations. Most studies (18) based treatment-effect estimates on single trials, although more recent evaluations deployed meta-analyses (5/10 over the last 10 years). Markov models (14 studies) were most commonly used and only one study employed discrete event simulation. Models varied particularly in terms of health states and treatment-effect duration. No studies used a systematic review to obtain utilities. Most studies took a healthcare perspective (21/26) and sourced resource use from key trials instead of local data. Overall, reporting quality was suboptimal. This review reveals methodological changes over time, but reporting weaknesses remain, particularly with respect to transparency of model reporting.

Formative Process Evaluation for Implementing a Social Marketing Intervention to Increase Walking Among African Americans in the Positive Action for Today’s Health Trial

PubMed Central

Wilson, Dawn K.; Griffin, Sarah; St. George, Sara M.; Alia, Kassandra A.; Trumpeter, Nevelyn N.; Wandersman, Abraham K.; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-01-01

Objectives. Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today’s Health trial. Methods: We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Results: Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P < .001), a key social marketing component, and program social interaction was the primary reason for which walkers reported participating. Conclusions: Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities. PMID:23078486

Exploring Operational Test and Evaluation of Unmanned Aircraft Systems: A Qualitative Case Study

NASA Astrophysics Data System (ADS)

Saliceti, Jose A.

The purpose of this qualitative case study was to explore and identify strategies that may potentially remedy operational test and evaluation procedures used to evaluate Unmanned Aircraft Systems (UAS) technology. The sample for analysis consisted of organizations testing and evaluating UASs (e.g., U.S. Air Force, U.S. Navy, U.S. Army, U.S. Marine Corps, U.S. Coast Guard, and Customs Border Protection). A purposeful sampling technique was used to select 15 subject matter experts in the field of operational test and evaluation of UASs. A questionnaire was provided to participants to construct a descriptive and robust research. Analysis of responses revealed themes related to each research question. Findings revealed operational testers utilized requirements documents to extrapolate measures for testing UAS technology and develop critical operational issues. The requirements documents were (a) developed without the contribution of stakeholders and operational testers, (b) developed with vague or unrealistic measures, and (c) developed without a systematic method to derive requirements from mission tasks. Four approaches are recommended to develop testable operational requirements and assist operational testers: (a) use a mission task analysis tool to derive requirements for mission essential tasks for the system, (b) exercise collaboration among stakeholders and testers to ensure testable operational requirements based on mission tasks, (c) ensure testable measures are used in requirements documents, and (d) create a repository list of critical operational issues by mission areas. The preparation of operational test and evaluation processes for UAS technology is not uniform across testers. The processes in place are not standardized, thus test plan preparation and reporting are different among participants. A standard method to prepare and report UAS technology should be used when preparing and reporting on UAS technology. Using a systematic process, such as mission-based test design, resonated among participants as an analytical method to link UAS mission tasks and measures of performance to the capabilities of the system under test when developing operational test plans. Further research should examine system engineering designs for system requirements traceability matrix of mission tasks and subtasks while using an analysis tool that adequately evaluates UASs with an acceptable level of confidence in the results.

Human Research Program Unique Processes, Criteria, and Guidelines (UPCG). Revision C, July 28, 2011

NASA Technical Reports Server (NTRS)

Chin, Duane

2011-01-01

This document defines the processes, criteria, and guidelines exclusive to managing the Human Research Program (HRP). The intent of this document is to provide instruction to the reader in the form of processes, criteria, and guidelines. Of the three instructional categories, processes contain the most detail because of the need for a systematic series of actions directed to some end. In contrast, criteria have lesser detail than processes with the idea of creating a rule or principle structure for evaluating or testing something. Guidelines are a higher level indication of a course of action typically with the least amount of detail. The lack of detail in guidelines allows the reader flexibility when performing an action or actions.

Comparison of pre-processing methods for multiplex bead-based immunoassays.

PubMed

Rausch, Tanja K; Schillert, Arne; Ziegler, Andreas; Lüking, Angelika; Zucht, Hans-Dieter; Schulz-Knappe, Peter

2016-08-11

High throughput protein expression studies can be performed using bead-based protein immunoassays, such as the Luminex® xMAP® technology. Technical variability is inherent to these experiments and may lead to systematic bias and reduced power. To reduce technical variability, data pre-processing is performed. However, no recommendations exist for the pre-processing of Luminex® xMAP® data. We compared 37 different data pre-processing combinations of transformation and normalization methods in 42 samples on 384 analytes obtained from a multiplex immunoassay based on the Luminex® xMAP® technology. We evaluated the performance of each pre-processing approach with 6 different performance criteria. Three performance criteria were plots. All plots were evaluated by 15 independent and blinded readers. Four different combinations of transformation and normalization methods performed well as pre-processing procedure for this bead-based protein immunoassay. The following combinations of transformation and normalization were suitable for pre-processing Luminex® xMAP® data in this study: weighted Box-Cox followed by quantile or robust spline normalization (rsn), asinh transformation followed by loess normalization and Box-Cox followed by rsn.

Systematic, theoretically-grounded development and feasibility testing of an innovative, preventive web-based game for children exposed to acute trauma

PubMed Central

Marsac, Meghan L.; Winston, Flaura K.; Hildenbrand, Aimee K.; Kohser, Kristen L.; March, Sonja; Kenardy, Justin; Kassam-Adams, Nancy

2015-01-01

Background Millions of children are affected by acute medical events annually, creating need for resources to promote recovery. While web-based interventions promise wide reach and low cost for users, development can be time- and cost-intensive. A systematic approach to intervention development can help to minimize costs and increase likelihood of effectiveness. Using a systematic approach, our team integrated evidence on the etiology of traumatic stress, an explicit program theory, and a user-centered design process to intervention development. Objective To describe evidence and the program theory model applied to the Coping Coach intervention and present pilot data evaluating intervention feasibility and acceptability. Method Informed by empirical evidence on traumatic stress prevention, an overarching program theory model was articulated to delineate pathways from a) specific intervention content to b) program targets and proximal outcomes to c) key longer-term health outcomes. Systematic user-testing with children ages 8–12 (N = 42) exposed to an acute medical event and their parents was conducted throughout intervention development. Results Functionality challenges in early prototypes necessitated revisions. Child engagement was positive throughout revisions to the Coping Coach intervention. Final pilot-testing demonstrated promising feasibility and high user-engagement and satisfaction. Conclusion Applying a systematic approach to the development of Coping Coach led to the creation of a functional intervention that is accepted by children and parents. Development of new e-health interventions may benefit from a similar approach. Future research should evaluate the efficacy of Coping Coach in achieving targeted outcomes of reduced trauma symptoms and improved health-related quality of life. PMID:25844276

A systematic review of definitions and classification systems of adjacent segment pathology.

PubMed

Kraemer, Paul; Fehlings, Michael G; Hashimoto, Robin; Lee, Michael J; Anderson, Paul A; Chapman, Jens R; Raich, Annie; Norvell, Daniel C

2012-10-15

Systematic review. To undertake a systematic review to determine how "adjacent segment degeneration," "adjacent segment disease," or clinical pathological processes that serve as surrogates for adjacent segment pathology are classified and defined in the peer-reviewed literature. Adjacent segment degeneration and adjacent segment disease are terms referring to degenerative changes known to occur after reconstructive spine surgery, most commonly at an immediately adjacent functional spinal unit. These can include disc degeneration, instability, spinal stenosis, facet degeneration, and deformity. The true incidence and clinical impact of degenerative changes at the adjacent segment is unclear because there is lack of a universally accepted classification system that rigorously addresses clinical and radiological issues. A systematic review of the English language literature was undertaken and articles were classified using the Grades of Recommendation Assessment, Development, and Evaluation criteria. RESULTS.: Seven classification systems of spinal degeneration, including degeneration at the adjacent segment, were identified. None have been evaluated for reliability or validity specific to patients with degeneration at the adjacent segment. The ways in which terms related to adjacent segment "degeneration" or "disease" are defined in the peer-reviewed literature are highly variable. On the basis of the systematic review presented in this article, no formal classification system for either cervical or thoracolumbar adjacent segment disorders currently exists. No recommendations regarding the use of current classification of degeneration at any segments can be made based on the available literature. A new comprehensive definition for adjacent segment pathology (ASP, the now preferred terminology) has been proposed in this Focus Issue, which reflects the diverse pathology observed at functional spinal units adjacent to previous spinal reconstruction and balances detailed stratification with clinical utility. A comprehensive classification system is being developed through expert opinion and will require validation as well as peer review. Strength of Statement: Strong.

Participatory evaluation (I)--sharing lessons from fieldwork in Asia.

PubMed

Crishna, B

2007-05-01

There is a need to study methodologies for evaluating social development projects. Traditional methods of evaluation are often not able to capture or measure the 'spirit of change' in people, which is the very essence of human development. Using participatory methodologies is a positive way to ensure that evaluations encourage an understanding of the value of critical analysis among service providers and other stakeholders. Participatory evaluation provides a systematic process of learning through experiences. Practical experiences of conducting a number of evaluation studies in social development projects have led the author to develop four basic principles of participatory evaluation strategies. This has been further conceptualized through an extensive literature search. The article develops and shares these principles through descriptions of field experiences in Asia. The article illustrates that the role of any evaluation remains a learning process, one which promotes a climate of reflection and self-assessment. It shows how using participatory methods can create this environment of learning. However, one needs to keep in mind that participatory evaluation takes time, and that the role and calibre of the facilitator are crucial. Participatory evaluation methods have been recommended for social development projects to ensure that stakeholders remain in control of their own lives and decisions.

A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries.

PubMed

Jiang, Min; Chen, Yukun; Liu, Mei; Rosenbloom, S Trent; Mani, Subramani; Denny, Joshua C; Xu, Hua

2011-01-01

The authors' goal was to develop and evaluate machine-learning-based approaches to extracting clinical entities-including medical problems, tests, and treatments, as well as their asserted status-from hospital discharge summaries written using natural language. This project was part of the 2010 Center of Informatics for Integrating Biology and the Bedside/Veterans Affairs (VA) natural-language-processing challenge. The authors implemented a machine-learning-based named entity recognition system for clinical text and systematically evaluated the contributions of different types of features and ML algorithms, using a training corpus of 349 annotated notes. Based on the results from training data, the authors developed a novel hybrid clinical entity extraction system, which integrated heuristic rule-based modules with the ML-base named entity recognition module. The authors applied the hybrid system to the concept extraction and assertion classification tasks in the challenge and evaluated its performance using a test data set with 477 annotated notes. Standard measures including precision, recall, and F-measure were calculated using the evaluation script provided by the Center of Informatics for Integrating Biology and the Bedside/VA challenge organizers. The overall performance for all three types of clinical entities and all six types of assertions across 477 annotated notes were considered as the primary metric in the challenge. Systematic evaluation on the training set showed that Conditional Random Fields outperformed Support Vector Machines, and semantic information from existing natural-language-processing systems largely improved performance, although contributions from different types of features varied. The authors' hybrid entity extraction system achieved a maximum overall F-score of 0.8391 for concept extraction (ranked second) and 0.9313 for assertion classification (ranked fourth, but not statistically different than the first three systems) on the test data set in the challenge.

Tablet splitting of a narrow therapeutic index drug: a case with levothyroxine sodium.

PubMed

Shah, Rakhi B; Collier, Jarrod S; Sayeed, Vilayat A; Bryant, Arthur; Habib, Muhammad J; Khan, Mansoor A

2010-09-01

Levothyroxine is a narrow therapeutic index, and to avoid adverse effect associated with under or excessive dosage, the dose response is carefully titrated. The tablets are marketed with a score providing an option to split. However, there are no systematic studies evaluating the effect of splitting on dose accuracy, and current study was undertaken to evaluate effects of splitting and potential causes for uniformity failures by measuring assay and content uniformity in whole and split tablets. Stability was evaluated by assaying drug for a period of 8 weeks. Effect of formulation factors on splittability was evaluated by a systematic investigation of formulation factors by preparing levothyroxine tablets in house by varying the type of excipients (binder, diluent, disintegrant, glidant) or by varying the processing factors (granulating liquid, mixing type, compression pressure). The tablets were analyzed using novel analytical tool such as near infrared chemical imaging to visualize the distribution of levothyroxine. Assay was not significantly different for whole versus split tablets irrespective of method of splitting (hand or splitter), and splitting also had no measurable impact on the stability. Split tablets either by hand or splitter showed higher rate of content uniformity failures as compared to whole tablets. Tablet splitter produced more fragmentation and, hence, more content uniformity and friability failures. Chemical imaging data revealed that the distribution of levothyroxine was heterogeneous and was dependent on type of binder and the process used in the manufacture of tablets. Splitting such tablets could prove detrimental if sub- or super-potency becomes an issue.

Community‐Academic Partnerships: A Systematic Review of the State of the Literature and Recommendations for Future Research

PubMed Central

MEZA, ROSEMARY D.; BRIKHO, BRIGITTE; NAAF, MEGHAN; ESTABILLO, JASPER A.; GOMEZ, EMILY D.; VEJNOSKA, SARAH F.; DUFEK, SARAH; STAHMER, AUBYN C.; AARONS, GREGORY A.

2016-01-01

Policy Points: Communities, funding agencies, and institutions are increasingly involving community stakeholders as partners in research, to provide firsthand knowledge and insight.Based on our systematic review of major literature databases, we recommend using a single term, community‐academic partnership (CAP), and a conceptual definition to unite multiple research disciplines and strengthen the field.Interpersonal and operational factors that facilitate or hinder the collaborative process have been consistently identified, including “trust among partners” and “respect among partners” (facilitating interpersonal factors) and “excessive time commitment” (hindering operational factor).Once CAP processes and characteristics are better understood, the effectiveness of collaborative partner involvement can be tested. Context Communities, funding agencies, and institutions are increasingly involving community stakeholders as partners in research. Community stakeholders can provide firsthand knowledge and insight, thereby increasing research relevance and feasibility. Despite the greater emphasis and use of community‐academic partnerships (CAP) across multiple disciplines, definitions of partnerships and methodologies vary greatly, and no systematic reviews consolidating this literature have been published. The purpose of this article, then, is to facilitate the continued growth of this field by examining the characteristics of CAPs and the current state of the science, identifying the facilitating and hindering influences on the collaborative process, and developing a common term and conceptual definition for use across disciplines. Methods Our systematic search of 6 major literature databases generated 1,332 unique articles, 50 of which met our criteria for inclusion and provided data on 54 unique CAPs. We then analyzed studies to describe CAP characteristics and to identify the terms and methods used, as well as the common influences on the CAP process and distal outcomes. Findings CAP research spans disciplines, involves a variety of community stakeholders, and focuses on a large range of study topics. CAP research articles, however, rarely report characteristics such as membership numbers or duration. Most studies involved case studies using qualitative methods to collect data on the collaborative process. Although various terms were used to describe collaborative partnerships, few studies provided conceptual definitions. Twenty‐three facilitating and hindering factors influencing the CAP collaboration process emerged from the literature. Outcomes from the CAPs most often included developing or refining tangible products. Conclusions Based on our systematic review, we recommend using a single term, community‐academic partnership, as well as a conceptual definition to unite multiple research disciplines. In addition, CAP characteristics and methods should be reported more systematically to advance the field (eg, to develop CAP evaluation tools). We have identified the most common influences that facilitate and hinder CAPs, which in turn should guide their development and sustainment. PMID:26994713

Using GRADE as a framework to guide research on the sexual and reproductive health and rights (SRHR) of women living with HIV - methodological opportunities and challenges.

PubMed

Siegfried, Nandi; Narasimhan, Manjulaa; Kennedy, Caitlin E; Welbourn, Alice; Yuvraj, Anandi

2017-09-01

In March 2016, WHO reviewed evidence to develop global recommendations on the sexual and reproductive health and rights (SRHR) of women living with HIV. Systematic reviews and a global survey of women living with HIV informed the guideline development decision-making process. New recommendations covered abortion, Caesarean section, safe disclosure, and empowerment and self-efficacy interventions. Identification of key research gaps is part of the WHO guidelines development process, but consistent methods to do so are lacking. Our method aimed to ensure consistency and comprised the systematic application of a framework based on GRADE (Grading of Recommendations, Assessment, Development and Evaluation) to the process. The framework incorporates the strength and quality rating of recommendations and the priorities reported by women in the survey to inform research prioritisation. For each gap, we also articulated: (1) the most appropriate and robust study design to answer the question; (2) alternative pragmatic designs if the ideal design is not feasible; and (3) the methodological challenges facing researchers through identifying potential biases. We found 12 research gaps and identified five appropriate study designs to address the related questions: (1) Cross-sectional surveys; (2) Qualitative interview-driven studies; (3) Registries; (4) Randomised controlled trials; and (5) Medical record audit. Methodological challenges included selection, recruitment, misclassification, measurement and contextual biases, and confounding. In conclusion, a framework based on GRADE can provide a systematic approach to identifying research gaps from a WHO guideline. Incorporation of the priorities of women living with HIV into the framework systematically ensures that women living with HIV can shape future policy decisions affecting their lives. Implementation science and participatory research are appropriate over-arching approaches to enhance uptake of interventions and to ensure inclusion of women living with HIV at all stages of the research process.

[Development process of Evidence-based "Return-to-work Guidance in Occupational Health 2017"].

PubMed

Kojimahara, Noriko; Fukumoto, Masakatsu; Yoshikawa, Etsuko; Shinada, Kayoko; Tsuiki, Hirokazu

2018-06-05

Objective"Return-to-work Guidance in Occupational Health 2017 (RTW Guidance 2017) " is the first occupational health guide in Japan that evaluates the quality of evidence and offers recommendations based on results of the systematic review of randomized controlled trials. Details of the systematic review of each review question (RQs) will be described separately. This article presents an overview of the method and process of developing the "RTW Guidance 2017."Materials and MethodsThe guidance was developed following the previously-published "Method for developing evidence based occupational health guidance," which included the composition of a highly-transparent guidance developing group as well as the recruitment and selection of RQs. Using the Cochrane Library, PubMed, and Ichushi-Web, a literature search for the six RQs was conducted in January 2016 by partly modifying the search terms of the existing systematic review. Articles were selected according to the inclusion criteria, and the quality of evidence was evaluated using the GRADE approach. Meta-analysis was conducted for RQ2 and RQ4, and a qualitative systematic review was conducted for RQ5, RQ6, and cost-effectiveness. Recommendations were subsequently made after a thorough consideration for feasibility in Japan by examining the costs and available resources.ResultsBased on a comprehensive literature search, eleven RQ2, four RQ4, one RQ5, and three RQ6 were selected. Support program for returning to work, such as "Re-work" for those who are temporarily not working due to musculoskeletal disorders or mental health disorder, was recommended based on moderate evidence (RQ2). For RQ4, the collaboration between occupational health practice and clinical practice was weakly recommended based on low evidence. For RQ5 that evaluated the usefulness of social support, intervention by the manager/co-worker was proposed as a "best practice statement" without indicating it as a recommendation. Work accommodation was weakly recommended based on low evidence in RQ6.Discussion and ConclusionFrom the result of systematic reviews, it was recommended for workers on sick leave more than four weeks regardless of sick leave and sickness absence that interventions during leave would improve work-related outcomes, such as earlier reinstatement. Although there is limited evidence regarding occupational health in Japan, it is important for many occupational health professionals to learn the method of developing guidance and to identify issues for future studies with priority in Japan.

Systematic Review: Concept and Tool Development with Application in the Integrated Risk Information System (IRIS) Assessment Process

EPA Science Inventory

Systematic Review: Concept and tool development with application to the National Toxicology Program (NTP) and the Integrated Risk Information System (IRIS) Assessment Processes. There is growing interest within the environmental health community to incorporate systematic review m...

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

PubMed Central

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The most frequently applied economic evaluation is cost-effectiveness analysis. The majority of the studies did not follow the scientific method of economic evaluation process, which consequently resulted into lack of robustness of the analyses. Capacity building on economic evaluation of health and health-related programs should be enhanced. PMID:21771343

Evaluation and Validation of Organic Materials for Advanced Stirling Convertors (ASCs): Overview

NASA Technical Reports Server (NTRS)

Shin, Euy-Sik Eugene

2015-01-01

Various organic materials are used as essential parts in Stirling Convertors for their unique properties and functionalities such as bonding, potting, sealing, thread locking, insulation, and lubrication. More efficient Advanced Stirling Convertors (ASC) are being developed for future space applications especially with a long mission cycle, sometimes up to 17 years, such as deep space exploration or lunar surface power or Mars rovers, and others. Thus, performance, durability, and reliability of those organics should be critically evaluated in every possible material-process-fabrication-service environment relations based on their mission specifications. In general, thermal stability, radiation hardness, outgassing, and material compatibility of the selected organics have been systematically evaluated while their process and fabrication conditions and procedures were being optimized. Service environment-simulated long term aging tests up to 4 years were performed as a function of temperature for durability assessment of the most critical organic material systems.

Validation of Organics for Advanced Stirling Convertor (ASC)

NASA Astrophysics Data System (ADS)

Shin, E. Eugene; Scheiman, Dan; Cybulski, Michelle; Quade, Derek; Inghram, Linda; Burke, Chris

2008-01-01

Organic materials are an essential part of the Advanced Stirling Convertor (ASC) construction as adhesives, potting, wire insulation, lubrication coatings, bobbins, bumpers, insulators, thread lockers. Since a long lifetime of such convertors to be used in the Advanced Stirling Radioisotope Generator (ASRG), sometimes up to 17 years, is required in various space applications such as Mars rovers, deep space missions, and lunar surface power, performance, durability and reliability of those organics should be critically evaluated in every possible material-process-fabrication-service environment relations. The objective of this study was to evaluate, validate, and recommend organics for use in ASCs. Systematic and extensive evaluation methodologies were developed and conducted for various organic materials. The overall efforts dealing with organics materials for the last several years are summarized in the key areas, e.g., process-fabrication optimization, adhesive bonding integrity, outgassing, thermal stability, and durability

Using logic models in a community-based agricultural injury prevention project.

PubMed

Helitzer, Deborah; Willging, Cathleen; Hathorn, Gary; Benally, Jeannie

2009-01-01

The National Institute for Occupational Safety and Health has long promoted the logic model as a useful tool in an evaluator's portfolio. Because a logic model supports a systematic approach to designing interventions, it is equally useful for program planners. Undertaken with community stakeholders, a logic model process articulates the underlying foundations of a particular programmatic effort and enhances program design and evaluation. Most often presented as sequenced diagrams or flow charts, logic models demonstrate relationships among the following components: statement of a problem, various causal and mitigating factors related to that problem, available resources to address the problem, theoretical foundations of the selected intervention, intervention goals and planned activities, and anticipated short- and long-term outcomes. This article describes a case example of how a logic model process was used to help community stakeholders on the Navajo Nation conceive, design, implement, and evaluate agricultural injury prevention projects.

The effect of care pathways for hip fractures: a systematic review.

PubMed

Leigheb, Fabrizio; Vanhaecht, Kris; Sermeus, Walter; Lodewijckx, Cathy; Deneckere, Svin; Boonen, Steven; Boto, Paulo Alexandre Faria; Mendes, Rita Veloso; Panella, Massimiliano

2012-07-01

We performed a systematic review for primary studies on care pathways (CPs) for hip fracture (HF). The online databases MEDLINE-PubMed, Ovid-EMBASE, CINAHL-EBSCO host, and The Cochrane Library (Cochrane Central Register of Clinical Trials, Health Technology Assessment Database, NHS Economic Evaluation Database) were searched. Two researchers reviewed the literature independently. Primary studies that met predefined inclusion criteria were assessed for their methodological quality. A total of 15 publications were included: 15 primary studies corresponding with 12 main investigations. Primary studies were evaluated for clinical outcomes, process outcomes, and economic outcomes. The studies assessed a wide range of outcome measures. While a number of divergent clinical outcomes were reported, most studies showed positive results of process management and health-services utilization. In terms of mortality, the results provided evidence for a positive impact of CPs on in-hospital mortality. Most studies also showed a significantly reduced risk of complications, including medical complications, wound infections, and pressure sores. Moreover, time-span process measures showed that an improvement in the organization of care was achieved through the use of CPs. Conflicting results were observed with regard to functional recovery and mobility between patients treated with CPs compared to usual care. Although our review suggests that CPs can have positive effects in patients with HF, the available evidence is insufficient for formal recommendations. There is a need for more research on CPs with selected process and outcome indicators, for in-hospital and postdischarge management of HF, with an emphasis on well-designed randomized trials.

Disease management programs for type 2 diabetes in Germany: a systematic literature review evaluating effectiveness.

PubMed

Fuchs, Sabine; Henschke, Cornelia; Blümel, Miriam; Busse, Reinhard

2014-06-27

Disease management programs (DMPs) are intended to improve the care of persons with chronic diseases. Despite numerous studies there is no unequivocal evidence about the effectiveness of DMPs in Germany. We conducted a systematic literature review in the MEDLINE, EMBASE, Cochrane Library, and CCMed databases. Our analysis included all controlled studies in which patients with type 2 diabetes enrolled in a DMP were compared to type 2 diabetes patients receiving routine care with respect to process, outcome, and economic parameters. The 9 studies included in the analysis were highly divergent with respect to their characteristics and the process and outcome parameters studied in each. No study had data beyond the year 2008. In 3 publications, the DMP patients had a lower mortality than the control patients (2.3%, 11.3%, and 7.17% versus 4.7%, 14.4%, and 14.72%). In 2 publications, DMP participation was found to be associated with a mean survival time of 1044.94 (± 189.87) days, as against 985.02 (± 264.68) in the control group. No consistent effect was seen with respect to morbidity, quality of life, or economic parameters. 7 publications from 5 studies revealed positive effects on process parameters for DMP participants. The observed beneficial trends with respect to mortality and survival time, as well as improvements in process parameters, indicate that DMPs can, in fact, improve the care of patients with diabetes. Further evaluation is needed, because some changes in outcome parameters (an important indicator of the quality of care) may only be observable over a longer period of time.

A systematic approach to baseline assessment of nursing documentation and enterprise-wide prioritization for electronic conversion.

PubMed

Dykes, Patricia C; Spurr, Cindy; Gallagher, Joan; Li, Qi; Ives Erickson, Jeanette

2006-01-01

An important challenge associated with making the transition from paper to electronic documentation systems is achieving consensus regarding priorities for electronic conversion across diverse groups. In our work we focus on applying a systematic approach to evaluating the baseline state of nursing documentation across a large healthcare system and establishing a unified vision for electronic conversion. A review of the current state of nursing documentation across PHS was conducted using structured tools. Data from this assessment was employed to facilitate an evidence-based approach to decision-making regarding conversion to electronic documentation at local and PHS levels. In this paper we present highlights of the assessment process and the outcomes of this multi-site collaboration.

Additively Manufactured Metals in Oxygen Systems Project

NASA Technical Reports Server (NTRS)

Tylka, Jonathan

2015-01-01

Metals produced by additive manufacturing methods, such as Powder Bed Fusion Technology, are now mature enough to be considered for qualification in human spaceflight oxygen systems. The mechanical properties of metals produced through AM processes are being systematically studied. However, it is unknown whether AM metals in oxygen applications may present an increased risk of flammability or ignition as compared to wrought metals of the same metallurgical composition due to increased porosity. Per NASA-STD-6001B materials to be used in oxygen system applications shall be based on flammability and combustion test data, followed by a flammability assessment. Without systematic flammability and ignition testing in oxygen there is no credible method for NASA to accurately evaluate the risk of using AM metals in oxygen systems.

Evaluation of Graphite Fiber/Polyimide PMCs from Hot Melt vs Solution Prepreg

NASA Technical Reports Server (NTRS)

Shin, E. Eugene; Sutter, James K.; Eakin, Howard; Inghram, Linda; McCorkle, Linda; Scheiman, Dan; Papadopoulos, Demetrios; Thesken, John; Fink, Jeffrey E.

2002-01-01

Carbon fiber reinforced high temperature polymer matrix composites (PMC) have been extensively investigated as potential weight reduction replacements of various metallic components in next generation high performance propulsion rocket engines. The initial phase involves development of comprehensive composite material-process-structure-design-property-in-service performance correlations and database, especially for a high stiffness facesheet of various sandwich structures. Overview of the program plan, technical approaches and current multi-team efforts will be presented. During composite fabrication, it was found that the two large volume commercial prepregging methods (hot-melt vs. solution) resulted in considerably different composite cure behavior. Details of the process-induced physical and chemical modifications in the prepregs, their effects on composite processing, and systematic cure cycle optimization studies will be discussed. The combined effects of prepregging method and cure cycle modification on composite properties and isothermal aging performance were also evaluated.

Evaluation of Graphite Fiber/Polyimide PMCs from Hot Melt versus Solution Prepreg

NASA Technical Reports Server (NTRS)

Shin, Eugene E.; Sutter, James K.; Eakin, Howard; Inghram, Linda; McCorkle, Linda; Scheiman, Dan; Papadopoulos, Demetrios; Thesken, John; Fink, Jeffrey E.; Gray, Hugh R. (Technical Monitor)

2002-01-01

Carbon fiber reinforced high temperature polymer matrix composites (PMC) have been extensively investigated as potential weight reduction replacements of various metallic components in next generation high performance propulsion rocket engines. The initial phase involves development of comprehensive composite material-process-structure-design-property in-service performance correlations and database, especially for a high stiffness facesheet of various sandwich structures. Overview of the program plan, technical approaches and current multi-team efforts will be presented. During composite fabrication, it was found that the two large volume commercial prepregging methods (hot-melt vs. solution) resulted in considerably different composite cure behavior. Details of the process-induced physical and chemical modifications in the prepregs, their effects on composite processing, and systematic cure cycle optimization studies will be discussed. The combined effects of prepregging method and cure cycle modification on composite properties and isothermal aging performance were also evaluated.

Developing the skills required for evidence-based practice.

PubMed

French, B

1998-01-01

The current health care environment requires practitioners with the skills to find and apply the best currently available evidence for effective health care, to contribute to the development of evidence-based practice protocols, and to evaluate the impact of utilizing validated research findings in practice. Current approaches to teaching research are based mainly on gaining skills by participation in the research process. Emphasis on the requirement for rigour in the process of creating new knowledge is assumed to lead to skill in the process of using research information created by others. This article reflects upon the requirements for evidence-based practice, and the degree to which current approaches to teaching research prepare practitioners who are able to find, evaluate and best use currently available research information. The potential for using the principles of systematic review as a teaching and learning strategy for research is explored, and some of the possible strengths and weakness of this approach are highlighted.

Food security in indigenous and peasant populations: a systematic review.

PubMed

Restrepo-Arango, Marcos; Gutiérrez-Builes, Lina Andrea; Ríos-Osorio, Leonardo Alberto

2018-04-01

Food security and the vulnerability among indigenous and peasant populations has become a topic of interest to public health all around the world, leading to the investigation about measurement, classification and factors that determine it. This systematic review aims to describe the situation of food security in indigenous and peasant communities, and the methods used for evaluation. The literature search was performed on the Pub Med (5), ScienceDirect (221) and Scopus (377) databases searching for publications between 2004 and 2015, a total of 603 items were located with the search engines. At the end of the screening process and after adding the items found in the gray literature, 25 papers were obtained to write the review. In the 11 years evaluated between 2004 and 2015, scientific activity around the theme was poor with just 4.54% of the publications on this subject, but for 2011 the percentage increased to 13 publications, 63%. Various factors that influence the development of food insecurity are climate change, the diversity of agriculture, globalization and market westernization.

A Conceptual Framework for the Evaluation of Emergency Risk Communications

PubMed Central

Lin, Leesa; Gamhewage, Gaya M.

2017-01-01

Objectives. To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). Methods. The framework proposed is based on a systematic review of the scientific literature (2001–2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. Results. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees’ data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Conclusions. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies. PMID:28892436

A Conceptual Framework for the Evaluation of Emergency Risk Communications.

PubMed

Savoia, Elena; Lin, Leesa; Gamhewage, Gaya M

2017-09-01

To articulate a conceptual framework in support of evaluation activities in emergency risk communications (ERC). The framework proposed is based on a systematic review of the scientific literature (2001-2016) combined with data derived from a series of semistructured interviews with experts and practitioners in ERC, and it is designed to support local, national, and international public health organizations in implementing evaluation studies in ERC. We identified a list of ERC outcomes from the full-text review of 152 articles and categorized these into 3 groups, depending upon the level at which the outcome was measured: (1) information environment, (2) population, and (3) public health system. We analyzed interviewees' data from 18 interviews to identify practices and processes related to the effectiveness of ERC and included these as key structural components and processes in the developed evaluation framework. Researchers and public health practitioners interested in the evaluation of ERC can use the conceptual framework described in this article to guide the development of evaluation studies and methods for assessing communication outcomes related to public health emergencies.

Evidence-Based Guidelines for Fatigue Risk Management in EMS: Formulating Research Questions and Selecting Outcomes.

PubMed

Patterson, P Daniel; Higgins, J Stephen; Lang, Eddy S; Runyon, Michael S; Barger, Laura K; Studnek, Jonathan R; Moore, Charity G; Robinson, Kathy; Gainor, Dia; Infinger, Allison; Weiss, Patricia M; Sequeira, Denisse J; Martin-Gill, Christian

2017-01-01

Greater than half of Emergency Medical Services (EMS) personnel report work-related fatigue, yet there are no guidelines for the management of fatigue in EMS. A novel process has been established for evidence-based guideline (EBG) development germane to clinical EMS questions. This process has not yet been applied to operational EMS questions like fatigue risk management. The objective of this study was to develop content valid research questions in the Population, Intervention, Comparison, and Outcome (PICO) framework, and select outcomes to guide systematic reviews and development of EBGs for EMS fatigue risk management. We adopted the National Prehospital EBG Model Process and Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework for developing, implementing, and evaluating EBGs in the prehospital care setting. In accordance with steps one and two of the Model Process, we searched for existing EBGs, developed a multi-disciplinary expert panel and received external input. Panelists completed an iterative process to formulate research questions. We used the Content Validity Index (CVI) to score relevance and clarity of candidate PICO questions. The panel completed multiple rounds of question editing and used a CVI benchmark of ≥0.78 to indicate acceptable levels of clarity and relevance. Outcomes for each PICO question were rated from 1 = less important to 9 = critical. Panelists formulated 13 candidate PICO questions, of which 6 were eliminated or merged with other questions. Panelists reached consensus on seven PICO questions (n = 1 diagnosis and n = 6 intervention). Final CVI scores of relevance ranged from 0.81 to 1.00. Final CVI scores of clarity ranged from 0.88 to 1.00. The mean number of outcomes rated as critical, important, and less important by PICO question was 0.7 (SD 0.7), 5.4 (SD 1.4), and 3.6 (SD 1.9), respectively. Patient and personnel safety were rated as critical for most PICO questions. PICO questions and outcomes were registered with PROSPERO, an international database of prospectively registered systematic reviews. We describe formulating and refining research questions and selection of outcomes to guide systematic reviews germane to EMS fatigue risk management. We outline a protocol for applying the Model Process and GRADE framework to create evidence-based guidelines.

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise.

PubMed

Schünemann, Holger J; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brozek, Jan; Oxman, Andrew; Akl, Elie A

2014-02-18

Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date.

Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise

PubMed Central

Schünemann, Holger J.; Wiercioch, Wojtek; Etxeandia, Itziar; Falavigna, Maicon; Santesso, Nancy; Mustafa, Reem; Ventresca, Matthew; Brignardello-Petersen, Romina; Laisaar, Kaja-Triin; Kowalski, Sérgio; Baldeh, Tejan; Zhang, Yuan; Raid, Ulla; Neumann, Ignacio; Norris, Susan L.; Thornton, Judith; Harbour, Robin; Treweek, Shaun; Guyatt, Gordon; Alonso-Coello, Pablo; Reinap, Marge; Brožek, Jan; Oxman, Andrew; Akl, Elie A.

2014-01-01

Background: Although several tools to evaluate the credibility of health care guidelines exist, guidance on practical steps for developing guidelines is lacking. We systematically compiled a comprehensive checklist of items linked to relevant resources and tools that guideline developers could consider, without the expectation that every guideline would address each item. Methods: We searched data sources, including manuals of international guideline developers, literature on guidelines for guidelines (with a focus on methodology reports from international and national agencies, and professional societies) and recent articles providing systematic guidance. We reviewed these sources in duplicate, extracted items for the checklist using a sensitive approach and developed overarching topics relevant to guidelines. In an iterative process, we reviewed items for duplication and omissions and involved experts in guideline development for revisions and suggestions for items to be added. Results: We developed a checklist with 18 topics and 146 items and a webpage to facilitate its use by guideline developers. The topics and included items cover all stages of the guideline enterprise, from the planning and formulation of guidelines, to their implementation and evaluation. The final checklist includes links to training materials as well as resources with suggested methodology for applying the items. Interpretation: The checklist will serve as a resource for guideline developers. Consideration of items on the checklist will support the development, implementation and evaluation of guidelines. We will use crowdsourcing to revise the checklist and keep it up to date. PMID:24344144

Effect of various Danshen injections on patients with coronary heart disease after percutaneous coronary intervention: A protocol for a systematic review and network meta-analysis.

PubMed

Zhu, Zehao; Wang, Yuanping; Liao, Weilin; Li, Huimin; Wang, Dawei

2018-06-01

Patients with coronary heart disease (CHD) who undergo percutaneous coronary intervention (PCI) have a certain risk of vascular complications, including coronary restenosis and thrombosis. Many recent randomized controlled trials have reported that Danshen injection (DSI) combined with conventional Western medicine can significantly reduce the occurrence of major cardiovascular adverse events in patients with CHD after PCI. However, there are many types of DSIs, and no study has yet compared each type. Therefore, we propose a study protocol for the systematic evaluation of the efficacy of various DSIs in the treatment of CHD after PCI. We will search the following electronic databases for randomized controlled trials evaluating the effect of DSI in patients with CHD after PCI: PubMed, Embase, Web of Science, Cochrane Library, Scopus, Ovid Evidence-Based Medicine Reviews, China National Knowledge Infrastructure, and Chinese Biomedicine Literature Database. Each database will be searched from inception to April 2018. The entire process will include study selection, data extraction, risk of bias assessment, pairwise meta-analyses, and network meta-analyses. This proposed study will compare the efficacy of different DSIs in the treatment of patients with CHD after PCI. The outcomes will include major cardiovascular adverse events and left ventricular ejection fraction. This proposed systematic review will evaluate the different advantages of various types of DSIs in the treatment of patients with CHD after PCI. PROSPERO (registration number: CRD42018092705).

Is your prescription of distance running shoes evidence-based?

PubMed

Richards, C E; Magin, P J; Callister, R

2009-03-01

To determine whether the current practice of prescribing distance running shoes featuring elevated cushioned heels and pronation control systems tailored to the individual's foot type is evidence-based. MEDLINE (1950-May 2007), CINAHL (1982-May 2007), EMBASE (1980-May 2007), PsychInfo (1806-May 2007), Cochrane Database of Systematic Reviews (2(nd) Quarter 2007), Cochrane Central Register of Controlled trials (2(nd) Quarter 2007), SPORTSDiscus (1985-May 2007) and AMED (1985-May 2007). English language articles were identified via keyword and medical subject headings (MeSH) searches of the above electronic databases. With these searches and the subsequent review process, controlled trials or systematic reviews were sought in which the study population included adult recreational or competitive distance runners, the exposure was distance running, the intervention evaluated was a running shoe with an elevated cushioned heel and pronation control systems individualised to the wearer's foot type, and the outcome measures included either running injury rates, distance running performance, osteoarthritis risk, physical activity levels, or overall health and wellbeing. The quality of these studies and their findings were then evaluated. No original research that met the study criteria was identified either directly or via the findings of the six systematic reviews identified. The prescription of this shoe type to distance runners is not evidence-based.

A Systematic Approach for Real-Time Operator Functional State Assessment

NASA Technical Reports Server (NTRS)

Zhang, Guangfan; Wang, Wei; Pepe, Aaron; Xu, Roger; Schnell, Thomas; Anderson, Nick; Heitkamp, Dean; Li, Jiang; Li, Feng; McKenzie, Frederick

2012-01-01

A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.

The effect of rainfall measurement uncertainties on rainfall-runoff processes modelling.

PubMed

Stransky, D; Bares, V; Fatka, P

2007-01-01

Rainfall data are a crucial input for various tasks concerning the wet weather period. Nevertheless, their measurement is affected by random and systematic errors that cause an underestimation of the rainfall volume. Therefore, the general objective of the presented work was to assess the credibility of measured rainfall data and to evaluate the effect of measurement errors on urban drainage modelling tasks. Within the project, the methodology of the tipping bucket rain gauge (TBR) was defined and assessed in terms of uncertainty analysis. A set of 18 TBRs was calibrated and the results were compared to the previous calibration. This enables us to evaluate the ageing of TBRs. A propagation of calibration and other systematic errors through the rainfall-runoff model was performed on experimental catchment. It was found that the TBR calibration is important mainly for tasks connected with the assessment of peak values and high flow durations. The omission of calibration leads to up to 30% underestimation and the effect of other systematic errors can add a further 15%. The TBR calibration should be done every two years in order to catch up the ageing of TBR mechanics. Further, the authors recommend to adjust the dynamic test duration proportionally to generated rainfall intensity.

Systematic literature searching in policy relevant, inter-disciplinary reviews: an example from culture and sport.

PubMed

Schucan Bird, Karen; Tripney, Janice

2011-09-01

Within the systematic review process, the searching phase is critical to the final synthesis product, its use and value. Yet, relatively little is known about the utility of different search strategies for reviews of complex, inter-disciplinary evidence. This article used a recently completed programme of work on cultural and sporting engagement to conduct an empirical evaluation of a comprehensive search strategy. Ten different types of search source were evaluated, according to three dimensions: (i) effectiveness in identifying relevant studies; (ii) efficiency in identifying studies; and (iii) adding value by locating studies that were not identified by any other sources. The study found that general bibliographic databases and specialist databases ranked the highest on all three dimensions. Overall, websites and journals were the next most valuable types of source. For reviewers, these findings highlight that general and specialist databases should remain a core component of the comprehensive search strategy, supplemented with other types of sources that can efficiently identify unique or grey literature. For policy makers and other research commissioners, this study highlights the value of methodological analysis for improving the understanding of, and practice in, policy relevant, inter-disciplinary systematic reviews. Copyright © 2011 John Wiley & Sons, Ltd. Copyright © 2011 John Wiley & Sons, Ltd.

The application of the heuristic-systematic processing model to treatment decision making about prostate cancer.

PubMed

Steginga, Suzanne K; Occhipinti, Stefano

2004-01-01

The study investigated the utility of the Heuristic-Systematic Processing Model as a framework for the investigation of patient decision making. A total of 111 men recently diagnosed with localized prostate cancer were assessed using Verbal Protocol Analysis and self-report measures. Study variables included men's use of nonsystematic and systematic information processing, desire for involvement in decision making, and the individual differences of health locus of control, tolerance of ambiguity, and decision-related uncertainty. Most men (68%) preferred that decision making be shared equally between them and their doctor. Men's use of the expert opinion heuristic was related to men's verbal reports of decisional uncertainty and having a positive orientation to their doctor and medical care; a desire for greater involvement in decision making was predicted by a high internal locus of health control. Trends were observed for systematic information processing to increase when the heuristic strategy used was negatively affect laden and when men were uncertain about the probabilities for cure and side effects. There was a trend for decreased systematic processing when the expert opinion heuristic was used. Findings were consistent with the Heuristic-Systematic Processing Model and suggest that this model has utility for future research in applied decision making about health.

Is there a systematic bias of apparent diffusion coefficient (ADC) measurements of the breast if measured on different workstations? An inter- and intra-reader agreement study.

PubMed

Clauser, Paola; Marcon, Magda; Maieron, Marta; Zuiani, Chiara; Bazzocchi, Massimo; Baltzer, Pascal A T

2016-07-01

To evaluate the influence of post-processing systems, intra- and inter-reader agreement on the variability of apparent diffusion coefficient (ADC) measurements in breast lesions. Forty-one patients with 41 biopsy-proven breast lesions gave their informed consent and were included in this prospective IRB-approved study. Magnetic resonance imaging (MRI) examinations were performed at 1.5 T using an EPI-DWI sequence, with b-values of 0 and 1000 s/mm(2). Two radiologists (R1, R2) reviewed the images in separate sessions and measured the ADC for lesion, using MRI-workstation (S-WS), PACS-workstation (P-WS) and a commercial DICOM viewer (O-SW). Agreement was evaluated using the intraclass correlation coefficient (ICC), Bland-Altman plots and coefficient of variation (CV). Thirty-one malignant, two high-risk and eight benign mass-like lesions were analysed. Intra-reader agreement was almost perfect (ICC-R1 = 0.974; ICC-R2 = 0.990) while inter-reader agreement was substantial (ICC from 0.615 to 0.682). Bland-Altman plots revealed a significant bias in ADC values measured between O-SW and S-WS (P = 0.025), no further systematic differences were identified. CV varied from 6.8 % to 7.9 %. Post-processing systems may have a significant, although minor, impact on ADC measurements in breast lesions. While intra-reader agreement is high, the main source of ADC variability seems to be caused by inter-reader variation. • ADC provides quantitative information on breast lesions independent from the system used. • ADC measurement using different workstations and software systems is generally reliable. • Systematic, but minor, differences may occur between different post-processing systems. • Inter-reader agreement of ADC measurements exceeded intra-reader agreement.

A practical and systematic approach to organisational capacity strengthening for research in the health sector in Africa.

PubMed

Bates, Imelda; Boyd, Alan; Smith, Helen; Cole, Donald C

2014-03-03

Despite increasing investment in health research capacity strengthening efforts in low and middle income countries, published evidence to guide the systematic design and monitoring of such interventions is very limited. Systematic processes are important to underpin capacity strengthening interventions because they provide stepwise guidance and allow for continual improvement. Our objective here was to use evidence to inform the design of a replicable but flexible process to guide health research capacity strengthening that could be customized for different contexts, and to provide a framework for planning, collecting information, making decisions, and improving performance. We used peer-reviewed and grey literature to develop a five-step pathway for designing and evaluating health research capacity strengthening programmes, tested in a variety of contexts in Africa. The five steps are: i) defining the goal of the capacity strengthening effort, ii) describing the optimal capacity needed to achieve the goal, iii) determining the existing capacity gaps compared to the optimum, iv) devising an action plan to fill the gaps and associated indicators of change, and v) adapting the plan and indicators as the programme matures. Our paper describes three contrasting case studies of organisational research capacity strengthening to illustrate how our five-step approach works in practice. Our five-step pathway starts with a clear goal and objectives, making explicit the capacity required to achieve the goal. Strategies for promoting sustainability are agreed with partners and incorporated from the outset. Our pathway for designing capacity strengthening programmes focuses not only on technical, managerial, and financial processes within organisations, but also on the individuals within organisations and the wider system within which organisations are coordinated, financed, and managed. Our five-step approach is flexible enough to generate and utilise ongoing learning. We have tested and critiqued our approach in a variety of organisational settings in the health sector in sub-Saharan Africa, but it needs to be applied and evaluated in other sectors and continents to determine the extent of transferability.

Systematic reviews of animal studies; missing link in translational research?

PubMed

van Luijk, Judith; Bakker, Brenda; Rovers, Maroeska M; Ritskes-Hoitinga, Merel; de Vries, Rob B M; Leenaars, Marlies

2014-01-01

The methodological quality of animal studies is an important factor hampering the translation of results from animal studies to a clinical setting. Systematic reviews of animal studies may provide a suitable method to assess and thereby improve their methodological quality. The aims of this study were: 1) to evaluate the risk of bias assessment in animal-based systematic reviews, and 2) to study the internal validity of the primary animal studies included in these systematic reviews. We systematically searched Pubmed and Embase for SRs of preclinical animal studies published between 2005 and 2012. A total of 91 systematic reviews met our inclusion criteria. The risk of bias was assessed in 48 (52.7%) of these 91 systematic reviews. Thirty-three (36.3%) SRs provided sufficient information to evaluate the internal validity of the included studies. Of the evaluated primary studies, 24.6% was randomized, 14.6% reported blinding of the investigator/caretaker, 23.9% blinded the outcome assessment, and 23.1% reported drop-outs. To improve the translation of animal data to clinical practice, systematic reviews of animal studies are worthwhile, but the internal validity of primary animal studies needs to be improved. Furthermore, risk of bias should be assessed by systematic reviews of animal studies to provide insight into the reliability of the available evidence.

What Is the Evidence for “Food Addiction?” A Systematic Review

PubMed Central

Ariel-Donges, Aviva H.; Bauman, Viviana; Merlo, Lisa J.

2018-01-01

The diagnostic construct of “food addiction” is a highly controversial subject. The current systematic review is the first to evaluate empirical studies examining the construct of “food addiction” in humans and animals. Studies were included if they were quantitative, peer-reviewed, and in the English language. The 52 identified studies (35 articles) were qualitatively assessed to determine the extent to which their findings indicated the following addiction characteristics in relation to food: brain reward dysfunction, preoccupation, risky use, impaired control, tolerance/withdrawal, social impairment, chronicity, and relapse. Each pre-defined criterion was supported by at least one study. Brain reward dysfunction and impaired control were supported by the largest number of studies (n = 21 and n = 12, respectively); whereas risky use was supported by the fewest (n = 1). Overall, findings support food addiction as a unique construct consistent with criteria for other substance use disorder diagnoses. The evidence further suggests that certain foods, particularly processed foods with added sweeteners and fats, demonstrate the greatest addictive potential. Though both behavioral and substance-related factors are implicated in the addictive process, symptoms appear to better fit criteria for substance use disorder than behavioral addiction. Future research should explore social/role impairment, preoccupation, and risky use associated with food addiction and evaluate potential interventions for prevention and treatment. PMID:29649120

Systematic review for geo-authentic Lonicerae Japonicae Flos.

PubMed

Yang, Xingyue; Liu, Yali; Hou, Aijuan; Yang, Yang; Tian, Xin; He, Liyun

2017-06-01

In traditional Chinese medicine, Lonicerae Japonicae Flos is commonly used as anti-inflammatory, antiviral, and antipyretic herbal medicine, and geo-authentic herbs are believed to present the highest quality among all samples from different regions. To discuss the current situation and trend of geo-authentic Lonicerae Japonicae Flos, we searched Chinese Biomedicine Literature Database, Chinese Journal Full-text Database, Chinese Scientific Journal Full-text Database, Cochrane Central Register of Controlled Trials, Wanfang, and PubMed. We investigated all studies up to November 2015 pertaining to quality assessment, discrimination, pharmacological effects, planting or processing, or ecological system of geo-authentic Lonicerae Japonicae Flos. Sixty-five studies mainly discussing about chemical fingerprint, component analysis, planting and processing, discrimination between varieties, ecological system, pharmacological effects, and safety were systematically reviewed. By analyzing these studies, we found that the key points of geo-authentic Lonicerae Japonicae Flos research were quality and application. Further studies should focus on improving the quality by selecting the more superior of all varieties and evaluating clinical effectiveness.

Making Health System Performance Measurement Useful to Policy Makers: Aligning Strategies, Measurement and Local Health System Accountability in Ontario

PubMed Central

Veillard, Jeremy; Huynh, Tai; Ardal, Sten; Kadandale, Sowmya; Klazinga, Niek S.; Brown, Adalsteinn D.

2010-01-01

This study examined the experience of the Ontario Ministry of Health and Long-Term Care in enhancing its stewardship and performance management role by developing a health system strategy map and a strategy-based scorecard through a process of policy reviews and expert consultations, and linking them to accountability agreements. An evaluation of the implementation and of the effects of the policy intervention has been carried out through direct policy observation over three years, document analysis, interviews with decision-makers and systematic discussion of findings with other authors and external reviewers. Cascading strategies at health and local health system levels were identified, and a core set of health system and local health system performance indicators was selected and incorporated into accountability agreements with the Local Health Integration Networks. despite the persistence of such challenges as measurement limitations and lack of systematic linkage to decision-making processes, these activities helped to strengthen substantially the ministry's performance management function. PMID:21286268

Systematic review of innovation design contests for health: spurring innovation and mass engagement

PubMed Central

Pan, Stephen W; Stein, Gabriella; Bayus, Barry; Tang, Weiming; Mathews, Allison; Wang, Cheng; Wei, Chongyi; Tucker, Joseph D

2018-01-01

We undertook a systematic review evaluating the effectiveness and cost of health-focused innovation design contests. We followed Cochrane guidance and systematically searched eight databases. Articles were included if they reported an open contest focused on improving health, required participants submit finished design solutions and contained a prize structure. We searched 3579 citations, identifying 29 health-focused innovation design contests which collectively received 15494 contest submissions. Contests solicited submissions worldwide (7) and exclusively from North America (13), Asia (4), Africa (2), Australia (2) and Europe (1). Submissions per contest ranged from 3 to 11354 (median of 73). Contest entrants were tasked with helping develop health promotion messages (HPM) (25) and improve predictive clinical models, protocols and/or algorithms (4). Two types of contests emerged—those focused on high-quality, innovative outcomes and those focused on the process of mass community engagement. All outcome-oriented contests had innovation design contest solutions equivalent or superior to the comparator (100%; 7/7). Two of two studies found that innovation design contests saved money (100%; 2/2). Five of seven process-oriented contests concluded the contest improved at least one health indicator (71%; 5/7). Innovation design contests are an effective way to solicit innovative solutions to health problems and spur mass community engagement. PMID:29576873

Systematic review of innovation design contests for health: spurring innovation and mass engagement.

PubMed

Pan, Stephen W; Stein, Gabriella; Bayus, Barry; Tang, Weiming; Mathews, Allison; Wang, Cheng; Wei, Chongyi; Tucker, Joseph D

2017-01-01

We undertook a systematic review evaluating the effectiveness and cost of health-focused innovation design contests. We followed Cochrane guidance and systematically searched eight databases. Articles were included if they reported an open contest focused on improving health, required participants submit finished design solutions and contained a prize structure. We searched 3579 citations, identifying 29 health-focused innovation design contests which collectively received 15494 contest submissions. Contests solicited submissions worldwide (7) and exclusively from North America (13), Asia (4), Africa (2), Australia (2) and Europe (1). Submissions per contest ranged from 3 to 11354 (median of 73). Contest entrants were tasked with helping develop health promotion messages (HPM) (25) and improve predictive clinical models, protocols and/or algorithms (4). Two types of contests emerged-those focused on high-quality, innovative outcomes and those focused on the process of mass community engagement. All outcome-oriented contests had innovation design contest solutions equivalent or superior to the comparator (100%; 7/7). Two of two studies found that innovation design contests saved money (100%; 2/2). Five of seven process-oriented contests concluded the contest improved at least one health indicator (71%; 5/7). Innovation design contests are an effective way to solicit innovative solutions to health problems and spur mass community engagement.

Media milling process optimization for manufacture of drug nanoparticles using design of experiments (DOE).

PubMed

Nekkanti, Vijaykumar; Marwah, Ashwani; Pillai, Raviraj

2015-01-01

Design of experiments (DOE), a component of Quality by Design (QbD), is systematic and simultaneous evaluation of process variables to develop a product with predetermined quality attributes. This article presents a case study to understand the effects of process variables in a bead milling process used for manufacture of drug nanoparticles. Experiments were designed and results were computed according to a 3-factor, 3-level face-centered central composite design (CCD). The factors investigated were motor speed, pump speed and bead volume. Responses analyzed for evaluating these effects and interactions were milling time, particle size and process yield. Process validation batches were executed using the optimum process conditions obtained from software Design-Expert® to evaluate both the repeatability and reproducibility of bead milling technique. Milling time was optimized to <5 h to obtain the desired particle size (d90 < 400 nm). The desirability function used to optimize the response variables and observed responses were in agreement with experimental values. These results demonstrated the reliability of selected model for manufacture of drug nanoparticles with predictable quality attributes. The optimization of bead milling process variables by applying DOE resulted in considerable decrease in milling time to achieve the desired particle size. The study indicates the applicability of DOE approach to optimize critical process parameters in the manufacture of drug nanoparticles.

Comparative Evaluation of Small Molecular Additives and Their Effects on Peptide/Protein Identification.

PubMed

Gao, Jing; Zhong, Shaoyun; Zhou, Yanting; He, Han; Peng, Shuying; Zhu, Zhenyun; Liu, Xing; Zheng, Jing; Xu, Bin; Zhou, Hu

2017-06-06

Detergents and salts are widely used in lysis buffers to enhance protein extraction from biological samples, facilitating in-depth proteomic analysis. However, these detergents and salt additives must be efficiently removed from the digested samples prior to LC-MS/MS analysis to obtain high-quality mass spectra. Although filter-aided sample preparation (FASP), acetone precipitation (AP), followed by in-solution digestion, and strong cation exchange-based centrifugal proteomic reactors (CPRs) are commonly used for proteomic sample processing, little is known about their efficiencies at removing detergents and salt additives. In this study, we (i) developed an integrative workflow for the quantification of small molecular additives in proteomic samples, developing a multiple reaction monitoring (MRM)-based LC-MS approach for the quantification of six additives (i.e., Tris, urea, CHAPS, SDS, SDC, and Triton X-100) and (ii) systematically evaluated the relationships between the level of additive remaining in samples following sample processing and the number of peptides/proteins identified by mass spectrometry. Although FASP outperformed the other two methods, the results were complementary in terms of peptide/protein identification, as well as the GRAVY index and amino acid distributions. This is the first systematic and quantitative study of the effect of detergents and salt additives on protein identification. This MRM-based approach can be used for an unbiased evaluation of the performance of new sample preparation methods. Data are available via ProteomeXchange under identifier PXD005405.

Implementing a Systematic Process for Consistent Nursing Care in a NICU: A Quality Improvement Project.

PubMed

McCarley, Renay Marie; Dowling, Donna A; Dolansky, Mary A; Bieda, Amy

2018-03-01

The global aim of this quality improvement project was to develop and implement a systematic process to assign and maintain consistent bedside nurses for infants and families. A systematic process based on a primary care nursing model was implemented to assign consistent care for a 48-bed, single-family room NICU. Four PDSA cycles were necessary to obtain agreement from the nursing staff as to the best process for assigning primary nurses. Post-intervention data revealed a 9.5 percent decrease of consistent caregivers for infants in the NICU ≤ 28 days and a 2.3 percent increase of consistent caregivers for infants in the NICU ≥ 29 days. Although these findings did not meet the goal of the specific aim, a systematic process was created to assign bedside nurses to infants. Further PDSAs will be needed to refine the process to reach the aim.

KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors

PubMed Central

Lentine, Krista L.; Kasiske, Bertram L.; Levey, Andrew S.; Adams, Patricia L.; Alberú, Josefina; Bakr, Mohamed A.; Gallon, Lorenzo; Garvey, Catherine A.; Guleria, Sandeep; Li, Philip Kam-Tao; Segev, Dorry L.; Taler, Sandra J.; Tanabe, Kazunari; Wright, Linda; Zeier, Martin G.; Cheung, Michael; Garg, Amit X.

2017-01-01

Abstract The 2017 Kidney Disease: Improving Global Outcomes (KDIGO) Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors is intended to assist medical professionals who evaluate living kidney donor candidates and provide care before, during and after donation. The guideline development process followed the Grades of Recommendation Assessment, Development, and Evaluation (GRADE) approach and guideline recommendations are based on systematic reviews of relevant studies that included critical appraisal of the quality of the evidence and the strength of recommendations. However, many recommendations, for which there was no evidence or no systematic search for evidence was undertaken by the Evidence Review Team, were issued as ungraded expert opinion recommendations. The guideline work group concluded that a comprehensive approach to risk assessment should replace decisions based on assessments of single risk factors in isolation. Original data analyses were undertaken to produce a “proof-in-concept” risk-prediction model for kidney failure to support a framework for quantitative risk assessment in the donor candidate evaluation and defensible shared decision making. This framework is grounded in the simultaneous consideration of each candidate's profile of demographic and health characteristics. The processes and framework for the donor candidate evaluation are presented, along with recommendations for optimal care before, during, and after donation. Limitations of the evidence are discussed, especially regarding the lack of definitive prospective studies and clinical outcome trials. Suggestions for future research, including the need for continued refinement of long-term risk prediction and novel approaches to estimating donation-attributable risks, are also provided. In citing this document, the following format should be used: Kidney Disease: Improving Global Outcomes (KDIGO) Living Kidney Donor Work Group. KDIGO Clinical Practice Guideline on the Evaluation and Care of Living Kidney Donors. Transplantation. 2017;101(Suppl 8S):S1–S109. PMID:28742762

Coach design for the Korean high-speed train: a systematic approach to passenger seat design and layout.

PubMed

Jung, E S; Han, S H; Jung, M; Choe, J

1998-12-01

Proper ergonomic design of a passenger seat and coach layout for a high-speed train is an essential component that is directly related to passenger comfort. In this research, a systematic approach to the design of passenger seats was described and the coach layout which reflected the tradeoff between transportation capacity and passenger comfort was investigated for the Korean high-speed train. As a result, design recommendations and specifications of the passenger seat and its layout were suggested. The whole design process is composed of four stages. A survey and analysis of design requirement was first conducted, which formed the base for designing the first and second class passenger seats. Prototypes were made and evaluated iteratively, and seat arrangement and coach layout were finally obtained. The systematic approach and recommendations suggested in this study are expected to be applicable to the seat design for public transportations and to help modify and redesign existing vehicular seats.

Patient-reported outcomes in neurofibromatosis and schwannomatosis clinical trials.

PubMed

Wolters, Pamela L; Martin, Staci; Merker, Vanessa L; Gardner, Kathy L; Hingtgen, Cynthia M; Tonsgard, James H; Schorry, Elizabeth K; Baldwin, Andrea

2013-11-19

Neurofibromatosis (NF) is a genetic disease with multiple clinical manifestations that can significantly impact quality of life (QOL). Clinical trials should include patient-reported outcomes (PROs) as endpoints to assess treatment effects on various aspects of QOL, but there is no consensus on the selection and use of such measures in NF. This article describes the PRO Working Group of the Response Evaluation in Neurofibromatosis and Schwannomatosis (REiNS) Collaboration, its main goals, methods for identifying appropriate PRO measures for NF clinical trials, and recommendations for assessing pain intensity. The REiNS PRO group selected core endpoint domains important to assess in NF. The members developed criteria to rate PRO measures, including patient characteristics, psychometric properties, and feasibility, and utilized a systematic process to evaluate PROs for NF clinical trials. Within the subdomain of pain intensity, the group reviewed the Numerical Rating Scale-11 (NRS-11), the Visual Analogue Scale, and the Faces Pain Scale-Revised using this process. Based on the review criteria, each of these pain intensity scales is brief, reliable, valid, and widely used. However, the NRS-11 was given the highest rating for use in NF clinical trials due to recommendations from pain experts and other consensus groups, its extensive use in research, strong psychometric data including sensitivity to change, and excellent feasibility in ages ≥ 8 years. The systematic review criteria and process are effective for identifying appropriate PRO measures and provide information utilized by the REiNS Collaboration to achieve consensus regarding PROs in NF clinical trials.

Evaluation of the Hip: History and Physical Examination

PubMed Central

2007-01-01

Examination of a painful hip is fairly concise and reliable at detecting the presence of a hip joint problem. Hip joint disorders often go undetected, leading to the development of secondary disorders. Using a thoughtful approach and methodical examination techniques, most hip joint problems can be detected and a proper treatment strategy can then be implemented based on an accurate diagnosis. The purpose of this clinical commentary is to present a systematic examination process that outlines important components in each of the evaluation areas of history and physical examination (including inspection, measurements, symptom localization, muscle strength, and special tests). PMID:21509142

Targeting Cislunar Near Rectilinear Halo Orbits for Human Space Exploration

NASA Technical Reports Server (NTRS)

Williams, Jacob; Lee, David E.; Whitley, Ryan J.; Bokelmann, Kevin A.; Davis, Diane C.; Berry, Christopher F.

2017-01-01

Part of the challenge of charting a human exploration space architecture is finding locations to stage missions to multiple destinations. To that end, a specific subset of Earth-Moon halo orbits, known as Near Rectilinear Halo Orbits (NRHOs) are evaluated. In this paper, a systematic process for generating full ephemeris based ballistic NRHOs is outlined, different size NRHOs are examined for their favorability to avoid eclipses, the performance requirements for missions to and from NRHOs are calculated, and disposal options are evaluated. Combined, these studies confirm the feasibility of cislunar NRHOs to enable human exploration in the cislunar proving ground.

Systematic reviews of health economic evaluations: a protocol for a systematic review of characteristics and methods applied.

PubMed

Luhnen, Miriam; Prediger, Barbara; Neugebauer, Edmund A M; Mathes, Tim

2017-12-02

The number of systematic reviews of economic evaluations is steadily increasing. This is probably related to the continuing pressure on health budgets worldwide which makes an efficient resource allocation increasingly crucial. In particular in recent years, the introduction of several high-cost interventions presents enormous challenges regarding universal accessibility and sustainability of health care systems. An increasing number of health authorities, inter alia, feel the need for analyzing economic evidence. Economic evidence might effectively be generated by means of systematic reviews. Nevertheless, no standard methods seem to exist for their preparation so far. The objective of this study was to analyze the methods applied for systematic reviews of health economic evaluations (SR-HE) with a focus on the identification of common challenges. The planned study is a systematic review of the characteristics and methods actually applied in SR-HE. We will combine validated search filters developed for the retrieval of economic evaluations and systematic reviews to identify relevant studies in MEDLINE (via Ovid, 2015-present). To be eligible for inclusion, studies have to conduct a systematic review of full economic evaluations. Articles focusing exclusively on methodological aspects and secondary publications of health technology assessment (HTA) reports will be excluded. Two reviewers will independently assess titles and abstracts and then full-texts of studies for eligibility. Methodological features will be extracted in a standardized, beforehand piloted data extraction form. Data will be summarized with descriptive statistical measures and systematically analyzed focusing on differences/similarities and methodological weaknesses. The systematic review will provide a detailed overview of characteristics of SR-HE and the applied methods. Differences and methodological shortcomings will be detected and their implications will be discussed. The findings of our study can improve the recommendations on the preparation of SR-HE. This can increase the acceptance and usefulness of systematic reviews in health economics for researchers and medical decision makers. The review will not be registered with PROSPERO as it does not meet the eligibility criterion of dealing with clinical outcomes.

Development of a Nonlinear Soft-Sensor Using a GMDH Network for a Refinery Crude Distillation Tower

NASA Astrophysics Data System (ADS)

Fujii, Kenzo; Yamamoto, Toru

In atmospheric distillation processes, the stabilization of processes is required in order to optimize the crude-oil composition that corresponds to product market conditions. However, the process control systems sometimes fall into unstable states in the case where unexpected disturbances are introduced, and these unusual phenomena have had an undesirable affect on certain products. Furthermore, a useful chemical engineering model has not yet been established for these phenomena. This remains a serious problem in the atmospheric distillation process. This paper describes a new modeling scheme to predict unusual phenomena in the atmospheric distillation process using the GMDH (Group Method of Data Handling) network which is one type of network model. According to the GMDH network, the model structure can be determined systematically. However, the least squares method has been commonly utilized in determining weight coefficients (model parameters). Estimation accuracy is not entirely expected, because the sum of squared errors between the measured values and estimates is evaluated. Therefore, instead of evaluating the sum of squared errors, the sum of absolute value of errors is introduced and the Levenberg-Marquardt method is employed in order to determine model parameters. The effectiveness of the proposed method is evaluated by the foaming prediction in the crude oil switching operation in the atmospheric distillation process.

Impacts of structuring the electronic health record: Results of a systematic literature review from the perspective of secondary use of patient data.

PubMed

Vuokko, Riikka; Mäkelä-Bengs, Päivi; Hyppönen, Hannele; Lindqvist, Minna; Doupi, Persephone

2017-01-01

To explore the impacts that structuring of electronic health records (EHRs) has had from the perspective of secondary use of patient data as reflected in currently published literature. This paper presents the results of a systematic literature review aimed at answering the following questions; (1) what are the common methods of structuring patient data to serve secondary use purposes; (2) what are the common methods of evaluating patient data structuring in the secondary use context, and (3) what impacts or outcomes of EHR structuring have been reported from the secondary use perspective. The reported study forms part of a wider systematic literature review on the impacts of EHR structuring methods and evaluations of their impact. The review was based on a 12-step systematic review protocol adapted from the Cochrane methodology. Original articles included in the study were divided into three groups for analysis and reporting based on their use focus: nursing documentation, medical use and secondary use (presented in this paper). The analysis from the perspective of secondary use of data includes 85 original articles from 1975 to 2010 retrieved from 15 bibliographic databases. The implementation of structured EHRs can be roughly divided into applications for documenting patient data at the point of care and application for retrieval of patient data (post hoc structuring). Two thirds of the secondary use articles concern EHR structuring methods which were still under development or in the testing phase. of structuring patient data such as codes, terminologies, reference information models, forms or templates and documentation standards were usually applied in combination. Most of the identified benefits of utilizing structured EHR data for secondary use purposes concentrated on information content and quality or on technical quality and reliability, particularly in the case of Natural Language Processing (NLP) studies. A few individual articles evaluated impacts on care processes, productivity and costs, patient safety, care quality or other health impacts. In most articles these endpoints were usually discussed as goals of secondary use and less as evidence-supported impacts, resulting from the use of structured EHR data for secondary purposes. Further studies and more sound evaluation methods are needed for evidence on how EHRs are utilized for secondary purposes, and how structured documentation methods can serve different users' needs, e.g. administration, statistics and research and development, in parallel to medical use purposes. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Maximizing the Impact of Systematic Reviews in Health Care Decision Making: A Systematic Scoping Review of Knowledge-Translation Resources

PubMed Central

Chambers, Duncan; Wilson, Paul M; Thompson, Carl A; Hanbury, Andria; Farley, Katherine; Light, Kate

2011-01-01

Context: Barriers to the use of systematic reviews by policymakers may be overcome by resources that adapt and present the findings in formats more directly tailored to their needs. We performed a systematic scoping review to identify such knowledge-translation resources and evaluations of them. Methods: Resources were eligible for inclusion in this study if they were based exclusively or primarily on systematic reviews and were aimed at health care policymakers at the national or local level. Resources were identified by screening the websites of health technology assessment agencies and systematic review producers, supplemented by an email survey. Electronic databases and proceedings of the Cochrane Colloquium and HTA International were searched as well for published and unpublished evaluations of knowledge-translation resources. Resources were classified as summaries, overviews, or policy briefs using a previously published classification. Findings: Twenty knowledge-translation resources were identified, of which eleven were classified as summaries, six as overviews, and three as policy briefs. Resources added value to systematic reviews by, for example, evaluating their methodological quality or assessing the reliability of their conclusions or their generalizability to particular settings. The literature search found four published evaluation studies of knowledge-translation resources, and the screening of abstracts and contact with authors found three more unpublished studies. The majority of studies reported on the perceived usefulness of the service, although there were some examples of review-based resources being used to assist actual decision making. Conclusions: Systematic review producers provide a variety of resources to help policymakers, of which focused summaries are the most common. More evaluations of these resources are required to ensure users’ needs are being met, to demonstrate their impact, and to justify their funding. PMID:21418315

Processing Mode Causally Influences Emotional Reactivity

PubMed Central

Watkins, Ed; Moberly, Nicholas J.; Moulds, Michelle L.

2008-01-01

Three studies are reported showing that emotional responses to stress can be modified by systematic prior practice in adopting particular processing modes. Participants were induced to think about positive and negative scenarios in a mode either characteristic of or inconsistent with the abstract-evaluative mind-set observed in depressive rumination, via explicit instructions (Experiments 1 and 2) and via implicit induction of interpretative biases (Experiment 3), before being exposed to a failure experience. In all three studies, participants trained into the mode antithetical to depressive rumination demonstrated less emotional reactivity following failure than participants trained into the mode consistent with depressive rumination. These findings provide evidence consistent with the hypothesis that processing mode modifies emotional reactivity and support the processing-mode theory of rumination. PMID:18540752

Biodesign process and culture to enable pediatric medical technology innovation.

PubMed

Wall, James; Wynne, Elizabeth; Krummel, Thomas

2015-06-01

Innovation is the process through which new scientific discoveries are developed and promoted from bench to bedside. In an effort to encourage young entrepreneurs in this area, Stanford Biodesign developed a medical device innovation training program focused on need-based innovation. The program focuses on teaching systematic evaluation of healthcare needs, invention, and concept development. This process can be applied to any field of medicine, including Pediatric Surgery. Similar training programs have gained traction throughout the United States and beyond. Equally important to process in the success of these programs is an institutional culture that supports transformative thinking. Key components of this culture include risk tolerance, patience, encouragement of creativity, management of conflict, and networking effects. Copyright © 2015 Elsevier Inc. All rights reserved.

[Gender: new methodological approaches in guideline development].

PubMed

Weinbrenner, Susanne; Lönnfors, Sanna; Babitsch, Birgit

2010-01-01

Gender and diversity have a strong impact on health and illness as evidenced by sex and gender differences in the onset and progression of diseases as well as in diagnosis, therapy, and therapeutic outcome. The number of sex/gender-specific studies in medicine has increased steadily in recent years, indicating sex (biological) and gender (social) differences in numerous diseases. Despite this evidence, however, sex/gender differences are rarely considered in medical practice or in health systems, suggesting a delay in transferring such research into evidence-based medical treatment. Similarly, quality improvement guidelines in medical care do not systematically integrate the sex/gender perspective. Against this backdrop, this paper seeks to enumerate the necessary components of a guideline development and evaluation process that systematically integrates sex/gender differences in addition to providing a sex/gender-based methodological approach. The latter is illustrated by a pilot study in which four international guidelines on depression were selected. The sex/gender appropriateness of these guidelines was analysed using two methods: first, sex/gender-relevant words were counted; and second, relevant sex/gender differences were summarised based on a systematic literature review and then compared with the information given in the guidelines. The findings of the pilot study revealed that although strong evidence exists on sex/gender differences in depression, such research was rarely implemented in the guidelines. Given the scope and potential of guidelines to improve the quality of health care, it is essential that they consider the crucial role of sex/gender differences. To date, sex/gender differences have been insufficiently addressed in guideline development and evaluation when they should be an integral component of the process. Copyright © 2010. Published by Elsevier GmbH.

A process evaluation of systematic risk and needs assessment for caregivers in specialised palliative care.

PubMed

Thomsen, Kia Toft; Guldin, Mai-Britt; Nielsen, Mette Kjærgaard; Ollars, Chaitali Laura; Jensen, Anders Bonde

2017-04-08

Caregiving is strenuous and it may be associated with adverse psychological outcomes. During the palliative care trajectory, there are unique opportunities for providing support and preventing poor bereavement outcome. However, the tasks of palliative care staff in relation to caregivers are often unclear in the daily practice. Assessment is recommended to establish risk and needs and standards for caregiver support are available. Still, the feasibility of applying these standards among caregivers in everyday clinical practice has not been tested so far. This study tested the feasibility of an intervention based on key elements of the "Bereavement support standards for specialist palliative care services" in a Danish specialised palliative home care team. We followed the UK Medical Research Council's guidelines for the process evaluation of complex interventions. The intervention consisted of: 1. Systematic risk and needs assessment for caregivers at care entry; 2. Interdisciplinary conference to prepare a support plan; 3. Targeted support; 4. The establishment of an electronic medical record for caregivers to document targeted support. Outcomes included the reach, fidelity and acceptability of the intervention as well as the assessment of contextual factors. The intervention reached 76 of 164 caregivers (46%). The interdisciplinary risk assessment and documentation of a support plan was conducted in 57 (75%) of the enrolled caregivers. Finally, a separate medical record was established according to the intervention blueprint for 62% of caregivers receiving targeted support. After managing initial challenges, palliative care staff reported that the intervention was useful and acceptable. The intervention proved feasible and useful. Still, we identified barriers to the implementation which should be taken into consideration when planning implementation of a systematic risk and needs assessment and in the establishment of medical records for caregivers.

Factors affecting adoption, implementation fidelity, and sustainability of the Redesigned Community Health Fund in Tanzania: a mixed methods protocol for process evaluation in the Dodoma region

PubMed Central

Kalolo, Albino; Radermacher, Ralf; Stoermer, Manfred; Meshack, Menoris; De Allegri, Manuela

2015-01-01

Background Despite the implementation of various initiatives to address low enrollment in voluntary micro health insurance (MHI) schemes in sub-Saharan Africa, the problem of low enrollment remains unresolved. The lack of process evaluations of such interventions makes it difficult to ascertain whether their poor results are because of design failures or implementation weaknesses. Objective In this paper, we describe a process evaluation protocol aimed at opening the ‘black box’ to evaluate the implementation processes of the Redesigned Community Health Fund (CHF) program in the Dodoma region of Tanzania. Design The study employs a cross-sectional mixed methods design and is being carried out 3 years after the launch of the Redesigned CHF program. The study is grounded in a conceptual framework which rests on the Diffusion of Innovation Theory and the Implementation Fidelity Framework. The study utilizes a mixture of quantitative and qualitative data collection tools (questionnaires, focus group discussions, in-depth interviews, and document review), and aligns the evaluation to the Theory of Intervention developed by our team. Quantitative data will be used to measure program adoption, implementation fidelity, and their moderating factors. Qualitative data will be used to explore the responses of stakeholders to the intervention, contextual factors, and moderators of adoption, implementation fidelity, and sustainability. Discussion This protocol describes a systematic process evaluation in relation to the implementation of a reformed MHI. We trust that the theoretical approaches and methodologies described in our protocol may be useful to inform the design of future process evaluations focused on the assessment of complex interventions, such as MHI schemes. PMID:26679408

[Identification of the authentic quality of Longdanxiegan pill by systematic quantified fingerprint method based on three wavelength fusion chromatogram].

PubMed

Sun, Guoxiang; Zhang, Jingxian

2009-05-01

The three wavelength fusion high performance liquid chromatographic fingerprin (TWFFP) of Longdanxiegan pill (LDXGP) was established to identify the quality of LDXGP by the systematic quantified fingerprint method. The chromatographic fingerprints (CFPs) of the 12 batches of LDXGP were determined by reversed-phase high performance liquid chromatography. The technique of multi-wavelength fusion fingerprint was applied during processing the fingerprints. The TWFFPs containing 63 co-possessing peaks were obtained when choosing baicalin peak as the referential peak. The 12 batches of LDXGP were identified with hierarchical clustering analysis by using macro qualitative similarity (S(m)) as the variable. According to the results of classification, the referential fingerprint (RFP) was synthesized from 10 batches of LDXGP. Taking the RFP for the qualified model, all the 12 batches of LDXGP were evaluated by the systematic quantified fingerprint method. Among the 12 batches of LDXGP, 9 batches were completely qualified, the contents of 1 batch were obviously higher while the chemical constituents quantity and distributed proportion in 2 batches were not qualified. The systematic quantified fingerprint method based on the technique of multi-wavelength fusion fingerprint ca effectively identify the authentic quality of traditional Chinese medicine.

A Point Kinetics Model for Estimating Neutron Multiplication of Bare Uranium Metal in Tagged Neutron Measurements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tweardy, Matthew C.; McConchie, Seth; Hayward, Jason P.

An extension of the point kinetics model is developed in this paper to describe the neutron multiplicity response of a bare uranium object under interrogation by an associated particle imaging deuterium-tritium (D-T) measurement system. This extended model is used to estimate the total neutron multiplication of the uranium. Both MCNPX-PoliMi simulations and data from active interrogation measurements of highly enriched and depleted uranium geometries are used to evaluate the potential of this method and to identify the sources of systematic error. The detection efficiency correction for measured coincidence response is identified as a large source of systematic error. If themore » detection process is not considered, results suggest that the method can estimate total multiplication to within 13% of the simulated value. Values for multiplicity constants in the point kinetics equations are sensitive to enrichment due to (n, xn) interactions by D-T neutrons and can introduce another significant source of systematic bias. This can theoretically be corrected if isotopic composition is known a priori. Finally, the spatial dependence of multiplication is also suspected of introducing further systematic bias for high multiplication uranium objects.« less

A Point Kinetics Model for Estimating Neutron Multiplication of Bare Uranium Metal in Tagged Neutron Measurements

DOE PAGES

Tweardy, Matthew C.; McConchie, Seth; Hayward, Jason P.

2017-06-13

An extension of the point kinetics model is developed in this paper to describe the neutron multiplicity response of a bare uranium object under interrogation by an associated particle imaging deuterium-tritium (D-T) measurement system. This extended model is used to estimate the total neutron multiplication of the uranium. Both MCNPX-PoliMi simulations and data from active interrogation measurements of highly enriched and depleted uranium geometries are used to evaluate the potential of this method and to identify the sources of systematic error. The detection efficiency correction for measured coincidence response is identified as a large source of systematic error. If themore » detection process is not considered, results suggest that the method can estimate total multiplication to within 13% of the simulated value. Values for multiplicity constants in the point kinetics equations are sensitive to enrichment due to (n, xn) interactions by D-T neutrons and can introduce another significant source of systematic bias. This can theoretically be corrected if isotopic composition is known a priori. Finally, the spatial dependence of multiplication is also suspected of introducing further systematic bias for high multiplication uranium objects.« less

The N2N instrument to evaluate healthy work environments: an Italian validation.

PubMed

Palese, Alvisa; Dante, Angelo; Tonzar, Laura; Balboni, Bernardo

2014-02-01

The aims of the study were to (a) validate N2N Healthy Work Environment tool, (b) assess the healthiness of work environments as perceived by nurses themselves and (c) identify the factors associated with Italian nurses' perception of work environment healthiness. The linguistic and cultural adaptation of USA-N2N Healthy Work Environments was achieved through a process of forward/backward translation. Content validity was assessed by three expert nurses. The stability of the instrument was checked with a test/retest evaluation. The instrument psychometric properties, the confirmatory factor analysis as well the healthiness of the work environment and its determinant factors were evaluated with a sample of 294 nurses. The content and face validity of the N2N Healthy Work Environment instrument was confirmed. The instrument demonstrated good internal consistency (α of 0.82), excellent stability values (ρ > 0.70) and high levels of acceptability (response rate: 96.4 %). The confirmatory factor analysis has corroborated the existence of two factors as documented in the original instrument (Mays et al. in J Nurs Manag 19:18-26, 2011). Eighty-seven (29.6 %) nurses perceived the work environment where they work as "healthy". Working under a functional model of care delivery (χ(2) 24.856, p 0.000) and being responsible for one project or more (χ(2) 5.256, p 0.021) were associated with healthy environments. The instrument--valid and reliable, short in the number of items, easy to understand and based on international standards--allows a systematic assessment of the healthiness of the environment and might provide not only the opportunity to evaluate the effects of new organizational models and interventions, but also the possibility to activate a process of self-analysis and a process of ongoing review. The instrument can be used to systematically check the healthiness of Italian working environments, allowing for organizational diagnosis, targeted interventions and international comparisons.

Interprofessional teamwork and team interventions in chronic care: A systematic review.

PubMed

Körner, Mirjam; Bütof, Sarah; Müller, Christian; Zimmermann, Linda; Becker, Sonja; Bengel, Jürgen

2016-01-01

To identify key features of teamwork and interventions for enhancing interprofessional teamwork (IPT) in chronic care and to develop a framework for further research, we conducted a systematic literature review of IPT in chronic care for the years 2002-2014. Database searches yielded 3217 abstracts, 21 of which fulfilled inclusion criteria. We identified two more studies on the topic by scanning the reference lists of included articles, which resulted in a final total of 23 included studies. The key features identified in the articles (e.g., team member characteristics, common task, communication, cooperation, coordination, responsibility, participation, staff satisfaction, patient satisfaction, and efficiency) were structured in line with the input-process-output model, and evaluated interventions, such as tools, workshops, and changes in team structure, were added to the model. The most frequently evaluated team interventions were complex intervention programs. All but one of the 14 evaluation studies resulted in enhancement of teamwork and/or staff-related, patient-related, and organization-related outcome criteria. To date, there is no consensus about the main features of IPT and the most effective team interventions in chronic care. However, the findings may be used to standardize the implementation and evaluation of IPT and team interventions in practice and for further research.

Practitioner Review: Engaging fathers – recommendations for a game change in parenting interventions based on a systematic review of the global evidence

PubMed Central

Panter-Brick, Catherine; Burgess, Adrienne; Eggerman, Mark; McAllister, Fiona; Pruett, Kyle; Leckman, James F

2014-01-01

Background Despite robust evidence of fathers’ impact on children and mothers, engaging with fathers is one of the least well-explored and articulated aspects of parenting interventions. It is therefore critical to evaluate implicit and explicit biases manifested in current approaches to research, intervention, and policy. Methods We conducted a systematic database and a thematic hand search of the global literature on parenting interventions. Studies were selected from Medline, Psychinfo, SSCI, and Cochrane databases, and from gray literature on parenting programs, using multiple search terms for parent, father, intervention, and evaluation. We tabulated single programs and undertook systematic quality coding to review the evidence base in terms of the scope and nature of data reporting. Results After screening 786 nonduplicate records, we identified 199 publications that presented evidence on father participation and impact in parenting interventions. With some notable exceptions, few interventions disaggregate ‘father’ or ‘couple’ effects in their evaluation, being mostly driven by a focus on the mother–child dyad. We identified seven key barriers to engaging fathers in parenting programs, pertaining to cultural, institutional, professional, operational, content, resource, and policy considerations in their design and delivery. Conclusions Barriers to engaging men as parents work against father inclusion as well as father retention, and undervalue coparenting as contrasted with mothering. Robust evaluations of father participation and father impact on child or family outcomes are stymied by the ways in which parenting interventions are currently designed, delivered, and evaluated. Three key priorities are to engage fathers and coparenting couples successfully, to disaggregate process and impact data by fathers, mothers, and coparents, and to pay greater attention to issues of reach, sustainability, cost, equity, and scale-up. Clarity of purpose with respect to gender-differentiated and coparenting issues in the design, delivery, and evaluation of parenting programs will constitute a game change in this field. PMID:24980187

Application of systematic review methodology to the field of nutrition.

PubMed

Lichtenstein, Alice H; Yetley, Elizabeth A; Lau, Joseph

2008-12-01

Systematic reviews represent a rigorous and transparent approach to synthesizing scientific evidence that minimizes bias. They evolved within the medical community to support development of clinical and public health practice guidelines, set research agendas, and formulate scientific consensus statements. The use of systematic reviews for nutrition-related topics is more recent. Systematic reviews provide independently conducted comprehensive and objective assessments of available information addressing precise questions. This approach to summarizing available data is a useful tool for identifying the state of science including knowledge gaps and associated research needs, supporting development of science-based recommendations and guidelines, and serving as the foundation for updates as new data emerge. Our objective is to describe the steps for performing systematic reviews and highlight areas unique to the discipline of nutrition that are important to consider in data assessment. The steps involved in generating systematic reviews include identifying staffing and planning for outside expert input, forming a research team, developing an analytic framework, developing and refining research questions, defining eligibility criteria, identifying search terms, screening abstracts according to eligibility criteria, retrieving articles for evaluation, constructing evidence and summary tables, assessing methodological quality and applicability, and synthesizing results including performing meta-analysis, if appropriate. Unique and at times challenging, nutrition-related considerations include baseline nutrient exposure, nutrient status, bioequivalence of bioactive compounds, bioavailability, multiple and interrelated biological functions, undefined nature of some interventions, and uncertainties in intake assessment. Systematic reviews are a valuable and independent component of decision-making processes by groups responsible for developing science-based recommendations and policies.

Development of Chemical Process Design and Control for ...

EPA Pesticide Factsheets

This contribution describes a novel process systems engineering framework that couples advanced control with sustainability evaluation and decision making for the optimization of process operations to minimize environmental impacts associated with products, materials, and energy. The implemented control strategy combines a biologically inspired method with optimal control concepts for finding more sustainable operating trajectories. The sustainability assessment of process operating points is carried out by using the U.S. E.P.A.’s Gauging Reaction Effectiveness for the ENvironmental Sustainability of Chemistries with a multi-Objective Process Evaluator (GREENSCOPE) tool that provides scores for the selected indicators in the economic, material efficiency, environmental and energy areas. The indicator scores describe process performance on a sustainability measurement scale, effectively determining which operating point is more sustainable if there are more than several steady states for one specific product manufacturing. Through comparisons between a representative benchmark and the optimal steady-states obtained through implementation of the proposed controller, a systematic decision can be made in terms of whether the implementation of the controller is moving the process towards a more sustainable operation. The effectiveness of the proposed framework is illustrated through a case study of a continuous fermentation process for fuel production, whose materi

Modeling and evaluating user behavior in exploratory visual analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Reda, Khairi; Johnson, Andrew E.; Papka, Michael E.

Empirical evaluation methods for visualizations have traditionally focused on assessing the outcome of the visual analytic process as opposed to characterizing how that process unfolds. There are only a handful of methods that can be used to systematically study how people use visualizations, making it difficult for researchers to capture and characterize the subtlety of cognitive and interaction behaviors users exhibit during visual analysis. To validate and improve visualization design, however, it is important for researchers to be able to assess and understand how users interact with visualization systems under realistic scenarios. This paper presents a methodology for modeling andmore » evaluating the behavior of users in exploratory visual analysis. We model visual exploration using a Markov chain process comprising transitions between mental, interaction, and computational states. These states and the transitions between them can be deduced from a variety of sources, including verbal transcripts, videos and audio recordings, and log files. This model enables the evaluator to characterize the cognitive and computational processes that are essential to insight acquisition in exploratory visual analysis, and reconstruct the dynamics of interaction between the user and the visualization system. We illustrate this model with two exemplar user studies, and demonstrate the qualitative and quantitative analytical tools it affords.« less

The use of concept mapping in measurement development and evaluation: Application and future directions.

PubMed

Rosas, Scott R; Ridings, John W

2017-02-01

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Diagnosis and kidney-sparing treatments for upper tract urothelial carcinoma: state of the art.

PubMed

Territo, Angelo; Foerster, Bear; Shariat, Shahrokh F; Rouprêt, Morgan; Gaya, Jose M; Palou, Joan; Breda, Alberto

2018-02-01

Conservative management of upper tract urothelial cancer (UTUC) is becoming increasingly popular: the key to success is correct selection of patients with low-risk UTUC based on size (≤ 2 cm), focality (single lesion), stage (< T2), and grade (low grade). Despite the recent growing interest in the conservative approach to UTUC, the diagnostic process is still a challenge, and kidney-sparing surgery (KSS) is traditionally reserved for patients with contraindications to radical nephroureterectomy. In order to explore the "state of the art" in the diagnosis and conservative treatment of UTUC, a systematic review of the literature was performed. A PubMed, Scopus, and Cochrane search for peer-reviewed studies was performed using the keywords "upper tract urothelial carcinoma" OR "UTUC" OR "upper urinary tract" AND "biopsy" OR "diagnosis" OR "endomicroscopy" OR "imaging" AND "URS" OR "ureteroscopy" OR "kidney-sparing surgery" OR "laser ablation" OR "ureterectomy". We considered as relevant comparative prospective studies (randomized, quasi-randomized, no randomized), retrospective studies, meta-analyses, systematic reviews, and case report series written in the English language. Letters to the editor and contributions written in languages other than English were not considered of value for this review. Eligible articles were reviewed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) criteria. Two hundred and sixty-three (263) records were identified using the above-mentioned keywords. Overall, 30 studies were considered relevant for the purpose of this systematic review and for the evidence evaluation process during qualitative synthesis. The outcomes evaluated in this review were the current diagnostic methods and the KSS approaches in UTUC. Furthermore, we included in the review the emerging technology for distinguishing between normal tissue, low-grade UTUC, and high-grade UTUC. Conclusive diagnosis is fundamental to the decision-making process in patients who could benefit from conservative treatment of UTUC. The most relevant diagnostic modalities are computed tomography urography, local urine cytology, and ureteroscopy with acquisition of an adequate biopsy sample for histology. KSS includes the endourological approach and segmental ureterectomy. Promising technology in the endourological management of UTUC helps in providing intraoperative information on UTUC grading and staging, with a high accuracy. Patients treated conservatively have to undergo stringent postoperative follow-up in order to detect and, if necessary, treat any recurrence promptly. Further larger and multicenter studies are needed to confirm these findings.

Systematic, Cooperative Evaluation.

ERIC Educational Resources Information Center

Nassif, Paula M.

Evaluation procedures based on a systematic evaluation methodology, decision-maker validity, new measurement and design techniques, low cost, and a high level of cooperation on the part of the school staff were used in the assessment of a public school mathematics program for grades 3-8. The mathematics curriculum was organized into Spirals which…

Cell design and manufacturing changes during the past decade

NASA Technical Reports Server (NTRS)

Baer, D. A.

1978-01-01

Eight of the most important changes that occurred in the GE 12 AH cell over the past ten years, which are currently being used are evaluated, and a systematic approach to compare their relative merits is presented. Typical positive thickness, typical negative thickness, positive loading, negative loading, final KOH quantity, and precharge as adjustment are shown for the control cell, and the following variables: Teflon treatment; silver treatment; light loading; no PQ treatment; polypropylene separator; the A.K. 1968 plate design no PQ, old elec process, no decarb process and the A.K. 1968 plate design, no PQ, present aerospace processes. The acceptance test cell voltage and cell pressure performance and capacity test results are included.

Systematic Reviews of Animal Models: Methodology versus Epistemology

PubMed Central

Greek, Ray; Menache, Andre

2013-01-01

Systematic reviews are currently favored methods of evaluating research in order to reach conclusions regarding medical practice. The need for such reviews is necessitated by the fact that no research is perfect and experts are prone to bias. By combining many studies that fulfill specific criteria, one hopes that the strengths can be multiplied and thus reliable conclusions attained. Potential flaws in this process include the assumptions that underlie the research under examination. If the assumptions, or axioms, upon which the research studies are based, are untenable either scientifically or logically, then the results must be highly suspect regardless of the otherwise high quality of the studies or the systematic reviews. We outline recent criticisms of animal-based research, namely that animal models are failing to predict human responses. It is this failure that is purportedly being corrected via systematic reviews. We then examine the assumption that animal models can predict human outcomes to perturbations such as disease or drugs, even under the best of circumstances. We examine the use of animal models in light of empirical evidence comparing human outcomes to those from animal models, complexity theory, and evolutionary biology. We conclude that even if legitimate criticisms of animal models were addressed, through standardization of protocols and systematic reviews, the animal model would still fail as a predictive modality for human response to drugs and disease. Therefore, systematic reviews and meta-analyses of animal-based research are poor tools for attempting to reach conclusions regarding human interventions. PMID:23372426

[Characteristics of systematic reviews about the impact of pharmacists].

PubMed

Tanguay, C; Guérin, A; Bussières, J-F

2014-11-01

The pharmacists' role is varied and numerous articles evaluate the outcomes of pharmaceutical interventions. The main objectives of this study were to establish the characteristics of systematic reviews about pharmacists' interventions that were published in the last five years. A literature search was performed on Pubmed for French and English articles published between 01-01-2008 and 31-05-2013. Systematic reviews that presented the role, the interventions and the impact of pharmacists were selected by two research assistants. A total of 46 systematic reviews was identified, amongst which one third (n=15/46, 33 %) were meta-analyses. A quarter of systematic reviews did not evaluate the quality of included articles (n=13/46, 28 %). Twelve themes were identified. A median [min-max] of 16 [2-298] articles was included per systematic review. The most frequent pharmaceutical activities were patient counseling (n=41 systematic reviews), patient chart review (n=29), pharmacotherapy evaluation (n=27) and recommendations (n=26). The least frequent activities were teaching others than patients (n=12) and medical rounds participation (n=7). Many elements can influence the completion of pharmacy practice research projects; however, there exists no link between the presence of systematic reviews and the importance of pharmacists in a given healthcare program. This study presents the characteristics of 46 systematic reviews about pharmacists interventions published since 2008. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

Optimising the Efficacy of Hybrid Academic Teams: Lessons from a Systematic Review Process

ERIC Educational Resources Information Center

Lake, Warren; Wallin, Margie; Boyd, Bill; Woolcott, Geoff; Markopoulos, Christos; Boyd, Wendy; Foster, Alan

2018-01-01

Undertaking a systematic review can have many benefits, beyond any theoretical or conceptual discoveries pertaining to the underlying research question. This paper explores the value of utilising a hybrid academic team when undertaking the systematic review process, and shares a range of practical strategies. The paper also comments on how such a…

[Research on evolution and transition of quality evaluation of Shihu].

PubMed

Zhao, Yu-Jiao; Han, Bang-Xing; Peng, Hua-Sheng; Peng, Dai-Yin

2016-04-01

Shihu is one of the most valuable Chinese medicines in China. The sources of Shihu are complex and the quality evaluation of it mainly depends on morphologic characteristics distinction. In order to understand the Shihu's quality evaluation concept of Chinese herbalists in the past dynasties. This paper summarizes the methods of quality evaluation in ancient bencao systematically. The ancient bencao records that the quality of Shihu is closely related to its germplasm, habitat, processing and character. The concept of germplasm about shihu includes generalized and narrow sense, besides, the clinical applications of Dendrobium huoshanenese, D. officinale and D. nobile are focused on different diseases. D. huoshanenese has been regarded as Dao-di herbs since Qing Dynasty. The main products of Shihu contain fresh goods and dry goods, their clinical applications are also treated differently. Fengdou is one of the commodity specifications in Shihu. Its processing method probably dated from the Qing Dynasty, but now, it has become the mainstream commodityform. There was a common sense that different kinds of Shihu owed different characters and curative effects in ancient bencao, and the quality would enhance with the increasing viscidity. Therefore, the "Germplasm", "Geoherbs", "processing", "characters" were integrated into traditional quality evaluation methods of Shihu. Meanwhile, we should pay attention to the clinical efficacy of shihu with different species and processing methods. Copyright© by the Chinese Pharmaceutical Association.

Ethical and methodological issues in qualitative health research involving children: A systematic review.

PubMed

Huang, Xiaoyan; O'Connor, Margaret; Ke, Li-Shan; Lee, Susan

2016-05-01

The right of children to have their voice heard has been accepted by researchers, and there are increasing numbers of qualitative health studies involving children. The ethical and methodological issues of including children in research have caused worldwide concerns, and many researchers have published articles sharing their own experiences. To systematically review and synthesise experts' opinions and experiences about ethical and methodological issues of including children in research, as well as related solution strategies. The research design was a systematic review of opinion-based evidence, based on the guidelines by Joanna Briggs Institute. A search of five computerised databases has been conducted in April 2014 and 2271 articles were found. After screening the titles, abstracts, full texts and appraising the quality, 30 articles were finally included in the review. A meta-aggregative approach was applied in the data analysis and synthesis process. Ethical approval is not needed as it is a systematic review of published literature. Six themes were identified, including evaluating potential risks and benefits, gaining access, obtaining informed consent/assent, protecting confidentiality and privacy, building rapport and collecting rich data. The similarities and differences between research involving children and that involving adults were indicated. All potential incentives should be justified when designing the study. Further studies need to research how to evaluate individual capacity of children and how to balance protecting children's right to participate and their interests in the research. Cultural differences related to researching children in different regions should also be studied. © The Author(s) 2014.

Epidemiology characteristics, reporting characteristics, and methodological quality of systematic reviews and meta-analyses on traditional Chinese medicine nursing interventions published in Chinese journals.

PubMed

Yang, Min; Jiang, Li; Wang, Aihong; Xu, Guihua

2017-02-01

To evaluate the epidemiological characteristics, reporting characteristics, and methodological quality of systematic reviews in the traditional Chinese medicine nursing field published in Chinese journals. The number of systematic reviews in the traditional Chinese medicine nursing field has increased, but their epidemiology, quality, and reporting characteristics have not been assessed completely. We generated an overview of reviews using a narrative approach. Four Chinese databases were searched for systematic reviews from inception to December 2015. The Preferred Reporting Items of Systematic Reviews and Meta-analyses and the Assessment of Multiple Systematic Reviews checklists were adopted to evaluate reporting and methodological quality, respectively. A total of 73 eligible systematic reviews, published from 2005 to 2015, were included. The deficiencies in reporting characteristics mainly lay in the lack of structured abstract or protocol, incomplete reporting of search strategies, study selection, and risk of bias. The deficiencies in methodological quality were reflected in the lack of a priori design and conflict of interest, incomplete literature searches, and assessment of publication bias. The quality of the evaluated reviews was unsatisfactory; attention should be paid to the improvement of reporting and methodological quality in the conduct of systematic reviews. © 2016 John Wiley & Sons Australia, Ltd.

Shoreline Change and Storm-Induced Beach Erosion Modeling: A Collection of Seven Papers

DTIC Science & Technology

1990-03-01

reducing, and analyzing the data in a systematic manner. Most physical data needed for evaluating and interpreting shoreline and beach evolution processes...proposed development concepts using both physical and numerical models. b. Analyzed and interpreted model results. c. Provided technical documentation of... interpret study results in the context required for "Confirmation" hearings. 26 The Corps of Engineers, Los Angeles District (SPL), has also begun studies

How to benchmark methods for structure-based virtual screening of large compound libraries.

PubMed

Christofferson, Andrew J; Huang, Niu

2012-01-01

Structure-based virtual screening is a useful computational technique for ligand discovery. To systematically evaluate different docking approaches, it is important to have a consistent benchmarking protocol that is both relevant and unbiased. Here, we describe the designing of a benchmarking data set for docking screen assessment, a standard docking screening process, and the analysis and presentation of the enrichment of annotated ligands among a background decoy database.

A comparison of two finite element models of tidal hydrodynamics using a North Sea data set

USGS Publications Warehouse

Walters, R.A.; Werner, F.E.

1989-01-01

Using the region of the English Channel and the southern bight of the North Sea, we systematically compare the results of two independent finite element models of tidal hydrodynamics. The model intercomparison provides a means for increasing our understanding of the relevant physical processes in the region in question as well as a means for the evaluation of certain algorithmic procedures of the two models. ?? 1989.

Evidence-based practice: extending the search to find material for the systematic review

PubMed Central

Helmer, Diane; Savoie, Isabelle; Green, Carolyn; Kazanjian, Arminée

2001-01-01

Background: Cochrane-style systematic reviews increasingly require the participation of librarians. Guidelines on the appropriate search strategy to use for systematic reviews have been proposed. However, research evidence supporting these recommendations is limited. Objective: This study investigates the effectiveness of various systematic search methods used to uncover randomized controlled trials (RCTs) for systematic reviews. Effectiveness is defined as the proportion of relevant material uncovered for the systematic review using extended systematic review search methods. The following extended systematic search methods are evaluated: searching subject-specific or specialized databases (including trial registries), hand searching, scanning reference lists, and communicating personally. Methods: Two systematic review projects were prospectively monitored regarding the method used to identify items as well as the type of items retrieved. The proportion of RCTs identified by each systematic search method was calculated. Results: The extended systematic search methods uncovered 29.2% of all items retrieved for the systematic reviews. The search of specialized databases was the most effective method, followed by scanning of reference lists, communicating personally, and hand searching. Although the number of items identified through hand searching was small, these unique items would otherwise have been missed. Conclusions: Extended systematic search methods are effective tools for uncovering material for the systematic review. The quality of the items uncovered has yet to be assessed and will be key in evaluating the value of the systematic search methods. PMID:11837256

Trainee underperformance: a guide to achieving resolution.

PubMed

Rashid, Prem; Grills, Richard; Kuan, Melvyn; Klein, Deborah

2015-05-01

Underperformance and the disharmony it can cause are not commonly faced by trainees. However, when it occurs, a process to recognize and manage the issues compassionately must be put in place. A literature review was undertaken to outline processes and themes in addressing and resolving these types of issues. A PubMed search using 'surgical underperformance' and 'remedial teaching' was used as a broad template to find papers that illustrated key concepts. One thousand four hundred and fifteen papers were identified. In papers where the titles were in line with the stated topic, 294 abstracts were reviewed. Key papers were used to develop themes. Additional cross-referenced papers were also included where relevant. There can be a variety of reasons for trainee underperformance. The root cause is not always clear. Disharmony can result in a surgical unit during this time. The involved trainee as well as the members of the clinical unit may experience a variety of stressors. A systematic process of management can be used to evaluate the situation and bring some resolution to difficulties in working relationships. Early constructive intervention improves outcomes. There should be a process to systematically and compassionately resolve underlying issues. This paper outlines the disharmony that can result from trainee underperformance and offers guidance for resolution to those involved. © 2014 Royal Australasian College of Surgeons.

Integrating utilization-focused evaluation with business process modeling for clinical research improvement.

PubMed

Kagan, Jonathan M; Rosas, Scott; Trochim, William M K

2010-10-01

New discoveries in basic science are creating extraordinary opportunities to design novel biomedical preventions and therapeutics for human disease. But the clinical evaluation of these new interventions is, in many instances, being hindered by a variety of legal, regulatory, policy and operational factors, few of which enhance research quality, the safety of study participants or research ethics. With the goal of helping increase the efficiency and effectiveness of clinical research, we have examined how the integration of utilization-focused evaluation with elements of business process modeling can reveal opportunities for systematic improvements in clinical research. Using data from the NIH global HIV/AIDS clinical trials networks, we analyzed the absolute and relative times required to traverse defined phases associated with specific activities within the clinical protocol lifecycle. Using simple median duration and Kaplan-Meyer survival analysis, we show how such time-based analyses can provide a rationale for the prioritization of research process analysis and re-engineering, as well as a means for statistically assessing the impact of policy modifications, resource utilization, re-engineered processes and best practices. Successfully applied, this approach can help researchers be more efficient in capitalizing on new science to speed the development of improved interventions for human disease.

SEIPS-based process modeling in primary care.

PubMed

Wooldridge, Abigail R; Carayon, Pascale; Hundt, Ann Schoofs; Hoonakker, Peter L T

2017-04-01

Process mapping, often used as part of the human factors and systems engineering approach to improve care delivery and outcomes, should be expanded to represent the complex, interconnected sociotechnical aspects of health care. Here, we propose a new sociotechnical process modeling method to describe and evaluate processes, using the SEIPS model as the conceptual framework. The method produces a process map and supplementary table, which identify work system barriers and facilitators. In this paper, we present a case study applying this method to three primary care processes. We used purposeful sampling to select staff (care managers, providers, nurses, administrators and patient access representatives) from two clinics to observe and interview. We show the proposed method can be used to understand and analyze healthcare processes systematically and identify specific areas of improvement. Future work is needed to assess usability and usefulness of the SEIPS-based process modeling method and further refine it. Copyright © 2016 Elsevier Ltd. All rights reserved.

SEIPS-Based Process Modeling in Primary Care

PubMed Central

Wooldridge, Abigail R.; Carayon, Pascale; Hundt, Ann Schoofs; Hoonakker, Peter

2016-01-01

Process mapping, often used as part of the human factors and systems engineering approach to improve care delivery and outcomes, should be expanded to represent the complex, interconnected sociotechnical aspects of health care. Here, we propose a new sociotechnical process modeling method to describe and evaluate processes, using the SEIPS model as the conceptual framework. The method produces a process map and supplementary table, which identify work system barriers and facilitators. In this paper, we present a case study applying this method to three primary care processes. We used purposeful sampling to select staff (care managers, providers, nurses, administrators and patient access representatives) from two clinics to observe and interview. We show the proposed method can be used to understand and analyze healthcare processes systematically and identify specific areas of improvement. Future work is needed to assess usability and usefulness of the SEIPS-based process modeling method and further refine it. PMID:28166883

Software Quality Evaluation Models Applicable in Health Information and Communications Technologies. A Review of the Literature.

PubMed

Villamor Ordozgoiti, Alberto; Delgado Hito, Pilar; Guix Comellas, Eva María; Fernandez Sanchez, Carlos Manuel; Garcia Hernandez, Milagros; Lluch Canut, Teresa

2016-01-01

Information and Communications Technologies in healthcare has increased the need to consider quality criteria through standardised processes. The aim of this study was to analyse the software quality evaluation models applicable to healthcare from the perspective of ICT-purchasers. Through a systematic literature review with the keywords software, product, quality, evaluation and health, we selected and analysed 20 original research papers published from 2005-2016 in health science and technology databases. The results showed four main topics: non-ISO models, software quality evaluation models based on ISO/IEC standards, studies analysing software quality evaluation models, and studies analysing ISO standards for software quality evaluation. The models provide cost-efficiency criteria for specific software, and improve use outcomes. The ISO/IEC25000 standard is shown as the most suitable for evaluating the quality of ICTs for healthcare use from the perspective of institutional acquisition.

Systematic development of a theory-informed multifaceted behavioural intervention to increase physical activity of adults with type 2 diabetes in routine primary care: Movement as Medicine for Type 2 Diabetes.

PubMed

Avery, Leah; Charman, Sarah J; Taylor, Louise; Flynn, Darren; Mosely, Kylie; Speight, Jane; Lievesley, Matthew; Taylor, Roy; Sniehotta, Falko F; Trenell, Michael I

2016-07-19

Despite substantial evidence for physical activity (PA) as a management option for type 2 diabetes, there remains a lack of PA behavioural interventions suitable for delivery in primary care. This paper describes the systematic development of an evidence-informed PA behavioural intervention for use during routine primary care consultations. In accordance with the Medical Research Council Framework for the Development and Evaluation of Complex Interventions, a four-stage systematic development process was undertaken: (1) exploratory work involving interviews and workshop discussions identified training needs of healthcare professionals and support needs of adults with type 2 diabetes; (2) a systematic review with meta- and moderator analyses identified behaviour change techniques and optimal intervention intensity and duration; (3) usability testing identified strategies to increase implementation of the intervention in primary care and (4) an open pilot study in two primary care practices facilitated intervention optimisation. Healthcare professional training needs included knowledge about type, intensity and duration of PA sufficient to improve glycaemic control and acquisition of skills to promote PA behaviour change. Patients lacked knowledge about type 2 diabetes and skills to enable them to make sustainable changes to their level of PA. An accredited online training programme for healthcare professionals and a professional-delivered behavioural intervention for adults with type 2 diabetes were subsequently developed. This multifaceted intervention was informed by the theory of planned behaviour and social cognitive theory and consisted of 15 behaviour change techniques. Intervention intensity and duration were informed by a systematic review. Usability testing resolved technical problems with the online training intervention that facilitated use on practice IT systems. An open pilot study of the intervention with fidelity of delivery assessment informed optimisation and identified mechanisms to enhance implementation of the intervention during routine diabetes consultations. Movement as Medicine for Type 2 diabetes represents an evidence-informed multifaceted behavioural intervention targeting PA for management of type 2 diabetes developed for delivery in primary care. The structured development process undertaken enhances transparency of intervention content, replicability and scalability. Movement as Medicine for Type 2 diabetes is currently undergoing evaluation in a pilot RCT. ISRCTN67997502.

Properties of pellets manufactured by wet extrusion/spheronization process using kappa-carrageenan: effect of process parameters.

PubMed

Thommes, Markus; Kleinebudde, Peter

2007-11-09

The aim of this study was to systematically evaluate the pelletization process parameters of kappa-carrageenan-containing formulations. The study dealt with the effect of 4 process parameters--screw speed, number of die holes, friction plate speed, and spheronizer temperature--on the pellet properties of shape, size, size distribution, tensile strength, and drug release. These parameters were varied systematically in a 2(4) full factorial design. In addition, 4 drugs--phenacetin, chloramphenicol, dimenhydrinate, and lidocaine hydrochloride--were investigated under constant process conditions. The most spherical pellets were achieved in a high yield by using a large number of die holes and a high spheronizer speed. There was no relevant influence of the investigated process parameters on the size distribution, mechanical stability, and drug release. The poorly soluble drugs, phenacetin and chloramphenicol, resulted in pellets with adequate shape, size, and tensile strength and a fast drug release. The salts of dimenhydrinate and lidocaine affected pellet shape, mechanical stability, and the drug release properties using an aqueous solution of pH 3 as a granulation liquid. In the case of dimenhydrinate, this was attributed to the ionic interactions with kappa-carrageenan, resulting in a stable matrix during dissolution that did not disintegrate. The effect of lidocaine is comparable to the effect of sodium ions, which suppress the gelling of carrageenan, resulting in pellets with fast disintegration and drug release characteristics. The pellet properties are affected by the process parameters and the active pharmaceutical ingredient used.

Publication bias in dermatology systematic reviews and meta-analyses.

PubMed

Atakpo, Paul; Vassar, Matt

2016-05-01

Systematic reviews and meta-analyses in dermatology provide high-level evidence for clinicians and policy makers that influence clinical decision making and treatment guidelines. One methodological problem with systematic reviews is the under representation of unpublished studies. This problem is due in part to publication bias. Omission of statistically non-significant data from meta-analyses may result in overestimation of treatment effect sizes which may lead to clinical consequences. Our goal was to assess whether systematic reviewers in dermatology evaluate and report publication bias. Further, we wanted to conduct our own evaluation of publication bias on meta-analyses that failed to do so. Our study considered systematic reviews and meta-analyses from ten dermatology journals from 2006 to 2016. A PubMed search was conducted, and all full-text articles that met our inclusion criteria were retrieved and coded by the primary author. 293 articles were included in our analysis. Additionally, we formally evaluated publication bias in meta-analyses that failed to do so using trim and fill and cumulative meta-analysis by precision methods. Publication bias was mentioned in 107 articles (36.5%) and was formally evaluated in 64 articles (21.8%). Visual inspection of a funnel plot was the most common method of evaluating publication bias. Publication bias was present in 45 articles (15.3%), not present in 57 articles (19.5%) and not determined in 191 articles (65.2%). Using the trim and fill method, 7 meta-analyses (33.33%) showed evidence of publication bias. Although the trim and fill method only found evidence of publication bias in 7 meta-analyses, the cumulative meta-analysis by precision method found evidence of publication bias in 15 meta-analyses (71.4%). Many of the reviews in our study did not mention or evaluate publication bias. Further, of the 42 articles that stated following PRISMA reporting guidelines, 19 (45.2%) evaluated for publication bias. In comparison to other studies, we found that systematic reviews in dermatology were less likely to evaluate for publication bias. Evaluating and reporting the likelihood of publication bias should be standard practice in systematic reviews when appropriate. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Distance and near visual acuity improvement after implantation of multifocal intraocular lenses in cataract patients with presbyopia: a systematic review.

PubMed

Agresta, Blaise; Knorz, Michael C; Kohnen, Thomas; Donatti, Christina; Jackson, Daniel

2012-06-01

To evaluate uncorrected distance visual acuity (UDVA) as well as uncorrected near visual acuity (UNVA) as outcomes in treating presbyopic cataract patients to assist clinicians and ophthalmologists in their decision-making process regarding available interventions. Medline, Embase, and Evidence Based Medicine Reviews were systematically reviewed to identify studies reporting changes in UDVA and UNVA after cataract surgery in presbyopic patients. Strict inclusion/exclusion criteria were used to exclude any studies not reporting uncorrected visual acuity in a presbyopic population with cataracts implanted with multifocal intraocular lenses (IOLs). Relevant outcomes (UDVA and UNVA) were identified from the studies retrieved through the systematic review process. Twenty-nine studies were identified that reported uncorrected visual acuities, including one study that reported uncorrected intermediate visual acuity. Nine brands of multifocal IOLs were identified in the search. All studies identified in the literature search reported improvements in UDVA and UNVA following multifocal IOL implantation. The largest improvements in visual acuity were reported using the Rayner M-Flex lens (Rayner Intraocular Lenses Ltd) (UDVA, binocular: 1.05 logMAR, monocular: 0.92 logMAR; UNVA, binocular and monocular: 0.83 logMAR) and the smallest improvements were reported using the Acri.LISA lens (Carl Zeiss Meditec) (UDVA, 0.21 decimal; UNVA, 0.51 decimal). The results of this systematic review show the aggregate of studies reporting a beneficial increase in UDVA and UNVA with the use of multifocal IOLs in cataract patients with presbyopia, hence providing evidence to support the hypothesis that multifocal IOLs increase UDVA and UNVA in cataract patients. Copyright 2012, SLACK Incorporated.

A Systematic Evaluation of Blood Serum and Plasma Pre-Analytics for Metabolomics Cohort Studies

PubMed Central

Jobard, Elodie; Trédan, Olivier; Postoly, Déborah; André, Fabrice; Martin, Anne-Laure; Elena-Herrmann, Bénédicte; Boyault, Sandrine

2016-01-01

The recent thriving development of biobanks and associated high-throughput phenotyping studies requires the elaboration of large-scale approaches for monitoring biological sample quality and compliance with standard protocols. We present a metabolomic investigation of human blood samples that delineates pitfalls and guidelines for the collection, storage and handling procedures for serum and plasma. A series of eight pre-processing technical parameters is systematically investigated along variable ranges commonly encountered across clinical studies. While metabolic fingerprints, as assessed by nuclear magnetic resonance, are not significantly affected by altered centrifugation parameters or delays between sample pre-processing (blood centrifugation) and storage, our metabolomic investigation highlights that both the delay and storage temperature between blood draw and centrifugation are the primary parameters impacting serum and plasma metabolic profiles. Storing the blood drawn at 4 °C is shown to be a reliable routine to confine variability associated with idle time prior to sample pre-processing. Based on their fine sensitivity to pre-analytical parameters and protocol variations, metabolic fingerprints could be exploited as valuable ways to determine compliance with standard procedures and quality assessment of blood samples within large multi-omic clinical and translational cohort studies. PMID:27929400

Using Green Chemistry and Engineering Principles to Design ...

EPA Pesticide Factsheets

The concepts of green chemistry and engineering (GC&E) have been promoted as an effective qualitative framework for developing more sustainable chemical syntheses, processes, and material management techniques. This has been demonstrated by many theoretical and practical cases. In addition, there are several approaches and frameworks focused on demonstrating that improvements were achieved through GC&E technologies. However, the application of these principles is not always straightforward. We propose using systematic frameworks and tools that help practitioners when deciding which principles can be applied, the levels of implementation, prospective of obtaining simultaneous improvements in all sustainability aspects, and ways to deal with multiobjective problems. Therefore, this contribution aims to provide a systematic combination of three different and complementary design tools for assisting designers in evaluating, developing, and improving chemical manufacturing and material management systems under GC&E perspectives. The WAR Algorithm, GREENSCOPE, and SustainPro were employed for this synergistic approach of incorporating sustainability at early stages of process development. In this demonstration, simulated ammonia production is used as a case study to illustrate this advancement. Results show how to identify process design areas for improvements, key factors, multi-criteria decision-making solutions, and optimal tradeoffs. Finally, conclusions were pre

Photolithography diagnostic expert systems: a systematic approach to problem solving in a wafer fabrication facility

NASA Astrophysics Data System (ADS)

Weatherwax Scott, Caroline; Tsareff, Christopher R.

1990-06-01

One of the main goals of process engineering in the semiconductor industry is to improve wafer fabrication productivity and throughput. Engineers must work continuously toward this goal in addition to performing sustaining and development tasks. To accomplish these objectives, managers must make efficient use of engineering resources. One of the tools being used to improve efficiency is the diagnostic expert system. Expert systems are knowledge based computer programs designed to lead the user through the analysis and solution of a problem. Several photolithography diagnostic expert systems have been implemented at the Hughes Technology Center to provide a systematic approach to process problem solving. This systematic approach was achieved by documenting cause and effect analyses for a wide variety of processing problems. This knowledge was organized in the form of IF-THEN rules, a common structure for knowledge representation in expert system technology. These rules form the knowledge base of the expert system which is stored in the computer. The systems also include the problem solving methodology used by the expert when addressing a problem in his area of expertise. Operators now use the expert systems to solve many process problems without engineering assistance. The systems also facilitate the collection of appropriate data to assist engineering in solving unanticipated problems. Currently, several expert systems have been implemented to cover all aspects of the photolithography process. The systems, which have been in use for over a year, include wafer surface preparation (HMDS), photoresist coat and softbake, align and expose on a wafer stepper, and develop inspection. These systems are part of a plan to implement an expert system diagnostic environment throughout the wafer fabrication facility. In this paper, the systems' construction is described, including knowledge acquisition, rule construction, knowledge refinement, testing, and evaluation. The roles played by the process engineering expert and the knowledge engineer are discussed. The features of the systems are shown, particularly the interactive quality of the consultations and the ease of system use.

Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review.

PubMed

Hemens, Brian J; Holbrook, Anne; Tonkin, Marita; Mackay, Jean A; Weise-Kelly, Lorraine; Navarro, Tamara; Wilczynski, Nancy L; Haynes, R Brian

2011-08-03

Computerized clinical decision support systems (CCDSSs) for drug therapy management are designed to promote safe and effective medication use. Evidence documenting the effectiveness of CCDSSs for improving drug therapy is necessary for informed adoption decisions. The objective of this review was to systematically review randomized controlled trials assessing the effects of CCDSSs for drug therapy management on process of care and patient outcomes. We also sought to identify system and study characteristics that predicted benefit. We conducted a decision-maker-researcher partnership systematic review. We updated our earlier reviews (1998, 2005) by searching MEDLINE, EMBASE, EBM Reviews, Inspec, and other databases, and consulting reference lists through January 2010. Authors of 82% of included studies confirmed or supplemented extracted data. We included only randomized controlled trials that evaluated the effect on process of care or patient outcomes of a CCDSS for drug therapy management compared to care provided without a CCDSS. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive. Sixty-five studies met our inclusion criteria, including 41 new studies since our previous review. Methodological quality was generally high and unchanged with time. CCDSSs improved process of care performance in 37 of the 59 studies assessing this type of outcome (64%, 57% of all studies). Twenty-nine trials assessed patient outcomes, of which six trials (21%, 9% of all trials) reported improvements. CCDSSs inconsistently improved process of care measures and seldomly improved patient outcomes. Lack of clear patient benefit and lack of data on harms and costs preclude a recommendation to adopt CCDSSs for drug therapy management.

Do changes to supply chains and procurement processes yield cost savings and improve availability of pharmaceuticals, vaccines or health products? A systematic review of evidence from low-income and middle-income countries

PubMed Central

Atun, Rifat

2017-01-01

Introduction Improving health systems performance, especially in low-resource settings facing complex disease burdens, can improve population health. Specifically, the efficiency and effectiveness of supply chains and procurement processes for pharmaceuticals, vaccines and other health products has important implications for health system performance. Pharmaceuticals, vaccines and other health products make up a large share of total health expenditure in low-income and middle-income countries (LMICs), and they are critical for delivering health services. Therefore, programmes which achieve cost savings on these expenditures may help improve a health system's efficiency, whereas programmes that increase availability of health products may improve a health system's effectiveness. This systematic review investigates whether changes to supply chains and procurement processes can achieve cost savings and/or improve the availability of drugs in LMICs. Methods Using the PRISMA guidelines for systematic reviews, we searched PubMed, Embase, CINAHL and the Health Economic Evaluation Database to identify. Results We identified 1264 articles, of which 38 were included in our study. We found evidence that centralised procurement and tendering can achieve direct cost savings, while supply chain management programmes can reduce drug stock outs and increase drug availability for populations. Conclusions This research identifies a broad set of programmes which can improve the ways that health systems purchase and delivery health products. On the basis of this evidence, policymakers and programme managers should examine the root causes of inefficiencies in pharmaceutical supply chain and procurement processes in order to determine how best to improve health systems performance in their specific contexts. PMID:28589028

Do changes to supply chains and procurement processes yield cost savings and improve availability of pharmaceuticals, vaccines or health products? A systematic review of evidence from low-income and middle-income countries.

PubMed

Seidman, Gabriel; Atun, Rifat

2017-01-01

Improving health systems performance, especially in low-resource settings facing complex disease burdens, can improve population health. Specifically, the efficiency and effectiveness of supply chains and procurement processes for pharmaceuticals, vaccines and other health products has important implications for health system performance. Pharmaceuticals, vaccines and other health products make up a large share of total health expenditure in low-income and middle-income countries (LMICs), and they are critical for delivering health services. Therefore, programmes which achieve cost savings on these expenditures may help improve a health system's efficiency, whereas programmes that increase availability of health products may improve a health system's effectiveness. This systematic review investigates whether changes to supply chains and procurement processes can achieve cost savings and/or improve the availability of drugs in LMICs. Using the PRISMA guidelines for systematic reviews, we searched PubMed, Embase, CINAHL and the Health Economic Evaluation Database to identify. We identified 1264 articles, of which 38 were included in our study. We found evidence that centralised procurement and tendering can achieve direct cost savings, while supply chain management programmes can reduce drug stock outs and increase drug availability for populations. This research identifies a broad set of programmes which can improve the ways that health systems purchase and delivery health products. On the basis of this evidence, policymakers and programme managers should examine the root causes of inefficiencies in pharmaceutical supply chain and procurement processes in order to determine how best to improve health systems performance in their specific contexts.

Development of clinical process measures for pediatric burn care: Understanding variation in practice patterns.

PubMed

Kazis, Lewis E; Sheridan, Robert L; Shapiro, Gabriel D; Lee, Austin F; Liang, Matthew H; Ryan, Colleen M; Schneider, Jeffrey C; Lydon, Martha; Soley-Bori, Marina; Sonis, Lily A; Dore, Emily C; Palmieri, Tina; Herndon, David; Meyer, Walter; Warner, Petra; Kagan, Richard; Stoddard, Frederick J; Murphy, Michael; Tompkins, Ronald G

2018-04-01

There has been little systematic examination of variation in pediatric burn care clinical practices and its effect on outcomes. As a first step, current clinical care processes need to be operationally defined. The highly specialized burn care units of the Shriners Hospitals for Children system present an opportunity to describe the processes of care. The aim of this study was to develop a set of process-based measures for pediatric burn care and examine adherence to them by providers in a cohort of pediatric burn patients. We conducted a systematic literature review to compile a set of process-based indicators. These measures were refined by an expert panel of burn care providers, yielding 36 process-based indicators in four clinical areas: initial evaluation and resuscitation, acute excisional surgery and critical care, psychosocial and pain control, and reconstruction and aftercare. We assessed variability in adherence to the indicators in a cohort of 1,076 children with burns at four regional pediatric burn programs in the Shriners Hospital system. The percentages of the cohort at each of the four sites were as follows: Boston, 20.8%; Cincinnati, 21.1%; Galveston, 36.0%; and Sacramento, 22.1%. The cohort included children who received care between 2006 and 2010. Adherence to the process indicators varied both across sites and by clinical area. Adherence was lowest for the clinical areas of acute excisional surgery and critical care, with a range of 35% to 48% across sites, followed by initial evaluation and resuscitation (range, 34%-60%). In contrast, the clinical areas of psychosocial and pain control and reconstruction and aftercare had relatively high adherence across sites, with ranges of 62% to 93% and 71% to 87%, respectively. Of the 36 process indicators, 89% differed significantly in adherence between clinical sites (p < 0.05). Acute excisional surgery and critical care exhibited the most variability. The development of this set of process-based measures represents an important step in the assessment of clinical practice in pediatric burn care. Substantial variation was observed in practices of pediatric burn care. However, further research is needed to link these process-based measures to clinical outcomes. Therapeutic/care management, level IV.

Disentangling the influence of value predispositions and risk/benefit perceptions on support for nanotechnology among the American public.

PubMed

Kim, Jiyoun; Yeo, Sara K; Brossard, Dominique; Scheufele, Dietram A; Xenos, Michael A

2014-05-01

Using nanotechnology as a case study, this article explores (1) how people's perceptions of benefits and risks are related to their approval of nanotechnology, (2) which information-processing factors contribute to public risk/benefit perceptions, and (3) whether individuals' predispositions (i.e., deference to scientific authority and ideology) may moderate the relationship between cognitive processing and risk perceptions of the technology. Results indicate that benefit perceptions positively affect public support for nanotechnology; perceptions of risk tend to be more influenced by systematic processing than by heuristic cues, whereas both heuristic and systematic processing influence benefit perceptions. People who are more liberal-minded tend to be more affected by systematic processing when thinking about the benefits of nanotechnology than those who are more conservative. Compared to less deferent individuals, those who are more deferent to scientific authority tend to be less influenced by systematic processing when making judgments about the benefits and risks of nanotechnology. Implications are discussed. © 2013 Society for Risk Analysis.

Improving Human Services: Methods for Systematic Planning, Evaluation, and Staff Development.

ERIC Educational Resources Information Center

Jones, G. Brian; And Others

This monograph speaks to the basic problems confronting human services programs, and offers suggestions for improving guidance services. Specific concerns addressed are: (1) the need for more systematic program planning and evaluation; (2) an approach to effective planning and evaluation; (3) development of staff skills for use in the…

Effect of Processing Conditions on the Anelastic Behavior of Plasma Sprayed Thermal Barrier Coatings

NASA Astrophysics Data System (ADS)

Viswanathan, Vaishak

2011-12-01

Plasma sprayed ceramic materials contain an assortment of micro-structural defects, including pores, cracks, and interfaces arising from the droplet based assemblage of the spray deposition technique. The defective architecture of the deposits introduces a novel "anelastic" response in the coatings comprising of their non-linear and hysteretic stress-strain relationship under mechanical loading. It has been established that this anelasticity can be attributed to the relative movement of the embedded defects under varying stresses. While the non-linear response of the coatings arises from the opening/closure of defects, hysteresis is produced by the frictional sliding among defect surfaces. Recent studies have indicated that anelastic behavior of coatings can be a unique descriptor of their mechanical behavior and related to the defect configuration. In this dissertation, a multi-variable study employing systematic processing strategies was conducted to augment the understanding on various aspects of the reported anelastic behavior. A bi-layer curvature measurement technique was adapted to measure the anelastic properties of plasma sprayed ceramic. The quantification of anelastic parameters was done using a non-linear model proposed by Nakamura et.al. An error analysis was conducted on the technique to know the available margins for both experimental as well as computational errors. The error analysis was extended to evaluate its sensitivity towards different coating microstructure. For this purpose, three coatings with significantly different microstructures were fabricated via tuning of process parameters. Later the three coatings were also subjected to different strain ranges systematically, in order to understand the origin and evolution of anelasticity on different microstructures. The last segment of this thesis attempts to capture the intricacies on the processing front and tries to evaluate and establish a correlation between them and the anelastic parameters.

Tool for evaluating research implementation challenges: A sense-making protocol for addressing implementation challenges in complex research settings

PubMed Central

2013-01-01

Background Many challenges arise in complex organizational interventions that threaten research integrity. This article describes a Tool for Evaluating Research Implementation Challenges (TECH), developed using a complexity science framework to assist research teams in assessing and managing these challenges. Methods During the implementation of a multi-site, randomized controlled trial (RCT) of organizational interventions to reduce resident falls in eight nursing homes, we inductively developed, and later codified the TECH. The TECH was developed through processes that emerged from interactions among research team members and nursing home staff participants, including a purposive use of complexity science principles. Results The TECH provided a structure to assess challenges systematically, consider their potential impact on intervention feasibility and fidelity, and determine actions to take. We codified the process into an algorithm that can be adopted or adapted for other research projects. We present selected examples of the use of the TECH that are relevant to many complex interventions. Conclusions Complexity theory provides a useful lens through which research procedures can be developed to address implementation challenges that emerge from complex organizations and research designs. Sense-making is a group process in which diverse members interpret challenges when available information is ambiguous; the groups’ interpretations provide cues for taking action. Sense-making facilitates the creation of safe environments for generating innovative solutions that balance research integrity and practical issues. The challenges encountered during implementation of complex interventions are often unpredictable; however, adoption of a systematic process will allow investigators to address them in a consistent yet flexible manner, protecting fidelity. Research integrity is also protected by allowing for appropriate adaptations to intervention protocols that preserve the feasibility of ‘real world’ interventions. PMID:23281623

Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations.

PubMed

Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C

2015-03-10

In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross-organizational findings about implementing healthcare innovations while also enhancing organizational capacity and accelerating translation of findings by facilitating continuous learning within individual sites. Researchers evaluating change initiatives and healthcare organizations implementing improvement initiatives may benefit from a Learning Evaluation approach.

Project evaluation and selection using fuzzy Delphi method and zero - one goal programming

NASA Astrophysics Data System (ADS)

Alias, Suriana; Adna, Nofarziah; Arsad, Roslah; Soid, Siti Khuzaimah; Ali, Zaileha Md

2014-12-01

Project evaluation and selection is a factor affecting the impotence of board director in which is trying to maximize all the possible goals. Assessment of the problem occurred in organization plan is the first phase for decision making process. The company needs a group of expert to evaluate the problems. The Fuzzy Delphi Method (FDM) is a systematic procedure to evoke the group's opinion in order to get the best result to evaluate the project performance. This paper proposes an evaluation and selection of the best alternative project based on combination of FDM and Zero - One Goal Programming (ZOGP) formulation. ZOGP is used to solve the multi-criteria decision making for final decision part by using optimization software LINDO 6.1. An empirical example on an ongoing decision making project in Johor, Malaysia is implemented for case study.

Bridging the gap between neurocognitive processing theory and performance validity assessment among the cognitively impaired: a review and methodological approach.

PubMed

Leighton, Angela; Weinborn, Michael; Maybery, Murray

2014-10-01

Bigler (2012) and Larrabee (2012) recently addressed the state of the science surrounding performance validity tests (PVTs) in a dialogue highlighting evidence for the valid and increased use of PVTs, but also for unresolved problems. Specifically, Bigler criticized the lack of guidance from neurocognitive processing theory in the PVT literature. For example, individual PVTs have applied the simultaneous forced-choice methodology using a variety of test characteristics (e.g., word vs. picture stimuli) with known neurocognitive processing implications (e.g., the "picture superiority effect"). However, the influence of such variations on classification accuracy has been inadequately evaluated, particularly among cognitively impaired individuals. The current review places the PVT literature in the context of neurocognitive processing theory, and identifies potential methodological factors to account for the significant variability we identified in classification accuracy across current PVTs. We subsequently evaluated the utility of a well-known cognitive manipulation to provide a Clinical Analogue Methodology (CAM), that is, to alter the PVT performance of healthy individuals to be similar to that of a cognitively impaired group. Initial support was found, suggesting the CAM may be useful alongside other approaches (analogue malingering methodology) for the systematic evaluation of PVTs, particularly the influence of specific neurocognitive processing components on performance.

The Quality of Systematic Reviews in Head and Neck Microsurgery: A Perspective from Plastic Surgery and Otolaryngology.

PubMed

Sun, Beatrice J; Tijerina, Jonathan; Nazerali, Rahim S; Lee, Gordon K

2018-05-01

In recent years, there has been a push to publish higher level of evidence studies in medicine, particularly in plastic surgery. Well-conducted systematic reviews are considered the strongest level of evidence in medicine, recently becoming the key process indicators for quality delivery. A varying quality of systematic reviews, however, has led to concerns of their validity in clinical decision-making. We perform a quality analysis of systematic reviews published in head and neck microsurgery by the surgical specialties of plastic surgery and otolaryngology. An evaluation of systematic reviews published on microsurgery in 13 high-impact surgical journals was conducted by searching PubMed and Scopus. Two authors independently performed searches, screened for eligibility, and extracted data from included articles. Discrepancies were resolved by discussion and consensus. Assessment of Multiple Systematic Reviews (AMSTAR) criteria were used to assess methodological quality. The initial database search retrieved 166 articles. After removing duplicates, screening titles and abstracts, 26 articles remained for full text review. Seven did not focus on head and neck microsurgery and were further excluded, leaving 19 systematic reviews for final analysis. Of those, 10 systematic reviews were published by otolaryngology, and 9 were published by plastic surgery. Median AMSTAR score was 8 for otolaryngology, 7 for plastic surgery, and 8 overall, reflecting "fair to good" quality. The number of systematic reviews on head and neck microsurgery markedly increased over time. Of note, both the AMSTAR score and the number of systematic reviews published by plastic surgery have steadily increased from 2014 to 2016, whereas those published by otolaryngology have remained relatively stable since 2010. Our review shows a trend toward publishing more systematic reviews. The increasing quantity and quality of systematic reviews published by plastic surgeons indicates recognition in the need for higher levels of evidence in plastic surgery, as well as growing interest and advances in microsurgery. Given these trends, familiarity with quality assessment guidelines, such as AMSTAR, will remain important in providing a basis for building relevant value-based quality measures.

Advancing the discussion about systematic classroom behavioral observation, a product review of Tenny, J. (2010). eCOVE observation software. Pacific City, OR: eCOVE Software, LLC.

PubMed

Froiland, John Mark; Smith, Liana

2014-05-01

Applied child psychologists and behavioral consultants often use systematic behavioral observations to inform the psychological assessment and intervention development process for children referred for attention and hyperactivity problems. This article provides a review of the 2010 version of the eCOVE classroom observation software in terms of its utility in tracking the progress of children with attention and hyperactive behaviors and its use in evaluating teacher behaviors that may impede or promote children's attention and positive behavior. The eCOVE shows promise as an efficient tool for psychologists and behavioral consultants who want to evaluate the effects of interventions for children with symptoms of ADHD, ODD, mood disorders and learning disorders; however, some research-based improvements for future models are suggested. The reviewers also share their firsthand experience in using eCOVE to evaluate teacher and student behavior exhibited on a television show about teaching urban high school students and during a movie about an eccentric new kindergarten teacher. Rich examples are provided of using strategic behavioral observations to reveal how to improve the classroom environment so as to facilitate attention, motivation and positive behavior among youth. Broader implications for enhancing the use of systematic behavioral observations in the assessment of children and adolescents with attention disorders and related behavioral problems are discussed. Key issues are examined such as the use of behavioral observations during psychological consultation to prevent the previously found gender bias in referrals for ADHD. Using behavioral observations to enhance differential diagnosis is also discussed.

A systematic review of team-building interventions in non-acute healthcare settings.

PubMed

Miller, Christopher J; Kim, Bo; Silverman, Allie; Bauer, Mark S

2018-03-01

Healthcare is increasingly delivered in a team-based format emphasizing interdisciplinary coordination. While recent reviews have investigated team-building interventions primarily in acute healthcare settings (e.g. emergency or surgery departments), we aimed to systematically review the evidence base for team-building interventions in non-acute settings (e.g. primary care or rehabilitation clinics). We conducted a systematic review in PubMed and Embase to identify team-building interventions, and conducted follow-up literature searches to identify articles describing empirical studies of those interventions. This process identified 14 team-building interventions for non-acute healthcare settings, and 25 manuscripts describing empirical studies of these interventions. We evaluated outcomes in four domains: trainee evaluations, teamwork attitudes/knowledge, team functioning, and patient impact. Trainee evaluations for team-building interventions were generally positive, but only one study associated team-building with statistically significant improvement in teamwork attitudes/knowledge. Similarly mixed results emerged for team functioning and patient impact. The evidence base for healthcare team-building interventions in non-acute healthcare settings is much less developed than the parallel literature for short-term team function in acute care settings. Only one intervention we identified has been tested in multiple non-acute settings by distinct research teams. Positive findings regarding the utility of team-building interventions are tempered by a lack of control conditions, inconsistency in outcome measures, and high probability of bias. Considering these results alongside the well-recognized costs of poor healthcare teamwork suggests that additional research is sorely needed to develop the evidence base for team-building in non-acute settings.

Students' Evaluation Strategies in a Web Research Task: Are They Sensitive to Relevance and Reliability?

ERIC Educational Resources Information Center

Rodicio, Héctor García

2015-01-01

When searching and using resources on the Web, students have to evaluate Web pages in terms of relevance and reliability. This evaluation can be done in a more or less systematic way, by either considering deep or superficial cues of relevance and reliability. The goal of this study was to examine how systematic students are when evaluating Web…

Use of Geriatric Assessment for Older Adults in the Oncology Setting: A Systematic Review

PubMed Central

2012-01-01

Background Geriatric assessment is a multidisciplinary diagnostic process that evaluates the older adult’s medical, psychological, social, and functional capacity. No systematic review of the use of geriatric assessment in oncology has been conducted. The goals of this systematic review were: 1) to provide an overview of all geriatric assessment instruments used in the oncology setting; 2) to examine the feasibility and psychometric properties of those instruments; and 3) to systematically evaluate the effectiveness of geriatric assessment in predicting or modifying outcomes (including the impact on treatment decision making, toxicity of treatment, and mortality). Methods We searched Medline, Embase, Psychinfo, Cinahl, and the Cochrane Library for articles published in English, French, Dutch, or German between January 1, 1996, and November 16, 2010, reporting on cross-sectional, longitudinal, interventional, or observational studies that assessed the feasibility or effectiveness of geriatric assessment instruments. The quality of articles was evaluated using relevant quality assessment frameworks. Results We identified 83 articles that reported on 73 studies. The quality of most studies was poor to moderate. Eleven studies examined psychometric properties or diagnostic accuracy of the geriatric assessment instruments used. The assessment generally took 10–45min. Geriatric assessment was most often completed to describe a patient’s health and functional status. Specific domains of geriatric assessment were associated with treatment toxicity in 6 of 9 studies and with mortality in 8 of 16 studies. Of the four studies that examined the impact of geriatric assessment on the cancer treatment decision, two found that geriatric assessment impacted 40%–50% of treatment decisions. Conclusion Geriatric assessment in the oncology setting is feasible, and some domains are associated with adverse outcomes. However, there is limited evidence that geriatric assessment impacted treatment decision making. Further research examining the effectiveness of geriatric assessment on treatment decisions and outcomes is needed. PMID:22851269

A systematic review on how to conduct evaluations in community-based rehabilitation.

PubMed

Grandisson, Marie; Hébert, Michèle; Thibeault, Rachel

2014-01-01

Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations.

A systematic review on how to conduct evaluations in community-based rehabilitation

PubMed Central

Hébert, Michèle; Thibeault, Rachel

2014-01-01

Purpose Community-based rehabilitation (CBR) must prove that it is making a significant difference for people with disabilities in low- and middle-income countries. Yet, evaluation is not a common practice and the evidence for its effectiveness is fragmented and largely insufficient. The objective of this article was to review the literature on best practices in program evaluation in CBR in relation to the evaluative process, the frameworks, and the methods of data collection. Method A systematic search was conducted on five rehabilitation databases and the World Health Organization website with keywords associated with CBR and program evaluation. Two independent researchers selected the articles. Results Twenty-two documents were included. The results suggest that (1) the evaluative process needs to be conducted in close collaboration with the local community, including people with disabilities, and to be followed by sharing the findings and taking actions, (2) many frameworks have been proposed to evaluate CBR but no agreement has been reached, and (3) qualitative methodologies have dominated the scene in CBR so far, but their combination with quantitative methods has a lot of potential to better capture the effectiveness of this strategy. Conclusions In order to facilitate and improve evaluations in CBR, there is an urgent need to agree on a common framework, such as the CBR matrix, and to develop best practice guidelines based on the literature available and consensus among a group of experts. These will need to demonstrate a good balance between community development and standards for effective evaluations. Implications for Rehabilitation In the quest for evidence of the effectiveness of community-based rehabilitation (CBR), a shared program evaluation framework would better enable the combination of findings from different studies. The evaluation of CBR programs should always include sharing findings and taking action for the sake of the local community. Although qualitative methodologies have dominated the scene in CBR and remain highly relevant, there is also a call for the inclusion of quantitative indicators in order to capture the progress made by people participating in CBR programs. The production of best practice guidelines for evaluation in CBR could foster accountable and empowering program evaluations that are congruent with the principles at the heart of CBR and the standards for effective evaluations. PMID:23614357

Evaluation of participatory planning: Lessons from Hungarian Natura 2000 management planning processes.

PubMed

Kovács, Eszter; Kelemen, Eszter; Kiss, Gabriella; Kalóczkai, Ágnes; Fabók, Veronika; Mihók, Barbara; Megyesi, Boldizsár; Pataki, György; Bodorkós, Barbara; Balázs, Bálint; Bela, Györgyi; Margóczi, Katalin; Roboz, Ágnes; Molnár, Dániel

2017-12-15

Stakeholder participation in nature conservation policies and especially in the management of protected areas has gained importance in the last decades. These changes are underlined by democratic principles and the perceived contribution of stakeholder involvement to the effectiveness of conservation management. Evaluating participatory processes is essential to learn about the past and thus increase the quality of future processes. The evaluation can be useful for the organisations responsible for planning and management, stakeholders and policy makers as well. The present paper shows the results of a systematic evaluation of 25 participatory processes related to the development of management plans for Natura 2000 sites in Hungary between 2007 and 2015. A conceptual framework was developed to evaluate the process and outcome of participatory management planning processes. Criteria were based on the scientific literature on public participation and tailored to conservation-related management planning and stakeholder involvement. Evaluated processes were grouped in three cases based on their time range and financial sources. Overall, the analysed processes scored at a medium level, showing better performance in the process criteria than in the outcome criteria. The best case scored significantly higher in four criteria compared to the other cases: representativeness, resource availability for facilitation, new, creative ideas and impact on the plan. The main factors behind the success were (1) embeddedness of the planning process in a larger project, where the plan was a tool for conservation, (2) carrying out only one process at a time, (3) previous experience of facilitators and planners with participatory planning and (4) the opportunity and capacity to propose a payment scheme as an incentive. But even this case received low scores in some criteria: conflict resolution, early involvement and well defined goals. Based on the results we suggest that more data is needed to evaluate the implementation of the plans and, in many cases, the impact of the process on the plan. Performance can be improved with the assistance of policy makers by further developing guidelines, harmonising payment schemes with the conservation measures of the plans and providing training on conflict resolution. The evaluation framework proved to be suitable for the assessment of a large set of conservation related management planning processes, but it also had some limitations, e.g. concerning the incorporation of stakeholders' views in the evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Victim Satisfaction With the Criminal Justice System and Emotional Recovery: A Systematic and Critical Review of the Literature.

PubMed

Kunst, Maarten; Popelier, Lieke; Varekamp, Ellen

2015-07-01

The current study systematically and critically reviewed the empirical literature to evaluate the association between satisfaction with the criminal justice system and adult crime victims' emotional recovery. Despite the widely accepted notion that involvement in the criminal justice system may impact recovery from crime victimization--either beneficially or maliciously--a systematic review of empirical studies that addresses this topic has never been conducted. Electronic literature databases (ISI Web of Knowledge [including Web of Science and MEDLINE], EBSCO host [including PsychInfo, CINAHL, Criminal Justice Abstracts, ERIC, PsychARTICLES, and Psychology and Behavioral Sciences Collection], and ProQuest [including PILOTS, Social Services Abstracts, and Sociological Abstracts]) were searched to identify relevant quantitative studies. The Cambridge Quality Checklists were used to evaluate the quality of selected studies. These checklists can be used to assess the quality of risk and protective factors in criminal justice research. In this study they were used to explore the impact of victim satisfaction on crime victims' emotional and cognitive states post-victimization. The review process revealed mixed results, with some studies suggesting a healing impact of victim satisfaction and others not. More consistent were findings regarding the existence of an association between victim satisfaction and (alterations in) positive cognitions. However, since the majority of studies suffered from severe methodological shortcomings, definite conclusions cannot be drawn yet. © The Author(s) 2014.

A systematic approach for the development of a kindergarten-based intervention for the prevention of obesity in preschool age children: the ToyBox-study.

PubMed

Manios, Y; Grammatikaki, E; Androutsos, O; Chinapaw, M J M; Gibson, E L; Buijs, G; Iotova, V; Socha, P; Annemans, L; Wildgruber, A; Mouratidou, T; Yngve, A; Duvinage, K; de Bourdeaudhuij, I

2012-03-01

The increasing childhood obesity epidemic calls for appropriate measures and effective policies to be applied early in life. Large-scale socioecological frameworks providing a holistic multifactorial and cost-effective approach necessary to support obesity prevention initiatives in this age are however currently missing. To address this missing link, ToyBox-study aims to build and evaluate a cost-effective kindergarten-based, family-involved intervention scheme to prevent obesity in early childhood, which could potentially be expanded on a pan-European scale. A multidisciplinary team of researchers from 10 countries have joined forces and will work to realize this according to a systematic stepwise approach that combines the use of the PRECEDE-PROCEED model and intervention mapping protocol. ToyBox-study will conduct systematic and narrative reviews, secondary data analyses, focus group research and societal assessment to design, implement and evaluate outcome, impact, process and cost effectiveness of the intervention. This is the first time that such a holistic approach has been used on a pan-European scale to promote healthy weight and healthy energy balance-related behaviours for the prevention of early childhood obesity. The results of ToyBox-study will be disseminated among key stakeholders including researchers, policy makers, practitioners and the general population. © 2012 The Authors. obesity reviews © 2012 International Association for the Study of Obesity.

Translating evidence into practice: pursuing perfection in pneumococcal vaccination in a rural community.

PubMed

Doyle, D M; Dauterive, R; Chuang, K H; Ellrodt, A G

2001-11-01

There are many challenges to effectively and efficiently translating evidence into practice. Potential strategies include (1) training more evidence-based practitioners in the art and science of evidence-based medicine, (2) enhancing the quality and availability of systematic reviews, and (3) more effectively linking evidence-based practitioners and evidence users through comprehensive behavioral change initiatives. Herein we explore the third strategy and highlight the key elements of success for a program using behavioral change strategies. We present a clinical model based on clear understanding of the "problem," a systematic approach to diagnosis, selection of scientifically sound treatment options, and effective evaluation with appropriate modification of the treatment plan. A successful program begins with effective team leadership, the expression of a clinically compelling case for change, and commitment to the pursuit of perfection in the delivery of key evidence-based interventions. The team must then diagnose behavioral barriers to change, using a systematic approach based on a published rigorous differential diagnosis framework. This diagnostic step provides the foundation for selection of effective dissemination and implementation strategies (treatments) proven to improve processes of care and clinical outcomes. Finally the team must evaluate progress toward perfection, reviewing interim data and adjusting the treatment regimen to newly diagnosed barriers. We then present a specific project (improving pneumococcal immunization rates in our rural community) and interim results to demonstrate the use of the framework in the real world.

Comprehensive evaluation on low-carbon development of coal enterprise groups.

PubMed

Wang, Bang-Jun; Wu, Yan-Fang; Zhao, Jia-Lu

2017-12-19

Scientifically evaluating the level of low-carbon development in terms of theoretical and practical significance is extremely important to coal enterprise groups for implementing national energy-related systems. This assessment can assist in building institutional mechanisms that are conducive for the economic development of coal business cycle and energy conservation as well as promoting the healthy development of coal enterprises to realize coal scientific development and resource utilization. First, by adopting systematic analysis method, this study builds low-carbon development evaluation index system for coal enterprise groups. Second, to determine the weight serving as guideline and criteria of the index, analytic hierarchy process (AHP) is applied using integrated linear weighted sum method to evaluate the level of low-carbon development of coal enterprise groups. Evaluation is also performed by coal enterprise groups, and the process comprises field analysis and evaluation. Finally, industrial policies are proposed regarding the development of low-carbon coal conglomerate strategies and measures. This study aims mainly to guide the low-carbon development of coal enterprise groups, solve the problem of coal mining and the destruction of ecological environment, support the conservation of raw materials and various resources, and achieve the sustainable development of the coal industry.

Maintenance = reuse-oriented software development

NASA Technical Reports Server (NTRS)

Basili, Victor R.

1989-01-01

Maintenance is viewed as a reuse process. In this context, a set of models that can be used to support the maintenance process is discussed. A high level reuse framework is presented that characterizes the object of reuse, the process for adapting that object for its target application, and the reused object within its target application. Based upon this framework, a qualitative comparison is offered of the three maintenance process models with regard to their strengths and weaknesses and the circumstances in which they are appropriate. To provide a more systematic, quantitative approach for evaluating the appropriateness of the particular maintenance model, a measurement scheme is provided, based upon the reuse framework, in the form of an organized set of questions that need to be answered. To support the reuse perspective, a set of reuse enablers are discussed.

Audit of the internal controls over the processing of oil overcharge refunds

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-03-31

This report is on internal controls over the processing of oil overcharge refunds. The Office of Hearings and Appeals administers the distribution of refunds to parties that were overcharged during the period of petroleum price controls. The refund process was initiated in 1979. As of September 30, 1991, Hearings and Appeals had received over 200,000 applications for refunds. It had granted refunds with a total value of more than 600 million on about 160,000 applications, with 26,636 applications pending. The objectie of the audit was to evaluate the adequacy of Hearings and Appeals' internal controls over refund practices and procedures,more » specifically those used to ensure that claims approved were complete, systematically processed, and properly distributed.« less

Audit of the internal controls over the processing of oil overcharge refunds

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1992-03-31

This report is on internal controls over the processing of oil overcharge refunds. The Office of Hearings and Appeals administers the distribution of refunds to parties that were overcharged during the period of petroleum price controls. The refund process was initiated in 1979. As of September 30, 1991, Hearings and Appeals had received over 200,000 applications for refunds. It had granted refunds with a total value of more than 600 million on about 160,000 applications, with 26,636 applications pending. The objectie of the audit was to evaluate the adequacy of Hearings and Appeals` internal controls over refund practices and procedures,more » specifically those used to ensure that claims approved were complete, systematically processed, and properly distributed.« less